[2025-10-16T17:00:01.467962] [INFO ] [MAIN ] Using last completed trading day: 2025-10-16 [2025-10-16T17:00:01.650204] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-16T17:00:01.650388] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-16T17:00:01.863037] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-16T17:00:01.863347] [WARN ] [STATE ] State set to: RUNNING [2025-10-16T17:00:01.863423] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-16T17:00:01.863466] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-16T17:00:01.863547] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-16T17:00:01.863581] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-16T17:00:03.636186] [DEBUG] [SYMBOL ] Found 2421 valid NYSE symbols. [2025-10-16T17:00:03.636475] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-16T17:00:03.636789] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-16T17:00:03.637384] [INFO ] [LOCAL ] Symbols cache updated with 2369 symbols. [2025-10-16T17:00:03.637445] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-16T17:00:03.637479] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-16T17:00:03.637545] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-16T17:00:03.637579] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-16T17:00:03.637609] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-16T17:00:03.638040] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-10-16T17:00:03.638093] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-16T17:00:03.638254] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-16T17:00:03.638290] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2369 valid symbols. [2025-10-16T17:00:03.638322] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-16T17:00:03.638354] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-16T17:00:03.660747] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-16T17:00:03.684634] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-16T17:00:03.684948] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-16T17:00:03.684991] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-16T17:00:03.685024] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-16T17:00:03.685097] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-16T17:00:03.685590] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-10-16T17:00:03.685691] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-16T17:00:03.685762] [INFO ] [MAIN ] Starting incremental update for 2369 symbols. [2025-10-16T17:00:03.685825] [INFO ] [MAIN ] Running in parallel mode [2025-10-16T17:00:03.686102] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2369 symbols [2025-10-16T17:00:04.348962] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:04.394553] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:04.439436] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:04.445923] [DEBUG] [LOCAL ] AA: No existing data file found in primary storage. [2025-10-16T17:00:04.454708] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-16T17:00:04.454800] [WARN ] [MAIN ] AA: No existing data found, performing full refresh instead. [2025-10-16T17:00:04.454951] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-16T17:00:04.472687] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-16T17:00:04.472579] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:04.473035] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-16T17:00:04.473260] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-16T17:00:04.473163] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-16T17:00:04.473592] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-10-16T17:00:04.473465] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-16T17:00:04.473358] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-16T17:00:04.473735] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-16T17:00:04.473950] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-16T17:00:04.485491] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-16T17:00:04.473876] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-16T17:00:04.597226] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-16T17:00:04.677329] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-16T17:00:04.680722] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-16T17:00:05.063479] [DEBUG] [LOCAL ] A: Loaded 50779 existing records from primary storage. [2025-10-16T17:00:05.162596] [INFO ] [MAIN ] A: Loaded 50779 existing records. [2025-10-16T17:00:05.478321] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:05.542682] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-16T17:00:05.659013] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:05.676046] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-16T17:00:05.800503] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:05.808678] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-16T17:00:05.829193] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:05.830423] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-16T17:00:05.830478] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-16T17:00:05.830884] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-16T17:00:05.830943] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-16T17:00:06.121072] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-16T17:00:06.111533] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:00:06.125984] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-16T17:00:06.136997] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-16T17:00:06.166512] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:00:06.185973] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-16T17:00:06.209557] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:00:06.209464] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:06.210011] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-16T17:00:06.210369] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-16T17:00:06.211275] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-16T17:00:06.211348] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-16T17:00:06.211394] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-16T17:00:06.211441] [INFO ] [MAIN ] Update Progress: 1/2369 symbols completed. AAMI took 2.4s. Estimated remaining: 1h 39m 40s. Rate: 23.8 symbols/min [2025-10-16T17:00:06.391027] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:06.445145] [DEBUG] [LOCAL ] AAP: Loaded 51846 existing records from primary storage. [2025-10-16T17:00:06.445458] [INFO ] [MAIN ] AAP: Loaded 51846 existing records. [2025-10-16T17:00:06.548248] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-16T17:00:06.555049] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-16T17:00:06.629217] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:06.629406] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-16T17:00:06.629460] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-16T17:00:06.630578] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-16T17:00:06.630670] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-16T17:00:06.999985] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:07.000314] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-16T17:00:07.060694] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-16T17:00:07.061739] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-16T17:00:07.391409] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-16T17:00:07.392361] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-16T17:00:07.654070] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-16T17:00:07.659798] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-16T17:00:07.663117] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-16T17:00:07.679935] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-16T17:00:08.021163] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-16T17:00:08.022106] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-16T17:00:08.062307] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T17:00:08.072317] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-16T17:00:08.254596] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-16T17:00:08.255899] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-16T17:00:08.599297] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-16T17:00:08.600358] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-16T17:00:08.630739] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T17:00:08.641419] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-16T17:00:09.001248] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-16T17:00:09.002358] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-16T17:00:09.241713] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-16T17:00:09.242587] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-16T17:00:09.564810] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T17:00:09.574602] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-16T17:00:09.592119] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-16T17:00:09.593208] [INFO ] [REMOTE ] AAM: Full fetch complete (926 records). [2025-10-16T17:00:09.593481] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-16T17:00:09.593908] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:00:09.593991] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:00:09.594036] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:00:09.594100] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-16T17:00:09.594163] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-16T17:00:09.594202] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-16T17:00:09.594242] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-16T17:00:09.603626] [INFO ] [MAIN ] Update Progress: 2/2369 symbols completed. AAM took 5.8s. Estimated remaining: 1h 56m 44s. Rate: 20.3 symbols/min [2025-10-16T17:00:09.688743] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T17:00:09.728449] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-16T17:00:09.817611] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:09.850368] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T17:00:09.863344] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-16T17:00:09.887940] [DEBUG] [LOCAL ] AAT: Loaded 30450 existing records from primary storage. [2025-10-16T17:00:09.888219] [INFO ] [MAIN ] AAT: Loaded 30450 existing records. [2025-10-16T17:00:10.096259] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:10.096499] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-16T17:00:10.096550] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-16T17:00:10.097358] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-16T17:00:10.097422] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-16T17:00:10.632280] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:10.632696] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-16T17:00:10.914195] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-16T17:00:10.929156] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-16T17:00:11.382570] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T17:00:11.393125] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-16T17:00:11.660715] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-16T17:00:11.671021] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-16T17:00:11.905213] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T17:00:11.911147] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-16T17:00:12.379093] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T17:00:12.391603] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-16T17:00:12.897631] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T17:00:12.908840] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-16T17:00:13.050611] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T17:00:13.056117] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-16T17:00:13.491409] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T17:00:13.505327] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-16T17:00:13.989943] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-16T17:00:14.001861] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-16T17:00:14.521994] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T17:00:14.527759] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-16T17:00:14.809161] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T17:00:14.823542] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-16T17:00:15.308670] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T17:00:15.321162] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-16T17:00:15.549410] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T17:00:15.561704] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-16T17:00:15.860159] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T17:00:15.866587] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-16T17:00:16.268050] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T17:00:16.281330] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-16T17:00:17.261857] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T17:00:17.274736] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-16T17:00:17.493544] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-16T17:00:17.504796] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-16T17:00:17.888534] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T17:00:17.899581] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-16T17:00:19.167477] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (3.30 seconds). [2025-10-16T17:00:19.176080] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-16T17:00:19.316698] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-16T17:00:19.327828] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-16T17:00:19.771458] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-16T17:00:19.784998] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-16T17:00:19.932840] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-16T17:00:19.948117] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-16T17:00:20.434679] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T17:00:20.441347] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-16T17:00:20.950609] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T17:00:20.961910] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-16T17:00:21.416965] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-16T17:00:21.423592] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-16T17:00:21.510962] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T17:00:21.522972] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-16T17:00:21.635137] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T17:00:21.647894] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-16T17:00:22.581422] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T17:00:22.595324] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-16T17:00:22.817468] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T17:00:22.825096] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-16T17:00:23.043089] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T17:00:23.054192] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-16T17:00:23.312187] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T17:00:23.324565] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-16T17:00:23.717046] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T17:00:23.724704] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-16T17:00:24.421598] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-16T17:00:24.431268] [INFO ] [REMOTE ] A: Full fetch complete (73471 records). [2025-10-16T17:00:24.431513] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-16T17:00:24.793197] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T17:00:24.837340] [INFO ] [REMOTE ] AAP: Full fetch complete (75218 records). [2025-10-16T17:00:24.857212] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-16T17:00:24.960445] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T17:00:24.966178] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-16T17:00:24.972234] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-16T17:00:25.017289] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-16T17:00:25.004902] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-16T17:00:25.023700] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-16T17:00:25.173505] [DEBUG] [LOCAL ] A: Trimmed 73471 records to 51164 (keeping 200 days of data) [2025-10-16T17:00:25.471133] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-16T17:00:25.472579] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-16T17:00:25.478343] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-16T17:00:25.478782] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-16T17:00:25.591225] [DEBUG] [LOCAL ] AAP: Trimmed 75218 records to 52218 (keeping 200 days of data) [2025-10-16T17:00:25.728207] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-16T17:00:25.774355] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-16T17:00:25.884697] [DEBUG] [LOCAL ] A: Primary data saved (51164 records). [2025-10-16T17:00:25.887635] [INFO ] [MAIN ] A: Full history saved. [2025-10-16T17:00:25.888360] [INFO ] [MAIN ] Update Progress: 3/2369 symbols completed. A took 22.2s. Estimated remaining: 4h 51m 50s. Rate: 8.1 symbols/min [2025-10-16T17:00:26.184116] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:26.194087] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-16T17:00:26.194711] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-16T17:00:26.196912] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-16T17:00:26.201590] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-16T17:00:26.201721] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-16T17:00:26.201782] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-16T17:00:26.382394] [DEBUG] [LOCAL ] AAP: Primary data saved (52218 records). [2025-10-16T17:00:26.387280] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-16T17:00:26.414528] [INFO ] [MAIN ] Update Progress: 4/2369 symbols completed. AAP took 20.2s. Estimated remaining: 3h 43m 58s. Rate: 10.6 symbols/min [2025-10-16T17:00:26.457492] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T17:00:26.580342] [INFO ] [REMOTE ] AAT: Full fetch complete (42964 records). [2025-10-16T17:00:26.633108] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-16T17:00:26.868337] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:26.885937] [DEBUG] [LOCAL ] AB: No existing data file found in primary storage. [2025-10-16T17:00:26.942189] [WARN ] [MAIN ] AB: No existing data found, performing full refresh instead. [2025-10-16T17:00:26.955279] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-16T17:00:26.955036] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:26.955482] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-16T17:00:26.966396] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-16T17:00:26.971566] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-16T17:00:26.976800] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-16T17:00:27.271383] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:00:27.316567] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-16T17:00:27.381424] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:00:27.396520] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-16T17:00:27.479414] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:00:27.545330] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-16T17:00:27.556891] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-16T17:00:27.557707] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-16T17:00:27.557225] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-16T17:00:27.558211] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-16T17:00:27.563769] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-16T17:00:27.563603] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-16T17:00:27.569166] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-16T17:00:27.569244] [INFO ] [MAIN ] Update Progress: 5/2369 symbols completed. AAUC took 1.7s. Estimated remaining: 3h 8m 12s. Rate: 12.6 symbols/min [2025-10-16T17:00:27.657528] [DEBUG] [LOCAL ] AAT: Trimmed 42964 records to 30661 (keeping 200 days of data) [2025-10-16T17:00:27.743813] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:27.754625] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-16T17:00:27.929351] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:27.936773] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-10-16T17:00:27.940364] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-10-16T17:00:27.948430] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-16T17:00:27.950983] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-16T17:00:27.951162] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-16T17:00:27.952928] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-16T17:00:28.099380] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-16T17:00:28.136964] [INFO ] [REMOTE ] AA: Full fetch complete (77723 records). [2025-10-16T17:00:28.150949] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-16T17:00:28.231033] [DEBUG] [LOCAL ] AAT: Primary data saved (30661 records). [2025-10-16T17:00:28.313553] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-16T17:00:28.385527] [INFO ] [MAIN ] Update Progress: 6/2369 symbols completed. AAT took 18.8s. Estimated remaining: 2h 42m 8s. Rate: 14.6 symbols/min [2025-10-16T17:00:28.972057] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:28.986326] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-16T17:00:28.980587] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:29.075360] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-16T17:00:29.075739] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-16T17:00:29.076747] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-16T17:00:29.076961] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-16T17:00:29.079087] [DEBUG] [LOCAL ] AA: Trimmed 77723 records to 54011 (keeping 200 days of data) [2025-10-16T17:00:29.197980] [DEBUG] [LOCAL ] ABCB: Loaded 30489 existing records from primary storage. [2025-10-16T17:00:29.200556] [INFO ] [MAIN ] ABCB: Loaded 30489 existing records. [2025-10-16T17:00:29.391843] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:29.394613] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-16T17:00:29.394746] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-16T17:00:29.399204] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-16T17:00:29.405634] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-16T17:00:29.471522] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T17:00:29.599879] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-16T17:00:29.918177] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:29.919372] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-16T17:00:30.018312] [DEBUG] [LOCAL ] AA: Primary data saved (54011 records). [2025-10-16T17:00:30.018469] [INFO ] [MAIN ] AA: Full history saved. [2025-10-16T17:00:30.020219] [INFO ] [MAIN ] Update Progress: 7/2369 symbols completed. AA took 26.3s. Estimated remaining: 2h 28m 6s. Rate: 15.9 symbols/min [2025-10-16T17:00:30.200460] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:30.250619] [DEBUG] [LOCAL ] ABEV: Loaded 53278 existing records from primary storage. [2025-10-16T17:00:30.251012] [INFO ] [MAIN ] ABEV: Loaded 53278 existing records. [2025-10-16T17:00:30.432811] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:30.433055] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-16T17:00:30.433102] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-16T17:00:30.433937] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-16T17:00:30.433994] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-16T17:00:30.803115] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:30.803891] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-16T17:00:30.840037] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T17:00:30.851097] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-16T17:00:30.970341] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T17:00:30.978056] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-16T17:00:31.012692] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T17:00:31.019423] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-16T17:00:31.846362] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-16T17:00:31.853207] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-16T17:00:32.421151] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T17:00:32.430406] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-16T17:00:32.506809] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T17:00:32.518281] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-16T17:00:32.668704] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T17:00:32.674812] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-16T17:00:32.827395] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-16T17:00:32.838084] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-16T17:00:33.786218] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-16T17:00:33.796200] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-16T17:00:33.886565] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T17:00:33.893777] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-16T17:00:33.981833] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T17:00:33.992125] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-16T17:00:34.790280] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-16T17:00:34.801033] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-16T17:00:34.965195] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T17:00:34.975143] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-16T17:00:35.282985] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T17:00:35.291304] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-16T17:00:35.921820] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-16T17:00:35.926300] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-16T17:00:35.938594] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-16T17:00:35.940075] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-16T17:00:36.145389] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T17:00:36.151677] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-16T17:00:36.637186] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T17:00:36.648424] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-16T17:00:36.661238] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T17:00:36.666001] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-16T17:00:36.865276] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T17:00:36.870928] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-16T17:00:37.363091] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T17:00:37.374213] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-16T17:00:37.798293] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T17:00:37.804674] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-16T17:00:37.935980] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T17:00:37.943318] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-16T17:00:38.507327] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-16T17:00:38.544605] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-16T17:00:38.546027] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T17:00:38.559576] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-16T17:00:38.780813] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T17:00:38.787883] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-16T17:00:38.947592] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T17:00:38.959041] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-16T17:00:39.778907] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T17:00:39.785013] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-16T17:00:40.183582] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T17:00:40.195878] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-16T17:00:40.634749] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-16T17:00:40.656730] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-16T17:00:40.659563] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T17:00:40.663956] [INFO ] [REMOTE ] AB: Full fetch complete (44477 records). [2025-10-16T17:00:40.664114] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-16T17:00:41.127811] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-16T17:00:41.126266] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-16T17:00:41.127953] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-16T17:00:41.139515] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-16T17:00:41.139626] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-16T17:00:41.140628] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-16T17:00:41.142097] [DEBUG] [LOCAL ] AB: Trimmed 44477 records to 25663 (keeping 200 days of data) [2025-10-16T17:00:41.337987] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T17:00:41.344417] [DEBUG] [LOCAL ] AB: Primary data saved (25663 records). [2025-10-16T17:00:41.344737] [INFO ] [MAIN ] AB: Full history saved. [2025-10-16T17:00:41.344849] [INFO ] [MAIN ] Update Progress: 8/2369 symbols completed. AB took 14.9s. Estimated remaining: 3h 5m 14s. Rate: 12.7 symbols/min [2025-10-16T17:00:41.344971] [INFO ] [REMOTE ] ABCB: Full fetch complete (44830 records). [2025-10-16T17:00:41.357106] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-16T17:00:41.660560] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:41.847563] [DEBUG] [LOCAL ] ABG: Loaded 18383 existing records from primary storage. [2025-10-16T17:00:41.853742] [INFO ] [MAIN ] ABG: Loaded 18383 existing records. [2025-10-16T17:00:42.056563] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-16T17:00:42.066942] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-16T17:00:42.072749] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-16T17:00:42.096702] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-16T17:00:42.131325] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:42.131920] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-16T17:00:42.132048] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-16T17:00:42.132458] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-16T17:00:42.132526] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-16T17:00:42.165042] [DEBUG] [LOCAL ] ABCB: Trimmed 44830 records to 30801 (keeping 200 days of data) [2025-10-16T17:00:42.628450] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:42.630805] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-16T17:00:42.711269] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-16T17:00:42.743139] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-16T17:00:42.760224] [DEBUG] [LOCAL ] ABCB: Primary data saved (30801 records). [2025-10-16T17:00:42.760856] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-16T17:00:42.760968] [INFO ] [MAIN ] Update Progress: 9/2369 symbols completed. ABCB took 14.3s. Estimated remaining: 2h 50m 46s. Rate: 13.8 symbols/min [2025-10-16T17:00:42.933405] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:42.933661] [DEBUG] [LOCAL ] ABM: No existing data file found in primary storage. [2025-10-16T17:00:42.933726] [WARN ] [MAIN ] ABM: No existing data found, performing full refresh instead. [2025-10-16T17:00:42.933919] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-16T17:00:42.933991] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-16T17:00:42.934144] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-16T17:00:42.934240] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-16T17:00:43.260540] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-16T17:00:43.327020] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-16T17:00:43.359013] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:43.359424] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-16T17:00:43.702917] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T17:00:43.706202] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-16T17:00:44.405223] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-16T17:00:44.411279] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-16T17:00:44.911708] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-16T17:00:44.924593] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-16T17:00:44.938136] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-16T17:00:44.943095] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-16T17:00:45.003245] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T17:00:45.015018] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-16T17:00:45.364256] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T17:00:45.370348] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-16T17:00:46.095687] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T17:00:46.099979] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-16T17:00:46.177980] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T17:00:46.183160] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-16T17:00:46.475668] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T17:00:46.487508] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-16T17:00:46.881365] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T17:00:46.894610] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-16T17:00:47.278802] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T17:00:47.285864] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-16T17:00:47.316390] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T17:00:47.322178] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-16T17:00:48.372322] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T17:00:48.380741] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-16T17:00:48.435590] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-16T17:00:48.442607] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-16T17:00:48.601528] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-16T17:00:48.613035] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-16T17:00:48.680513] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T17:00:48.692346] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-16T17:00:49.356455] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T17:00:49.363374] [INFO ] [REMOTE ] ABBV: Full fetch complete (77456 records). [2025-10-16T17:00:49.363527] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-16T17:00:49.377890] [FATAL] [VALIDATOR ] ABBV: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:00:49.378120] [FATAL] [MAIN ] ABBV: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:00:49.378222] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:00:49.379364] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T17:00:49.378878] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-16T17:00:49.384559] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-16T17:00:49.385080] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-10-16T17:00:49.385369] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-16T17:00:49.385451] [DEBUG] [LOCAL ] ABBV: No derivative data file found to delete. [2025-10-16T17:00:49.386263] [INFO ] [MAIN ] Update Progress: 10/2369 symbols completed. ABBV took 21.8s. Estimated remaining: 2h 59m 41s. Rate: 13.1 symbols/min [2025-10-16T17:00:49.452397] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T17:00:49.497939] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-16T17:00:49.579156] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:49.628638] [DEBUG] [LOCAL ] ABR: Loaded 51966 existing records from primary storage. [2025-10-16T17:00:49.628987] [INFO ] [MAIN ] ABR: Loaded 51966 existing records. [2025-10-16T17:00:49.805605] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:49.805813] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-16T17:00:49.805871] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-16T17:00:49.806073] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-16T17:00:49.806129] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-16T17:00:50.154855] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:50.155201] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-16T17:00:50.166735] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-16T17:00:50.170726] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-16T17:00:50.418850] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T17:00:50.425667] [INFO ] [REMOTE ] ABEV: Full fetch complete (77353 records). [2025-10-16T17:00:50.425787] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-16T17:00:50.845796] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-16T17:00:50.847410] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T17:00:50.846396] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-16T17:00:50.859761] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-16T17:00:50.861516] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-16T17:00:50.860750] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-16T17:00:50.870704] [DEBUG] [LOCAL ] ABEV: Trimmed 77353 records to 53668 (keeping 200 days of data) [2025-10-16T17:00:50.879468] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-16T17:00:50.948068] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-16T17:00:51.201203] [DEBUG] [LOCAL ] ABEV: Primary data saved (53668 records). [2025-10-16T17:00:51.201337] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-16T17:00:51.201414] [INFO ] [MAIN ] Update Progress: 11/2369 symbols completed. ABEV took 21.2s. Estimated remaining: 2h 49m 46s. Rate: 13.9 symbols/min [2025-10-16T17:00:51.367402] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:51.416518] [DEBUG] [LOCAL ] ABT: Loaded 53621 existing records from primary storage. [2025-10-16T17:00:51.416842] [INFO ] [MAIN ] ABT: Loaded 53621 existing records. [2025-10-16T17:00:51.593605] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:51.593835] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-16T17:00:51.593901] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-16T17:00:51.594138] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-16T17:00:51.594193] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-16T17:00:51.943632] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:51.943913] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-16T17:00:52.079212] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T17:00:52.089337] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-16T17:00:52.137095] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T17:00:52.141495] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-16T17:00:52.423839] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T17:00:52.431011] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-16T17:00:52.826343] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-16T17:00:52.830338] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-16T17:00:53.454025] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T17:00:53.464616] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-16T17:00:53.687430] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T17:00:53.689968] [INFO ] [REMOTE ] ABG: Full fetch complete (26661 records). [2025-10-16T17:00:53.690046] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-16T17:00:53.824461] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:00:53.920415] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-16T17:00:54.145390] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-16T17:00:54.174888] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-16T17:00:54.175484] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-16T17:00:54.177132] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-16T17:00:54.176585] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-16T17:00:54.177313] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-16T17:00:54.179828] [DEBUG] [LOCAL ] ABG: Trimmed 26661 records to 18453 (keeping 200 days of data) [2025-10-16T17:00:54.286865] [DEBUG] [LOCAL ] ABG: Primary data saved (18453 records). [2025-10-16T17:00:54.287021] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-16T17:00:54.287102] [INFO ] [MAIN ] Update Progress: 12/2369 symbols completed. ABG took 12.9s. Estimated remaining: 2h 45m 39s. Rate: 14.2 symbols/min [2025-10-16T17:00:54.458670] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:54.480539] [DEBUG] [LOCAL ] ACA: Loaded 22955 existing records from primary storage. [2025-10-16T17:00:54.480851] [INFO ] [MAIN ] ACA: Loaded 22955 existing records. [2025-10-16T17:00:54.671300] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:54.671579] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-16T17:00:54.671677] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-16T17:00:54.671891] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-16T17:00:54.671950] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-16T17:00:55.032780] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:55.033219] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-16T17:00:55.495438] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-16T17:00:55.506609] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-16T17:00:55.593955] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T17:00:55.606386] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-16T17:00:55.642695] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T17:00:55.652605] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-16T17:00:55.840568] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-16T17:00:55.845046] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-16T17:00:56.594171] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T17:00:56.609900] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T17:00:56.610556] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-16T17:00:56.615616] [INFO ] [REMOTE ] ABM: Full fetch complete (44951 records). [2025-10-16T17:00:56.615746] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-16T17:00:56.997081] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-16T17:00:56.997160] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-16T17:00:56.997679] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-16T17:00:56.997764] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-16T17:00:56.998771] [DEBUG] [LOCAL ] ABM: Trimmed 44951 records to 32403 (keeping 200 days of data) [2025-10-16T17:00:57.191019] [DEBUG] [LOCAL ] ABM: Primary data saved (32403 records). [2025-10-16T17:00:57.191151] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-16T17:00:57.191221] [INFO ] [MAIN ] Update Progress: 13/2369 symbols completed. ABM took 14.4s. Estimated remaining: 2h 41m 37s. Rate: 14.6 symbols/min [2025-10-16T17:00:57.370337] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:57.399860] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-16T17:00:57.410237] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-16T17:00:57.437996] [DEBUG] [LOCAL ] ACCO: Loaded 37070 existing records from primary storage. [2025-10-16T17:00:57.438264] [INFO ] [MAIN ] ACCO: Loaded 37070 existing records. [2025-10-16T17:00:57.632119] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:57.632843] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-16T17:00:57.633191] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-16T17:00:57.646185] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-16T17:00:57.646601] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T17:00:57.646778] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-16T17:00:57.706351] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-16T17:00:58.025425] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:58.042915] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-16T17:00:58.055233] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-16T17:00:58.066406] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-16T17:00:59.004706] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T17:00:59.003193] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T17:00:59.022605] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-16T17:00:59.022365] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-16T17:00:59.171192] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T17:00:59.178728] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-16T17:00:59.473873] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T17:00:59.485254] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-16T17:01:00.194875] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T17:01:00.200946] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-16T17:01:00.432175] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T17:01:00.439731] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-16T17:01:00.671129] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T17:01:00.742807] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-16T17:01:01.032214] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T17:01:01.358397] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T17:01:01.478594] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T17:01:01.542774] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-16T17:01:02.325351] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T17:01:02.342771] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-16T17:01:03.144044] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T17:01:03.142975] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-16T17:01:03.754544] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T17:01:03.942824] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-16T17:01:04.577420] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T17:01:04.742817] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-16T17:01:05.292709] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T17:01:05.542799] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-16T17:01:05.576436] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-16T17:01:06.342846] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-16T17:01:07.109885] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T17:01:07.142839] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-16T17:01:07.867350] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T17:01:07.942835] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-16T17:01:08.713929] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T17:01:08.742772] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-16T17:01:09.446977] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T17:01:09.542816] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-16T17:01:10.100842] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T17:01:10.342859] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-16T17:01:11.049982] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T17:01:11.142856] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-16T17:01:11.942813] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-16T17:01:12.455053] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-16T17:01:12.483884] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T17:01:12.742825] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-16T17:01:13.034235] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-16T17:01:13.542808] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-16T17:01:13.840269] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T17:01:14.342862] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-16T17:01:15.142898] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-16T17:01:15.506089] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-16T17:01:15.525931] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T17:01:15.529562] [INFO ] [REMOTE ] ACA: Full fetch complete (34089 records). [2025-10-16T17:01:15.529850] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-16T17:01:15.530857] [FATAL] [VALIDATOR ] ACA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:01:15.530971] [FATAL] [MAIN ] ACA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:01:15.531051] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:01:15.531161] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-16T17:01:15.531264] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-16T17:01:15.531341] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-10-16T17:01:15.532153] [DEBUG] [LOCAL ] ACA: Deleted derivative data file. [2025-10-16T17:01:15.532288] [INFO ] [MAIN ] Update Progress: 14/2369 symbols completed. ACA took 21.2s. Estimated remaining: 3h 21m 26s. Rate: 11.7 symbols/min [2025-10-16T17:01:15.710527] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:01:15.737481] [DEBUG] [LOCAL ] ACEL: Loaded 26736 existing records from primary storage. [2025-10-16T17:01:15.737798] [INFO ] [MAIN ] ACEL: Loaded 26736 existing records. [2025-10-16T17:01:15.917223] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:01:15.917445] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-16T17:01:15.917497] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-16T17:01:15.917764] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-16T17:01:15.917822] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-16T17:01:15.949296] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-16T17:01:16.317464] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:01:16.642338] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T17:01:16.742844] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-16T17:01:17.542849] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-16T17:01:17.627626] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T17:01:17.636116] [INFO ] [REMOTE ] ABR: Full fetch complete (75436 records). [2025-10-16T17:01:17.636435] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-16T17:01:18.089083] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-16T17:01:18.089316] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-16T17:01:18.090262] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-16T17:01:18.090330] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-16T17:01:18.091868] [DEBUG] [LOCAL ] ABR: Trimmed 75436 records to 52354 (keeping 200 days of data) [2025-10-16T17:01:18.204564] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T17:01:18.342814] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-16T17:01:18.436472] [DEBUG] [LOCAL ] ABR: Primary data saved (52354 records). [2025-10-16T17:01:18.436617] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-16T17:01:18.436730] [INFO ] [MAIN ] Update Progress: 15/2369 symbols completed. ABR took 29.1s. Estimated remaining: 3h 15m 31s. Rate: 12.0 symbols/min [2025-10-16T17:01:18.605932] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:01:18.606107] [DEBUG] [LOCAL ] ACHR: No existing data file found in primary storage. [2025-10-16T17:01:18.606144] [WARN ] [MAIN ] ACHR: No existing data found, performing full refresh instead. [2025-10-16T17:01:18.606256] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-16T17:01:18.606297] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-16T17:01:18.606337] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-16T17:01:18.606367] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-16T17:01:18.962175] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:01:19.116099] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-16T17:01:19.142814] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-16T17:01:19.473683] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-16T17:01:19.942890] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-16T17:01:20.742892] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-16T17:01:21.422298] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T17:01:21.542777] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-16T17:01:21.750709] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-16T17:01:21.758952] [INFO ] [REMOTE ] ABT: Full fetch complete (77764 records). [2025-10-16T17:01:21.759179] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-16T17:01:22.172218] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (3.03 seconds). [2025-10-16T17:01:22.228900] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-16T17:01:22.229002] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-16T17:01:22.229802] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-16T17:01:22.229865] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-16T17:01:22.231321] [DEBUG] [LOCAL ] ABT: Trimmed 77764 records to 54011 (keeping 200 days of data) [2025-10-16T17:01:22.346839] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-16T17:01:22.567337] [DEBUG] [LOCAL ] ABT: Primary data saved (54011 records). [2025-10-16T17:01:22.567467] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-16T17:01:22.568186] [INFO ] [MAIN ] Update Progress: 16/2369 symbols completed. ABT took 31.4s. Estimated remaining: 3h 13m 21s. Rate: 12.2 symbols/min [2025-10-16T17:01:22.739820] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:01:22.762726] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T17:01:22.812077] [DEBUG] [LOCAL ] ACI: Loaded 53282 existing records from primary storage. [2025-10-16T17:01:22.812375] [INFO ] [MAIN ] ACI: Loaded 53282 existing records. [2025-10-16T17:01:22.986970] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:01:22.987205] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-16T17:01:22.987261] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-16T17:01:22.987598] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-16T17:01:22.987684] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-16T17:01:23.146735] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-16T17:01:23.359572] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:01:23.679845] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T17:01:23.684450] [INFO ] [REMOTE ] ACCO: Full fetch complete (54099 records). [2025-10-16T17:01:23.684568] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-16T17:01:23.947940] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-16T17:01:24.073821] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-16T17:01:24.073908] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-16T17:01:24.074493] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-16T17:01:24.074605] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-16T17:01:24.075957] [DEBUG] [LOCAL ] ACCO: Trimmed 54099 records to 37310 (keeping 200 days of data) [2025-10-16T17:01:24.287476] [DEBUG] [LOCAL ] ACCO: Primary data saved (37310 records). [2025-10-16T17:01:24.287634] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-16T17:01:24.287755] [INFO ] [MAIN ] Update Progress: 17/2369 symbols completed. ACCO took 27.1s. Estimated remaining: 3h 5m 52s. Rate: 12.7 symbols/min [2025-10-16T17:01:24.460879] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:01:24.501964] [DEBUG] [LOCAL ] ACM: Loaded 42993 existing records from primary storage. [2025-10-16T17:01:24.502266] [INFO ] [MAIN ] ACM: Loaded 42993 existing records. [2025-10-16T17:01:24.685758] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:01:24.685959] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-16T17:01:24.686007] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-16T17:01:24.686220] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-16T17:01:24.686278] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-16T17:01:24.751547] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-16T17:01:25.057924] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:01:25.542795] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-16T17:01:25.647794] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T17:01:25.674469] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-16T17:01:25.718002] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-16T17:01:26.342821] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-16T17:01:27.142808] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-16T17:01:27.413108] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T17:01:27.942826] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-16T17:01:28.380439] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-16T17:01:28.742796] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-16T17:01:28.836047] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-16T17:01:29.245556] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T17:01:29.542834] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-16T17:01:29.718954] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T17:01:30.342935] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-16T17:01:31.147996] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-16T17:01:31.169398] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T17:01:31.903499] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T17:01:31.942778] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-16T17:01:32.742829] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-16T17:01:33.465037] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T17:01:33.542806] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-16T17:01:34.097750] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.95 seconds). [2025-10-16T17:01:34.183412] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T17:01:34.342824] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-16T17:01:34.731744] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T17:01:35.142878] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-16T17:01:35.942821] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-16T17:01:36.670069] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-16T17:01:36.723808] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T17:01:36.742784] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-16T17:01:37.430116] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T17:01:37.542861] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-16T17:01:38.224312] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T17:01:38.322275] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T17:01:38.342814] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-16T17:01:39.142859] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-16T17:01:39.495318] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T17:01:39.942820] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-16T17:01:40.742830] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-16T17:01:41.468141] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T17:01:41.542789] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-16T17:01:41.718304] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-16T17:01:41.971739] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T17:01:42.342819] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-16T17:01:43.060704] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T17:01:43.142790] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-16T17:01:43.278777] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-16T17:01:43.942817] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-16T17:01:44.742802] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-16T17:01:44.833454] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T17:01:45.542866] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-16T17:01:45.837466] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T17:01:45.841638] [INFO ] [REMOTE ] ACEL: Full fetch complete (38894 records). [2025-10-16T17:01:45.841771] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-16T17:01:46.225443] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-16T17:01:46.225567] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-16T17:01:46.226145] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-16T17:01:46.226249] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-16T17:01:46.227707] [DEBUG] [LOCAL ] ACEL: Trimmed 38894 records to 26895 (keeping 200 days of data) [2025-10-16T17:01:46.349709] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-16T17:01:46.424201] [DEBUG] [LOCAL ] ACEL: Primary data saved (26895 records). [2025-10-16T17:01:46.424398] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-16T17:01:46.424503] [INFO ] [MAIN ] Update Progress: 18/2369 symbols completed. ACEL took 30.9s. Estimated remaining: 3h 43m 39s. Rate: 10.5 symbols/min [2025-10-16T17:01:46.607789] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:01:46.662724] [DEBUG] [LOCAL ] ACN: Loaded 53439 existing records from primary storage. [2025-10-16T17:01:46.663263] [INFO ] [MAIN ] ACN: Loaded 53439 existing records. [2025-10-16T17:01:46.855787] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:01:46.856192] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-16T17:01:46.856358] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-16T17:01:46.856745] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-16T17:01:46.856814] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-16T17:01:47.089153] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (3.15 seconds). [2025-10-16T17:01:47.212343] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T17:01:47.254222] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-16T17:01:47.343122] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:01:47.676355] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T17:01:47.942821] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-16T17:01:48.742819] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-16T17:01:49.542789] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-16T17:01:49.716177] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-16T17:01:49.780854] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T17:01:50.328975] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T17:01:50.342770] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-16T17:01:50.804193] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T17:01:51.142855] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-16T17:01:51.817446] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T17:01:51.942863] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-16T17:01:52.742863] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-16T17:01:52.911903] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T17:01:53.542844] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-16T17:01:53.575379] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T17:01:54.342877] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-16T17:01:54.931628] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-16T17:01:55.142862] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-16T17:01:55.327146] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T17:01:55.911116] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T17:01:55.942840] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-16T17:01:56.742855] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-16T17:01:56.820210] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T17:01:56.825878] [INFO ] [REMOTE ] ACM: Full fetch complete (63156 records). [2025-10-16T17:01:56.826030] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-16T17:01:57.206020] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-16T17:01:57.206103] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-16T17:01:57.206724] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-16T17:01:57.206790] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-16T17:01:57.208167] [DEBUG] [LOCAL ] ACM: Trimmed 63156 records to 43294 (keeping 200 days of data) [2025-10-16T17:01:57.472192] [DEBUG] [LOCAL ] ACM: Primary data saved (43294 records). [2025-10-16T17:01:57.472352] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-16T17:01:57.473698] [INFO ] [MAIN ] Update Progress: 19/2369 symbols completed. ACM took 33.2s. Estimated remaining: 3h 54m 34s. Rate: 10.0 symbols/min [2025-10-16T17:01:57.547948] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-16T17:01:57.640789] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:01:57.671486] [DEBUG] [LOCAL ] ACP: Loaded 30939 existing records from primary storage. [2025-10-16T17:01:57.671775] [INFO ] [MAIN ] ACP: Loaded 30939 existing records. [2025-10-16T17:01:57.844360] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:01:57.844600] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-16T17:01:57.844683] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-16T17:01:57.844984] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-16T17:01:57.845044] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-16T17:01:58.195554] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:01:58.342797] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-16T17:01:58.720039] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-10-16T17:01:58.838595] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-16T17:01:59.142811] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-16T17:01:59.486604] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-16T17:01:59.493499] [INFO ] [REMOTE ] ACI: Full fetch complete (77228 records). [2025-10-16T17:01:59.493637] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-16T17:01:59.891435] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-16T17:01:59.891587] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-16T17:01:59.892878] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-16T17:01:59.893027] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-16T17:01:59.895189] [DEBUG] [LOCAL ] ACI: Trimmed 77228 records to 53672 (keeping 200 days of data) [2025-10-16T17:01:59.964024] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-16T17:02:00.041377] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T17:02:00.279800] [DEBUG] [LOCAL ] ACI: Primary data saved (53672 records). [2025-10-16T17:02:00.280001] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-16T17:02:00.280620] [INFO ] [MAIN ] Update Progress: 20/2369 symbols completed. ACI took 37.7s. Estimated remaining: 3h 48m 14s. Rate: 10.3 symbols/min [2025-10-16T17:02:00.449852] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:02:00.458957] [DEBUG] [LOCAL ] ACR: Loaded 5445 existing records from primary storage. [2025-10-16T17:02:00.459178] [INFO ] [MAIN ] ACR: Loaded 5445 existing records. [2025-10-16T17:02:00.652164] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:02:00.652443] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-16T17:02:00.652518] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-16T17:02:00.652750] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-16T17:02:00.652818] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-16T17:02:00.752823] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-16T17:02:01.020697] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:02:01.544042] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-16T17:02:01.544230] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-16T17:02:01.901630] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T17:02:02.200215] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-16T17:02:02.342887] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-16T17:02:02.457075] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-16T17:02:02.465041] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-16T17:02:02.465189] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-16T17:02:02.892194] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-16T17:02:02.892498] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-16T17:02:02.893291] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-16T17:02:02.893355] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-16T17:02:02.894834] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 54208 (keeping 200 days of data) [2025-10-16T17:02:03.159868] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-16T17:02:03.210072] [DEBUG] [LOCAL ] ACHR: Primary data saved (54208 records). [2025-10-16T17:02:03.210211] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-16T17:02:03.210286] [INFO ] [MAIN ] Update Progress: 21/2369 symbols completed. ACHR took 44.8s. Estimated remaining: 3h 42m 44s. Rate: 10.5 symbols/min [2025-10-16T17:02:03.378269] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:02:03.397009] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-16T17:02:03.430890] [DEBUG] [LOCAL ] ACRE: Loaded 33640 existing records from primary storage. [2025-10-16T17:02:03.431173] [INFO ] [MAIN ] ACRE: Loaded 33640 existing records. [2025-10-16T17:02:03.605954] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:02:03.606210] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-16T17:02:03.606268] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-16T17:02:03.607075] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-16T17:02:03.607135] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-16T17:02:03.856272] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-16T17:02:03.947388] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-16T17:02:03.961150] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:02:04.742839] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-16T17:02:05.542838] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-16T17:02:05.580572] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T17:02:06.178516] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T17:02:06.210606] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T17:02:06.342835] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-16T17:02:07.142867] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-16T17:02:07.816763] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T17:02:07.942822] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-16T17:02:08.609553] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T17:02:08.742840] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-16T17:02:09.302325] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-16T17:02:09.542825] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-16T17:02:09.903051] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T17:02:10.335979] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T17:02:10.342761] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-16T17:02:11.069597] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T17:02:11.142821] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-16T17:02:11.942820] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-16T17:02:12.148757] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T17:02:12.743209] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-16T17:02:13.541125] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T17:02:13.544381] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-16T17:02:13.796687] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T17:02:14.342852] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-16T17:02:14.464534] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-16T17:02:15.142811] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-16T17:02:15.863584] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T17:02:15.920422] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T17:02:15.942781] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-16T17:02:16.742834] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-16T17:02:17.044579] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T17:02:17.439194] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-16T17:02:17.542843] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-16T17:02:18.181556] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T17:02:18.342842] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-16T17:02:19.142830] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-16T17:02:19.954063] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-16T17:02:19.970541] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T17:02:20.382624] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-16T17:02:20.742791] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-16T17:02:20.884609] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T17:02:21.542831] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-16T17:02:22.067853] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T17:02:22.342836] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-16T17:02:22.809464] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-16T17:02:23.142898] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-16T17:02:23.942843] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-16T17:02:24.394949] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T17:02:24.640058] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T17:02:24.644477] [INFO ] [REMOTE ] ACR: Full fetch complete (8533 records). [2025-10-16T17:02:24.646495] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-16T17:02:24.645158] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-16T17:02:24.747965] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-16T17:02:25.031451] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-16T17:02:25.031551] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-16T17:02:25.031783] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-16T17:02:25.031845] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-16T17:02:25.032322] [DEBUG] [LOCAL ] ACR: Trimmed 8533 records to 5466 (keeping 200 days of data) [2025-10-16T17:02:25.063831] [DEBUG] [LOCAL ] ACR: Primary data saved (5466 records). [2025-10-16T17:02:25.063964] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-16T17:02:25.064046] [INFO ] [MAIN ] Update Progress: 22/2369 symbols completed. ACR took 24.8s. Estimated remaining: 4h 11m 22s. Rate: 9.3 symbols/min [2025-10-16T17:02:25.237869] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:02:25.247713] [DEBUG] [LOCAL ] ACV: Loaded 7659 existing records from primary storage. [2025-10-16T17:02:25.247943] [INFO ] [MAIN ] ACV: Loaded 7659 existing records. [2025-10-16T17:02:25.431955] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:02:25.432232] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-16T17:02:25.432295] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-16T17:02:25.432441] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-16T17:02:25.432482] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-16T17:02:25.547972] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-16T17:02:25.799641] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:02:25.821351] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T17:02:26.342834] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-16T17:02:27.099542] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-16T17:02:27.105961] [INFO ] [REMOTE ] ACP: Full fetch complete (46580 records). [2025-10-16T17:02:27.106139] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-16T17:02:27.147931] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-16T17:02:27.525636] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-16T17:02:27.525774] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-16T17:02:27.526297] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-16T17:02:27.526342] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-16T17:02:27.527362] [DEBUG] [LOCAL ] ACP: Trimmed 46580 records to 31216 (keeping 200 days of data) [2025-10-16T17:02:27.705460] [DEBUG] [LOCAL ] ACP: Primary data saved (31216 records). [2025-10-16T17:02:27.705616] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-16T17:02:27.705734] [INFO ] [MAIN ] Update Progress: 23/2369 symbols completed. ACP took 30.2s. Estimated remaining: 4h 4m 50s. Rate: 9.6 symbols/min [2025-10-16T17:02:27.871825] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:02:27.915027] [DEBUG] [LOCAL ] ACVA: Loaded 49299 existing records from primary storage. [2025-10-16T17:02:27.915355] [INFO ] [MAIN ] ACVA: Loaded 49299 existing records. [2025-10-16T17:02:27.956946] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-16T17:02:28.098707] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:02:28.099713] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-16T17:02:28.099801] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-16T17:02:28.100577] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-16T17:02:28.100636] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-16T17:02:28.464084] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:02:28.483188] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T17:02:28.572700] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-16T17:02:28.584890] [INFO ] [REMOTE ] ACN: Full fetch complete (77378 records). [2025-10-16T17:02:28.585090] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-16T17:02:28.585304] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-16T17:02:28.746760] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-16T17:02:28.990508] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-16T17:02:28.990589] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-16T17:02:28.991311] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-16T17:02:28.991380] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-16T17:02:28.992866] [DEBUG] [LOCAL ] ACN: Trimmed 77378 records to 53829 (keeping 200 days of data) [2025-10-16T17:02:29.335907] [DEBUG] [LOCAL ] ACN: Primary data saved (53829 records). [2025-10-16T17:02:29.336051] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-16T17:02:29.336131] [INFO ] [MAIN ] Update Progress: 24/2369 symbols completed. ACN took 42.9s. Estimated remaining: 3h 57m 11s. Rate: 9.9 symbols/min [2025-10-16T17:02:29.509273] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:02:29.509434] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-16T17:02:29.509472] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-16T17:02:29.509581] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-16T17:02:29.509624] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-16T17:02:29.509702] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-16T17:02:29.509748] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-16T17:02:29.552700] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-16T17:02:29.877792] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:02:30.103569] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T17:02:30.285945] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-16T17:02:30.342816] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-16T17:02:31.142846] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-16T17:02:31.432119] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T17:02:31.942823] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-16T17:02:32.584369] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T17:02:32.742836] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-16T17:02:33.195245] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T17:02:33.542864] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-16T17:02:34.271906] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T17:02:34.342810] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-16T17:02:34.635316] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T17:02:34.640001] [INFO ] [REMOTE ] ACRE: Full fetch complete (49909 records). [2025-10-16T17:02:34.640150] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-16T17:02:35.054960] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-16T17:02:35.055076] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-16T17:02:35.055621] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-16T17:02:35.055699] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-16T17:02:35.056819] [DEBUG] [LOCAL ] ACRE: Trimmed 49909 records to 33901 (keeping 200 days of data) [2025-10-16T17:02:35.143074] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-16T17:02:35.261431] [DEBUG] [LOCAL ] ACRE: Primary data saved (33901 records). [2025-10-16T17:02:35.261584] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-16T17:02:35.261703] [INFO ] [MAIN ] Update Progress: 25/2369 symbols completed. ACRE took 32.1s. Estimated remaining: 3h 56m 52s. Rate: 9.9 symbols/min [2025-10-16T17:02:35.454307] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:02:35.505459] [DEBUG] [LOCAL ] ADC: Loaded 46389 existing records from primary storage. [2025-10-16T17:02:35.505807] [INFO ] [MAIN ] ADC: Loaded 46389 existing records. [2025-10-16T17:02:35.685069] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:02:35.685326] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-16T17:02:35.685379] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-16T17:02:35.685564] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-16T17:02:35.685604] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-16T17:02:35.794777] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T17:02:35.946815] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-16T17:02:36.057209] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:02:36.090462] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T17:02:36.466260] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-16T17:02:36.742839] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-16T17:02:37.542813] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-16T17:02:38.316366] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T17:02:38.342769] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-16T17:02:38.429141] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T17:02:39.142827] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-16T17:02:39.179172] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T17:02:39.327444] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:02:39.327762] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-16T17:02:39.327851] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:02:39.327902] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-16T17:02:39.327964] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:02:39.328039] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-16T17:02:39.328166] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-16T17:02:39.328224] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-16T17:02:39.328270] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-16T17:02:39.328326] [INFO ] [MAIN ] Update Progress: 26/2369 symbols completed. AD took 10.0s. Estimated remaining: 3h 53m 46s. Rate: 10.0 symbols/min [2025-10-16T17:02:39.520184] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:02:39.520404] [DEBUG] [LOCAL ] ADCT: No existing data file found in primary storage. [2025-10-16T17:02:39.520449] [WARN ] [MAIN ] ADCT: No existing data found, performing full refresh instead. [2025-10-16T17:02:39.520561] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-16T17:02:39.520604] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-16T17:02:39.520677] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-16T17:02:39.520732] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-16T17:02:39.886608] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:02:39.942775] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-16T17:02:40.742837] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-16T17:02:41.542813] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-16T17:02:41.811364] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T17:02:41.890789] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T17:02:42.342835] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-16T17:02:43.142804] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-16T17:02:43.235063] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T17:02:43.558986] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-16T17:02:43.814444] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T17:02:43.942801] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-16T17:02:44.742813] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-16T17:02:45.332884] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-16T17:02:45.542821] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-16T17:02:45.630788] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T17:02:46.342835] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-16T17:02:47.088126] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T17:02:47.123913] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T17:02:47.142795] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-16T17:02:47.942876] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-16T17:02:47.972322] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T17:02:48.742890] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-16T17:02:49.393249] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T17:02:49.542889] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-16T17:02:49.858481] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T17:02:50.342837] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-16T17:02:51.070455] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T17:02:51.142836] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-16T17:02:51.786800] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T17:02:51.942829] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-16T17:02:52.213339] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T17:02:52.215324] [INFO ] [REMOTE ] ACV: Full fetch complete (10426 records). [2025-10-16T17:02:52.215394] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-16T17:02:52.573087] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-16T17:02:52.573167] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-16T17:02:52.573372] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-16T17:02:52.573412] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-16T17:02:52.573875] [DEBUG] [LOCAL ] ACV: Trimmed 10426 records to 7694 (keeping 200 days of data) [2025-10-16T17:02:52.619910] [DEBUG] [LOCAL ] ACV: Primary data saved (7694 records). [2025-10-16T17:02:52.620038] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-16T17:02:52.620118] [INFO ] [MAIN ] Update Progress: 27/2369 symbols completed. ACV took 27.6s. Estimated remaining: 4h 4m 13s. Rate: 9.6 symbols/min [2025-10-16T17:02:52.747909] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-16T17:02:52.797309] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:02:52.852010] [DEBUG] [LOCAL ] ADM: Loaded 53398 existing records from primary storage. [2025-10-16T17:02:52.852347] [INFO ] [MAIN ] ADM: Loaded 53398 existing records. [2025-10-16T17:02:53.028032] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:02:53.028295] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-16T17:02:53.028347] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-16T17:02:53.028635] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-16T17:02:53.028734] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-16T17:02:53.403324] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:02:53.542810] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-16T17:02:53.620004] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T17:02:54.175236] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T17:02:54.342857] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-16T17:02:55.142823] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-16T17:02:55.393688] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T17:02:55.553793] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-16T17:02:55.942839] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-16T17:02:56.188176] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T17:02:56.742832] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-16T17:02:57.450108] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T17:02:57.542850] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-16T17:02:57.924214] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-16T17:02:58.342823] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-16T17:02:58.975796] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T17:02:59.142851] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-16T17:02:59.634083] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T17:02:59.942873] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-16T17:03:00.444103] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T17:03:00.742775] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-16T17:03:01.216330] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T17:03:01.542856] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-16T17:03:02.342801] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-16T17:03:02.372482] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T17:03:02.379105] [INFO ] [REMOTE ] ACVA: Full fetch complete (70911 records). [2025-10-16T17:03:02.379269] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-16T17:03:02.769322] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-16T17:03:02.769416] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-16T17:03:02.770172] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-16T17:03:02.770236] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-16T17:03:02.771685] [DEBUG] [LOCAL ] ACVA: Trimmed 70911 records to 49671 (keeping 200 days of data) [2025-10-16T17:03:03.076614] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T17:03:03.094907] [DEBUG] [LOCAL ] ACVA: Primary data saved (49671 records). [2025-10-16T17:03:03.095037] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-16T17:03:03.095114] [INFO ] [MAIN ] Update Progress: 28/2369 symbols completed. ACVA took 35.4s. Estimated remaining: 4h 9m 60s. Rate: 9.4 symbols/min [2025-10-16T17:03:03.150615] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-16T17:03:03.275908] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:03:03.322949] [DEBUG] [LOCAL ] ADNT: Loaded 46787 existing records from primary storage. [2025-10-16T17:03:03.323321] [INFO ] [MAIN ] ADNT: Loaded 46787 existing records. [2025-10-16T17:03:03.507661] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:03:03.507884] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-16T17:03:03.507938] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-16T17:03:03.508256] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-16T17:03:03.508354] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-16T17:03:03.869835] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:03:03.942772] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-16T17:03:04.352201] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T17:03:04.742867] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-16T17:03:04.798554] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T17:03:05.240353] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T17:03:05.542835] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-16T17:03:06.130831] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:03:06.342852] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-16T17:03:07.142802] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-16T17:03:07.370230] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-16T17:03:07.438130] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T17:03:07.942828] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-16T17:03:08.311170] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T17:03:08.742809] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-16T17:03:09.518482] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T17:03:09.524122] [INFO ] [REMOTE ] ADCT: Full fetch complete (51554 records). [2025-10-16T17:03:09.524225] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-16T17:03:09.555128] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-16T17:03:09.924805] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-16T17:03:09.924928] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-16T17:03:09.925448] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-16T17:03:09.925490] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-16T17:03:09.926512] [DEBUG] [LOCAL ] ADCT: Trimmed 51554 records to 35639 (keeping 200 days of data) [2025-10-16T17:03:10.115040] [DEBUG] [LOCAL ] ADCT: Primary data saved (35639 records). [2025-10-16T17:03:10.115191] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-16T17:03:10.115286] [INFO ] [MAIN ] Update Progress: 29/2369 symbols completed. ADCT took 30.8s. Estimated remaining: 4h 10m 43s. Rate: 9.3 symbols/min [2025-10-16T17:03:10.282399] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:03:10.330981] [DEBUG] [LOCAL ] ADT: Loaded 53443 existing records from primary storage. [2025-10-16T17:03:10.331298] [INFO ] [MAIN ] ADT: Loaded 53443 existing records. [2025-10-16T17:03:10.362015] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-16T17:03:10.509588] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:03:10.509907] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-16T17:03:10.510024] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-16T17:03:10.510323] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-16T17:03:10.510379] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-16T17:03:10.877556] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:03:10.911577] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-16T17:03:11.095718] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T17:03:11.142768] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-16T17:03:11.648551] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T17:03:11.942826] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-16T17:03:12.742811] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-16T17:03:12.948418] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T17:03:13.350626] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T17:03:13.542804] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-16T17:03:14.342787] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-16T17:03:14.661281] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T17:03:14.760571] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T17:03:15.142855] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-16T17:03:15.677344] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T17:03:15.682893] [INFO ] [REMOTE ] ADC: Full fetch complete (66159 records). [2025-10-16T17:03:15.683021] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-16T17:03:15.683693] [FATAL] [VALIDATOR ] ADC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:03:15.683784] [FATAL] [MAIN ] ADC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:03:15.683826] [WARN ] [MAIN ] ADC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:03:15.683888] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-16T17:03:15.683950] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-16T17:03:15.683984] [INFO ] [LOCAL ] ADC: Starting deletion of derivative data. [2025-10-16T17:03:15.684161] [DEBUG] [LOCAL ] ADC: Deleted derivative data file. [2025-10-16T17:03:15.684251] [INFO ] [MAIN ] Update Progress: 30/2369 symbols completed. ADC took 40.4s. Estimated remaining: 4h 9m 29s. Rate: 9.4 symbols/min [2025-10-16T17:03:15.850481] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:03:15.877108] [DEBUG] [LOCAL ] ADX: Loaded 27657 existing records from primary storage. [2025-10-16T17:03:15.877358] [INFO ] [MAIN ] ADX: Loaded 27657 existing records. [2025-10-16T17:03:15.950626] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-16T17:03:16.062387] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:03:16.062604] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-16T17:03:16.062681] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-16T17:03:16.062952] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-16T17:03:16.063010] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-16T17:03:16.423902] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:03:16.742788] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-16T17:03:17.183385] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-16T17:03:17.542880] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-16T17:03:17.580088] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T17:03:18.220824] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T17:03:18.342874] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-16T17:03:19.113134] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T17:03:19.142774] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-16T17:03:19.327069] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T17:03:19.942816] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-16T17:03:20.742847] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-16T17:03:20.864918] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T17:03:20.940830] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T17:03:21.542815] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-16T17:03:22.136499] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T17:03:22.342819] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-16T17:03:22.831345] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T17:03:23.142813] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-16T17:03:23.731954] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T17:03:23.942817] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-16T17:03:24.742796] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-16T17:03:24.860053] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T17:03:25.244225] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T17:03:25.542805] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-16T17:03:26.342814] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-16T17:03:26.621987] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T17:03:27.039273] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T17:03:27.142833] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-16T17:03:27.942840] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-16T17:03:28.110190] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T17:03:28.173886] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T17:03:28.742809] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-16T17:03:29.542777] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-16T17:03:29.632407] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-16T17:03:29.767465] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T17:03:30.342835] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-16T17:03:31.142787] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-16T17:03:31.544719] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-16T17:03:31.578180] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T17:03:31.942850] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-16T17:03:32.604893] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T17:03:32.742795] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-16T17:03:33.424409] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T17:03:33.542874] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-16T17:03:34.229846] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T17:03:34.235549] [INFO ] [REMOTE ] ADNT: Full fetch complete (67979 records). [2025-10-16T17:03:34.235736] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-16T17:03:34.347918] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-16T17:03:34.628591] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-16T17:03:34.628699] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-16T17:03:34.629424] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-16T17:03:34.629489] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-16T17:03:34.630845] [DEBUG] [LOCAL ] ADNT: Trimmed 67979 records to 47055 (keeping 200 days of data) [2025-10-16T17:03:34.894590] [DEBUG] [LOCAL ] ADNT: Primary data saved (47055 records). [2025-10-16T17:03:34.894737] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-16T17:03:34.894822] [INFO ] [MAIN ] Update Progress: 31/2369 symbols completed. ADNT took 31.8s. Estimated remaining: 4h 25m 29s. Rate: 8.8 symbols/min [2025-10-16T17:03:35.066421] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:03:35.110624] [DEBUG] [LOCAL ] AEE: Loaded 50164 existing records from primary storage. [2025-10-16T17:03:35.110972] [INFO ] [MAIN ] AEE: Loaded 50164 existing records. [2025-10-16T17:03:35.153019] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-16T17:03:35.329477] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:03:35.331441] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T17:03:35.342282] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-16T17:03:35.342430] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-16T17:03:35.343001] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-16T17:03:35.343214] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-16T17:03:35.715853] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T17:03:35.720113] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:03:35.942791] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-16T17:03:36.742787] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-16T17:03:36.938842] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T17:03:37.509111] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-16T17:03:37.542783] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-16T17:03:37.584211] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T17:03:38.342858] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-16T17:03:38.902230] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T17:03:39.142851] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-16T17:03:39.764325] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T17:03:39.768475] [INFO ] [REMOTE ] ADX: Full fetch complete (41925 records). [2025-10-16T17:03:39.768565] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-16T17:03:39.944497] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-16T17:03:40.064893] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T17:03:40.108031] [INFO ] [REMOTE ] ADM: Full fetch complete (77056 records). [2025-10-16T17:03:40.129945] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-16T17:03:40.170358] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-16T17:03:40.170175] [FATAL] [VALIDATOR ] ADM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:03:40.170539] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-16T17:03:40.171058] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-16T17:03:40.171137] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-16T17:03:40.170488] [FATAL] [MAIN ] ADM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:03:40.171318] [WARN ] [MAIN ] ADM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:03:40.171392] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-16T17:03:40.171757] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-10-16T17:03:40.171900] [INFO ] [LOCAL ] ADM: Starting deletion of derivative data. [2025-10-16T17:03:40.172241] [DEBUG] [LOCAL ] ADX: Trimmed 41925 records to 27929 (keeping 200 days of data) [2025-10-16T17:03:40.172274] [DEBUG] [LOCAL ] ADM: Deleted derivative data file. [2025-10-16T17:03:40.172980] [INFO ] [MAIN ] Update Progress: 32/2369 symbols completed. ADM took 47.6s. Estimated remaining: 4h 23m 30s. Rate: 8.9 symbols/min [2025-10-16T17:03:40.445375] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:03:40.446736] [DEBUG] [LOCAL ] AEFC: No existing data file found in primary storage. [2025-10-16T17:03:40.447076] [WARN ] [MAIN ] AEFC: No existing data found, performing full refresh instead. [2025-10-16T17:03:40.447990] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-16T17:03:40.448525] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-16T17:03:40.449902] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-16T17:03:40.450455] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-16T17:03:40.744371] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-16T17:03:40.873555] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:03:40.900913] [DEBUG] [LOCAL ] ADX: Primary data saved (27929 records). [2025-10-16T17:03:40.901022] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-16T17:03:40.901093] [INFO ] [MAIN ] Update Progress: 33/2369 symbols completed. ADX took 25.2s. Estimated remaining: 4h 16m 16s. Rate: 9.1 symbols/min [2025-10-16T17:03:41.066153] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:03:41.108054] [DEBUG] [LOCAL ] AEG: Loaded 49572 existing records from primary storage. [2025-10-16T17:03:41.108343] [INFO ] [MAIN ] AEG: Loaded 49572 existing records. [2025-10-16T17:03:41.283699] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:03:41.283920] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-16T17:03:41.283973] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-16T17:03:41.284313] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-16T17:03:41.284354] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-16T17:03:41.547688] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-16T17:03:41.643172] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:03:41.697163] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T17:03:41.960546] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-16T17:03:42.197441] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-16T17:03:42.342819] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-16T17:03:43.142809] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-16T17:03:43.942779] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-16T17:03:44.036092] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T17:03:44.458702] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-16T17:03:44.491806] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T17:03:44.742779] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-16T17:03:45.542809] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-16T17:03:46.022416] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T17:03:46.342807] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-16T17:03:46.928586] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T17:03:47.142797] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-16T17:03:47.798070] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-16T17:03:47.942826] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-16T17:03:47.992155] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T17:03:48.742833] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-16T17:03:49.349791] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T17:03:49.458245] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T17:03:49.542790] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-16T17:03:50.049305] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-16T17:03:50.342831] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-16T17:03:51.142856] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-16T17:03:51.942786] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-16T17:03:52.206131] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-16T17:03:52.481131] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T17:03:52.742839] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-16T17:03:52.786742] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T17:03:53.542817] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-16T17:03:54.234924] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T17:03:54.342833] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-16T17:03:54.582997] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-16T17:03:55.142821] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-16T17:03:55.942795] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-16T17:03:56.221518] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T17:03:56.228612] [INFO ] [REMOTE ] ADT: Full fetch complete (77366 records). [2025-10-16T17:03:56.228795] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-16T17:03:56.646548] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-16T17:03:56.647569] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-16T17:03:56.647657] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-16T17:03:56.651205] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-16T17:03:56.651353] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-16T17:03:56.652958] [DEBUG] [LOCAL ] ADT: Trimmed 77366 records to 53829 (keeping 200 days of data) [2025-10-16T17:03:56.678823] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T17:03:56.745453] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-16T17:03:56.998602] [DEBUG] [LOCAL ] ADT: Primary data saved (53829 records). [2025-10-16T17:03:56.998771] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-16T17:03:56.998878] [INFO ] [MAIN ] Update Progress: 34/2369 symbols completed. ADT took 46.9s. Estimated remaining: 4h 27m 3s. Rate: 8.7 symbols/min [2025-10-16T17:03:57.168154] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:03:57.223961] [DEBUG] [LOCAL ] AEM: Loaded 53478 existing records from primary storage. [2025-10-16T17:03:57.224499] [INFO ] [MAIN ] AEM: Loaded 53478 existing records. [2025-10-16T17:03:57.442597] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:03:57.442915] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-16T17:03:57.442987] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-16T17:03:57.443594] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-16T17:03:57.443725] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-16T17:03:57.549478] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-16T17:03:57.578300] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-16T17:03:57.996140] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:03:58.342836] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-16T17:03:59.142822] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-16T17:03:59.447184] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T17:03:59.940110] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T17:03:59.949949] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-16T17:04:00.666809] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T17:04:00.742798] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-16T17:04:01.542906] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-16T17:04:01.619460] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T17:04:02.342858] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-16T17:04:02.650350] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-16T17:04:02.879431] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T17:04:03.119681] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-16T17:04:03.142764] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-16T17:04:03.677289] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-16T17:04:03.678547] [INFO ] [REMOTE ] AEFC: Full fetch complete (11763 records). [2025-10-16T17:04:03.678631] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-16T17:04:03.682251] [FATAL] [VALIDATOR ] AEFC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:04:03.682406] [FATAL] [MAIN ] AEFC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:04:03.682473] [WARN ] [MAIN ] AEFC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:04:03.682545] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-16T17:04:03.682610] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-16T17:04:03.682679] [INFO ] [LOCAL ] AEFC: Starting deletion of derivative data. [2025-10-16T17:04:03.682749] [DEBUG] [LOCAL ] AEFC: No derivative data file found to delete. [2025-10-16T17:04:03.682819] [INFO ] [MAIN ] Update Progress: 35/2369 symbols completed. AEFC took 23.5s. Estimated remaining: 4h 26m 44s. Rate: 8.8 symbols/min [2025-10-16T17:04:03.857613] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:04:03.857825] [DEBUG] [LOCAL ] AEO: No existing data file found in primary storage. [2025-10-16T17:04:03.857869] [WARN ] [MAIN ] AEO: No existing data found, performing full refresh instead. [2025-10-16T17:04:03.857980] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-16T17:04:03.858022] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-16T17:04:03.858065] [DEBUG] [LOCAL ] AEO: No primary data file found to delete. [2025-10-16T17:04:03.858099] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-16T17:04:03.948011] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-16T17:04:04.218193] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:04:04.742830] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-16T17:04:05.542776] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-16T17:04:05.694030] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-16T17:04:06.008374] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T17:04:06.342854] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-16T17:04:07.142851] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-16T17:04:07.465002] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T17:04:07.826173] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T17:04:07.833055] [INFO ] [REMOTE ] AEE: Full fetch complete (72991 records). [2025-10-16T17:04:07.833228] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-16T17:04:07.947943] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-16T17:04:08.231929] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-16T17:04:08.232272] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-16T17:04:08.233111] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-16T17:04:08.233181] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-16T17:04:08.234729] [DEBUG] [LOCAL ] AEE: Trimmed 72991 records to 50542 (keeping 200 days of data) [2025-10-16T17:04:08.537119] [DEBUG] [LOCAL ] AEE: Primary data saved (50542 records). [2025-10-16T17:04:08.537262] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-16T17:04:08.537353] [INFO ] [MAIN ] Update Progress: 36/2369 symbols completed. AEE took 33.6s. Estimated remaining: 4h 24m 28s. Rate: 8.8 symbols/min [2025-10-16T17:04:08.708030] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:04:08.751899] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-16T17:04:08.755330] [DEBUG] [LOCAL ] AER: Loaded 48137 existing records from primary storage. [2025-10-16T17:04:08.755605] [INFO ] [MAIN ] AER: Loaded 48137 existing records. [2025-10-16T17:04:08.942913] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:04:08.943277] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-16T17:04:08.943345] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-16T17:04:08.957206] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-16T17:04:08.978151] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-16T17:04:09.040010] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-16T17:04:09.367473] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:04:09.542783] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-16T17:04:09.925135] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-16T17:04:10.227716] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T17:04:10.342805] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-16T17:04:11.142795] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-16T17:04:11.301731] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T17:04:11.942798] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-16T17:04:12.084562] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T17:04:12.742849] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-16T17:04:13.122412] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-16T17:04:13.542798] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-16T17:04:13.621407] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T17:04:14.342868] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-16T17:04:14.456095] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T17:04:15.142821] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-16T17:04:15.585275] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-16T17:04:15.654268] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T17:04:15.942816] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-16T17:04:16.539840] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T17:04:16.742814] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-16T17:04:17.232557] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T17:04:17.542833] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-16T17:04:18.342863] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-16T17:04:18.549999] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T17:04:18.708793] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T17:04:19.142807] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-16T17:04:19.942812] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-16T17:04:20.135948] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T17:04:20.147237] [INFO ] [REMOTE ] AEG: Full fetch complete (70562 records). [2025-10-16T17:04:20.147578] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-16T17:04:20.560023] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-16T17:04:20.560152] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-16T17:04:20.561201] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-16T17:04:20.561284] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-16T17:04:20.563525] [DEBUG] [LOCAL ] AEG: Trimmed 70562 records to 49936 (keeping 200 days of data) [2025-10-16T17:04:20.752699] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-16T17:04:20.887103] [DEBUG] [LOCAL ] AEG: Primary data saved (49936 records). [2025-10-16T17:04:20.887481] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-16T17:04:20.887600] [INFO ] [MAIN ] Update Progress: 37/2369 symbols completed. AEG took 40.0s. Estimated remaining: 4h 30m 11s. Rate: 8.6 symbols/min [2025-10-16T17:04:21.094192] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-16T17:04:21.548042] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-16T17:04:21.567805] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T17:04:22.342835] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-16T17:04:22.441578] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T17:04:23.142849] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-16T17:04:23.423397] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T17:04:23.942819] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-16T17:04:24.161809] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T17:04:24.705715] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T17:04:24.742786] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-16T17:04:25.542798] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-16T17:04:25.884893] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T17:04:26.082442] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T17:04:26.342861] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-16T17:04:27.142803] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-16T17:04:27.378429] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T17:04:27.686865] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T17:04:27.942824] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-16T17:04:28.742836] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-16T17:04:28.985001] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T17:04:29.542836] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-16T17:04:29.701672] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T17:04:30.342840] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-16T17:04:30.467586] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T17:04:31.142799] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-16T17:04:31.512913] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T17:04:31.831888] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:04:31.942782] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-16T17:04:32.715669] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T17:04:32.722420] [INFO ] [REMOTE ] AEM: Full fetch complete (77433 records). [2025-10-16T17:04:32.722543] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-16T17:04:32.754479] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-16T17:04:33.138733] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-16T17:04:33.138814] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-16T17:04:33.139559] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-16T17:04:33.139621] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-16T17:04:33.141071] [DEBUG] [LOCAL ] AEM: Trimmed 77433 records to 53868 (keeping 200 days of data) [2025-10-16T17:04:33.498702] [DEBUG] [LOCAL ] AEM: Primary data saved (53868 records). [2025-10-16T17:04:33.505026] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-16T17:04:33.505117] [INFO ] [MAIN ] Update Progress: 38/2369 symbols completed. AEM took 36.5s. Estimated remaining: 4h 35m 51s. Rate: 8.5 symbols/min [2025-10-16T17:04:33.506593] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T17:04:33.542764] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-16T17:04:34.588610] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-16T17:04:34.595488] [INFO ] [REMOTE ] AEO: Full fetch complete (77645 records). [2025-10-16T17:04:34.595613] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-16T17:04:34.989351] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-16T17:04:34.989499] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-16T17:04:34.990318] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-16T17:04:34.990400] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-16T17:04:35.006462] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T17:04:35.013035] [INFO ] [REMOTE ] AER: Full fetch complete (69925 records). [2025-10-16T17:04:35.012902] [DEBUG] [LOCAL ] AEO: Trimmed 77645 records to 53956 (keeping 200 days of data) [2025-10-16T17:04:35.013227] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-16T17:04:35.512734] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-16T17:04:35.513553] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-16T17:04:35.514828] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-16T17:04:35.514906] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-16T17:04:35.520201] [DEBUG] [LOCAL ] AER: Trimmed 69925 records to 48455 (keeping 200 days of data) [2025-10-16T17:04:36.053978] [DEBUG] [LOCAL ] AEO: Primary data saved (53956 records). [2025-10-16T17:04:36.054603] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-16T17:04:36.055217] [INFO ] [MAIN ] Update Progress: 39/2369 symbols completed. AEO took 32.4s. Estimated remaining: 4h 31m 12s. Rate: 8.6 symbols/min [2025-10-16T17:04:36.062039] [DEBUG] [LOCAL ] AER: Primary data saved (48455 records). [2025-10-16T17:04:36.062177] [INFO ] [MAIN ] AER: Full history saved. [2025-10-16T17:04:36.062890] [INFO ] [MAIN ] Update Progress: 40/2369 symbols completed. AER took 27.5s. Estimated remaining: 4h 24m 19s. Rate: 8.8 symbols/min [2025-10-16T17:04:36.620809] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:04:36.746854] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:04:36.761850] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:04:36.765340] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:04:36.765760] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-16T17:04:36.766075] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-16T17:04:36.766327] [DEBUG] [LOCAL ] AFB: No existing data file found in primary storage. [2025-10-16T17:04:36.766276] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-16T17:04:36.766621] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-16T17:04:36.766419] [WARN ] [MAIN ] AFB: No existing data found, performing full refresh instead. [2025-10-16T17:04:36.767015] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-16T17:04:36.766900] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-16T17:04:36.767142] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-16T17:04:36.767230] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-16T17:04:36.773066] [DEBUG] [LOCAL ] AFB: No primary data file found to delete. [2025-10-16T17:04:36.797116] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-16T17:04:37.094208] [DEBUG] [LOCAL ] AESI: Loaded 49739 existing records from primary storage. [2025-10-16T17:04:37.148840] [INFO ] [MAIN ] AESI: Loaded 49739 existing records. [2025-10-16T17:04:37.387932] [DEBUG] [LOCAL ] AES: Loaded 53669 existing records from primary storage. [2025-10-16T17:04:37.407526] [INFO ] [MAIN ] AES: Loaded 53669 existing records. [2025-10-16T17:04:37.667106] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:04:37.763357] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-16T17:04:37.833715] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:04:37.888757] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-16T17:04:37.897208] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-16T17:04:37.947125] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-16T17:04:37.951309] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-16T17:04:37.951132] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:04:38.004469] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:04:38.004999] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-16T17:04:38.028509] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-16T17:04:38.050182] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-16T17:04:38.065127] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-16T17:04:38.065668] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-16T17:04:38.065534] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:04:38.107245] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-16T17:04:38.136704] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:04:38.153492] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-16T17:04:38.164317] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:04:38.164503] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-16T17:04:38.234053] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-16T17:04:38.283782] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-16T17:04:38.343559] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-16T17:04:38.343758] [INFO ] [MAIN ] Update Progress: 41/2369 symbols completed. AEXA took 2.3s. Estimated remaining: 4h 19m 55s. Rate: 9.0 symbols/min [2025-10-16T17:04:38.961678] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:04:38.966031] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-16T17:04:38.965617] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:04:38.988621] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:04:38.990354] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-16T17:04:39.001434] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-16T17:04:39.004677] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-16T17:04:39.046305] [DEBUG] [LOCAL ] AFG: Loaded 32218 existing records from primary storage. [2025-10-16T17:04:39.046671] [INFO ] [MAIN ] AFG: Loaded 32218 existing records. [2025-10-16T17:04:39.226347] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:04:39.226629] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-16T17:04:39.226722] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-16T17:04:39.226922] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-16T17:04:39.226960] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-16T17:04:39.574011] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:04:39.574411] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-16T17:04:39.582265] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T17:04:39.585238] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-16T17:04:40.296901] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T17:04:40.305885] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-16T17:04:40.325966] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T17:04:40.555121] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T17:04:40.679289] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T17:04:40.742852] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-16T17:04:41.423721] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T17:04:41.542864] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-16T17:04:42.287949] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T17:04:42.342802] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-16T17:04:43.026238] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T17:04:43.142843] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-16T17:04:43.942872] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-16T17:04:44.329093] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-16T17:04:44.430786] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T17:04:44.580445] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-16T17:04:44.742861] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-16T17:04:45.542823] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-16T17:04:46.342827] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-16T17:04:46.815965] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-16T17:04:46.949258] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T17:04:46.973177] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-16T17:04:47.142873] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-16T17:04:47.942827] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-16T17:04:48.742857] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-16T17:04:48.946600] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T17:04:49.439399] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-16T17:04:49.542833] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-16T17:04:49.901309] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T17:04:50.128146] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-16T17:04:50.342816] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-16T17:04:50.947790] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T17:04:51.142807] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-16T17:04:51.942819] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-16T17:04:52.571429] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T17:04:52.742902] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-16T17:04:53.542875] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-16T17:04:53.586159] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T17:04:54.078802] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-16T17:04:54.282121] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T17:04:54.342812] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-16T17:04:55.142776] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-16T17:04:55.212946] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T17:04:55.942841] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-16T17:04:56.742824] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-16T17:04:57.170377] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-16T17:04:57.255250] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T17:04:57.542821] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-16T17:04:58.068564] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T17:04:58.342834] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-16T17:04:58.461122] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T17:04:58.462983] [INFO ] [REMOTE ] AFB: Full fetch complete (16517 records). [2025-10-16T17:04:58.463057] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-16T17:04:58.817572] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-16T17:04:58.817676] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-16T17:04:58.817942] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-16T17:04:58.817983] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-16T17:04:58.818538] [DEBUG] [LOCAL ] AFB: Trimmed 16517 records to 11274 (keeping 200 days of data) [2025-10-16T17:04:58.885412] [DEBUG] [LOCAL ] AFB: Primary data saved (11274 records). [2025-10-16T17:04:58.885545] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-16T17:04:58.885614] [INFO ] [MAIN ] Update Progress: 42/2369 symbols completed. AFB took 22.8s. Estimated remaining: 4h 32m 35s. Rate: 8.5 symbols/min [2025-10-16T17:04:59.057640] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:04:59.057863] [DEBUG] [LOCAL ] AFGB: No existing data file found in primary storage. [2025-10-16T17:04:59.057918] [WARN ] [MAIN ] AFGB: No existing data found, performing full refresh instead. [2025-10-16T17:04:59.058056] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-16T17:04:59.058111] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-16T17:04:59.058157] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-16T17:04:59.058192] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-16T17:04:59.151098] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-16T17:04:59.432032] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:04:59.662121] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T17:04:59.942827] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-16T17:05:00.349108] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T17:05:00.742826] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-16T17:05:01.400901] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T17:05:01.513627] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T17:05:01.542781] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-16T17:05:02.343010] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-16T17:05:03.133757] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T17:05:03.142759] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-16T17:05:03.725502] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T17:05:03.942811] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-16T17:05:04.636810] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-16T17:05:04.742878] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-16T17:05:05.542820] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-16T17:05:05.650120] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T17:05:05.731200] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T17:05:06.015891] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T17:05:06.342801] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-16T17:05:07.142808] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-16T17:05:07.942795] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-16T17:05:08.027356] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T17:05:08.037492] [INFO ] [REMOTE ] AESI: Full fetch complete (71329 records). [2025-10-16T17:05:08.037674] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-16T17:05:08.420477] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-16T17:05:08.420561] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-16T17:05:08.421267] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-16T17:05:08.421332] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-16T17:05:08.422752] [DEBUG] [LOCAL ] AESI: Trimmed 71329 records to 50127 (keeping 200 days of data) [2025-10-16T17:05:08.719791] [DEBUG] [LOCAL ] AESI: Primary data saved (50127 records). [2025-10-16T17:05:08.719913] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-16T17:05:08.719989] [INFO ] [MAIN ] Update Progress: 43/2369 symbols completed. AESI took 32.7s. Estimated remaining: 4h 35m 0s. Rate: 8.5 symbols/min [2025-10-16T17:05:08.751012] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-16T17:05:08.907126] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:05:08.912778] [DEBUG] [LOCAL ] AFGC: Loaded 2561 existing records from primary storage. [2025-10-16T17:05:08.912976] [INFO ] [MAIN ] AFGC: Loaded 2561 existing records. [2025-10-16T17:05:09.154497] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T17:05:09.152942] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:05:09.168685] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-16T17:05:09.169736] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-16T17:05:09.172760] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-16T17:05:09.172880] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-16T17:05:09.172696] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-16T17:05:09.269493] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-16T17:05:09.549358] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-16T17:05:09.568294] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:05:10.342846] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-16T17:05:11.142856] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-16T17:05:11.480028] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T17:05:11.485223] [INFO ] [REMOTE ] AFG: Full fetch complete (46730 records). [2025-10-16T17:05:11.485420] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-16T17:05:11.594744] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-16T17:05:11.818203] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-16T17:05:11.925040] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-16T17:05:11.925113] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-16T17:05:11.925591] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-16T17:05:11.925631] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-16T17:05:11.926662] [DEBUG] [LOCAL ] AFG: Trimmed 46730 records to 32434 (keeping 200 days of data) [2025-10-16T17:05:11.980986] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-16T17:05:12.131294] [DEBUG] [LOCAL ] AFG: Primary data saved (32434 records). [2025-10-16T17:05:12.131486] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-16T17:05:12.131586] [INFO ] [MAIN ] Update Progress: 44/2369 symbols completed. AFG took 33.8s. Estimated remaining: 4h 31m 39s. Rate: 8.6 symbols/min [2025-10-16T17:05:12.304298] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:05:12.308438] [DEBUG] [LOCAL ] AFGD: Loaded 1772 existing records from primary storage. [2025-10-16T17:05:12.308596] [INFO ] [MAIN ] AFGD: Loaded 1772 existing records. [2025-10-16T17:05:12.487047] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:05:12.487281] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-16T17:05:12.487329] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-16T17:05:12.487454] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-16T17:05:12.487494] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-16T17:05:12.746846] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-16T17:05:12.780882] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-16T17:05:12.864690] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:05:13.542820] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-16T17:05:14.086581] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-16T17:05:14.342789] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-16T17:05:14.831134] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-16T17:05:14.832497] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-16T17:05:15.142819] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-16T17:05:15.942863] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-16T17:05:16.333930] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-16T17:05:16.742865] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-16T17:05:17.195636] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-16T17:05:17.357211] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-16T17:05:17.364058] [INFO ] [REMOTE ] AES: Full fetch complete (77847 records). [2025-10-16T17:05:17.364213] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-16T17:05:17.556778] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-16T17:05:17.756389] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-16T17:05:17.756478] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-16T17:05:17.757288] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-16T17:05:17.757358] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-16T17:05:17.758872] [DEBUG] [LOCAL ] AES: Trimmed 77847 records to 54059 (keeping 200 days of data) [2025-10-16T17:05:17.974797] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-16T17:05:18.094125] [DEBUG] [LOCAL ] AES: Primary data saved (54059 records). [2025-10-16T17:05:18.094282] [INFO ] [MAIN ] AES: Full history saved. [2025-10-16T17:05:18.094367] [INFO ] [MAIN ] Update Progress: 45/2369 symbols completed. AES took 42.0s. Estimated remaining: 4h 30m 37s. Rate: 8.6 symbols/min [2025-10-16T17:05:18.270277] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:05:18.274961] [DEBUG] [LOCAL ] AFGE: Loaded 2374 existing records from primary storage. [2025-10-16T17:05:18.275137] [INFO ] [MAIN ] AFGE: Loaded 2374 existing records. [2025-10-16T17:05:18.347953] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-16T17:05:18.465315] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:05:18.465556] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-16T17:05:18.465607] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-16T17:05:18.465793] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-16T17:05:18.465851] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-16T17:05:18.866479] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:05:18.870500] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-16T17:05:19.142804] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-16T17:05:19.474143] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-16T17:05:19.942803] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-16T17:05:20.251581] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-16T17:05:20.742812] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-16T17:05:21.177377] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-16T17:05:21.542869] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-16T17:05:22.080365] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-16T17:05:22.342831] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-16T17:05:22.793426] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-16T17:05:23.142803] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-16T17:05:23.589242] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-16T17:05:23.942837] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-16T17:05:24.439869] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-16T17:05:24.742819] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-16T17:05:25.200112] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-16T17:05:25.542846] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-16T17:05:26.152146] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-16T17:05:26.342862] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-16T17:05:26.886998] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-16T17:05:26.887789] [INFO ] [REMOTE ] AFGB: Full fetch complete (3543 records). [2025-10-16T17:05:26.887857] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-16T17:05:26.888198] [FATAL] [VALIDATOR ] AFGB: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:05:26.888280] [FATAL] [MAIN ] AFGB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:05:26.888323] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:05:26.888362] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-16T17:05:26.888415] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-16T17:05:26.888449] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-10-16T17:05:26.888537] [DEBUG] [LOCAL ] AFGB: No derivative data file found to delete. [2025-10-16T17:05:26.888607] [INFO ] [MAIN ] Update Progress: 46/2369 symbols completed. AFGB took 28.0s. Estimated remaining: 4h 32m 2s. Rate: 8.5 symbols/min [2025-10-16T17:05:27.060485] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:05:27.112322] [DEBUG] [LOCAL ] AFL: Loaded 53190 existing records from primary storage. [2025-10-16T17:05:27.112636] [INFO ] [MAIN ] AFL: Loaded 53190 existing records. [2025-10-16T17:05:27.147946] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-16T17:05:27.302253] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:05:27.302468] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-16T17:05:27.302516] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-16T17:05:27.303441] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-16T17:05:27.303511] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-16T17:05:27.580729] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T17:05:27.666914] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:05:27.942809] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-16T17:05:28.355830] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T17:05:28.742813] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-16T17:05:29.301034] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-16T17:05:29.542857] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-16T17:05:29.975612] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-16T17:05:30.342865] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-16T17:05:31.142831] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-16T17:05:31.641184] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-16T17:05:31.942794] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-16T17:05:32.227731] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T17:05:32.515492] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T17:05:32.742851] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-16T17:05:33.183404] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T17:05:33.542808] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-16T17:05:33.949604] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-16T17:05:33.950415] [INFO ] [REMOTE ] AFGC: Full fetch complete (3666 records). [2025-10-16T17:05:33.950486] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-16T17:05:34.295938] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-16T17:05:34.296012] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-16T17:05:34.296131] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-16T17:05:34.296168] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-16T17:05:34.296503] [DEBUG] [LOCAL ] AFGC: Trimmed 3666 records to 2570 (keeping 200 days of data) [2025-10-16T17:05:34.312252] [DEBUG] [LOCAL ] AFGC: Primary data saved (2570 records). [2025-10-16T17:05:34.312337] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-16T17:05:34.312410] [INFO ] [MAIN ] Update Progress: 47/2369 symbols completed. AFGC took 25.6s. Estimated remaining: 4h 32m 14s. Rate: 8.5 symbols/min [2025-10-16T17:05:34.343735] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-16T17:05:34.481917] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:05:34.482070] [DEBUG] [LOCAL ] AG: No existing data file found in primary storage. [2025-10-16T17:05:34.482106] [WARN ] [MAIN ] AG: No existing data found, performing full refresh instead. [2025-10-16T17:05:34.482215] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-16T17:05:34.482256] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-16T17:05:34.482296] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-10-16T17:05:34.482328] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-16T17:05:34.825597] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:05:35.142813] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-16T17:05:35.831765] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T17:05:35.942777] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-16T17:05:36.057228] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T17:05:36.476091] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-16T17:05:36.742850] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-16T17:05:37.542822] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-16T17:05:37.966844] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-16T17:05:38.342831] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-16T17:05:38.466450] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T17:05:38.653183] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-16T17:05:39.142800] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-16T17:05:39.474098] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-16T17:05:39.942805] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-16T17:05:40.442591] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-16T17:05:40.742816] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-16T17:05:41.542854] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-16T17:05:41.881298] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-16T17:05:42.342801] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-16T17:05:42.712342] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-16T17:05:42.775686] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-16T17:05:43.142796] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-16T17:05:43.560588] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-16T17:05:43.942828] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-16T17:05:44.742830] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-16T17:05:45.542823] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-16T17:05:45.892062] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-16T17:05:45.931517] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-16T17:05:46.306382] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T17:05:46.342829] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-16T17:05:47.142850] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-16T17:05:47.942923] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-16T17:05:48.161510] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T17:05:48.654006] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T17:05:48.742836] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-16T17:05:49.107900] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-16T17:05:49.308832] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T17:05:49.542884] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-16T17:05:49.972636] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-16T17:05:49.973361] [INFO ] [REMOTE ] AFGD: Full fetch complete (2936 records). [2025-10-16T17:05:49.973429] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-16T17:05:50.346683] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-16T17:05:50.372044] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-16T17:05:50.372122] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-16T17:05:50.372261] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-16T17:05:50.372315] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-16T17:05:50.372753] [DEBUG] [LOCAL ] AFGD: Trimmed 2936 records to 1786 (keeping 200 days of data) [2025-10-16T17:05:50.383623] [DEBUG] [LOCAL ] AFGD: Primary data saved (1786 records). [2025-10-16T17:05:50.383714] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-16T17:05:50.383829] [INFO ] [MAIN ] Update Progress: 48/2369 symbols completed. AFGD took 38.3s. Estimated remaining: 4h 39m 24s. Rate: 8.3 symbols/min [2025-10-16T17:05:50.564054] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:05:50.606629] [DEBUG] [LOCAL ] AGCO: Loaded 42395 existing records from primary storage. [2025-10-16T17:05:50.606943] [INFO ] [MAIN ] AGCO: Loaded 42395 existing records. [2025-10-16T17:05:50.831107] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:05:50.831304] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-16T17:05:50.831351] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-16T17:05:50.831523] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-16T17:05:50.831563] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-16T17:05:51.147880] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-16T17:05:51.206786] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:05:51.942797] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-16T17:05:52.030468] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T17:05:52.190542] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-16T17:05:52.742817] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-16T17:05:53.177775] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-16T17:05:53.178513] [INFO ] [REMOTE ] AFGE: Full fetch complete (3395 records). [2025-10-16T17:05:53.178581] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-16T17:05:53.511419] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-16T17:05:53.564299] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-16T17:05:53.618700] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-16T17:05:53.618820] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-16T17:05:53.618975] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-16T17:05:53.619053] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-16T17:05:53.619415] [DEBUG] [LOCAL ] AFGE: Trimmed 3395 records to 2380 (keeping 200 days of data) [2025-10-16T17:05:53.634667] [DEBUG] [LOCAL ] AFGE: Primary data saved (2380 records). [2025-10-16T17:05:53.634766] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-16T17:05:53.634839] [INFO ] [MAIN ] Update Progress: 49/2369 symbols completed. AFGE took 35.5s. Estimated remaining: 4h 36m 9s. Rate: 8.4 symbols/min [2025-10-16T17:05:53.811265] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:05:53.829506] [DEBUG] [LOCAL ] AGD: Loaded 19317 existing records from primary storage. [2025-10-16T17:05:53.829774] [INFO ] [MAIN ] AGD: Loaded 19317 existing records. [2025-10-16T17:05:54.032098] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:05:54.032334] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-16T17:05:54.032407] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-16T17:05:54.032889] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-16T17:05:54.032948] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-16T17:05:54.347977] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-16T17:05:54.410277] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:05:55.142787] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-16T17:05:55.376786] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T17:05:55.942886] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-16T17:05:56.498561] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T17:05:56.664977] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-16T17:05:56.742827] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-16T17:05:57.543525] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-16T17:05:57.543455] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T17:05:58.342829] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-16T17:05:58.470569] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T17:05:59.142857] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-16T17:05:59.352460] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T17:05:59.395136] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T17:05:59.942864] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-16T17:06:00.668588] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T17:06:00.742777] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-16T17:06:01.196315] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T17:06:01.542812] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-16T17:06:02.342882] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-16T17:06:02.805183] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-16T17:06:03.020364] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T17:06:03.142786] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-16T17:06:03.211600] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T17:06:03.942822] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-16T17:06:04.637729] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T17:06:04.742813] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-16T17:06:05.542811] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-16T17:06:05.604673] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T17:06:06.176596] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T17:06:06.183365] [INFO ] [REMOTE ] AFL: Full fetch complete (77073 records). [2025-10-16T17:06:06.183471] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-16T17:06:06.354689] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-16T17:06:06.571341] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-16T17:06:06.571414] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-16T17:06:06.572159] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-16T17:06:06.572222] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-16T17:06:06.573561] [DEBUG] [LOCAL ] AFL: Trimmed 77073 records to 53580 (keeping 200 days of data) [2025-10-16T17:06:06.901387] [DEBUG] [LOCAL ] AFL: Primary data saved (53580 records). [2025-10-16T17:06:06.901546] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-16T17:06:06.902301] [INFO ] [MAIN ] Update Progress: 50/2369 symbols completed. AFL took 40.0s. Estimated remaining: 4h 40m 46s. Rate: 8.3 symbols/min [2025-10-16T17:06:07.070326] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:06:07.079311] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T17:06:07.127764] [DEBUG] [LOCAL ] AGI: Loaded 53424 existing records from primary storage. [2025-10-16T17:06:07.128061] [INFO ] [MAIN ] AGI: Loaded 53424 existing records. [2025-10-16T17:06:07.148419] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-16T17:06:07.307004] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:06:07.307187] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-16T17:06:07.307233] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-16T17:06:07.308152] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-16T17:06:07.308231] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-16T17:06:07.658575] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:06:07.830428] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-16T17:06:07.942774] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-16T17:06:08.184005] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T17:06:08.742876] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-16T17:06:09.542773] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-16T17:06:09.650971] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T17:06:10.342783] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-16T17:06:10.416585] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T17:06:10.536510] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T17:06:11.142816] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-16T17:06:11.937555] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T17:06:11.948009] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-16T17:06:12.529717] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T17:06:12.742817] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-16T17:06:13.542792] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-16T17:06:13.807989] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T17:06:14.213928] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-16T17:06:14.342851] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-16T17:06:14.991111] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T17:06:15.018491] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-16T17:06:15.142846] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-16T17:06:15.942811] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-16T17:06:16.706334] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T17:06:16.742791] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-16T17:06:17.080145] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T17:06:17.542821] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-16T17:06:18.167484] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T17:06:18.349743] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-16T17:06:18.351799] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T17:06:19.142813] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-16T17:06:19.942816] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-16T17:06:20.356850] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T17:06:20.360739] [INFO ] [REMOTE ] AGD: Full fetch complete (26579 records). [2025-10-16T17:06:20.360886] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-16T17:06:20.755005] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-16T17:06:20.752931] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-16T17:06:20.756280] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-16T17:06:20.756774] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-16T17:06:20.756858] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-16T17:06:20.758067] [DEBUG] [LOCAL ] AGD: Trimmed 26579 records to 19404 (keeping 200 days of data) [2025-10-16T17:06:20.779161] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-16T17:06:20.870154] [INFO ] [REMOTE ] AG: Full fetch complete (77780 records). [2025-10-16T17:06:20.895738] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-16T17:06:20.904681] [DEBUG] [LOCAL ] AGD: Primary data saved (19404 records). [2025-10-16T17:06:20.904920] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-16T17:06:20.905014] [INFO ] [MAIN ] Update Progress: 51/2369 symbols completed. AGD took 27.3s. Estimated remaining: 4h 45m 45s. Rate: 8.1 symbols/min [2025-10-16T17:06:21.210967] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:06:21.519065] [DEBUG] [LOCAL ] AGL: Loaded 52580 existing records from primary storage. [2025-10-16T17:06:21.541099] [INFO ] [MAIN ] AGL: Loaded 52580 existing records. [2025-10-16T17:06:21.541398] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-16T17:06:21.572260] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-16T17:06:21.578703] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-16T17:06:21.597502] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-16T17:06:21.659962] [DEBUG] [LOCAL ] AG: Trimmed 77780 records to 54033 (keeping 200 days of data) [2025-10-16T17:06:21.798242] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:06:21.825161] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-16T17:06:21.825894] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-16T17:06:21.834728] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-16T17:06:21.838847] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-16T17:06:21.899971] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-16T17:06:22.064394] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-16T17:06:22.392124] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:06:22.392472] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-16T17:06:22.476074] [DEBUG] [LOCAL ] AG: Primary data saved (54033 records). [2025-10-16T17:06:22.476246] [INFO ] [MAIN ] AG: Full history saved. [2025-10-16T17:06:22.476326] [INFO ] [MAIN ] Update Progress: 52/2369 symbols completed. AG took 48.2s. Estimated remaining: 4h 41m 18s. Rate: 8.2 symbols/min [2025-10-16T17:06:22.647057] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:06:22.660190] [DEBUG] [LOCAL ] AGM: Loaded 10719 existing records from primary storage. [2025-10-16T17:06:22.660460] [INFO ] [MAIN ] AGM: Loaded 10719 existing records. [2025-10-16T17:06:22.861565] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-16T17:06:22.874828] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:06:22.886562] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-16T17:06:22.886629] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-16T17:06:22.886895] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-16T17:06:22.886952] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-16T17:06:23.151939] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-16T17:06:23.231446] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:06:23.727679] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T17:06:23.942826] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-16T17:06:24.346706] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T17:06:24.742875] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-16T17:06:25.119862] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T17:06:25.532062] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T17:06:25.542766] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-16T17:06:26.059912] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T17:06:26.342804] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-16T17:06:27.147919] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-16T17:06:27.162482] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-16T17:06:27.171105] [INFO ] [REMOTE ] AGCO: Full fetch complete (61670 records). [2025-10-16T17:06:27.171259] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-16T17:06:27.561910] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-16T17:06:27.562040] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-16T17:06:27.562728] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-16T17:06:27.562819] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-16T17:06:27.564363] [DEBUG] [LOCAL ] AGCO: Trimmed 61670 records to 42651 (keeping 200 days of data) [2025-10-16T17:06:27.716341] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T17:06:27.862147] [DEBUG] [LOCAL ] AGCO: Primary data saved (42651 records). [2025-10-16T17:06:27.862238] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-16T17:06:27.863090] [INFO ] [MAIN ] Update Progress: 53/2369 symbols completed. AGCO took 37.5s. Estimated remaining: 4h 39m 48s. Rate: 8.3 symbols/min [2025-10-16T17:06:27.947957] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-16T17:06:28.038830] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:06:28.069179] [DEBUG] [LOCAL ] AGO: Loaded 27929 existing records from primary storage. [2025-10-16T17:06:28.069449] [INFO ] [MAIN ] AGO: Loaded 27929 existing records. [2025-10-16T17:06:28.186940] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T17:06:28.266882] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:06:28.267092] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-16T17:06:28.267140] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-16T17:06:28.267772] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-16T17:06:28.267830] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-16T17:06:28.627575] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:06:28.742856] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-16T17:06:29.418787] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T17:06:29.542815] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-16T17:06:29.923176] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T17:06:30.342860] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-16T17:06:31.142803] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-16T17:06:31.249053] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T17:06:31.369144] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T17:06:31.772463] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-16T17:06:31.942830] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-16T17:06:32.742850] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-16T17:06:33.424194] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-16T17:06:33.542822] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-16T17:06:33.750870] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T17:06:34.128461] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-16T17:06:34.342811] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-16T17:06:35.142796] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-16T17:06:35.447600] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T17:06:35.942825] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-16T17:06:36.742782] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-16T17:06:36.760318] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-16T17:06:37.439128] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-16T17:06:37.542822] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-16T17:06:38.065678] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T17:06:38.342833] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-16T17:06:39.142794] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-16T17:06:39.267621] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-16T17:06:39.339178] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-16T17:06:39.942798] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-16T17:06:39.960149] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T17:06:40.742873] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-16T17:06:41.406343] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T17:06:41.542831] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-16T17:06:41.841782] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T17:06:42.342878] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-16T17:06:43.142770] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-16T17:06:43.420389] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T17:06:43.638455] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-16T17:06:43.942867] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-16T17:06:44.740216] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-16T17:06:44.745036] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-16T17:06:44.974392] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T17:06:45.542771] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-16T17:06:45.590296] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T17:06:46.177066] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-16T17:06:46.342893] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-16T17:06:46.868794] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-16T17:06:47.142843] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-16T17:06:47.942844] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-16T17:06:48.605985] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-16T17:06:48.742788] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-16T17:06:49.008067] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T17:06:49.542863] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-16T17:06:50.342859] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-16T17:06:50.612317] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T17:06:50.695247] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T17:06:51.142881] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-16T17:06:51.658062] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T17:06:51.661237] [INFO ] [REMOTE ] AGM: Full fetch complete (13276 records). [2025-10-16T17:06:51.661357] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-16T17:06:51.948507] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-16T17:06:52.043575] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-16T17:06:52.043691] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-16T17:06:52.043941] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-16T17:06:52.043983] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-16T17:06:52.044730] [DEBUG] [LOCAL ] AGM: Trimmed 13276 records to 10792 (keeping 200 days of data) [2025-10-16T17:06:52.111212] [DEBUG] [LOCAL ] AGM: Primary data saved (10792 records). [2025-10-16T17:06:52.111349] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-16T17:06:52.111429] [INFO ] [MAIN ] Update Progress: 54/2369 symbols completed. AGM took 29.6s. Estimated remaining: 4h 51m 49s. Rate: 7.9 symbols/min [2025-10-16T17:06:52.277794] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:06:52.307266] [DEBUG] [LOCAL ] AGRO: Loaded 33087 existing records from primary storage. [2025-10-16T17:06:52.307523] [INFO ] [MAIN ] AGRO: Loaded 33087 existing records. [2025-10-16T17:06:52.485384] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:06:52.485760] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-16T17:06:52.485906] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-16T17:06:52.486547] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-16T17:06:52.486606] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-16T17:06:52.603900] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T17:06:52.747893] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-16T17:06:52.864444] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:06:53.542859] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-16T17:06:53.596254] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T17:06:53.603604] [INFO ] [REMOTE ] AGL: Full fetch complete (75889 records). [2025-10-16T17:06:53.603816] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-16T17:06:53.780790] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T17:06:54.035165] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-16T17:06:54.035258] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-16T17:06:54.036210] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-16T17:06:54.036283] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-16T17:06:54.037864] [DEBUG] [LOCAL ] AGL: Trimmed 75889 records to 52970 (keeping 200 days of data) [2025-10-16T17:06:54.344386] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-16T17:06:54.358997] [DEBUG] [LOCAL ] AGL: Primary data saved (52970 records). [2025-10-16T17:06:54.359097] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-16T17:06:54.359189] [INFO ] [MAIN ] Update Progress: 55/2369 symbols completed. AGL took 33.5s. Estimated remaining: 4h 47m 58s. Rate: 8.0 symbols/min [2025-10-16T17:06:54.588445] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:06:54.624956] [DEBUG] [LOCAL ] AGX: Loaded 32884 existing records from primary storage. [2025-10-16T17:06:54.625288] [INFO ] [MAIN ] AGX: Loaded 32884 existing records. [2025-10-16T17:06:54.818478] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:06:54.818716] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-16T17:06:54.818773] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-16T17:06:54.819167] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-16T17:06:54.819224] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-16T17:06:55.148620] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-16T17:06:55.173217] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:06:55.509490] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T17:06:55.950471] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T17:06:55.947508] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-16T17:06:56.337769] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T17:06:56.342249] [INFO ] [REMOTE ] AGO: Full fetch complete (39721 records). [2025-10-16T17:06:56.342396] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-16T17:06:56.722843] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-16T17:06:56.722967] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-16T17:06:56.723401] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-16T17:06:56.723444] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-16T17:06:56.724561] [DEBUG] [LOCAL ] AGO: Trimmed 39721 records to 28168 (keeping 200 days of data) [2025-10-16T17:06:56.777924] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-16T17:06:56.896461] [DEBUG] [LOCAL ] AGO: Primary data saved (28168 records). [2025-10-16T17:06:56.896635] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-16T17:06:56.896781] [INFO ] [MAIN ] Update Progress: 56/2369 symbols completed. AGO took 29.0s. Estimated remaining: 4h 44m 27s. Rate: 8.1 symbols/min [2025-10-16T17:06:57.064296] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:06:57.102296] [DEBUG] [LOCAL ] AHH: Loaded 40527 existing records from primary storage. [2025-10-16T17:06:57.102621] [INFO ] [MAIN ] AHH: Loaded 40527 existing records. [2025-10-16T17:06:57.294479] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:06:57.294705] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-16T17:06:57.294760] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-16T17:06:57.294956] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-16T17:06:57.295012] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-16T17:06:57.547903] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-16T17:06:57.649223] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:06:57.916146] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-16T17:06:57.923468] [INFO ] [REMOTE ] AGI: Full fetch complete (77257 records). [2025-10-16T17:06:57.923750] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-16T17:06:58.123898] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T17:06:58.357451] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-16T17:06:58.361309] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-16T17:06:58.362114] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-16T17:06:58.362887] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-16T17:06:58.362950] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-16T17:06:58.364370] [DEBUG] [LOCAL ] AGI: Trimmed 77257 records to 53813 (keeping 200 days of data) [2025-10-16T17:06:58.680949] [DEBUG] [LOCAL ] AGI: Primary data saved (53813 records). [2025-10-16T17:06:58.681093] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-16T17:06:58.681172] [INFO ] [MAIN ] Update Progress: 57/2369 symbols completed. AGI took 51.8s. Estimated remaining: 4h 40m 33s. Rate: 8.2 symbols/min [2025-10-16T17:06:58.849685] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:06:58.849979] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-16T17:06:58.850055] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-16T17:06:58.850164] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-16T17:06:58.850205] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-16T17:06:58.850246] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-16T17:06:58.850277] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-16T17:06:59.142869] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-16T17:06:59.144359] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T17:06:59.228311] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:06:59.942826] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-16T17:06:59.998698] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T17:07:00.254061] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:07:00.254519] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-16T17:07:00.254638] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:07:00.254752] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-16T17:07:00.254828] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:07:00.254914] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-16T17:07:00.254999] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-16T17:07:00.255050] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-16T17:07:00.255104] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-16T17:07:00.255171] [INFO ] [MAIN ] Update Progress: 58/2369 symbols completed. AHL took 1.6s. Estimated remaining: 4h 36m 38s. Rate: 8.4 symbols/min [2025-10-16T17:07:00.466706] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:07:00.490054] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T17:07:00.541730] [DEBUG] [LOCAL ] AHR: Loaded 49077 existing records from primary storage. [2025-10-16T17:07:00.542056] [INFO ] [MAIN ] AHR: Loaded 49077 existing records. [2025-10-16T17:07:00.736049] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:07:00.736298] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-16T17:07:00.736358] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-16T17:07:00.736669] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-16T17:07:00.736728] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-16T17:07:00.747984] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-16T17:07:01.091797] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:07:01.542863] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-16T17:07:02.342828] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-16T17:07:02.690808] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-16T17:07:03.131622] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T17:07:03.142775] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-16T17:07:03.905717] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T17:07:03.942820] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-16T17:07:04.663675] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T17:07:04.742773] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-16T17:07:05.316495] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T17:07:05.542814] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-16T17:07:05.854626] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T17:07:06.342812] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-16T17:07:07.133415] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T17:07:07.142783] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-16T17:07:07.939943] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T17:07:07.948922] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-16T17:07:08.238265] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T17:07:08.742828] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-16T17:07:09.130337] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T17:07:09.542828] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-16T17:07:10.224501] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T17:07:10.342804] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-16T17:07:11.093082] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T17:07:11.142819] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-16T17:07:11.440214] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T17:07:11.942818] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-16T17:07:12.458291] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T17:07:12.742811] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-16T17:07:12.930164] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T17:07:13.542817] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-16T17:07:14.276136] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T17:07:14.342802] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-16T17:07:15.142785] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-16T17:07:15.223220] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T17:07:15.733367] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:07:15.942840] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-16T17:07:16.641284] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T17:07:16.742821] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-16T17:07:16.920317] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T17:07:17.542810] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-16T17:07:18.275773] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T17:07:18.342773] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-16T17:07:18.854700] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-16T17:07:18.858841] [INFO ] [REMOTE ] AGRO: Full fetch complete (48987 records). [2025-10-16T17:07:18.858968] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-16T17:07:19.151768] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-16T17:07:19.245849] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-16T17:07:19.245934] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-16T17:07:19.246458] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-16T17:07:19.246498] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-16T17:07:19.247526] [DEBUG] [LOCAL ] AGRO: Trimmed 48987 records to 33278 (keeping 200 days of data) [2025-10-16T17:07:19.430714] [DEBUG] [LOCAL ] AGRO: Primary data saved (33278 records). [2025-10-16T17:07:19.430839] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-16T17:07:19.430918] [INFO ] [MAIN ] Update Progress: 59/2369 symbols completed. AGRO took 27.3s. Estimated remaining: 4h 44m 21s. Rate: 8.1 symbols/min [2025-10-16T17:07:19.608450] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:07:19.615614] [DEBUG] [LOCAL ] AHT: Loaded 6362 existing records from primary storage. [2025-10-16T17:07:19.615807] [INFO ] [MAIN ] AHT: Loaded 6362 existing records. [2025-10-16T17:07:19.799967] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:07:19.800269] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-16T17:07:19.800432] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-16T17:07:19.816175] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-16T17:07:19.817134] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T17:07:19.816590] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-16T17:07:19.948003] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-16T17:07:20.194229] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:07:20.721181] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T17:07:20.742764] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-16T17:07:21.524803] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T17:07:21.542780] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-16T17:07:21.752391] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T17:07:22.342812] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-16T17:07:22.952588] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T17:07:23.142868] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-16T17:07:23.956210] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-16T17:07:23.963313] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T17:07:24.574147] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T17:07:24.578418] [INFO ] [REMOTE ] AGX: Full fetch complete (48960 records). [2025-10-16T17:07:24.578573] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-16T17:07:24.743806] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-16T17:07:24.976683] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-16T17:07:24.976872] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-16T17:07:24.977401] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-16T17:07:24.977444] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-16T17:07:24.978468] [DEBUG] [LOCAL ] AGX: Trimmed 48960 records to 33089 (keeping 200 days of data) [2025-10-16T17:07:25.180746] [DEBUG] [LOCAL ] AGX: Primary data saved (33089 records). [2025-10-16T17:07:25.180873] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-16T17:07:25.180949] [INFO ] [MAIN ] Update Progress: 60/2369 symbols completed. AGX took 30.8s. Estimated remaining: 4h 43m 10s. Rate: 8.2 symbols/min [2025-10-16T17:07:25.346269] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:07:25.397758] [DEBUG] [LOCAL ] AI: Loaded 53765 existing records from primary storage. [2025-10-16T17:07:25.398136] [INFO ] [MAIN ] AI: Loaded 53765 existing records. [2025-10-16T17:07:25.569292] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-16T17:07:25.591073] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:07:25.592203] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-16T17:07:25.592409] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-16T17:07:25.599929] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-16T17:07:25.609984] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-16T17:07:25.657718] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T17:07:25.693186] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T17:07:25.978003] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:07:26.342846] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-16T17:07:27.142786] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-16T17:07:27.541732] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-16T17:07:27.595082] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T17:07:27.600294] [INFO ] [REMOTE ] AHH: Full fetch complete (59698 records). [2025-10-16T17:07:27.600391] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-16T17:07:27.731860] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-16T17:07:27.953823] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-16T17:07:28.007074] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-16T17:07:28.007149] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-16T17:07:28.007768] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-16T17:07:28.007831] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-16T17:07:28.009112] [DEBUG] [LOCAL ] AHH: Trimmed 59698 records to 40838 (keeping 200 days of data) [2025-10-16T17:07:28.240415] [DEBUG] [LOCAL ] AHH: Primary data saved (40838 records). [2025-10-16T17:07:28.240540] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-16T17:07:28.241172] [INFO ] [MAIN ] Update Progress: 61/2369 symbols completed. AHH took 31.3s. Estimated remaining: 4h 40m 20s. Rate: 8.2 symbols/min [2025-10-16T17:07:28.410216] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:07:28.460379] [DEBUG] [LOCAL ] AIG: Loaded 53470 existing records from primary storage. [2025-10-16T17:07:28.460699] [INFO ] [MAIN ] AIG: Loaded 53470 existing records. [2025-10-16T17:07:28.636437] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:07:28.636705] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-16T17:07:28.636761] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-16T17:07:28.637110] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-16T17:07:28.637158] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-16T17:07:28.747980] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-16T17:07:28.791397] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T17:07:29.001570] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:07:29.542831] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-16T17:07:30.147735] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T17:07:30.342895] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-16T17:07:30.472443] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T17:07:31.142809] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-16T17:07:31.956187] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-16T17:07:31.960518] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T17:07:32.320130] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-16T17:07:32.525917] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T17:07:32.742832] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-16T17:07:33.542821] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-16T17:07:34.167532] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T17:07:34.347905] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-16T17:07:34.364799] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:07:35.142895] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-16T17:07:35.942795] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-16T17:07:35.981417] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T17:07:36.743195] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-16T17:07:36.743013] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-16T17:07:37.486986] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-16T17:07:37.542786] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-16T17:07:38.342804] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-16T17:07:38.472967] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T17:07:39.142819] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-16T17:07:39.610949] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-16T17:07:39.942822] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-16T17:07:40.041516] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T17:07:40.443306] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-16T17:07:40.705008] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T17:07:40.742814] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-16T17:07:41.454032] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T17:07:41.542854] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-16T17:07:42.342840] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-16T17:07:43.103395] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T17:07:43.142886] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-16T17:07:43.942853] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-16T17:07:44.663631] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T17:07:44.748027] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-16T17:07:44.753100] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-16T17:07:44.907582] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T17:07:45.542808] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-16T17:07:46.070296] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T17:07:46.076552] [INFO ] [REMOTE ] AHR: Full fetch complete (70848 records). [2025-10-16T17:07:46.076745] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-16T17:07:46.350271] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-16T17:07:46.387029] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T17:07:46.421942] [INFO ] [REMOTE ] AHT: Full fetch complete (9173 records). [2025-10-16T17:07:46.431973] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-16T17:07:46.580922] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-16T17:07:46.581252] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-16T17:07:46.581989] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-16T17:07:46.587403] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-16T17:07:46.706638] [DEBUG] [LOCAL ] AHR: Trimmed 70848 records to 49438 (keeping 200 days of data) [2025-10-16T17:07:46.941183] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-16T17:07:46.941740] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-16T17:07:46.942288] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-16T17:07:46.942608] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-16T17:07:46.947271] [DEBUG] [LOCAL ] AHT: Trimmed 9173 records to 6425 (keeping 200 days of data) [2025-10-16T17:07:46.986196] [DEBUG] [LOCAL ] AHT: Primary data saved (6425 records). [2025-10-16T17:07:46.987761] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-16T17:07:46.988084] [INFO ] [MAIN ] Update Progress: 62/2369 symbols completed. AHT took 27.6s. Estimated remaining: 4h 47m 19s. Rate: 8.0 symbols/min [2025-10-16T17:07:47.155412] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-16T17:07:47.233106] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:07:47.270486] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-16T17:07:47.270826] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-16T17:07:47.271722] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-16T17:07:47.273640] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-16T17:07:47.276565] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-16T17:07:47.278484] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-16T17:07:47.719065] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:07:47.751346] [DEBUG] [LOCAL ] AHR: Primary data saved (49438 records). [2025-10-16T17:07:47.751485] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-16T17:07:47.752292] [INFO ] [MAIN ] Update Progress: 63/2369 symbols completed. AHR took 47.5s. Estimated remaining: 4h 43m 6s. Rate: 8.1 symbols/min [2025-10-16T17:07:47.917836] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:07:47.941345] [DEBUG] [LOCAL ] AIN: Loaded 24434 existing records from primary storage. [2025-10-16T17:07:47.941594] [INFO ] [MAIN ] AIN: Loaded 24434 existing records. [2025-10-16T17:07:47.972296] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-16T17:07:48.117934] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:07:48.118187] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-16T17:07:48.118237] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-16T17:07:48.118416] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-16T17:07:48.118455] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-16T17:07:48.277399] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:07:48.296872] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-16T17:07:48.297067] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:07:48.312380] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-16T17:07:48.332345] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:07:48.356162] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-16T17:07:48.364927] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-16T17:07:48.381817] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-16T17:07:48.402883] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-16T17:07:48.408604] [INFO ] [MAIN ] Update Progress: 64/2369 symbols completed. AII took 1.4s. Estimated remaining: 4h 38m 57s. Rate: 8.3 symbols/min [2025-10-16T17:07:48.486986] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:07:48.653986] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:07:48.684544] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-16T17:07:48.706144] [DEBUG] [LOCAL ] AIO: Loaded 13371 existing records from primary storage. [2025-10-16T17:07:48.706364] [INFO ] [MAIN ] AIO: Loaded 13371 existing records. [2025-10-16T17:07:48.747922] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-16T17:07:48.915220] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:07:48.917445] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-16T17:07:48.928232] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-16T17:07:48.928556] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-16T17:07:48.929534] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-16T17:07:48.929603] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-16T17:07:49.315346] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:07:49.542857] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-16T17:07:50.342838] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-16T17:07:50.534534] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T17:07:50.667087] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T17:07:51.142948] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-16T17:07:51.328453] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T17:07:51.942817] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-16T17:07:52.102763] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T17:07:52.742865] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-16T17:07:52.927855] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T17:07:53.542842] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-16T17:07:54.342855] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-16T17:07:55.053331] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T17:07:55.096244] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-16T17:07:55.142782] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-16T17:07:55.298502] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T17:07:55.942826] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-16T17:07:56.742911] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-16T17:07:56.833682] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T17:07:57.396181] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-16T17:07:57.542818] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-16T17:07:58.220406] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T17:07:58.342809] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-16T17:07:59.142878] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-16T17:07:59.942813] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-16T17:08:00.064380] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-16T17:08:00.123179] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-16T17:08:00.165083] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T17:08:00.742855] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-16T17:08:00.862753] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-16T17:08:01.542820] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-16T17:08:02.342845] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-16T17:08:03.043994] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T17:08:03.142799] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-16T17:08:03.444335] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-16T17:08:03.481778] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T17:08:03.942867] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-16T17:08:04.497454] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T17:08:04.742787] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-16T17:08:05.542787] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-16T17:08:05.575166] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T17:08:05.582142] [INFO ] [REMOTE ] AIG: Full fetch complete (77563 records). [2025-10-16T17:08:05.582283] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-16T17:08:05.986518] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-16T17:08:05.986689] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-16T17:08:05.987519] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-16T17:08:05.987585] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-16T17:08:05.989128] [DEBUG] [LOCAL ] AIG: Trimmed 77563 records to 53860 (keeping 200 days of data) [2025-10-16T17:08:06.345180] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-16T17:08:06.345758] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T17:08:06.362081] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-16T17:08:06.387491] [DEBUG] [LOCAL ] AIG: Primary data saved (53860 records). [2025-10-16T17:08:06.387631] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-16T17:08:06.388191] [INFO ] [MAIN ] Update Progress: 65/2369 symbols completed. AIG took 38.1s. Estimated remaining: 4h 45m 10s. Rate: 8.1 symbols/min [2025-10-16T17:08:06.558111] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:08:06.585633] [DEBUG] [LOCAL ] AIR: Loaded 28874 existing records from primary storage. [2025-10-16T17:08:06.585935] [INFO ] [MAIN ] AIR: Loaded 28874 existing records. [2025-10-16T17:08:06.764390] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:08:06.764692] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-16T17:08:06.764750] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-16T17:08:06.765065] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-16T17:08:06.765145] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-16T17:08:07.143686] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:08:07.143882] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-16T17:08:07.861884] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T17:08:07.942782] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-16T17:08:08.657524] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T17:08:08.742829] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-16T17:08:09.403311] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-16T17:08:09.542786] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-16T17:08:09.705093] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-16T17:08:09.712165] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-16T17:08:09.712287] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-16T17:08:10.105184] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-16T17:08:10.105265] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-16T17:08:10.106018] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-16T17:08:10.106080] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-16T17:08:10.107473] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 54155 (keeping 200 days of data) [2025-10-16T17:08:10.343325] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-16T17:08:10.429171] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-16T17:08:10.450804] [DEBUG] [LOCAL ] AI: Primary data saved (54155 records). [2025-10-16T17:08:10.450919] [INFO ] [MAIN ] AI: Full history saved. [2025-10-16T17:08:10.451540] [INFO ] [MAIN ] Update Progress: 66/2369 symbols completed. AI took 45.3s. Estimated remaining: 4h 43m 5s. Rate: 8.1 symbols/min [2025-10-16T17:08:10.618184] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:08:10.645894] [DEBUG] [LOCAL ] AIT: Loaded 26971 existing records from primary storage. [2025-10-16T17:08:10.646161] [INFO ] [MAIN ] AIT: Loaded 26971 existing records. [2025-10-16T17:08:10.824947] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:08:10.825159] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-16T17:08:10.825216] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-16T17:08:10.825455] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-16T17:08:10.825511] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-16T17:08:11.147906] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-16T17:08:11.192256] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:08:11.527245] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T17:08:11.942823] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-16T17:08:11.972599] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T17:08:12.742823] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-16T17:08:13.054990] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T17:08:13.542857] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-16T17:08:13.590587] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T17:08:14.300377] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T17:08:14.342815] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-16T17:08:15.142733] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-16T17:08:15.236820] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T17:08:15.243310] [INFO ] [REMOTE ] AIO: Full fetch complete (20149 records). [2025-10-16T17:08:15.244398] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-16T17:08:15.608844] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-16T17:08:15.608982] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-16T17:08:15.609319] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-16T17:08:15.609362] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-16T17:08:15.610105] [DEBUG] [LOCAL ] AIO: Trimmed 20149 records to 13450 (keeping 200 days of data) [2025-10-16T17:08:15.690964] [DEBUG] [LOCAL ] AIO: Primary data saved (13450 records). [2025-10-16T17:08:15.691108] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-16T17:08:15.691212] [INFO ] [MAIN ] Update Progress: 67/2369 symbols completed. AIO took 27.2s. Estimated remaining: 4h 41m 44s. Rate: 8.2 symbols/min [2025-10-16T17:08:15.865518] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:08:15.902996] [DEBUG] [LOCAL ] AIV: Loaded 41436 existing records from primary storage. [2025-10-16T17:08:15.903265] [INFO ] [MAIN ] AIV: Loaded 41436 existing records. [2025-10-16T17:08:15.947917] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-16T17:08:16.103231] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:08:16.103594] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-16T17:08:16.103709] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-16T17:08:16.104310] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-16T17:08:16.104384] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-16T17:08:16.297109] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T17:08:16.484252] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:08:16.742803] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-16T17:08:17.092089] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T17:08:17.542782] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-16T17:08:17.838131] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T17:08:18.342852] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-16T17:08:19.051970] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T17:08:19.142817] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-16T17:08:19.460299] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T17:08:19.942873] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-16T17:08:20.347158] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T17:08:20.742849] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-16T17:08:21.480121] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T17:08:21.542809] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-16T17:08:21.939455] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T17:08:22.342881] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-16T17:08:22.554357] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T17:08:23.142868] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-16T17:08:23.565254] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T17:08:23.942840] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-16T17:08:24.591507] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T17:08:24.742882] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-16T17:08:25.308929] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T17:08:25.542790] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-16T17:08:26.014681] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T17:08:26.342834] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-16T17:08:26.607073] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T17:08:27.134891] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-16T17:08:27.142762] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-16T17:08:27.942893] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-16T17:08:28.169842] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T17:08:28.742903] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-16T17:08:29.220585] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T17:08:29.224880] [INFO ] [REMOTE ] AIN: Full fetch complete (33645 records). [2025-10-16T17:08:29.225044] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-16T17:08:29.547938] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-16T17:08:29.701469] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-16T17:08:29.701568] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-16T17:08:29.702111] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-16T17:08:29.702177] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-16T17:08:29.703236] [DEBUG] [LOCAL ] AIN: Trimmed 33645 records to 24655 (keeping 200 days of data) [2025-10-16T17:08:29.870495] [DEBUG] [LOCAL ] AIN: Primary data saved (24655 records). [2025-10-16T17:08:29.870672] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-16T17:08:29.870778] [INFO ] [MAIN ] Update Progress: 68/2369 symbols completed. AIN took 42.1s. Estimated remaining: 4h 45m 28s. Rate: 8.1 symbols/min [2025-10-16T17:08:30.084705] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:08:30.118099] [DEBUG] [LOCAL ] AIZ: Loaded 29532 existing records from primary storage. [2025-10-16T17:08:30.118388] [INFO ] [MAIN ] AIZ: Loaded 29532 existing records. [2025-10-16T17:08:30.341425] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:08:30.341698] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-16T17:08:30.341831] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-16T17:08:30.342097] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-16T17:08:30.342249] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-16T17:08:30.347871] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-16T17:08:30.497508] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T17:08:30.805195] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:08:30.823743] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-16T17:08:31.142866] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-16T17:08:31.942839] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-16T17:08:32.003298] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T17:08:32.637363] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:08:32.742797] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-16T17:08:33.250118] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-16T17:08:33.542864] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-16T17:08:33.726412] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T17:08:34.342781] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-16T17:08:34.803341] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T17:08:35.142826] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-16T17:08:35.666362] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T17:08:35.671311] [INFO ] [REMOTE ] AIR: Full fetch complete (40269 records). [2025-10-16T17:08:35.671398] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-16T17:08:35.951902] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-16T17:08:36.044712] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-16T17:08:36.044907] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-16T17:08:36.045492] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-16T17:08:36.045568] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-16T17:08:36.046776] [DEBUG] [LOCAL ] AIR: Trimmed 40269 records to 29128 (keeping 200 days of data) [2025-10-16T17:08:36.162043] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T17:08:36.240847] [DEBUG] [LOCAL ] AIR: Primary data saved (29128 records). [2025-10-16T17:08:36.240948] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-16T17:08:36.241022] [INFO ] [MAIN ] Update Progress: 69/2369 symbols completed. AIR took 29.9s. Estimated remaining: 4h 44m 45s. Rate: 8.1 symbols/min [2025-10-16T17:08:36.405767] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:08:36.411811] [DEBUG] [LOCAL ] AIZN: Loaded 3961 existing records from primary storage. [2025-10-16T17:08:36.411965] [INFO ] [MAIN ] AIZN: Loaded 3961 existing records. [2025-10-16T17:08:36.589569] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:08:36.589784] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-16T17:08:36.589832] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-16T17:08:36.589959] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-16T17:08:36.589997] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-16T17:08:36.742792] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-16T17:08:36.942062] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:08:37.331171] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T17:08:37.542844] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-16T17:08:37.868091] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T17:08:38.342818] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-16T17:08:38.641943] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T17:08:39.142823] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-16T17:08:39.497970] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T17:08:39.785141] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-16T17:08:39.942802] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-16T17:08:40.486300] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-16T17:08:40.742819] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-16T17:08:41.542822] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-16T17:08:41.985167] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T17:08:42.342852] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-16T17:08:42.490522] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T17:08:43.142886] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-16T17:08:43.488792] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T17:08:43.942834] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-16T17:08:44.742821] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-16T17:08:44.795918] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T17:08:45.322599] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T17:08:45.542858] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-16T17:08:45.941877] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T17:08:45.945633] [INFO ] [REMOTE ] AIT: Full fetch complete (39238 records). [2025-10-16T17:08:45.945824] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-16T17:08:46.342952] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-16T17:08:46.343418] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-16T17:08:46.344415] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-16T17:08:46.344956] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-16T17:08:46.345020] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-16T17:08:46.346160] [DEBUG] [LOCAL ] AIT: Trimmed 39238 records to 27175 (keeping 200 days of data) [2025-10-16T17:08:46.533237] [DEBUG] [LOCAL ] AIT: Primary data saved (27175 records). [2025-10-16T17:08:46.533441] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-16T17:08:46.533566] [INFO ] [MAIN ] Update Progress: 70/2369 symbols completed. AIT took 36.1s. Estimated remaining: 4h 46m 12s. Rate: 8.0 symbols/min [2025-10-16T17:08:46.743309] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:08:46.768624] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T17:08:46.772352] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-16T17:08:46.825240] [DEBUG] [LOCAL ] AJG: Loaded 46536 existing records from primary storage. [2025-10-16T17:08:46.825610] [INFO ] [MAIN ] AJG: Loaded 46536 existing records. [2025-10-16T17:08:46.997424] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:08:46.997690] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-16T17:08:46.997748] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-16T17:08:46.998092] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-16T17:08:46.998146] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-16T17:08:47.145628] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-16T17:08:47.347833] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:08:47.942815] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-16T17:08:48.513106] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-16T17:08:48.753692] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-16T17:08:48.759093] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T17:08:49.542827] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-16T17:08:50.342864] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-16T17:08:50.588471] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T17:08:50.637243] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T17:08:51.007135] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-16T17:08:51.142878] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-16T17:08:51.728071] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T17:08:51.942854] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-16T17:08:52.742876] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-16T17:08:53.542800] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-16T17:08:53.698870] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-16T17:08:53.704948] [INFO ] [REMOTE ] AIV: Full fetch complete (60346 records). [2025-10-16T17:08:53.705058] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-16T17:08:53.980006] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T17:08:54.124530] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-16T17:08:54.124620] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-16T17:08:54.125362] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-16T17:08:54.125445] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-16T17:08:54.126929] [DEBUG] [LOCAL ] AIV: Trimmed 60346 records to 41824 (keeping 200 days of data) [2025-10-16T17:08:54.246104] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T17:08:54.353576] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-16T17:08:54.396712] [DEBUG] [LOCAL ] AIV: Primary data saved (41824 records). [2025-10-16T17:08:54.396809] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-16T17:08:54.396886] [INFO ] [MAIN ] Update Progress: 71/2369 symbols completed. AIV took 38.7s. Estimated remaining: 4h 46m 17s. Rate: 8.0 symbols/min [2025-10-16T17:08:54.565255] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:08:54.565442] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-16T17:08:54.565481] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-16T17:08:54.565590] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-16T17:08:54.565663] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-16T17:08:54.565742] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-16T17:08:54.565806] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-16T17:08:54.921485] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:08:55.142836] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-16T17:08:55.673957] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-16T17:08:55.941900] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T17:08:55.950537] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-16T17:08:56.500982] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T17:08:56.742845] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-16T17:08:57.542819] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-16T17:08:58.026238] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T17:08:58.226057] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T17:08:58.342837] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-16T17:08:59.142858] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-16T17:08:59.592260] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T17:08:59.951904] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-16T17:08:59.970697] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T17:09:00.742806] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-16T17:09:01.237872] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-16T17:09:01.326298] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T17:09:01.542789] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-16T17:09:02.342880] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-16T17:09:03.142862] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-16T17:09:03.536088] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T17:09:03.575071] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-16T17:09:03.700358] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-16T17:09:03.942817] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-16T17:09:04.637540] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T17:09:04.638738] [INFO ] [REMOTE ] AIZN: Full fetch complete (5885 records). [2025-10-16T17:09:04.638809] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-16T17:09:04.748173] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-16T17:09:05.001302] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-16T17:09:05.001384] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-16T17:09:05.001546] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-16T17:09:05.001589] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-16T17:09:05.001985] [DEBUG] [LOCAL ] AIZN: Trimmed 5885 records to 3972 (keeping 200 days of data) [2025-10-16T17:09:05.026410] [DEBUG] [LOCAL ] AIZN: Primary data saved (3972 records). [2025-10-16T17:09:05.026528] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-16T17:09:05.026608] [INFO ] [MAIN ] Update Progress: 72/2369 symbols completed. AIZN took 28.8s. Estimated remaining: 4h 47m 50s. Rate: 8.0 symbols/min [2025-10-16T17:09:05.205259] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:09:05.248168] [DEBUG] [LOCAL ] AKR: Loaded 46096 existing records from primary storage. [2025-10-16T17:09:05.248505] [INFO ] [MAIN ] AKR: Loaded 46096 existing records. [2025-10-16T17:09:05.430771] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:09:05.430964] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-16T17:09:05.431019] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-16T17:09:05.431447] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-16T17:09:05.431502] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-16T17:09:05.547983] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-16T17:09:05.790522] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:09:05.813980] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T17:09:06.342873] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-16T17:09:07.142888] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-16T17:09:07.208936] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-16T17:09:07.650203] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T17:09:07.756583] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T17:09:07.942816] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-16T17:09:08.742815] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-16T17:09:09.254889] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T17:09:09.542795] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-16T17:09:10.119848] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T17:09:10.119369] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-16T17:09:10.125015] [INFO ] [REMOTE ] AIZ: Full fetch complete (42823 records). [2025-10-16T17:09:10.125119] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-16T17:09:10.347877] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-16T17:09:10.532726] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-16T17:09:10.532807] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-16T17:09:10.533273] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-16T17:09:10.533311] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-16T17:09:10.534207] [DEBUG] [LOCAL ] AIZ: Trimmed 42823 records to 29712 (keeping 200 days of data) [2025-10-16T17:09:10.713562] [DEBUG] [LOCAL ] AIZ: Primary data saved (29712 records). [2025-10-16T17:09:10.713718] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-16T17:09:10.713805] [INFO ] [MAIN ] Update Progress: 73/2369 symbols completed. AIZ took 40.8s. Estimated remaining: 4h 46m 45s. Rate: 8.0 symbols/min [2025-10-16T17:09:10.882819] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:09:10.922604] [DEBUG] [LOCAL ] AL: Loaded 44699 existing records from primary storage. [2025-10-16T17:09:10.922918] [INFO ] [MAIN ] AL: Loaded 44699 existing records. [2025-10-16T17:09:11.124526] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:09:11.128324] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-16T17:09:11.128434] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-16T17:09:11.129293] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T17:09:11.129355] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-16T17:09:11.129554] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-16T17:09:11.144268] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-16T17:09:11.532971] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:09:11.670600] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-16T17:09:11.942805] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-16T17:09:12.742835] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-16T17:09:13.344368] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T17:09:13.542858] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-16T17:09:14.342796] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-16T17:09:14.433605] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T17:09:14.612063] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-16T17:09:15.142860] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-16T17:09:15.514868] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-16T17:09:15.517967] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T17:09:15.942876] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-16T17:09:16.742821] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-16T17:09:17.092533] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-16T17:09:17.509819] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T17:09:17.542787] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-16T17:09:18.342822] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-16T17:09:18.911295] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-16T17:09:19.140162] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T17:09:19.141203] [INFO ] [REMOTE ] AKA: Full fetch complete (2615 records). [2025-10-16T17:09:19.141273] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-16T17:09:19.152466] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-16T17:09:19.323773] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-16T17:09:19.323995] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:09:19.324068] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:09:19.324138] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-16T17:09:19.324204] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-16T17:09:19.324240] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-16T17:09:19.324277] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-16T17:09:19.324331] [INFO ] [MAIN ] Update Progress: 74/2369 symbols completed. AKA took 24.9s. Estimated remaining: 4h 47m 12s. Rate: 8.0 symbols/min [2025-10-16T17:09:19.494423] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:09:19.542720] [DEBUG] [LOCAL ] ALB: Loaded 53343 existing records from primary storage. [2025-10-16T17:09:19.543052] [INFO ] [MAIN ] ALB: Loaded 53343 existing records. [2025-10-16T17:09:19.719304] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:09:19.719538] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-16T17:09:19.719584] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-16T17:09:19.719967] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-16T17:09:19.720034] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-16T17:09:19.955046] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-16T17:09:20.081968] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:09:20.742849] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-16T17:09:20.926716] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-16T17:09:20.932502] [INFO ] [REMOTE ] AJG: Full fetch complete (69062 records). [2025-10-16T17:09:20.932612] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-16T17:09:21.335749] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-16T17:09:21.335892] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-16T17:09:21.337105] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-16T17:09:21.337176] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-16T17:09:21.338663] [DEBUG] [LOCAL ] AJG: Trimmed 69062 records to 46920 (keeping 200 days of data) [2025-10-16T17:09:21.471760] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T17:09:21.563925] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-16T17:09:21.677405] [DEBUG] [LOCAL ] AJG: Primary data saved (46920 records). [2025-10-16T17:09:21.677536] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-16T17:09:21.677612] [INFO ] [MAIN ] Update Progress: 75/2369 symbols completed. AJG took 35.1s. Estimated remaining: 4h 44m 27s. Rate: 8.1 symbols/min [2025-10-16T17:09:21.845448] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:09:21.895050] [DEBUG] [LOCAL ] ALC: Loaded 51181 existing records from primary storage. [2025-10-16T17:09:21.895353] [INFO ] [MAIN ] ALC: Loaded 51181 existing records. [2025-10-16T17:09:22.080543] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:09:22.080854] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-16T17:09:22.080942] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-16T17:09:22.088881] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-16T17:09:22.102059] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-16T17:09:22.147237] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T17:09:22.351732] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-16T17:09:22.467473] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:09:22.815113] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T17:09:23.142859] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-16T17:09:23.942820] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-16T17:09:24.748672] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-16T17:09:24.753382] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T17:09:24.873031] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-16T17:09:25.465048] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T17:09:25.542835] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-16T17:09:26.347897] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-16T17:09:26.361450] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T17:09:27.082252] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T17:09:27.142768] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-16T17:09:27.942819] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-16T17:09:28.271741] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-16T17:09:28.389051] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-16T17:09:28.742817] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-16T17:09:29.553092] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-16T17:09:29.558121] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:09:30.342783] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-16T17:09:30.607117] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-16T17:09:30.700245] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T17:09:31.142817] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-16T17:09:31.843164] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T17:09:31.942874] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-16T17:09:32.709960] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T17:09:32.742768] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-16T17:09:33.352355] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T17:09:33.542784] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-16T17:09:34.342806] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-16T17:09:34.552123] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T17:09:35.109955] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T17:09:35.142840] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-16T17:09:35.942822] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-16T17:09:35.992008] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T17:09:36.742822] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-16T17:09:36.832032] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T17:09:37.246682] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-16T17:09:37.542810] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-16T17:09:38.342794] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-16T17:09:38.621905] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-16T17:09:38.693946] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T17:09:39.142852] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-16T17:09:39.942865] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-16T17:09:40.210794] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T17:09:40.443335] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T17:09:40.742815] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-16T17:09:41.542787] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-16T17:09:41.690501] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T17:09:42.342796] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-16T17:09:42.397091] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T17:09:42.403183] [INFO ] [REMOTE ] AL: Full fetch complete (63480 records). [2025-10-16T17:09:42.403301] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-16T17:09:42.787195] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-16T17:09:42.787299] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-16T17:09:42.788010] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-16T17:09:42.788075] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-16T17:09:42.789372] [DEBUG] [LOCAL ] AL: Trimmed 63480 records to 45074 (keeping 200 days of data) [2025-10-16T17:09:43.066068] [DEBUG] [LOCAL ] AL: Primary data saved (45074 records). [2025-10-16T17:09:43.066219] [INFO ] [MAIN ] AL: Full history saved. [2025-10-16T17:09:43.066351] [INFO ] [MAIN ] Update Progress: 76/2369 symbols completed. AL took 32.4s. Estimated remaining: 4h 51m 21s. Rate: 7.9 symbols/min [2025-10-16T17:09:43.148128] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-16T17:09:43.277165] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:09:43.310383] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-16T17:09:43.360099] [DEBUG] [LOCAL ] ALE: Loaded 31952 existing records from primary storage. [2025-10-16T17:09:43.360472] [INFO ] [MAIN ] ALE: Loaded 31952 existing records. [2025-10-16T17:09:43.623512] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:09:43.623814] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-16T17:09:43.623880] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-16T17:09:43.624226] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-16T17:09:43.624288] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-16T17:09:43.950418] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-16T17:09:44.158099] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:09:44.724731] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-16T17:09:44.742773] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-16T17:09:44.887722] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T17:09:45.224254] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-16T17:09:45.542894] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-16T17:09:46.342923] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-16T17:09:46.905059] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-16T17:09:47.142814] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-16T17:09:47.214047] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T17:09:47.760392] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T17:09:47.942805] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-16T17:09:48.742771] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-16T17:09:49.135089] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T17:09:49.485560] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-16T17:09:49.542810] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-16T17:09:50.042053] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T17:09:50.048194] [INFO ] [REMOTE ] AKR: Full fetch complete (65467 records). [2025-10-16T17:09:50.048305] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-16T17:09:50.347925] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-16T17:09:50.434118] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-16T17:09:50.434192] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-16T17:09:50.434864] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-16T17:09:50.434962] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-16T17:09:50.436225] [DEBUG] [LOCAL ] AKR: Trimmed 65467 records to 46457 (keeping 200 days of data) [2025-10-16T17:09:50.718726] [DEBUG] [LOCAL ] AKR: Primary data saved (46457 records). [2025-10-16T17:09:50.718865] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-16T17:09:50.719290] [INFO ] [MAIN ] Update Progress: 77/2369 symbols completed. AKR took 45.7s. Estimated remaining: 4h 51m 14s. Rate: 7.9 symbols/min [2025-10-16T17:09:51.142844] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-16T17:09:51.795191] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T17:09:51.870911] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-16T17:09:51.877725] [INFO ] [REMOTE ] ALB: Full fetch complete (77067 records). [2025-10-16T17:09:51.877838] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-16T17:09:51.947974] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-16T17:09:52.297552] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-16T17:09:52.297670] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-16T17:09:52.298458] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-16T17:09:52.298520] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-16T17:09:52.299902] [DEBUG] [LOCAL ] ALB: Trimmed 77067 records to 53733 (keeping 200 days of data) [2025-10-16T17:09:52.620416] [DEBUG] [LOCAL ] ALB: Primary data saved (53733 records). [2025-10-16T17:09:52.620560] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-16T17:09:52.620688] [INFO ] [MAIN ] Update Progress: 78/2369 symbols completed. ALB took 33.3s. Estimated remaining: 4h 48m 18s. Rate: 7.9 symbols/min [2025-10-16T17:09:52.923833] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T17:09:52.934400] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-16T17:09:53.082103] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T17:09:53.542906] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-16T17:09:54.563574] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T17:09:54.575027] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-16T17:09:54.590897] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T17:09:55.142890] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-16T17:09:56.335107] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T17:09:56.347564] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-16T17:09:56.429597] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T17:09:56.742860] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-16T17:09:57.959379] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T17:09:57.968227] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-16T17:09:58.073209] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T17:09:58.342871] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-16T17:09:58.972625] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T17:09:59.142873] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-16T17:09:59.748768] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T17:09:59.755760] [INFO ] [REMOTE ] ALC: Full fetch complete (73621 records). [2025-10-16T17:09:59.755912] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-16T17:10:00.145575] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-16T17:10:00.145766] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-16T17:10:00.146497] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-16T17:10:00.146540] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-16T17:10:00.147869] [DEBUG] [LOCAL ] ALC: Trimmed 73621 records to 51569 (keeping 200 days of data) [2025-10-16T17:10:00.442606] [DEBUG] [LOCAL ] ALC: Primary data saved (51569 records). [2025-10-16T17:10:00.442758] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-16T17:10:00.442855] [INFO ] [MAIN ] Update Progress: 79/2369 symbols completed. ALC took 38.8s. Estimated remaining: 4h 48m 18s. Rate: 7.9 symbols/min [2025-10-16T17:10:00.626763] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T17:10:00.634518] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-16T17:10:02.072372] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T17:10:02.080180] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-16T17:10:03.590236] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T17:10:03.598152] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-16T17:10:05.092906] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T17:10:05.098042] [INFO ] [REMOTE ] ALE: Full fetch complete (43919 records). [2025-10-16T17:10:05.098126] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-16T17:10:05.466593] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-16T17:10:05.466691] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-16T17:10:05.467182] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-16T17:10:05.467223] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-16T17:10:05.468076] [DEBUG] [LOCAL ] ALE: Trimmed 43919 records to 32255 (keeping 200 days of data) [2025-10-16T17:10:05.654340] [DEBUG] [LOCAL ] ALE: Primary data saved (32255 records). [2025-10-16T17:10:05.654465] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-16T17:10:05.654544] [INFO ] [MAIN ] Update Progress: 80/2369 symbols completed. ALE took 22.6s. Estimated remaining: 4h 47m 4s. Rate: 8.0 symbols/min [2025-10-16T17:10:06.191456] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:06.315253] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-16T17:10:06.331809] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-16T17:10:06.340155] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:06.374206] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:06.374298] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-16T17:10:06.375026] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-16T17:10:06.375889] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:06.376780] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-16T17:10:06.376867] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-16T17:10:06.503931] [DEBUG] [LOCAL ] ALG: Loaded 9756 existing records from primary storage. [2025-10-16T17:10:06.534772] [INFO ] [MAIN ] ALG: Loaded 9756 existing records. [2025-10-16T17:10:06.528865] [DEBUG] [LOCAL ] ALEX: Loaded 31156 existing records from primary storage. [2025-10-16T17:10:06.588378] [INFO ] [MAIN ] ALEX: Loaded 31156 existing records. [2025-10-16T17:10:06.838987] [DEBUG] [LOCAL ] ALIT: Loaded 52788 existing records from primary storage. [2025-10-16T17:10:06.909997] [INFO ] [MAIN ] ALIT: Loaded 52788 existing records. [2025-10-16T17:10:07.164968] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:10:07.205066] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-16T17:10:07.261682] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-16T17:10:07.335917] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:10:07.385000] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-16T17:10:07.395451] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:10:07.400580] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-16T17:10:07.400377] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-16T17:10:07.400789] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-16T17:10:07.400723] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-16T17:10:07.421820] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-16T17:10:07.422046] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-16T17:10:07.422180] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-16T17:10:07.421748] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:07.467439] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-16T17:10:07.481944] [INFO ] [REMOTE ] ALH: Fetching primary data for 2024-12. [2025-10-16T17:10:07.494054] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-16T17:10:07.978474] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:10:08.084219] [WARN ] [REMOTE ] ALH: No data returned for month 2024-12 [2025-10-16T17:10:08.177794] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:10:08.214893] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-16T17:10:08.265735] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:10:08.359508] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-16T17:10:08.396042] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-16T17:10:08.553738] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:08.432947] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-16T17:10:08.569945] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-16T17:10:08.575476] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-16T17:10:08.575223] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:08.588007] [INFO ] [MAIN ] Update Progress: 81/2369 symbols completed. ALH took 2.9s. Estimated remaining: 4h 44m 47s. Rate: 8.0 symbols/min [2025-10-16T17:10:08.598859] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-16T17:10:08.687069] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:08.723422] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-16T17:10:08.862809] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:08.913145] [DEBUG] [LOCAL ] ALK: Loaded 53081 existing records from primary storage. [2025-10-16T17:10:08.913555] [INFO ] [MAIN ] ALK: Loaded 53081 existing records. [2025-10-16T17:10:09.122364] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:10:09.122597] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-16T17:10:09.122689] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-16T17:10:09.123291] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-16T17:10:09.123347] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-16T17:10:09.483188] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:09.483506] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-16T17:10:09.692141] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T17:10:09.695023] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-16T17:10:10.296971] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T17:10:10.307576] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-16T17:10:10.515897] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T17:10:10.520184] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-16T17:10:10.675911] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-16T17:10:10.683120] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-16T17:10:11.131015] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-16T17:10:11.133851] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-16T17:10:11.397310] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-16T17:10:11.409581] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-16T17:10:11.523289] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T17:10:11.529900] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-16T17:10:11.712298] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T17:10:11.893459] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-16T17:10:11.942802] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-16T17:10:12.742797] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-16T17:10:12.792075] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T17:10:12.831528] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T17:10:12.937861] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T17:10:13.542854] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-16T17:10:14.287219] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T17:10:14.342785] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-16T17:10:15.142774] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-16T17:10:15.230705] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T17:10:15.942787] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-16T17:10:16.024176] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T17:10:16.221134] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-16T17:10:16.742840] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-16T17:10:17.461496] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T17:10:17.542788] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-16T17:10:18.051354] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T17:10:18.342816] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-16T17:10:19.013540] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T17:10:19.142808] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-16T17:10:19.731477] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T17:10:19.942830] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-16T17:10:20.639830] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T17:10:20.742801] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-16T17:10:21.542787] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-16T17:10:21.955816] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-16T17:10:22.342782] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-16T17:10:22.573579] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T17:10:22.697044] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-16T17:10:23.117316] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T17:10:23.142819] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-16T17:10:23.793206] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-16T17:10:23.942806] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-16T17:10:24.510008] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T17:10:24.742835] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-16T17:10:25.491610] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T17:10:25.542776] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-16T17:10:26.342813] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-16T17:10:26.794532] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T17:10:27.142812] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-16T17:10:27.744282] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T17:10:27.942880] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-16T17:10:28.742809] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-16T17:10:28.773905] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T17:10:28.856674] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-16T17:10:29.542827] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-16T17:10:30.343138] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-16T17:10:30.521281] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T17:10:30.969716] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T17:10:31.142867] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-16T17:10:31.206997] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T17:10:31.209149] [INFO ] [REMOTE ] ALG: Full fetch complete (15332 records). [2025-10-16T17:10:31.209257] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-16T17:10:31.589163] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-16T17:10:31.589267] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-16T17:10:31.589567] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-16T17:10:31.589628] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-16T17:10:31.590252] [DEBUG] [LOCAL ] ALG: Trimmed 15332 records to 9812 (keeping 200 days of data) [2025-10-16T17:10:31.652156] [DEBUG] [LOCAL ] ALG: Primary data saved (9812 records). [2025-10-16T17:10:31.652297] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-16T17:10:31.652375] [INFO ] [MAIN ] Update Progress: 82/2369 symbols completed. ALG took 26.0s. Estimated remaining: 4h 51m 54s. Rate: 7.8 symbols/min [2025-10-16T17:10:31.818576] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:31.864727] [DEBUG] [LOCAL ] ALL: Loaded 49786 existing records from primary storage. [2025-10-16T17:10:31.865084] [INFO ] [MAIN ] ALL: Loaded 49786 existing records. [2025-10-16T17:10:31.944850] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-16T17:10:32.051937] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:10:32.052226] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-16T17:10:32.052289] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-16T17:10:32.052906] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-16T17:10:32.052965] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-16T17:10:32.436065] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:32.437439] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T17:10:32.742835] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-16T17:10:33.542797] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-16T17:10:34.036577] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-16T17:10:34.157862] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T17:10:34.342896] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-16T17:10:34.970456] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T17:10:35.142865] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-16T17:10:35.684628] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T17:10:35.689573] [INFO ] [REMOTE ] ALEX: Full fetch complete (44625 records). [2025-10-16T17:10:35.689711] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-16T17:10:35.954806] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-16T17:10:36.151226] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-16T17:10:36.151345] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-16T17:10:36.151946] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-16T17:10:36.152016] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-16T17:10:36.153498] [DEBUG] [LOCAL ] ALEX: Trimmed 44625 records to 31407 (keeping 200 days of data) [2025-10-16T17:10:36.395125] [DEBUG] [LOCAL ] ALEX: Primary data saved (31407 records). [2025-10-16T17:10:36.395290] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-16T17:10:36.395377] [INFO ] [MAIN ] Update Progress: 83/2369 symbols completed. ALEX took 30.7s. Estimated remaining: 4h 50m 26s. Rate: 7.9 symbols/min [2025-10-16T17:10:36.665160] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:36.723305] [DEBUG] [LOCAL ] ALLE: Loaded 44203 existing records from primary storage. [2025-10-16T17:10:36.723996] [INFO ] [MAIN ] ALLE: Loaded 44203 existing records. [2025-10-16T17:10:36.749118] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-16T17:10:36.968067] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:10:36.968398] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-16T17:10:36.968695] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-16T17:10:36.969130] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-16T17:10:36.969189] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-16T17:10:37.317094] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-16T17:10:37.407168] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:37.509260] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T17:10:37.542781] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-16T17:10:38.229815] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T17:10:38.342812] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-16T17:10:39.021302] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T17:10:39.142822] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-16T17:10:39.915038] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T17:10:39.942827] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-16T17:10:40.742870] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-16T17:10:40.779533] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T17:10:41.542824] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-16T17:10:41.822234] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T17:10:41.829588] [INFO ] [REMOTE ] ALIT: Full fetch complete (76612 records). [2025-10-16T17:10:41.829753] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-16T17:10:42.254236] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-16T17:10:42.254345] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-16T17:10:42.255241] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-16T17:10:42.255375] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-16T17:10:42.256937] [DEBUG] [LOCAL ] ALIT: Trimmed 76612 records to 53175 (keeping 200 days of data) [2025-10-16T17:10:42.343011] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-16T17:10:42.372268] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T17:10:42.627318] [DEBUG] [LOCAL ] ALIT: Primary data saved (53175 records). [2025-10-16T17:10:42.627463] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-16T17:10:42.627546] [INFO ] [MAIN ] Update Progress: 84/2369 symbols completed. ALIT took 36.9s. Estimated remaining: 4h 49m 41s. Rate: 7.9 symbols/min [2025-10-16T17:10:42.824983] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:42.874817] [DEBUG] [LOCAL ] ALLY: Loaded 53221 existing records from primary storage. [2025-10-16T17:10:42.875117] [INFO ] [MAIN ] ALLY: Loaded 53221 existing records. [2025-10-16T17:10:43.059078] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:10:43.059381] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-16T17:10:43.059508] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-16T17:10:43.060038] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-16T17:10:43.060134] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-16T17:10:43.150296] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-16T17:10:43.380288] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T17:10:43.469244] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:43.942887] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-16T17:10:44.120900] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-16T17:10:44.127848] [INFO ] [REMOTE ] ALK: Full fetch complete (77013 records). [2025-10-16T17:10:44.128006] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-16T17:10:44.522980] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-16T17:10:44.523083] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-16T17:10:44.523865] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-16T17:10:44.523933] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-16T17:10:44.525498] [DEBUG] [LOCAL ] ALK: Trimmed 77013 records to 53470 (keeping 200 days of data) [2025-10-16T17:10:44.742976] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-16T17:10:44.861127] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T17:10:44.881394] [DEBUG] [LOCAL ] ALK: Primary data saved (53470 records). [2025-10-16T17:10:44.881497] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-16T17:10:44.881567] [INFO ] [MAIN ] Update Progress: 85/2369 symbols completed. ALK took 36.3s. Estimated remaining: 4h 47m 9s. Rate: 8.0 symbols/min [2025-10-16T17:10:45.049569] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:45.089278] [DEBUG] [LOCAL ] ALSN: Loaded 43474 existing records from primary storage. [2025-10-16T17:10:45.089580] [INFO ] [MAIN ] ALSN: Loaded 43474 existing records. [2025-10-16T17:10:45.262256] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:10:45.262462] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-16T17:10:45.262509] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-16T17:10:45.262846] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-16T17:10:45.262902] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-16T17:10:45.547932] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-16T17:10:45.617980] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:45.882725] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T17:10:46.342807] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-16T17:10:46.395256] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T17:10:47.050120] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T17:10:47.142795] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-16T17:10:47.901610] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T17:10:47.942783] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-16T17:10:48.742889] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-16T17:10:48.912849] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T17:10:48.998878] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-16T17:10:49.542820] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-16T17:10:50.199374] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T17:10:50.342839] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-16T17:10:50.813370] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T17:10:51.142811] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-16T17:10:51.942905] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-16T17:10:52.109924] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T17:10:52.742872] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-16T17:10:52.841258] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T17:10:53.485117] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T17:10:53.542823] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-16T17:10:54.165603] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T17:10:54.342831] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-16T17:10:55.142840] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-16T17:10:55.171844] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T17:10:55.942871] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-16T17:10:56.004498] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T17:10:56.602418] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T17:10:56.742825] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-16T17:10:57.232166] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T17:10:57.542818] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-16T17:10:58.193529] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T17:10:58.342824] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-16T17:10:59.142877] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-16T17:10:59.185968] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T17:10:59.942805] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-16T17:11:00.145310] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T17:11:00.749205] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-16T17:11:00.771513] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T17:11:01.320269] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T17:11:01.542889] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-16T17:11:02.342788] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-16T17:11:02.431636] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T17:11:02.851310] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T17:11:03.142795] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-16T17:11:03.942786] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-16T17:11:04.120604] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T17:11:04.593135] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T17:11:04.742866] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-16T17:11:05.542830] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-16T17:11:05.663961] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T17:11:05.672012] [INFO ] [REMOTE ] ALLE: Full fetch complete (64818 records). [2025-10-16T17:11:05.672228] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-16T17:11:06.103276] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-16T17:11:06.103346] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-16T17:11:06.104008] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-16T17:11:06.104085] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-16T17:11:06.105425] [DEBUG] [LOCAL ] ALLE: Trimmed 64818 records to 44517 (keeping 200 days of data) [2025-10-16T17:11:06.343393] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-16T17:11:06.379024] [DEBUG] [LOCAL ] ALLE: Primary data saved (44517 records). [2025-10-16T17:11:06.379136] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-16T17:11:06.379561] [INFO ] [MAIN ] Update Progress: 86/2369 symbols completed. ALLE took 30.0s. Estimated remaining: 4h 53m 12s. Rate: 7.8 symbols/min [2025-10-16T17:11:06.552528] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:11:06.582198] [DEBUG] [LOCAL ] ALTG: Loaded 23330 existing records from primary storage. [2025-10-16T17:11:06.582432] [INFO ] [MAIN ] ALTG: Loaded 23330 existing records. [2025-10-16T17:11:06.704555] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T17:11:06.756410] [INFO ] [REMOTE ] ALL: Full fetch complete (72540 records). [2025-10-16T17:11:06.782500] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-16T17:11:06.787739] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:11:06.787996] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-16T17:11:06.788045] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-16T17:11:06.793687] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-16T17:11:06.845218] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-16T17:11:07.567868] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:11:07.589395] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-16T17:11:07.590081] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-16T17:11:07.591117] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-16T17:11:07.592052] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-16T17:11:07.592473] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-16T17:11:07.595029] [DEBUG] [LOCAL ] ALL: Trimmed 72540 records to 50161 (keeping 200 days of data) [2025-10-16T17:11:07.738154] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-16T17:11:07.753351] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T17:11:07.946631] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-16T17:11:07.983513] [DEBUG] [LOCAL ] ALL: Primary data saved (50161 records). [2025-10-16T17:11:07.983624] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-16T17:11:07.983743] [INFO ] [MAIN ] Update Progress: 87/2369 symbols completed. ALL took 36.3s. Estimated remaining: 4h 50m 24s. Rate: 7.9 symbols/min [2025-10-16T17:11:08.150185] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:11:08.160430] [DEBUG] [LOCAL ] ALUR: Loaded 9544 existing records from primary storage. [2025-10-16T17:11:08.160618] [INFO ] [MAIN ] ALUR: Loaded 9544 existing records. [2025-10-16T17:11:08.334015] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:11:08.334189] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-16T17:11:08.334236] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-16T17:11:08.334453] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-16T17:11:08.334519] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-16T17:11:08.683909] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:11:08.742769] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-16T17:11:08.790057] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T17:11:09.543853] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-16T17:11:09.546500] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T17:11:10.211956] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T17:11:10.342805] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-16T17:11:10.545123] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T17:11:11.142831] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-16T17:11:11.585811] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T17:11:11.942815] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-16T17:11:12.470797] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T17:11:12.742817] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-16T17:11:12.948280] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T17:11:13.542800] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-16T17:11:13.855056] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T17:11:14.342811] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-16T17:11:14.849465] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T17:11:15.142781] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-16T17:11:15.488747] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T17:11:15.942819] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-16T17:11:16.750167] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-16T17:11:16.757443] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T17:11:17.075146] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T17:11:17.542852] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-16T17:11:17.554703] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T17:11:18.342817] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-16T17:11:18.517100] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T17:11:19.142880] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-16T17:11:19.768202] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T17:11:19.777286] [INFO ] [REMOTE ] ALSN: Full fetch complete (62561 records). [2025-10-16T17:11:19.777466] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-16T17:11:19.951879] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-16T17:11:20.186174] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-16T17:11:20.186266] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-16T17:11:20.186939] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-16T17:11:20.187005] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-16T17:11:20.188336] [DEBUG] [LOCAL ] ALSN: Trimmed 62561 records to 43767 (keeping 200 days of data) [2025-10-16T17:11:20.455063] [DEBUG] [LOCAL ] ALSN: Primary data saved (43767 records). [2025-10-16T17:11:20.455209] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-16T17:11:20.455298] [INFO ] [MAIN ] Update Progress: 88/2369 symbols completed. ALSN took 35.6s. Estimated remaining: 4h 52m 22s. Rate: 7.8 symbols/min [2025-10-16T17:11:20.628496] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:11:20.684475] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T17:11:20.712085] [DEBUG] [LOCAL ] ALV: Loaded 42121 existing records from primary storage. [2025-10-16T17:11:20.712404] [INFO ] [MAIN ] ALV: Loaded 42121 existing records. [2025-10-16T17:11:20.748035] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-16T17:11:20.900740] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:11:20.901131] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-16T17:11:20.901179] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-16T17:11:20.901632] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-16T17:11:20.901716] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-16T17:11:21.275863] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:11:21.324540] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T17:11:21.542859] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-16T17:11:22.216505] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T17:11:22.302037] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T17:11:22.342783] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-16T17:11:23.142798] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-16T17:11:23.277794] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T17:11:23.942855] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-16T17:11:24.303273] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-16T17:11:24.375195] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-16T17:11:24.742811] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-16T17:11:25.542808] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-16T17:11:26.342799] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-16T17:11:26.481765] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T17:11:26.755479] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-16T17:11:26.792577] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T17:11:27.142830] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-16T17:11:27.942841] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-16T17:11:28.742940] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-16T17:11:29.043607] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-16T17:11:29.055330] [INFO ] [REMOTE ] ALLY: Full fetch complete (77204 records). [2025-10-16T17:11:29.055572] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-16T17:11:29.197808] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-16T17:11:29.544072] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T17:11:29.544160] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-16T17:11:29.573186] [INFO ] [REMOTE ] ALUR: Full fetch complete (19061 records). [2025-10-16T17:11:29.602609] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-16T17:11:29.716944] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-16T17:11:29.738521] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-16T17:11:29.763336] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-16T17:11:29.763450] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-16T17:11:29.819702] [DEBUG] [LOCAL ] ALLY: Trimmed 77204 records to 53610 (keeping 200 days of data) [2025-10-16T17:11:30.373966] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-16T17:11:30.482370] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-16T17:11:30.482089] [DEBUG] [LOCAL ] ALLY: Primary data saved (53610 records). [2025-10-16T17:11:30.482698] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-16T17:11:30.482592] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-16T17:11:30.483949] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-16T17:11:30.483424] [INFO ] [MAIN ] Update Progress: 89/2369 symbols completed. ALLY took 47.9s. Estimated remaining: 4h 53m 14s. Rate: 7.8 symbols/min [2025-10-16T17:11:30.505278] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-16T17:11:30.583242] [DEBUG] [LOCAL ] ALUR: Trimmed 19061 records to 9589 (keeping 200 days of data) [2025-10-16T17:11:30.704203] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:11:30.720293] [DEBUG] [LOCAL ] ALUR: Primary data saved (9589 records). [2025-10-16T17:11:30.720619] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-16T17:11:30.720797] [INFO ] [MAIN ] Update Progress: 90/2369 symbols completed. ALUR took 22.7s. Estimated remaining: 4h 49m 57s. Rate: 7.9 symbols/min [2025-10-16T17:11:30.837146] [DEBUG] [LOCAL ] ALX: Loaded 6965 existing records from primary storage. [2025-10-16T17:11:30.841333] [INFO ] [MAIN ] ALX: Loaded 6965 existing records. [2025-10-16T17:11:31.002625] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:11:31.127897] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:11:31.128860] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-16T17:11:31.129356] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-16T17:11:31.129639] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-16T17:11:31.129798] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-16T17:11:31.275797] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T17:11:31.301816] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-16T17:11:31.440953] [DEBUG] [LOCAL ] AM: Loaded 51939 existing records from primary storage. [2025-10-16T17:11:31.451558] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T17:11:31.463876] [INFO ] [MAIN ] AM: Loaded 51939 existing records. [2025-10-16T17:11:31.837611] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:11:31.875470] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:11:31.875733] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-16T17:11:31.875791] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-16T17:11:31.876091] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-16T17:11:31.876131] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-16T17:11:31.947989] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-16T17:11:32.226584] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:11:32.711294] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T17:11:32.742765] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-16T17:11:33.152838] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T17:11:33.155888] [INFO ] [REMOTE ] ALTG: Full fetch complete (33304 records). [2025-10-16T17:11:33.155973] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-16T17:11:33.156496] [FATAL] [VALIDATOR ] ALTG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:11:33.156594] [FATAL] [MAIN ] ALTG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:11:33.156694] [WARN ] [MAIN ] ALTG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:11:33.156784] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-16T17:11:33.156865] [DEBUG] [LOCAL ] ALTG: No primary data file found to delete. [2025-10-16T17:11:33.156901] [INFO ] [LOCAL ] ALTG: Starting deletion of derivative data. [2025-10-16T17:11:33.157054] [DEBUG] [LOCAL ] ALTG: Deleted derivative data file. [2025-10-16T17:11:33.157140] [INFO ] [MAIN ] Update Progress: 91/2369 symbols completed. ALTG took 26.8s. Estimated remaining: 4h 47m 40s. Rate: 7.9 symbols/min [2025-10-16T17:11:33.324979] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:11:33.357385] [DEBUG] [LOCAL ] AMBC: Loaded 36270 existing records from primary storage. [2025-10-16T17:11:33.357659] [INFO ] [MAIN ] AMBC: Loaded 36270 existing records. [2025-10-16T17:11:33.534803] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:11:33.535019] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-16T17:11:33.535076] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-16T17:11:33.535335] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-16T17:11:33.535399] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-16T17:11:33.542852] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-16T17:11:33.885374] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:11:34.009259] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T17:11:34.342856] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-16T17:11:35.098592] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-16T17:11:35.142855] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-16T17:11:35.438425] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-16T17:11:35.636852] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-16T17:11:35.942820] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-16T17:11:36.440814] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-16T17:11:36.742819] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-16T17:11:37.542856] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-16T17:11:38.092961] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T17:11:38.342821] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-16T17:11:38.960931] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T17:11:39.087147] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T17:11:39.142818] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-16T17:11:39.942803] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-16T17:11:40.025543] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T17:11:40.742825] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-16T17:11:41.447682] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T17:11:41.542838] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-16T17:11:42.294857] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T17:11:42.342836] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-16T17:11:43.142796] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-16T17:11:43.236836] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T17:11:43.511366] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-16T17:11:43.666726] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T17:11:43.942806] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-16T17:11:44.432994] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-16T17:11:44.742834] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-16T17:11:45.542857] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-16T17:11:46.284404] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T17:11:46.342827] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-16T17:11:47.062606] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T17:11:47.142820] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-16T17:11:47.942802] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-16T17:11:48.040491] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T17:11:48.748661] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-16T17:11:48.753203] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T17:11:49.183276] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-16T17:11:49.542833] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-16T17:11:50.342806] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-16T17:11:50.449334] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T17:11:50.856342] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-16T17:11:50.917632] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T17:11:51.142829] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-16T17:11:51.942830] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-16T17:11:52.742841] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-16T17:11:52.778782] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T17:11:52.797309] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T17:11:53.542819] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-16T17:11:53.958217] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T17:11:54.315235] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T17:11:54.342822] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-16T17:11:55.142832] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-16T17:11:55.727493] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T17:11:55.942810] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-16T17:11:56.755447] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-16T17:11:56.757758] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T17:11:57.375518] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T17:11:57.542810] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-16T17:11:58.186937] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T17:11:58.342812] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-16T17:11:59.087731] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-16T17:11:59.147965] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-16T17:11:59.163229] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T17:11:59.942832] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-16T17:12:00.651365] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T17:12:00.739525] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T17:12:00.742763] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-16T17:12:01.542892] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-16T17:12:01.877140] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-16T17:12:01.879007] [INFO ] [REMOTE ] ALX: Full fetch complete (7865 records). [2025-10-16T17:12:01.879075] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-16T17:12:02.282211] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-16T17:12:02.282315] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-16T17:12:02.282545] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-16T17:12:02.282607] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-16T17:12:02.283165] [DEBUG] [LOCAL ] ALX: Trimmed 7865 records to 7061 (keeping 200 days of data) [2025-10-16T17:12:02.325898] [DEBUG] [LOCAL ] ALX: Primary data saved (7061 records). [2025-10-16T17:12:02.326019] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-16T17:12:02.326091] [INFO ] [MAIN ] Update Progress: 92/2369 symbols completed. ALX took 31.8s. Estimated remaining: 4h 56m 26s. Rate: 7.7 symbols/min [2025-10-16T17:12:02.347854] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-16T17:12:02.494699] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:02.534333] [DEBUG] [LOCAL ] AMBP: Loaded 44639 existing records from primary storage. [2025-10-16T17:12:02.534610] [INFO ] [MAIN ] AMBP: Loaded 44639 existing records. [2025-10-16T17:12:02.708594] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:12:02.708829] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-16T17:12:02.708876] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-16T17:12:02.709239] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-16T17:12:02.709307] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-16T17:12:03.070925] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:03.146774] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-16T17:12:03.150364] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T17:12:03.155966] [INFO ] [REMOTE ] ALV: Full fetch complete (62090 records). [2025-10-16T17:12:03.156057] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-16T17:12:03.545606] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-16T17:12:03.545814] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-16T17:12:03.546462] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-16T17:12:03.546540] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-16T17:12:03.567122] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T17:12:03.566342] [DEBUG] [LOCAL ] ALV: Trimmed 62090 records to 42481 (keeping 200 days of data) [2025-10-16T17:12:03.829889] [DEBUG] [LOCAL ] ALV: Primary data saved (42481 records). [2025-10-16T17:12:03.830010] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-16T17:12:03.830085] [INFO ] [MAIN ] Update Progress: 93/2369 symbols completed. ALV took 43.4s. Estimated remaining: 4h 53m 44s. Rate: 7.7 symbols/min [2025-10-16T17:12:03.947978] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-16T17:12:03.999802] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:03.999910] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-16T17:12:03.999948] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-16T17:12:04.000052] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-16T17:12:04.000092] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-16T17:12:04.000131] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-16T17:12:04.000163] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-16T17:12:04.348523] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:04.620622] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T17:12:04.742774] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-16T17:12:05.542781] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-16T17:12:05.787755] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T17:12:06.342836] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-16T17:12:06.487039] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T17:12:06.560208] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T17:12:07.142868] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-16T17:12:07.942851] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-16T17:12:08.178838] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:12:08.179167] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-16T17:12:08.179252] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:12:08.179301] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-16T17:12:08.179363] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:12:08.179435] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-16T17:12:08.179517] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-16T17:12:08.179572] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-16T17:12:08.179615] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-16T17:12:08.179688] [INFO ] [MAIN ] Update Progress: 94/2369 symbols completed. AMBQ took 4.3s. Estimated remaining: 4h 52m 14s. Rate: 7.8 symbols/min [2025-10-16T17:12:08.307963] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-16T17:12:08.341114] [INFO ] [REMOTE ] AM: Full fetch complete (75735 records). [2025-10-16T17:12:08.388388] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:08.384814] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-16T17:12:08.754887] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-16T17:12:08.831741] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-16T17:12:08.832304] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-16T17:12:08.833566] [DEBUG] [LOCAL ] AMC: Loaded 53762 existing records from primary storage. [2025-10-16T17:12:08.834529] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-16T17:12:08.834917] [INFO ] [MAIN ] AMC: Loaded 53762 existing records. [2025-10-16T17:12:08.848407] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-16T17:12:08.929049] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T17:12:08.973151] [DEBUG] [LOCAL ] AM: Trimmed 75735 records to 52320 (keeping 200 days of data) [2025-10-16T17:12:09.121617] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:12:09.155552] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-16T17:12:09.156850] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-16T17:12:09.159856] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-16T17:12:09.160630] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-16T17:12:09.545160] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-16T17:12:09.747781] [DEBUG] [LOCAL ] AM: Primary data saved (52320 records). [2025-10-16T17:12:09.753827] [INFO ] [MAIN ] AM: Full history saved. [2025-10-16T17:12:09.753974] [INFO ] [MAIN ] Update Progress: 95/2369 symbols completed. AM took 39.0s. Estimated remaining: 4h 49m 40s. Rate: 7.9 symbols/min [2025-10-16T17:12:09.753729] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:09.919364] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:09.969710] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-16T17:12:09.970100] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-10-16T17:12:10.157085] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:12:10.157314] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-16T17:12:10.157361] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-16T17:12:10.157748] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-16T17:12:10.157805] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-16T17:12:10.361707] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-16T17:12:10.474376] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T17:12:10.519329] [INFO ] [REMOTE ] AMBC: Full fetch complete (51830 records). [2025-10-16T17:12:10.562411] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-16T17:12:10.567241] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:10.948559] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-16T17:12:10.948636] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-16T17:12:10.949229] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-16T17:12:10.949290] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-16T17:12:10.950372] [DEBUG] [LOCAL ] AMBC: Trimmed 51830 records to 36530 (keeping 200 days of data) [2025-10-16T17:12:11.149861] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-16T17:12:11.155004] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T17:12:11.190233] [DEBUG] [LOCAL ] AMBC: Primary data saved (36530 records). [2025-10-16T17:12:11.190697] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-16T17:12:11.191610] [INFO ] [MAIN ] Update Progress: 96/2369 symbols completed. AMBC took 38.0s. Estimated remaining: 4h 47m 5s. Rate: 7.9 symbols/min [2025-10-16T17:12:11.355771] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:11.405115] [DEBUG] [LOCAL ] AME: Loaded 48691 existing records from primary storage. [2025-10-16T17:12:11.405545] [INFO ] [MAIN ] AME: Loaded 48691 existing records. [2025-10-16T17:12:11.577936] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:12:11.578138] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-16T17:12:11.578185] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-16T17:12:11.578478] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-16T17:12:11.578533] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-16T17:12:11.919956] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:11.942774] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-16T17:12:12.729026] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T17:12:12.742771] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-16T17:12:13.078237] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-10-16T17:12:13.542825] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-16T17:12:13.708806] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T17:12:14.342810] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-16T17:12:14.380667] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T17:12:15.054014] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T17:12:15.142799] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-16T17:12:15.942798] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-16T17:12:16.039078] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T17:12:16.742791] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-16T17:12:16.884853] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T17:12:17.423484] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T17:12:17.542790] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-16T17:12:18.342801] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-16T17:12:18.380842] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T17:12:19.142810] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-16T17:12:19.608215] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-16T17:12:19.734118] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T17:12:19.942797] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-16T17:12:20.208440] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T17:12:20.742833] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-16T17:12:21.358939] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T17:12:21.542789] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-16T17:12:22.307445] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T17:12:22.342787] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-16T17:12:23.142778] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-16T17:12:23.557086] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-16T17:12:23.942879] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-16T17:12:24.393844] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-16T17:12:24.701446] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T17:12:24.742815] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-16T17:12:25.205402] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T17:12:25.542815] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-16T17:12:26.345516] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-16T17:12:26.350837] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T17:12:27.018164] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T17:12:27.142822] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-16T17:12:27.942845] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-16T17:12:28.728621] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-16T17:12:28.750310] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-16T17:12:28.753639] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T17:12:28.759091] [INFO ] [REMOTE ] AMBP: Full fetch complete (65265 records). [2025-10-16T17:12:28.759186] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-16T17:12:29.176676] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-16T17:12:29.176911] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-16T17:12:29.177633] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-16T17:12:29.177746] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-16T17:12:29.179142] [DEBUG] [LOCAL ] AMBP: Trimmed 65265 records to 44894 (keeping 200 days of data) [2025-10-16T17:12:29.413192] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T17:12:29.482907] [DEBUG] [LOCAL ] AMBP: Primary data saved (44894 records). [2025-10-16T17:12:29.483041] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-16T17:12:29.483117] [INFO ] [MAIN ] Update Progress: 97/2369 symbols completed. AMBP took 27.2s. Estimated remaining: 4h 51m 9s. Rate: 7.8 symbols/min [2025-10-16T17:12:29.547915] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-16T17:12:29.651124] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:29.671464] [DEBUG] [LOCAL ] AMG: Loaded 20143 existing records from primary storage. [2025-10-16T17:12:29.671745] [INFO ] [MAIN ] AMG: Loaded 20143 existing records. [2025-10-16T17:12:29.846499] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:12:29.846788] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-16T17:12:29.846841] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-16T17:12:29.847112] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-16T17:12:29.847151] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-16T17:12:30.210374] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:30.352320] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-16T17:12:30.373514] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T17:12:31.142788] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-16T17:12:31.423035] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T17:12:31.475895] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-16T17:12:31.942815] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-16T17:12:32.438132] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T17:12:32.742789] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-16T17:12:33.085568] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T17:12:33.542825] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-16T17:12:34.342886] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-16T17:12:34.773083] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-16T17:12:35.047382] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T17:12:35.142780] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-16T17:12:35.554468] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T17:12:35.942818] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-16T17:12:36.742884] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-16T17:12:36.849742] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T17:12:37.543025] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-16T17:12:37.992112] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-16T17:12:38.342876] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-16T17:12:38.892681] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T17:12:39.142829] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-16T17:12:39.290090] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-16T17:12:39.942848] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-16T17:12:40.060062] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T17:12:40.067236] [INFO ] [REMOTE ] AMCR: Full fetch complete (77841 records). [2025-10-16T17:12:40.067415] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-16T17:12:40.497246] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T17:12:40.528178] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-16T17:12:40.528686] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-16T17:12:40.530003] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-16T17:12:40.530073] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-16T17:12:40.531561] [DEBUG] [LOCAL ] AMCR: Trimmed 77841 records to 54059 (keeping 200 days of data) [2025-10-16T17:12:40.745475] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-16T17:12:40.856090] [DEBUG] [LOCAL ] AMCR: Primary data saved (54059 records). [2025-10-16T17:12:40.856232] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-16T17:12:40.856313] [INFO ] [MAIN ] Update Progress: 98/2369 symbols completed. AMCR took 31.1s. Estimated remaining: 4h 52m 26s. Rate: 7.8 symbols/min [2025-10-16T17:12:41.027860] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:41.075913] [DEBUG] [LOCAL ] AMH: Loaded 51831 existing records from primary storage. [2025-10-16T17:12:41.076249] [INFO ] [MAIN ] AMH: Loaded 51831 existing records. [2025-10-16T17:12:41.256055] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:12:41.256332] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-16T17:12:41.256445] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-16T17:12:41.256882] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-16T17:12:41.256940] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-16T17:12:41.548082] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-16T17:12:41.614125] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:42.023334] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-16T17:12:42.153124] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T17:12:42.342822] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-16T17:12:42.992310] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T17:12:43.001118] [INFO ] [REMOTE ] AME: Full fetch complete (70056 records). [2025-10-16T17:12:43.001256] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-16T17:12:43.147957] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-16T17:12:43.396290] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-16T17:12:43.396458] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-16T17:12:43.397287] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-16T17:12:43.397374] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-16T17:12:43.398831] [DEBUG] [LOCAL ] AME: Trimmed 70056 records to 49020 (keeping 200 days of data) [2025-10-16T17:12:43.631431] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T17:12:43.726497] [DEBUG] [LOCAL ] AME: Primary data saved (49020 records). [2025-10-16T17:12:43.726665] [INFO ] [MAIN ] AME: Full history saved. [2025-10-16T17:12:43.727090] [INFO ] [MAIN ] Update Progress: 99/2369 symbols completed. AME took 32.5s. Estimated remaining: 4h 50m 27s. Rate: 7.8 symbols/min [2025-10-16T17:12:43.890882] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:43.930820] [DEBUG] [LOCAL ] AMN: Loaded 41839 existing records from primary storage. [2025-10-16T17:12:43.931103] [INFO ] [MAIN ] AMN: Loaded 41839 existing records. [2025-10-16T17:12:43.951241] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-16T17:12:44.106596] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:12:44.106825] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-16T17:12:44.106871] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-16T17:12:44.107164] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-16T17:12:44.107220] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-16T17:12:44.451180] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:44.610607] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T17:12:44.742813] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-16T17:12:45.045450] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T17:12:45.542877] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-16T17:12:46.342867] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-16T17:12:47.065837] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-16T17:12:47.114846] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T17:12:47.142786] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-16T17:12:47.948034] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-16T17:12:47.963781] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:12:48.742776] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-16T17:12:48.891899] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T17:12:49.542861] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-16T17:12:49.657006] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-16T17:12:49.695069] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T17:12:50.342877] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-16T17:12:50.520714] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T17:12:51.142815] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-16T17:12:51.909700] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T17:12:51.942817] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-16T17:12:52.351503] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T17:12:52.742821] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-16T17:12:53.393613] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T17:12:53.542829] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-16T17:12:54.342828] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-16T17:12:54.374730] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T17:12:55.142822] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-16T17:12:55.521903] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T17:12:55.524562] [INFO ] [REMOTE ] AMG: Full fetch complete (29574 records). [2025-10-16T17:12:55.524661] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-16T17:12:55.932879] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-16T17:12:55.935336] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-16T17:12:55.935578] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-16T17:12:55.945963] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-16T17:12:55.946681] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-16T17:12:55.947616] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-16T17:12:55.949472] [DEBUG] [LOCAL ] AMG: Trimmed 29574 records to 20310 (keeping 200 days of data) [2025-10-16T17:12:56.076853] [DEBUG] [LOCAL ] AMG: Primary data saved (20310 records). [2025-10-16T17:12:56.076983] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-16T17:12:56.077057] [INFO ] [MAIN ] Update Progress: 100/2369 symbols completed. AMG took 26.6s. Estimated remaining: 4h 52m 6s. Rate: 7.8 symbols/min [2025-10-16T17:12:56.250341] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:56.285178] [DEBUG] [LOCAL ] AMP: Loaded 32020 existing records from primary storage. [2025-10-16T17:12:56.285450] [INFO ] [MAIN ] AMP: Loaded 32020 existing records. [2025-10-16T17:12:56.461185] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:12:56.461965] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-16T17:12:56.462016] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-16T17:12:56.462308] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-16T17:12:56.462347] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-16T17:12:56.752341] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-16T17:12:56.834025] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:56.874976] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T17:12:57.308459] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T17:12:57.542816] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-16T17:12:58.342822] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-16T17:12:59.082597] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-16T17:12:59.142820] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-16T17:12:59.335044] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T17:12:59.495732] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T17:12:59.942821] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-16T17:13:00.742823] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-16T17:13:01.371762] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T17:13:01.462497] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-16T17:13:01.469408] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-16T17:13:01.469547] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-16T17:13:01.547976] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-16T17:13:01.876074] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-16T17:13:01.876164] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-16T17:13:01.877039] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-16T17:13:01.877112] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-16T17:13:01.879027] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 54152 (keeping 200 days of data) [2025-10-16T17:13:02.228181] [DEBUG] [LOCAL ] AMC: Primary data saved (54152 records). [2025-10-16T17:13:02.228540] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-16T17:13:02.228718] [INFO ] [MAIN ] Update Progress: 101/2369 symbols completed. AMC took 54.0s. Estimated remaining: 4h 51m 23s. Rate: 7.8 symbols/min [2025-10-16T17:13:02.359404] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-16T17:13:02.378752] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T17:13:02.456463] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:13:02.507739] [DEBUG] [LOCAL ] AMPX: Loaded 52338 existing records from primary storage. [2025-10-16T17:13:02.508062] [INFO ] [MAIN ] AMPX: Loaded 52338 existing records. [2025-10-16T17:13:02.698670] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:13:02.699010] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-16T17:13:02.699083] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-16T17:13:02.699498] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-16T17:13:02.699697] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-16T17:13:02.828324] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T17:13:03.086904] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:13:03.142781] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-16T17:13:03.732381] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T17:13:03.942811] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-16T17:13:04.742792] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-16T17:13:04.771467] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T17:13:05.334906] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T17:13:05.542829] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-16T17:13:06.276184] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T17:13:06.342784] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-16T17:13:06.728140] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T17:13:07.142858] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-16T17:13:07.661005] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-16T17:13:07.942840] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-16T17:13:08.731717] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T17:13:08.742769] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-16T17:13:09.219973] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T17:13:09.542874] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-16T17:13:10.215693] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T17:13:10.342840] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-16T17:13:11.079750] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T17:13:11.142830] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-16T17:13:11.334938] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T17:13:11.942834] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-16T17:13:12.742842] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-16T17:13:12.886199] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T17:13:13.004935] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T17:13:13.542867] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-16T17:13:14.089126] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-16T17:13:14.097234] [INFO ] [REMOTE ] AMN: Full fetch complete (60378 records). [2025-10-16T17:13:14.097407] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-16T17:13:14.354267] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-16T17:13:14.501177] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-16T17:13:14.501284] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-16T17:13:14.502358] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-16T17:13:14.502438] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-16T17:13:14.504170] [DEBUG] [LOCAL ] AMN: Trimmed 60378 records to 42102 (keeping 200 days of data) [2025-10-16T17:13:14.775839] [DEBUG] [LOCAL ] AMN: Primary data saved (42102 records). [2025-10-16T17:13:14.775972] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-16T17:13:14.776388] [INFO ] [MAIN ] Update Progress: 102/2369 symbols completed. AMN took 31.0s. Estimated remaining: 4h 53m 2s. Rate: 7.7 symbols/min [2025-10-16T17:13:14.953322] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:13:14.974521] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T17:13:15.016682] [DEBUG] [LOCAL ] AMPY: Loaded 39159 existing records from primary storage. [2025-10-16T17:13:15.016969] [INFO ] [MAIN ] AMPY: Loaded 39159 existing records. [2025-10-16T17:13:15.148038] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-16T17:13:15.199687] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:13:15.200150] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-16T17:13:15.200205] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-16T17:13:15.200574] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-16T17:13:15.200631] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-16T17:13:15.569676] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:13:15.942807] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-16T17:13:16.330846] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-16T17:13:16.722088] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T17:13:16.742758] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-16T17:13:16.884495] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-16T17:13:17.542851] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-16T17:13:18.210979] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T17:13:18.217033] [INFO ] [REMOTE ] AMP: Full fetch complete (47525 records). [2025-10-16T17:13:18.217185] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-16T17:13:18.348011] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-16T17:13:18.618261] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-16T17:13:18.618340] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-16T17:13:18.618850] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-16T17:13:18.618932] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-16T17:13:18.619884] [DEBUG] [LOCAL ] AMP: Trimmed 47525 records to 32286 (keeping 200 days of data) [2025-10-16T17:13:18.816112] [DEBUG] [LOCAL ] AMP: Primary data saved (32286 records). [2025-10-16T17:13:18.816290] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-16T17:13:18.817093] [INFO ] [MAIN ] Update Progress: 103/2369 symbols completed. AMP took 22.7s. Estimated remaining: 4h 51m 33s. Rate: 7.8 symbols/min [2025-10-16T17:13:19.002664] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:13:19.032359] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:13:19.070041] [DEBUG] [LOCAL ] AMR: Loaded 28956 existing records from primary storage. [2025-10-16T17:13:19.070293] [INFO ] [MAIN ] AMR: Loaded 28956 existing records. [2025-10-16T17:13:19.146104] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-16T17:13:19.248686] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:13:19.248942] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-16T17:13:19.249000] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-16T17:13:19.249298] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-16T17:13:19.249353] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-16T17:13:19.551176] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T17:13:19.621550] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:13:19.942863] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-16T17:13:20.425454] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T17:13:20.742863] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-16T17:13:21.173785] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T17:13:21.542878] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-16T17:13:22.342815] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-16T17:13:22.649877] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-16T17:13:22.710444] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T17:13:23.142813] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-16T17:13:23.879700] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T17:13:23.942839] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-16T17:13:24.742892] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-16T17:13:24.974628] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T17:13:25.542845] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-16T17:13:25.691510] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T17:13:25.698171] [INFO ] [REMOTE ] AMH: Full fetch complete (75087 records). [2025-10-16T17:13:25.698280] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-16T17:13:26.032874] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T17:13:26.133563] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-16T17:13:26.133663] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-16T17:13:26.134415] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-16T17:13:26.134457] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-16T17:13:26.135840] [DEBUG] [LOCAL ] AMH: Trimmed 75087 records to 52220 (keeping 200 days of data) [2025-10-16T17:13:26.348535] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-16T17:13:26.448815] [DEBUG] [LOCAL ] AMH: Primary data saved (52220 records). [2025-10-16T17:13:26.448985] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-16T17:13:26.449104] [INFO ] [MAIN ] Update Progress: 104/2369 symbols completed. AMH took 45.6s. Estimated remaining: 4h 51m 23s. Rate: 7.8 symbols/min [2025-10-16T17:13:26.627581] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:13:26.664243] [DEBUG] [LOCAL ] AMRC: Loaded 38459 existing records from primary storage. [2025-10-16T17:13:26.664555] [INFO ] [MAIN ] AMRC: Loaded 38459 existing records. [2025-10-16T17:13:26.838993] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:13:26.839234] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-16T17:13:26.839284] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-16T17:13:26.839628] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-16T17:13:26.839744] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-16T17:13:27.144898] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-16T17:13:27.205716] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:13:27.305421] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T17:13:27.626057] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T17:13:27.942823] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-16T17:13:27.997081] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T17:13:28.742872] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-16T17:13:29.542899] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-16T17:13:29.695404] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T17:13:29.862771] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T17:13:30.342830] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-16T17:13:30.898887] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T17:13:31.142825] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-16T17:13:31.942781] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-16T17:13:32.125582] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T17:13:32.655125] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-16T17:13:32.742796] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-16T17:13:33.126983] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T17:13:33.542877] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-16T17:13:34.342835] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-16T17:13:34.622566] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T17:13:34.881041] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-16T17:13:35.142812] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-16T17:13:35.260082] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T17:13:35.942831] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-16T17:13:36.742873] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-16T17:13:36.967452] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T17:13:37.381638] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T17:13:37.542975] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-16T17:13:37.604127] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T17:13:38.342831] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-16T17:13:39.142824] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-16T17:13:39.611034] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-16T17:13:39.617859] [INFO ] [REMOTE ] AMPX: Full fetch complete (75210 records). [2025-10-16T17:13:39.617970] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-16T17:13:39.944331] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-16T17:13:39.947017] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T17:13:40.058829] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-16T17:13:40.059057] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-16T17:13:40.060663] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-16T17:13:40.061080] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-16T17:13:40.063266] [DEBUG] [LOCAL ] AMPX: Trimmed 75210 records to 52728 (keeping 200 days of data) [2025-10-16T17:13:40.137082] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T17:13:40.382634] [DEBUG] [LOCAL ] AMPX: Primary data saved (52728 records). [2025-10-16T17:13:40.382801] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-16T17:13:40.382888] [INFO ] [MAIN ] Update Progress: 105/2369 symbols completed. AMPX took 38.2s. Estimated remaining: 4h 53m 30s. Rate: 7.7 symbols/min [2025-10-16T17:13:40.548791] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:13:40.548993] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-16T17:13:40.549041] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-16T17:13:40.549164] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-16T17:13:40.549206] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-16T17:13:40.549247] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-16T17:13:40.549279] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-16T17:13:40.749460] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-16T17:13:40.908841] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:13:41.542835] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-16T17:13:41.705782] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T17:13:42.070015] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T17:13:42.342871] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-16T17:13:42.629422] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T17:13:43.142797] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-16T17:13:43.734993] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T17:13:43.942855] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-16T17:13:44.165956] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:13:44.166268] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-16T17:13:44.166374] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:13:44.166499] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-16T17:13:44.166586] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:13:44.166707] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-16T17:13:44.166795] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-16T17:13:44.166835] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-16T17:13:44.166877] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-16T17:13:44.166926] [INFO ] [MAIN ] Update Progress: 106/2369 symbols completed. AMRZ took 3.8s. Estimated remaining: 4h 51m 56s. Rate: 7.8 symbols/min [2025-10-16T17:13:44.342196] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:13:44.403760] [DEBUG] [LOCAL ] AMT: Loaded 52475 existing records from primary storage. [2025-10-16T17:13:44.404087] [INFO ] [MAIN ] AMT: Loaded 52475 existing records. [2025-10-16T17:13:44.591764] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:13:44.592041] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-16T17:13:44.592282] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-16T17:13:44.592888] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-16T17:13:44.592948] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-16T17:13:44.753447] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-16T17:13:45.024863] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T17:13:45.038276] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:13:45.542828] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-16T17:13:46.260243] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T17:13:46.342788] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-16T17:13:47.142856] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-16T17:13:47.437811] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-16T17:13:47.505769] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T17:13:47.942876] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-16T17:13:48.742880] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-16T17:13:48.881565] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T17:13:48.888546] [INFO ] [REMOTE ] AMPY: Full fetch complete (52957 records). [2025-10-16T17:13:48.888713] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-16T17:13:49.198047] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T17:13:49.305845] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-16T17:13:49.305935] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-16T17:13:49.306572] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-16T17:13:49.306617] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-16T17:13:49.307982] [DEBUG] [LOCAL ] AMPY: Trimmed 52957 records to 39500 (keeping 200 days of data) [2025-10-16T17:13:49.525366] [DEBUG] [LOCAL ] AMPY: Primary data saved (39500 records). [2025-10-16T17:13:49.525557] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-16T17:13:49.526012] [INFO ] [MAIN ] Update Progress: 107/2369 symbols completed. AMPY took 34.7s. Estimated remaining: 4h 50m 58s. Rate: 7.8 symbols/min [2025-10-16T17:13:49.548052] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-16T17:13:49.698067] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:13:49.720237] [DEBUG] [LOCAL ] AMTB: Loaded 20526 existing records from primary storage. [2025-10-16T17:13:49.720475] [INFO ] [MAIN ] AMTB: Loaded 20526 existing records. [2025-10-16T17:13:49.892036] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:13:49.892288] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-16T17:13:49.892341] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-16T17:13:49.892516] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-16T17:13:49.892572] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-16T17:13:50.249662] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:13:50.342795] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-16T17:13:50.593272] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T17:13:51.041823] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T17:13:51.142792] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-16T17:13:51.597426] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T17:13:51.602239] [INFO ] [REMOTE ] AMR: Full fetch complete (40595 records). [2025-10-16T17:13:51.602419] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-16T17:13:51.947980] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-16T17:13:51.999414] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-16T17:13:51.999494] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-16T17:13:52.000067] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-16T17:13:52.000143] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-16T17:13:52.001086] [DEBUG] [LOCAL ] AMR: Trimmed 40595 records to 29158 (keeping 200 days of data) [2025-10-16T17:13:52.184300] [DEBUG] [LOCAL ] AMR: Primary data saved (29158 records). [2025-10-16T17:13:52.184401] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-16T17:13:52.184482] [INFO ] [MAIN ] Update Progress: 108/2369 symbols completed. AMR took 33.4s. Estimated remaining: 4h 49m 5s. Rate: 7.8 symbols/min [2025-10-16T17:13:52.352415] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:13:52.358535] [DEBUG] [LOCAL ] AMTD: Loaded 3789 existing records from primary storage. [2025-10-16T17:13:52.358719] [INFO ] [MAIN ] AMTD: Loaded 3789 existing records. [2025-10-16T17:13:52.541101] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:13:52.541323] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-16T17:13:52.541391] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-16T17:13:52.557743] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-16T17:13:52.558151] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-16T17:13:52.558688] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T17:13:52.753867] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-16T17:13:52.925343] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:13:53.238321] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-16T17:13:53.542814] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-16T17:13:54.076934] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-16T17:13:54.342865] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-16T17:13:54.438051] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T17:13:54.810943] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T17:13:55.142836] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-16T17:13:55.942845] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-16T17:13:56.716971] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T17:13:56.742776] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-16T17:13:56.945332] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T17:13:57.542855] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-16T17:13:58.113411] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T17:13:58.342789] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-16T17:13:58.584305] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T17:13:58.862922] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-16T17:13:59.142806] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-16T17:13:59.942843] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-16T17:14:00.287618] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-16T17:14:00.742800] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-16T17:14:01.233203] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-16T17:14:01.542811] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-16T17:14:01.777609] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T17:14:02.342817] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-16T17:14:03.142481] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T17:14:03.150678] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-16T17:14:03.484959] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T17:14:03.515887] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-16T17:14:03.942815] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-16T17:14:04.663962] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T17:14:04.742791] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-16T17:14:05.323036] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-16T17:14:05.542841] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-16T17:14:06.342864] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-16T17:14:06.690858] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T17:14:06.919425] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-16T17:14:07.142860] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-16T17:14:07.942863] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-16T17:14:08.145887] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T17:14:08.742928] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-16T17:14:09.099782] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T17:14:09.167883] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-16T17:14:09.542824] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-16T17:14:10.342832] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-16T17:14:10.678223] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T17:14:10.934682] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T17:14:10.935897] [INFO ] [REMOTE ] AMTD: Full fetch complete (5580 records). [2025-10-16T17:14:10.935968] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-16T17:14:11.150115] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-16T17:14:11.346118] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-16T17:14:11.346192] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-16T17:14:11.346345] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-16T17:14:11.346381] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-16T17:14:11.346766] [DEBUG] [LOCAL ] AMTD: Trimmed 5580 records to 3819 (keeping 200 days of data) [2025-10-16T17:14:11.368428] [DEBUG] [LOCAL ] AMTD: Primary data saved (3819 records). [2025-10-16T17:14:11.368495] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-16T17:14:11.368563] [INFO ] [MAIN ] Update Progress: 109/2369 symbols completed. AMTD took 19.2s. Estimated remaining: 4h 52m 56s. Rate: 7.7 symbols/min [2025-10-16T17:14:11.540109] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:14:11.589738] [DEBUG] [LOCAL ] AMTM: Loaded 50564 existing records from primary storage. [2025-10-16T17:14:11.590045] [INFO ] [MAIN ] AMTM: Loaded 50564 existing records. [2025-10-16T17:14:11.773328] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:14:11.774757] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-16T17:14:11.774817] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-16T17:14:11.775735] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-16T17:14:11.775793] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-16T17:14:11.949780] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-16T17:14:12.133244] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:14:12.329078] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-16T17:14:12.742823] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-16T17:14:13.542846] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-16T17:14:13.934498] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-16T17:14:14.207543] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T17:14:14.342835] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-16T17:14:14.630543] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T17:14:15.142818] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-16T17:14:15.942802] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-16T17:14:16.334991] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-16T17:14:16.532911] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T17:14:16.742818] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-16T17:14:16.944891] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-16T17:14:17.542857] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-16T17:14:18.342820] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-16T17:14:18.575387] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T17:14:18.855756] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T17:14:19.130710] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T17:14:19.133604] [INFO ] [REMOTE ] AMTB: Full fetch complete (29608 records). [2025-10-16T17:14:19.133706] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-16T17:14:19.147996] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-16T17:14:19.529779] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-16T17:14:19.529876] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-16T17:14:19.530267] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-16T17:14:19.530309] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-16T17:14:19.531222] [DEBUG] [LOCAL ] AMTB: Trimmed 29608 records to 20672 (keeping 200 days of data) [2025-10-16T17:14:19.654728] [DEBUG] [LOCAL ] AMTB: Primary data saved (20672 records). [2025-10-16T17:14:19.654846] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-16T17:14:19.654920] [INFO ] [MAIN ] Update Progress: 110/2369 symbols completed. AMTB took 30.1s. Estimated remaining: 4h 52m 58s. Rate: 7.7 symbols/min [2025-10-16T17:14:19.839975] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:14:19.851456] [DEBUG] [LOCAL ] AMWL: Loaded 9542 existing records from primary storage. [2025-10-16T17:14:19.851696] [INFO ] [MAIN ] AMWL: Loaded 9542 existing records. [2025-10-16T17:14:19.950363] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-16T17:14:20.041430] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:14:20.041706] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-16T17:14:20.041765] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-16T17:14:20.041914] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-16T17:14:20.041970] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-16T17:14:20.386128] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:14:20.742797] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-16T17:14:21.175234] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-16T17:14:21.542804] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-16T17:14:21.682373] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T17:14:22.122455] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T17:14:22.131228] [INFO ] [REMOTE ] AMRC: Full fetch complete (54271 records). [2025-10-16T17:14:22.131460] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-16T17:14:22.347983] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-16T17:14:22.657426] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-16T17:14:22.657541] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-16T17:14:22.658384] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-16T17:14:22.658452] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-16T17:14:22.660461] [DEBUG] [LOCAL ] AMRC: Trimmed 54271 records to 38803 (keeping 200 days of data) [2025-10-16T17:14:22.885570] [DEBUG] [LOCAL ] AMRC: Primary data saved (38803 records). [2025-10-16T17:14:22.885737] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-16T17:14:22.885827] [INFO ] [MAIN ] Update Progress: 111/2369 symbols completed. AMRC took 56.4s. Estimated remaining: 4h 51m 18s. Rate: 7.8 symbols/min [2025-10-16T17:14:23.051707] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:14:23.097686] [DEBUG] [LOCAL ] AMX: Loaded 49144 existing records from primary storage. [2025-10-16T17:14:23.098027] [INFO ] [MAIN ] AMX: Loaded 49144 existing records. [2025-10-16T17:14:23.155543] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-16T17:14:23.295001] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:14:23.295390] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-16T17:14:23.295601] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-16T17:14:23.295977] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-16T17:14:23.296084] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-16T17:14:23.422193] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T17:14:23.474333] [INFO ] [REMOTE ] AMT: Full fetch complete (76191 records). [2025-10-16T17:14:23.489696] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-16T17:14:23.868427] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:14:23.946707] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-16T17:14:24.165258] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-16T17:14:24.165707] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-16T17:14:24.173987] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-16T17:14:24.174219] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-16T17:14:24.176305] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T17:14:24.180886] [DEBUG] [LOCAL ] AMT: Trimmed 76191 records to 52860 (keeping 200 days of data) [2025-10-16T17:14:24.308512] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-16T17:14:24.561775] [DEBUG] [LOCAL ] AMT: Primary data saved (52860 records). [2025-10-16T17:14:24.561916] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-16T17:14:24.562697] [INFO ] [MAIN ] Update Progress: 112/2369 symbols completed. AMT took 40.4s. Estimated remaining: 4h 49m 8s. Rate: 7.8 symbols/min [2025-10-16T17:14:24.736794] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:14:24.742819] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-16T17:14:24.776935] [DEBUG] [LOCAL ] AN: Loaded 31439 existing records from primary storage. [2025-10-16T17:14:24.777212] [INFO ] [MAIN ] AN: Loaded 31439 existing records. [2025-10-16T17:14:24.958517] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:14:24.958781] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-16T17:14:24.958833] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-16T17:14:24.959110] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-16T17:14:24.959167] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-16T17:14:25.353468] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:14:25.542863] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-16T17:14:25.700305] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T17:14:26.342853] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-16T17:14:26.557292] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T17:14:26.711398] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T17:14:27.142816] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-16T17:14:27.584791] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-16T17:14:27.942865] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-16T17:14:28.582202] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T17:14:28.742847] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-16T17:14:29.287503] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T17:14:29.542894] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-16T17:14:29.645735] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T17:14:30.342869] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-16T17:14:30.415886] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T17:14:31.142877] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-16T17:14:31.784130] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T17:14:31.942835] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-16T17:14:32.638416] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T17:14:32.742816] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-16T17:14:33.374529] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T17:14:33.542843] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-16T17:14:34.342788] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-16T17:14:34.379581] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T17:14:34.926501] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T17:14:35.142846] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-16T17:14:35.520365] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-16T17:14:35.942846] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-16T17:14:36.039007] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T17:14:36.742848] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-16T17:14:37.333022] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-16T17:14:37.332836] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:14:37.542809] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-16T17:14:38.342805] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-16T17:14:39.142821] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-16T17:14:39.286062] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T17:14:39.723948] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T17:14:39.942825] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-16T17:14:40.608708] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T17:14:40.742802] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-16T17:14:41.542783] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-16T17:14:41.684108] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T17:14:41.997690] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T17:14:42.342805] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-16T17:14:43.066261] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T17:14:43.073369] [INFO ] [REMOTE ] AMTM: Full fetch complete (73883 records). [2025-10-16T17:14:43.073532] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-16T17:14:43.151548] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-16T17:14:43.479413] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-16T17:14:43.479706] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-16T17:14:43.480583] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-16T17:14:43.480706] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-16T17:14:43.482394] [DEBUG] [LOCAL ] AMTM: Trimmed 73883 records to 50899 (keeping 200 days of data) [2025-10-16T17:14:43.717685] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T17:14:43.771759] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-16T17:14:43.837461] [DEBUG] [LOCAL ] AMTM: Primary data saved (50899 records). [2025-10-16T17:14:43.837610] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-16T17:14:43.838572] [INFO ] [MAIN ] Update Progress: 113/2369 symbols completed. AMTM took 32.5s. Estimated remaining: 4h 52m 52s. Rate: 7.7 symbols/min [2025-10-16T17:14:43.948040] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-16T17:14:44.008145] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:14:44.063698] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-16T17:14:44.064021] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-16T17:14:44.238435] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:14:44.238678] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-16T17:14:44.238737] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-16T17:14:44.239208] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-16T17:14:44.239264] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-16T17:14:44.588956] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:14:44.742782] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-16T17:14:45.425145] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T17:14:45.542841] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-16T17:14:46.342820] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-16T17:14:46.745826] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-16T17:14:46.827586] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-16T17:14:47.142808] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-16T17:14:47.579549] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T17:14:47.942825] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-16T17:14:48.742885] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-16T17:14:49.074908] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T17:14:49.420555] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-16T17:14:49.437618] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T17:14:49.542843] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-16T17:14:50.342830] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-16T17:14:51.142904] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-16T17:14:51.724801] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-16T17:14:51.942833] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-16T17:14:52.188633] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T17:14:52.227946] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T17:14:52.231916] [INFO ] [REMOTE ] AN: Full fetch complete (47121 records). [2025-10-16T17:14:52.232049] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-16T17:14:52.635384] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-16T17:14:52.635491] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-16T17:14:52.636090] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-16T17:14:52.636154] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-16T17:14:52.637462] [DEBUG] [LOCAL ] AN: Trimmed 47121 records to 31615 (keeping 200 days of data) [2025-10-16T17:14:52.742870] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-16T17:14:52.833004] [DEBUG] [LOCAL ] AN: Primary data saved (31615 records). [2025-10-16T17:14:52.833169] [INFO ] [MAIN ] AN: Full history saved. [2025-10-16T17:14:52.833254] [INFO ] [MAIN ] Update Progress: 114/2369 symbols completed. AN took 28.3s. Estimated remaining: 4h 53m 8s. Rate: 7.7 symbols/min [2025-10-16T17:14:53.010820] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:14:53.060352] [DEBUG] [LOCAL ] ANF: Loaded 52079 existing records from primary storage. [2025-10-16T17:14:53.060706] [INFO ] [MAIN ] ANF: Loaded 52079 existing records. [2025-10-16T17:14:53.241201] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:14:53.241538] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-16T17:14:53.241592] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-16T17:14:53.241904] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-16T17:14:53.241959] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-16T17:14:53.349815] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T17:14:53.548006] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-16T17:14:53.614495] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:14:54.021181] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-16T17:14:54.105524] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-16T17:14:54.342822] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-16T17:14:55.082132] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-16T17:14:55.142828] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-16T17:14:55.942920] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-16T17:14:56.742895] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-16T17:14:57.195411] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-16T17:14:57.463933] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T17:14:57.542815] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-16T17:14:58.342859] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-16T17:14:58.687413] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T17:14:58.790209] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T17:14:58.796750] [INFO ] [REMOTE ] AMX: Full fetch complete (70959 records). [2025-10-16T17:14:58.796933] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-16T17:14:59.149746] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-16T17:14:59.206273] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-16T17:14:59.202404] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-16T17:14:59.206400] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-16T17:14:59.207402] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-16T17:14:59.210726] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-16T17:14:59.212211] [DEBUG] [LOCAL ] AMX: Trimmed 70959 records to 49533 (keeping 200 days of data) [2025-10-16T17:14:59.507433] [DEBUG] [LOCAL ] AMX: Primary data saved (49533 records). [2025-10-16T17:14:59.507716] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-16T17:14:59.507833] [INFO ] [MAIN ] Update Progress: 115/2369 symbols completed. AMX took 36.6s. Estimated remaining: 4h 52m 38s. Rate: 7.7 symbols/min [2025-10-16T17:14:59.674112] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:14:59.674311] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-16T17:14:59.674349] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-16T17:14:59.674458] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-16T17:14:59.674498] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-16T17:14:59.674538] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-16T17:14:59.674569] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-16T17:14:59.947717] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-16T17:15:00.028571] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:00.742863] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-16T17:15:01.542856] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-16T17:15:01.771082] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T17:15:01.800947] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:15:01.801341] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-16T17:15:01.801437] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:15:01.801525] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-16T17:15:01.801609] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:15:01.801723] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-16T17:15:01.801808] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-16T17:15:01.801856] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-16T17:15:01.801909] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-16T17:15:01.801968] [INFO ] [MAIN ] Update Progress: 116/2369 symbols completed. ANGX took 2.3s. Estimated remaining: 4h 50m 44s. Rate: 7.7 symbols/min [2025-10-16T17:15:01.945332] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-10-16T17:15:01.996350] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T17:15:02.020671] [INFO ] [REMOTE ] AMWL: Full fetch complete (14538 records). [2025-10-16T17:15:02.039903] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-16T17:15:02.076922] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:15:02.138507] [DEBUG] [LOCAL ] ANRO: No existing data file found in primary storage. [2025-10-16T17:15:02.176587] [WARN ] [MAIN ] ANRO: No existing data found, performing full refresh instead. [2025-10-16T17:15:02.180066] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-16T17:15:02.195908] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-16T17:15:02.229114] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-10-16T17:15:02.302797] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-16T17:15:02.358475] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-16T17:15:02.662052] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-16T17:15:02.678285] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-16T17:15:02.741565] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-16T17:15:02.756478] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-16T17:15:02.795495] [DEBUG] [LOCAL ] AMWL: Trimmed 14538 records to 9671 (keeping 200 days of data) [2025-10-16T17:15:02.909794] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:02.924157] [DEBUG] [LOCAL ] AMWL: Primary data saved (9671 records). [2025-10-16T17:15:02.924229] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-16T17:15:02.924296] [INFO ] [MAIN ] Update Progress: 117/2369 symbols completed. AMWL took 43.3s. Estimated remaining: 4h 48m 28s. Rate: 7.8 symbols/min [2025-10-16T17:15:03.142777] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-16T17:15:03.942842] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-16T17:15:04.243484] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T17:15:04.742848] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-16T17:15:04.984030] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-16T17:15:05.447927] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T17:15:05.468782] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-16T17:15:05.542795] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-16T17:15:06.342792] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-16T17:15:06.587079] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T17:15:07.142842] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-16T17:15:07.942830] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-16T17:15:08.290492] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T17:15:08.742847] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-16T17:15:09.174480] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-16T17:15:09.230477] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-16T17:15:09.542818] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-16T17:15:10.342849] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-16T17:15:10.731322] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T17:15:10.754696] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-16T17:15:11.142901] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-16T17:15:11.942860] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-16T17:15:12.384711] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-16T17:15:12.742881] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-16T17:15:12.957372] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T17:15:13.116977] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T17:15:13.542900] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-16T17:15:14.342874] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-16T17:15:14.557507] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T17:15:15.142905] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-16T17:15:15.200400] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-16T17:15:15.906844] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T17:15:15.929229] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T17:15:15.942791] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-16T17:15:16.742796] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-16T17:15:16.763375] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T17:15:17.542912] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-16T17:15:18.300521] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T17:15:18.342807] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-16T17:15:18.670413] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T17:15:19.142839] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-16T17:15:19.587433] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-16T17:15:19.591419] [INFO ] [REMOTE ] ANRO: Full fetch complete (29806 records). [2025-10-16T17:15:19.591528] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-16T17:15:19.946693] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-16T17:15:19.986387] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-16T17:15:19.986497] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-16T17:15:19.987058] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-16T17:15:19.987321] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-16T17:15:19.988830] [DEBUG] [LOCAL ] ANRO: Trimmed 29806 records to 19575 (keeping 200 days of data) [2025-10-16T17:15:20.083334] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T17:15:20.094573] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-16T17:15:20.095583] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-16T17:15:20.521354] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-16T17:15:20.521737] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-16T17:15:20.522717] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-16T17:15:20.523066] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-16T17:15:20.525944] [DEBUG] [LOCAL ] ANRO: Primary data saved (19575 records). [2025-10-16T17:15:20.526060] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-16T17:15:20.526251] [INFO ] [MAIN ] Update Progress: 118/2369 symbols completed. ANRO took 18.7s. Estimated remaining: 4h 51m 30s. Rate: 7.7 symbols/min [2025-10-16T17:15:20.527053] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 54156 (keeping 200 days of data) [2025-10-16T17:15:20.841798] [DEBUG] [LOCAL ] ANET: Primary data saved (54156 records). [2025-10-16T17:15:20.841934] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-16T17:15:20.842676] [INFO ] [MAIN ] Update Progress: 119/2369 symbols completed. ANET took 37.0s. Estimated remaining: 4h 49m 1s. Rate: 7.8 symbols/min [2025-10-16T17:15:21.772377] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T17:15:21.784026] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-16T17:15:23.298233] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T17:15:23.309202] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-16T17:15:25.215510] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-16T17:15:25.222527] [INFO ] [REMOTE ] ANF: Full fetch complete (75804 records). [2025-10-16T17:15:25.222717] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-16T17:15:25.617059] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-16T17:15:25.617133] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-16T17:15:25.617879] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-16T17:15:25.617941] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-16T17:15:25.619275] [DEBUG] [LOCAL ] ANF: Trimmed 75804 records to 52463 (keeping 200 days of data) [2025-10-16T17:15:25.915617] [DEBUG] [LOCAL ] ANF: Primary data saved (52463 records). [2025-10-16T17:15:25.915778] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-16T17:15:25.916268] [INFO ] [MAIN ] Update Progress: 120/2369 symbols completed. ANF took 33.1s. Estimated remaining: 4h 48m 4s. Rate: 7.8 symbols/min [2025-10-16T17:15:26.492929] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:15:26.545344] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-16T17:15:26.583235] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-16T17:15:26.569853] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:15:26.638313] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-16T17:15:26.640603] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-16T17:15:26.637979] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:15:26.641483] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:15:26.641732] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-16T17:15:26.642488] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-16T17:15:26.832959] [DEBUG] [LOCAL ] AOMR: Loaded 16461 existing records from primary storage. [2025-10-16T17:15:26.849870] [DEBUG] [LOCAL ] ANVS: Loaded 23750 existing records from primary storage. [2025-10-16T17:15:26.857432] [DEBUG] [LOCAL ] AOD: Loaded 30814 existing records from primary storage. [2025-10-16T17:15:26.856990] [INFO ] [MAIN ] AOMR: Loaded 16461 existing records. [2025-10-16T17:15:26.865535] [INFO ] [MAIN ] AOD: Loaded 30814 existing records. [2025-10-16T17:15:26.857692] [INFO ] [MAIN ] ANVS: Loaded 23750 existing records. [2025-10-16T17:15:27.591245] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:15:27.613550] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-16T17:15:27.587812] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:27.653007] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-16T17:15:27.658215] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:15:27.638251] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-16T17:15:27.664192] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-16T17:15:27.667465] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-16T17:15:27.667197] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:15:27.667384] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-16T17:15:27.712107] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-16T17:15:27.721962] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-16T17:15:27.736178] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-16T17:15:27.721793] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-16T17:15:27.746863] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-16T17:15:27.789548] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-16T17:15:27.850824] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-16T17:15:27.918314] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:15:27.957317] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-16T17:15:27.974328] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:15:28.038948] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-16T17:15:28.122371] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:15:28.173365] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-16T17:15:28.226728] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-16T17:15:28.333384] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-16T17:15:28.417907] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:28.436696] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-16T17:15:28.436405] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-16T17:15:28.505456] [INFO ] [MAIN ] Update Progress: 121/2369 symbols completed. AOMD took 2.6s. Estimated remaining: 4h 46m 22s. Rate: 7.9 symbols/min [2025-10-16T17:15:28.870272] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:28.907517] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-16T17:15:28.938082] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:28.964577] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-16T17:15:28.986357] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:15:29.029210] [DEBUG] [LOCAL ] AON: Loaded 45133 existing records from primary storage. [2025-10-16T17:15:29.029556] [INFO ] [MAIN ] AON: Loaded 45133 existing records. [2025-10-16T17:15:29.200790] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:15:29.200974] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-16T17:15:29.201022] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-16T17:15:29.201211] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-16T17:15:29.201250] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-16T17:15:29.495865] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T17:15:29.509319] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-16T17:15:29.560009] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:29.560304] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-16T17:15:30.150092] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-16T17:15:30.152996] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-16T17:15:30.292726] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T17:15:30.299453] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-16T17:15:30.376143] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T17:15:30.383225] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-16T17:15:31.269152] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T17:15:31.279076] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-16T17:15:31.295804] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T17:15:31.300306] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-16T17:15:31.326987] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T17:15:31.334507] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-16T17:15:31.594030] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T17:15:31.942891] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-16T17:15:32.262021] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T17:15:32.342501] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T17:15:32.436074] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T17:15:32.742829] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-16T17:15:33.386628] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T17:15:33.542850] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-16T17:15:34.031117] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T17:15:34.317326] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T17:15:34.343007] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-16T17:15:35.142803] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-16T17:15:35.459932] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T17:15:35.942854] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-16T17:15:36.309971] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T17:15:36.742851] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-16T17:15:37.083579] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-16T17:15:37.542894] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-16T17:15:37.578449] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T17:15:38.342887] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-16T17:15:38.822593] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T17:15:39.142897] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-16T17:15:39.894456] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T17:15:39.942820] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-16T17:15:40.552489] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T17:15:40.742822] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-16T17:15:41.453531] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T17:15:41.542805] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-16T17:15:42.095846] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T17:15:42.342853] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-16T17:15:43.142804] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-16T17:15:43.325629] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T17:15:43.760271] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T17:15:43.942777] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-16T17:15:44.016673] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-16T17:15:44.742861] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-16T17:15:45.249513] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T17:15:45.542791] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-16T17:15:45.795211] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T17:15:46.342818] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-16T17:15:46.659630] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T17:15:47.142821] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-16T17:15:47.629674] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T17:15:47.942867] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-16T17:15:48.141080] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T17:15:48.581454] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-16T17:15:48.742814] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-16T17:15:49.542810] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-16T17:15:49.725777] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T17:15:50.342818] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-16T17:15:50.846749] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T17:15:50.851473] [INFO ] [REMOTE ] AOD: Full fetch complete (44706 records). [2025-10-16T17:15:50.851638] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-16T17:15:51.145444] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-16T17:15:51.236918] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-16T17:15:51.237036] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-16T17:15:51.237582] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-16T17:15:51.237625] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-16T17:15:51.238797] [DEBUG] [LOCAL ] AOD: Trimmed 44706 records to 31036 (keeping 200 days of data) [2025-10-16T17:15:51.419307] [DEBUG] [LOCAL ] AOD: Primary data saved (31036 records). [2025-10-16T17:15:51.419480] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-16T17:15:51.419603] [INFO ] [MAIN ] Update Progress: 122/2369 symbols completed. AOD took 25.5s. Estimated remaining: 4h 50m 55s. Rate: 7.7 symbols/min [2025-10-16T17:15:51.594606] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:15:51.622108] [DEBUG] [LOCAL ] AORT: Loaded 29190 existing records from primary storage. [2025-10-16T17:15:51.622405] [INFO ] [MAIN ] AORT: Loaded 29190 existing records. [2025-10-16T17:15:51.799819] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:15:51.800092] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-16T17:15:51.800258] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-16T17:15:51.800447] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-16T17:15:51.800489] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-16T17:15:51.940859] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T17:15:51.954034] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-16T17:15:52.017328] [INFO ] [REMOTE ] ANVS: Full fetch complete (36868 records). [2025-10-16T17:15:52.048042] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-16T17:15:52.353211] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:52.569374] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-16T17:15:52.569660] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-16T17:15:52.570697] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-16T17:15:52.570960] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-16T17:15:52.580002] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-16T17:15:52.584388] [DEBUG] [LOCAL ] ANVS: Trimmed 36868 records to 24112 (keeping 200 days of data) [2025-10-16T17:15:52.746971] [DEBUG] [LOCAL ] ANVS: Primary data saved (24112 records). [2025-10-16T17:15:52.747401] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-16T17:15:52.747081] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-16T17:15:52.748348] [INFO ] [MAIN ] Update Progress: 123/2369 symbols completed. ANVS took 26.8s. Estimated remaining: 4h 48m 50s. Rate: 7.8 symbols/min [2025-10-16T17:15:52.751309] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T17:15:52.931316] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:15:52.975521] [DEBUG] [LOCAL ] AOS: Loaded 48761 existing records from primary storage. [2025-10-16T17:15:52.975851] [INFO ] [MAIN ] AOS: Loaded 48761 existing records. [2025-10-16T17:15:53.150484] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:15:53.150723] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-16T17:15:53.150780] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-16T17:15:53.151053] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-16T17:15:53.151093] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-16T17:15:53.503835] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:53.542809] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-16T17:15:53.968064] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-16T17:15:54.342810] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-16T17:15:55.048588] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T17:15:55.142831] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-16T17:15:55.597329] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T17:15:55.942810] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-16T17:15:56.621282] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T17:15:56.742855] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-16T17:15:57.193149] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T17:15:57.542837] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-16T17:15:57.746878] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T17:15:58.342823] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-16T17:15:59.008732] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T17:15:59.142864] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-16T17:15:59.305254] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T17:15:59.942791] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-16T17:16:00.125577] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T17:16:00.742858] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-16T17:16:01.542850] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-16T17:16:01.708352] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T17:16:02.351075] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-16T17:16:02.358439] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T17:16:02.528010] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T17:16:03.142850] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-16T17:16:03.942834] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-16T17:16:04.009086] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T17:16:04.115284] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-16T17:16:04.742726] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-16T17:16:04.827394] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T17:16:04.829279] [INFO ] [REMOTE ] AOMR: Full fetch complete (23101 records). [2025-10-16T17:16:04.829355] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-16T17:16:04.829865] [FATAL] [VALIDATOR ] AOMR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:16:04.829949] [FATAL] [MAIN ] AOMR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:16:04.829991] [WARN ] [MAIN ] AOMR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:16:04.830029] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-16T17:16:04.830085] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-10-16T17:16:04.830159] [INFO ] [LOCAL ] AOMR: Starting deletion of derivative data. [2025-10-16T17:16:04.830369] [DEBUG] [LOCAL ] AOMR: Deleted derivative data file. [2025-10-16T17:16:04.830455] [INFO ] [MAIN ] Update Progress: 124/2369 symbols completed. AOMR took 38.9s. Estimated remaining: 4h 50m 1s. Rate: 7.7 symbols/min [2025-10-16T17:16:04.997701] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:16:05.007347] [DEBUG] [LOCAL ] AP: Loaded 7352 existing records from primary storage. [2025-10-16T17:16:05.007577] [INFO ] [MAIN ] AP: Loaded 7352 existing records. [2025-10-16T17:16:05.187464] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:16:05.187757] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-16T17:16:05.187809] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-16T17:16:05.188025] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-16T17:16:05.188081] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-16T17:16:05.537612] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:16:05.542784] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-16T17:16:06.193582] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T17:16:06.277731] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-16T17:16:06.342772] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-16T17:16:07.142837] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-16T17:16:07.785426] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T17:16:07.942818] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-16T17:16:08.742838] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-16T17:16:08.964175] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T17:16:09.145314] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T17:16:09.170699] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-16T17:16:09.542823] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-16T17:16:10.210753] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T17:16:10.342816] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-16T17:16:10.758344] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-16T17:16:11.142802] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-16T17:16:11.756575] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-16T17:16:11.942826] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-16T17:16:12.742839] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-16T17:16:13.542797] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-16T17:16:13.558237] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-16T17:16:13.563695] [INFO ] [REMOTE ] AON: Full fetch complete (64971 records). [2025-10-16T17:16:13.563797] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-16T17:16:13.949840] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-16T17:16:13.949916] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-16T17:16:13.950563] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-16T17:16:13.950604] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-16T17:16:13.951836] [DEBUG] [LOCAL ] AON: Trimmed 64971 records to 45501 (keeping 200 days of data) [2025-10-16T17:16:14.239990] [DEBUG] [LOCAL ] AON: Primary data saved (45501 records). [2025-10-16T17:16:14.240119] [INFO ] [MAIN ] AON: Full history saved. [2025-10-16T17:16:14.240204] [INFO ] [MAIN ] Update Progress: 125/2369 symbols completed. AON took 45.7s. Estimated remaining: 4h 50m 23s. Rate: 7.7 symbols/min [2025-10-16T17:16:14.343940] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-16T17:16:14.420259] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:16:14.420609] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-10-16T17:16:14.420729] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-10-16T17:16:14.421006] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-16T17:16:14.421147] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-16T17:16:14.421230] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-16T17:16:14.421421] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-16T17:16:14.745390] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-16T17:16:14.839103] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:16:14.848894] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-16T17:16:14.872214] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T17:16:15.142826] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-16T17:16:15.942851] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-16T17:16:16.668964] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T17:16:16.748049] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-16T17:16:16.754041] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T17:16:17.542828] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-16T17:16:18.342763] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-16T17:16:18.509874] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T17:16:18.583783] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-16T17:16:19.142835] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-16T17:16:19.584729] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T17:16:19.942850] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-16T17:16:20.742811] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-16T17:16:20.802968] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T17:16:21.051909] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T17:16:21.542819] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-16T17:16:21.727165] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T17:16:21.730801] [INFO ] [REMOTE ] AORT: Full fetch complete (42339 records). [2025-10-16T17:16:21.730893] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-16T17:16:22.112395] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-16T17:16:22.112484] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-16T17:16:22.112982] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-16T17:16:22.113078] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-16T17:16:22.114279] [DEBUG] [LOCAL ] AORT: Trimmed 42339 records to 29387 (keeping 200 days of data) [2025-10-16T17:16:22.279637] [DEBUG] [LOCAL ] AORT: Primary data saved (29387 records). [2025-10-16T17:16:22.279793] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-16T17:16:22.279885] [INFO ] [MAIN ] Update Progress: 126/2369 symbols completed. AORT took 30.9s. Estimated remaining: 4h 50m 21s. Rate: 7.7 symbols/min [2025-10-16T17:16:22.347945] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-16T17:16:22.462157] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:16:22.512538] [DEBUG] [LOCAL ] APD: Loaded 45470 existing records from primary storage. [2025-10-16T17:16:22.512897] [INFO ] [MAIN ] APD: Loaded 45470 existing records. [2025-10-16T17:16:22.726912] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:16:22.727161] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-16T17:16:22.727213] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-16T17:16:22.727511] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-16T17:16:22.727571] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-16T17:16:23.147341] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-16T17:16:23.168579] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T17:16:23.229752] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T17:16:23.310873] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:16:23.942854] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-16T17:16:24.742881] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-16T17:16:24.773004] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-16T17:16:24.804071] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T17:16:25.542818] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-16T17:16:26.074452] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T17:16:26.342818] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-16T17:16:27.138975] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T17:16:27.148062] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-16T17:16:27.714386] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T17:16:27.942858] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-16T17:16:28.375341] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T17:16:28.742893] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-16T17:16:28.844766] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T17:16:29.542857] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-16T17:16:30.068311] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T17:16:30.074611] [INFO ] [REMOTE ] AOS: Full fetch complete (70615 records). [2025-10-16T17:16:30.074818] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-16T17:16:30.075841] [FATAL] [VALIDATOR ] AOS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:16:30.075950] [FATAL] [MAIN ] AOS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:16:30.075995] [WARN ] [MAIN ] AOS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:16:30.076069] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-16T17:16:30.076136] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-10-16T17:16:30.076175] [INFO ] [LOCAL ] AOS: Starting deletion of derivative data. [2025-10-16T17:16:30.076371] [DEBUG] [LOCAL ] AOS: Deleted derivative data file. [2025-10-16T17:16:30.076884] [INFO ] [MAIN ] Update Progress: 127/2369 symbols completed. AOS took 37.3s. Estimated remaining: 4h 50m 13s. Rate: 7.7 symbols/min [2025-10-16T17:16:30.279791] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:16:30.331215] [DEBUG] [LOCAL ] APG: Loaded 50584 existing records from primary storage. [2025-10-16T17:16:30.331542] [INFO ] [MAIN ] APG: Loaded 50584 existing records. [2025-10-16T17:16:30.352214] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-16T17:16:30.513263] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:16:30.513478] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-16T17:16:30.513525] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-16T17:16:30.513835] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-16T17:16:30.513896] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-16T17:16:30.886448] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:16:30.987954] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T17:16:31.142841] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-16T17:16:31.942847] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-16T17:16:32.051773] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T17:16:32.665476] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T17:16:32.742840] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-16T17:16:33.385227] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T17:16:33.387079] [INFO ] [REMOTE ] AP: Full fetch complete (9082 records). [2025-10-16T17:16:33.387239] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-16T17:16:33.547327] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-16T17:16:33.767370] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-16T17:16:33.767476] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-16T17:16:33.767769] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-16T17:16:33.767909] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-16T17:16:33.768521] [DEBUG] [LOCAL ] AP: Trimmed 9082 records to 7398 (keeping 200 days of data) [2025-10-16T17:16:33.825075] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T17:16:33.845824] [DEBUG] [LOCAL ] AP: Primary data saved (7398 records). [2025-10-16T17:16:33.845974] [INFO ] [MAIN ] AP: Full history saved. [2025-10-16T17:16:33.846056] [INFO ] [MAIN ] Update Progress: 128/2369 symbols completed. AP took 29.0s. Estimated remaining: 4h 48m 56s. Rate: 7.8 symbols/min [2025-10-16T17:16:34.016027] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:16:34.070240] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-16T17:16:34.070541] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-16T17:16:34.246965] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:16:34.247174] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-16T17:16:34.247221] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-16T17:16:34.247426] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-16T17:16:34.247483] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-16T17:16:34.347935] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-16T17:16:34.671792] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:16:34.792438] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T17:16:35.142845] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-16T17:16:35.942822] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-16T17:16:36.345964] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T17:16:36.380128] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-16T17:16:36.742866] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-16T17:16:37.511746] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T17:16:37.542789] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-16T17:16:38.001861] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T17:16:38.342787] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-16T17:16:38.900787] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T17:16:39.142887] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-16T17:16:39.581303] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-16T17:16:39.942788] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-16T17:16:40.742833] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-16T17:16:41.081301] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T17:16:41.542792] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-16T17:16:41.671870] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T17:16:41.752576] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T17:16:42.342858] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-16T17:16:42.913565] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T17:16:43.142860] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-16T17:16:43.942801] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-16T17:16:44.040614] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T17:16:44.672064] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T17:16:44.742779] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-16T17:16:44.988238] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T17:16:44.992931] [INFO ] [REMOTE ] APAM: Full fetch complete (51888 records). [2025-10-16T17:16:44.993024] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-16T17:16:44.993680] [FATAL] [VALIDATOR ] APAM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:16:44.993763] [FATAL] [MAIN ] APAM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:16:44.993806] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:16:44.993844] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-16T17:16:44.993898] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-16T17:16:44.993932] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-10-16T17:16:44.993970] [DEBUG] [LOCAL ] APAM: No derivative data file found to delete. [2025-10-16T17:16:44.994023] [INFO ] [MAIN ] Update Progress: 129/2369 symbols completed. APAM took 30.8s. Estimated remaining: 4h 49m 47s. Rate: 7.7 symbols/min [2025-10-16T17:16:45.160606] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:16:45.160829] [DEBUG] [LOCAL ] APLE: No existing data file found in primary storage. [2025-10-16T17:16:45.160874] [WARN ] [MAIN ] APLE: No existing data found, performing full refresh instead. [2025-10-16T17:16:45.161011] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-16T17:16:45.161073] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-16T17:16:45.161122] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-16T17:16:45.161157] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-16T17:16:45.525732] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:16:45.542784] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-16T17:16:46.342786] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-16T17:16:46.576203] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-16T17:16:47.142789] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-16T17:16:47.413306] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-16T17:16:47.877932] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T17:16:47.942779] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-16T17:16:48.742867] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-16T17:16:49.043056] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-16T17:16:49.542873] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-16T17:16:49.669562] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T17:16:50.342843] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-16T17:16:50.437162] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T17:16:51.142808] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-16T17:16:51.640987] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-16T17:16:51.862771] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T17:16:51.942799] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-16T17:16:52.742727] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-16T17:16:52.931178] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T17:16:53.230947] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T17:16:53.542848] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-16T17:16:53.890438] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T17:16:54.342833] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-16T17:16:55.142842] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-16T17:16:55.349041] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T17:16:55.772194] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T17:16:55.942780] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-16T17:16:56.748608] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-16T17:16:56.754378] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T17:16:57.542841] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-16T17:16:57.716179] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T17:16:58.126034] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T17:16:58.132986] [INFO ] [REMOTE ] APD: Full fetch complete (67334 records). [2025-10-16T17:16:58.133229] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-16T17:16:58.343612] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-16T17:16:58.563394] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-16T17:16:58.563471] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-16T17:16:58.564239] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-16T17:16:58.564304] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-16T17:16:58.565619] [DEBUG] [LOCAL ] APD: Trimmed 67334 records to 45857 (keeping 200 days of data) [2025-10-16T17:16:58.864165] [DEBUG] [LOCAL ] APD: Primary data saved (45857 records). [2025-10-16T17:16:58.864292] [INFO ] [MAIN ] APD: Full history saved. [2025-10-16T17:16:58.864369] [INFO ] [MAIN ] Update Progress: 130/2369 symbols completed. APD took 36.6s. Estimated remaining: 4h 51m 24s. Rate: 7.7 symbols/min [2025-10-16T17:16:59.051119] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:16:59.082863] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T17:16:59.143307] [DEBUG] [LOCAL ] APO: Loaded 53389 existing records from primary storage. [2025-10-16T17:16:59.143383] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-16T17:16:59.144448] [INFO ] [MAIN ] APO: Loaded 53389 existing records. [2025-10-16T17:16:59.350087] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:16:59.350305] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-16T17:16:59.350354] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-16T17:16:59.350619] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-16T17:16:59.350720] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-16T17:16:59.729438] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:16:59.832197] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:16:59.942768] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-16T17:17:00.742820] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-16T17:17:00.782248] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T17:17:01.305685] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T17:17:01.542863] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-16T17:17:02.342810] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-16T17:17:02.904195] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-16T17:17:02.932261] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T17:17:02.938719] [INFO ] [REMOTE ] APG: Full fetch complete (72176 records). [2025-10-16T17:17:02.938833] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-16T17:17:03.151962] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-16T17:17:03.324436] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-16T17:17:03.324522] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-16T17:17:03.325237] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-16T17:17:03.325300] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-16T17:17:03.326712] [DEBUG] [LOCAL ] APG: Trimmed 72176 records to 50964 (keeping 200 days of data) [2025-10-16T17:17:03.629939] [DEBUG] [LOCAL ] APG: Primary data saved (50964 records). [2025-10-16T17:17:03.630062] [INFO ] [MAIN ] APG: Full history saved. [2025-10-16T17:17:03.630747] [INFO ] [MAIN ] Update Progress: 131/2369 symbols completed. APG took 33.6s. Estimated remaining: 4h 50m 25s. Rate: 7.7 symbols/min [2025-10-16T17:17:03.805100] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:17:03.837147] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T17:17:03.851388] [DEBUG] [LOCAL ] APOS: Loaded 7314 existing records from primary storage. [2025-10-16T17:17:03.851681] [INFO ] [MAIN ] APOS: Loaded 7314 existing records. [2025-10-16T17:17:03.948162] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-16T17:17:04.029340] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:17:04.029538] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-16T17:17:04.029586] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-16T17:17:04.029779] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-16T17:17:04.029836] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-16T17:17:04.377803] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:17:04.742871] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-16T17:17:05.307422] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-16T17:17:05.542788] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-16T17:17:05.955574] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T17:17:06.349454] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-16T17:17:06.369402] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T17:17:06.949963] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T17:17:07.142798] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-16T17:17:07.942842] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-16T17:17:08.110977] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T17:17:08.742821] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-16T17:17:09.207215] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-16T17:17:09.291923] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-16T17:17:09.334436] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T17:17:09.542877] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-16T17:17:10.342853] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-16T17:17:11.010944] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T17:17:11.142847] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-16T17:17:11.233073] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T17:17:11.239975] [INFO ] [REMOTE ] APH: Full fetch complete (77479 records). [2025-10-16T17:17:11.240157] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-16T17:17:11.241104] [FATAL] [VALIDATOR ] APH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:17:11.241206] [FATAL] [MAIN ] APH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:17:11.241249] [WARN ] [MAIN ] APH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:17:11.241289] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-16T17:17:11.241346] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-10-16T17:17:11.241382] [INFO ] [LOCAL ] APH: Starting deletion of derivative data. [2025-10-16T17:17:11.241687] [DEBUG] [LOCAL ] APH: Deleted derivative data file. [2025-10-16T17:17:11.242221] [INFO ] [MAIN ] Update Progress: 132/2369 symbols completed. APH took 37.4s. Estimated remaining: 4h 50m 14s. Rate: 7.7 symbols/min [2025-10-16T17:17:11.412891] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:17:11.413115] [DEBUG] [LOCAL ] APTV: No existing data file found in primary storage. [2025-10-16T17:17:11.413153] [WARN ] [MAIN ] APTV: No existing data found, performing full refresh instead. [2025-10-16T17:17:11.413271] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-16T17:17:11.413312] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-16T17:17:11.413353] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-16T17:17:11.413385] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-16T17:17:11.776905] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:17:11.942806] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-16T17:17:12.742807] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-16T17:17:13.001102] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-16T17:17:13.542804] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-16T17:17:13.675475] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T17:17:14.232245] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-16T17:17:14.342830] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-16T17:17:14.519769] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T17:17:15.142888] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-16T17:17:15.942835] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-16T17:17:15.998100] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T17:17:16.171011] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-16T17:17:16.178068] [INFO ] [REMOTE ] APLE: Full fetch complete (74728 records). [2025-10-16T17:17:16.178174] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-16T17:17:16.565028] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-16T17:17:16.565107] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-16T17:17:16.565841] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-16T17:17:16.565904] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-16T17:17:16.567238] [DEBUG] [LOCAL ] APLE: Trimmed 74728 records to 52352 (keeping 200 days of data) [2025-10-16T17:17:16.747871] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-16T17:17:16.880535] [DEBUG] [LOCAL ] APLE: Primary data saved (52352 records). [2025-10-16T17:17:16.880699] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-16T17:17:16.880785] [INFO ] [MAIN ] Update Progress: 133/2369 symbols completed. APLE took 31.9s. Estimated remaining: 4h 49m 30s. Rate: 7.7 symbols/min [2025-10-16T17:17:17.045427] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:17:17.045557] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-10-16T17:17:17.045593] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-10-16T17:17:17.045724] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-16T17:17:17.045783] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-16T17:17:17.045869] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-16T17:17:17.045917] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-16T17:17:17.389222] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:17:17.409984] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-16T17:17:17.542873] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-16T17:17:18.191374] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-16T17:17:18.342779] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-16T17:17:19.142792] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-16T17:17:19.209000] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T17:17:19.942790] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-16T17:17:20.236620] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T17:17:20.652923] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T17:17:20.742783] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-16T17:17:21.321467] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T17:17:21.542886] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-16T17:17:21.969789] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T17:17:22.342826] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-16T17:17:22.923372] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T17:17:23.142773] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-16T17:17:23.252442] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T17:17:23.942814] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-16T17:17:24.704314] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T17:17:24.742764] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-16T17:17:25.542918] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-16T17:17:25.678417] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T17:17:26.230187] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T17:17:26.274517] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-16T17:17:26.342812] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-16T17:17:27.142817] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-16T17:17:27.563942] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-16T17:17:27.942895] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-16T17:17:28.062425] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T17:17:28.742818] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-16T17:17:29.542832] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-16T17:17:29.864859] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T17:17:30.342812] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-16T17:17:30.519502] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T17:17:30.834574] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T17:17:31.142850] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-16T17:17:31.890442] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T17:17:31.942785] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-16T17:17:32.742815] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-16T17:17:32.875957] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T17:17:33.428249] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:17:33.474785] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T17:17:33.542780] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-16T17:17:34.342792] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-16T17:17:35.142931] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-16T17:17:35.380534] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T17:17:35.942872] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-16T17:17:36.161438] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T17:17:36.441504] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-16T17:17:36.613136] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T17:17:36.742776] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-16T17:17:37.542862] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-16T17:17:38.342800] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-16T17:17:38.532957] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T17:17:38.844495] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T17:17:39.142867] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-16T17:17:39.942886] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-16T17:17:40.012583] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T17:17:40.022825] [INFO ] [REMOTE ] APO: Full fetch complete (77464 records). [2025-10-16T17:17:40.023054] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-16T17:17:40.403906] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-16T17:17:40.403981] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-16T17:17:40.404740] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-16T17:17:40.404802] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-16T17:17:40.406163] [DEBUG] [LOCAL ] APO: Trimmed 77464 records to 53779 (keeping 200 days of data) [2025-10-16T17:17:40.753703] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-16T17:17:40.773798] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T17:17:40.792174] [DEBUG] [LOCAL ] APO: Primary data saved (53779 records). [2025-10-16T17:17:40.793032] [INFO ] [MAIN ] APO: Full history saved. [2025-10-16T17:17:40.793137] [INFO ] [MAIN ] Update Progress: 134/2369 symbols completed. APO took 41.9s. Estimated remaining: 4h 53m 52s. Rate: 7.6 symbols/min [2025-10-16T17:17:40.957787] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:17:40.965448] [DEBUG] [LOCAL ] AQNB: Loaded 4069 existing records from primary storage. [2025-10-16T17:17:40.965665] [INFO ] [MAIN ] AQNB: Loaded 4069 existing records. [2025-10-16T17:17:41.141249] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:17:41.141492] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-16T17:17:41.141547] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-16T17:17:41.141737] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-16T17:17:41.141794] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-16T17:17:41.509744] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:17:41.538484] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T17:17:41.544032] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-16T17:17:41.546007] [INFO ] [REMOTE ] APTV: Full fetch complete (75563 records). [2025-10-16T17:17:41.546157] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-16T17:17:41.547070] [FATAL] [VALIDATOR ] APTV: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:17:41.547165] [FATAL] [MAIN ] APTV: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:17:41.547208] [WARN ] [MAIN ] APTV: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:17:41.547272] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-16T17:17:41.547335] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-16T17:17:41.547372] [INFO ] [LOCAL ] APTV: Starting deletion of derivative data. [2025-10-16T17:17:41.547410] [DEBUG] [LOCAL ] APTV: No derivative data file found to delete. [2025-10-16T17:17:41.547468] [INFO ] [MAIN ] Update Progress: 135/2369 symbols completed. APTV took 30.3s. Estimated remaining: 4h 51m 46s. Rate: 7.7 symbols/min [2025-10-16T17:17:41.719404] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:17:41.719604] [DEBUG] [LOCAL ] AR: No existing data file found in primary storage. [2025-10-16T17:17:41.719661] [WARN ] [MAIN ] AR: No existing data found, performing full refresh instead. [2025-10-16T17:17:41.719788] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-16T17:17:41.719828] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-16T17:17:41.719869] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-16T17:17:41.719900] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-16T17:17:41.827221] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T17:17:41.840489] [INFO ] [REMOTE ] APOS: Full fetch complete (10331 records). [2025-10-16T17:17:41.851235] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-16T17:17:42.322503] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-16T17:17:42.354097] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-16T17:17:42.385083] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:17:42.507881] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-16T17:17:42.507969] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-16T17:17:42.508193] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-16T17:17:42.508233] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-16T17:17:42.508892] [DEBUG] [LOCAL ] APOS: Trimmed 10331 records to 7359 (keeping 200 days of data) [2025-10-16T17:17:42.556270] [DEBUG] [LOCAL ] APOS: Primary data saved (7359 records). [2025-10-16T17:17:42.556457] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-16T17:17:42.556554] [INFO ] [MAIN ] Update Progress: 136/2369 symbols completed. APOS took 38.9s. Estimated remaining: 4h 49m 46s. Rate: 7.7 symbols/min [2025-10-16T17:17:42.733114] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:17:42.773371] [DEBUG] [LOCAL ] ARCO: Loaded 44501 existing records from primary storage. [2025-10-16T17:17:42.773705] [INFO ] [MAIN ] ARCO: Loaded 44501 existing records. [2025-10-16T17:17:42.954907] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:17:42.955202] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-16T17:17:42.955293] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-16T17:17:42.955711] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-16T17:17:42.955776] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-16T17:17:43.148700] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-16T17:17:43.325293] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:17:43.853955] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T17:17:43.942787] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-16T17:17:44.632403] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T17:17:44.742796] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-16T17:17:45.542831] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-16T17:17:45.777212] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T17:17:46.342825] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-16T17:17:46.440741] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T17:17:46.911815] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T17:17:47.142828] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-16T17:17:47.771246] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T17:17:47.778391] [INFO ] [REMOTE ] AQN: Full fetch complete (75386 records). [2025-10-16T17:17:47.778519] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-16T17:17:47.963096] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-16T17:17:48.187212] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-16T17:17:48.187328] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-16T17:17:48.188121] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-16T17:17:48.188190] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-16T17:17:48.189699] [DEBUG] [LOCAL ] AQN: Trimmed 75386 records to 52131 (keeping 200 days of data) [2025-10-16T17:17:48.490973] [DEBUG] [LOCAL ] AQN: Primary data saved (52131 records). [2025-10-16T17:17:48.491146] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-16T17:17:48.491244] [INFO ] [MAIN ] Update Progress: 137/2369 symbols completed. AQN took 31.6s. Estimated remaining: 4h 49m 8s. Rate: 7.7 symbols/min [2025-10-16T17:17:48.669815] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:17:48.686704] [DEBUG] [LOCAL ] ARDC: Loaded 15318 existing records from primary storage. [2025-10-16T17:17:48.686932] [INFO ] [MAIN ] ARDC: Loaded 15318 existing records. [2025-10-16T17:17:48.752029] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-16T17:17:48.893430] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T17:17:48.907274] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:17:48.908345] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-16T17:17:48.908404] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-16T17:17:48.908634] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-16T17:17:48.908724] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-16T17:17:49.250319] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:17:49.298110] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T17:17:49.345557] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T17:17:49.542807] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-16T17:17:49.980031] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T17:17:50.342814] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-16T17:17:50.916035] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-16T17:17:51.142829] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-16T17:17:51.802338] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-16T17:17:51.942866] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-16T17:17:52.742836] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-16T17:17:52.815230] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T17:17:53.279213] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-16T17:17:53.542930] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-16T17:17:54.342880] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-16T17:17:54.654071] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T17:17:55.142841] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-16T17:17:55.942889] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-16T17:17:56.175456] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T17:17:56.615394] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-16T17:17:56.742834] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-16T17:17:56.951755] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T17:17:57.542819] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-16T17:17:57.627244] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T17:17:58.342839] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-16T17:17:59.142800] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-16T17:17:59.330178] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T17:17:59.474971] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T17:17:59.764461] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-16T17:17:59.942796] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-16T17:18:00.321363] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-16T17:18:00.742817] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-16T17:18:01.542848] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-16T17:18:02.236430] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-16T17:18:02.321421] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T17:18:02.342774] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-16T17:18:03.142841] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-16T17:18:03.932282] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T17:18:03.942759] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-16T17:18:04.226480] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T17:18:04.271632] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-16T17:18:04.742868] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-16T17:18:05.319503] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T17:18:05.320439] [INFO ] [REMOTE ] AQNB: Full fetch complete (5485 records). [2025-10-16T17:18:05.320507] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-16T17:18:05.547914] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-16T17:18:05.695511] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-16T17:18:05.695587] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-16T17:18:05.695768] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-16T17:18:05.695828] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-16T17:18:05.696183] [DEBUG] [LOCAL ] AQNB: Trimmed 5485 records to 4077 (keeping 200 days of data) [2025-10-16T17:18:05.719995] [DEBUG] [LOCAL ] AQNB: Primary data saved (4077 records). [2025-10-16T17:18:05.720058] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-16T17:18:05.720146] [INFO ] [MAIN ] Update Progress: 138/2369 symbols completed. AQNB took 24.9s. Estimated remaining: 4h 51m 33s. Rate: 7.7 symbols/min [2025-10-16T17:18:05.884067] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:18:05.910393] [DEBUG] [LOCAL ] ARDT: Loaded 27721 existing records from primary storage. [2025-10-16T17:18:05.910663] [INFO ] [MAIN ] ARDT: Loaded 27721 existing records. [2025-10-16T17:18:06.083742] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:18:06.083940] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-16T17:18:06.083986] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-16T17:18:06.084182] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-16T17:18:06.084237] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-16T17:18:06.348036] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-16T17:18:06.441834] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:18:06.452968] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T17:18:07.142875] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-16T17:18:07.942882] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-16T17:18:08.252397] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T17:18:08.742919] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-16T17:18:08.784725] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-16T17:18:09.542789] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-16T17:18:09.691124] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T17:18:09.746564] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T17:18:10.342815] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-16T17:18:10.949624] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T17:18:11.142816] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-16T17:18:11.160873] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T17:18:11.942784] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-16T17:18:12.742854] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-16T17:18:13.199534] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-16T17:18:13.225964] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T17:18:13.542815] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-16T17:18:14.257974] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T17:18:14.342833] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-16T17:18:14.454452] [DEBUG] [REMOTE ] ARCO: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-16T17:18:14.454841] [WARN ] [REMOTE ] ARCO: No data returned for month 2025-07 [2025-10-16T17:18:14.454947] [FATAL] [REMOTE ] ARCO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:18:14.455069] [FATAL] [MAIN ] ARCO: Failed to fetch primary data. [2025-10-16T17:18:14.455151] [WARN ] [MAIN ] ARCO: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:18:14.455262] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-16T17:18:14.455360] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-16T17:18:14.455412] [INFO ] [LOCAL ] ARCO: Starting deletion of derivative data. [2025-10-16T17:18:14.455625] [DEBUG] [LOCAL ] ARCO: Deleted derivative data file. [2025-10-16T17:18:14.456278] [INFO ] [MAIN ] Update Progress: 139/2369 symbols completed. ARCO took 31.9s. Estimated remaining: 4h 51m 39s. Rate: 7.6 symbols/min [2025-10-16T17:18:14.637936] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:18:14.687447] [DEBUG] [LOCAL ] ARE: Loaded 50973 existing records from primary storage. [2025-10-16T17:18:14.687799] [INFO ] [MAIN ] ARE: Loaded 50973 existing records. [2025-10-16T17:18:14.864716] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:18:14.864923] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-16T17:18:14.864969] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-16T17:18:14.865295] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-16T17:18:14.865334] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-16T17:18:15.147936] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-16T17:18:15.223626] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:18:15.772538] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-16T17:18:15.779832] [INFO ] [REMOTE ] AR: Full fetch complete (77738 records). [2025-10-16T17:18:15.780003] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-16T17:18:15.949956] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-16T17:18:15.971268] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-16T17:18:16.202946] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-16T17:18:16.203035] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-16T17:18:16.203846] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-16T17:18:16.203915] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-16T17:18:16.205455] [DEBUG] [LOCAL ] AR: Trimmed 77738 records to 53977 (keeping 200 days of data) [2025-10-16T17:18:16.535981] [DEBUG] [LOCAL ] AR: Primary data saved (53977 records). [2025-10-16T17:18:16.536133] [INFO ] [MAIN ] AR: Full history saved. [2025-10-16T17:18:16.536225] [INFO ] [MAIN ] Update Progress: 140/2369 symbols completed. AR took 35.0s. Estimated remaining: 4h 49m 60s. Rate: 7.7 symbols/min [2025-10-16T17:18:16.705879] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:18:16.706036] [DEBUG] [LOCAL ] ARES: No existing data file found in primary storage. [2025-10-16T17:18:16.706116] [WARN ] [MAIN ] ARES: No existing data found, performing full refresh instead. [2025-10-16T17:18:16.706198] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-16T17:18:16.706235] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-16T17:18:16.706289] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-16T17:18:16.706334] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-16T17:18:16.748293] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-16T17:18:17.069973] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:18:17.483508] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T17:18:17.542837] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-16T17:18:17.791165] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T17:18:18.342847] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-16T17:18:19.094458] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T17:18:19.142874] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-16T17:18:19.517190] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T17:18:19.942874] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-16T17:18:20.748124] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-16T17:18:20.762571] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:18:21.542802] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-16T17:18:21.948314] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T17:18:22.022463] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T17:18:22.342830] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-16T17:18:23.073756] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T17:18:23.142778] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-16T17:18:23.682373] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-16T17:18:23.942833] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-16T17:18:24.650855] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T17:18:24.742777] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-16T17:18:25.029821] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T17:18:25.542816] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-16T17:18:26.342820] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-16T17:18:26.399981] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T17:18:26.946073] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-16T17:18:27.142009] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-16T17:18:27.145985] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-16T17:18:27.942812] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-16T17:18:28.742804] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-16T17:18:29.118249] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T17:18:29.542789] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-16T17:18:29.690283] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T17:18:29.723810] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T17:18:30.342780] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-16T17:18:30.499708] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T17:18:31.142865] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-16T17:18:31.792536] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T17:18:31.942817] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-16T17:18:32.742884] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-16T17:18:33.083113] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-16T17:18:33.286250] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T17:18:33.542820] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-16T17:18:34.005110] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T17:18:34.342815] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-16T17:18:35.142869] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-16T17:18:35.312087] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T17:18:35.372025] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T17:18:35.942846] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-16T17:18:36.193250] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T17:18:36.196330] [INFO ] [REMOTE ] ARDC: Full fetch complete (21501 records). [2025-10-16T17:18:36.196452] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-16T17:18:36.563569] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-16T17:18:36.563894] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-16T17:18:36.564225] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-16T17:18:36.564264] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-16T17:18:36.564858] [DEBUG] [LOCAL ] ARDC: Trimmed 21501 records to 15429 (keeping 200 days of data) [2025-10-16T17:18:36.653678] [DEBUG] [LOCAL ] ARDC: Primary data saved (15429 records). [2025-10-16T17:18:36.653809] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-16T17:18:36.653889] [INFO ] [MAIN ] Update Progress: 141/2369 symbols completed. ARDC took 48.2s. Estimated remaining: 4h 53m 6s. Rate: 7.6 symbols/min [2025-10-16T17:18:36.749410] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-16T17:18:36.823809] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:18:36.863075] [DEBUG] [LOCAL ] ARI: Loaded 43733 existing records from primary storage. [2025-10-16T17:18:36.863366] [INFO ] [MAIN ] ARI: Loaded 43733 existing records. [2025-10-16T17:18:37.047166] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T17:18:37.052221] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:18:37.056786] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-16T17:18:37.057163] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-16T17:18:37.057350] [INFO ] [REMOTE ] ARDT: Full fetch complete (41633 records). [2025-10-16T17:18:37.057427] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-16T17:18:37.057639] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-16T17:18:37.088704] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-16T17:18:37.547794] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-16T17:18:37.800524] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-16T17:18:37.805773] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-16T17:18:37.811468] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-16T17:18:37.816702] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-16T17:18:37.879819] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:18:37.879994] [DEBUG] [LOCAL ] ARDT: Trimmed 41633 records to 27912 (keeping 200 days of data) [2025-10-16T17:18:38.036982] [DEBUG] [LOCAL ] ARDT: Primary data saved (27912 records). [2025-10-16T17:18:38.037120] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-16T17:18:38.037201] [INFO ] [MAIN ] Update Progress: 142/2369 symbols completed. ARDT took 32.3s. Estimated remaining: 4h 51m 16s. Rate: 7.6 symbols/min [2025-10-16T17:18:38.209519] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:18:38.252897] [DEBUG] [LOCAL ] ARLO: Loaded 43803 existing records from primary storage. [2025-10-16T17:18:38.253221] [INFO ] [MAIN ] ARLO: Loaded 43803 existing records. [2025-10-16T17:18:38.349375] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-16T17:18:38.445135] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:18:38.445414] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-16T17:18:38.445474] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-16T17:18:38.445755] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-16T17:18:38.445814] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-16T17:18:38.854030] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:18:38.887801] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-16T17:18:39.008193] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T17:18:39.142817] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-16T17:18:39.708121] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T17:18:39.942871] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-16T17:18:40.742829] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-16T17:18:41.097830] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-16T17:18:41.542827] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-16T17:18:41.833688] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-16T17:18:41.909314] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T17:18:42.342812] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-16T17:18:43.037395] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T17:18:43.142794] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-16T17:18:43.942858] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-16T17:18:43.997332] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T17:18:44.609885] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T17:18:44.616537] [INFO ] [REMOTE ] ARE: Full fetch complete (73003 records). [2025-10-16T17:18:44.616679] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-16T17:18:44.748021] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-16T17:18:45.016032] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-16T17:18:45.016130] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-16T17:18:45.017046] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-16T17:18:45.017122] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-16T17:18:45.018616] [DEBUG] [LOCAL ] ARE: Trimmed 73003 records to 51360 (keeping 200 days of data) [2025-10-16T17:18:45.339234] [DEBUG] [LOCAL ] ARE: Primary data saved (51360 records). [2025-10-16T17:18:45.339361] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-16T17:18:45.340367] [INFO ] [MAIN ] Update Progress: 143/2369 symbols completed. ARE took 30.9s. Estimated remaining: 4h 51m 0s. Rate: 7.6 symbols/min [2025-10-16T17:18:45.516188] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T17:18:45.541955] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:18:45.550253] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-16T17:18:45.550393] [DEBUG] [LOCAL ] ARMK: No existing data file found in primary storage. [2025-10-16T17:18:45.550474] [WARN ] [MAIN ] ARMK: No existing data found, performing full refresh instead. [2025-10-16T17:18:45.552055] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-16T17:18:45.552468] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-16T17:18:45.552674] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-10-16T17:18:45.552729] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-16T17:18:45.908095] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:18:46.342780] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-16T17:18:46.585186] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T17:18:46.591675] [INFO ] [REMOTE ] ARES: Full fetch complete (71085 records). [2025-10-16T17:18:46.591839] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-16T17:18:46.592580] [FATAL] [VALIDATOR ] ARES: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:18:46.592787] [FATAL] [MAIN ] ARES: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:18:46.592864] [WARN ] [MAIN ] ARES: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:18:46.592937] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-16T17:18:46.593028] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-16T17:18:46.593079] [INFO ] [LOCAL ] ARES: Starting deletion of derivative data. [2025-10-16T17:18:46.593134] [DEBUG] [LOCAL ] ARES: No derivative data file found to delete. [2025-10-16T17:18:46.593214] [INFO ] [MAIN ] Update Progress: 144/2369 symbols completed. ARES took 30.1s. Estimated remaining: 4h 49m 10s. Rate: 7.7 symbols/min [2025-10-16T17:18:46.761149] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:18:46.811601] [DEBUG] [LOCAL ] AROC: Loaded 49062 existing records from primary storage. [2025-10-16T17:18:46.811991] [INFO ] [MAIN ] AROC: Loaded 49062 existing records. [2025-10-16T17:18:47.002538] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:18:47.002939] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-16T17:18:47.003218] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-16T17:18:47.003723] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-16T17:18:47.003792] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-16T17:18:47.146605] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-16T17:18:47.271528] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T17:18:47.402820] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:18:47.755850] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T17:18:47.942845] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-16T17:18:48.742821] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-16T17:18:48.975045] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T17:18:49.542819] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-16T17:18:49.644512] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T17:18:49.852518] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T17:18:50.342814] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-16T17:18:50.899874] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-16T17:18:51.142875] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-16T17:18:51.925012] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T17:18:51.942771] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-16T17:18:52.544753] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T17:18:52.742810] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-16T17:18:53.411941] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T17:18:53.542817] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-16T17:18:53.892013] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T17:18:54.342881] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-16T17:18:55.010941] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T17:18:55.142835] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-16T17:18:55.893447] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T17:18:55.942850] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-16T17:18:56.326470] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T17:18:56.742920] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-16T17:18:57.548085] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-16T17:18:57.571685] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T17:18:58.342874] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-16T17:18:58.385687] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T17:18:58.829969] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T17:18:59.142881] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-16T17:18:59.947926] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-16T17:18:59.977328] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T17:19:00.743481] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-16T17:19:00.748104] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T17:19:01.542866] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-16T17:19:01.707492] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T17:19:02.294336] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T17:19:02.342941] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-16T17:19:02.800785] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T17:19:03.142825] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-16T17:19:03.942816] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-16T17:19:04.121257] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T17:19:04.485292] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T17:19:04.491150] [INFO ] [REMOTE ] ARI: Full fetch complete (62553 records). [2025-10-16T17:19:04.491342] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-16T17:19:04.752509] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-16T17:19:04.891108] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-16T17:19:04.891199] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-16T17:19:04.891873] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-16T17:19:04.891937] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-16T17:19:04.893231] [DEBUG] [LOCAL ] ARI: Trimmed 62553 records to 44048 (keeping 200 days of data) [2025-10-16T17:19:05.154798] [DEBUG] [LOCAL ] ARI: Primary data saved (44048 records). [2025-10-16T17:19:05.154977] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-16T17:19:05.155707] [INFO ] [MAIN ] Update Progress: 145/2369 symbols completed. ARI took 28.5s. Estimated remaining: 4h 51m 48s. Rate: 7.6 symbols/min [2025-10-16T17:19:05.323045] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:19:05.376041] [DEBUG] [LOCAL ] ARR: Loaded 52115 existing records from primary storage. [2025-10-16T17:19:05.376331] [INFO ] [MAIN ] ARR: Loaded 52115 existing records. [2025-10-16T17:19:05.548380] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-16T17:19:05.552589] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:19:05.553680] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-16T17:19:05.553838] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-16T17:19:05.554108] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-16T17:19:05.554154] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-16T17:19:05.835623] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-16T17:19:05.947805] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:19:06.350911] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-16T17:19:06.356221] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T17:19:06.971279] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T17:19:07.142886] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-16T17:19:07.942802] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-16T17:19:08.119841] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T17:19:08.742870] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-16T17:19:08.811950] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T17:19:08.817431] [INFO ] [REMOTE ] ARLO: Full fetch complete (62948 records). [2025-10-16T17:19:08.817598] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-16T17:19:08.818496] [FATAL] [VALIDATOR ] ARLO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:19:08.818590] [FATAL] [MAIN ] ARLO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:19:08.818680] [WARN ] [MAIN ] ARLO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:19:08.818757] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-16T17:19:08.818823] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-16T17:19:08.818860] [INFO ] [LOCAL ] ARLO: Starting deletion of derivative data. [2025-10-16T17:19:08.819041] [DEBUG] [LOCAL ] ARLO: Deleted derivative data file. [2025-10-16T17:19:08.819133] [INFO ] [MAIN ] Update Progress: 146/2369 symbols completed. ARLO took 30.8s. Estimated remaining: 4h 50m 36s. Rate: 7.6 symbols/min [2025-10-16T17:19:08.990713] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:19:09.023359] [DEBUG] [LOCAL ] ARW: Loaded 33090 existing records from primary storage. [2025-10-16T17:19:09.023666] [INFO ] [MAIN ] ARW: Loaded 33090 existing records. [2025-10-16T17:19:09.197529] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:19:09.197747] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-16T17:19:09.197798] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-16T17:19:09.197977] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-16T17:19:09.198014] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-16T17:19:09.544167] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-16T17:19:09.548817] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:19:09.590572] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T17:19:10.342804] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-16T17:19:10.610568] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T17:19:10.717012] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T17:19:11.142855] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-16T17:19:11.942927] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-16T17:19:12.420301] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-16T17:19:12.468054] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T17:19:12.742848] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-16T17:19:13.524494] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T17:19:13.542786] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-16T17:19:14.274675] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T17:19:14.342783] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-16T17:19:15.142798] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-16T17:19:15.271524] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T17:19:15.761117] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T17:19:15.942791] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-16T17:19:16.504293] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T17:19:16.742861] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-16T17:19:17.542950] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-16T17:19:17.933296] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-16T17:19:17.999823] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T17:19:18.342851] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-16T17:19:18.946025] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T17:19:19.142871] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-16T17:19:19.942840] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-16T17:19:20.080762] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T17:19:20.175372] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T17:19:20.742842] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-16T17:19:21.542847] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-16T17:19:21.932178] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T17:19:21.995957] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-16T17:19:22.342831] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-16T17:19:22.895944] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T17:19:23.142814] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-16T17:19:23.501206] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-16T17:19:23.942851] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-16T17:19:24.722368] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T17:19:24.742784] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-16T17:19:25.542789] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-16T17:19:25.948024] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-16T17:19:25.954698] [INFO ] [REMOTE ] ARMK: Full fetch complete (72955 records). [2025-10-16T17:19:25.954841] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-16T17:19:26.337718] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-16T17:19:26.337904] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-16T17:19:26.338910] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-16T17:19:26.339013] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-16T17:19:26.340527] [DEBUG] [LOCAL ] ARMK: Trimmed 72955 records to 50753 (keeping 200 days of data) [2025-10-16T17:19:26.392731] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-16T17:19:26.588394] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T17:19:26.713155] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T17:19:26.740506] [DEBUG] [LOCAL ] ARMK: Primary data saved (50753 records). [2025-10-16T17:19:26.740671] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-16T17:19:26.740763] [INFO ] [MAIN ] Update Progress: 147/2369 symbols completed. ARMK took 41.4s. Estimated remaining: 4h 53m 0s. Rate: 7.6 symbols/min [2025-10-16T17:19:26.909072] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:19:26.909260] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-16T17:19:26.909298] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-16T17:19:26.909434] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-16T17:19:26.909476] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-16T17:19:26.909518] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-16T17:19:26.909551] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-16T17:19:27.149579] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-16T17:19:27.267865] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:19:27.942777] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-16T17:19:28.122504] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T17:19:28.133055] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:19:28.133837] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-16T17:19:28.133936] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:19:28.134368] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-16T17:19:28.134437] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:19:28.134509] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-16T17:19:28.134571] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-16T17:19:28.134607] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-16T17:19:28.134671] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-16T17:19:28.134736] [INFO ] [MAIN ] Update Progress: 148/2369 symbols completed. ARX took 1.4s. Estimated remaining: 4h 51m 15s. Rate: 7.6 symbols/min [2025-10-16T17:19:28.314183] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:19:28.362619] [DEBUG] [LOCAL ] AS: Loaded 53174 existing records from primary storage. [2025-10-16T17:19:28.362966] [INFO ] [MAIN ] AS: Loaded 53174 existing records. [2025-10-16T17:19:28.560246] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:19:28.561614] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T17:19:28.561885] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-16T17:19:28.568421] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-16T17:19:28.568907] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-16T17:19:28.568995] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-16T17:19:28.750850] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-16T17:19:28.914082] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:19:29.542858] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-16T17:19:30.159543] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T17:19:30.342796] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-16T17:19:30.996243] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T17:19:31.142829] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-16T17:19:31.727390] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T17:19:31.942815] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-16T17:19:32.742786] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-16T17:19:32.804839] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T17:19:32.810909] [INFO ] [REMOTE ] AROC: Full fetch complete (70871 records). [2025-10-16T17:19:32.811027] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-16T17:19:32.811923] [FATAL] [VALIDATOR ] AROC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:19:32.812013] [FATAL] [MAIN ] AROC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:19:32.812055] [WARN ] [MAIN ] AROC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:19:32.812120] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-16T17:19:32.812182] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-10-16T17:19:32.812219] [INFO ] [LOCAL ] AROC: Starting deletion of derivative data. [2025-10-16T17:19:32.812378] [DEBUG] [LOCAL ] AROC: Deleted derivative data file. [2025-10-16T17:19:32.812466] [INFO ] [MAIN ] Update Progress: 149/2369 symbols completed. AROC took 46.2s. Estimated remaining: 4h 50m 19s. Rate: 7.6 symbols/min [2025-10-16T17:19:32.995366] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:19:33.013423] [DEBUG] [LOCAL ] ASA: Loaded 15215 existing records from primary storage. [2025-10-16T17:19:33.013695] [INFO ] [MAIN ] ASA: Loaded 15215 existing records. [2025-10-16T17:19:33.197979] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:19:33.198217] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-16T17:19:33.198301] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-16T17:19:33.198501] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-16T17:19:33.198588] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-16T17:19:33.377599] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T17:19:33.554011] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-16T17:19:33.594180] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:19:34.342833] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-16T17:19:34.430677] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T17:19:34.844671] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T17:19:35.142830] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-16T17:19:35.648069] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T17:19:35.942802] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-16T17:19:36.742837] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-16T17:19:36.849886] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T17:19:37.072846] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-16T17:19:37.077900] [INFO ] [REMOTE ] ARW: Full fetch complete (48439 records). [2025-10-16T17:19:37.078037] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-16T17:19:37.526430] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-16T17:19:37.526503] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-16T17:19:37.527088] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-16T17:19:37.527151] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-16T17:19:37.528135] [DEBUG] [LOCAL ] ARW: Trimmed 48439 records to 33338 (keeping 200 days of data) [2025-10-16T17:19:37.581393] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-16T17:19:37.728139] [DEBUG] [LOCAL ] ARW: Primary data saved (33338 records). [2025-10-16T17:19:37.728270] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-16T17:19:37.728351] [INFO ] [MAIN ] Update Progress: 150/2369 symbols completed. ARW took 28.9s. Estimated remaining: 4h 49m 28s. Rate: 7.7 symbols/min [2025-10-16T17:19:37.899019] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:19:37.948881] [DEBUG] [LOCAL ] ASAN: Loaded 52733 existing records from primary storage. [2025-10-16T17:19:37.949210] [INFO ] [MAIN ] ASAN: Loaded 52733 existing records. [2025-10-16T17:19:38.127072] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:19:38.127278] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-16T17:19:38.127334] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-16T17:19:38.127743] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-16T17:19:38.127798] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-16T17:19:38.250871] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-16T17:19:38.343335] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-16T17:19:38.530303] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:19:38.559722] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T17:19:39.142796] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-16T17:19:39.191038] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T17:19:39.942819] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-16T17:19:40.537243] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T17:19:40.655630] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T17:19:40.742866] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-16T17:19:41.542852] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-16T17:19:41.578257] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T17:19:42.342829] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-16T17:19:43.142805] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-16T17:19:43.294386] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-16T17:19:43.491588] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T17:19:43.942834] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-16T17:19:44.742818] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-16T17:19:44.795115] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T17:19:44.802205] [INFO ] [REMOTE ] ARR: Full fetch complete (75480 records). [2025-10-16T17:19:44.802388] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-16T17:19:45.198022] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-16T17:19:45.198101] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-16T17:19:45.198936] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-16T17:19:45.199009] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-16T17:19:45.200387] [DEBUG] [LOCAL ] ARR: Trimmed 75480 records to 52502 (keeping 200 days of data) [2025-10-16T17:19:45.453747] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T17:19:45.552562] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-16T17:19:45.567530] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T17:19:45.590301] [DEBUG] [LOCAL ] ARR: Primary data saved (52502 records). [2025-10-16T17:19:45.590417] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-16T17:19:45.591296] [INFO ] [MAIN ] Update Progress: 151/2369 symbols completed. ARR took 40.4s. Estimated remaining: 4h 49m 21s. Rate: 7.7 symbols/min [2025-10-16T17:19:45.758006] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:19:45.804149] [DEBUG] [LOCAL ] ASB: Loaded 49632 existing records from primary storage. [2025-10-16T17:19:45.804445] [INFO ] [MAIN ] ASB: Loaded 49632 existing records. [2025-10-16T17:19:45.980178] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:19:45.980374] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-16T17:19:45.980422] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-16T17:19:45.980700] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-16T17:19:45.980758] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-16T17:19:46.341358] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:19:46.342766] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-16T17:19:47.142851] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-16T17:19:47.452270] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-16T17:19:47.786278] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T17:19:47.896636] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-16T17:19:47.942785] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-16T17:19:48.742826] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-16T17:19:49.000625] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T17:19:49.542843] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-16T17:19:50.342807] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-16T17:19:50.383502] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T17:19:51.113489] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T17:19:51.142801] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-16T17:19:51.942814] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-16T17:19:52.290399] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T17:19:52.335764] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T17:19:52.742902] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-16T17:19:53.187497] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-16T17:19:53.542881] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-16T17:19:54.300888] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T17:19:54.342781] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-16T17:19:55.148000] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-16T17:19:55.171637] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T17:19:55.671564] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T17:19:55.942791] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-16T17:19:56.122172] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T17:19:56.742851] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-16T17:19:57.542837] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-16T17:19:57.717489] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T17:19:58.342850] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-16T17:19:58.377431] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T17:19:58.607213] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-16T17:19:59.142884] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-16T17:19:59.942781] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-16T17:20:00.074367] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T17:20:00.730668] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T17:20:00.742770] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-16T17:20:01.542870] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-16T17:20:01.587707] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-16T17:20:01.592989] [INFO ] [REMOTE ] ASA: Full fetch complete (20237 records). [2025-10-16T17:20:01.593165] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-16T17:20:01.997883] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-16T17:20:01.998029] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-16T17:20:01.998517] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-16T17:20:01.998591] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-16T17:20:01.999785] [DEBUG] [LOCAL ] ASA: Trimmed 20237 records to 15405 (keeping 200 days of data) [2025-10-16T17:20:02.115122] [DEBUG] [LOCAL ] ASA: Primary data saved (15405 records). [2025-10-16T17:20:02.115308] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-16T17:20:02.115424] [INFO ] [MAIN ] Update Progress: 152/2369 symbols completed. ASA took 29.3s. Estimated remaining: 4h 51m 20s. Rate: 7.6 symbols/min [2025-10-16T17:20:02.311271] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:02.355174] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-16T17:20:02.358040] [DEBUG] [LOCAL ] ASBA: Loaded 3459 existing records from primary storage. [2025-10-16T17:20:02.362934] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T17:20:02.363365] [INFO ] [MAIN ] ASBA: Loaded 3459 existing records. [2025-10-16T17:20:02.567715] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:20:02.568004] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-16T17:20:02.568054] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-16T17:20:02.568180] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-16T17:20:02.568220] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-16T17:20:02.928616] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:20:03.039805] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T17:20:03.142862] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-16T17:20:03.682830] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-16T17:20:03.942829] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-16T17:20:04.205290] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-16T17:20:04.742837] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-16T17:20:05.542873] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-16T17:20:05.988377] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-16T17:20:06.342794] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-16T17:20:06.582438] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T17:20:06.760590] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T17:20:07.142835] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-16T17:20:07.942788] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-16T17:20:08.166469] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T17:20:08.173768] [INFO ] [REMOTE ] ASAN: Full fetch complete (76647 records). [2025-10-16T17:20:08.173950] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-16T17:20:08.588613] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-16T17:20:08.588843] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-16T17:20:08.589774] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-16T17:20:08.589856] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-16T17:20:08.591406] [DEBUG] [LOCAL ] ASAN: Trimmed 76647 records to 53123 (keeping 200 days of data) [2025-10-16T17:20:08.718142] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-16T17:20:08.742994] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-16T17:20:08.951760] [DEBUG] [LOCAL ] ASAN: Primary data saved (53123 records). [2025-10-16T17:20:08.951920] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-16T17:20:08.952003] [INFO ] [MAIN ] Update Progress: 153/2369 symbols completed. ASAN took 31.2s. Estimated remaining: 4h 50m 57s. Rate: 7.6 symbols/min [2025-10-16T17:20:09.137488] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:09.172679] [DEBUG] [LOCAL ] ASC: Loaded 37348 existing records from primary storage. [2025-10-16T17:20:09.172989] [INFO ] [MAIN ] ASC: Loaded 37348 existing records. [2025-10-16T17:20:09.392570] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:20:09.393342] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-16T17:20:09.393454] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-16T17:20:09.394018] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-16T17:20:09.394078] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-16T17:20:09.552829] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-16T17:20:09.728135] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T17:20:09.869905] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:20:10.131078] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:20:10.222858] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T17:20:10.342961] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-16T17:20:11.142914] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-16T17:20:11.693918] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T17:20:11.797407] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T17:20:11.942884] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-16T17:20:12.474909] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-16T17:20:12.742892] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-16T17:20:13.317186] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T17:20:13.542896] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-16T17:20:14.236254] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T17:20:14.342865] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-16T17:20:14.683105] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-16T17:20:15.142883] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-16T17:20:15.942866] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-16T17:20:16.742852] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-16T17:20:17.542796] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-16T17:20:17.884338] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-16T17:20:17.894017] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-16T17:20:17.896383] [INFO ] [REMOTE ] AS: Full fetch complete (76875 records). [2025-10-16T17:20:17.896478] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-16T17:20:18.287437] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-16T17:20:18.287561] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-16T17:20:18.288517] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-16T17:20:18.288585] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-16T17:20:18.290380] [DEBUG] [LOCAL ] AS: Trimmed 76875 records to 53564 (keeping 200 days of data) [2025-10-16T17:20:18.343619] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-16T17:20:18.630099] [DEBUG] [LOCAL ] AS: Primary data saved (53564 records). [2025-10-16T17:20:18.630377] [INFO ] [MAIN ] AS: Full history saved. [2025-10-16T17:20:18.631091] [INFO ] [MAIN ] Update Progress: 154/2369 symbols completed. AS took 50.5s. Estimated remaining: 4h 51m 15s. Rate: 7.6 symbols/min [2025-10-16T17:20:18.813853] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:18.835847] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-16T17:20:18.846419] [DEBUG] [LOCAL ] ASG: Loaded 19561 existing records from primary storage. [2025-10-16T17:20:18.847268] [INFO ] [MAIN ] ASG: Loaded 19561 existing records. [2025-10-16T17:20:18.986168] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (3.84 seconds). [2025-10-16T17:20:19.107045] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:20:19.107350] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-16T17:20:19.107422] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-16T17:20:19.107847] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-16T17:20:19.107974] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-16T17:20:19.148053] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-16T17:20:19.261392] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-16T17:20:19.521469] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:20:19.630925] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-16T17:20:19.942882] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-16T17:20:20.510835] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T17:20:20.511895] [INFO ] [REMOTE ] ASBA: Full fetch complete (5218 records). [2025-10-16T17:20:20.511973] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-16T17:20:20.748813] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-16T17:20:20.878410] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-16T17:20:20.878478] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-16T17:20:20.878630] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-16T17:20:20.878707] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-16T17:20:20.879155] [DEBUG] [LOCAL ] ASBA: Trimmed 5218 records to 3483 (keeping 200 days of data) [2025-10-16T17:20:20.899743] [DEBUG] [LOCAL ] ASBA: Primary data saved (3483 records). [2025-10-16T17:20:20.899830] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-16T17:20:20.899905] [INFO ] [MAIN ] Update Progress: 155/2369 symbols completed. ASBA took 18.8s. Estimated remaining: 4h 49m 47s. Rate: 7.6 symbols/min [2025-10-16T17:20:21.076682] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:21.100629] [DEBUG] [LOCAL ] ASGI: Loaded 22951 existing records from primary storage. [2025-10-16T17:20:21.100918] [INFO ] [MAIN ] ASGI: Loaded 22951 existing records. [2025-10-16T17:20:21.278460] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:20:21.278776] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-16T17:20:21.278829] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-16T17:20:21.279015] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-16T17:20:21.279070] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-16T17:20:21.551270] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-16T17:20:21.633172] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:20:22.300454] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T17:20:22.342816] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-16T17:20:23.142842] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-16T17:20:23.482959] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-16T17:20:23.504734] [INFO ] [REMOTE ] ASB: Full fetch complete (72117 records). [2025-10-16T17:20:23.505530] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-16T17:20:23.506069] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T17:20:23.905437] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-16T17:20:23.905513] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-16T17:20:23.906257] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-16T17:20:23.906319] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-16T17:20:23.907633] [DEBUG] [LOCAL ] ASB: Trimmed 72117 records to 50019 (keeping 200 days of data) [2025-10-16T17:20:23.959808] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-16T17:20:24.155316] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-16T17:20:24.232508] [DEBUG] [LOCAL ] ASB: Primary data saved (50019 records). [2025-10-16T17:20:24.232809] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-16T17:20:24.233443] [INFO ] [MAIN ] Update Progress: 156/2369 symbols completed. ASB took 38.6s. Estimated remaining: 4h 48m 35s. Rate: 7.7 symbols/min [2025-10-16T17:20:24.399760] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:24.435250] [DEBUG] [LOCAL ] ASGN: Loaded 36578 existing records from primary storage. [2025-10-16T17:20:24.435547] [INFO ] [MAIN ] ASGN: Loaded 36578 existing records. [2025-10-16T17:20:24.608978] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:20:24.609200] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-16T17:20:24.609246] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-16T17:20:24.609516] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-16T17:20:24.609572] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-16T17:20:24.748111] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-16T17:20:24.965392] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:20:25.536593] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T17:20:25.545598] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-16T17:20:26.025189] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T17:20:26.342859] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-16T17:20:26.811395] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T17:20:26.986741] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T17:20:27.142832] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-16T17:20:27.942880] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-16T17:20:28.150977] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T17:20:28.742848] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-16T17:20:29.542819] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-16T17:20:29.675528] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T17:20:29.725016] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T17:20:30.342812] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-16T17:20:30.887834] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T17:20:31.142809] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-16T17:20:31.596571] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-16T17:20:31.850495] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-16T17:20:31.942805] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-16T17:20:32.742806] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-16T17:20:33.460227] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T17:20:33.542835] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-16T17:20:34.201313] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T17:20:34.342794] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-16T17:20:34.599609] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T17:20:35.142784] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-16T17:20:35.214513] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-16T17:20:35.942863] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-16T17:20:36.554935] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T17:20:36.742821] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-16T17:20:37.030167] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T17:20:37.542790] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-16T17:20:37.562922] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T17:20:38.342807] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-16T17:20:38.928052] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T17:20:38.989797] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-16T17:20:39.142819] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-16T17:20:39.942787] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-16T17:20:40.264269] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T17:20:40.742812] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-16T17:20:41.542803] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-16T17:20:41.578351] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T17:20:41.857910] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-16T17:20:42.342794] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-16T17:20:42.558303] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T17:20:43.142818] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-16T17:20:43.757446] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T17:20:43.942850] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-16T17:20:44.468317] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T17:20:44.540681] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T17:20:44.742826] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-16T17:20:45.542828] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-16T17:20:45.720264] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T17:20:46.342786] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-16T17:20:46.843345] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T17:20:47.096964] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T17:20:47.142833] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-16T17:20:47.942817] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-16T17:20:48.696301] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T17:20:48.742775] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-16T17:20:49.359119] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T17:20:49.364206] [INFO ] [REMOTE ] ASC: Full fetch complete (56216 records). [2025-10-16T17:20:49.364347] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-16T17:20:49.552974] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-16T17:20:49.755148] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-16T17:20:49.755306] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-16T17:20:49.756125] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-16T17:20:49.756229] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-16T17:20:49.775620] [DEBUG] [LOCAL ] ASC: Trimmed 56216 records to 37642 (keeping 200 days of data) [2025-10-16T17:20:49.776603] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T17:20:50.008278] [DEBUG] [LOCAL ] ASC: Primary data saved (37642 records). [2025-10-16T17:20:50.008425] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-16T17:20:50.008505] [INFO ] [MAIN ] Update Progress: 157/2369 symbols completed. ASC took 41.1s. Estimated remaining: 4h 52m 40s. Rate: 7.6 symbols/min [2025-10-16T17:20:50.342834] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-16T17:20:50.698840] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-16T17:20:50.701749] [INFO ] [REMOTE ] ASG: Full fetch complete (31008 records). [2025-10-16T17:20:50.701878] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-16T17:20:51.066464] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-16T17:20:51.066535] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-16T17:20:51.066953] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-16T17:20:51.067014] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-16T17:20:51.067723] [DEBUG] [LOCAL ] ASG: Trimmed 31008 records to 19723 (keeping 200 days of data) [2025-10-16T17:20:51.145002] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-16T17:20:51.178592] [DEBUG] [LOCAL ] ASG: Primary data saved (19723 records). [2025-10-16T17:20:51.178746] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-16T17:20:51.178834] [INFO ] [MAIN ] Update Progress: 158/2369 symbols completed. ASG took 32.5s. Estimated remaining: 4h 50m 57s. Rate: 7.6 symbols/min [2025-10-16T17:20:51.568222] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T17:20:51.942827] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-16T17:20:52.451822] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T17:20:52.742806] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-16T17:20:53.097995] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T17:20:53.542875] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-16T17:20:53.957373] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T17:20:53.960989] [INFO ] [REMOTE ] ASGI: Full fetch complete (33339 records). [2025-10-16T17:20:53.961099] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-16T17:20:54.344476] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-16T17:20:54.344560] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-16T17:20:54.345006] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-16T17:20:54.345069] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-16T17:20:54.345989] [DEBUG] [LOCAL ] ASGI: Trimmed 33339 records to 23140 (keeping 200 days of data) [2025-10-16T17:20:54.485848] [DEBUG] [LOCAL ] ASGI: Primary data saved (23140 records). [2025-10-16T17:20:54.485977] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-16T17:20:54.486059] [INFO ] [MAIN ] Update Progress: 159/2369 symbols completed. ASGI took 33.6s. Estimated remaining: 4h 49m 45s. Rate: 7.6 symbols/min [2025-10-16T17:20:55.014152] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T17:20:55.022614] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-16T17:20:56.399890] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T17:20:56.408604] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-16T17:20:57.944712] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-16T17:20:57.950845] [INFO ] [REMOTE ] ASGN: Full fetch complete (53291 records). [2025-10-16T17:20:57.950979] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-16T17:20:58.334007] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-16T17:20:58.334090] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-16T17:20:58.334702] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-16T17:20:58.334766] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-16T17:20:58.336143] [DEBUG] [LOCAL ] ASGN: Trimmed 53291 records to 36906 (keeping 200 days of data) [2025-10-16T17:20:58.551496] [DEBUG] [LOCAL ] ASGN: Primary data saved (36906 records). [2025-10-16T17:20:58.551667] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-16T17:20:58.552270] [INFO ] [MAIN ] Update Progress: 160/2369 symbols completed. ASGN took 34.3s. Estimated remaining: 4h 48m 45s. Rate: 7.7 symbols/min [2025-10-16T17:20:59.237988] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:59.233264] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:59.277573] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:59.306281] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:59.317503] [DEBUG] [LOCAL ] ASR: Loaded 9379 existing records from primary storage. [2025-10-16T17:20:59.317808] [INFO ] [MAIN ] ASR: Loaded 9379 existing records. [2025-10-16T17:20:59.538699] [DEBUG] [LOCAL ] ASIX: Loaded 23077 existing records from primary storage. [2025-10-16T17:20:59.599444] [INFO ] [MAIN ] ASIX: Loaded 23077 existing records. [2025-10-16T17:20:59.600132] [DEBUG] [LOCAL ] ASH: Loaded 37552 existing records from primary storage. [2025-10-16T17:20:59.631271] [INFO ] [MAIN ] ASH: Loaded 37552 existing records. [2025-10-16T17:20:59.605576] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:20:59.666802] [DEBUG] [LOCAL ] ASPN: Loaded 49893 existing records from primary storage. [2025-10-16T17:20:59.666058] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-16T17:20:59.678722] [INFO ] [MAIN ] ASPN: Loaded 49893 existing records. [2025-10-16T17:20:59.702769] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-16T17:20:59.739461] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-16T17:20:59.830903] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-16T17:21:00.249550] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:21:00.252477] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:21:00.307183] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-16T17:21:00.327852] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-16T17:21:00.328180] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-16T17:21:00.353167] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-16T17:21:00.359120] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-16T17:21:00.347870] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-16T17:21:00.403262] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:21:00.424119] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-16T17:21:00.430884] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-16T17:21:00.466107] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-16T17:21:00.481718] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-16T17:21:00.482039] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-16T17:21:00.495480] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-16T17:21:01.373384] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:01.415935] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-16T17:21:01.785888] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:01.844190] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-16T17:21:01.941072] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:01.956098] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-16T17:21:02.002271] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:02.002747] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-16T17:21:02.626591] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-16T17:21:02.636147] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-16T17:21:02.762737] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T17:21:02.768600] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-16T17:21:03.170529] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-16T17:21:03.173864] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-16T17:21:03.386687] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T17:21:03.397629] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-16T17:21:03.490949] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-16T17:21:03.495458] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-16T17:21:03.498086] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T17:21:03.508585] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-16T17:21:03.619484] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T17:21:03.942838] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-16T17:21:04.135458] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T17:21:04.527424] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T17:21:04.742884] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-16T17:21:04.803784] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T17:21:05.098047] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T17:21:05.542841] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-16T17:21:05.734738] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-16T17:21:06.342861] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-16T17:21:06.354607] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-16T17:21:07.142818] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-16T17:21:07.408821] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T17:21:07.942837] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-16T17:21:07.956267] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T17:21:08.742835] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-16T17:21:09.057943] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T17:21:09.526075] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T17:21:09.542765] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-16T17:21:10.342803] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-16T17:21:10.351450] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-16T17:21:11.142797] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-16T17:21:11.262311] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-16T17:21:11.589444] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T17:21:11.942786] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-16T17:21:12.742871] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-16T17:21:13.445156] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T17:21:13.542781] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-16T17:21:14.342844] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-16T17:21:14.411024] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T17:21:14.495047] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T17:21:15.142841] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-16T17:21:15.427855] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T17:21:15.942871] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-16T17:21:16.737254] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T17:21:16.737932] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T17:21:16.748747] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-16T17:21:16.750577] [INFO ] [REMOTE ] ASR: Full fetch complete (12389 records). [2025-10-16T17:21:16.751500] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-16T17:21:17.102531] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-16T17:21:17.102601] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-16T17:21:17.102830] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-16T17:21:17.102890] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-16T17:21:17.103318] [DEBUG] [LOCAL ] ASR: Trimmed 12389 records to 9418 (keeping 200 days of data) [2025-10-16T17:21:17.160380] [DEBUG] [LOCAL ] ASR: Primary data saved (9418 records). [2025-10-16T17:21:17.160492] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-16T17:21:17.160565] [INFO ] [MAIN ] Update Progress: 161/2369 symbols completed. ASR took 18.6s. Estimated remaining: 4h 51m 5s. Rate: 7.6 symbols/min [2025-10-16T17:21:17.325723] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:21:17.375725] [DEBUG] [LOCAL ] ASX: Loaded 52874 existing records from primary storage. [2025-10-16T17:21:17.376029] [INFO ] [MAIN ] ASX: Loaded 52874 existing records. [2025-10-16T17:21:17.551408] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-16T17:21:17.556004] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:21:17.556954] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-16T17:21:17.557008] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-16T17:21:17.557185] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-16T17:21:17.557222] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-16T17:21:17.904504] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:17.922723] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T17:21:18.342817] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-16T17:21:19.051500] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T17:21:19.142791] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-16T17:21:19.942790] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-16T17:21:20.404002] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-16T17:21:20.633298] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T17:21:20.742798] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-16T17:21:20.966720] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-16T17:21:21.542812] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-16T17:21:22.348002] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-16T17:21:22.353638] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T17:21:23.142793] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-16T17:21:23.301796] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-16T17:21:23.361356] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T17:21:23.942830] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-16T17:21:24.370815] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T17:21:24.742835] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-16T17:21:25.542866] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-16T17:21:25.625480] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T17:21:25.969057] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T17:21:26.342872] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-16T17:21:27.142793] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-16T17:21:27.326109] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T17:21:27.549845] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T17:21:27.553463] [INFO ] [REMOTE ] ASIX: Full fetch complete (30964 records). [2025-10-16T17:21:27.553557] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-16T17:21:27.914111] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-16T17:21:27.914199] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-16T17:21:27.914600] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-16T17:21:27.914639] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-16T17:21:27.915424] [DEBUG] [LOCAL ] ASIX: Trimmed 30964 records to 23274 (keeping 200 days of data) [2025-10-16T17:21:27.965702] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-16T17:21:28.055510] [DEBUG] [LOCAL ] ASIX: Primary data saved (23274 records). [2025-10-16T17:21:28.055634] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-16T17:21:28.055747] [INFO ] [MAIN ] Update Progress: 162/2369 symbols completed. ASIX took 29.5s. Estimated remaining: 4h 51m 38s. Rate: 7.6 symbols/min [2025-10-16T17:21:28.232366] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:21:28.268998] [DEBUG] [LOCAL ] ATEN: Loaded 38334 existing records from primary storage. [2025-10-16T17:21:28.269300] [INFO ] [MAIN ] ATEN: Loaded 38334 existing records. [2025-10-16T17:21:28.451136] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:21:28.451372] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-16T17:21:28.451419] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-16T17:21:28.451608] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-16T17:21:28.451706] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-16T17:21:28.743915] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-16T17:21:28.824953] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:28.953726] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T17:21:29.472792] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T17:21:29.542784] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-16T17:21:29.837954] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T17:21:30.342809] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-16T17:21:30.990585] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-16T17:21:31.142807] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-16T17:21:31.942795] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-16T17:21:32.273822] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-16T17:21:32.633392] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T17:21:32.742784] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-16T17:21:33.531127] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T17:21:33.542757] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-16T17:21:34.226155] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T17:21:34.342810] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-16T17:21:34.448768] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T17:21:35.142865] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-16T17:21:35.942869] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-16T17:21:36.113979] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-16T17:21:36.616891] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T17:21:36.742824] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-16T17:21:37.496053] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T17:21:37.542786] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-16T17:21:38.342864] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-16T17:21:38.403859] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T17:21:39.002215] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T17:21:39.142801] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-16T17:21:39.942875] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-16T17:21:40.224109] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T17:21:40.231402] [INFO ] [REMOTE ] ASPN: Full fetch complete (72651 records). [2025-10-16T17:21:40.231555] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-16T17:21:40.521555] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T17:21:40.653969] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-16T17:21:40.654045] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-16T17:21:40.654837] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-16T17:21:40.654899] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-16T17:21:40.656264] [DEBUG] [LOCAL ] ASPN: Trimmed 72651 records to 50279 (keeping 200 days of data) [2025-10-16T17:21:40.744925] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-16T17:21:40.938979] [DEBUG] [LOCAL ] ASPN: Primary data saved (50279 records). [2025-10-16T17:21:40.939116] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-16T17:21:40.939194] [INFO ] [MAIN ] Update Progress: 163/2369 symbols completed. ASPN took 42.4s. Estimated remaining: 4h 52m 37s. Rate: 7.5 symbols/min [2025-10-16T17:21:41.108761] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:21:41.140071] [DEBUG] [LOCAL ] ATGE: Loaded 31064 existing records from primary storage. [2025-10-16T17:21:41.140331] [INFO ] [MAIN ] ATGE: Loaded 31064 existing records. [2025-10-16T17:21:41.319017] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:21:41.319322] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-16T17:21:41.319385] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-16T17:21:41.327856] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-16T17:21:41.343054] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T17:21:41.342244] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-16T17:21:41.547899] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-16T17:21:41.706769] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:42.006408] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T17:21:42.342801] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-16T17:21:43.139306] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T17:21:43.149196] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-16T17:21:43.246911] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T17:21:43.942821] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-16T17:21:44.672175] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T17:21:44.677534] [INFO ] [REMOTE ] ASH: Full fetch complete (55583 records). [2025-10-16T17:21:44.677718] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-16T17:21:44.748050] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-16T17:21:45.070280] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-16T17:21:45.070394] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-16T17:21:45.071048] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-16T17:21:45.071112] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-16T17:21:45.072370] [DEBUG] [LOCAL ] ASH: Trimmed 55583 records to 37839 (keeping 200 days of data) [2025-10-16T17:21:45.301257] [DEBUG] [LOCAL ] ASH: Primary data saved (37839 records). [2025-10-16T17:21:45.301388] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-16T17:21:45.301467] [INFO ] [MAIN ] Update Progress: 164/2369 symbols completed. ASH took 46.7s. Estimated remaining: 4h 51m 40s. Rate: 7.6 symbols/min [2025-10-16T17:21:45.472914] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:21:45.502054] [DEBUG] [LOCAL ] ATHM: Loaded 31512 existing records from primary storage. [2025-10-16T17:21:45.502335] [INFO ] [MAIN ] ATHM: Loaded 31512 existing records. [2025-10-16T17:21:45.556203] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-16T17:21:45.685551] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:21:45.685870] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-16T17:21:45.685953] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-16T17:21:45.686382] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-16T17:21:45.686464] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-16T17:21:45.819391] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-16T17:21:46.102377] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:46.120542] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T17:21:46.342816] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-16T17:21:47.142857] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-16T17:21:47.573371] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-16T17:21:47.942912] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-16T17:21:48.152022] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-16T17:21:48.159020] [INFO ] [REMOTE ] ASX: Full fetch complete (76779 records). [2025-10-16T17:21:48.159197] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-16T17:21:48.569344] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-16T17:21:48.569447] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-16T17:21:48.570240] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-16T17:21:48.570303] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-16T17:21:48.571742] [DEBUG] [LOCAL ] ASX: Trimmed 76779 records to 53264 (keeping 200 days of data) [2025-10-16T17:21:48.746891] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-16T17:21:48.886376] [DEBUG] [LOCAL ] ASX: Primary data saved (53264 records). [2025-10-16T17:21:48.886503] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-16T17:21:48.886580] [INFO ] [MAIN ] Update Progress: 165/2369 symbols completed. ASX took 31.7s. Estimated remaining: 4h 50m 34s. Rate: 7.6 symbols/min [2025-10-16T17:21:49.072155] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:21:49.089852] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T17:21:49.119016] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T17:21:49.132790] [DEBUG] [LOCAL ] ATHS: Loaded 6640 existing records from primary storage. [2025-10-16T17:21:49.133027] [INFO ] [MAIN ] ATHS: Loaded 6640 existing records. [2025-10-16T17:21:49.314173] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:21:49.314414] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-16T17:21:49.314473] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-16T17:21:49.314637] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-16T17:21:49.314732] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-16T17:21:49.555752] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-16T17:21:49.701534] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:50.229840] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T17:21:50.342785] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-16T17:21:50.730781] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T17:21:51.142877] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-16T17:21:51.942854] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-16T17:21:52.014139] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T17:21:52.666674] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-16T17:21:52.694188] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T17:21:52.742827] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-16T17:21:53.542848] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-16T17:21:54.141309] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T17:21:54.342833] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-16T17:21:55.093225] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T17:21:55.142896] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-16T17:21:55.829933] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T17:21:55.942879] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-16T17:21:56.074113] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T17:21:56.078778] [INFO ] [REMOTE ] ATEN: Full fetch complete (56912 records). [2025-10-16T17:21:56.078997] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-16T17:21:56.461239] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-16T17:21:56.461315] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-16T17:21:56.461962] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-16T17:21:56.462025] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-16T17:21:56.463100] [DEBUG] [LOCAL ] ATEN: Trimmed 56912 records to 38592 (keeping 200 days of data) [2025-10-16T17:21:56.570381] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-16T17:21:56.700059] [DEBUG] [LOCAL ] ATEN: Primary data saved (38592 records). [2025-10-16T17:21:56.700187] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-16T17:21:56.700583] [INFO ] [MAIN ] Update Progress: 166/2369 symbols completed. ATEN took 28.6s. Estimated remaining: 4h 50m 25s. Rate: 7.6 symbols/min [2025-10-16T17:21:56.752259] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-16T17:21:56.872524] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:21:56.872709] [DEBUG] [LOCAL ] ATI: No existing data file found in primary storage. [2025-10-16T17:21:56.872762] [WARN ] [MAIN ] ATI: No existing data found, performing full refresh instead. [2025-10-16T17:21:56.872868] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-16T17:21:56.872909] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-16T17:21:56.872949] [DEBUG] [LOCAL ] ATI: No primary data file found to delete. [2025-10-16T17:21:56.872981] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-16T17:21:57.213353] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:57.542878] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-16T17:21:58.155485] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T17:21:58.342858] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-16T17:21:59.142797] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-16T17:21:59.303599] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T17:21:59.871505] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T17:21:59.942800] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-16T17:22:00.742803] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-16T17:22:01.122763] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-16T17:22:01.286790] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T17:22:01.542878] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-16T17:22:02.037484] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T17:22:02.036277] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-16T17:22:02.342824] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-16T17:22:02.970184] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T17:22:03.142819] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-16T17:22:03.942868] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-16T17:22:04.585430] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T17:22:04.742803] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-16T17:22:05.315997] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T17:22:05.542871] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-16T17:22:06.022984] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-16T17:22:06.201451] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T17:22:06.342793] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-16T17:22:07.142892] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-16T17:22:07.791908] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T17:22:07.942796] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-16T17:22:08.742815] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-16T17:22:08.892003] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T17:22:08.890355] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-16T17:22:09.542836] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-16T17:22:09.609034] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T17:22:09.959804] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-16T17:22:10.342823] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-16T17:22:11.142831] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-16T17:22:11.952302] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-16T17:22:11.979166] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T17:22:12.007964] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-16T17:22:12.742834] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-16T17:22:13.347142] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:22:13.542904] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-16T17:22:14.342790] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-16T17:22:14.476708] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T17:22:14.810713] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-16T17:22:15.142849] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-16T17:22:15.486267] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-16T17:22:15.942893] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-16T17:22:16.742916] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-16T17:22:16.901942] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T17:22:17.285012] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T17:22:17.294749] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T17:22:17.294421] [INFO ] [REMOTE ] ATGE: Full fetch complete (46044 records). [2025-10-16T17:22:17.297347] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-16T17:22:17.551433] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-16T17:22:17.682940] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-16T17:22:17.683028] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-16T17:22:17.683553] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-16T17:22:17.683596] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-16T17:22:17.684700] [DEBUG] [LOCAL ] ATGE: Trimmed 46044 records to 31229 (keeping 200 days of data) [2025-10-16T17:22:17.893509] [DEBUG] [LOCAL ] ATGE: Primary data saved (31229 records). [2025-10-16T17:22:17.893692] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-16T17:22:17.893788] [INFO ] [MAIN ] Update Progress: 167/2369 symbols completed. ATGE took 37.0s. Estimated remaining: 4h 53m 12s. Rate: 7.5 symbols/min [2025-10-16T17:22:18.066508] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:22:18.072514] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-16T17:22:18.106145] [DEBUG] [LOCAL ] ATKR: Loaded 35206 existing records from primary storage. [2025-10-16T17:22:18.106411] [INFO ] [MAIN ] ATKR: Loaded 35206 existing records. [2025-10-16T17:22:18.284532] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:22:18.284841] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-16T17:22:18.284893] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-16T17:22:18.285133] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-16T17:22:18.285199] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-16T17:22:18.347950] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-16T17:22:18.647350] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:22:19.142845] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-16T17:22:19.464216] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T17:22:19.942801] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-16T17:22:20.519527] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T17:22:20.734089] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T17:22:20.742768] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-16T17:22:21.542849] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-16T17:22:21.844811] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T17:22:22.342883] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-16T17:22:23.142879] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-16T17:22:23.368171] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T17:22:23.942792] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-16T17:22:23.991279] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T17:22:24.200179] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T17:22:24.204476] [INFO ] [REMOTE ] ATHM: Full fetch complete (50010 records). [2025-10-16T17:22:24.204600] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-16T17:22:24.602189] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-16T17:22:24.602310] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-16T17:22:24.603014] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-16T17:22:24.603086] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-16T17:22:24.604782] [DEBUG] [LOCAL ] ATHM: Trimmed 50010 records to 31712 (keeping 200 days of data) [2025-10-16T17:22:24.760477] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-16T17:22:24.812547] [DEBUG] [LOCAL ] ATHM: Primary data saved (31712 records). [2025-10-16T17:22:24.812798] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-16T17:22:24.812912] [INFO ] [MAIN ] Update Progress: 168/2369 symbols completed. ATHM took 39.5s. Estimated remaining: 4h 52m 50s. Rate: 7.5 symbols/min [2025-10-16T17:22:24.991012] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:22:24.991187] [DEBUG] [LOCAL ] ATMU: No existing data file found in primary storage. [2025-10-16T17:22:24.991227] [WARN ] [MAIN ] ATMU: No existing data found, performing full refresh instead. [2025-10-16T17:22:24.991339] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-16T17:22:24.991381] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-16T17:22:24.991423] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-10-16T17:22:24.991457] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-16T17:22:25.360876] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:22:25.410441] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T17:22:25.463249] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T17:22:25.464913] [INFO ] [REMOTE ] ATHS: Full fetch complete (9621 records). [2025-10-16T17:22:25.465007] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-16T17:22:25.547969] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-16T17:22:25.840110] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-16T17:22:25.840193] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-16T17:22:25.840439] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-16T17:22:25.840478] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-16T17:22:25.840957] [DEBUG] [LOCAL ] ATHS: Trimmed 9621 records to 6668 (keeping 200 days of data) [2025-10-16T17:22:25.881603] [DEBUG] [LOCAL ] ATHS: Primary data saved (6668 records). [2025-10-16T17:22:25.881779] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-16T17:22:25.881865] [INFO ] [MAIN ] Update Progress: 169/2369 symbols completed. ATHS took 37.0s. Estimated remaining: 4h 51m 12s. Rate: 7.6 symbols/min [2025-10-16T17:22:26.050554] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:22:26.091332] [DEBUG] [LOCAL ] ATO: Loaded 41759 existing records from primary storage. [2025-10-16T17:22:26.091610] [INFO ] [MAIN ] ATO: Loaded 41759 existing records. [2025-10-16T17:22:26.264024] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:22:26.264234] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-16T17:22:26.264280] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-16T17:22:26.264489] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-16T17:22:26.264527] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-16T17:22:26.351585] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-16T17:22:26.613298] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:22:27.087899] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T17:22:27.142771] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-16T17:22:27.949669] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-16T17:22:27.967562] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T17:22:28.192459] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T17:22:28.742869] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-16T17:22:29.542876] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-16T17:22:29.599355] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T17:22:29.932875] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T17:22:30.342804] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-16T17:22:30.952821] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T17:22:31.142872] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-16T17:22:31.799763] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T17:22:31.942822] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-16T17:22:32.639359] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T17:22:32.742815] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-16T17:22:32.893121] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T17:22:33.542793] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-16T17:22:33.904309] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-16T17:22:34.342884] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-16T17:22:34.950669] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T17:22:35.142809] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-16T17:22:35.778520] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T17:22:35.785035] [INFO ] [REMOTE ] ATI: Full fetch complete (74011 records). [2025-10-16T17:22:35.785161] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-16T17:22:35.971302] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-16T17:22:36.195751] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-16T17:22:36.195890] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-16T17:22:36.196749] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-16T17:22:36.196827] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-16T17:22:36.198475] [DEBUG] [LOCAL ] ATI: Trimmed 74011 records to 51723 (keeping 200 days of data) [2025-10-16T17:22:36.418960] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T17:22:36.525548] [DEBUG] [LOCAL ] ATI: Primary data saved (51723 records). [2025-10-16T17:22:36.525708] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-16T17:22:36.525792] [INFO ] [MAIN ] Update Progress: 170/2369 symbols completed. ATI took 39.8s. Estimated remaining: 4h 51m 39s. Rate: 7.5 symbols/min [2025-10-16T17:22:36.711299] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:22:36.741804] [DEBUG] [LOCAL ] ATR: Loaded 30562 existing records from primary storage. [2025-10-16T17:22:36.742053] [INFO ] [MAIN ] ATR: Loaded 30562 existing records. [2025-10-16T17:22:36.753332] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-16T17:22:36.936138] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:22:36.936338] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-16T17:22:36.936387] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-16T17:22:36.936560] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-16T17:22:36.936599] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-16T17:22:37.304233] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:22:37.486302] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T17:22:37.542801] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-16T17:22:38.347990] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-16T17:22:38.367600] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T17:22:38.800849] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T17:22:39.143047] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-16T17:22:39.742932] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T17:22:39.942842] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-16T17:22:40.136173] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T17:22:40.742849] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-16T17:22:41.312313] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-16T17:22:41.542808] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-16T17:22:42.118033] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T17:22:42.342807] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-16T17:22:42.821164] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T17:22:42.825717] [INFO ] [REMOTE ] ATKR: Full fetch complete (53529 records). [2025-10-16T17:22:42.825812] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-16T17:22:43.156684] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-16T17:22:43.210439] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-16T17:22:43.210515] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-16T17:22:43.211122] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-16T17:22:43.211201] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-16T17:22:43.212301] [DEBUG] [LOCAL ] ATKR: Trimmed 53529 records to 35500 (keeping 200 days of data) [2025-10-16T17:22:43.431817] [DEBUG] [LOCAL ] ATKR: Primary data saved (35500 records). [2025-10-16T17:22:43.431975] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-16T17:22:43.432066] [INFO ] [MAIN ] Update Progress: 171/2369 symbols completed. ATKR took 25.5s. Estimated remaining: 4h 51m 18s. Rate: 7.5 symbols/min [2025-10-16T17:22:43.602698] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:22:43.602874] [DEBUG] [LOCAL ] ATS: No existing data file found in primary storage. [2025-10-16T17:22:43.602912] [WARN ] [MAIN ] ATS: No existing data found, performing full refresh instead. [2025-10-16T17:22:43.603025] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-16T17:22:43.603085] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-16T17:22:43.603155] [DEBUG] [LOCAL ] ATS: No primary data file found to delete. [2025-10-16T17:22:43.603199] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-16T17:22:43.946581] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-16T17:22:43.968503] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:22:43.991359] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T17:22:44.225355] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T17:22:44.742818] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-16T17:22:45.290301] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T17:22:45.542910] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-16T17:22:46.343152] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-16T17:22:46.345984] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-16T17:22:46.915551] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T17:22:47.063617] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-16T17:22:47.142844] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-16T17:22:47.942897] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-16T17:22:48.128067] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T17:22:48.742918] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-16T17:22:49.284882] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T17:22:49.542794] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-16T17:22:49.661462] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T17:22:50.342857] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-16T17:22:51.117905] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T17:22:51.142821] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-16T17:22:51.541381] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-16T17:22:51.942844] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-16T17:22:52.747993] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-16T17:22:52.754605] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T17:22:52.759741] [INFO ] [REMOTE ] ATMU: Full fetch complete (56818 records). [2025-10-16T17:22:52.759836] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-16T17:22:53.166745] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-16T17:22:53.166842] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-16T17:22:53.167472] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-16T17:22:53.167539] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-16T17:22:53.168869] [DEBUG] [LOCAL ] ATMU: Trimmed 56818 records to 39185 (keeping 200 days of data) [2025-10-16T17:22:53.402996] [DEBUG] [LOCAL ] ATMU: Primary data saved (39185 records). [2025-10-16T17:22:53.403132] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-16T17:22:53.403203] [INFO ] [MAIN ] Update Progress: 172/2369 symbols completed. ATMU took 28.6s. Estimated remaining: 4h 51m 36s. Rate: 7.5 symbols/min [2025-10-16T17:22:53.547982] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-16T17:22:53.575262] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:22:53.617365] [DEBUG] [LOCAL ] ATUS: Loaded 49869 existing records from primary storage. [2025-10-16T17:22:53.617662] [INFO ] [MAIN ] ATUS: Loaded 49869 existing records. [2025-10-16T17:22:53.792979] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:22:53.793199] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-16T17:22:53.793246] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-16T17:22:53.793436] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-16T17:22:53.793491] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-16T17:22:54.174163] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:22:54.342801] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-16T17:23:06.187153] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (12.64 seconds). [2025-10-16T17:23:06.191858] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-16T17:23:06.987404] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (12.64 seconds). [2025-10-16T17:23:06.997085] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-16T17:23:07.111505] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (14.36 seconds). [2025-10-16T17:23:07.118348] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-16T17:23:07.671077] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (15.73 seconds). [2025-10-16T17:23:07.681458] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-16T17:23:07.759106] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T17:23:07.764218] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-16T17:23:08.051056] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T17:23:08.058013] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-16T17:23:08.540633] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T17:23:08.545105] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-16T17:23:09.024978] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T17:23:09.035340] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-16T17:23:09.413795] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-16T17:23:09.424731] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T17:23:09.425069] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-16T17:23:09.430055] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-16T17:23:09.472102] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T17:23:09.480366] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-16T17:23:10.451683] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-16T17:23:10.457768] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-16T17:23:10.476430] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-16T17:23:10.504491] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-16T17:23:10.509387] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T17:23:10.518677] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-16T17:23:10.762385] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-16T17:23:10.771964] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-16T17:23:11.366626] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T17:23:11.371136] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-16T17:23:11.965714] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T17:23:11.971106] [INFO ] [REMOTE ] ATR: Full fetch complete (43970 records). [2025-10-16T17:23:11.971219] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-16T17:23:12.332202] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T17:23:12.369107] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-16T17:23:12.412389] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T17:23:12.423612] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T17:23:12.470388] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-16T17:23:12.498103] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-16T17:23:12.549957] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-16T17:23:12.550044] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-16T17:23:12.550700] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-16T17:23:12.550785] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-16T17:23:12.552011] [DEBUG] [LOCAL ] ATR: Trimmed 43970 records to 30763 (keeping 200 days of data) [2025-10-16T17:23:12.770467] [DEBUG] [LOCAL ] ATR: Primary data saved (30763 records). [2025-10-16T17:23:12.770620] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-16T17:23:12.770736] [INFO ] [MAIN ] Update Progress: 173/2369 symbols completed. ATR took 36.2s. Estimated remaining: 4h 53m 53s. Rate: 7.5 symbols/min [2025-10-16T17:23:12.978299] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:13.033181] [DEBUG] [LOCAL ] AU: Loaded 53079 existing records from primary storage. [2025-10-16T17:23:13.033510] [INFO ] [MAIN ] AU: Loaded 53079 existing records. [2025-10-16T17:23:13.211792] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:23:13.212138] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-16T17:23:13.212269] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-16T17:23:13.212564] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-16T17:23:13.212620] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-16T17:23:13.397494] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-16T17:23:13.482269] [INFO ] [REMOTE ] ATS: Full fetch complete (25588 records). [2025-10-16T17:23:13.507757] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-16T17:23:13.704564] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:13.708544] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-16T17:23:13.991036] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-16T17:23:13.991353] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-16T17:23:13.992030] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-16T17:23:13.992226] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-16T17:23:13.993441] [DEBUG] [LOCAL ] ATS: Trimmed 25588 records to 17690 (keeping 200 days of data) [2025-10-16T17:23:14.100213] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-16T17:23:14.119414] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-16T17:23:14.151689] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T17:23:14.164079] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-16T17:23:14.181663] [DEBUG] [LOCAL ] ATS: Primary data saved (17690 records). [2025-10-16T17:23:14.181785] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-16T17:23:14.181859] [INFO ] [MAIN ] Update Progress: 174/2369 symbols completed. ATS took 30.7s. Estimated remaining: 4h 52m 21s. Rate: 7.5 symbols/min [2025-10-16T17:23:14.381457] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:14.426351] [DEBUG] [LOCAL ] AUB: Loaded 46010 existing records from primary storage. [2025-10-16T17:23:14.426677] [INFO ] [MAIN ] AUB: Loaded 46010 existing records. [2025-10-16T17:23:14.631195] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:23:14.631395] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-16T17:23:14.631445] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-16T17:23:14.632095] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-16T17:23:14.632153] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-16T17:23:15.046583] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:15.046974] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-16T17:23:15.723290] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T17:23:15.734036] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-16T17:23:15.811952] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-16T17:23:15.824844] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-16T17:23:15.869396] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T17:23:15.882397] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-16T17:23:16.521499] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T17:23:16.530258] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-16T17:23:17.511439] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-16T17:23:17.517023] [INFO ] [REMOTE ] ATO: Full fetch complete (60700 records). [2025-10-16T17:23:17.517172] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-16T17:23:17.917513] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-16T17:23:17.986722] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-16T17:23:18.039387] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-16T17:23:18.039939] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-16T17:23:18.041132] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-16T17:23:18.041290] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-16T17:23:18.077799] [DEBUG] [LOCAL ] ATO: Trimmed 60700 records to 42086 (keeping 200 days of data) [2025-10-16T17:23:18.080360] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-16T17:23:18.156279] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-16T17:23:18.213177] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T17:23:18.349573] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-16T17:23:18.402162] [DEBUG] [LOCAL ] ATO: Primary data saved (42086 records). [2025-10-16T17:23:18.402305] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-16T17:23:18.402387] [INFO ] [MAIN ] Update Progress: 175/2369 symbols completed. ATO took 52.5s. Estimated remaining: 4h 51m 26s. Rate: 7.5 symbols/min [2025-10-16T17:23:18.581574] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:18.588623] [DEBUG] [LOCAL ] AUNA: Loaded 5131 existing records from primary storage. [2025-10-16T17:23:18.588852] [INFO ] [MAIN ] AUNA: Loaded 5131 existing records. [2025-10-16T17:23:18.763930] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:23:18.764129] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-16T17:23:18.764175] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-16T17:23:18.764337] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-16T17:23:18.764391] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-16T17:23:19.121100] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:19.142794] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-16T17:23:19.671247] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T17:23:19.707902] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T17:23:19.709834] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-16T17:23:19.942892] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-16T17:23:20.097205] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-16T17:23:20.742856] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-16T17:23:21.546369] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-16T17:23:21.551665] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T17:23:21.940252] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-16T17:23:22.003631] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T17:23:22.342811] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-16T17:23:23.143020] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-16T17:23:23.953500] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-16T17:23:23.956945] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T17:23:24.743058] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-16T17:23:25.132321] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-16T17:23:25.382468] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T17:23:25.542975] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-16T17:23:25.593994] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T17:23:26.092473] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-16T17:23:26.342803] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-16T17:23:27.142862] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-16T17:23:27.506246] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-16T17:23:27.943036] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-16T17:23:28.121304] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T17:23:28.343895] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-16T17:23:28.742859] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-16T17:23:29.542805] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-16T17:23:30.309330] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T17:23:30.316478] [INFO ] [REMOTE ] ATUS: Full fetch complete (71384 records). [2025-10-16T17:23:30.316715] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-16T17:23:30.347892] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-16T17:23:30.724235] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-16T17:23:30.724321] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-16T17:23:30.725098] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-16T17:23:30.725164] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-16T17:23:30.726725] [DEBUG] [LOCAL ] ATUS: Trimmed 71384 records to 50229 (keeping 200 days of data) [2025-10-16T17:23:31.011915] [DEBUG] [LOCAL ] ATUS: Primary data saved (50229 records). [2025-10-16T17:23:31.012059] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-16T17:23:31.012158] [INFO ] [MAIN ] Update Progress: 176/2369 symbols completed. ATUS took 37.6s. Estimated remaining: 4h 52m 16s. Rate: 7.5 symbols/min [2025-10-16T17:23:31.151041] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-16T17:23:31.184146] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:31.221615] [DEBUG] [LOCAL ] AVA: Loaded 38779 existing records from primary storage. [2025-10-16T17:23:31.221938] [INFO ] [MAIN ] AVA: Loaded 38779 existing records. [2025-10-16T17:23:31.400712] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:23:31.400954] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-16T17:23:31.401030] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-16T17:23:31.401398] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-16T17:23:31.401447] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-16T17:23:31.764835] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:31.799571] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-16T17:23:31.841231] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T17:23:31.942792] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-16T17:23:32.026699] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T17:23:32.742812] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-16T17:23:33.542786] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-16T17:23:33.945495] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-16T17:23:34.316103] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T17:23:34.342805] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-16T17:23:35.046064] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T17:23:35.142823] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-16T17:23:35.570065] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T17:23:35.942815] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-16T17:23:36.742876] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-16T17:23:37.133800] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-16T17:23:37.168081] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-16T17:23:37.542835] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-16T17:23:38.342806] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-16T17:23:38.466513] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T17:23:38.601802] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T17:23:39.142841] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-16T17:23:39.942802] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-16T17:23:40.400688] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T17:23:40.487292] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-16T17:23:40.672066] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T17:23:40.677942] [INFO ] [REMOTE ] AUB: Full fetch complete (66171 records). [2025-10-16T17:23:40.678076] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-16T17:23:40.748073] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-16T17:23:41.082245] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-16T17:23:41.082342] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-16T17:23:41.083098] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-16T17:23:41.083164] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-16T17:23:41.084532] [DEBUG] [LOCAL ] AUB: Trimmed 66171 records to 46391 (keeping 200 days of data) [2025-10-16T17:23:41.370967] [DEBUG] [LOCAL ] AUB: Primary data saved (46391 records). [2025-10-16T17:23:41.371107] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-16T17:23:41.371742] [INFO ] [MAIN ] Update Progress: 177/2369 symbols completed. AUB took 27.2s. Estimated remaining: 4h 52m 37s. Rate: 7.5 symbols/min [2025-10-16T17:23:41.480304] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T17:23:41.548554] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-16T17:23:41.551337] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:41.564582] [DEBUG] [LOCAL ] AVAL: Loaded 8592 existing records from primary storage. [2025-10-16T17:23:41.564836] [INFO ] [MAIN ] AVAL: Loaded 8592 existing records. [2025-10-16T17:23:41.738464] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:23:41.738706] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-16T17:23:41.738762] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-16T17:23:41.738916] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-16T17:23:41.738994] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-16T17:23:42.088553] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:42.342812] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-16T17:23:42.985112] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-16T17:23:43.010911] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T17:23:43.142805] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-16T17:23:43.942838] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-16T17:23:44.742853] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-16T17:23:44.853995] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T17:23:45.149998] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T17:23:45.542810] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-16T17:23:46.051474] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T17:23:46.342796] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-16T17:23:46.431543] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T17:23:47.142891] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-16T17:23:47.859839] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T17:23:47.942827] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-16T17:23:48.742862] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-16T17:23:48.908054] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T17:23:49.392920] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T17:23:49.542830] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-16T17:23:49.564898] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T17:23:50.342817] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-16T17:23:51.065208] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T17:23:51.142846] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-16T17:23:51.942922] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-16T17:23:52.215908] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-16T17:23:52.223851] [INFO ] [REMOTE ] AU: Full fetch complete (76165 records). [2025-10-16T17:23:52.224026] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-16T17:23:52.224941] [FATAL] [VALIDATOR ] AU: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:23:52.225042] [FATAL] [MAIN ] AU: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:23:52.225086] [WARN ] [MAIN ] AU: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:23:52.225125] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-16T17:23:52.225196] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-10-16T17:23:52.225251] [INFO ] [LOCAL ] AU: Starting deletion of derivative data. [2025-10-16T17:23:52.225417] [DEBUG] [LOCAL ] AU: Deleted derivative data file. [2025-10-16T17:23:52.225800] [INFO ] [MAIN ] Update Progress: 178/2369 symbols completed. AU took 39.5s. Estimated remaining: 4h 53m 4s. Rate: 7.5 symbols/min [2025-10-16T17:23:52.406194] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:52.406453] [DEBUG] [LOCAL ] AVB: No existing data file found in primary storage. [2025-10-16T17:23:52.406534] [WARN ] [MAIN ] AVB: No existing data found, performing full refresh instead. [2025-10-16T17:23:52.406833] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-16T17:23:52.406954] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-16T17:23:52.407209] [DEBUG] [LOCAL ] AVB: No primary data file found to delete. [2025-10-16T17:23:52.407388] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-16T17:23:52.484814] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-16T17:23:52.531854] [INFO ] [REMOTE ] AUNA: Full fetch complete (7788 records). [2025-10-16T17:23:52.543925] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-16T17:23:52.545630] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T17:23:52.752235] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-16T17:23:53.126985] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:53.203914] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-16T17:23:53.203993] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-16T17:23:53.204213] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-16T17:23:53.204263] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-16T17:23:53.204661] [DEBUG] [LOCAL ] AUNA: Trimmed 7788 records to 5158 (keeping 200 days of data) [2025-10-16T17:23:53.231770] [DEBUG] [LOCAL ] AUNA: Primary data saved (5158 records). [2025-10-16T17:23:53.231855] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-16T17:23:53.231928] [INFO ] [MAIN ] Update Progress: 179/2369 symbols completed. AUNA took 34.8s. Estimated remaining: 4h 51m 30s. Rate: 7.5 symbols/min [2025-10-16T17:23:53.400294] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:53.400463] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-16T17:23:53.400500] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-16T17:23:53.400615] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-16T17:23:53.400687] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-16T17:23:53.400777] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-16T17:23:53.400812] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-16T17:23:53.552163] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-16T17:23:53.764097] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:54.251468] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T17:23:54.342807] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-16T17:23:54.790891] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T17:23:55.142816] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-16T17:23:55.336960] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:23:55.337293] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-16T17:23:55.337387] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:23:55.337434] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-16T17:23:55.337469] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:23:55.337511] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-16T17:23:55.337586] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-16T17:23:55.337622] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-16T17:23:55.337719] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-16T17:23:55.337802] [INFO ] [MAIN ] Update Progress: 180/2369 symbols completed. AVBC took 2.1s. Estimated remaining: 4h 50m 10s. Rate: 7.5 symbols/min [2025-10-16T17:23:55.519251] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:55.534283] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T17:23:55.539399] [INFO ] [REMOTE ] AVA: Full fetch complete (55526 records). [2025-10-16T17:23:55.539556] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-16T17:23:55.727354] [DEBUG] [LOCAL ] AVD: Loaded 21808 existing records from primary storage. [2025-10-16T17:23:55.730139] [INFO ] [MAIN ] AVD: Loaded 21808 existing records. [2025-10-16T17:23:55.942949] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-16T17:23:56.277556] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-16T17:23:56.277708] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-16T17:23:56.279032] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-16T17:23:56.279139] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-16T17:23:56.255140] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:23:56.280733] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-16T17:23:56.281173] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-16T17:23:56.281507] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-16T17:23:56.281596] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-16T17:23:56.281436] [DEBUG] [LOCAL ] AVA: Trimmed 55526 records to 39001 (keeping 200 days of data) [2025-10-16T17:23:56.772840] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-16T17:23:57.134126] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:57.168584] [DEBUG] [LOCAL ] AVA: Primary data saved (39001 records). [2025-10-16T17:23:57.168834] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-16T17:23:57.169001] [INFO ] [MAIN ] Update Progress: 181/2369 symbols completed. AVA took 26.2s. Estimated remaining: 4h 48m 49s. Rate: 7.6 symbols/min [2025-10-16T17:23:57.344340] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:57.363838] [DEBUG] [LOCAL ] AVK: Loaded 18628 existing records from primary storage. [2025-10-16T17:23:57.364235] [INFO ] [MAIN ] AVK: Loaded 18628 existing records. [2025-10-16T17:23:57.509999] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T17:23:57.552317] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-16T17:23:57.587724] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:23:57.589011] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-16T17:23:57.589082] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-16T17:23:57.589281] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-16T17:23:57.589322] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-16T17:23:57.897225] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T17:23:57.967661] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:58.342798] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-16T17:23:58.690475] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T17:23:59.006585] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-16T17:23:59.142816] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-16T17:23:59.869079] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T17:23:59.942840] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-16T17:24:00.742897] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-16T17:24:01.224263] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T17:24:01.284204] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-16T17:24:01.542814] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-16T17:24:02.342813] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-16T17:24:02.568164] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T17:24:03.142837] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-16T17:24:03.788305] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T17:24:03.943060] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-16T17:24:04.299483] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T17:24:04.742833] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-16T17:24:05.542785] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-16T17:24:05.736958] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T17:24:05.756543] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T17:24:06.342812] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-16T17:24:06.456001] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T17:24:07.142837] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-16T17:24:07.539842] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T17:24:07.942823] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-16T17:24:08.525429] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T17:24:08.742798] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-16T17:24:08.905579] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-16T17:24:09.542810] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-16T17:24:09.993485] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-16T17:24:10.342783] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-16T17:24:10.621003] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-16T17:24:11.142807] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-16T17:24:11.397349] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T17:24:11.942813] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-16T17:24:12.675615] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T17:24:12.742818] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-16T17:24:12.798472] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T17:24:13.364396] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T17:24:13.542840] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-16T17:24:14.342825] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-16T17:24:14.536488] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T17:24:15.142820] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-16T17:24:15.905210] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-16T17:24:15.947916] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-16T17:24:15.963099] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T17:24:16.742804] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-16T17:24:16.885099] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-16T17:24:17.543909] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-16T17:24:17.546075] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T17:24:18.342794] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-16T17:24:18.527604] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T17:24:19.050128] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T17:24:19.142847] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-16T17:24:19.619815] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-16T17:24:19.942804] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-16T17:24:20.742827] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-16T17:24:21.018371] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T17:24:21.524695] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T17:24:21.526409] [INFO ] [REMOTE ] AVAL: Full fetch complete (14928 records). [2025-10-16T17:24:21.526481] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-16T17:24:21.548033] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-16T17:24:21.908471] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-16T17:24:21.908548] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-16T17:24:21.908861] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-16T17:24:21.908945] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-16T17:24:21.909449] [DEBUG] [LOCAL ] AVAL: Trimmed 14928 records to 8650 (keeping 200 days of data) [2025-10-16T17:24:21.960311] [DEBUG] [LOCAL ] AVAL: Primary data saved (8650 records). [2025-10-16T17:24:21.960456] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-16T17:24:21.960536] [INFO ] [MAIN ] Update Progress: 182/2369 symbols completed. AVAL took 40.6s. Estimated remaining: 4h 52m 3s. Rate: 7.5 symbols/min [2025-10-16T17:24:22.132764] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:24:22.168110] [DEBUG] [LOCAL ] AVNS: Loaded 33666 existing records from primary storage. [2025-10-16T17:24:22.168400] [INFO ] [MAIN ] AVNS: Loaded 33666 existing records. [2025-10-16T17:24:22.341589] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:24:22.341819] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-16T17:24:22.341867] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-16T17:24:22.342138] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-16T17:24:22.342176] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-16T17:24:22.353149] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-16T17:24:22.708138] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:24:22.714290] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T17:24:23.142811] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-16T17:24:23.592329] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-16T17:24:23.597314] [INFO ] [REMOTE ] AVK: Full fetch complete (26720 records). [2025-10-16T17:24:23.597394] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-16T17:24:23.951124] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-16T17:24:23.962848] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-16T17:24:23.963117] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-16T17:24:23.964304] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-16T17:24:23.964469] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-16T17:24:23.965301] [DEBUG] [LOCAL ] AVK: Trimmed 26720 records to 18751 (keeping 200 days of data) [2025-10-16T17:24:24.077105] [DEBUG] [LOCAL ] AVK: Primary data saved (18751 records). [2025-10-16T17:24:24.077224] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-16T17:24:24.077298] [INFO ] [MAIN ] Update Progress: 183/2369 symbols completed. AVK took 26.9s. Estimated remaining: 4h 50m 45s. Rate: 7.5 symbols/min [2025-10-16T17:24:24.272309] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T17:24:24.275954] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:24:24.319672] [DEBUG] [LOCAL ] AVNT: Loaded 39045 existing records from primary storage. [2025-10-16T17:24:24.319958] [INFO ] [MAIN ] AVNT: Loaded 39045 existing records. [2025-10-16T17:24:24.490434] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:24:24.490609] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-16T17:24:24.490682] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-16T17:24:24.491026] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-16T17:24:24.491083] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-16T17:24:24.749900] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-16T17:24:24.842400] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:24:25.542845] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-16T17:24:25.667049] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T17:24:25.750493] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T17:24:26.342865] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-16T17:24:27.118486] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T17:24:27.142766] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-16T17:24:27.715980] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T17:24:27.942826] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-16T17:24:28.471173] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T17:24:28.744008] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-16T17:24:28.748618] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T17:24:29.542858] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-16T17:24:30.278288] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-16T17:24:30.342827] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-16T17:24:30.532098] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T17:24:31.142781] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-16T17:24:31.343156] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T17:24:31.804817] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T17:24:31.807467] [INFO ] [REMOTE ] AVD: Full fetch complete (32746 records). [2025-10-16T17:24:31.807630] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-16T17:24:31.808239] [FATAL] [VALIDATOR ] AVD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:24:31.808341] [FATAL] [MAIN ] AVD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:24:31.808414] [WARN ] [MAIN ] AVD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:24:31.808509] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-16T17:24:31.808592] [DEBUG] [LOCAL ] AVD: No primary data file found to delete. [2025-10-16T17:24:31.808632] [INFO ] [LOCAL ] AVD: Starting deletion of derivative data. [2025-10-16T17:24:31.808833] [DEBUG] [LOCAL ] AVD: Deleted derivative data file. [2025-10-16T17:24:31.808955] [INFO ] [MAIN ] Update Progress: 184/2369 symbols completed. AVD took 36.5s. Estimated remaining: 4h 50m 34s. Rate: 7.5 symbols/min [2025-10-16T17:24:31.949226] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-16T17:24:31.982396] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:24:32.040725] [DEBUG] [LOCAL ] AVTR: Loaded 53572 existing records from primary storage. [2025-10-16T17:24:32.041066] [INFO ] [MAIN ] AVTR: Loaded 53572 existing records. [2025-10-16T17:24:32.216201] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:24:32.216435] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-16T17:24:32.216503] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-16T17:24:32.216865] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-16T17:24:32.216925] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-16T17:24:32.591012] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:24:32.742823] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-16T17:24:33.542840] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-16T17:24:33.613562] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T17:24:33.619347] [INFO ] [REMOTE ] AVB: Full fetch complete (59108 records). [2025-10-16T17:24:33.619533] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-16T17:24:34.024098] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-16T17:24:34.024176] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-16T17:24:34.024833] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-16T17:24:34.024895] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-16T17:24:34.026260] [DEBUG] [LOCAL ] AVB: Trimmed 59108 records to 42587 (keeping 200 days of data) [2025-10-16T17:24:34.293690] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T17:24:34.336268] [DEBUG] [LOCAL ] AVB: Primary data saved (42587 records). [2025-10-16T17:24:34.336395] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-16T17:24:34.336465] [INFO ] [MAIN ] Update Progress: 185/2369 symbols completed. AVB took 42.1s. Estimated remaining: 4h 49m 22s. Rate: 7.5 symbols/min [2025-10-16T17:24:34.348207] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-16T17:24:34.524547] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:24:34.524775] [DEBUG] [LOCAL ] AVY: No existing data file found in primary storage. [2025-10-16T17:24:34.524847] [WARN ] [MAIN ] AVY: No existing data found, performing full refresh instead. [2025-10-16T17:24:34.524965] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-16T17:24:34.525007] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-16T17:24:34.525052] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-16T17:24:34.525123] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-16T17:24:34.901460] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:24:34.921684] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T17:24:35.142821] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-16T17:24:35.919623] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T17:24:35.942768] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-16T17:24:36.581624] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T17:24:36.742862] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-16T17:24:37.186836] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-16T17:24:37.542880] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-16T17:24:37.764237] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-16T17:24:38.342818] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-16T17:24:39.142861] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-16T17:24:39.360082] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-16T17:24:39.693866] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T17:24:39.942829] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-16T17:24:40.582453] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T17:24:40.742829] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-16T17:24:41.396221] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T17:24:41.542966] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-16T17:24:42.063332] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T17:24:42.342817] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-16T17:24:43.122908] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T17:24:43.142773] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-16T17:24:43.422899] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T17:24:43.942810] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-16T17:24:44.591572] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T17:24:44.742808] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-16T17:24:45.468223] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T17:24:45.542782] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-16T17:24:46.337011] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T17:24:46.351095] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-16T17:24:46.594933] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-16T17:24:47.142838] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-16T17:24:47.697336] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T17:24:47.942993] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-16T17:24:48.742908] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-16T17:24:49.004262] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-16T17:24:49.479283] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-16T17:24:49.484631] [INFO ] [REMOTE ] AVNT: Full fetch complete (56444 records). [2025-10-16T17:24:49.484849] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-16T17:24:49.548252] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-16T17:24:49.920266] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-16T17:24:49.920485] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-16T17:24:49.921262] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-16T17:24:49.921434] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-16T17:24:49.939565] [DEBUG] [LOCAL ] AVNT: Trimmed 56444 records to 39339 (keeping 200 days of data) [2025-10-16T17:24:49.941175] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T17:24:50.186982] [DEBUG] [LOCAL ] AVNT: Primary data saved (39339 records). [2025-10-16T17:24:50.187125] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-16T17:24:50.187206] [INFO ] [MAIN ] Update Progress: 186/2369 symbols completed. AVNT took 26.1s. Estimated remaining: 4h 50m 46s. Rate: 7.5 symbols/min [2025-10-16T17:24:50.357335] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:24:50.353504] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-16T17:24:50.357723] [DEBUG] [LOCAL ] AWF: No existing data file found in primary storage. [2025-10-16T17:24:50.358453] [WARN ] [MAIN ] AWF: No existing data found, performing full refresh instead. [2025-10-16T17:24:50.358594] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-16T17:24:50.358697] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-16T17:24:50.358762] [DEBUG] [LOCAL ] AWF: No primary data file found to delete. [2025-10-16T17:24:50.358799] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-16T17:24:50.739893] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:24:51.088464] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T17:24:51.142813] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-16T17:24:51.476350] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T17:24:51.942894] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-16T17:24:52.742830] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-16T17:24:52.861253] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T17:24:53.178025] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T17:24:53.542828] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-16T17:24:54.145023] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T17:24:54.342858] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-16T17:24:55.142846] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-16T17:24:55.212574] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T17:24:55.943873] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-16T17:24:55.946229] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T17:24:56.157281] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T17:24:56.742820] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-16T17:24:57.411425] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T17:24:57.542837] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-16T17:24:58.106604] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T17:24:58.112728] [INFO ] [REMOTE ] AVNS: Full fetch complete (48471 records). [2025-10-16T17:24:58.112851] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-16T17:24:58.350913] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-16T17:24:58.503370] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-16T17:24:58.503449] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-16T17:24:58.504058] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-16T17:24:58.504121] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-16T17:24:58.505233] [DEBUG] [LOCAL ] AVNS: Trimmed 48471 records to 33913 (keeping 200 days of data) [2025-10-16T17:24:58.700013] [DEBUG] [LOCAL ] AVNS: Primary data saved (33913 records). [2025-10-16T17:24:58.700146] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-16T17:24:58.700222] [INFO ] [MAIN ] Update Progress: 187/2369 symbols completed. AVNS took 36.7s. Estimated remaining: 4h 50m 44s. Rate: 7.5 symbols/min [2025-10-16T17:24:58.870206] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T17:24:58.887930] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:24:58.893489] [DEBUG] [LOCAL ] AWI: No existing data file found in primary storage. [2025-10-16T17:24:58.893546] [WARN ] [MAIN ] AWI: No existing data found, performing full refresh instead. [2025-10-16T17:24:58.893699] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-16T17:24:58.893754] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-16T17:24:58.893799] [DEBUG] [LOCAL ] AWI: No primary data file found to delete. [2025-10-16T17:24:58.893847] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-16T17:24:59.147995] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-16T17:24:59.250591] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:24:59.942855] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-16T17:25:00.175974] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T17:25:00.201401] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-16T17:25:00.742860] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-16T17:25:01.389933] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T17:25:01.442975] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-16T17:25:01.542809] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-16T17:25:02.342821] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-16T17:25:02.754975] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T17:25:03.142807] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-16T17:25:03.942787] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-16T17:25:04.351475] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-16T17:25:04.393970] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T17:25:04.742849] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-16T17:25:05.063155] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T17:25:05.542840] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-16T17:25:06.283582] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-16T17:25:06.291114] [INFO ] [REMOTE ] AVTR: Full fetch complete (77641 records). [2025-10-16T17:25:06.291296] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-16T17:25:06.348005] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-16T17:25:06.683877] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-16T17:25:06.683992] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-16T17:25:06.684822] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-16T17:25:06.684883] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-16T17:25:06.686226] [DEBUG] [LOCAL ] AVTR: Trimmed 77641 records to 53962 (keeping 200 days of data) [2025-10-16T17:25:06.996456] [DEBUG] [LOCAL ] AVTR: Primary data saved (53962 records). [2025-10-16T17:25:06.996585] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-16T17:25:06.996685] [INFO ] [MAIN ] Update Progress: 188/2369 symbols completed. AVTR took 35.2s. Estimated remaining: 4h 50m 40s. Rate: 7.5 symbols/min [2025-10-16T17:25:07.166689] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-16T17:25:07.169260] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:25:07.193223] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T17:25:07.242701] [DEBUG] [LOCAL ] AWK: Loaded 48557 existing records from primary storage. [2025-10-16T17:25:07.243031] [INFO ] [MAIN ] AWK: Loaded 48557 existing records. [2025-10-16T17:25:07.419747] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:25:07.420054] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-16T17:25:07.420163] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-16T17:25:07.420673] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-16T17:25:07.420750] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-16T17:25:07.539880] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T17:25:07.791894] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:25:07.942814] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-16T17:25:08.075287] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T17:25:08.742919] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-16T17:25:09.494374] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T17:25:09.542776] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-16T17:25:09.679073] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T17:25:10.342878] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-16T17:25:10.836247] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T17:25:11.142834] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-16T17:25:11.775964] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T17:25:11.942803] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-16T17:25:12.004076] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-16T17:25:12.742840] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-16T17:25:12.927599] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T17:25:13.542836] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-16T17:25:14.342786] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-16T17:25:14.500194] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T17:25:14.768741] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T17:25:15.142813] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-16T17:25:15.478697] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T17:25:15.942824] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-16T17:25:16.601197] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T17:25:16.742799] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-16T17:25:17.542781] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-16T17:25:17.559853] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T17:25:17.651757] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T17:25:18.342808] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-16T17:25:18.475352] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T17:25:19.142848] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-16T17:25:19.942813] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-16T17:25:20.108702] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T17:25:20.425817] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T17:25:20.742855] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-16T17:25:21.121949] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-16T17:25:21.542880] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-16T17:25:22.161907] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T17:25:22.342812] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-16T17:25:23.056268] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-16T17:25:23.061510] [INFO ] [REMOTE ] AVY: Full fetch complete (56310 records). [2025-10-16T17:25:23.061669] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-16T17:25:23.062331] [FATAL] [VALIDATOR ] AVY: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:25:23.062416] [FATAL] [MAIN ] AVY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:25:23.062466] [WARN ] [MAIN ] AVY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:25:23.062504] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-16T17:25:23.062596] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-16T17:25:23.062697] [INFO ] [LOCAL ] AVY: Starting deletion of derivative data. [2025-10-16T17:25:23.062773] [DEBUG] [LOCAL ] AVY: No derivative data file found to delete. [2025-10-16T17:25:23.062845] [INFO ] [MAIN ] Update Progress: 189/2369 symbols completed. AVY took 48.7s. Estimated remaining: 4h 52m 5s. Rate: 7.5 symbols/min [2025-10-16T17:25:23.148002] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-16T17:25:23.239801] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:25:23.259420] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-16T17:25:23.280870] [DEBUG] [LOCAL ] AWP: Loaded 21616 existing records from primary storage. [2025-10-16T17:25:23.281120] [INFO ] [MAIN ] AWP: Loaded 21616 existing records. [2025-10-16T17:25:23.453165] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:25:23.453358] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-16T17:25:23.453474] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-16T17:25:23.453848] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-16T17:25:23.453905] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-16T17:25:23.794483] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:25:23.942782] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-16T17:25:24.402382] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T17:25:24.742814] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-16T17:25:24.878809] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T17:25:24.882345] [INFO ] [REMOTE ] AWF: Full fetch complete (35839 records). [2025-10-16T17:25:24.882420] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-16T17:25:25.242171] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-16T17:25:25.242266] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-16T17:25:25.242746] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-16T17:25:25.242807] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-16T17:25:25.243597] [DEBUG] [LOCAL ] AWF: Trimmed 35839 records to 24143 (keeping 200 days of data) [2025-10-16T17:25:25.383410] [DEBUG] [LOCAL ] AWF: Primary data saved (24143 records). [2025-10-16T17:25:25.383532] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-16T17:25:25.383601] [INFO ] [MAIN ] Update Progress: 190/2369 symbols completed. AWF took 35.2s. Estimated remaining: 4h 50m 51s. Rate: 7.5 symbols/min [2025-10-16T17:25:25.549694] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-16T17:25:25.574402] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:25:25.597003] [DEBUG] [LOCAL ] AWR: Loaded 22839 existing records from primary storage. [2025-10-16T17:25:25.597301] [INFO ] [MAIN ] AWR: Loaded 22839 existing records. [2025-10-16T17:25:25.778619] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:25:25.778914] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-16T17:25:25.779000] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-16T17:25:25.779226] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-16T17:25:25.779283] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-16T17:25:26.130022] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T17:25:26.149824] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:25:26.342775] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-16T17:25:26.451431] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T17:25:27.142790] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-16T17:25:27.189201] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T17:25:27.942820] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-16T17:25:28.742848] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-16T17:25:28.886146] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T17:25:29.182834] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-16T17:25:29.188253] [INFO ] [REMOTE ] AWI: Full fetch complete (36062 records). [2025-10-16T17:25:29.188387] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-16T17:25:29.558490] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-16T17:25:29.612259] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-16T17:25:29.612480] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-16T17:25:29.613073] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-16T17:25:29.613152] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-16T17:25:29.630955] [DEBUG] [LOCAL ] AWI: Trimmed 36062 records to 25598 (keeping 200 days of data) [2025-10-16T17:25:29.632223] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T17:25:29.801094] [DEBUG] [LOCAL ] AWI: Primary data saved (25598 records). [2025-10-16T17:25:29.801261] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-16T17:25:29.801354] [INFO ] [MAIN ] Update Progress: 191/2369 symbols completed. AWI took 31.1s. Estimated remaining: 4h 50m 3s. Rate: 7.5 symbols/min [2025-10-16T17:25:29.968544] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:25:29.997403] [DEBUG] [LOCAL ] AX: Loaded 28036 existing records from primary storage. [2025-10-16T17:25:29.997703] [INFO ] [MAIN ] AX: Loaded 28036 existing records. [2025-10-16T17:25:30.203385] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:25:30.203588] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-16T17:25:30.203636] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-16T17:25:30.203892] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-16T17:25:30.203934] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-16T17:25:30.347905] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-16T17:25:30.598476] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:25:31.046566] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:25:31.142779] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-16T17:25:31.175320] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-16T17:25:31.942819] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-16T17:25:32.742516] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T17:25:32.751974] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-16T17:25:33.105948] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T17:25:33.542849] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-16T17:25:34.135170] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T17:25:34.342849] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-16T17:25:34.972475] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T17:25:34.979024] [INFO ] [REMOTE ] AWK: Full fetch complete (70904 records). [2025-10-16T17:25:34.979206] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-16T17:25:35.145191] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-16T17:25:35.350233] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T17:25:35.404313] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-16T17:25:35.404392] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-16T17:25:35.405158] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-16T17:25:35.405221] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-16T17:25:35.406551] [DEBUG] [LOCAL ] AWK: Trimmed 70904 records to 48909 (keeping 200 days of data) [2025-10-16T17:25:35.709153] [DEBUG] [LOCAL ] AWK: Primary data saved (48909 records). [2025-10-16T17:25:35.709337] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-16T17:25:35.709451] [INFO ] [MAIN ] Update Progress: 192/2369 symbols completed. AWK took 28.7s. Estimated remaining: 4h 49m 31s. Rate: 7.5 symbols/min [2025-10-16T17:25:35.882155] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:25:35.929099] [DEBUG] [LOCAL ] AXL: Loaded 50565 existing records from primary storage. [2025-10-16T17:25:35.929407] [INFO ] [MAIN ] AXL: Loaded 50565 existing records. [2025-10-16T17:25:35.950147] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-16T17:25:36.114040] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:25:36.114259] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-16T17:25:36.114305] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-16T17:25:36.114502] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-16T17:25:36.114539] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-16T17:25:36.487408] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:25:36.519986] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T17:25:36.742843] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-16T17:25:37.084907] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T17:25:37.542840] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-16T17:25:38.342834] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-16T17:25:38.472259] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T17:25:38.766631] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T17:25:39.142801] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-16T17:25:39.235932] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T17:25:39.942818] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-16T17:25:40.658090] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T17:25:40.742787] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-16T17:25:41.262823] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T17:25:41.542876] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-16T17:25:42.089549] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T17:25:42.342837] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-16T17:25:42.610857] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-16T17:25:43.142885] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-16T17:25:43.408382] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-16T17:25:43.942794] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-16T17:25:44.742846] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-16T17:25:44.886071] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T17:25:44.912784] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T17:25:45.390969] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-16T17:25:45.542830] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-16T17:25:46.342817] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-16T17:25:47.142832] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-16T17:25:47.338745] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T17:25:47.530188] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T17:25:47.788871] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-16T17:25:47.942831] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-16T17:25:48.742825] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-16T17:25:49.463619] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-16T17:25:49.542789] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-16T17:25:49.659459] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T17:25:50.342441] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-16T17:25:50.347703] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-16T17:25:51.142823] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-16T17:25:51.681237] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T17:25:51.942874] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-16T17:25:52.518959] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T17:25:52.540836] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-16T17:25:52.742857] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-16T17:25:53.542822] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-16T17:25:54.150059] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T17:25:54.342851] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-16T17:25:55.142870] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-16T17:25:55.225692] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T17:25:55.277116] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T17:25:55.942862] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-16T17:25:56.021613] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T17:25:56.714147] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T17:25:56.742780] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-16T17:25:57.542839] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-16T17:25:57.879923] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-16T17:25:58.342909] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-16T17:25:58.608110] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T17:25:59.142850] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-16T17:25:59.237543] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T17:25:59.241551] [INFO ] [REMOTE ] AWP: Full fetch complete (31951 records). [2025-10-16T17:25:59.241722] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-16T17:25:59.614067] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-16T17:25:59.614154] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-16T17:25:59.614576] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-16T17:25:59.614616] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-16T17:25:59.615448] [DEBUG] [LOCAL ] AWP: Trimmed 31951 records to 21759 (keeping 200 days of data) [2025-10-16T17:25:59.744050] [DEBUG] [LOCAL ] AWP: Primary data saved (21759 records). [2025-10-16T17:25:59.744187] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-16T17:25:59.744269] [INFO ] [MAIN ] Update Progress: 193/2369 symbols completed. AWP took 36.7s. Estimated remaining: 4h 52m 24s. Rate: 7.4 symbols/min [2025-10-16T17:25:59.912214] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:25:59.944020] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-16T17:25:59.966837] [DEBUG] [LOCAL ] AXP: Loaded 53166 existing records from primary storage. [2025-10-16T17:25:59.967176] [INFO ] [MAIN ] AXP: Loaded 53166 existing records. [2025-10-16T17:26:00.143186] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:26:00.143449] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-16T17:26:00.143530] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-16T17:26:00.143905] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-16T17:26:00.143977] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-16T17:26:00.503486] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:00.742818] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-16T17:26:00.915241] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T17:26:00.972003] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T17:26:01.542874] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-16T17:26:02.342843] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-16T17:26:02.596100] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T17:26:02.741092] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T17:26:02.744475] [INFO ] [REMOTE ] AWR: Full fetch complete (32329 records). [2025-10-16T17:26:02.744602] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-16T17:26:03.122254] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-16T17:26:03.122342] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-16T17:26:03.122790] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-16T17:26:03.122850] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-16T17:26:03.123711] [DEBUG] [LOCAL ] AWR: Trimmed 32329 records to 23000 (keeping 200 days of data) [2025-10-16T17:26:03.175894] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-16T17:26:03.263877] [DEBUG] [LOCAL ] AWR: Primary data saved (23000 records). [2025-10-16T17:26:03.264017] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-16T17:26:03.264098] [INFO ] [MAIN ] Update Progress: 194/2369 symbols completed. AWR took 37.9s. Estimated remaining: 4h 51m 25s. Rate: 7.5 symbols/min [2025-10-16T17:26:03.444680] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:26:03.444921] [DEBUG] [LOCAL ] AXR: No existing data file found in primary storage. [2025-10-16T17:26:03.444970] [WARN ] [MAIN ] AXR: No existing data found, performing full refresh instead. [2025-10-16T17:26:03.445091] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-16T17:26:03.445183] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-16T17:26:03.445248] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-16T17:26:03.445294] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-16T17:26:03.761873] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T17:26:03.838810] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:03.942775] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-16T17:26:04.742838] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-16T17:26:05.015534] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T17:26:05.553200] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-16T17:26:05.578629] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-16T17:26:06.235948] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T17:26:06.342853] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-16T17:26:07.020244] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T17:26:07.024186] [INFO ] [REMOTE ] AX: Full fetch complete (42274 records). [2025-10-16T17:26:07.024299] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-16T17:26:07.147912] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-16T17:26:07.400414] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-16T17:26:07.400486] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-16T17:26:07.401002] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-16T17:26:07.401063] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-16T17:26:07.401903] [DEBUG] [LOCAL ] AX: Trimmed 42274 records to 28285 (keeping 200 days of data) [2025-10-16T17:26:07.561498] [DEBUG] [LOCAL ] AX: Primary data saved (28285 records). [2025-10-16T17:26:07.561629] [INFO ] [MAIN ] AX: Full history saved. [2025-10-16T17:26:07.561742] [INFO ] [MAIN ] Update Progress: 195/2369 symbols completed. AX took 37.8s. Estimated remaining: 4h 50m 35s. Rate: 7.5 symbols/min [2025-10-16T17:26:07.733757] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:26:07.772247] [DEBUG] [LOCAL ] AXS: Loaded 38593 existing records from primary storage. [2025-10-16T17:26:07.772670] [INFO ] [MAIN ] AXS: Loaded 38593 existing records. [2025-10-16T17:26:07.874813] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-16T17:26:07.944814] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-16T17:26:07.975751] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:26:07.977378] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-16T17:26:07.977295] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T17:26:07.977525] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-16T17:26:07.984441] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-16T17:26:07.984529] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-16T17:26:08.017188] [INFO ] [REMOTE ] AXL: Full fetch complete (73061 records). [2025-10-16T17:26:08.050069] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-16T17:26:08.540695] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T17:26:08.731234] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:08.750494] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-16T17:26:08.755357] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-16T17:26:08.755411] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-16T17:26:08.756298] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-16T17:26:08.756363] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-16T17:26:08.757893] [DEBUG] [LOCAL ] AXL: Trimmed 73061 records to 50921 (keeping 200 days of data) [2025-10-16T17:26:09.039838] [DEBUG] [LOCAL ] AXL: Primary data saved (50921 records). [2025-10-16T17:26:09.039966] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-16T17:26:09.040044] [INFO ] [MAIN ] Update Progress: 196/2369 symbols completed. AXL took 33.3s. Estimated remaining: 4h 49m 15s. Rate: 7.5 symbols/min [2025-10-16T17:26:09.205921] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:26:09.253813] [DEBUG] [LOCAL ] AXTA: Loaded 52253 existing records from primary storage. [2025-10-16T17:26:09.254144] [INFO ] [MAIN ] AXTA: Loaded 52253 existing records. [2025-10-16T17:26:09.426196] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:26:09.426434] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-16T17:26:09.426514] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-16T17:26:09.426883] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-16T17:26:09.426951] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-16T17:26:09.547870] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-16T17:26:09.785237] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:10.026716] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T17:26:10.342866] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-16T17:26:11.142790] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-16T17:26:11.594390] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-16T17:26:11.749571] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T17:26:11.942788] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-16T17:26:12.295757] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T17:26:12.742815] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-16T17:26:13.053922] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T17:26:13.542835] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-16T17:26:13.903258] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-16T17:26:14.158919] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T17:26:14.342810] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-16T17:26:15.142815] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-16T17:26:15.924607] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T17:26:15.942763] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-16T17:26:16.387396] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T17:26:16.421670] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-16T17:26:16.742816] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-16T17:26:17.542853] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-16T17:26:18.342922] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-16T17:26:18.743734] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-16T17:26:19.021570] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-16T17:26:19.061810] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T17:26:19.142803] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-16T17:26:19.942822] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-16T17:26:20.742876] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-16T17:26:20.826682] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T17:26:21.134063] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T17:26:21.542892] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-16T17:26:22.342816] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-16T17:26:22.957899] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-16T17:26:23.142845] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-16T17:26:23.242207] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T17:26:23.531621] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T17:26:23.588062] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T17:26:23.942838] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-16T17:26:24.429161] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-16T17:26:24.742822] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-16T17:26:25.542846] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-16T17:26:26.342885] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-16T17:26:26.809064] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-16T17:26:27.142841] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-16T17:26:27.211203] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T17:26:27.374686] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T17:26:27.942849] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-16T17:26:28.742853] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-16T17:26:29.011103] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-16T17:26:29.542816] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-16T17:26:29.582074] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T17:26:30.167843] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T17:26:30.342825] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-16T17:26:30.822009] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-16T17:26:30.822803] [INFO ] [REMOTE ] AXR: Full fetch complete (4411 records). [2025-10-16T17:26:30.822872] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-16T17:26:30.823214] [FATAL] [VALIDATOR ] AXR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:26:30.823297] [FATAL] [MAIN ] AXR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:26:30.823342] [WARN ] [MAIN ] AXR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:26:30.823419] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-16T17:26:30.823496] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-16T17:26:30.823558] [INFO ] [LOCAL ] AXR: Starting deletion of derivative data. [2025-10-16T17:26:30.823629] [DEBUG] [LOCAL ] AXR: No derivative data file found to delete. [2025-10-16T17:26:30.823757] [INFO ] [MAIN ] Update Progress: 197/2369 symbols completed. AXR took 27.6s. Estimated remaining: 4h 51m 39s. Rate: 7.4 symbols/min [2025-10-16T17:26:31.142836] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-16T17:26:31.635570] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-16T17:26:31.942890] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-16T17:26:32.742884] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-16T17:26:32.902683] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T17:26:33.197194] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T17:26:33.542838] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-16T17:26:34.342888] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-16T17:26:34.893273] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-16T17:26:34.996030] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T17:26:35.142834] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-16T17:26:35.774820] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T17:26:35.942808] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-16T17:26:36.648630] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T17:26:36.742802] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-16T17:26:37.542861] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-16T17:26:38.320681] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-16T17:26:38.330309] [INFO ] [REMOTE ] AXP: Full fetch complete (77087 records). [2025-10-16T17:26:38.330468] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-16T17:26:38.771791] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-16T17:26:38.829629] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-16T17:26:38.828690] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-16T17:26:38.831092] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-16T17:26:38.832171] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-16T17:26:38.832421] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-16T17:26:38.857060] [DEBUG] [LOCAL ] AXP: Trimmed 77087 records to 53555 (keeping 200 days of data) [2025-10-16T17:26:38.858861] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T17:26:39.182079] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-16T17:26:39.236266] [DEBUG] [LOCAL ] AXP: Primary data saved (53555 records). [2025-10-16T17:26:39.236412] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-16T17:26:39.236806] [INFO ] [MAIN ] Update Progress: 198/2369 symbols completed. AXP took 39.5s. Estimated remaining: 4h 51m 35s. Rate: 7.4 symbols/min [2025-10-16T17:26:40.672757] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T17:26:40.681139] [INFO ] [REMOTE ] AXTA: Full fetch complete (75375 records). [2025-10-16T17:26:40.681486] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-16T17:26:40.870780] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T17:26:40.928318] [INFO ] [REMOTE ] AXS: Full fetch complete (55880 records). [2025-10-16T17:26:40.966961] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-16T17:26:41.444742] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-16T17:26:41.450422] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-16T17:26:41.456373] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-16T17:26:41.475789] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-16T17:26:41.559227] [DEBUG] [LOCAL ] AXTA: Trimmed 75375 records to 52641 (keeping 200 days of data) [2025-10-16T17:26:41.578539] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-16T17:26:41.578895] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-16T17:26:41.579546] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-16T17:26:41.579630] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-16T17:26:41.662316] [DEBUG] [LOCAL ] AXS: Trimmed 55880 records to 38896 (keeping 200 days of data) [2025-10-16T17:26:42.008371] [DEBUG] [LOCAL ] AXTA: Primary data saved (52641 records). [2025-10-16T17:26:42.009017] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-16T17:26:42.010247] [INFO ] [MAIN ] Update Progress: 199/2369 symbols completed. AXTA took 33.0s. Estimated remaining: 4h 50m 29s. Rate: 7.5 symbols/min [2025-10-16T17:26:42.125712] [DEBUG] [LOCAL ] AXS: Primary data saved (38896 records). [2025-10-16T17:26:42.125872] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-16T17:26:42.125954] [INFO ] [MAIN ] Update Progress: 200/2369 symbols completed. AXS took 34.6s. Estimated remaining: 4h 48m 55s. Rate: 7.5 symbols/min [2025-10-16T17:26:42.734581] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:26:42.742791] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-16T17:26:42.786914] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-16T17:26:42.819003] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:26:42.817863] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-16T17:26:42.847826] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-16T17:26:42.846058] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:26:42.866899] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:26:42.867564] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-16T17:26:42.867839] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-16T17:26:42.962078] [DEBUG] [LOCAL ] AZO: Loaded 11036 existing records from primary storage. [2025-10-16T17:26:42.985759] [INFO ] [MAIN ] AZO: Loaded 11036 existing records. [2025-10-16T17:26:43.077506] [DEBUG] [LOCAL ] AZZ: Loaded 22700 existing records from primary storage. [2025-10-16T17:26:43.122373] [INFO ] [MAIN ] AZZ: Loaded 22700 existing records. [2025-10-16T17:26:43.099958] [DEBUG] [LOCAL ] AYI: Loaded 24967 existing records from primary storage. [2025-10-16T17:26:43.296540] [INFO ] [MAIN ] AYI: Loaded 24967 existing records. [2025-10-16T17:26:43.454675] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:26:43.502365] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-16T17:26:43.523476] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-16T17:26:43.550722] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-16T17:26:43.658391] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-16T17:26:43.696077] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:43.699626] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-16T17:26:43.757803] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:26:43.804048] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-16T17:26:43.817174] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-16T17:26:43.908127] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:26:43.901704] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-16T17:26:43.929496] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-16T17:26:43.929631] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-16T17:26:43.976196] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-16T17:26:44.108221] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-16T17:26:44.165242] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-16T17:26:44.535282] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:44.572136] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-16T17:26:44.903717] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:44.932382] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-16T17:26:44.963851] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:44.964547] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-16T17:26:45.126300] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T17:26:45.134057] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-16T17:26:45.725891] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T17:26:45.729729] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-16T17:26:45.803766] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T17:26:45.808301] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-16T17:26:45.885994] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T17:26:45.891213] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-16T17:26:45.969398] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T17:26:46.256221] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-16T17:26:46.342811] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-16T17:26:46.554874] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:26:46.555222] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-16T17:26:46.555359] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:26:46.555459] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-16T17:26:46.555524] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:26:46.555601] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-16T17:26:46.555720] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-16T17:26:46.555802] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-16T17:26:46.555889] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-16T17:26:46.555951] [INFO ] [MAIN ] Update Progress: 201/2369 symbols completed. B took 4.4s. Estimated remaining: 4h 48m 9s. Rate: 7.5 symbols/min [2025-10-16T17:26:46.737633] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:26:46.789075] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-16T17:26:46.789396] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-16T17:26:46.967262] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:26:46.977814] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-16T17:26:46.978366] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-16T17:26:46.978799] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T17:26:46.982694] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-16T17:26:46.983410] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-16T17:26:47.147130] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-16T17:26:47.379867] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:47.381730] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T17:26:47.692506] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T17:26:47.942812] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-16T17:26:48.742856] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-16T17:26:49.542785] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-16T17:26:49.790742] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-16T17:26:50.342838] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-16T17:26:51.142841] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-16T17:26:51.810911] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T17:26:51.945462] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-16T17:26:51.947901] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-16T17:26:52.098603] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T17:26:52.243014] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (4.30 seconds). [2025-10-16T17:26:52.742823] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-16T17:26:53.098235] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T17:26:53.542789] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-16T17:26:53.585832] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-16T17:26:54.349792] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-16T17:26:54.353584] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T17:26:55.142808] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-16T17:26:55.942886] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-16T17:26:56.525565] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T17:26:56.653291] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T17:26:56.697327] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-16T17:26:56.742796] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-16T17:26:57.542867] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-16T17:26:58.342785] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-16T17:26:58.670784] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T17:26:59.062313] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-16T17:26:59.142838] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-16T17:26:59.362637] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T17:26:59.942820] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-16T17:27:00.742858] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-16T17:27:01.350181] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T17:27:01.542837] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-16T17:27:01.811403] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-16T17:27:02.283192] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T17:27:02.342836] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-16T17:27:02.457626] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T17:27:03.142835] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-16T17:27:03.942773] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-16T17:27:04.331111] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T17:27:04.682100] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-16T17:27:04.739212] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-16T17:27:04.742763] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-16T17:27:05.469384] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-16T17:27:05.542827] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-16T17:27:06.322793] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T17:27:06.342809] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-16T17:27:07.142793] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-16T17:27:07.267246] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T17:27:07.942838] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-16T17:27:08.096296] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T17:27:08.742835] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-16T17:27:09.542818] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-16T17:27:09.752199] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-16T17:27:09.756019] [INFO ] [REMOTE ] AYI: Full fetch complete (37024 records). [2025-10-16T17:27:09.756173] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-16T17:27:10.156536] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-16T17:27:10.156625] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-16T17:27:10.157223] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-16T17:27:10.157278] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-16T17:27:10.158317] [DEBUG] [LOCAL ] AYI: Trimmed 37024 records to 25059 (keeping 200 days of data) [2025-10-16T17:27:10.315307] [DEBUG] [LOCAL ] AYI: Primary data saved (25059 records). [2025-10-16T17:27:10.315466] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-16T17:27:10.315555] [INFO ] [MAIN ] Update Progress: 202/2369 symbols completed. AYI took 28.2s. Estimated remaining: 4h 50m 50s. Rate: 7.5 symbols/min [2025-10-16T17:27:10.359134] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-16T17:27:10.495061] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:27:10.501495] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T17:27:10.504553] [INFO ] [REMOTE ] AZO: Full fetch complete (15947 records). [2025-10-16T17:27:10.504694] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-16T17:27:10.878966] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-16T17:27:10.903116] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-16T17:27:10.915358] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.97 seconds). [2025-10-16T17:27:11.104262] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-16T17:27:11.104431] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-16T17:27:11.104949] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-16T17:27:11.105105] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-16T17:27:11.127109] [DEBUG] [LOCAL ] AZO: Trimmed 15947 records to 11071 (keeping 200 days of data) [2025-10-16T17:27:11.154624] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-16T17:27:11.188004] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:27:11.216987] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-16T17:27:11.237818] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-16T17:27:11.239899] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-16T17:27:11.242949] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-16T17:27:11.553175] [DEBUG] [LOCAL ] AZO: Primary data saved (11071 records). [2025-10-16T17:27:11.568842] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-16T17:27:11.569342] [INFO ] [MAIN ] Update Progress: 203/2369 symbols completed. AZO took 29.4s. Estimated remaining: 4h 49m 29s. Rate: 7.5 symbols/min [2025-10-16T17:27:11.693872] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:27:11.768866] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T17:27:11.859858] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:27:11.913220] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-16T17:27:11.913602] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-16T17:27:11.947978] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-16T17:27:12.097924] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:27:12.098130] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-16T17:27:12.098179] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-16T17:27:12.098396] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-16T17:27:12.098435] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-16T17:27:12.465785] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:27:12.742799] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-16T17:27:12.836199] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T17:27:13.542789] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-16T17:27:13.627119] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-16T17:27:14.352543] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T17:27:14.351584] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-16T17:27:15.060348] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-16T17:27:15.142783] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-16T17:27:15.942783] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-16T17:27:16.569406] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T17:27:16.573497] [INFO ] [REMOTE ] AZZ: Full fetch complete (31907 records). [2025-10-16T17:27:16.573585] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-16T17:27:16.755716] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-16T17:27:16.952758] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-16T17:27:16.952841] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-16T17:27:16.953341] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-16T17:27:16.953429] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-16T17:27:16.954251] [DEBUG] [LOCAL ] AZZ: Trimmed 31907 records to 22902 (keeping 200 days of data) [2025-10-16T17:27:17.118084] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-10-16T17:27:17.134007] [DEBUG] [LOCAL ] AZZ: Primary data saved (22902 records). [2025-10-16T17:27:17.134110] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-16T17:27:17.134189] [INFO ] [MAIN ] Update Progress: 204/2369 symbols completed. AZZ took 35.0s. Estimated remaining: 4h 48m 55s. Rate: 7.5 symbols/min [2025-10-16T17:27:17.304138] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:27:17.355364] [DEBUG] [LOCAL ] BAH: Loaded 51719 existing records from primary storage. [2025-10-16T17:27:17.355747] [INFO ] [MAIN ] BAH: Loaded 51719 existing records. [2025-10-16T17:27:17.526099] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:27:17.526343] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-16T17:27:17.526411] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-16T17:27:17.526615] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-16T17:27:17.526692] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-16T17:27:17.557246] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-16T17:27:17.872037] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:27:18.348037] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-16T17:27:18.364228] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-16T17:27:19.034093] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-16T17:27:19.142818] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-16T17:27:19.735503] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-16T17:27:19.942805] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-16T17:27:20.176992] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T17:27:20.742890] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-16T17:27:20.950508] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T17:27:21.542818] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-16T17:27:22.328479] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-16T17:27:22.342770] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-16T17:27:22.478415] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T17:27:23.142825] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-16T17:27:23.599621] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-16T17:27:23.942857] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-16T17:27:24.549457] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T17:27:24.742868] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-16T17:27:24.962741] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-16T17:27:25.542909] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-16T17:27:26.342890] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-16T17:27:26.412881] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-16T17:27:26.876955] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-16T17:27:26.920963] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T17:27:26.950911] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-16T17:27:26.957946] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-16T17:27:26.958092] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-16T17:27:27.143106] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-16T17:27:27.362598] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-16T17:27:27.362711] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-16T17:27:27.363526] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-16T17:27:27.363569] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-16T17:27:27.365048] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 54180 (keeping 200 days of data) [2025-10-16T17:27:27.685869] [DEBUG] [LOCAL ] BA: Primary data saved (54180 records). [2025-10-16T17:27:27.685997] [INFO ] [MAIN ] BA: Full history saved. [2025-10-16T17:27:27.686590] [INFO ] [MAIN ] Update Progress: 205/2369 symbols completed. BA took 41.1s. Estimated remaining: 4h 49m 14s. Rate: 7.5 symbols/min [2025-10-16T17:27:27.858157] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:27:27.897870] [DEBUG] [LOCAL ] BAK: Loaded 39305 existing records from primary storage. [2025-10-16T17:27:27.898137] [INFO ] [MAIN ] BAK: Loaded 39305 existing records. [2025-10-16T17:27:27.952551] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-16T17:27:28.078230] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:27:28.078436] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-16T17:27:28.078482] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-16T17:27:28.078808] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-16T17:27:28.078878] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-16T17:27:28.424528] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:27:28.742901] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-16T17:27:29.542865] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-16T17:27:29.873890] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T17:27:29.992271] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-10-16T17:27:30.342904] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-16T17:27:30.754772] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-16T17:27:31.142800] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-16T17:27:31.268212] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-16T17:27:31.952805] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-16T17:27:31.976815] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T17:27:32.742784] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-16T17:27:33.480611] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-16T17:27:33.542886] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-16T17:27:34.300125] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-16T17:27:34.349854] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-16T17:27:34.364422] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:27:35.142826] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-16T17:27:35.942831] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-16T17:27:36.262839] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-16T17:27:36.522427] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-16T17:27:36.742845] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-16T17:27:36.816091] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T17:27:36.885809] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T17:27:37.542860] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-16T17:27:38.342843] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-16T17:27:38.972683] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-16T17:27:39.142810] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-16T17:27:39.735392] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T17:27:39.840961] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-16T17:27:39.942861] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-16T17:27:40.742856] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-16T17:27:41.228632] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-16T17:27:41.542889] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-16T17:27:41.769938] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T17:27:42.342873] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-16T17:27:43.101462] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T17:27:43.142797] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-16T17:27:43.413882] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-16T17:27:43.833827] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:27:43.942856] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-16T17:27:44.563968] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T17:27:44.742843] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-16T17:27:45.421129] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T17:27:45.542867] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-16T17:27:46.186058] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T17:27:46.342837] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-16T17:27:47.048228] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-16T17:27:47.054892] [INFO ] [REMOTE ] BAH: Full fetch complete (75238 records). [2025-10-16T17:27:47.055015] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-16T17:27:47.150094] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-16T17:27:47.454861] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-16T17:27:47.454967] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-16T17:27:47.456169] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-16T17:27:47.456237] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-16T17:27:47.458183] [DEBUG] [LOCAL ] BAH: Trimmed 75238 records to 52097 (keeping 200 days of data) [2025-10-16T17:27:47.821153] [DEBUG] [LOCAL ] BAH: Primary data saved (52097 records). [2025-10-16T17:27:47.821350] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-16T17:27:47.822263] [INFO ] [MAIN ] Update Progress: 206/2369 symbols completed. BAH took 30.7s. Estimated remaining: 4h 51m 13s. Rate: 7.4 symbols/min [2025-10-16T17:27:47.948006] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-16T17:27:48.010667] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:27:48.080579] [DEBUG] [LOCAL ] BALL: Loaded 51888 existing records from primary storage. [2025-10-16T17:27:48.081092] [INFO ] [MAIN ] BALL: Loaded 51888 existing records. [2025-10-16T17:27:48.277817] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:27:48.278155] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-16T17:27:48.278206] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-16T17:27:48.278735] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-16T17:27:48.278797] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-16T17:27:48.700481] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:27:48.743078] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-16T17:27:48.744984] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-16T17:27:48.755525] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T17:27:48.766310] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-16T17:27:48.766741] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-16T17:27:49.185900] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-16T17:27:49.186024] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-16T17:27:49.187237] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-16T17:27:49.187311] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-16T17:27:49.189585] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 54198 (keeping 200 days of data) [2025-10-16T17:27:49.544737] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-16T17:27:49.558038] [DEBUG] [LOCAL ] BAC: Primary data saved (54198 records). [2025-10-16T17:27:49.558264] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-16T17:27:49.558825] [INFO ] [MAIN ] Update Progress: 207/2369 symbols completed. BAC took 38.0s. Estimated remaining: 4h 49m 59s. Rate: 7.5 symbols/min [2025-10-16T17:27:49.741505] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:27:49.741777] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-16T17:27:49.741825] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-16T17:27:49.741959] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-16T17:27:49.742005] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-16T17:27:49.742046] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-16T17:27:49.742079] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-16T17:27:50.184327] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:27:50.335342] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T17:27:50.345274] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-16T17:27:50.546878] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T17:27:50.651897] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-16T17:27:51.142864] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-16T17:27:51.203560] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-16T17:27:51.942817] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-16T17:27:52.742789] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-16T17:27:53.016521] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T17:27:53.542815] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-16T17:27:53.626635] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T17:27:54.296779] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-16T17:27:54.342776] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-16T17:27:55.151625] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-16T17:27:55.172497] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T17:27:55.942894] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-16T17:27:56.474591] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T17:27:56.742752] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-16T17:27:57.142964] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T17:27:57.165010] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.82 seconds). [2025-10-16T17:27:57.174397] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-16T17:27:57.174553] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-16T17:27:57.542798] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-16T17:27:57.596143] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-16T17:27:57.596280] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-16T17:27:57.597362] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-16T17:27:57.597479] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-16T17:27:57.599242] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 54210 (keeping 200 days of data) [2025-10-16T17:27:57.728573] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T17:27:57.974982] [DEBUG] [LOCAL ] BABA: Primary data saved (54210 records). [2025-10-16T17:27:57.975130] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-16T17:27:57.975211] [INFO ] [MAIN ] Update Progress: 208/2369 symbols completed. BABA took 47.7s. Estimated remaining: 4h 49m 55s. Rate: 7.5 symbols/min [2025-10-16T17:27:58.141318] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:27:58.194560] [DEBUG] [LOCAL ] BAM: Loaded 52107 existing records from primary storage. [2025-10-16T17:27:58.194900] [INFO ] [MAIN ] BAM: Loaded 52107 existing records. [2025-10-16T17:27:58.351021] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-16T17:27:58.381157] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:27:58.381370] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-16T17:27:58.381435] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-16T17:27:58.381813] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-16T17:27:58.381871] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-16T17:27:58.745809] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:27:58.792371] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T17:27:58.798421] [INFO ] [REMOTE ] BAK: Full fetch complete (56952 records). [2025-10-16T17:27:58.798610] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-16T17:27:59.154822] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-16T17:27:59.217556] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-16T17:27:59.214428] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T17:27:59.218029] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-16T17:27:59.219715] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-16T17:27:59.221328] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-16T17:27:59.223606] [DEBUG] [LOCAL ] BAK: Trimmed 56952 records to 39589 (keeping 200 days of data) [2025-10-16T17:27:59.438978] [DEBUG] [LOCAL ] BAK: Primary data saved (39589 records). [2025-10-16T17:27:59.439142] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-16T17:27:59.439223] [INFO ] [MAIN ] Update Progress: 209/2369 symbols completed. BAK took 31.8s. Estimated remaining: 4h 48m 39s. Rate: 7.5 symbols/min [2025-10-16T17:27:59.603557] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:27:59.603758] [DEBUG] [LOCAL ] BANC: No existing data file found in primary storage. [2025-10-16T17:27:59.603803] [WARN ] [MAIN ] BANC: No existing data found, performing full refresh instead. [2025-10-16T17:27:59.603910] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-16T17:27:59.603950] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-16T17:27:59.603990] [DEBUG] [LOCAL ] BANC: No primary data file found to delete. [2025-10-16T17:27:59.604022] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-16T17:27:59.950552] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-16T17:27:59.956792] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:28:00.742797] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-16T17:28:01.055624] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T17:28:01.421939] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T17:28:01.542827] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-16T17:28:02.342848] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-16T17:28:02.552913] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T17:28:02.897022] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T17:28:03.142814] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-16T17:28:03.861906] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T17:28:03.942811] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-16T17:28:04.742856] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-16T17:28:04.875083] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T17:28:05.542825] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-16T17:28:05.660601] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T17:28:06.071241] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T17:28:06.342833] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-16T17:28:07.147006] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-16T17:28:07.149982] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T17:28:07.942877] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-16T17:28:08.033333] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T17:28:08.523867] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T17:28:08.683830] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T17:28:08.742806] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-16T17:28:09.542863] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-16T17:28:10.342890] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-16T17:28:10.476976] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T17:28:11.142821] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-16T17:28:11.275213] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T17:28:11.694962] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T17:28:11.942861] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-16T17:28:12.742805] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-16T17:28:12.902243] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T17:28:13.290153] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T17:28:13.542806] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-16T17:28:14.208084] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T17:28:14.342823] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-16T17:28:14.970483] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-16T17:28:15.142785] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-16T17:28:15.228291] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T17:28:15.942851] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-16T17:28:16.742878] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-16T17:28:16.929605] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T17:28:16.936679] [INFO ] [REMOTE ] BALL: Full fetch complete (75576 records). [2025-10-16T17:28:16.936878] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-16T17:28:17.334953] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-16T17:28:17.335124] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-16T17:28:17.336202] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-16T17:28:17.336287] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-16T17:28:17.337977] [DEBUG] [LOCAL ] BALL: Trimmed 75576 records to 52278 (keeping 200 days of data) [2025-10-16T17:28:17.571719] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-16T17:28:17.584296] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T17:28:17.688107] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T17:28:17.710959] [DEBUG] [LOCAL ] BALL: Primary data saved (52278 records). [2025-10-16T17:28:17.711096] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-16T17:28:17.712043] [INFO ] [MAIN ] Update Progress: 210/2369 symbols completed. BALL took 29.9s. Estimated remaining: 4h 50m 16s. Rate: 7.4 symbols/min [2025-10-16T17:28:17.897930] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:28:17.925799] [DEBUG] [LOCAL ] BAP: Loaded 25781 existing records from primary storage. [2025-10-16T17:28:17.926044] [INFO ] [MAIN ] BAP: Loaded 25781 existing records. [2025-10-16T17:28:18.113300] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:28:18.113503] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-16T17:28:18.113554] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-16T17:28:18.113817] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-16T17:28:18.113873] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-16T17:28:18.352202] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-16T17:28:18.469275] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:28:19.142800] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-16T17:28:19.253585] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T17:28:19.942862] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-16T17:28:20.087731] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T17:28:20.620220] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T17:28:20.742890] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-16T17:28:21.306183] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T17:28:21.542886] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-16T17:28:22.342840] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-16T17:28:22.441614] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T17:28:22.902068] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T17:28:22.923927] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-16T17:28:23.142872] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-16T17:28:23.942860] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-16T17:28:24.586163] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T17:28:24.742849] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-16T17:28:24.876664] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T17:28:25.496491] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T17:28:25.542836] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-16T17:28:26.342863] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-16T17:28:27.142793] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-16T17:28:27.335513] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T17:28:27.364914] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T17:28:27.942852] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-16T17:28:28.742792] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-16T17:28:28.819511] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T17:28:28.821581] [INFO ] [REMOTE ] BALY: Full fetch complete (16390 records). [2025-10-16T17:28:28.821696] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-16T17:28:29.026681] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T17:28:29.027081] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:28:29.027219] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:28:29.027298] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-16T17:28:29.027379] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-16T17:28:29.027437] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-16T17:28:29.027484] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-16T17:28:29.027553] [INFO ] [MAIN ] Update Progress: 211/2369 symbols completed. BALY took 39.5s. Estimated remaining: 4h 50m 41s. Rate: 7.4 symbols/min [2025-10-16T17:28:29.214818] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:28:29.235241] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-16T17:28:29.242525] [INFO ] [REMOTE ] BAM: Full fetch complete (75023 records). [2025-10-16T17:28:29.242753] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-16T17:28:29.525344] [DEBUG] [LOCAL ] BARK: Loaded 38160 existing records from primary storage. [2025-10-16T17:28:29.579003] [INFO ] [MAIN ] BARK: Loaded 38160 existing records. [2025-10-16T17:28:29.557813] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-16T17:28:29.790088] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-16T17:28:29.790563] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-16T17:28:29.812208] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-16T17:28:29.830122] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-16T17:28:29.870503] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:28:29.884599] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-16T17:28:29.884930] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-16T17:28:29.885981] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T17:28:29.890871] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-16T17:28:29.891246] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-16T17:28:29.912304] [DEBUG] [LOCAL ] BAM: Trimmed 75023 records to 52489 (keeping 200 days of data) [2025-10-16T17:28:30.366317] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-16T17:28:30.493016] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:28:30.588072] [DEBUG] [LOCAL ] BAM: Primary data saved (52489 records). [2025-10-16T17:28:30.588204] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-16T17:28:30.588283] [INFO ] [MAIN ] Update Progress: 212/2369 symbols completed. BAM took 32.6s. Estimated remaining: 4h 49m 27s. Rate: 7.5 symbols/min [2025-10-16T17:28:30.752839] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:28:30.802102] [DEBUG] [LOCAL ] BAX: Loaded 53529 existing records from primary storage. [2025-10-16T17:28:30.802402] [INFO ] [MAIN ] BAX: Loaded 53529 existing records. [2025-10-16T17:28:30.976934] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:28:30.977131] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-16T17:28:30.977177] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-16T17:28:30.977611] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-16T17:28:30.977702] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-16T17:28:31.150417] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-16T17:28:31.352706] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:28:31.843386] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T17:28:31.924417] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-16T17:28:31.931462] [INFO ] [REMOTE ] BANC: Full fetch complete (74544 records). [2025-10-16T17:28:31.931630] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-16T17:28:31.952556] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-16T17:28:32.320620] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-16T17:28:32.320789] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-16T17:28:32.321633] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-16T17:28:32.321809] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-16T17:28:32.323594] [DEBUG] [LOCAL ] BANC: Trimmed 74544 records to 51734 (keeping 200 days of data) [2025-10-16T17:28:32.348791] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T17:28:32.664024] [DEBUG] [LOCAL ] BANC: Primary data saved (51734 records). [2025-10-16T17:28:32.664191] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-16T17:28:32.664285] [INFO ] [MAIN ] Update Progress: 213/2369 symbols completed. BANC took 33.2s. Estimated remaining: 4h 48m 18s. Rate: 7.5 symbols/min [2025-10-16T17:28:32.747939] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-16T17:28:32.835735] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:28:32.882999] [DEBUG] [LOCAL ] BB: Loaded 52914 existing records from primary storage. [2025-10-16T17:28:32.883325] [INFO ] [MAIN ] BB: Loaded 52914 existing records. [2025-10-16T17:28:33.059721] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:28:33.059976] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-16T17:28:33.060024] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-16T17:28:33.060330] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-16T17:28:33.060369] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-16T17:28:33.423556] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:28:33.440983] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T17:28:33.542799] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-16T17:28:34.291184] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T17:28:34.342891] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-16T17:28:35.142837] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-16T17:28:35.728875] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-16T17:28:35.845019] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T17:28:35.942870] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-16T17:28:36.026041] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T17:28:36.742839] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-16T17:28:37.194266] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T17:28:37.542786] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-16T17:28:37.846230] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T17:28:38.342810] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-16T17:28:39.142786] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-16T17:28:39.552559] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T17:28:39.942857] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-16T17:28:40.021279] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T17:28:40.148521] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T17:28:40.742802] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-16T17:28:40.799987] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T17:28:41.542826] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-16T17:28:42.342814] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-16T17:28:42.506398] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-16T17:28:42.938440] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-16T17:28:43.142893] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-16T17:28:43.756736] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T17:28:43.942844] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-16T17:28:44.742839] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-16T17:28:45.031000] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T17:28:45.076322] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-16T17:28:45.542814] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-16T17:28:46.342793] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-16T17:28:46.750321] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T17:28:47.006500] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T17:28:47.142864] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-16T17:28:47.826845] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T17:28:47.942802] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-16T17:28:48.742857] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-16T17:28:49.050616] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-16T17:28:49.267208] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T17:28:49.542914] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-16T17:28:49.688217] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T17:28:50.342894] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-16T17:28:50.936730] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T17:28:51.142885] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-16T17:28:51.531236] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T17:28:51.536119] [INFO ] [REMOTE ] BAP: Full fetch complete (37481 records). [2025-10-16T17:28:51.536230] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-16T17:28:51.913553] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-16T17:28:51.913665] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-16T17:28:51.914150] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-16T17:28:51.914192] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-16T17:28:51.915002] [DEBUG] [LOCAL ] BAP: Trimmed 37481 records to 25985 (keeping 200 days of data) [2025-10-16T17:28:51.967616] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-16T17:28:52.079318] [DEBUG] [LOCAL ] BAP: Primary data saved (25985 records). [2025-10-16T17:28:52.079475] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-16T17:28:52.079560] [INFO ] [MAIN ] Update Progress: 214/2369 symbols completed. BAP took 34.4s. Estimated remaining: 4h 50m 5s. Rate: 7.4 symbols/min [2025-10-16T17:28:52.250778] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:28:52.307008] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-16T17:28:52.307373] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-16T17:28:52.482258] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:28:52.482459] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-16T17:28:52.482506] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-16T17:28:52.482755] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-16T17:28:52.482811] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-16T17:28:52.748742] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-16T17:28:52.841081] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:28:53.211901] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-16T17:28:53.542867] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-16T17:28:53.851088] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T17:28:54.128393] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T17:28:54.342831] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-16T17:28:55.142862] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-16T17:28:55.579277] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-16T17:28:55.942870] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-16T17:28:56.560982] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T17:28:56.742799] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-16T17:28:57.092534] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-10-16T17:28:57.542881] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-16T17:28:57.769915] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T17:28:58.342881] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-16T17:28:58.714017] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T17:28:59.142855] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-16T17:28:59.947924] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-16T17:28:59.967149] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T17:29:00.022762] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-16T17:29:00.347373] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T17:29:00.352518] [INFO ] [REMOTE ] BARK: Full fetch complete (56259 records). [2025-10-16T17:29:00.352720] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-16T17:29:00.734917] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-16T17:29:00.735002] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-16T17:29:00.735688] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-16T17:29:00.735750] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-16T17:29:00.737007] [DEBUG] [LOCAL ] BARK: Trimmed 56259 records to 38444 (keeping 200 days of data) [2025-10-16T17:29:00.782948] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-16T17:29:00.968929] [DEBUG] [LOCAL ] BARK: Primary data saved (38444 records). [2025-10-16T17:29:00.969117] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-16T17:29:00.969637] [INFO ] [MAIN ] Update Progress: 215/2369 symbols completed. BARK took 31.9s. Estimated remaining: 4h 50m 5s. Rate: 7.4 symbols/min [2025-10-16T17:29:01.134351] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:01.175875] [DEBUG] [LOCAL ] BBAR: Loaded 42354 existing records from primary storage. [2025-10-16T17:29:01.176153] [INFO ] [MAIN ] BBAR: Loaded 42354 existing records. [2025-10-16T17:29:01.349381] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:29:01.349618] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-16T17:29:01.349693] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-16T17:29:01.349893] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-16T17:29:01.349932] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-16T17:29:01.551093] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-16T17:29:01.718793] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:01.889637] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-16T17:29:02.342817] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-16T17:29:03.142901] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-16T17:29:03.365019] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-16T17:29:03.381152] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T17:29:03.942849] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-16T17:29:04.491046] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-16T17:29:04.500894] [INFO ] [REMOTE ] BB: Full fetch complete (77004 records). [2025-10-16T17:29:04.501063] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-16T17:29:04.754159] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-16T17:29:04.935868] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-16T17:29:04.936051] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-16T17:29:04.936942] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-16T17:29:04.937140] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-16T17:29:04.961686] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-16T17:29:04.970229] [DEBUG] [LOCAL ] BB: Trimmed 77004 records to 53298 (keeping 200 days of data) [2025-10-16T17:29:05.268979] [DEBUG] [LOCAL ] BB: Primary data saved (53298 records). [2025-10-16T17:29:05.269133] [INFO ] [MAIN ] BB: Full history saved. [2025-10-16T17:29:05.269774] [INFO ] [MAIN ] Update Progress: 216/2369 symbols completed. BB took 32.6s. Estimated remaining: 4h 49m 19s. Rate: 7.4 symbols/min [2025-10-16T17:29:05.440159] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:05.494514] [DEBUG] [LOCAL ] BBD: Loaded 53260 existing records from primary storage. [2025-10-16T17:29:05.494849] [INFO ] [MAIN ] BBD: Loaded 53260 existing records. [2025-10-16T17:29:05.559351] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-16T17:29:05.674535] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:29:05.674766] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-16T17:29:05.674819] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-16T17:29:05.675184] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-16T17:29:05.675243] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-16T17:29:06.025984] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:06.256360] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-16T17:29:06.342822] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-16T17:29:06.652072] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T17:29:06.832197] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T17:29:07.142807] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-16T17:29:07.942889] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-16T17:29:08.625445] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T17:29:08.745462] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-16T17:29:08.748732] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-16T17:29:09.418861] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T17:29:09.542849] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-16T17:29:10.245516] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T17:29:10.342819] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-16T17:29:11.142819] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-16T17:29:11.453783] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-16T17:29:11.882049] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T17:29:11.942810] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-16T17:29:12.742774] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-16T17:29:12.830358] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T17:29:12.837337] [INFO ] [REMOTE ] BAX: Full fetch complete (77613 records). [2025-10-16T17:29:12.837453] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-16T17:29:13.242575] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-16T17:29:13.242715] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-16T17:29:13.243711] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-16T17:29:13.243794] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-16T17:29:13.267175] [DEBUG] [LOCAL ] BAX: Trimmed 77613 records to 53919 (keeping 200 days of data) [2025-10-16T17:29:13.269086] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T17:29:13.549757] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-16T17:29:13.598292] [DEBUG] [LOCAL ] BAX: Primary data saved (53919 records). [2025-10-16T17:29:13.598395] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-16T17:29:13.598467] [INFO ] [MAIN ] Update Progress: 217/2369 symbols completed. BAX took 43.0s. Estimated remaining: 4h 49m 14s. Rate: 7.4 symbols/min [2025-10-16T17:29:13.767162] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:13.797455] [DEBUG] [LOCAL ] BBDC: Loaded 33095 existing records from primary storage. [2025-10-16T17:29:13.797764] [INFO ] [MAIN ] BBDC: Loaded 33095 existing records. [2025-10-16T17:29:13.970356] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:29:13.970573] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-16T17:29:13.970623] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-16T17:29:13.970835] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-16T17:29:13.970882] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-16T17:29:14.341224] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:14.351735] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-16T17:29:14.372741] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T17:29:14.827257] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T17:29:15.142862] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-16T17:29:15.920969] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T17:29:15.942769] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-16T17:29:16.451757] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T17:29:16.742812] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-16T17:29:17.285787] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T17:29:17.542814] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-16T17:29:17.980526] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T17:29:18.342821] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-16T17:29:18.419081] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T17:29:19.142828] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-16T17:29:19.942778] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-16T17:29:20.136708] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T17:29:20.273402] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T17:29:20.742884] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-16T17:29:20.831517] [DEBUG] [REMOTE ] BBDC: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-16T17:29:20.831874] [WARN ] [REMOTE ] BBDC: No data returned for month 2025-04 [2025-10-16T17:29:20.831963] [FATAL] [REMOTE ] BBDC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:29:20.832058] [FATAL] [MAIN ] BBDC: Failed to fetch primary data. [2025-10-16T17:29:20.832127] [WARN ] [MAIN ] BBDC: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:29:20.832199] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-16T17:29:20.832299] [DEBUG] [LOCAL ] BBDC: No primary data file found to delete. [2025-10-16T17:29:20.832342] [INFO ] [LOCAL ] BBDC: Starting deletion of derivative data. [2025-10-16T17:29:20.832483] [DEBUG] [LOCAL ] BBDC: Deleted derivative data file. [2025-10-16T17:29:20.832564] [INFO ] [MAIN ] Update Progress: 218/2369 symbols completed. BBDC took 7.2s. Estimated remaining: 4h 48m 58s. Rate: 7.4 symbols/min [2025-10-16T17:29:21.018486] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:21.025316] [DEBUG] [LOCAL ] BBDO: Loaded 5027 existing records from primary storage. [2025-10-16T17:29:21.025505] [INFO ] [MAIN ] BBDO: Loaded 5027 existing records. [2025-10-16T17:29:21.227846] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:29:21.228280] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-16T17:29:21.228357] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-16T17:29:21.236782] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-16T17:29:21.251428] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-16T17:29:21.286486] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T17:29:21.547994] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-16T17:29:21.639149] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:22.342896] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-16T17:29:23.151211] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-16T17:29:23.157402] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T17:29:23.294258] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T17:29:23.942864] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-16T17:29:24.742886] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-16T17:29:25.350440] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T17:29:25.467892] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T17:29:25.525042] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-16T17:29:25.542764] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-16T17:29:26.342826] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-16T17:29:27.142856] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-16T17:29:27.858517] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-16T17:29:27.942841] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-16T17:29:28.026386] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T17:29:28.033321] [INFO ] [REMOTE ] BBAR: Full fetch complete (61319 records). [2025-10-16T17:29:28.033501] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-16T17:29:28.455426] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-16T17:29:28.455535] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-16T17:29:28.456362] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-16T17:29:28.456559] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-16T17:29:28.458245] [DEBUG] [LOCAL ] BBAR: Trimmed 61319 records to 42696 (keeping 200 days of data) [2025-10-16T17:29:28.577624] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T17:29:28.748580] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-16T17:29:28.756516] [DEBUG] [LOCAL ] BBAR: Primary data saved (42696 records). [2025-10-16T17:29:28.757529] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-16T17:29:28.757924] [INFO ] [MAIN ] Update Progress: 219/2369 symbols completed. BBAR took 27.8s. Estimated remaining: 4h 48m 48s. Rate: 7.4 symbols/min [2025-10-16T17:29:28.926615] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:28.926811] [DEBUG] [LOCAL ] BBN: No existing data file found in primary storage. [2025-10-16T17:29:28.926853] [WARN ] [MAIN ] BBN: No existing data found, performing full refresh instead. [2025-10-16T17:29:28.926959] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-16T17:29:28.926999] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-16T17:29:28.927039] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-16T17:29:28.927095] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-16T17:29:29.274508] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:29.542832] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-16T17:29:30.121998] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T17:29:30.342880] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-16T17:29:30.452427] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T17:29:30.528621] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-16T17:29:30.756458] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-16T17:29:31.142826] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-16T17:29:31.942786] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-16T17:29:32.593146] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T17:29:32.742821] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-16T17:29:33.233546] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-16T17:29:33.542878] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-16T17:29:34.342853] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-16T17:29:34.525158] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T17:29:34.644854] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T17:29:35.142780] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-16T17:29:35.257118] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T17:29:35.942833] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-16T17:29:36.742788] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-16T17:29:36.972783] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T17:29:37.409207] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T17:29:37.542849] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-16T17:29:38.342846] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-16T17:29:38.440367] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-16T17:29:38.877174] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-10-16T17:29:38.944193] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T17:29:39.142822] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-16T17:29:39.942873] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-16T17:29:40.632371] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T17:29:40.639290] [INFO ] [REMOTE ] BBD: Full fetch complete (77277 records). [2025-10-16T17:29:40.639419] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-16T17:29:40.747999] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-16T17:29:41.035004] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-16T17:29:41.035112] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-16T17:29:41.035993] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-16T17:29:41.036060] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-16T17:29:41.037632] [DEBUG] [LOCAL ] BBD: Trimmed 77277 records to 53650 (keeping 200 days of data) [2025-10-16T17:29:41.353265] [DEBUG] [LOCAL ] BBD: Primary data saved (53650 records). [2025-10-16T17:29:41.353490] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-16T17:29:41.354064] [INFO ] [MAIN ] Update Progress: 220/2369 symbols completed. BBD took 36.1s. Estimated remaining: 4h 49m 25s. Rate: 7.4 symbols/min [2025-10-16T17:29:41.508971] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T17:29:41.525284] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:41.527309] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-16T17:29:41.527352] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-16T17:29:41.527455] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-16T17:29:41.527495] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-16T17:29:41.527536] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-16T17:29:41.527567] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-16T17:29:41.547887] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-16T17:29:41.876916] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:42.115792] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T17:29:42.342786] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-16T17:29:42.583592] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-16T17:29:43.109402] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T17:29:43.142786] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-16T17:29:43.942919] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-16T17:29:44.131320] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:29:44.131746] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-16T17:29:44.131853] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:29:44.131944] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-16T17:29:44.132027] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:29:44.132119] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-16T17:29:44.132223] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-16T17:29:44.132277] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-16T17:29:44.132321] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-16T17:29:44.132366] [INFO ] [MAIN ] Update Progress: 221/2369 symbols completed. BBT took 2.8s. Estimated remaining: 4h 48m 25s. Rate: 7.4 symbols/min [2025-10-16T17:29:44.318407] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:44.318622] [DEBUG] [LOCAL ] BBU: No existing data file found in primary storage. [2025-10-16T17:29:44.318699] [WARN ] [MAIN ] BBU: No existing data found, performing full refresh instead. [2025-10-16T17:29:44.318822] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-16T17:29:44.318879] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-16T17:29:44.318988] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-16T17:29:44.319046] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-16T17:29:44.704792] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:44.742844] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-16T17:29:45.407074] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-16T17:29:45.542845] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-16T17:29:46.024273] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.88 seconds). [2025-10-16T17:29:46.031272] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-16T17:29:46.031417] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-16T17:29:46.344165] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-16T17:29:46.431037] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-16T17:29:46.459170] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-16T17:29:46.460712] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-16T17:29:46.461661] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-16T17:29:46.461734] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-16T17:29:46.463348] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 54210 (keeping 200 days of data) [2025-10-16T17:29:46.769476] [DEBUG] [LOCAL ] BBAI: Primary data saved (54210 records). [2025-10-16T17:29:46.769604] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-16T17:29:46.770566] [INFO ] [MAIN ] Update Progress: 222/2369 symbols completed. BBAI took 54.7s. Estimated remaining: 4h 47m 25s. Rate: 7.5 symbols/min [2025-10-16T17:29:46.937094] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:46.937243] [DEBUG] [LOCAL ] BBUC: No existing data file found in primary storage. [2025-10-16T17:29:46.937281] [WARN ] [MAIN ] BBUC: No existing data found, performing full refresh instead. [2025-10-16T17:29:46.937390] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-16T17:29:46.937448] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-16T17:29:46.937491] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-10-16T17:29:46.937525] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-16T17:29:47.149719] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-16T17:29:47.226090] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T17:29:47.319279] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:47.942866] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-16T17:29:48.228902] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T17:29:48.355326] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-16T17:29:48.742825] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-16T17:29:49.542794] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-16T17:29:49.790912] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-16T17:29:50.342829] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-16T17:29:50.401742] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-16T17:29:51.142876] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-16T17:29:51.366899] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-16T17:29:51.942892] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-16T17:29:51.997223] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T17:29:52.524160] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T17:29:52.742867] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-16T17:29:53.542827] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-16T17:29:53.715194] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T17:29:53.716739] [INFO ] [REMOTE ] BBDO: Full fetch complete (7489 records). [2025-10-16T17:29:53.716836] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-16T17:29:54.107017] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-16T17:29:54.107109] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-16T17:29:54.107318] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-16T17:29:54.107358] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-16T17:29:54.107871] [DEBUG] [LOCAL ] BBDO: Trimmed 7489 records to 5066 (keeping 200 days of data) [2025-10-16T17:29:54.137459] [DEBUG] [LOCAL ] BBDO: Primary data saved (5066 records). [2025-10-16T17:29:54.137602] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-16T17:29:54.137703] [INFO ] [MAIN ] Update Progress: 223/2369 symbols completed. BBDO took 33.3s. Estimated remaining: 4h 47m 10s. Rate: 7.5 symbols/min [2025-10-16T17:29:54.309028] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:54.352535] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-16T17:29:54.355474] [DEBUG] [LOCAL ] BBVA: Loaded 49092 existing records from primary storage. [2025-10-16T17:29:54.355884] [INFO ] [MAIN ] BBVA: Loaded 49092 existing records. [2025-10-16T17:29:54.533254] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:29:54.533444] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-16T17:29:54.533490] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-16T17:29:54.533921] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-16T17:29:54.533988] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-16T17:29:54.717313] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-16T17:29:54.911292] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:54.982927] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-16T17:29:55.142785] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-16T17:29:55.942886] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-16T17:29:56.714542] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T17:29:56.742797] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-16T17:29:56.994705] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T17:29:57.508522] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T17:29:57.542822] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-16T17:29:58.342835] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-16T17:29:58.636633] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T17:29:58.639165] [INFO ] [REMOTE ] BBN: Full fetch complete (25527 records). [2025-10-16T17:29:58.639243] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-16T17:29:58.994858] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-16T17:29:58.994957] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-16T17:29:58.995377] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-16T17:29:58.995437] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-16T17:29:58.996449] [DEBUG] [LOCAL ] BBN: Trimmed 25527 records to 18148 (keeping 200 days of data) [2025-10-16T17:29:59.104214] [DEBUG] [LOCAL ] BBN: Primary data saved (18148 records). [2025-10-16T17:29:59.104349] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-16T17:29:59.104418] [INFO ] [MAIN ] Update Progress: 224/2369 symbols completed. BBN took 30.3s. Estimated remaining: 4h 46m 33s. Rate: 7.5 symbols/min [2025-10-16T17:29:59.148046] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-16T17:29:59.273665] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:59.273921] [DEBUG] [LOCAL ] BBW: No existing data file found in primary storage. [2025-10-16T17:29:59.273974] [WARN ] [MAIN ] BBW: No existing data found, performing full refresh instead. [2025-10-16T17:29:59.274142] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-16T17:29:59.274265] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-16T17:29:59.274321] [DEBUG] [LOCAL ] BBW: No primary data file found to delete. [2025-10-16T17:29:59.274354] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-16T17:29:59.480593] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T17:29:59.664407] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:59.942789] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-16T17:30:00.566602] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-16T17:30:00.742783] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-16T17:30:00.850870] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T17:30:01.542795] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-16T17:30:01.599006] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T17:30:02.342836] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-16T17:30:03.142835] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-16T17:30:03.250486] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T17:30:03.286082] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T17:30:03.689925] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-16T17:30:03.942808] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-16T17:30:04.742816] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-16T17:30:04.768207] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T17:30:05.542832] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-16T17:30:06.342794] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-16T17:30:06.404726] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T17:30:06.513152] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-16T17:30:07.142854] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-16T17:30:07.270536] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T17:30:07.603017] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-16T17:30:07.942899] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-16T17:30:08.443284] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-16T17:30:08.742827] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-16T17:30:09.374771] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T17:30:09.542835] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-16T17:30:10.342847] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-16T17:30:10.439090] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T17:30:11.142865] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-16T17:30:11.880814] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-16T17:30:11.942807] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-16T17:30:12.026723] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T17:30:12.617292] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-16T17:30:12.742837] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-16T17:30:13.542820] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-16T17:30:13.759077] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T17:30:13.762291] [INFO ] [REMOTE ] BBUC: Full fetch complete (19033 records). [2025-10-16T17:30:13.762389] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-16T17:30:14.129515] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-16T17:30:14.129601] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-16T17:30:14.129991] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-16T17:30:14.130053] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-16T17:30:14.130633] [DEBUG] [LOCAL ] BBUC: Trimmed 19033 records to 13949 (keeping 200 days of data) [2025-10-16T17:30:14.214467] [DEBUG] [LOCAL ] BBUC: Primary data saved (13949 records). [2025-10-16T17:30:14.214670] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-16T17:30:14.214765] [INFO ] [MAIN ] Update Progress: 225/2369 symbols completed. BBUC took 27.4s. Estimated remaining: 4h 47m 32s. Rate: 7.5 symbols/min [2025-10-16T17:30:14.355507] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-16T17:30:14.392534] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:30:14.453959] [DEBUG] [LOCAL ] BBWI: Loaded 53584 existing records from primary storage. [2025-10-16T17:30:14.454284] [INFO ] [MAIN ] BBWI: Loaded 53584 existing records. [2025-10-16T17:30:14.594847] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T17:30:14.622795] [INFO ] [REMOTE ] BBU: Full fetch complete (7334 records). [2025-10-16T17:30:14.642298] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-16T17:30:14.661570] [FATAL] [VALIDATOR ] BBU: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:30:14.685518] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:30:14.685602] [FATAL] [MAIN ] BBU: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:30:14.685790] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-16T17:30:14.685918] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-16T17:30:14.685841] [WARN ] [MAIN ] BBU: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:30:14.686076] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-16T17:30:14.686143] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-16T17:30:14.686181] [INFO ] [LOCAL ] BBU: Starting deletion of derivative data. [2025-10-16T17:30:14.686219] [DEBUG] [LOCAL ] BBU: No derivative data file found to delete. [2025-10-16T17:30:14.686247] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-16T17:30:14.686350] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-16T17:30:14.686451] [INFO ] [MAIN ] Update Progress: 226/2369 symbols completed. BBU took 30.6s. Estimated remaining: 4h 46m 12s. Rate: 7.5 symbols/min [2025-10-16T17:30:15.030032] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:30:15.144372] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-16T17:30:15.234498] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:30:15.268878] [DEBUG] [LOCAL ] BBY: Loaded 53445 existing records from primary storage. [2025-10-16T17:30:15.269230] [INFO ] [MAIN ] BBY: Loaded 53445 existing records. [2025-10-16T17:30:15.444162] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:30:15.444368] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-16T17:30:15.444414] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-16T17:30:15.444673] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-16T17:30:15.444732] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-16T17:30:15.793832] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:30:15.906251] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T17:30:15.942771] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-16T17:30:16.662559] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T17:30:16.742827] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-16T17:30:17.547897] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-16T17:30:17.565898] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T17:30:17.892123] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T17:30:18.342821] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-16T17:30:19.012139] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T17:30:19.142836] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-16T17:30:19.664361] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T17:30:19.942886] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-16T17:30:20.298769] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-16T17:30:20.742819] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-16T17:30:20.762222] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T17:30:21.542869] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-16T17:30:22.342854] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-16T17:30:22.814606] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-16T17:30:23.142853] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-16T17:30:23.409004] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T17:30:23.957291] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-16T17:30:23.968259] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T17:30:24.742853] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-16T17:30:24.810905] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T17:30:25.542865] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-16T17:30:25.647838] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T17:30:26.342862] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-16T17:30:26.475026] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T17:30:27.142828] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-16T17:30:27.232477] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T17:30:27.942829] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-16T17:30:27.994437] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T17:30:28.259426] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T17:30:28.742837] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-16T17:30:29.542839] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-16T17:30:29.684560] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T17:30:29.863459] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-16T17:30:30.342817] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-16T17:30:31.099245] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T17:30:31.142829] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-16T17:30:31.942805] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-16T17:30:32.053897] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T17:30:32.742819] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-16T17:30:32.929943] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T17:30:33.542793] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-16T17:30:33.628727] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T17:30:34.342834] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-16T17:30:34.561166] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T17:30:34.567757] [INFO ] [REMOTE ] BBVA: Full fetch complete (71777 records). [2025-10-16T17:30:34.567928] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-16T17:30:34.955491] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-16T17:30:34.955586] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-16T17:30:34.956369] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-16T17:30:34.956434] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-16T17:30:34.957866] [DEBUG] [LOCAL ] BBVA: Trimmed 71777 records to 49475 (keeping 200 days of data) [2025-10-16T17:30:35.159595] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-16T17:30:35.271035] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T17:30:35.300048] [DEBUG] [LOCAL ] BBVA: Primary data saved (49475 records). [2025-10-16T17:30:35.300196] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-16T17:30:35.300306] [INFO ] [MAIN ] Update Progress: 227/2369 symbols completed. BBVA took 41.2s. Estimated remaining: 4h 48m 3s. Rate: 7.4 symbols/min [2025-10-16T17:30:35.469911] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:30:35.508765] [DEBUG] [LOCAL ] BC: Loaded 44083 existing records from primary storage. [2025-10-16T17:30:35.509126] [INFO ] [MAIN ] BC: Loaded 44083 existing records. [2025-10-16T17:30:35.700530] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T17:30:35.705134] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:30:35.710698] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-16T17:30:35.711206] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-16T17:30:35.711742] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-16T17:30:35.711811] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-16T17:30:35.948063] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-16T17:30:36.065584] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:30:36.742848] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-16T17:30:36.796042] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T17:30:37.297552] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T17:30:37.542909] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-16T17:30:38.251027] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T17:30:38.342846] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-16T17:30:39.142876] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-16T17:30:39.365336] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T17:30:39.702875] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T17:30:39.942858] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-16T17:30:40.736340] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T17:30:40.747589] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-16T17:30:41.475666] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T17:30:41.542831] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-16T17:30:42.342830] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-16T17:30:42.567979] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T17:30:42.717076] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T17:30:42.722689] [INFO ] [REMOTE ] BBW: Full fetch complete (39791 records). [2025-10-16T17:30:42.722847] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-16T17:30:43.139870] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-16T17:30:43.140008] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-16T17:30:43.140865] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-16T17:30:43.140937] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-16T17:30:43.142419] [DEBUG] [LOCAL ] BBW: Trimmed 39791 records to 27636 (keeping 200 days of data) [2025-10-16T17:30:43.142996] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-16T17:30:43.310883] [DEBUG] [LOCAL ] BBW: Primary data saved (27636 records). [2025-10-16T17:30:43.311035] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-16T17:30:43.311112] [INFO ] [MAIN ] Update Progress: 228/2369 symbols completed. BBW took 44.2s. Estimated remaining: 4h 47m 55s. Rate: 7.4 symbols/min [2025-10-16T17:30:43.475359] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:30:43.510993] [DEBUG] [LOCAL ] BCAT: Loaded 34198 existing records from primary storage. [2025-10-16T17:30:43.511299] [INFO ] [MAIN ] BCAT: Loaded 34198 existing records. [2025-10-16T17:30:43.688393] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:30:43.688772] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-16T17:30:43.689017] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-16T17:30:43.689281] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-16T17:30:43.689449] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-16T17:30:43.947931] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-16T17:30:44.060948] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T17:30:44.086149] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:30:44.742790] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-16T17:30:45.166587] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-16T17:30:45.542873] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-16T17:30:45.573871] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T17:30:45.839899] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T17:30:46.342826] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-16T17:30:47.142816] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-16T17:30:47.269690] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T17:30:47.276595] [INFO ] [REMOTE ] BBWI: Full fetch complete (77626 records). [2025-10-16T17:30:47.276749] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-16T17:30:47.671416] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-16T17:30:47.671566] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-16T17:30:47.672439] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-16T17:30:47.672552] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-16T17:30:47.674029] [DEBUG] [LOCAL ] BBWI: Trimmed 77626 records to 53974 (keeping 200 days of data) [2025-10-16T17:30:47.914364] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T17:30:47.944445] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-16T17:30:48.039023] [DEBUG] [LOCAL ] BBWI: Primary data saved (53974 records). [2025-10-16T17:30:48.039187] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-16T17:30:48.040052] [INFO ] [MAIN ] Update Progress: 229/2369 symbols completed. BBWI took 33.8s. Estimated remaining: 4h 47m 15s. Rate: 7.4 symbols/min [2025-10-16T17:30:48.206106] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:30:48.236769] [DEBUG] [LOCAL ] BCC: Loaded 28504 existing records from primary storage. [2025-10-16T17:30:48.237036] [INFO ] [MAIN ] BCC: Loaded 28504 existing records. [2025-10-16T17:30:48.410756] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:30:48.411004] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-16T17:30:48.411075] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-16T17:30:48.411346] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-16T17:30:48.411384] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-16T17:30:48.743795] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-16T17:30:48.766194] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:30:49.241120] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-16T17:30:49.248308] [INFO ] [REMOTE ] BBY: Full fetch complete (77394 records). [2025-10-16T17:30:49.248482] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-16T17:30:49.543482] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-16T17:30:49.672132] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-16T17:30:49.672359] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-16T17:30:49.673367] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-16T17:30:49.673588] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-16T17:30:49.675634] [DEBUG] [LOCAL ] BBY: Trimmed 77394 records to 53831 (keeping 200 days of data) [2025-10-16T17:30:49.700836] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T17:30:49.848928] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T17:30:50.074619] [DEBUG] [LOCAL ] BBY: Primary data saved (53831 records). [2025-10-16T17:30:50.074805] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-16T17:30:50.074890] [INFO ] [MAIN ] Update Progress: 230/2369 symbols completed. BBY took 35.4s. Estimated remaining: 4h 46m 11s. Rate: 7.5 symbols/min [2025-10-16T17:30:50.257373] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:30:50.306778] [DEBUG] [LOCAL ] BCE: Loaded 52247 existing records from primary storage. [2025-10-16T17:30:50.307114] [INFO ] [MAIN ] BCE: Loaded 52247 existing records. [2025-10-16T17:30:50.349624] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-16T17:30:50.493114] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:30:50.493408] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-16T17:30:50.493473] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-16T17:30:50.493934] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-16T17:30:50.493993] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-16T17:30:50.820500] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T17:30:50.876580] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:30:51.142861] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-16T17:30:51.827738] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T17:30:51.942824] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-16T17:30:52.607943] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T17:30:52.742823] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-16T17:30:53.332382] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T17:30:53.542809] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-16T17:30:54.342827] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-16T17:30:54.662366] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T17:30:54.751572] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T17:30:55.142813] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-16T17:30:55.528215] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T17:30:55.942836] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-16T17:30:56.641026] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T17:30:56.742839] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-16T17:30:57.360026] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T17:30:57.542822] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-16T17:30:58.342776] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-16T17:30:58.408349] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T17:30:58.809681] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T17:30:59.142813] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-16T17:30:59.792122] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T17:30:59.942810] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-16T17:31:00.188110] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T17:31:00.742813] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-16T17:31:00.988341] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T17:31:01.542815] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-16T17:31:02.288888] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T17:31:02.342822] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-16T17:31:03.085095] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T17:31:03.142819] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-16T17:31:03.795713] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T17:31:03.942863] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-16T17:31:04.675042] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T17:31:04.742846] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-16T17:31:04.990280] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-16T17:31:05.542895] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-16T17:31:06.333398] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T17:31:06.342819] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-16T17:31:06.922154] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T17:31:07.142847] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-16T17:31:07.861247] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T17:31:07.942839] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-16T17:31:08.484149] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T17:31:08.742881] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-16T17:31:09.038103] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T17:31:09.042970] [INFO ] [REMOTE ] BC: Full fetch complete (63466 records). [2025-10-16T17:31:09.043068] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-16T17:31:09.043752] [FATAL] [VALIDATOR ] BC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:31:09.043835] [FATAL] [MAIN ] BC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:31:09.043880] [WARN ] [MAIN ] BC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:31:09.043967] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-16T17:31:09.044047] [DEBUG] [LOCAL ] BC: No primary data file found to delete. [2025-10-16T17:31:09.044096] [INFO ] [LOCAL ] BC: Starting deletion of derivative data. [2025-10-16T17:31:09.044382] [DEBUG] [LOCAL ] BC: Deleted derivative data file. [2025-10-16T17:31:09.044493] [INFO ] [MAIN ] Update Progress: 231/2369 symbols completed. BC took 33.7s. Estimated remaining: 4h 47m 45s. Rate: 7.4 symbols/min [2025-10-16T17:31:09.210338] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:31:09.210510] [DEBUG] [LOCAL ] BCH: No existing data file found in primary storage. [2025-10-16T17:31:09.210547] [WARN ] [MAIN ] BCH: No existing data found, performing full refresh instead. [2025-10-16T17:31:09.210682] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-16T17:31:09.210736] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-16T17:31:09.210790] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-10-16T17:31:09.210856] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-16T17:31:09.551154] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-16T17:31:09.555759] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:31:10.296160] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-16T17:31:10.300715] [INFO ] [REMOTE ] BCAT: Full fetch complete (50000 records). [2025-10-16T17:31:10.300823] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-16T17:31:10.348067] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-16T17:31:10.732231] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-16T17:31:10.732323] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-16T17:31:10.732929] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-16T17:31:10.732994] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-16T17:31:10.734167] [DEBUG] [LOCAL ] BCAT: Trimmed 50000 records to 34487 (keeping 200 days of data) [2025-10-16T17:31:10.935097] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T17:31:10.966226] [DEBUG] [LOCAL ] BCAT: Primary data saved (34487 records). [2025-10-16T17:31:10.966377] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-16T17:31:10.966786] [INFO ] [MAIN ] Update Progress: 232/2369 symbols completed. BCAT took 27.7s. Estimated remaining: 4h 46m 40s. Rate: 7.5 symbols/min [2025-10-16T17:31:11.144465] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:31:11.142846] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-16T17:31:11.171534] [DEBUG] [LOCAL ] BCO: Loaded 25461 existing records from primary storage. [2025-10-16T17:31:11.171829] [INFO ] [MAIN ] BCO: Loaded 25461 existing records. [2025-10-16T17:31:11.347744] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:31:11.347990] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-16T17:31:11.348036] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-16T17:31:11.348269] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-16T17:31:11.348326] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-16T17:31:11.698462] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:31:11.942856] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-16T17:31:12.519949] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-16T17:31:12.710348] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T17:31:12.743057] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-16T17:31:12.742963] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-16T17:31:13.542845] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-16T17:31:14.342870] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-16T17:31:14.444898] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T17:31:14.494397] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T17:31:15.142789] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-16T17:31:15.231538] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-16T17:31:15.942820] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-16T17:31:16.742843] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-16T17:31:16.947922] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T17:31:17.330084] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:31:17.450142] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-16T17:31:17.542862] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-16T17:31:18.342780] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-16T17:31:18.508221] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-16T17:31:19.142814] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-16T17:31:19.588316] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T17:31:19.942826] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-16T17:31:20.570923] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T17:31:20.742857] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-16T17:31:21.262987] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T17:31:21.267591] [INFO ] [REMOTE ] BCC: Full fetch complete (41282 records). [2025-10-16T17:31:21.267772] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-16T17:31:21.544272] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-16T17:31:21.686594] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-16T17:31:21.686719] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-16T17:31:21.687331] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-16T17:31:21.687409] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-16T17:31:21.688592] [DEBUG] [LOCAL ] BCC: Trimmed 41282 records to 28737 (keeping 200 days of data) [2025-10-16T17:31:21.796016] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T17:31:21.889761] [DEBUG] [LOCAL ] BCC: Primary data saved (28737 records). [2025-10-16T17:31:21.889906] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-16T17:31:21.889992] [INFO ] [MAIN ] Update Progress: 233/2369 symbols completed. BCC took 33.8s. Estimated remaining: 4h 46m 58s. Rate: 7.4 symbols/min [2025-10-16T17:31:22.058686] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:31:22.111015] [DEBUG] [LOCAL ] BCS: Loaded 53442 existing records from primary storage. [2025-10-16T17:31:22.111354] [INFO ] [MAIN ] BCS: Loaded 53442 existing records. [2025-10-16T17:31:22.296015] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:31:22.296254] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-16T17:31:22.296301] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-16T17:31:22.296485] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-16T17:31:22.296524] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-16T17:31:22.351265] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-16T17:31:22.671895] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:31:23.142898] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-16T17:31:23.334448] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T17:31:23.469168] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T17:31:23.942856] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-16T17:31:24.742836] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-16T17:31:25.087087] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T17:31:25.542825] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-16T17:31:25.791860] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T17:31:25.877805] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T17:31:26.342838] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-16T17:31:26.733056] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T17:31:27.142855] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-16T17:31:27.931366] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T17:31:27.942809] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-16T17:31:28.175744] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T17:31:28.742828] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-16T17:31:28.917111] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T17:31:29.542831] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-16T17:31:30.342822] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-16T17:31:30.552043] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T17:31:30.837201] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T17:31:31.048335] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-16T17:31:31.142821] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-16T17:31:31.942806] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-16T17:31:32.742848] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-16T17:31:33.039820] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T17:31:33.042489] [INFO ] [REMOTE ] BCO: Full fetch complete (36259 records). [2025-10-16T17:31:33.042568] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-16T17:31:33.203351] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-16T17:31:33.455800] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-16T17:31:33.455875] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-16T17:31:33.456406] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-16T17:31:33.456451] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-16T17:31:33.457289] [DEBUG] [LOCAL ] BCO: Trimmed 36259 records to 25583 (keeping 200 days of data) [2025-10-16T17:31:33.547104] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-16T17:31:33.613715] [DEBUG] [LOCAL ] BCO: Primary data saved (25583 records). [2025-10-16T17:31:33.613852] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-16T17:31:33.613947] [INFO ] [MAIN ] Update Progress: 234/2369 symbols completed. BCO took 22.6s. Estimated remaining: 4h 47m 24s. Rate: 7.4 symbols/min [2025-10-16T17:31:33.785966] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:31:33.807848] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-16T17:31:33.837368] [DEBUG] [LOCAL ] BCSF: Loaded 28156 existing records from primary storage. [2025-10-16T17:31:33.837676] [INFO ] [MAIN ] BCSF: Loaded 28156 existing records. [2025-10-16T17:31:34.011632] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:31:34.011846] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-16T17:31:34.011893] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-16T17:31:34.012085] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-16T17:31:34.012124] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-16T17:31:34.343312] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-16T17:31:34.365259] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:31:35.008141] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T17:31:35.142839] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-16T17:31:35.942833] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-16T17:31:36.282348] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T17:31:36.470141] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-16T17:31:36.742868] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-16T17:31:37.269011] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T17:31:37.542857] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-16T17:31:38.342838] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-16T17:31:38.710907] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T17:31:38.740209] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T17:31:39.142837] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-16T17:31:39.942833] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-16T17:31:40.086090] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T17:31:40.119565] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-16T17:31:40.679489] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T17:31:40.742828] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-16T17:31:41.542842] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-16T17:31:42.331912] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T17:31:42.343092] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-16T17:31:43.142804] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-16T17:31:43.294145] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T17:31:43.301816] [INFO ] [REMOTE ] BCE: Full fetch complete (76118 records). [2025-10-16T17:31:43.302023] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-16T17:31:43.714917] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-16T17:31:43.725207] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-16T17:31:43.726402] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-16T17:31:43.726488] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-16T17:31:43.728175] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:31:43.736204] [DEBUG] [LOCAL ] BCE: Trimmed 76118 records to 52634 (keeping 200 days of data) [2025-10-16T17:31:43.949302] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-16T17:31:44.064434] [DEBUG] [LOCAL ] BCE: Primary data saved (52634 records). [2025-10-16T17:31:44.064611] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-16T17:31:44.065342] [INFO ] [MAIN ] Update Progress: 235/2369 symbols completed. BCE took 54.0s. Estimated remaining: 4h 47m 37s. Rate: 7.4 symbols/min [2025-10-16T17:31:44.233988] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:31:44.253433] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T17:31:44.278227] [DEBUG] [LOCAL ] BCX: Loaded 22028 existing records from primary storage. [2025-10-16T17:31:44.278515] [INFO ] [MAIN ] BCX: Loaded 22028 existing records. [2025-10-16T17:31:44.452122] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:31:44.452393] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-16T17:31:44.452442] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-16T17:31:44.452896] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-16T17:31:44.452980] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-16T17:31:44.748049] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-16T17:31:44.808448] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:31:45.466341] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T17:31:45.542803] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-16T17:31:46.342783] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-16T17:31:46.567937] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T17:31:46.816083] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T17:31:47.142864] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-16T17:31:47.784924] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T17:31:47.942855] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-16T17:31:48.742836] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-16T17:31:49.082289] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-16T17:31:49.176110] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-16T17:31:49.182760] [INFO ] [REMOTE ] BCH: Full fetch complete (41559 records). [2025-10-16T17:31:49.183018] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-16T17:31:49.184133] [FATAL] [VALIDATOR ] BCH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:31:49.184258] [FATAL] [MAIN ] BCH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:31:49.184304] [WARN ] [MAIN ] BCH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:31:49.184351] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-16T17:31:49.184490] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-10-16T17:31:49.184537] [INFO ] [LOCAL ] BCH: Starting deletion of derivative data. [2025-10-16T17:31:49.184797] [DEBUG] [LOCAL ] BCH: No derivative data file found to delete. [2025-10-16T17:31:49.184888] [INFO ] [MAIN ] Update Progress: 236/2369 symbols completed. BCH took 40.1s. Estimated remaining: 4h 47m 2s. Rate: 7.4 symbols/min [2025-10-16T17:31:49.406662] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:31:49.406840] [DEBUG] [LOCAL ] BDC: No existing data file found in primary storage. [2025-10-16T17:31:49.406878] [WARN ] [MAIN ] BDC: No existing data found, performing full refresh instead. [2025-10-16T17:31:49.406988] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-16T17:31:49.407028] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-16T17:31:49.407069] [DEBUG] [LOCAL ] BDC: No primary data file found to delete. [2025-10-16T17:31:49.407101] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-16T17:31:49.548730] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-16T17:31:49.793584] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:31:49.962983] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-16T17:31:50.342820] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-16T17:31:51.142823] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-16T17:31:51.404491] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T17:31:51.510611] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-16T17:31:51.942811] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-16T17:31:52.560947] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T17:31:52.742907] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-16T17:31:53.542976] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-16T17:31:53.896459] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-16T17:31:53.904048] [INFO ] [REMOTE ] BCS: Full fetch complete (77510 records). [2025-10-16T17:31:53.904215] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-16T17:31:54.205554] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T17:31:54.342342] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-16T17:31:54.342417] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-16T17:31:54.343231] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-16T17:31:54.343285] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-16T17:31:54.344130] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-16T17:31:54.345680] [DEBUG] [LOCAL ] BCS: Trimmed 77510 records to 53832 (keeping 200 days of data) [2025-10-16T17:31:54.675340] [DEBUG] [LOCAL ] BCS: Primary data saved (53832 records). [2025-10-16T17:31:54.675476] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-16T17:31:54.676233] [INFO ] [MAIN ] Update Progress: 237/2369 symbols completed. BCS took 32.8s. Estimated remaining: 4h 46m 31s. Rate: 7.4 symbols/min [2025-10-16T17:31:54.740092] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T17:31:55.142765] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-16T17:31:55.546118] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T17:31:55.942782] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-16T17:31:56.098290] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-16T17:31:56.742826] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-16T17:31:57.113482] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T17:31:57.542882] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-16T17:31:57.674365] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T17:31:58.342924] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-16T17:31:58.466052] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T17:31:59.143061] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-16T17:31:59.405964] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T17:31:59.942818] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-16T17:32:00.379934] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-16T17:32:00.742794] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-16T17:32:00.861015] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T17:32:01.542899] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-16T17:32:02.203719] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T17:32:02.342814] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-16T17:32:02.519605] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-16T17:32:03.142814] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-16T17:32:03.502102] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-16T17:32:03.942768] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-16T17:32:04.187042] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-16T17:32:04.742828] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-16T17:32:05.048906] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T17:32:05.542904] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-16T17:32:05.619839] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T17:32:06.342860] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-16T17:32:06.915328] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T17:32:07.142937] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-16T17:32:07.552829] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-16T17:32:07.942904] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-16T17:32:08.538703] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T17:32:08.742871] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-16T17:32:09.482435] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T17:32:09.548772] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-16T17:32:09.559198] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T17:32:10.342875] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-16T17:32:11.037093] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T17:32:11.041678] [INFO ] [REMOTE ] BCSF: Full fetch complete (39461 records). [2025-10-16T17:32:11.041784] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-16T17:32:11.148127] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-16T17:32:11.414617] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-16T17:32:11.414753] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-16T17:32:11.415362] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-16T17:32:11.415415] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-16T17:32:11.416421] [DEBUG] [LOCAL ] BCSF: Trimmed 39461 records to 28381 (keeping 200 days of data) [2025-10-16T17:32:11.540377] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T17:32:11.545890] [INFO ] [REMOTE ] BDC: Full fetch complete (35918 records). [2025-10-16T17:32:11.546829] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-16T17:32:11.963696] [DEBUG] [LOCAL ] BCSF: Primary data saved (28381 records). [2025-10-16T17:32:11.982152] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-16T17:32:12.002000] [INFO ] [MAIN ] Update Progress: 238/2369 symbols completed. BCSF took 38.4s. Estimated remaining: 4h 47m 46s. Rate: 7.4 symbols/min [2025-10-16T17:32:12.039567] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-16T17:32:12.039692] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-16T17:32:12.040337] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-16T17:32:12.040383] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-16T17:32:12.041521] [DEBUG] [LOCAL ] BDC: Trimmed 35918 records to 24680 (keeping 200 days of data) [2025-10-16T17:32:12.199301] [DEBUG] [LOCAL ] BDC: Primary data saved (24680 records). [2025-10-16T17:32:12.199444] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-16T17:32:12.199518] [INFO ] [MAIN ] Update Progress: 239/2369 symbols completed. BDC took 23.0s. Estimated remaining: 4h 46m 27s. Rate: 7.4 symbols/min [2025-10-16T17:32:12.422464] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T17:32:12.427352] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-16T17:32:13.523180] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T17:32:13.527166] [INFO ] [REMOTE ] BCX: Full fetch complete (33652 records). [2025-10-16T17:32:13.527259] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-16T17:32:13.527904] [FATAL] [VALIDATOR ] BCX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:32:13.527985] [FATAL] [MAIN ] BCX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:32:13.528032] [WARN ] [MAIN ] BCX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:32:13.528069] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-16T17:32:13.528123] [DEBUG] [LOCAL ] BCX: No primary data file found to delete. [2025-10-16T17:32:13.528157] [INFO ] [LOCAL ] BCX: Starting deletion of derivative data. [2025-10-16T17:32:13.528342] [DEBUG] [LOCAL ] BCX: Deleted derivative data file. [2025-10-16T17:32:13.528429] [INFO ] [MAIN ] Update Progress: 240/2369 symbols completed. BCX took 29.5s. Estimated remaining: 4h 45m 19s. Rate: 7.5 symbols/min [2025-10-16T17:32:14.073936] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:32:14.179920] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:32:14.244996] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:32:14.265239] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:32:14.308405] [DEBUG] [LOCAL ] BDJ: Loaded 29470 existing records from primary storage. [2025-10-16T17:32:14.308877] [INFO ] [MAIN ] BDJ: Loaded 29470 existing records. [2025-10-16T17:32:14.463852] [DEBUG] [LOCAL ] BDX: Loaded 52176 existing records from primary storage. [2025-10-16T17:32:14.542050] [INFO ] [MAIN ] BDX: Loaded 52176 existing records. [2025-10-16T17:32:14.547743] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:32:14.595032] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-16T17:32:14.610424] [DEBUG] [LOCAL ] BE: Loaded 53661 existing records from primary storage. [2025-10-16T17:32:14.609682] [DEBUG] [LOCAL ] BDN: Loaded 47666 existing records from primary storage. [2025-10-16T17:32:14.616008] [INFO ] [MAIN ] BE: Loaded 53661 existing records. [2025-10-16T17:32:14.629317] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-16T17:32:14.653755] [INFO ] [MAIN ] BDN: Loaded 47666 existing records. [2025-10-16T17:32:14.684467] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-16T17:32:14.791404] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-16T17:32:15.082998] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:32:15.173534] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-16T17:32:15.241189] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-16T17:32:15.286763] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-16T17:32:15.276506] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:32:15.292102] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-16T17:32:15.280959] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:32:15.297378] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-16T17:32:15.313666] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-16T17:32:15.319014] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-16T17:32:15.313490] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-16T17:32:15.349184] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-16T17:32:15.343684] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-16T17:32:15.406576] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-16T17:32:15.485344] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-16T17:32:16.177294] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:32:16.284037] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-16T17:32:16.570429] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:32:16.586546] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-16T17:32:16.677184] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:32:16.682734] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-16T17:32:16.736472] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:32:16.736830] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-16T17:32:17.592455] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T17:32:17.599073] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-16T17:32:18.058634] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T17:32:18.068265] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-16T17:32:18.339419] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T17:32:18.345910] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-16T17:32:18.484132] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-16T17:32:18.495913] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-16T17:32:19.059052] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-16T17:32:19.142789] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-16T17:32:19.384722] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T17:32:19.483932] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T17:32:19.866472] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T17:32:19.942777] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-16T17:32:20.742868] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-16T17:32:20.804806] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T17:32:21.155771] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T17:32:21.542878] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-16T17:32:22.342874] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-16T17:32:22.433311] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T17:32:22.878450] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T17:32:23.142843] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-16T17:32:23.223111] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-16T17:32:23.942838] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-16T17:32:24.742844] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-16T17:32:25.003545] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-16T17:32:25.282145] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T17:32:25.542849] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-16T17:32:26.175074] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T17:32:26.342805] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-16T17:32:26.889131] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T17:32:27.142856] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-16T17:32:27.704159] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T17:32:27.942922] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-16T17:32:28.742842] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-16T17:32:29.297122] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-16T17:32:29.341552] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T17:32:29.542851] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-16T17:32:30.342837] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-16T17:32:30.518851] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T17:32:31.142824] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-16T17:32:31.522393] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T17:32:31.570666] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-16T17:32:31.942889] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-16T17:32:32.742823] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-16T17:32:33.182800] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-16T17:32:33.259075] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T17:32:33.542847] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-16T17:32:34.342841] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-16T17:32:34.485320] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T17:32:35.150482] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-16T17:32:35.156424] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T17:32:35.942867] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-16T17:32:36.141554] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T17:32:36.584282] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T17:32:36.742807] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-16T17:32:36.866617] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T17:32:37.542809] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-16T17:32:38.209637] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T17:32:38.342819] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-16T17:32:39.080845] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T17:32:39.142803] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-16T17:32:39.942811] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-16T17:32:40.061458] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T17:32:40.430030] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T17:32:40.742831] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-16T17:32:41.542825] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-16T17:32:41.765517] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T17:32:42.342820] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-16T17:32:42.621452] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T17:32:43.101095] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T17:32:43.142843] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-16T17:32:43.942802] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-16T17:32:44.054842] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-16T17:32:44.062405] [INFO ] [REMOTE ] BDN: Full fetch complete (69350 records). [2025-10-16T17:32:44.062557] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-16T17:32:44.491487] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-16T17:32:44.491574] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-16T17:32:44.492339] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-16T17:32:44.492404] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-16T17:32:44.494375] [DEBUG] [LOCAL ] BDN: Trimmed 69350 records to 48013 (keeping 200 days of data) [2025-10-16T17:32:44.718103] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T17:32:44.725724] [INFO ] [REMOTE ] BDX: Full fetch complete (75559 records). [2025-10-16T17:32:44.729197] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-16T17:32:44.753532] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-16T17:32:45.119179] [DEBUG] [LOCAL ] BDN: Primary data saved (48013 records). [2025-10-16T17:32:45.119461] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-16T17:32:45.119925] [INFO ] [MAIN ] Update Progress: 241/2369 symbols completed. BDN took 31.6s. Estimated remaining: 4h 48m 39s. Rate: 7.4 symbols/min [2025-10-16T17:32:45.335767] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-16T17:32:45.335930] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-16T17:32:45.337221] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-16T17:32:45.337309] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-16T17:32:45.412946] [DEBUG] [LOCAL ] BDX: Trimmed 75559 records to 52564 (keeping 200 days of data) [2025-10-16T17:32:45.415917] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:32:45.416591] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-16T17:32:45.416694] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-16T17:32:45.417103] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-16T17:32:45.417186] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-16T17:32:45.417240] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-16T17:32:45.417279] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-16T17:32:46.081613] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:32:46.084135] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-16T17:32:46.092877] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T17:32:46.221564] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-16T17:32:46.238461] [DEBUG] [LOCAL ] BDX: Primary data saved (52564 records). [2025-10-16T17:32:46.238632] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-16T17:32:46.238796] [INFO ] [MAIN ] Update Progress: 242/2369 symbols completed. BDX took 32.7s. Estimated remaining: 4h 47m 29s. Rate: 7.4 symbols/min [2025-10-16T17:32:46.347089] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-16T17:32:46.415849] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:32:46.416440] [DEBUG] [LOCAL ] BEKE: No existing data file found in primary storage. [2025-10-16T17:32:46.416494] [WARN ] [MAIN ] BEKE: No existing data found, performing full refresh instead. [2025-10-16T17:32:46.416603] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-16T17:32:46.416672] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-16T17:32:46.416739] [DEBUG] [LOCAL ] BEKE: No primary data file found to delete. [2025-10-16T17:32:46.416774] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-16T17:32:46.701130] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-16T17:32:46.780452] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:32:47.142783] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-16T17:32:47.348176] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T17:32:47.352621] [INFO ] [REMOTE ] BDJ: Full fetch complete (43090 records). [2025-10-16T17:32:47.352801] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-16T17:32:47.456304] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-16T17:32:47.729828] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-16T17:32:47.729936] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-16T17:32:47.730525] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-16T17:32:47.730586] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-16T17:32:47.731546] [DEBUG] [LOCAL ] BDJ: Trimmed 43090 records to 29694 (keeping 200 days of data) [2025-10-16T17:32:47.906668] [DEBUG] [LOCAL ] BDJ: Primary data saved (29694 records). [2025-10-16T17:32:47.906809] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-16T17:32:47.906888] [INFO ] [MAIN ] Update Progress: 243/2369 symbols completed. BDJ took 34.4s. Estimated remaining: 4h 46m 25s. Rate: 7.4 symbols/min [2025-10-16T17:32:47.947949] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-16T17:32:48.076831] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:32:48.139378] [DEBUG] [LOCAL ] BEN: Loaded 53122 existing records from primary storage. [2025-10-16T17:32:48.139720] [INFO ] [MAIN ] BEN: Loaded 53122 existing records. [2025-10-16T17:32:48.314590] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:32:48.314846] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-16T17:32:48.314893] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-16T17:32:48.315267] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-16T17:32:48.315323] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-16T17:32:48.680497] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:32:48.742809] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-16T17:32:48.991610] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-16T17:32:49.542800] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-16T17:32:49.937271] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-16T17:32:50.003846] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-16T17:32:50.342815] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-16T17:32:51.142823] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-16T17:32:51.942850] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-16T17:32:52.148624] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T17:32:52.742845] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-16T17:32:53.542823] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-16T17:32:53.714846] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T17:32:53.763447] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-16T17:32:53.814050] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-16T17:32:54.110081] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T17:32:54.342842] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-16T17:32:54.673976] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-16T17:32:55.142811] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-16T17:32:55.464129] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-16T17:32:55.942821] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-16T17:32:56.169090] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-16T17:32:56.742901] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-16T17:32:57.027348] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-16T17:32:57.542822] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-16T17:32:57.948006] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-16T17:32:58.342865] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-16T17:32:59.142877] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-16T17:32:59.942855] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-16T17:33:00.090691] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T17:33:00.431495] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T17:33:00.432408] [INFO ] [REMOTE ] BEDU: Full fetch complete (1332 records). [2025-10-16T17:33:00.432500] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-16T17:33:00.610102] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-16T17:33:00.610328] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:33:00.610417] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:33:00.610512] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-16T17:33:00.610593] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-16T17:33:00.610631] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-16T17:33:00.610738] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-16T17:33:00.610817] [INFO ] [MAIN ] Update Progress: 244/2369 symbols completed. BEDU took 15.5s. Estimated remaining: 4h 46m 57s. Rate: 7.4 symbols/min [2025-10-16T17:33:00.748047] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-16T17:33:00.795306] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:33:00.832903] [DEBUG] [LOCAL ] BEP: Loaded 38951 existing records from primary storage. [2025-10-16T17:33:00.833218] [INFO ] [MAIN ] BEP: Loaded 38951 existing records. [2025-10-16T17:33:01.006461] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:33:01.006686] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-16T17:33:01.006744] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-16T17:33:01.006980] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-16T17:33:01.007035] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-16T17:33:01.379630] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:33:01.542849] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-16T17:33:02.137507] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.99 seconds). [2025-10-16T17:33:02.144620] [INFO ] [REMOTE ] BE: Full fetch complete (77813 records). [2025-10-16T17:33:02.144797] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-16T17:33:02.348934] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-16T17:33:02.553967] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-16T17:33:02.554147] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-16T17:33:02.555056] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-16T17:33:02.555138] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-16T17:33:02.556724] [DEBUG] [LOCAL ] BE: Trimmed 77813 records to 54051 (keeping 200 days of data) [2025-10-16T17:33:02.710145] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-16T17:33:02.850841] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T17:33:02.952953] [DEBUG] [LOCAL ] BE: Primary data saved (54051 records). [2025-10-16T17:33:02.953109] [INFO ] [MAIN ] BE: Full history saved. [2025-10-16T17:33:02.953944] [INFO ] [MAIN ] Update Progress: 245/2369 symbols completed. BE took 49.4s. Estimated remaining: 4h 45m 59s. Rate: 7.4 symbols/min [2025-10-16T17:33:03.121763] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:33:03.151082] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-16T17:33:03.169849] [DEBUG] [LOCAL ] BEPC: Loaded 46488 existing records from primary storage. [2025-10-16T17:33:03.170130] [INFO ] [MAIN ] BEPC: Loaded 46488 existing records. [2025-10-16T17:33:03.355369] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:33:03.355596] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-16T17:33:03.355663] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-16T17:33:03.355940] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-16T17:33:03.355995] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-16T17:33:03.708708] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:33:03.942770] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-16T17:33:04.008800] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T17:33:04.671117] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T17:33:04.742844] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-16T17:33:05.202934] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T17:33:05.542808] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-16T17:33:06.342851] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-16T17:33:06.693512] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-16T17:33:06.752072] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T17:33:07.142838] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-16T17:33:07.942846] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-16T17:33:08.053340] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T17:33:08.660916] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T17:33:08.742778] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-16T17:33:09.529665] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T17:33:09.542789] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-16T17:33:10.169473] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T17:33:10.342837] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-16T17:33:11.095909] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T17:33:11.142812] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-16T17:33:11.782322] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T17:33:11.942826] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-16T17:33:12.551435] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T17:33:12.742862] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-16T17:33:13.334375] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T17:33:13.542879] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-16T17:33:14.328068] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T17:33:14.342776] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-16T17:33:15.077370] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T17:33:15.142791] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-16T17:33:15.942822] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-16T17:33:16.015220] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T17:33:16.742901] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-16T17:33:17.039906] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-16T17:33:17.310979] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T17:33:17.542826] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-16T17:33:17.751954] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T17:33:18.342839] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-16T17:33:18.872344] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T17:33:19.142844] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-16T17:33:19.764310] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T17:33:19.942872] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-16T17:33:20.742805] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-16T17:33:20.931947] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T17:33:21.497697] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T17:33:21.542775] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-16T17:33:22.342821] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-16T17:33:22.478311] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T17:33:23.123898] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T17:33:23.142798] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-16T17:33:23.684010] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T17:33:23.942891] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-16T17:33:24.742806] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-16T17:33:24.957982] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T17:33:25.513126] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T17:33:25.518605] [INFO ] [REMOTE ] BEP: Full fetch complete (58943 records). [2025-10-16T17:33:25.518725] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-16T17:33:25.519417] [FATAL] [VALIDATOR ] BEP: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:33:25.519508] [FATAL] [MAIN ] BEP: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:33:25.519550] [WARN ] [MAIN ] BEP: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:33:25.519588] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-16T17:33:25.519665] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-10-16T17:33:25.519723] [INFO ] [LOCAL ] BEP: Starting deletion of derivative data. [2025-10-16T17:33:25.519894] [DEBUG] [LOCAL ] BEP: Deleted derivative data file. [2025-10-16T17:33:25.520329] [INFO ] [MAIN ] Update Progress: 246/2369 symbols completed. BEP took 24.9s. Estimated remaining: 4h 47m 56s. Rate: 7.4 symbols/min [2025-10-16T17:33:25.551946] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-16T17:33:25.700888] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:33:25.701088] [DEBUG] [LOCAL ] BEPH: No existing data file found in primary storage. [2025-10-16T17:33:25.701143] [WARN ] [MAIN ] BEPH: No existing data found, performing full refresh instead. [2025-10-16T17:33:25.701251] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-16T17:33:25.701292] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-16T17:33:25.701332] [DEBUG] [LOCAL ] BEPH: No primary data file found to delete. [2025-10-16T17:33:25.701364] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-16T17:33:26.054412] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:33:26.082246] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T17:33:26.342924] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-16T17:33:27.090111] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T17:33:27.142777] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-16T17:33:27.942834] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-16T17:33:28.206888] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-16T17:33:28.213681] [INFO ] [REMOTE ] BEKE: Full fetch complete (77341 records). [2025-10-16T17:33:28.213820] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-16T17:33:28.654734] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-16T17:33:28.655325] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-16T17:33:28.655567] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T17:33:28.658936] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-16T17:33:28.659138] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-16T17:33:28.660713] [DEBUG] [LOCAL ] BEKE: Trimmed 77341 records to 53596 (keeping 200 days of data) [2025-10-16T17:33:28.745569] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-16T17:33:29.000209] [DEBUG] [LOCAL ] BEKE: Primary data saved (53596 records). [2025-10-16T17:33:29.012828] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-16T17:33:29.016404] [INFO ] [MAIN ] Update Progress: 247/2369 symbols completed. BEKE took 42.8s. Estimated remaining: 4h 47m 8s. Rate: 7.4 symbols/min [2025-10-16T17:33:29.063678] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-16T17:33:29.202175] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:33:29.208518] [DEBUG] [LOCAL ] BEPI: Loaded 3616 existing records from primary storage. [2025-10-16T17:33:29.208711] [INFO ] [MAIN ] BEPI: Loaded 3616 existing records. [2025-10-16T17:33:29.380836] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:33:29.381067] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-16T17:33:29.381113] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-16T17:33:29.381248] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-16T17:33:29.381285] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-16T17:33:29.545558] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-16T17:33:29.741956] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:33:30.214356] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T17:33:30.334402] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T17:33:30.344127] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-16T17:33:30.911801] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T17:33:31.142817] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-16T17:33:31.942829] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-16T17:33:32.626638] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-16T17:33:32.742833] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-16T17:33:33.122800] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-16T17:33:33.137628] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-16T17:33:33.145130] [INFO ] [REMOTE ] BEN: Full fetch complete (77090 records). [2025-10-16T17:33:33.145308] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-16T17:33:33.555228] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-16T17:33:33.560281] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-16T17:33:33.560356] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-16T17:33:33.561284] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-16T17:33:33.561442] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-16T17:33:33.563026] [DEBUG] [LOCAL ] BEN: Trimmed 77090 records to 53511 (keeping 200 days of data) [2025-10-16T17:33:33.886672] [DEBUG] [LOCAL ] BEN: Primary data saved (53511 records). [2025-10-16T17:33:33.886829] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-16T17:33:33.886909] [INFO ] [MAIN ] Update Progress: 248/2369 symbols completed. BEN took 46.0s. Estimated remaining: 4h 46m 32s. Rate: 7.4 symbols/min [2025-10-16T17:33:34.058775] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:33:34.065160] [DEBUG] [LOCAL ] BEPJ: Loaded 3112 existing records from primary storage. [2025-10-16T17:33:34.065357] [INFO ] [MAIN ] BEPJ: Loaded 3112 existing records. [2025-10-16T17:33:34.253728] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:33:34.253983] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-16T17:33:34.254056] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-16T17:33:34.254203] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-16T17:33:34.254244] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-16T17:33:34.348210] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-16T17:33:34.377431] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T17:33:34.639207] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:33:34.743876] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T17:33:35.142857] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-16T17:33:35.618573] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-16T17:33:35.942902] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-16T17:33:36.713468] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T17:33:36.742817] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-16T17:33:37.542855] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-16T17:33:38.047827] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-16T17:33:38.230161] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:33:38.342782] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-16T17:33:39.142833] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-16T17:33:39.710962] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-16T17:33:39.947904] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-16T17:33:39.973885] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T17:33:40.742844] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-16T17:33:40.837076] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T17:33:41.542865] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-16T17:33:42.174464] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-16T17:33:42.344163] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-16T17:33:42.346255] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T17:33:42.353138] [INFO ] [REMOTE ] BEPC: Full fetch complete (68925 records). [2025-10-16T17:33:42.353250] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-16T17:33:42.747927] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-16T17:33:42.748017] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-16T17:33:42.748864] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-16T17:33:42.748930] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-16T17:33:42.750376] [DEBUG] [LOCAL ] BEPC: Trimmed 68925 records to 46866 (keeping 200 days of data) [2025-10-16T17:33:42.978257] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T17:33:43.058276] [DEBUG] [LOCAL ] BEPC: Primary data saved (46866 records). [2025-10-16T17:33:43.058444] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-16T17:33:43.059118] [INFO ] [MAIN ] Update Progress: 249/2369 symbols completed. BEPC took 40.1s. Estimated remaining: 4h 46m 33s. Rate: 7.4 symbols/min [2025-10-16T17:33:43.148065] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-16T17:33:43.249302] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:33:43.249484] [DEBUG] [LOCAL ] BFAM: No existing data file found in primary storage. [2025-10-16T17:33:43.249523] [WARN ] [MAIN ] BFAM: No existing data found, performing full refresh instead. [2025-10-16T17:33:43.249700] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-16T17:33:43.249775] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-16T17:33:43.249840] [DEBUG] [LOCAL ] BFAM: No primary data file found to delete. [2025-10-16T17:33:43.249877] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-16T17:33:43.627137] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:33:43.721876] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T17:33:43.942809] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-16T17:33:44.425443] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-16T17:33:44.742809] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-16T17:33:45.212543] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T17:33:45.542826] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-16T17:33:46.160255] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-16T17:33:46.342818] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-16T17:33:46.795499] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T17:33:47.142815] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-16T17:33:47.595790] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T17:33:47.942811] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-16T17:33:48.487373] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-16T17:33:48.488335] [INFO ] [REMOTE ] BEPI: Full fetch complete (4742 records). [2025-10-16T17:33:48.488414] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-16T17:33:48.747956] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-16T17:33:48.851787] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-16T17:33:48.851863] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-16T17:33:48.852014] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-16T17:33:48.852086] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-16T17:33:48.852461] [DEBUG] [LOCAL ] BEPI: Trimmed 4742 records to 3629 (keeping 200 days of data) [2025-10-16T17:33:48.874336] [DEBUG] [LOCAL ] BEPI: Primary data saved (3629 records). [2025-10-16T17:33:48.874460] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-16T17:33:48.874539] [INFO ] [MAIN ] Update Progress: 250/2369 symbols completed. BEPI took 19.9s. Estimated remaining: 4h 46m 5s. Rate: 7.4 symbols/min [2025-10-16T17:33:49.046107] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:33:49.083334] [DEBUG] [LOCAL ] BFH: Loaded 41564 existing records from primary storage. [2025-10-16T17:33:49.083627] [INFO ] [MAIN ] BFH: Loaded 41564 existing records. [2025-10-16T17:33:49.262239] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:33:49.262546] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-16T17:33:49.262604] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-16T17:33:49.262892] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-16T17:33:49.262961] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-16T17:33:49.368866] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-16T17:33:49.548780] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-16T17:33:49.630821] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:33:50.206626] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-16T17:33:50.342807] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-16T17:33:51.142829] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-16T17:33:51.198783] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T17:33:51.203194] [INFO ] [REMOTE ] BEPH: Full fetch complete (7598 records). [2025-10-16T17:33:51.203311] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-16T17:33:51.550638] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-16T17:33:51.550742] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-16T17:33:51.550933] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-16T17:33:51.550970] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-16T17:33:51.551352] [DEBUG] [LOCAL ] BEPH: Trimmed 7598 records to 5205 (keeping 200 days of data) [2025-10-16T17:33:51.583753] [DEBUG] [LOCAL ] BEPH: Primary data saved (5205 records). [2025-10-16T17:33:51.583866] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-16T17:33:51.583932] [INFO ] [MAIN ] Update Progress: 251/2369 symbols completed. BEPH took 26.1s. Estimated remaining: 4h 45m 12s. Rate: 7.4 symbols/min [2025-10-16T17:33:51.749524] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:33:51.764583] [DEBUG] [LOCAL ] BFK: Loaded 13505 existing records from primary storage. [2025-10-16T17:33:51.764853] [INFO ] [MAIN ] BFK: Loaded 13505 existing records. [2025-10-16T17:33:51.937441] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:33:51.937701] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-16T17:33:51.937756] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-16T17:33:51.937949] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-16T17:33:51.938003] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-16T17:33:51.949131] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-16T17:33:52.288839] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:33:52.499697] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T17:33:52.743382] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-16T17:33:52.745701] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T17:33:53.543049] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-16T17:33:53.857916] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T17:33:54.342816] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-16T17:33:54.863323] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T17:33:55.142834] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-16T17:33:55.247176] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T17:33:55.942867] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-16T17:33:56.566288] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T17:33:56.742809] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-16T17:33:56.846126] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T17:33:57.542830] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-16T17:33:58.266061] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T17:33:58.342779] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-16T17:33:58.866825] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T17:33:59.142883] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-16T17:33:59.824764] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T17:33:59.861481] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T17:33:59.942821] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-16T17:34:00.449700] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-16T17:34:00.742861] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-16T17:34:01.542817] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-16T17:34:01.784708] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T17:34:02.285637] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T17:34:02.342814] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-16T17:34:02.775442] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-16T17:34:03.142818] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-16T17:34:03.942857] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-16T17:34:04.634269] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T17:34:04.742819] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-16T17:34:05.542914] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-16T17:34:05.867984] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-16T17:34:06.161944] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T17:34:06.329093] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T17:34:06.342815] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-16T17:34:06.661632] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-16T17:34:07.142882] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-16T17:34:07.942812] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-16T17:34:08.466629] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T17:34:08.715278] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T17:34:08.742877] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-16T17:34:09.315585] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-16T17:34:09.542823] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-16T17:34:10.342888] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-16T17:34:10.808357] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-16T17:34:10.922991] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-16T17:34:11.142856] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-16T17:34:11.942863] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-16T17:34:12.376978] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T17:34:12.537482] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-16T17:34:12.742827] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-16T17:34:13.542797] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-16T17:34:14.118496] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T17:34:14.137401] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-16T17:34:14.342845] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-16T17:34:15.142867] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-16T17:34:15.633628] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T17:34:15.942851] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-16T17:34:16.742864] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-16T17:34:16.791693] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T17:34:17.409470] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T17:34:17.543810] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-16T17:34:17.548397] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T17:34:18.342812] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-16T17:34:18.931675] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T17:34:19.142815] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-16T17:34:19.291118] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T17:34:19.942867] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-16T17:34:20.376909] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-16T17:34:20.381938] [INFO ] [REMOTE ] BFAM: Full fetch complete (47279 records). [2025-10-16T17:34:20.382081] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-16T17:34:20.750127] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-16T17:34:20.753350] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-16T17:34:20.753402] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-16T17:34:20.753975] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-16T17:34:20.754036] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-16T17:34:20.755308] [DEBUG] [LOCAL ] BFAM: Trimmed 47279 records to 34121 (keeping 200 days of data) [2025-10-16T17:34:20.948057] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-16T17:34:20.953993] [INFO ] [REMOTE ] BFK: Full fetch complete (19059 records). [2025-10-16T17:34:20.955064] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-16T17:34:21.144438] [DEBUG] [LOCAL ] BFAM: Primary data saved (34121 records). [2025-10-16T17:34:21.160795] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-16T17:34:21.162102] [INFO ] [MAIN ] Update Progress: 252/2369 symbols completed. BFAM took 38.1s. Estimated remaining: 4h 48m 4s. Rate: 7.3 symbols/min [2025-10-16T17:34:21.528692] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:34:21.553525] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-16T17:34:21.543824] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-16T17:34:21.554244] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-16T17:34:21.554711] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-16T17:34:21.556466] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-16T17:34:21.557592] [DEBUG] [LOCAL ] BFK: Trimmed 19059 records to 13686 (keeping 200 days of data) [2025-10-16T17:34:21.638905] [DEBUG] [LOCAL ] BFK: Primary data saved (13686 records). [2025-10-16T17:34:21.639068] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-16T17:34:21.639163] [INFO ] [MAIN ] Update Progress: 253/2369 symbols completed. BFK took 30.1s. Estimated remaining: 4h 46m 52s. Rate: 7.4 symbols/min [2025-10-16T17:34:21.846169] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:34:21.848590] [DEBUG] [LOCAL ] BFLY: Loaded 51836 existing records from primary storage. [2025-10-16T17:34:21.849289] [INFO ] [MAIN ] BFLY: Loaded 51836 existing records. [2025-10-16T17:34:21.966547] [DEBUG] [LOCAL ] BFS: Loaded 9589 existing records from primary storage. [2025-10-16T17:34:21.983105] [INFO ] [MAIN ] BFS: Loaded 9589 existing records. [2025-10-16T17:34:22.085875] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:34:22.120398] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-16T17:34:22.120789] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-16T17:34:22.121148] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-16T17:34:22.121217] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-16T17:34:22.295405] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T17:34:22.387311] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:34:22.390768] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-16T17:34:22.389207] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T17:34:22.406255] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-16T17:34:22.423193] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-16T17:34:22.482423] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-16T17:34:22.490782] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-16T17:34:22.845953] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:34:22.884758] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-16T17:34:23.067606] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:34:23.142784] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-16T17:34:23.849241] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T17:34:23.942831] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-16T17:34:24.031333] [DEBUG] [REMOTE ] BFS: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-16T17:34:24.031683] [WARN ] [REMOTE ] BFS: No data returned for month 2025-01 [2025-10-16T17:34:24.031789] [FATAL] [REMOTE ] BFS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:34:24.031904] [FATAL] [MAIN ] BFS: Failed to fetch primary data. [2025-10-16T17:34:24.031993] [WARN ] [MAIN ] BFS: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:34:24.032092] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-16T17:34:24.032176] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-16T17:34:24.032215] [INFO ] [LOCAL ] BFS: Starting deletion of derivative data. [2025-10-16T17:34:24.032347] [DEBUG] [LOCAL ] BFS: Deleted derivative data file. [2025-10-16T17:34:24.032430] [INFO ] [MAIN ] Update Progress: 254/2369 symbols completed. BFS took 2.4s. Estimated remaining: 4h 45m 56s. Rate: 7.4 symbols/min [2025-10-16T17:34:24.209071] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:34:24.222379] [DEBUG] [LOCAL ] BFZ: Loaded 11947 existing records from primary storage. [2025-10-16T17:34:24.222597] [INFO ] [MAIN ] BFZ: Loaded 11947 existing records. [2025-10-16T17:34:24.405246] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:34:24.405480] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-16T17:34:24.405537] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-16T17:34:24.405734] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-16T17:34:24.405792] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-16T17:34:24.746293] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-16T17:34:24.768913] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:34:25.542900] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-16T17:34:25.978622] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-16T17:34:25.979506] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4406 records). [2025-10-16T17:34:25.979596] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-16T17:34:26.343091] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-16T17:34:26.408903] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-16T17:34:26.409176] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-16T17:34:26.409382] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-16T17:34:26.409530] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-16T17:34:26.410343] [DEBUG] [LOCAL ] BEPJ: Trimmed 4406 records to 3119 (keeping 200 days of data) [2025-10-16T17:34:26.433212] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3119 records). [2025-10-16T17:34:26.433349] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-16T17:34:26.452981] [INFO ] [MAIN ] Update Progress: 255/2369 symbols completed. BEPJ took 52.6s. Estimated remaining: 4h 45m 1s. Rate: 7.4 symbols/min [2025-10-16T17:34:26.524624] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T17:34:26.675984] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:34:26.724719] [DEBUG] [LOCAL ] BG: Loaded 50524 existing records from primary storage. [2025-10-16T17:34:26.725028] [INFO ] [MAIN ] BG: Loaded 50524 existing records. [2025-10-16T17:34:26.895941] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:34:26.896162] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-16T17:34:26.896230] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-16T17:34:26.896558] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-16T17:34:26.896634] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-16T17:34:27.147903] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-16T17:34:27.253212] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:34:27.923218] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T17:34:27.929724] [INFO ] [REMOTE ] BFH: Full fetch complete (60168 records). [2025-10-16T17:34:27.929899] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-16T17:34:27.947920] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-16T17:34:28.306665] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T17:34:28.395304] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-16T17:34:28.395390] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-16T17:34:28.396150] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-16T17:34:28.396217] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-16T17:34:28.397516] [DEBUG] [LOCAL ] BFH: Trimmed 60168 records to 41891 (keeping 200 days of data) [2025-10-16T17:34:28.653355] [DEBUG] [LOCAL ] BFH: Primary data saved (41891 records). [2025-10-16T17:34:28.653485] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-16T17:34:28.653562] [INFO ] [MAIN ] Update Progress: 256/2369 symbols completed. BFH took 39.8s. Estimated remaining: 4h 44m 4s. Rate: 7.4 symbols/min [2025-10-16T17:34:28.748471] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-16T17:34:28.824032] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:34:28.842134] [DEBUG] [LOCAL ] BGB: Loaded 17952 existing records from primary storage. [2025-10-16T17:34:28.842403] [INFO ] [MAIN ] BGB: Loaded 17952 existing records. [2025-10-16T17:34:29.013436] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:34:29.013639] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-16T17:34:29.013722] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-16T17:34:29.013945] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-16T17:34:29.014004] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-16T17:34:29.365505] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:34:29.475968] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T17:34:29.542808] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-16T17:34:30.342824] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-16T17:34:30.578398] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T17:34:31.120710] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T17:34:31.142796] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-16T17:34:31.172263] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T17:34:31.942847] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-16T17:34:32.460865] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-16T17:34:32.732304] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T17:34:32.742763] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-16T17:34:33.542933] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-16T17:34:34.342823] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-16T17:34:34.366137] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T17:34:34.482909] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T17:34:35.004307] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-16T17:34:35.142890] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-16T17:34:35.942858] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-16T17:34:35.961162] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T17:34:36.742812] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-16T17:34:37.401370] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-16T17:34:37.471457] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T17:34:37.542833] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-16T17:34:38.342793] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-16T17:34:38.425005] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T17:34:39.142815] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-16T17:34:39.942840] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-16T17:34:40.146304] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T17:34:40.722962] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T17:34:40.742768] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-16T17:34:41.012352] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T17:34:41.542835] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-16T17:34:42.178458] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-16T17:34:42.352749] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-16T17:34:42.374442] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T17:34:43.130972] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-16T17:34:43.142775] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-16T17:34:43.942790] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-16T17:34:43.964521] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T17:34:44.742822] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-16T17:34:44.971440] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T17:34:45.419445] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-16T17:34:45.542810] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-16T17:34:46.342788] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-16T17:34:46.735224] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T17:34:47.142812] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-16T17:34:47.786854] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T17:34:47.942804] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-16T17:34:48.742835] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-16T17:34:48.866136] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T17:34:49.431497] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T17:34:49.542810] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-16T17:34:49.710514] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T17:34:50.123598] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T17:34:50.342866] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-16T17:34:51.142816] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-16T17:34:51.377107] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-16T17:34:51.379712] [INFO ] [REMOTE ] BFZ: Full fetch complete (17487 records). [2025-10-16T17:34:51.379803] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-16T17:34:51.754318] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-16T17:34:51.754399] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-16T17:34:51.754757] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-16T17:34:51.754818] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-16T17:34:51.755355] [DEBUG] [LOCAL ] BFZ: Trimmed 17487 records to 12108 (keeping 200 days of data) [2025-10-16T17:34:51.827971] [DEBUG] [LOCAL ] BFZ: Primary data saved (12108 records). [2025-10-16T17:34:51.828109] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-16T17:34:51.828188] [INFO ] [MAIN ] Update Progress: 257/2369 symbols completed. BFZ took 27.8s. Estimated remaining: 4h 46m 0s. Rate: 7.4 symbols/min [2025-10-16T17:34:51.947969] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-16T17:34:51.999537] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:34:52.018446] [DEBUG] [LOCAL ] BGH: Loaded 17264 existing records from primary storage. [2025-10-16T17:34:52.018711] [INFO ] [MAIN ] BGH: Loaded 17264 existing records. [2025-10-16T17:34:52.195821] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:34:52.196072] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-16T17:34:52.196121] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-16T17:34:52.196303] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-16T17:34:52.196361] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-16T17:34:52.561015] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:34:52.742867] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-16T17:34:53.082037] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T17:34:53.488706] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T17:34:53.542835] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-16T17:34:53.756441] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T17:34:54.342832] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-16T17:34:54.521291] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-16T17:34:55.142901] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-16T17:34:55.901374] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T17:34:55.942803] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-16T17:34:56.031866] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T17:34:56.742910] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-16T17:34:56.902616] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T17:34:57.542793] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-16T17:34:57.922850] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T17:34:58.342869] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-16T17:34:59.148011] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-16T17:34:59.169033] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T17:34:59.877797] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T17:34:59.942821] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-16T17:35:00.159459] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T17:35:00.742842] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-16T17:35:01.542810] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-16T17:35:01.742151] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T17:35:01.744874] [INFO ] [REMOTE ] BGB: Full fetch complete (26708 records). [2025-10-16T17:35:01.744953] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-16T17:35:01.745450] [FATAL] [VALIDATOR ] BGB: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:35:01.745531] [FATAL] [MAIN ] BGB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:35:01.745573] [WARN ] [MAIN ] BGB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:35:01.745611] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-16T17:35:01.745689] [DEBUG] [LOCAL ] BGB: No primary data file found to delete. [2025-10-16T17:35:01.745744] [INFO ] [LOCAL ] BGB: Starting deletion of derivative data. [2025-10-16T17:35:01.745856] [DEBUG] [LOCAL ] BGB: Deleted derivative data file. [2025-10-16T17:35:01.745921] [INFO ] [MAIN ] Update Progress: 258/2369 symbols completed. BGB took 33.1s. Estimated remaining: 4h 46m 7s. Rate: 7.4 symbols/min [2025-10-16T17:35:01.924549] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:35:01.941668] [DEBUG] [LOCAL ] BGR: Loaded 13605 existing records from primary storage. [2025-10-16T17:35:01.941899] [INFO ] [MAIN ] BGR: Loaded 13605 existing records. [2025-10-16T17:35:02.095369] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-16T17:35:02.195868] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:35:02.196301] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-16T17:35:02.196390] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-16T17:35:02.201930] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-16T17:35:02.207828] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-16T17:35:02.214895] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-16T17:35:02.347687] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-16T17:35:02.638858] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:35:03.142858] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-16T17:35:03.942833] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-16T17:35:04.202304] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-16T17:35:04.210820] [INFO ] [REMOTE ] BG: Full fetch complete (73010 records). [2025-10-16T17:35:04.210993] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-16T17:35:04.336492] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T17:35:04.639914] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-16T17:35:04.640021] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-16T17:35:04.640858] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-16T17:35:04.640922] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-16T17:35:04.642319] [DEBUG] [LOCAL ] BG: Trimmed 73010 records to 50912 (keeping 200 days of data) [2025-10-16T17:35:04.742943] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-16T17:35:04.953080] [DEBUG] [LOCAL ] BG: Primary data saved (50912 records). [2025-10-16T17:35:04.953220] [INFO ] [MAIN ] BG: Full history saved. [2025-10-16T17:35:04.954737] [INFO ] [MAIN ] Update Progress: 259/2369 symbols completed. BG took 38.5s. Estimated remaining: 4h 45m 18s. Rate: 7.4 symbols/min [2025-10-16T17:35:05.120631] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:35:05.171218] [DEBUG] [LOCAL ] BGS: Loaded 50534 existing records from primary storage. [2025-10-16T17:35:05.171531] [INFO ] [MAIN ] BGS: Loaded 50534 existing records. [2025-10-16T17:35:05.352334] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:35:05.352625] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-16T17:35:05.352707] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-16T17:35:05.353006] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-16T17:35:05.353062] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-16T17:35:05.546363] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-16T17:35:05.720081] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:35:05.730973] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T17:35:05.813389] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T17:35:06.342853] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-16T17:35:06.574570] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T17:35:07.046488] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-16T17:35:07.142806] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-16T17:35:07.942792] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-16T17:35:08.090702] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T17:35:08.742857] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-16T17:35:08.890974] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-16T17:35:09.542824] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-16T17:35:10.342831] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-16T17:35:10.355079] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T17:35:10.962331] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-16T17:35:10.969432] [INFO ] [REMOTE ] BFLY: Full fetch complete (75503 records). [2025-10-16T17:35:10.969577] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-16T17:35:11.153793] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-16T17:35:11.378750] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-16T17:35:11.378854] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-16T17:35:11.379757] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-16T17:35:11.379820] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-16T17:35:11.381434] [DEBUG] [LOCAL ] BFLY: Trimmed 75503 records to 52222 (keeping 200 days of data) [2025-10-16T17:35:11.687837] [DEBUG] [LOCAL ] BFLY: Primary data saved (52222 records). [2025-10-16T17:35:11.687985] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-16T17:35:11.688092] [INFO ] [MAIN ] Update Progress: 260/2369 symbols completed. BFLY took 50.5s. Estimated remaining: 4h 44m 59s. Rate: 7.4 symbols/min [2025-10-16T17:35:11.867675] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:35:11.877713] [DEBUG] [LOCAL ] BGSF: Loaded 7984 existing records from primary storage. [2025-10-16T17:35:11.877945] [INFO ] [MAIN ] BGSF: Loaded 7984 existing records. [2025-10-16T17:35:11.952581] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-16T17:35:12.110901] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:35:12.105310] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T17:35:12.111466] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-16T17:35:12.115688] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-16T17:35:12.122397] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-16T17:35:12.123301] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-16T17:35:12.264902] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T17:35:12.503260] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:35:12.634552] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-16T17:35:12.742849] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-16T17:35:13.497131] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T17:35:13.542817] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-16T17:35:13.913481] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-16T17:35:14.342899] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-16T17:35:14.764005] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-16T17:35:15.142856] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-16T17:35:15.942841] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-16T17:35:16.099061] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-16T17:35:16.742900] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-16T17:35:17.184605] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-16T17:35:17.542841] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-16T17:35:17.784868] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-16T17:35:17.891768] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-16T17:35:18.342810] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-16T17:35:18.788946] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-16T17:35:19.142956] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-16T17:35:19.942795] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-16T17:35:20.144710] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T17:35:20.147774] [INFO ] [REMOTE ] BGH: Full fetch complete (22896 records). [2025-10-16T17:35:20.147870] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-16T17:35:20.547787] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-16T17:35:20.547868] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-16T17:35:20.548235] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-16T17:35:20.548275] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-16T17:35:20.549084] [DEBUG] [LOCAL ] BGH: Trimmed 22896 records to 17362 (keeping 200 days of data) [2025-10-16T17:35:20.654563] [DEBUG] [LOCAL ] BGH: Primary data saved (17362 records). [2025-10-16T17:35:20.654754] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-16T17:35:20.654840] [INFO ] [MAIN ] Update Progress: 261/2369 symbols completed. BGH took 28.8s. Estimated remaining: 4h 44m 58s. Rate: 7.4 symbols/min [2025-10-16T17:35:20.747927] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-16T17:35:20.831118] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:35:20.849249] [DEBUG] [LOCAL ] BGT: Loaded 16412 existing records from primary storage. [2025-10-16T17:35:20.849511] [INFO ] [MAIN ] BGT: Loaded 16412 existing records. [2025-10-16T17:35:21.036832] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T17:35:21.042333] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:35:21.046264] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-16T17:35:21.046335] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-16T17:35:21.046512] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-16T17:35:21.046568] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-16T17:35:21.155196] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-16T17:35:21.430158] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:35:21.542804] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-16T17:35:22.342844] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-16T17:35:22.411534] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T17:35:23.126535] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T17:35:23.142810] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-16T17:35:23.942818] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-16T17:35:24.005613] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T17:35:24.742845] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-16T17:35:25.047192] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T17:35:25.542822] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-16T17:35:26.342892] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-16T17:35:26.422042] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T17:35:26.461249] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T17:35:26.685000] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-16T17:35:27.142842] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-16T17:35:27.942832] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-16T17:35:28.103886] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-16T17:35:28.742865] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-16T17:35:28.825337] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T17:35:29.542819] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-16T17:35:29.726951] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T17:35:30.097707] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T17:35:30.342818] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-16T17:35:31.142820] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-16T17:35:31.781237] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T17:35:31.942815] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-16T17:35:32.117014] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T17:35:32.742799] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-16T17:35:32.991697] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T17:35:33.542797] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-16T17:35:33.657882] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T17:35:34.269912] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-16T17:35:34.342816] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-16T17:35:35.142839] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-16T17:35:35.440447] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T17:35:35.942834] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-16T17:35:36.742805] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-16T17:35:36.770692] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T17:35:36.773722] [INFO ] [REMOTE ] BGR: Full fetch complete (19980 records). [2025-10-16T17:35:36.773822] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-16T17:35:37.098374] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T17:35:37.213167] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-16T17:35:37.213248] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-16T17:35:37.213632] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-16T17:35:37.213710] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-16T17:35:37.214409] [DEBUG] [LOCAL ] BGR: Trimmed 19980 records to 13687 (keeping 200 days of data) [2025-10-16T17:35:37.297947] [DEBUG] [LOCAL ] BGR: Primary data saved (13687 records). [2025-10-16T17:35:37.298096] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-16T17:35:37.298175] [INFO ] [MAIN ] Update Progress: 262/2369 symbols completed. BGR took 35.6s. Estimated remaining: 4h 45m 58s. Rate: 7.4 symbols/min [2025-10-16T17:35:37.469704] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:35:37.481476] [DEBUG] [LOCAL ] BGX: Loaded 11151 existing records from primary storage. [2025-10-16T17:35:37.481703] [INFO ] [MAIN ] BGX: Loaded 11151 existing records. [2025-10-16T17:35:37.548028] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-16T17:35:37.663433] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:35:37.663676] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-16T17:35:37.663737] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-16T17:35:37.663937] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-16T17:35:37.663990] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-16T17:35:37.784735] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T17:35:37.816611] [INFO ] [REMOTE ] BGSF: Full fetch complete (9581 records). [2025-10-16T17:35:37.851817] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-16T17:35:38.197200] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:35:38.352195] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-16T17:35:38.439815] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-16T17:35:38.439893] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-16T17:35:38.440121] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-16T17:35:38.440160] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-16T17:35:38.440679] [DEBUG] [LOCAL ] BGSF: Trimmed 9581 records to 8063 (keeping 200 days of data) [2025-10-16T17:35:38.487321] [DEBUG] [LOCAL ] BGSF: Primary data saved (8063 records). [2025-10-16T17:35:38.487465] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-16T17:35:38.487545] [INFO ] [MAIN ] Update Progress: 263/2369 symbols completed. BGSF took 26.8s. Estimated remaining: 4h 44m 55s. Rate: 7.4 symbols/min [2025-10-16T17:35:38.654909] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:35:38.675724] [DEBUG] [LOCAL ] BGY: Loaded 21983 existing records from primary storage. [2025-10-16T17:35:38.675992] [INFO ] [MAIN ] BGY: Loaded 21983 existing records. [2025-10-16T17:35:38.852314] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:35:38.852559] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-16T17:35:38.852606] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-16T17:35:38.852906] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-16T17:35:38.852967] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-16T17:35:39.147917] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-16T17:35:39.224355] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:35:39.306916] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T17:35:39.402709] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-16T17:35:39.942828] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-16T17:35:40.011390] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T17:35:40.742809] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-16T17:35:41.267771] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T17:35:41.542835] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-16T17:35:41.690454] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T17:35:42.159706] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-16T17:35:42.342811] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-16T17:35:43.142868] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-16T17:35:43.343614] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-16T17:35:43.942818] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-16T17:35:44.742806] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-16T17:35:44.784340] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T17:35:44.873716] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T17:35:44.875793] [INFO ] [REMOTE ] BGT: Full fetch complete (24177 records). [2025-10-16T17:35:44.875865] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-16T17:35:45.246963] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-16T17:35:45.247054] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-16T17:35:45.247500] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-16T17:35:45.247554] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-16T17:35:45.248213] [DEBUG] [LOCAL ] BGT: Trimmed 24177 records to 16514 (keeping 200 days of data) [2025-10-16T17:35:45.346196] [DEBUG] [LOCAL ] BGT: Primary data saved (16514 records). [2025-10-16T17:35:45.346336] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-16T17:35:45.346415] [INFO ] [MAIN ] Update Progress: 264/2369 symbols completed. BGT took 24.7s. Estimated remaining: 4h 44m 36s. Rate: 7.4 symbols/min [2025-10-16T17:35:45.516381] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:35:45.534026] [DEBUG] [LOCAL ] BH: Loaded 16248 existing records from primary storage. [2025-10-16T17:35:45.534228] [INFO ] [MAIN ] BH: Loaded 16248 existing records. [2025-10-16T17:35:45.547986] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-16T17:35:45.719619] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:35:45.719862] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-16T17:35:45.719909] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-16T17:35:45.720061] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-16T17:35:45.720098] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-16T17:35:46.122454] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:35:46.136230] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T17:35:46.342875] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-16T17:35:46.891456] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T17:35:47.142822] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-16T17:35:47.557935] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T17:35:47.942918] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-16T17:35:47.953842] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-16T17:35:48.742812] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-16T17:35:49.061208] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T17:35:49.286939] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-16T17:35:49.542883] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-16T17:35:50.342842] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-16T17:35:50.441519] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T17:35:51.142832] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-16T17:35:51.822574] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T17:35:51.942781] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-16T17:35:52.076550] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T17:35:52.591213] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T17:35:52.742844] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-16T17:35:53.504289] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T17:35:53.542775] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-16T17:35:54.342868] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-16T17:35:54.806044] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-16T17:35:55.142833] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-16T17:35:55.897247] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-16T17:35:55.942860] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-16T17:35:56.071771] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T17:35:56.081114] [INFO ] [REMOTE ] BGS: Full fetch complete (72680 records). [2025-10-16T17:35:56.081346] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-16T17:35:56.496317] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-16T17:35:56.496458] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-16T17:35:56.497370] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-16T17:35:56.497439] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-16T17:35:56.499006] [DEBUG] [LOCAL ] BGS: Trimmed 72680 records to 50921 (keeping 200 days of data) [2025-10-16T17:35:56.712048] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T17:35:56.750608] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-16T17:35:56.820036] [DEBUG] [LOCAL ] BGS: Primary data saved (50921 records). [2025-10-16T17:35:56.820232] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-16T17:35:56.820992] [INFO ] [MAIN ] Update Progress: 265/2369 symbols completed. BGS took 51.9s. Estimated remaining: 4h 44m 55s. Rate: 7.4 symbols/min [2025-10-16T17:35:56.999010] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:35:57.049288] [DEBUG] [LOCAL ] BHC: Loaded 46689 existing records from primary storage. [2025-10-16T17:35:57.049799] [INFO ] [MAIN ] BHC: Loaded 46689 existing records. [2025-10-16T17:35:57.249415] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:35:57.249706] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-16T17:35:57.249780] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-16T17:35:57.250023] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-16T17:35:57.250092] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-16T17:35:57.558352] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-16T17:35:57.598436] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:35:57.965425] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T17:35:58.128359] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T17:35:58.342845] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-16T17:35:59.142792] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-16T17:35:59.219398] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T17:35:59.942814] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-16T17:36:00.725779] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T17:36:00.742768] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-16T17:36:01.194835] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T17:36:01.542827] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-16T17:36:02.267235] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T17:36:02.342797] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-16T17:36:02.410791] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T17:36:03.142834] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-16T17:36:03.860019] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T17:36:03.942796] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-16T17:36:04.051097] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-16T17:36:04.742824] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-16T17:36:04.903698] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-16T17:36:05.515713] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T17:36:05.542814] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-16T17:36:06.343023] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-16T17:36:06.359736] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T17:36:07.142876] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-16T17:36:07.419249] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T17:36:07.942819] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-16T17:36:08.742801] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-16T17:36:08.772692] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T17:36:08.833361] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-16T17:36:09.542780] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-16T17:36:09.852057] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T17:36:09.854575] [INFO ] [REMOTE ] BGX: Full fetch complete (16672 records). [2025-10-16T17:36:09.854689] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-16T17:36:10.212912] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-16T17:36:10.212990] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-16T17:36:10.213313] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-16T17:36:10.213351] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-16T17:36:10.213919] [DEBUG] [LOCAL ] BGX: Trimmed 16672 records to 11261 (keeping 200 days of data) [2025-10-16T17:36:10.281299] [DEBUG] [LOCAL ] BGX: Primary data saved (11261 records). [2025-10-16T17:36:10.281426] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-16T17:36:10.281500] [INFO ] [MAIN ] Update Progress: 266/2369 symbols completed. BGX took 33.0s. Estimated remaining: 4h 45m 29s. Rate: 7.4 symbols/min [2025-10-16T17:36:10.345440] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-16T17:36:10.455888] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:36:10.468179] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T17:36:10.491142] [DEBUG] [LOCAL ] BHE: Loaded 23842 existing records from primary storage. [2025-10-16T17:36:10.491402] [INFO ] [MAIN ] BHE: Loaded 23842 existing records. [2025-10-16T17:36:10.669294] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:36:10.670331] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-16T17:36:10.670392] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-16T17:36:10.671080] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-16T17:36:10.671139] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-16T17:36:11.020475] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:36:11.142835] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-16T17:36:11.942856] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-16T17:36:12.095078] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T17:36:12.370053] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T17:36:12.742784] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-16T17:36:12.955709] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T17:36:13.526908] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T17:36:13.542782] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-16T17:36:14.342839] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-16T17:36:14.476230] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T17:36:15.142826] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-16T17:36:15.285620] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-16T17:36:15.942835] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-16T17:36:16.449328] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-16T17:36:16.742917] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-16T17:36:17.065598] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-16T17:36:17.069137] [INFO ] [REMOTE ] BGY: Full fetch complete (33173 records). [2025-10-16T17:36:17.069244] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-16T17:36:17.450868] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-16T17:36:17.450985] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-16T17:36:17.451542] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-16T17:36:17.451594] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-16T17:36:17.452535] [DEBUG] [LOCAL ] BGY: Trimmed 33173 records to 22120 (keeping 200 days of data) [2025-10-16T17:36:17.546890] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-16T17:36:17.585816] [DEBUG] [LOCAL ] BGY: Primary data saved (22120 records). [2025-10-16T17:36:17.586061] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-16T17:36:17.586201] [INFO ] [MAIN ] Update Progress: 267/2369 symbols completed. BGY took 39.1s. Estimated remaining: 4h 45m 14s. Rate: 7.4 symbols/min [2025-10-16T17:36:17.761052] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:36:17.775197] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T17:36:17.801063] [DEBUG] [LOCAL ] BHK: Loaded 23743 existing records from primary storage. [2025-10-16T17:36:17.801310] [INFO ] [MAIN ] BHK: Loaded 23743 existing records. [2025-10-16T17:36:17.977539] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:36:17.977776] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-16T17:36:17.977829] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-16T17:36:17.977992] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-16T17:36:17.978031] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-16T17:36:18.329233] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:36:18.342769] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-16T17:36:18.937549] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T17:36:19.142874] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-16T17:36:19.429156] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T17:36:19.942852] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-16T17:36:20.132394] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T17:36:20.742839] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-16T17:36:21.314413] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T17:36:21.487274] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T17:36:21.542773] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-16T17:36:22.342820] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-16T17:36:22.712833] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-16T17:36:23.144458] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-16T17:36:23.146877] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T17:36:23.942796] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-16T17:36:24.026555] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T17:36:24.742788] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-16T17:36:24.788604] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-16T17:36:25.542797] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-16T17:36:25.626287] [DEBUG] [REMOTE ] BHK: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-16T17:36:25.626531] [WARN ] [REMOTE ] BHK: No data returned for month 2025-03 [2025-10-16T17:36:25.626615] [FATAL] [REMOTE ] BHK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:36:25.626721] [FATAL] [MAIN ] BHK: Failed to fetch primary data. [2025-10-16T17:36:25.626787] [WARN ] [MAIN ] BHK: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:36:25.626861] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-16T17:36:25.626922] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-10-16T17:36:25.626957] [INFO ] [LOCAL ] BHK: Starting deletion of derivative data. [2025-10-16T17:36:25.627135] [DEBUG] [LOCAL ] BHK: Deleted derivative data file. [2025-10-16T17:36:25.627216] [INFO ] [MAIN ] Update Progress: 268/2369 symbols completed. BHK took 8.0s. Estimated remaining: 4h 45m 5s. Rate: 7.4 symbols/min [2025-10-16T17:36:25.797477] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:36:25.845056] [DEBUG] [LOCAL ] BHP: Loaded 53372 existing records from primary storage. [2025-10-16T17:36:25.845377] [INFO ] [MAIN ] BHP: Loaded 53372 existing records. [2025-10-16T17:36:26.028232] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:36:26.028460] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-16T17:36:26.028512] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-16T17:36:26.028938] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-16T17:36:26.029024] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-16T17:36:26.348618] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-16T17:36:26.392540] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:36:26.419797] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T17:36:27.142784] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-16T17:36:27.541923] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T17:36:27.942834] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-16T17:36:28.248208] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T17:36:28.742789] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-16T17:36:28.772470] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T17:36:29.542824] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-16T17:36:30.342895] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-16T17:36:30.481074] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T17:36:31.142793] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-16T17:36:31.392406] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T17:36:31.395956] [INFO ] [REMOTE ] BHE: Full fetch complete (36361 records). [2025-10-16T17:36:31.396134] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-16T17:36:31.728029] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-16T17:36:31.810867] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-16T17:36:31.810940] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-16T17:36:31.811410] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-16T17:36:31.811449] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-16T17:36:31.812206] [DEBUG] [LOCAL ] BHE: Trimmed 36361 records to 24043 (keeping 200 days of data) [2025-10-16T17:36:31.944139] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-16T17:36:31.958062] [DEBUG] [LOCAL ] BHE: Primary data saved (24043 records). [2025-10-16T17:36:31.958145] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-16T17:36:31.958216] [INFO ] [MAIN ] Update Progress: 269/2369 symbols completed. BHE took 21.7s. Estimated remaining: 4h 44m 43s. Rate: 7.4 symbols/min [2025-10-16T17:36:32.126157] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:36:32.147952] [DEBUG] [LOCAL ] BHR: Loaded 22093 existing records from primary storage. [2025-10-16T17:36:32.148167] [INFO ] [MAIN ] BHR: Loaded 22093 existing records. [2025-10-16T17:36:32.328335] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:36:32.328516] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-16T17:36:32.328582] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-16T17:36:32.328899] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-16T17:36:32.328979] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-16T17:36:32.691260] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:36:32.726936] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-16T17:36:32.742771] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-16T17:36:32.950787] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-16T17:36:32.953011] [INFO ] [REMOTE ] BH: Full fetch complete (19528 records). [2025-10-16T17:36:32.953080] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-16T17:36:33.318155] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-16T17:36:33.318250] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-16T17:36:33.318625] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-16T17:36:33.318706] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-16T17:36:33.319334] [DEBUG] [LOCAL ] BH: Trimmed 19528 records to 16356 (keeping 200 days of data) [2025-10-16T17:36:33.413393] [DEBUG] [LOCAL ] BH: Primary data saved (16356 records). [2025-10-16T17:36:33.413532] [INFO ] [MAIN ] BH: Full history saved. [2025-10-16T17:36:33.413611] [INFO ] [MAIN ] Update Progress: 270/2369 symbols completed. BH took 48.1s. Estimated remaining: 4h 43m 43s. Rate: 7.4 symbols/min [2025-10-16T17:36:33.555153] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-16T17:36:33.587115] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:36:33.587237] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-16T17:36:33.587275] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-16T17:36:33.587382] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-16T17:36:33.587425] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-16T17:36:33.587467] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-16T17:36:33.587502] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-16T17:36:33.930984] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T17:36:33.975411] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:36:34.342815] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-16T17:36:34.773617] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-16T17:36:35.132466] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T17:36:35.143164] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-16T17:36:35.942811] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-16T17:36:36.280711] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-16T17:36:36.596352] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T17:36:36.602972] [INFO ] [REMOTE ] BHC: Full fetch complete (67491 records). [2025-10-16T17:36:36.603127] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-16T17:36:36.747889] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-16T17:36:37.031431] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-16T17:36:37.031509] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-16T17:36:37.032289] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-16T17:36:37.032351] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-16T17:36:37.033588] [DEBUG] [LOCAL ] BHC: Trimmed 67491 records to 47069 (keeping 200 days of data) [2025-10-16T17:36:37.291372] [DEBUG] [LOCAL ] BHC: Primary data saved (47069 records). [2025-10-16T17:36:37.291504] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-16T17:36:37.292305] [INFO ] [MAIN ] Update Progress: 271/2369 symbols completed. BHC took 40.5s. Estimated remaining: 4h 43m 2s. Rate: 7.4 symbols/min [2025-10-16T17:36:37.459986] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:36:37.510293] [DEBUG] [LOCAL ] BHVN: Loaded 50605 existing records from primary storage. [2025-10-16T17:36:37.510622] [INFO ] [MAIN ] BHVN: Loaded 50605 existing records. [2025-10-16T17:36:37.551942] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-16T17:36:37.686588] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:36:37.686877] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-16T17:36:37.686936] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-16T17:36:37.687343] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-16T17:36:37.687409] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-16T17:36:38.028563] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:36:38.342778] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-16T17:36:38.450121] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T17:36:38.649100] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T17:36:39.142799] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-16T17:36:39.948212] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-16T17:36:39.953583] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T17:36:40.232784] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-16T17:36:40.742841] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-16T17:36:41.155902] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T17:36:41.309627] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T17:36:41.542831] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-16T17:36:41.815308] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-16T17:36:42.342844] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-16T17:36:43.142817] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-16T17:36:43.843049] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T17:36:43.942783] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-16T17:36:44.313674] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T17:36:44.742803] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-16T17:36:45.397371] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T17:36:45.542807] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-16T17:36:46.342838] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-16T17:36:46.652700] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-16T17:36:46.746008] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-16T17:36:46.873448] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-16T17:36:47.142880] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-16T17:36:47.942854] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-16T17:36:48.702116] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T17:36:48.742811] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-16T17:36:49.110521] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T17:36:49.468320] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-16T17:36:49.542777] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-16T17:36:50.342757] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-16T17:36:50.508443] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T17:36:51.142827] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-16T17:36:51.765038] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T17:36:51.942906] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-16T17:36:52.742864] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-16T17:36:53.019958] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T17:36:53.152286] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-16T17:36:53.542787] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-16T17:36:53.650447] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T17:36:54.342811] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-16T17:36:55.142855] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-16T17:36:55.599253] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-16T17:36:55.633756] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-16T17:36:55.942843] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-16T17:36:56.037919] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T17:36:56.742874] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-16T17:36:57.117367] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T17:36:57.127966] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-16T17:36:57.542827] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-16T17:36:57.891004] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-16T17:36:58.342824] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-16T17:36:59.142894] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-16T17:36:59.942826] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-16T17:37:00.487505] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-16T17:37:00.742787] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-16T17:37:00.807265] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T17:37:00.853449] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-16T17:37:01.190910] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T17:37:01.542843] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-16T17:37:02.342843] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-16T17:37:02.890280] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-16T17:37:02.894158] [INFO ] [REMOTE ] BHR: Full fetch complete (31396 records). [2025-10-16T17:37:02.894319] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-16T17:37:03.151807] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-16T17:37:03.262537] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-16T17:37:03.262618] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-16T17:37:03.263174] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-16T17:37:03.263236] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-16T17:37:03.263991] [DEBUG] [LOCAL ] BHR: Trimmed 31396 records to 22248 (keeping 200 days of data) [2025-10-16T17:37:03.388764] [DEBUG] [LOCAL ] BHR: Primary data saved (22248 records). [2025-10-16T17:37:03.388897] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-16T17:37:03.389007] [INFO ] [MAIN ] Update Progress: 272/2369 symbols completed. BHR took 31.4s. Estimated remaining: 4h 45m 13s. Rate: 7.4 symbols/min [2025-10-16T17:37:03.558615] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:03.612022] [DEBUG] [LOCAL ] BILL: Loaded 52497 existing records from primary storage. [2025-10-16T17:37:03.612381] [INFO ] [MAIN ] BILL: Loaded 52497 existing records. [2025-10-16T17:37:03.787700] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:03.787979] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-16T17:37:03.788027] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-16T17:37:03.788207] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-16T17:37:03.788246] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-16T17:37:03.952752] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-16T17:37:04.157287] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:04.325994] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T17:37:04.742792] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-16T17:37:05.105572] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-16T17:37:05.106290] [INFO ] [REMOTE ] BHV: Full fetch complete (1385 records). [2025-10-16T17:37:05.106359] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-16T17:37:05.284792] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-16T17:37:05.285339] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:37:05.285413] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:37:05.285485] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-16T17:37:05.285548] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-16T17:37:05.285597] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-16T17:37:05.297957] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-16T17:37:05.298112] [INFO ] [MAIN ] Update Progress: 273/2369 symbols completed. BHV took 31.9s. Estimated remaining: 4h 44m 17s. Rate: 7.4 symbols/min [2025-10-16T17:37:05.397841] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-16T17:37:05.502783] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:05.527415] [DEBUG] [LOCAL ] BIO: Loaded 24027 existing records from primary storage. [2025-10-16T17:37:05.527694] [INFO ] [MAIN ] BIO: Loaded 24027 existing records. [2025-10-16T17:37:05.548116] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-16T17:37:05.713608] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:05.713824] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-16T17:37:05.713872] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-16T17:37:05.714049] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-16T17:37:05.714087] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-16T17:37:06.056914] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:06.349275] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-16T17:37:06.373115] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T17:37:07.142787] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-16T17:37:07.335314] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T17:37:07.519960] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T17:37:07.942879] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-16T17:37:08.742869] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-16T17:37:08.811937] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T17:37:09.270976] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-16T17:37:09.279092] [INFO ] [REMOTE ] BHP: Full fetch complete (77441 records). [2025-10-16T17:37:09.279414] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-16T17:37:09.551430] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-16T17:37:09.705272] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-16T17:37:09.705369] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-16T17:37:09.706274] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-16T17:37:09.706345] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-16T17:37:09.707977] [DEBUG] [LOCAL ] BHP: Trimmed 77441 records to 53762 (keeping 200 days of data) [2025-10-16T17:37:10.033219] [DEBUG] [LOCAL ] BHP: Primary data saved (53762 records). [2025-10-16T17:37:10.033375] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-16T17:37:10.033919] [INFO ] [MAIN ] Update Progress: 274/2369 symbols completed. BHP took 44.4s. Estimated remaining: 4h 43m 43s. Rate: 7.4 symbols/min [2025-10-16T17:37:10.208796] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:10.251802] [DEBUG] [LOCAL ] BIP: Loaded 39192 existing records from primary storage. [2025-10-16T17:37:10.252137] [INFO ] [MAIN ] BIP: Loaded 39192 existing records. [2025-10-16T17:37:10.350268] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-16T17:37:10.431204] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:10.432208] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-16T17:37:10.432441] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-16T17:37:10.432714] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-16T17:37:10.432786] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-16T17:37:10.608332] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T17:37:10.822423] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:11.142826] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-16T17:37:11.177964] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T17:37:11.327232] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T17:37:11.942839] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-16T17:37:12.748124] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-16T17:37:12.761188] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T17:37:13.542823] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-16T17:37:13.973597] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-16T17:37:13.980156] [INFO ] [REMOTE ] BHVN: Full fetch complete (70520 records). [2025-10-16T17:37:13.980272] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-16T17:37:14.291114] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T17:37:14.347875] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-16T17:37:14.418172] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-16T17:37:14.418248] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-16T17:37:14.419220] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-16T17:37:14.419299] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-16T17:37:14.420707] [DEBUG] [LOCAL ] BHVN: Trimmed 70520 records to 50989 (keeping 200 days of data) [2025-10-16T17:37:14.714691] [DEBUG] [LOCAL ] BHVN: Primary data saved (50989 records). [2025-10-16T17:37:14.714802] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-16T17:37:14.715488] [INFO ] [MAIN ] Update Progress: 275/2369 symbols completed. BHVN took 37.4s. Estimated remaining: 4h 43m 8s. Rate: 7.4 symbols/min [2025-10-16T17:37:14.892620] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:14.933311] [DEBUG] [LOCAL ] BIPC: Loaded 41257 existing records from primary storage. [2025-10-16T17:37:14.933685] [INFO ] [MAIN ] BIPC: Loaded 41257 existing records. [2025-10-16T17:37:15.130160] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:15.130368] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-16T17:37:15.130539] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-16T17:37:15.146423] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-16T17:37:15.140504] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-16T17:37:15.146602] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-16T17:37:15.251971] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T17:37:15.524167] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:15.541302] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T17:37:15.942849] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-16T17:37:16.742820] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-16T17:37:16.797231] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T17:37:17.428468] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T17:37:17.542809] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-16T17:37:18.046272] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-16T17:37:18.342891] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-16T17:37:18.800907] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T17:37:19.142819] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-16T17:37:19.720892] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T17:37:19.942839] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-16T17:37:20.613581] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T17:37:20.742781] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-16T17:37:21.255556] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T17:37:21.542826] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-16T17:37:22.331083] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T17:37:22.342766] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-16T17:37:22.993441] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T17:37:23.142821] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-16T17:37:23.863520] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T17:37:23.942805] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-16T17:37:24.721542] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T17:37:24.742777] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-16T17:37:25.516162] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T17:37:25.542774] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-16T17:37:26.226445] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T17:37:26.342811] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-16T17:37:26.790218] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-16T17:37:27.142800] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-16T17:37:27.942849] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-16T17:37:28.087208] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T17:37:28.323722] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-16T17:37:28.742867] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-16T17:37:29.363303] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T17:37:29.542818] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-16T17:37:30.124165] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T17:37:30.342820] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-16T17:37:30.987463] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T17:37:31.142819] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-16T17:37:31.801248] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T17:37:31.942785] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-16T17:37:32.603040] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T17:37:32.742821] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-16T17:37:33.080636] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T17:37:33.542869] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-16T17:37:34.295121] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T17:37:34.342800] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-16T17:37:35.103582] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T17:37:35.142772] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-16T17:37:35.277483] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T17:37:35.942807] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-16T17:37:36.254290] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T17:37:36.742813] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-16T17:37:37.316793] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T17:37:37.542806] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-16T17:37:38.342784] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-16T17:37:38.423609] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T17:37:38.429188] [INFO ] [REMOTE ] BIP: Full fetch complete (57499 records). [2025-10-16T17:37:38.429285] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-16T17:37:38.806340] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-16T17:37:38.806414] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-16T17:37:38.807071] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-16T17:37:38.807132] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-16T17:37:38.808223] [DEBUG] [LOCAL ] BIP: Trimmed 57499 records to 39510 (keeping 200 days of data) [2025-10-16T17:37:39.050517] [DEBUG] [LOCAL ] BIP: Primary data saved (39510 records). [2025-10-16T17:37:39.050715] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-16T17:37:39.050822] [INFO ] [MAIN ] Update Progress: 276/2369 symbols completed. BIP took 29.0s. Estimated remaining: 4h 45m 3s. Rate: 7.3 symbols/min [2025-10-16T17:37:39.143586] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-16T17:37:39.233800] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:39.238865] [DEBUG] [LOCAL ] BIPH: Loaded 2518 existing records from primary storage. [2025-10-16T17:37:39.239092] [INFO ] [MAIN ] BIPH: Loaded 2518 existing records. [2025-10-16T17:37:39.418991] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:39.419479] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-16T17:37:39.419703] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-16T17:37:39.425126] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-16T17:37:39.425221] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-16T17:37:39.474416] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T17:37:39.698865] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-16T17:37:39.742774] [INFO ] [REMOTE ] BILL: Full fetch complete (76098 records). [2025-10-16T17:37:39.748556] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-16T17:37:39.924824] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:39.947880] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-16T17:37:40.239605] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-16T17:37:40.239713] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-16T17:37:40.240545] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-16T17:37:40.240587] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-16T17:37:40.241954] [DEBUG] [LOCAL ] BILL: Trimmed 76098 records to 52887 (keeping 200 days of data) [2025-10-16T17:37:40.543273] [DEBUG] [LOCAL ] BILL: Primary data saved (52887 records). [2025-10-16T17:37:40.543408] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-16T17:37:40.543486] [INFO ] [MAIN ] Update Progress: 277/2369 symbols completed. BILL took 37.2s. Estimated remaining: 4h 44m 5s. Rate: 7.4 symbols/min [2025-10-16T17:37:40.742851] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-16T17:37:40.788910] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T17:37:40.819998] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T17:37:41.542199] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T17:37:41.544771] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-16T17:37:41.546992] [INFO ] [REMOTE ] BIO: Full fetch complete (34265 records). [2025-10-16T17:37:41.547158] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-16T17:37:41.931025] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-16T17:37:41.931101] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-16T17:37:41.931570] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-16T17:37:41.931609] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-16T17:37:41.932380] [DEBUG] [LOCAL ] BIO: Trimmed 34265 records to 24218 (keeping 200 days of data) [2025-10-16T17:37:42.079608] [DEBUG] [LOCAL ] BIO: Primary data saved (24218 records). [2025-10-16T17:37:42.079767] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-16T17:37:42.079851] [INFO ] [MAIN ] Update Progress: 278/2369 symbols completed. BIO took 36.8s. Estimated remaining: 4h 43m 7s. Rate: 7.4 symbols/min [2025-10-16T17:37:42.149696] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-16T17:37:42.342847] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-16T17:37:42.766271] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-16T17:37:43.142821] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-16T17:37:43.942873] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-16T17:37:44.538819] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T17:37:44.564898] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T17:37:44.742873] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-16T17:37:45.542873] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-16T17:37:46.135060] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-16T17:37:46.134909] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T17:37:46.342790] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-16T17:37:46.780407] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-16T17:37:47.142824] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-16T17:37:47.942880] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-16T17:37:48.343029] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-16T17:37:48.688063] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-16T17:37:48.694230] [INFO ] [REMOTE ] BIPC: Full fetch complete (60276 records). [2025-10-16T17:37:48.694391] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-16T17:37:48.747896] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-16T17:37:49.137186] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-16T17:37:49.137272] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-16T17:37:49.138017] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-16T17:37:49.138083] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-16T17:37:49.139357] [DEBUG] [LOCAL ] BIPC: Trimmed 60276 records to 41583 (keeping 200 days of data) [2025-10-16T17:37:49.319926] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T17:37:49.389556] [DEBUG] [LOCAL ] BIPC: Primary data saved (41583 records). [2025-10-16T17:37:49.389722] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-16T17:37:49.390345] [INFO ] [MAIN ] Update Progress: 279/2369 symbols completed. BIPC took 34.7s. Estimated remaining: 4h 42m 52s. Rate: 7.4 symbols/min [2025-10-16T17:37:49.542923] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-16T17:37:49.908146] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-16T17:37:50.342847] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-16T17:37:50.873080] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-16T17:37:51.142838] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-16T17:37:55.147312] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (4.00 seconds). [2025-10-16T17:37:55.148138] [INFO ] [REMOTE ] BIPH: Full fetch complete (3983 records). [2025-10-16T17:37:55.148206] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-16T17:37:55.498052] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-16T17:37:55.498114] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-16T17:37:55.498234] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-16T17:37:55.498274] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-16T17:37:55.498601] [DEBUG] [LOCAL ] BIPH: Trimmed 3983 records to 2526 (keeping 200 days of data) [2025-10-16T17:37:55.513497] [DEBUG] [LOCAL ] BIPH: Primary data saved (2526 records). [2025-10-16T17:37:55.513561] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-16T17:37:55.513624] [INFO ] [MAIN ] Update Progress: 280/2369 symbols completed. BIPH took 16.5s. Estimated remaining: 4h 42m 29s. Rate: 7.4 symbols/min [2025-10-16T17:37:56.076410] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:56.169472] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:56.211191] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:56.237805] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:56.240705] [DEBUG] [LOCAL ] BIPJ: Loaded 3164 existing records from primary storage. [2025-10-16T17:37:56.241004] [INFO ] [MAIN ] BIPJ: Loaded 3164 existing records. [2025-10-16T17:37:56.313143] [DEBUG] [LOCAL ] BIPI: Loaded 2999 existing records from primary storage. [2025-10-16T17:37:56.329994] [INFO ] [MAIN ] BIPI: Loaded 2999 existing records. [2025-10-16T17:37:56.475974] [DEBUG] [LOCAL ] BIT: Loaded 23665 existing records from primary storage. [2025-10-16T17:37:56.559064] [INFO ] [MAIN ] BIT: Loaded 23665 existing records. [2025-10-16T17:37:56.562830] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:56.631990] [DEBUG] [LOCAL ] BIRK: Loaded 51107 existing records from primary storage. [2025-10-16T17:37:56.632081] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-16T17:37:56.674408] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-16T17:37:56.674596] [INFO ] [MAIN ] BIRK: Loaded 51107 existing records. [2025-10-16T17:37:56.720539] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-16T17:37:56.741670] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-16T17:37:56.874514] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:56.942525] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-16T17:37:56.988566] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-16T17:37:57.026990] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:57.053190] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-16T17:37:57.069091] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-16T17:37:57.090344] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-16T17:37:57.090633] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-16T17:37:57.090537] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-16T17:37:57.148518] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-16T17:37:57.253990] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:57.453614] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-16T17:37:57.516059] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-16T17:37:57.600696] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-16T17:37:57.664728] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-16T17:37:57.972710] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:58.079782] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-16T17:37:58.300285] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:58.362290] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-16T17:37:58.347496] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:58.387949] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-16T17:37:58.550518] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:58.550854] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-16T17:37:58.852498] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T17:37:58.854049] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-16T17:37:58.932910] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T17:37:58.934953] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-16T17:37:59.310964] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-16T17:37:59.312235] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-16T17:37:59.539046] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-16T17:37:59.540573] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-16T17:37:59.553701] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T17:37:59.558386] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-16T17:37:59.587876] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-16T17:37:59.589094] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-16T17:37:59.834162] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T17:37:59.942848] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-16T17:37:59.984629] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T17:38:00.059524] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-16T17:38:00.380368] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T17:38:00.742920] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-16T17:38:01.127470] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-16T17:38:01.375835] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T17:38:01.542805] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-16T17:38:01.967411] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-16T17:38:02.342815] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-16T17:38:02.969757] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-16T17:38:03.142843] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-16T17:38:03.942811] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-16T17:38:04.624011] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T17:38:04.742900] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-16T17:38:04.949632] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T17:38:05.056944] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-16T17:38:05.542878] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-16T17:38:05.988128] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-16T17:38:06.342849] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-16T17:38:06.786163] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-16T17:38:07.142883] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-16T17:38:07.515581] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-16T17:38:07.942824] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-16T17:38:08.742863] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-16T17:38:09.234369] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T17:38:09.535104] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T17:38:09.545075] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-16T17:38:10.113603] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T17:38:10.342835] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-16T17:38:10.949202] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-16T17:38:11.142800] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-16T17:38:11.479620] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-16T17:38:11.942844] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-16T17:38:12.511157] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T17:38:12.742854] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-16T17:38:13.321499] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T17:38:13.322401] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4333 records). [2025-10-16T17:38:13.322468] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-16T17:38:13.548037] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-16T17:38:13.695892] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-16T17:38:13.695965] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-16T17:38:13.696114] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-16T17:38:13.696169] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-16T17:38:13.696540] [DEBUG] [LOCAL ] BIPJ: Trimmed 4333 records to 3180 (keeping 200 days of data) [2025-10-16T17:38:13.715304] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3180 records). [2025-10-16T17:38:13.715412] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-16T17:38:13.715497] [INFO ] [MAIN ] Update Progress: 281/2369 symbols completed. BIPJ took 18.2s. Estimated remaining: 4h 43m 36s. Rate: 7.4 symbols/min [2025-10-16T17:38:13.884930] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:38:13.936001] [DEBUG] [LOCAL ] BJ: Loaded 51595 existing records from primary storage. [2025-10-16T17:38:13.936339] [INFO ] [MAIN ] BJ: Loaded 51595 existing records. [2025-10-16T17:38:14.116689] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:38:14.116915] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-16T17:38:14.116969] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-16T17:38:14.117299] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-16T17:38:14.117339] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-16T17:38:14.347902] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-16T17:38:14.495117] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:38:14.842673] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-16T17:38:15.142842] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-16T17:38:15.350105] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T17:38:15.587507] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-16T17:38:15.588381] [INFO ] [REMOTE ] BIPI: Full fetch complete (4762 records). [2025-10-16T17:38:15.588447] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-16T17:38:15.935659] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-16T17:38:15.935743] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-16T17:38:15.935902] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-16T17:38:15.935966] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-16T17:38:15.936318] [DEBUG] [LOCAL ] BIPI: Trimmed 4762 records to 3012 (keeping 200 days of data) [2025-10-16T17:38:15.945772] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-16T17:38:15.955928] [DEBUG] [LOCAL ] BIPI: Primary data saved (3012 records). [2025-10-16T17:38:15.955996] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-16T17:38:15.956068] [INFO ] [MAIN ] Update Progress: 282/2369 symbols completed. BIPI took 20.4s. Estimated remaining: 4h 42m 44s. Rate: 7.4 symbols/min [2025-10-16T17:38:16.130503] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:38:16.179431] [DEBUG] [LOCAL ] BK: Loaded 53543 existing records from primary storage. [2025-10-16T17:38:16.179782] [INFO ] [MAIN ] BK: Loaded 53543 existing records. [2025-10-16T17:38:16.352928] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:38:16.353139] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-16T17:38:16.353195] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-16T17:38:16.353583] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-16T17:38:16.353624] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-16T17:38:16.699247] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:38:16.742788] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-16T17:38:17.438894] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T17:38:17.542809] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-16T17:38:17.902810] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-16T17:38:18.342869] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-16T17:38:18.900680] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T17:38:19.142924] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-16T17:38:19.892985] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-16T17:38:19.942819] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-16T17:38:20.009601] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T17:38:20.742841] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-16T17:38:20.873891] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T17:38:21.542816] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-16T17:38:22.123621] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T17:38:22.342841] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-16T17:38:23.142800] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-16T17:38:23.259250] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T17:38:23.599428] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-16T17:38:23.942881] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-16T17:38:24.143300] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T17:38:24.742836] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-16T17:38:25.432721] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T17:38:25.542850] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-16T17:38:26.342862] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-16T17:38:26.565733] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T17:38:27.018396] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-16T17:38:27.053543] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T17:38:27.142829] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-16T17:38:27.942867] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-16T17:38:28.742778] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-16T17:38:28.968694] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T17:38:29.357823] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T17:38:29.542853] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-16T17:38:30.008354] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T17:38:30.342788] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-16T17:38:31.142880] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-16T17:38:31.514193] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-16T17:38:31.520970] [INFO ] [REMOTE ] BIRK: Full fetch complete (73323 records). [2025-10-16T17:38:31.521124] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-16T17:38:31.911675] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-16T17:38:31.911828] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-16T17:38:31.912681] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-16T17:38:31.912783] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-16T17:38:31.914186] [DEBUG] [LOCAL ] BIRK: Trimmed 73323 records to 51493 (keeping 200 days of data) [2025-10-16T17:38:31.961752] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-16T17:38:32.229601] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T17:38:32.252946] [DEBUG] [LOCAL ] BIRK: Primary data saved (51493 records). [2025-10-16T17:38:32.253054] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-16T17:38:32.253692] [INFO ] [MAIN ] Update Progress: 283/2369 symbols completed. BIRK took 36.7s. Estimated remaining: 4h 43m 37s. Rate: 7.4 symbols/min [2025-10-16T17:38:32.422374] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:38:32.471604] [DEBUG] [LOCAL ] BKD: Loaded 50474 existing records from primary storage. [2025-10-16T17:38:32.471918] [INFO ] [MAIN ] BKD: Loaded 50474 existing records. [2025-10-16T17:38:32.651555] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:38:32.651877] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-16T17:38:32.651935] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-16T17:38:32.652408] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-16T17:38:32.652510] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-16T17:38:32.768486] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-16T17:38:32.806152] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T17:38:33.076186] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:38:33.403454] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T17:38:33.542804] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-16T17:38:34.173231] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T17:38:34.342769] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-16T17:38:34.445887] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T17:38:35.142820] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-16T17:38:35.942835] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-16T17:38:36.267044] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T17:38:36.503990] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T17:38:36.742777] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-16T17:38:37.542894] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-16T17:38:37.717479] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T17:38:37.957298] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T17:38:37.961226] [INFO ] [REMOTE ] BIT: Full fetch complete (32124 records). [2025-10-16T17:38:37.961303] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-16T17:38:38.340923] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-16T17:38:38.341013] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-16T17:38:38.341703] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-16T17:38:38.341764] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-16T17:38:38.342519] [DEBUG] [LOCAL ] BIT: Trimmed 32124 records to 23884 (keeping 200 days of data) [2025-10-16T17:38:38.342888] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-16T17:38:38.484962] [DEBUG] [LOCAL ] BIT: Primary data saved (23884 records). [2025-10-16T17:38:38.485080] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-16T17:38:38.485153] [INFO ] [MAIN ] Update Progress: 284/2369 symbols completed. BIT took 43.0s. Estimated remaining: 4h 43m 14s. Rate: 7.4 symbols/min [2025-10-16T17:38:38.662368] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:38:38.704259] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T17:38:38.724005] [DEBUG] [LOCAL ] BKE: Loaded 33979 existing records from primary storage. [2025-10-16T17:38:38.724254] [INFO ] [MAIN ] BKE: Loaded 33979 existing records. [2025-10-16T17:38:38.902218] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:38:38.902470] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-16T17:38:38.902518] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-16T17:38:38.902873] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-16T17:38:38.902932] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-16T17:38:39.153307] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-16T17:38:39.271662] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:38:39.872278] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T17:38:39.942769] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-16T17:38:40.722804] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T17:38:40.742775] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-16T17:38:41.146906] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T17:38:41.542832] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-16T17:38:42.342844] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-16T17:38:42.555371] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T17:38:43.080510] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T17:38:43.142779] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-16T17:38:43.387974] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T17:38:43.942845] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-16T17:38:44.320399] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-16T17:38:44.742862] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-16T17:38:45.248887] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T17:38:45.542834] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-16T17:38:46.342836] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-16T17:38:46.390495] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T17:38:46.628612] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T17:38:47.142839] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-16T17:38:47.942797] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-16T17:38:48.113590] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T17:38:48.742830] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-16T17:38:49.024978] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T17:38:49.217015] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T17:38:49.542832] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-16T17:38:50.342864] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-16T17:38:50.495148] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T17:38:50.868693] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T17:38:51.142812] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-16T17:38:51.942880] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-16T17:38:52.143573] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-16T17:38:52.742868] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-16T17:38:52.959224] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T17:38:52.966402] [INFO ] [REMOTE ] BK: Full fetch complete (77673 records). [2025-10-16T17:38:52.966572] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-16T17:38:53.418426] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-16T17:38:53.418604] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-16T17:38:53.419528] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-16T17:38:53.419613] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-16T17:38:53.448728] [DEBUG] [LOCAL ] BK: Trimmed 77673 records to 53933 (keeping 200 days of data) [2025-10-16T17:38:53.450448] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T17:38:53.549789] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-16T17:38:53.795925] [DEBUG] [LOCAL ] BK: Primary data saved (53933 records). [2025-10-16T17:38:53.796090] [INFO ] [MAIN ] BK: Full history saved. [2025-10-16T17:38:53.796194] [INFO ] [MAIN ] Update Progress: 285/2369 symbols completed. BK took 37.8s. Estimated remaining: 4h 43m 58s. Rate: 7.3 symbols/min [2025-10-16T17:38:53.961677] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:38:53.995786] [DEBUG] [LOCAL ] BKH: Loaded 37090 existing records from primary storage. [2025-10-16T17:38:53.996072] [INFO ] [MAIN ] BKH: Loaded 37090 existing records. [2025-10-16T17:38:54.171140] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:38:54.171436] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-16T17:38:54.171485] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-16T17:38:54.171723] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-16T17:38:54.171780] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-16T17:38:54.343103] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-16T17:38:54.534826] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:38:54.569555] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T17:38:54.749555] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T17:38:55.142836] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-16T17:38:55.581099] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-16T17:38:55.942817] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-16T17:38:56.255798] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T17:38:56.742813] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-16T17:38:56.818521] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T17:38:57.542828] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-16T17:38:58.297136] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T17:38:58.342772] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-16T17:38:58.962834] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T17:38:59.142799] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-16T17:38:59.942872] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-16T17:39:00.027521] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T17:39:00.034098] [INFO ] [REMOTE ] BKD: Full fetch complete (72095 records). [2025-10-16T17:39:00.034206] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-16T17:39:00.450364] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T17:39:00.450517] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-16T17:39:00.450627] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-16T17:39:00.458192] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-16T17:39:00.458687] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-16T17:39:00.460103] [DEBUG] [LOCAL ] BKD: Trimmed 72095 records to 50839 (keeping 200 days of data) [2025-10-16T17:39:00.745234] [DEBUG] [LOCAL ] BKD: Primary data saved (50839 records). [2025-10-16T17:39:00.745575] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-16T17:39:00.746332] [INFO ] [MAIN ] Update Progress: 286/2369 symbols completed. BKD took 28.5s. Estimated remaining: 4h 43m 41s. Rate: 7.3 symbols/min [2025-10-16T17:39:00.745372] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-16T17:39:00.942057] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:39:00.991395] [DEBUG] [LOCAL ] BKKT: Loaded 36603 existing records from primary storage. [2025-10-16T17:39:00.991811] [INFO ] [MAIN ] BKKT: Loaded 36603 existing records. [2025-10-16T17:39:01.299681] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T17:39:01.332538] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:39:01.332869] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-16T17:39:01.332943] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-16T17:39:01.333298] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-16T17:39:01.333354] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-16T17:39:01.556498] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-16T17:39:01.815212] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:39:02.342787] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-16T17:39:02.823543] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-16T17:39:02.888379] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T17:39:03.142864] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-16T17:39:03.767473] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T17:39:03.942816] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-16T17:39:04.546718] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T17:39:04.742813] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-16T17:39:05.393261] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-16T17:39:05.542827] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-16T17:39:05.965097] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-16T17:39:05.969575] [INFO ] [REMOTE ] BKE: Full fetch complete (50411 records). [2025-10-16T17:39:05.969700] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-16T17:39:06.345120] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-16T17:39:06.345361] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-16T17:39:06.345430] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-16T17:39:06.346196] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-16T17:39:06.346275] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-16T17:39:06.347985] [DEBUG] [LOCAL ] BKE: Trimmed 50411 records to 34197 (keeping 200 days of data) [2025-10-16T17:39:06.564273] [DEBUG] [LOCAL ] BKE: Primary data saved (34197 records). [2025-10-16T17:39:06.564386] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-16T17:39:06.564462] [INFO ] [MAIN ] Update Progress: 287/2369 symbols completed. BKE took 28.1s. Estimated remaining: 4h 43m 16s. Rate: 7.3 symbols/min [2025-10-16T17:39:06.737669] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:39:06.747521] [DEBUG] [LOCAL ] BKN: Loaded 7312 existing records from primary storage. [2025-10-16T17:39:06.747752] [INFO ] [MAIN ] BKN: Loaded 7312 existing records. [2025-10-16T17:39:06.923964] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:39:06.924167] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-16T17:39:06.924218] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-16T17:39:06.924376] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-16T17:39:06.924432] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-16T17:39:07.147595] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-16T17:39:07.288281] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:39:07.310692] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T17:39:07.796737] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T17:39:07.942847] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-16T17:39:08.645069] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T17:39:08.651700] [INFO ] [REMOTE ] BJ: Full fetch complete (74416 records). [2025-10-16T17:39:08.651825] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-16T17:39:08.752566] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-16T17:39:09.045804] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-16T17:39:09.045944] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-16T17:39:09.046853] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-16T17:39:09.046922] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-16T17:39:09.048376] [DEBUG] [LOCAL ] BJ: Trimmed 74416 records to 51977 (keeping 200 days of data) [2025-10-16T17:39:09.369094] [DEBUG] [LOCAL ] BJ: Primary data saved (51977 records). [2025-10-16T17:39:09.369260] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-16T17:39:09.369619] [INFO ] [MAIN ] Update Progress: 288/2369 symbols completed. BJ took 55.7s. Estimated remaining: 4h 42m 29s. Rate: 7.4 symbols/min [2025-10-16T17:39:09.371013] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T17:39:09.548059] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-16T17:39:09.552945] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:39:09.601469] [DEBUG] [LOCAL ] BKSY: Loaded 48700 existing records from primary storage. [2025-10-16T17:39:09.601813] [INFO ] [MAIN ] BKSY: Loaded 48700 existing records. [2025-10-16T17:39:09.778452] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:39:09.778722] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-16T17:39:09.778781] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-16T17:39:09.779138] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-16T17:39:09.779195] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-16T17:39:10.142114] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:39:10.165697] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T17:39:10.217281] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-16T17:39:10.342817] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-16T17:39:11.124663] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T17:39:11.142762] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-16T17:39:11.781226] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T17:39:11.942823] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-16T17:39:12.742874] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-16T17:39:13.240818] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T17:39:13.542819] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-16T17:39:14.342888] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-16T17:39:14.554833] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T17:39:15.079221] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T17:39:15.142783] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-16T17:39:15.697766] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T17:39:15.942893] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-16T17:39:16.695203] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T17:39:16.742825] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-16T17:39:17.542812] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-16T17:39:17.730413] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-16T17:39:17.905092] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T17:39:18.074415] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-16T17:39:18.342840] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-16T17:39:19.142901] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-16T17:39:19.727476] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T17:39:19.942871] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-16T17:39:20.703849] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T17:39:20.708852] [INFO ] [REMOTE ] BKH: Full fetch complete (52837 records). [2025-10-16T17:39:20.709031] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-16T17:39:20.752689] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-16T17:39:21.090326] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-16T17:39:21.090405] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-16T17:39:21.091039] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-16T17:39:21.091112] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-16T17:39:21.092235] [DEBUG] [LOCAL ] BKH: Trimmed 52837 records to 37416 (keeping 200 days of data) [2025-10-16T17:39:21.309661] [DEBUG] [LOCAL ] BKH: Primary data saved (37416 records). [2025-10-16T17:39:21.309794] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-16T17:39:21.309871] [INFO ] [MAIN ] Update Progress: 289/2369 symbols completed. BKH took 27.5s. Estimated remaining: 4h 42m 48s. Rate: 7.4 symbols/min [2025-10-16T17:39:21.483124] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:39:21.499613] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T17:39:21.515217] [DEBUG] [LOCAL ] BKT: Loaded 12457 existing records from primary storage. [2025-10-16T17:39:21.515413] [INFO ] [MAIN ] BKT: Loaded 12457 existing records. [2025-10-16T17:39:21.547988] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-16T17:39:21.691104] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:39:21.691294] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-16T17:39:21.691341] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-16T17:39:21.691537] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-16T17:39:21.691576] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-16T17:39:22.033723] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:39:22.342877] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-16T17:39:22.454919] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T17:39:22.808543] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-16T17:39:23.142827] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-16T17:39:23.424950] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T17:39:23.942899] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-16T17:39:23.957711] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-16T17:39:24.443521] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-16T17:39:24.742842] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-16T17:39:25.506005] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T17:39:25.542818] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-16T17:39:26.342871] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-16T17:39:27.142875] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-16T17:39:27.451477] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-16T17:39:27.834543] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T17:39:27.939593] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T17:39:27.947727] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-16T17:39:28.742825] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-16T17:39:29.542777] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-16T17:39:29.636557] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T17:39:30.266866] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-16T17:39:30.342789] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-16T17:39:30.467208] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T17:39:31.120833] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T17:39:31.142773] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-16T17:39:31.656358] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-16T17:39:31.942807] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-16T17:39:32.742824] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-16T17:39:33.542807] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-16T17:39:33.658727] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-16T17:39:33.908691] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T17:39:34.342812] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-16T17:39:34.905935] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-16T17:39:35.016362] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T17:39:35.142821] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-16T17:39:35.942874] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-16T17:39:36.742785] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-16T17:39:36.880163] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T17:39:37.220916] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-16T17:39:37.228160] [INFO ] [REMOTE ] BKKT: Full fetch complete (51422 records). [2025-10-16T17:39:37.228504] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-16T17:39:37.553294] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-16T17:39:37.657622] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-16T17:39:37.657761] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-16T17:39:37.658762] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-16T17:39:37.658880] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-16T17:39:37.660776] [DEBUG] [LOCAL ] BKKT: Trimmed 51422 records to 36968 (keeping 200 days of data) [2025-10-16T17:39:37.886733] [DEBUG] [LOCAL ] BKKT: Primary data saved (36968 records). [2025-10-16T17:39:37.886927] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-16T17:39:37.887025] [INFO ] [MAIN ] Update Progress: 290/2369 symbols completed. BKKT took 37.1s. Estimated remaining: 4h 43m 41s. Rate: 7.3 symbols/min [2025-10-16T17:39:38.075882] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:39:38.094063] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-16T17:39:38.128466] [DEBUG] [LOCAL ] BKU: Loaded 42161 existing records from primary storage. [2025-10-16T17:39:38.128918] [INFO ] [MAIN ] BKU: Loaded 42161 existing records. [2025-10-16T17:39:38.325290] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:39:38.325634] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-16T17:39:38.325722] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-16T17:39:38.326118] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-16T17:39:38.326176] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-16T17:39:38.348104] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-16T17:39:38.707221] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:39:38.867528] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-16T17:39:38.965491] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-16T17:39:39.142853] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-16T17:39:39.767190] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-16T17:39:39.769097] [INFO ] [REMOTE ] BKN: Full fetch complete (11286 records). [2025-10-16T17:39:39.769204] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-16T17:39:39.949687] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-16T17:39:40.155316] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-16T17:39:40.155386] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-16T17:39:40.155667] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-16T17:39:40.155728] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-16T17:39:40.156153] [DEBUG] [LOCAL ] BKN: Trimmed 11286 records to 7345 (keeping 200 days of data) [2025-10-16T17:39:40.199589] [DEBUG] [LOCAL ] BKN: Primary data saved (7345 records). [2025-10-16T17:39:40.199745] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-16T17:39:40.199830] [INFO ] [MAIN ] Update Progress: 291/2369 symbols completed. BKN took 33.6s. Estimated remaining: 4h 42m 50s. Rate: 7.3 symbols/min [2025-10-16T17:39:40.368766] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:39:40.397145] [DEBUG] [LOCAL ] BKV: Loaded 29596 existing records from primary storage. [2025-10-16T17:39:40.397398] [INFO ] [MAIN ] BKV: Loaded 29596 existing records. [2025-10-16T17:39:40.575986] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:39:40.576183] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-16T17:39:40.576230] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-16T17:39:40.576509] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-16T17:39:40.576548] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-16T17:39:40.755791] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-16T17:39:40.852298] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-16T17:39:40.951946] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:39:41.542884] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-16T17:39:42.342872] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-16T17:39:42.657712] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T17:39:42.785461] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-16T17:39:42.997444] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-16T17:39:43.142816] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-16T17:39:43.942873] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-16T17:39:44.377319] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-16T17:39:44.632909] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-16T17:39:44.742872] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-16T17:39:45.542859] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-16T17:39:46.309186] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T17:39:46.342859] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-16T17:39:46.529111] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T17:39:47.142874] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-16T17:39:47.781547] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T17:39:47.942834] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-16T17:39:48.563955] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T17:39:48.742877] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-16T17:39:49.133345] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T17:39:49.136463] [INFO ] [REMOTE ] BKT: Full fetch complete (16339 records). [2025-10-16T17:39:49.136564] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-16T17:39:49.534822] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-16T17:39:49.534899] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-16T17:39:49.535251] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-16T17:39:49.535292] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-16T17:39:49.535858] [DEBUG] [LOCAL ] BKT: Trimmed 16339 records to 12606 (keeping 200 days of data) [2025-10-16T17:39:49.568140] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-16T17:39:49.613525] [DEBUG] [LOCAL ] BKT: Primary data saved (12606 records). [2025-10-16T17:39:49.613737] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-16T17:39:49.613824] [INFO ] [MAIN ] Update Progress: 292/2369 symbols completed. BKT took 28.3s. Estimated remaining: 4h 42m 51s. Rate: 7.3 symbols/min [2025-10-16T17:39:49.784904] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:39:49.804321] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T17:39:49.839542] [DEBUG] [LOCAL ] BLCO: Loaded 35230 existing records from primary storage. [2025-10-16T17:39:49.839838] [INFO ] [MAIN ] BLCO: Loaded 35230 existing records. [2025-10-16T17:39:50.011766] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:39:50.012036] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-16T17:39:50.012117] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-16T17:39:50.012370] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-16T17:39:50.012426] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-16T17:39:50.358586] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-16T17:39:50.365035] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:39:50.563976] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T17:39:51.142822] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-16T17:39:51.790721] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T17:39:51.942825] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-16T17:39:52.695031] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T17:39:52.742856] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-16T17:39:53.356508] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T17:39:53.542885] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-16T17:39:53.988757] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-16T17:39:54.342902] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-16T17:39:54.941341] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T17:39:55.142860] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-16T17:39:55.942860] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-16T17:39:56.324889] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-16T17:39:56.390398] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T17:39:56.742906] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-16T17:39:57.041118] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T17:39:57.542826] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-16T17:39:58.342842] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-16T17:39:58.635012] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T17:39:58.722828] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T17:39:59.142909] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-16T17:39:59.603970] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T17:39:59.942825] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-16T17:40:00.502121] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-16T17:40:00.742835] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-16T17:40:01.546763] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-16T17:40:01.553149] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T17:40:02.251370] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T17:40:02.342881] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-16T17:40:02.786679] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T17:40:03.142889] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-16T17:40:03.948194] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-16T17:40:03.964919] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T17:40:04.742864] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-16T17:40:05.197803] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T17:40:05.202636] [INFO ] [REMOTE ] BKV: Full fetch complete (44861 records). [2025-10-16T17:40:05.202787] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-16T17:40:05.551847] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-16T17:40:05.621297] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-16T17:40:05.621523] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-16T17:40:05.622237] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-16T17:40:05.622316] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-16T17:40:05.641038] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-16T17:40:05.648039] [DEBUG] [LOCAL ] BKV: Trimmed 44861 records to 29852 (keeping 200 days of data) [2025-10-16T17:40:05.648626] [INFO ] [REMOTE ] BKSY: Full fetch complete (70402 records). [2025-10-16T17:40:05.648944] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-16T17:40:06.170165] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-16T17:40:06.176497] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-16T17:40:06.177560] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-16T17:40:06.200186] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-16T17:40:06.236226] [DEBUG] [LOCAL ] BKV: Primary data saved (29852 records). [2025-10-16T17:40:06.236763] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-16T17:40:06.236945] [INFO ] [MAIN ] Update Progress: 293/2369 symbols completed. BKV took 26.0s. Estimated remaining: 4h 43m 43s. Rate: 7.3 symbols/min [2025-10-16T17:40:06.248608] [DEBUG] [LOCAL ] BKSY: Trimmed 70402 records to 49090 (keeping 200 days of data) [2025-10-16T17:40:06.460870] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T17:40:06.613451] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-16T17:40:06.612815] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:06.738810] [DEBUG] [LOCAL ] BKSY: Primary data saved (49090 records). [2025-10-16T17:40:06.747356] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-16T17:40:06.747830] [INFO ] [MAIN ] Update Progress: 294/2369 symbols completed. BKSY took 57.4s. Estimated remaining: 4h 42m 40s. Rate: 7.3 symbols/min [2025-10-16T17:40:06.898456] [DEBUG] [LOCAL ] BLD: Loaded 27482 existing records from primary storage. [2025-10-16T17:40:06.927788] [INFO ] [MAIN ] BLD: Loaded 27482 existing records. [2025-10-16T17:40:06.931413] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:07.122982] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:40:07.123835] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-16T17:40:07.124109] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-16T17:40:07.124513] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-16T17:40:07.124628] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-16T17:40:07.346509] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T17:40:07.325533] [DEBUG] [LOCAL ] BLDR: Loaded 51906 existing records from primary storage. [2025-10-16T17:40:07.379099] [INFO ] [MAIN ] BLDR: Loaded 51906 existing records. [2025-10-16T17:40:07.491057] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-16T17:40:07.777393] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:07.805625] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:40:07.806028] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-16T17:40:07.806147] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-16T17:40:07.806377] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-16T17:40:07.806432] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-16T17:40:07.961717] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-16T17:40:08.184175] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:08.205462] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T17:40:08.742877] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-16T17:40:09.015759] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T17:40:09.424768] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T17:40:09.542807] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-16T17:40:10.342866] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-16T17:40:10.760116] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-16T17:40:11.142819] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-16T17:40:11.762254] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T17:40:11.942822] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-16T17:40:12.026284] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T17:40:12.442002] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (3.70 seconds). [2025-10-16T17:40:12.742812] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-16T17:40:13.349094] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T17:40:13.542852] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-16T17:40:14.081414] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T17:40:14.342823] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-16T17:40:14.461974] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-16T17:40:15.142859] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-16T17:40:15.290043] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-16T17:40:15.942834] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-16T17:40:16.742777] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-16T17:40:16.872010] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T17:40:16.922251] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T17:40:17.542817] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-16T17:40:18.342905] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-16T17:40:18.555384] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T17:40:18.596507] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T17:40:19.142895] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-16T17:40:19.596320] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T17:40:19.602380] [INFO ] [REMOTE ] BKU: Full fetch complete (60782 records). [2025-10-16T17:40:19.602519] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-16T17:40:19.947235] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-16T17:40:19.986260] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-16T17:40:19.986374] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-16T17:40:19.987112] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-16T17:40:19.987176] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-16T17:40:19.988357] [DEBUG] [LOCAL ] BKU: Trimmed 60782 records to 42528 (keeping 200 days of data) [2025-10-16T17:40:20.240999] [DEBUG] [LOCAL ] BKU: Primary data saved (42528 records). [2025-10-16T17:40:20.241119] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-16T17:40:20.241862] [INFO ] [MAIN ] Update Progress: 295/2369 symbols completed. BKU took 42.4s. Estimated remaining: 4h 43m 10s. Rate: 7.3 symbols/min [2025-10-16T17:40:20.412347] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:20.427715] [DEBUG] [LOCAL ] BLE: Loaded 13810 existing records from primary storage. [2025-10-16T17:40:20.427969] [INFO ] [MAIN ] BLE: Loaded 13810 existing records. [2025-10-16T17:40:20.602168] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:40:20.602344] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-16T17:40:20.602390] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-16T17:40:20.602555] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-16T17:40:20.602610] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-16T17:40:20.743981] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-16T17:40:20.961573] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:20.999444] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-16T17:40:21.019875] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T17:40:21.024059] [INFO ] [REMOTE ] BLCO: Full fetch complete (52331 records). [2025-10-16T17:40:21.024148] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-16T17:40:21.402060] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-16T17:40:21.402134] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-16T17:40:21.402783] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-16T17:40:21.402844] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-16T17:40:21.403865] [DEBUG] [LOCAL ] BLCO: Trimmed 52331 records to 35460 (keeping 200 days of data) [2025-10-16T17:40:21.551309] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-16T17:40:21.603523] [DEBUG] [LOCAL ] BLCO: Primary data saved (35460 records). [2025-10-16T17:40:21.603635] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-16T17:40:21.603782] [INFO ] [MAIN ] Update Progress: 296/2369 symbols completed. BLCO took 32.0s. Estimated remaining: 4h 42m 14s. Rate: 7.3 symbols/min [2025-10-16T17:40:21.771788] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:21.803868] [DEBUG] [LOCAL ] BLK: Loaded 34301 existing records from primary storage. [2025-10-16T17:40:21.804139] [INFO ] [MAIN ] BLK: Loaded 34301 existing records. [2025-10-16T17:40:21.985718] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:40:21.985958] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-16T17:40:21.986015] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-16T17:40:21.986264] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-16T17:40:21.986338] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-16T17:40:22.345609] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-16T17:40:22.349483] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:22.379073] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T17:40:22.774892] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-16T17:40:23.142895] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-16T17:40:23.696213] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T17:40:23.710743] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-16T17:40:23.942886] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-16T17:40:24.742789] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-16T17:40:24.831000] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T17:40:25.542811] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-16T17:40:26.276750] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T17:40:26.342836] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-16T17:40:26.532463] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T17:40:27.142789] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-16T17:40:27.307067] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-16T17:40:27.942869] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-16T17:40:28.742864] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-16T17:40:28.935571] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T17:40:29.034913] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T17:40:29.542872] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-16T17:40:29.934530] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T17:40:29.937878] [INFO ] [REMOTE ] BLD: Full fetch complete (39928 records). [2025-10-16T17:40:29.937977] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-16T17:40:30.306677] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-16T17:40:30.306773] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-16T17:40:30.307301] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-16T17:40:30.307342] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-16T17:40:30.308308] [DEBUG] [LOCAL ] BLD: Trimmed 39928 records to 27593 (keeping 200 days of data) [2025-10-16T17:40:30.361395] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-16T17:40:30.480513] [DEBUG] [LOCAL ] BLD: Primary data saved (27593 records). [2025-10-16T17:40:30.480689] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-16T17:40:30.480787] [INFO ] [MAIN ] Update Progress: 297/2369 symbols completed. BLD took 24.2s. Estimated remaining: 4h 42m 10s. Rate: 7.3 symbols/min [2025-10-16T17:40:30.651064] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:30.695097] [DEBUG] [LOCAL ] BLND: Loaded 49281 existing records from primary storage. [2025-10-16T17:40:30.695420] [INFO ] [MAIN ] BLND: Loaded 49281 existing records. [2025-10-16T17:40:30.874439] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:40:30.874712] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-16T17:40:30.874778] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-16T17:40:30.875243] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-16T17:40:30.875301] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-16T17:40:31.152757] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-16T17:40:31.250729] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:31.364720] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T17:40:31.805452] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-16T17:40:31.859636] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T17:40:31.942809] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-16T17:40:32.742858] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-16T17:40:33.453981] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T17:40:33.542815] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-16T17:40:33.798639] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T17:40:34.342851] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-16T17:40:35.099530] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T17:40:35.142775] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-16T17:40:35.942798] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-16T17:40:36.189346] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-16T17:40:36.742868] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-16T17:40:36.808888] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-16T17:40:36.981497] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T17:40:37.542863] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-16T17:40:38.342842] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-16T17:40:38.759219] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T17:40:39.142862] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-16T17:40:39.304084] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T17:40:39.809203] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T17:40:39.942837] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-16T17:40:40.742872] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-16T17:40:40.899255] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T17:40:41.131849] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-16T17:40:41.542834] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-16T17:40:42.342832] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-16T17:40:42.390164] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T17:40:43.142786] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-16T17:40:43.168733] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T17:40:43.851995] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T17:40:43.942831] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-16T17:40:44.330475] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T17:40:44.742797] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-16T17:40:45.542896] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-16T17:40:45.937061] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-16T17:40:45.947520] [INFO ] [REMOTE ] BLDR: Full fetch complete (74728 records). [2025-10-16T17:40:45.947818] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-16T17:40:46.350944] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-16T17:40:46.409507] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-16T17:40:46.505929] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-16T17:40:46.506043] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-16T17:40:46.506952] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-16T17:40:46.507070] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-16T17:40:46.509076] [DEBUG] [LOCAL ] BLDR: Trimmed 74728 records to 52281 (keeping 200 days of data) [2025-10-16T17:40:46.533916] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T17:40:46.855956] [DEBUG] [LOCAL ] BLDR: Primary data saved (52281 records). [2025-10-16T17:40:46.856094] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-16T17:40:46.856516] [INFO ] [MAIN ] Update Progress: 298/2369 symbols completed. BLDR took 40.1s. Estimated remaining: 4h 42m 59s. Rate: 7.3 symbols/min [2025-10-16T17:40:47.047329] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:47.047547] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-16T17:40:47.047593] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-16T17:40:47.047730] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-16T17:40:47.047775] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-16T17:40:47.047819] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-16T17:40:47.047851] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-16T17:40:47.147921] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-16T17:40:47.406740] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:47.738801] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T17:40:47.942836] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-16T17:40:48.036993] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T17:40:48.742865] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-16T17:40:48.918203] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:40:48.918502] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-16T17:40:48.918596] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:40:48.918668] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-16T17:40:48.918724] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:40:48.918790] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-16T17:40:48.918852] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-16T17:40:48.918888] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-16T17:40:48.918927] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-16T17:40:48.918998] [INFO ] [MAIN ] Update Progress: 299/2369 symbols completed. BLSH took 2.1s. Estimated remaining: 4h 42m 9s. Rate: 7.3 symbols/min [2025-10-16T17:40:49.101118] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:49.120599] [DEBUG] [LOCAL ] BLW: Loaded 13190 existing records from primary storage. [2025-10-16T17:40:49.120962] [INFO ] [MAIN ] BLW: Loaded 13190 existing records. [2025-10-16T17:40:49.318594] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:40:49.319298] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-16T17:40:49.319480] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-16T17:40:49.326114] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-16T17:40:49.336461] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-16T17:40:49.374564] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T17:40:49.549248] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-16T17:40:49.773393] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:50.342862] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-16T17:40:51.027365] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T17:40:51.142835] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-16T17:40:51.265923] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T17:40:51.942885] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-16T17:40:52.742825] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-16T17:40:52.806285] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T17:40:52.905755] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T17:40:53.542806] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-16T17:40:54.304740] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T17:40:54.342793] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-16T17:40:54.392318] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T17:40:54.394293] [INFO ] [REMOTE ] BLE: Full fetch complete (19796 records). [2025-10-16T17:40:54.394369] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-16T17:40:54.748291] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-16T17:40:54.748369] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-16T17:40:54.748762] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-16T17:40:54.748823] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-16T17:40:54.749387] [DEBUG] [LOCAL ] BLE: Trimmed 19796 records to 13880 (keeping 200 days of data) [2025-10-16T17:40:54.829099] [DEBUG] [LOCAL ] BLE: Primary data saved (13880 records). [2025-10-16T17:40:54.829265] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-16T17:40:54.829351] [INFO ] [MAIN ] Update Progress: 300/2369 symbols completed. BLE took 34.6s. Estimated remaining: 4h 41m 45s. Rate: 7.3 symbols/min [2025-10-16T17:40:54.992455] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:55.008249] [DEBUG] [LOCAL ] BLX: Loaded 15583 existing records from primary storage. [2025-10-16T17:40:55.008472] [INFO ] [MAIN ] BLX: Loaded 15583 existing records. [2025-10-16T17:40:55.147069] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-16T17:40:55.182022] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:40:55.182178] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-16T17:40:55.182224] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-16T17:40:55.182425] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-16T17:40:55.182482] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-16T17:40:55.580040] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:55.942832] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-16T17:40:55.990365] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T17:40:56.034405] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T17:40:56.039497] [INFO ] [REMOTE ] BLK: Full fetch complete (52996 records). [2025-10-16T17:40:56.039588] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-16T17:40:56.418196] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-16T17:40:56.418292] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-16T17:40:56.419071] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-16T17:40:56.419132] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-16T17:40:56.420161] [DEBUG] [LOCAL ] BLK: Trimmed 52996 records to 34632 (keeping 200 days of data) [2025-10-16T17:40:56.643068] [DEBUG] [LOCAL ] BLK: Primary data saved (34632 records). [2025-10-16T17:40:56.643185] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-16T17:40:56.643256] [INFO ] [MAIN ] Update Progress: 301/2369 symbols completed. BLK took 35.0s. Estimated remaining: 4h 40m 53s. Rate: 7.4 symbols/min [2025-10-16T17:40:56.745481] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-16T17:40:56.822527] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:56.836588] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-16T17:40:56.870366] [DEBUG] [LOCAL ] BMA: Loaded 36165 existing records from primary storage. [2025-10-16T17:40:56.870683] [INFO ] [MAIN ] BMA: Loaded 36165 existing records. [2025-10-16T17:40:57.042981] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:40:57.043168] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-16T17:40:57.043214] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-16T17:40:57.043386] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-16T17:40:57.043424] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-16T17:40:57.388451] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:57.542777] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-16T17:40:57.777928] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T17:40:58.342852] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-16T17:40:58.989437] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T17:40:59.142831] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-16T17:40:59.942834] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-16T17:40:59.990358] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T17:41:00.668513] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T17:41:00.742776] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-16T17:41:00.818598] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-16T17:41:01.542849] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-16T17:41:02.259597] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T17:41:02.342774] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-16T17:41:02.519252] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T17:41:03.142832] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-16T17:41:03.942782] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-16T17:41:04.421769] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-16T17:41:04.537597] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T17:41:04.742799] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-16T17:41:04.945679] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T17:41:05.542804] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-16T17:41:06.215790] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T17:41:06.342786] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-16T17:41:06.423262] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T17:41:07.142827] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-16T17:41:07.853993] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T17:41:07.942796] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-16T17:41:08.742826] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-16T17:41:08.789889] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T17:41:09.473796] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T17:41:09.542803] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-16T17:41:09.565459] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-16T17:41:10.342984] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-16T17:41:10.693351] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T17:41:11.142814] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-16T17:41:11.942815] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-16T17:41:11.964512] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-16T17:41:12.222637] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T17:41:12.229251] [INFO ] [REMOTE ] BLND: Full fetch complete (72304 records). [2025-10-16T17:41:12.229388] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-16T17:41:12.608007] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-16T17:41:12.608129] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-16T17:41:12.608944] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-16T17:41:12.609026] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-16T17:41:12.610387] [DEBUG] [LOCAL ] BLND: Trimmed 72304 records to 49649 (keeping 200 days of data) [2025-10-16T17:41:12.762828] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-16T17:41:12.832059] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-16T17:41:12.902140] [DEBUG] [LOCAL ] BLND: Primary data saved (49649 records). [2025-10-16T17:41:12.902283] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-16T17:41:12.902880] [INFO ] [MAIN ] Update Progress: 302/2369 symbols completed. BLND took 42.4s. Estimated remaining: 4h 41m 40s. Rate: 7.3 symbols/min [2025-10-16T17:41:13.066782] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:41:13.080425] [DEBUG] [LOCAL ] BME: Loaded 11286 existing records from primary storage. [2025-10-16T17:41:13.080674] [INFO ] [MAIN ] BME: Loaded 11286 existing records. [2025-10-16T17:41:13.253147] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:41:13.253406] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-16T17:41:13.253472] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-16T17:41:13.253738] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-16T17:41:13.253796] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-16T17:41:13.547916] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-16T17:41:13.641176] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:41:14.167606] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T17:41:14.342838] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-16T17:41:14.491212] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T17:41:15.142818] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-16T17:41:15.871913] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T17:41:15.889707] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T17:41:15.942773] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-16T17:41:16.742786] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-16T17:41:16.811700] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T17:41:17.542791] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-16T17:41:17.658437] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-16T17:41:18.342815] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-16T17:41:18.394239] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T17:41:19.142807] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-16T17:41:19.753236] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T17:41:19.771531] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-16T17:41:19.942800] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-16T17:41:20.742876] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-16T17:41:20.754832] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T17:41:20.757882] [INFO ] [REMOTE ] BLW: Full fetch complete (19227 records). [2025-10-16T17:41:20.758003] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-16T17:41:21.134785] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-16T17:41:21.134872] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-16T17:41:21.135234] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-16T17:41:21.135275] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-16T17:41:21.135951] [DEBUG] [LOCAL ] BLW: Trimmed 19227 records to 13261 (keeping 200 days of data) [2025-10-16T17:41:21.219280] [DEBUG] [LOCAL ] BLW: Primary data saved (13261 records). [2025-10-16T17:41:21.219429] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-16T17:41:21.219508] [INFO ] [MAIN ] Update Progress: 303/2369 symbols completed. BLW took 32.3s. Estimated remaining: 4h 41m 33s. Rate: 7.3 symbols/min [2025-10-16T17:41:21.395969] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:41:21.396956] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T17:41:21.424062] [DEBUG] [LOCAL ] BMEZ: Loaded 25911 existing records from primary storage. [2025-10-16T17:41:21.424357] [INFO ] [MAIN ] BMEZ: Loaded 25911 existing records. [2025-10-16T17:41:21.547934] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-16T17:41:21.599677] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:41:21.599952] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-16T17:41:21.600022] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-16T17:41:21.600203] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-16T17:41:21.600241] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-16T17:41:21.951956] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:41:22.342816] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-16T17:41:22.505359] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T17:41:22.896223] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-16T17:41:23.142787] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-16T17:41:23.936536] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T17:41:23.942761] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-16T17:41:24.738271] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T17:41:24.742768] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-16T17:41:25.395315] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-16T17:41:25.542798] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-16T17:41:26.342822] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-16T17:41:26.551850] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T17:41:27.010217] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-16T17:41:27.142806] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-16T17:41:27.942827] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-16T17:41:27.993511] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-16T17:41:28.742813] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-16T17:41:28.974221] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T17:41:29.542812] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-16T17:41:29.584390] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T17:41:30.342789] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-16T17:41:30.382263] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T17:41:31.142830] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-16T17:41:31.942819] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-16T17:41:32.060681] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T17:41:32.067037] [INFO ] [REMOTE ] BMA: Full fetch complete (51993 records). [2025-10-16T17:41:32.067173] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-16T17:41:32.484904] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T17:41:32.549735] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-16T17:41:32.549844] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-16T17:41:32.550702] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-16T17:41:32.550772] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-16T17:41:32.551968] [DEBUG] [LOCAL ] BMA: Trimmed 51993 records to 36440 (keeping 200 days of data) [2025-10-16T17:41:32.747735] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-16T17:41:32.807322] [DEBUG] [LOCAL ] BMA: Primary data saved (36440 records). [2025-10-16T17:41:32.807504] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-16T17:41:32.807616] [INFO ] [MAIN ] Update Progress: 304/2369 symbols completed. BMA took 36.2s. Estimated remaining: 4h 41m 48s. Rate: 7.3 symbols/min [2025-10-16T17:41:32.945532] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T17:41:32.969862] [INFO ] [REMOTE ] BLX: Full fetch complete (22473 records). [2025-10-16T17:41:32.983321] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-16T17:41:33.099737] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:41:33.348604] [DEBUG] [LOCAL ] BMI: Loaded 24500 existing records from primary storage. [2025-10-16T17:41:33.364744] [INFO ] [MAIN ] BMI: Loaded 24500 existing records. [2025-10-16T17:41:33.544282] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-16T17:41:33.552033] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-16T17:41:33.557313] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-16T17:41:33.568688] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-16T17:41:33.586716] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-16T17:41:33.609329] [DEBUG] [LOCAL ] BLX: Trimmed 22473 records to 15678 (keeping 200 days of data) [2025-10-16T17:41:33.631497] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:41:33.632085] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-16T17:41:33.632137] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-16T17:41:33.632326] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-16T17:41:33.632364] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-16T17:41:34.021798] [DEBUG] [LOCAL ] BLX: Primary data saved (15678 records). [2025-10-16T17:41:34.041924] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-16T17:41:34.042148] [INFO ] [MAIN ] Update Progress: 305/2369 symbols completed. BLX took 39.2s. Estimated remaining: 4h 40m 53s. Rate: 7.3 symbols/min [2025-10-16T17:41:34.225002] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:41:34.332157] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:41:34.333708] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T17:41:34.343037] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-16T17:41:34.346308] [DEBUG] [LOCAL ] BMN: Loaded 2596 existing records from primary storage. [2025-10-16T17:41:34.346597] [INFO ] [MAIN ] BMN: Loaded 2596 existing records. [2025-10-16T17:41:34.464421] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T17:41:34.517073] [INFO ] [REMOTE ] BME: Full fetch complete (15959 records). [2025-10-16T17:41:34.533419] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-16T17:41:34.537038] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:41:34.537568] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-16T17:41:34.569462] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-16T17:41:34.608029] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-16T17:41:34.630634] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-16T17:41:35.146905] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-16T17:41:35.272187] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:41:35.302921] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-16T17:41:35.303098] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-16T17:41:35.303461] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-16T17:41:35.303504] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-16T17:41:35.304044] [DEBUG] [LOCAL ] BME: Trimmed 15959 records to 11376 (keeping 200 days of data) [2025-10-16T17:41:35.371008] [DEBUG] [LOCAL ] BME: Primary data saved (11376 records). [2025-10-16T17:41:35.371142] [INFO ] [MAIN ] BME: Full history saved. [2025-10-16T17:41:35.371225] [INFO ] [MAIN ] Update Progress: 306/2369 symbols completed. BME took 22.5s. Estimated remaining: 4h 39m 59s. Rate: 7.4 symbols/min [2025-10-16T17:41:35.558478] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:41:35.560272] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T17:41:35.609441] [DEBUG] [LOCAL ] BMO: Loaded 41237 existing records from primary storage. [2025-10-16T17:41:35.609803] [INFO ] [MAIN ] BMO: Loaded 41237 existing records. [2025-10-16T17:41:35.806491] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:41:35.806770] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-16T17:41:35.806825] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-16T17:41:35.807232] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-16T17:41:35.807271] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-16T17:41:35.948045] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-16T17:41:36.162152] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:41:36.387403] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T17:41:36.453005] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-16T17:41:36.742831] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-16T17:41:37.326827] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T17:41:37.542786] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-16T17:41:38.342873] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-16T17:41:38.401758] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T17:41:38.775698] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T17:41:39.142798] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-16T17:41:39.577184] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-16T17:41:39.942810] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-16T17:41:40.488777] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-16T17:41:40.742839] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-16T17:41:41.542895] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-16T17:41:41.911967] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T17:41:42.006287] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-16T17:41:42.342899] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-16T17:41:42.676392] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-16T17:41:43.142830] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-16T17:41:43.604410] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T17:41:43.942891] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-16T17:41:44.742848] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-16T17:41:45.542860] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-16T17:41:45.544401] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T17:41:45.850111] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T17:41:46.342891] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-16T17:41:46.981279] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T17:41:47.142847] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-16T17:41:47.409303] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T17:41:47.942851] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-16T17:41:48.062500] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-16T17:41:48.742847] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-16T17:41:49.339817] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T17:41:49.542841] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-16T17:41:49.777441] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T17:41:50.342847] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-16T17:41:50.828525] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T17:41:50.887386] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-16T17:41:51.142827] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-16T17:41:51.736699] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-16T17:41:51.942863] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-16T17:41:52.742867] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-16T17:41:53.315819] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T17:41:53.542874] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-16T17:41:54.342800] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-16T17:41:54.419567] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T17:41:54.665167] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T17:41:55.142857] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-16T17:41:55.443734] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T17:41:55.942855] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-16T17:41:56.553415] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T17:41:56.742881] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-16T17:41:57.299188] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T17:41:57.503101] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T17:41:57.542829] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-16T17:41:58.342886] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-16T17:41:58.864408] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T17:41:59.142836] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-16T17:41:59.542748] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-16T17:41:59.543589] [INFO ] [REMOTE ] BMN: Full fetch complete (3728 records). [2025-10-16T17:41:59.543681] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-16T17:41:59.848303] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T17:41:59.932579] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-16T17:41:59.932680] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-16T17:41:59.932805] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-16T17:41:59.932898] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-16T17:41:59.933270] [DEBUG] [LOCAL ] BMN: Trimmed 3728 records to 2621 (keeping 200 days of data) [2025-10-16T17:41:59.945136] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-16T17:41:59.950581] [DEBUG] [LOCAL ] BMN: Primary data saved (2621 records). [2025-10-16T17:41:59.950670] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-16T17:41:59.950760] [INFO ] [MAIN ] Update Progress: 307/2369 symbols completed. BMN took 25.9s. Estimated remaining: 4h 41m 41s. Rate: 7.3 symbols/min [2025-10-16T17:42:00.121639] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:42:00.170624] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-16T17:42:00.170947] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-16T17:42:00.346297] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:42:00.346487] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-16T17:42:00.346532] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-16T17:42:00.346788] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-16T17:42:00.346843] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-16T17:42:00.698003] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:42:00.742767] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-16T17:42:01.542831] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-16T17:42:01.738918] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T17:42:02.342803] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-16T17:42:02.448385] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T17:42:02.623535] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T17:42:03.142841] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-16T17:42:03.411082] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T17:42:03.942887] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-16T17:42:04.572284] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-16T17:42:04.742861] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-16T17:42:05.466216] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T17:42:05.542838] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-16T17:42:06.110143] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T17:42:06.114007] [INFO ] [REMOTE ] BMI: Full fetch complete (33526 records). [2025-10-16T17:42:06.114140] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-16T17:42:06.348012] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-16T17:42:06.505274] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-16T17:42:06.505383] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-16T17:42:06.505993] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-16T17:42:06.506082] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-16T17:42:06.523598] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T17:42:06.529679] [DEBUG] [LOCAL ] BMI: Trimmed 33526 records to 24756 (keeping 200 days of data) [2025-10-16T17:42:06.687483] [DEBUG] [LOCAL ] BMI: Primary data saved (24756 records). [2025-10-16T17:42:06.687623] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-16T17:42:06.687738] [INFO ] [MAIN ] Update Progress: 308/2369 symbols completed. BMI took 33.9s. Estimated remaining: 4h 41m 23s. Rate: 7.3 symbols/min [2025-10-16T17:42:06.872209] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:42:06.923024] [DEBUG] [LOCAL ] BN: Loaded 52988 existing records from primary storage. [2025-10-16T17:42:06.923396] [INFO ] [MAIN ] BN: Loaded 52988 existing records. [2025-10-16T17:42:07.107141] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:42:07.107351] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-16T17:42:07.107398] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-16T17:42:07.107691] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-16T17:42:07.107746] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-16T17:42:07.149431] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-16T17:42:07.460861] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:42:07.942835] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-16T17:42:08.059256] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T17:42:08.557504] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T17:42:08.561434] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40188 records). [2025-10-16T17:42:08.561565] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-16T17:42:08.755275] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-16T17:42:08.958238] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-16T17:42:08.958352] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-16T17:42:08.958959] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-16T17:42:08.959334] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-16T17:42:08.960497] [DEBUG] [LOCAL ] BMEZ: Trimmed 40188 records to 26080 (keeping 200 days of data) [2025-10-16T17:42:09.136425] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26080 records). [2025-10-16T17:42:09.136581] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-16T17:42:09.136712] [INFO ] [MAIN ] Update Progress: 309/2369 symbols completed. BMEZ took 47.9s. Estimated remaining: 4h 40m 36s. Rate: 7.3 symbols/min [2025-10-16T17:42:09.308569] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:42:09.338687] [DEBUG] [LOCAL ] BNED: Loaded 28621 existing records from primary storage. [2025-10-16T17:42:09.339050] [INFO ] [MAIN ] BNED: Loaded 28621 existing records. [2025-10-16T17:42:09.527729] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:42:09.528076] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-16T17:42:09.528261] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-16T17:42:09.528689] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-16T17:42:09.528771] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-16T17:42:09.550161] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-16T17:42:09.932343] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:42:09.926227] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-16T17:42:10.342828] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-16T17:42:10.735893] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-16T17:42:10.820960] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-16T17:42:10.826340] [INFO ] [REMOTE ] BMO: Full fetch complete (59963 records). [2025-10-16T17:42:10.826475] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-16T17:42:11.151363] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-16T17:42:11.207926] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-16T17:42:11.208009] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-16T17:42:11.208802] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-16T17:42:11.208867] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-16T17:42:11.210133] [DEBUG] [LOCAL ] BMO: Trimmed 59963 records to 41606 (keeping 200 days of data) [2025-10-16T17:42:11.483959] [DEBUG] [LOCAL ] BMO: Primary data saved (41606 records). [2025-10-16T17:42:11.484213] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-16T17:42:11.484344] [INFO ] [MAIN ] Update Progress: 310/2369 symbols completed. BMO took 36.1s. Estimated remaining: 4h 39m 49s. Rate: 7.4 symbols/min [2025-10-16T17:42:11.677926] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:42:11.678225] [DEBUG] [LOCAL ] BNH: No existing data file found in primary storage. [2025-10-16T17:42:11.678336] [WARN ] [MAIN ] BNH: No existing data found, performing full refresh instead. [2025-10-16T17:42:11.678478] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-16T17:42:11.678611] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-16T17:42:11.678714] [DEBUG] [LOCAL ] BNH: No primary data file found to delete. [2025-10-16T17:42:11.678760] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-16T17:42:11.809032] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T17:42:11.951803] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-16T17:42:12.068895] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:42:12.742868] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-16T17:42:13.273307] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-16T17:42:13.365588] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T17:42:13.522795] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-16T17:42:13.542763] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-16T17:42:14.084820] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-16T17:42:14.342829] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-16T17:42:14.799877] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-16T17:42:15.142829] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-16T17:42:15.942851] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-16T17:42:16.529318] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-16T17:42:16.742822] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-16T17:42:16.882147] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T17:42:17.542817] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-16T17:42:18.342799] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-16T17:42:18.658895] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T17:42:18.909083] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T17:42:19.018585] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T17:42:19.142777] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-16T17:42:19.942830] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-16T17:42:20.742837] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-16T17:42:20.816165] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T17:42:21.299401] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-16T17:42:21.542878] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-16T17:42:22.342837] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-16T17:42:22.506795] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-16T17:42:22.531467] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T17:42:23.142875] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-16T17:42:23.942790] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-16T17:42:23.990302] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T17:42:24.742869] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-16T17:42:25.285992] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-16T17:42:25.318859] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T17:42:25.542852] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-16T17:42:26.351993] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-16T17:42:26.371366] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T17:42:26.432918] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T17:42:27.142812] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-16T17:42:27.942856] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-16T17:42:28.232217] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T17:42:28.288432] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T17:42:28.509989] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T17:42:28.742881] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-16T17:42:29.276996] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-16T17:42:29.542897] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-16T17:42:30.150624] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T17:42:30.342875] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-16T17:42:31.142813] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-16T17:42:31.535184] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T17:42:31.942857] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-16T17:42:32.510708] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-16T17:42:32.742847] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-16T17:42:33.156138] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T17:42:33.542818] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-16T17:42:34.342888] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-16T17:42:34.960447] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-16T17:42:35.023344] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T17:42:35.142843] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-16T17:42:35.942885] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-16T17:42:36.081217] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T17:42:36.682251] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T17:42:36.742814] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-16T17:42:37.542924] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-16T17:42:37.997862] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T17:42:38.150293] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-16T17:42:38.206007] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T17:42:38.342834] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-16T17:42:39.142929] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-16T17:42:39.942804] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-16T17:42:40.078139] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T17:42:40.081431] [INFO ] [REMOTE ] BNED: Full fetch complete (42514 records). [2025-10-16T17:42:40.081555] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-16T17:42:40.485720] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-16T17:42:40.512724] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-16T17:42:40.513142] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-16T17:42:40.514004] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-16T17:42:40.514089] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-16T17:42:40.515550] [DEBUG] [LOCAL ] BNED: Trimmed 42514 records to 28780 (keeping 200 days of data) [2025-10-16T17:42:40.673295] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T17:42:40.679369] [INFO ] [REMOTE ] BNH: Full fetch complete (6888 records). [2025-10-16T17:42:40.684527] [DEBUG] [LOCAL ] BNED: Primary data saved (28780 records). [2025-10-16T17:42:40.684638] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-16T17:42:40.684980] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-16T17:42:40.685168] [INFO ] [MAIN ] Update Progress: 311/2369 symbols completed. BNED took 31.5s. Estimated remaining: 4h 42m 1s. Rate: 7.3 symbols/min [2025-10-16T17:42:40.748152] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-16T17:42:41.067986] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:42:41.187768] [DEBUG] [LOCAL ] BNJ: Loaded 2607 existing records from primary storage. [2025-10-16T17:42:41.198752] [INFO ] [MAIN ] BNJ: Loaded 2607 existing records. [2025-10-16T17:42:41.401035] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-16T17:42:41.406285] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-16T17:42:41.406561] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-16T17:42:41.411766] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-16T17:42:41.463700] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:42:41.464795] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-16T17:42:41.465027] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-16T17:42:41.464931] [DEBUG] [LOCAL ] BNH: Trimmed 6888 records to 5044 (keeping 200 days of data) [2025-10-16T17:42:41.465480] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-16T17:42:41.465811] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-16T17:42:41.546484] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-16T17:42:41.599886] [DEBUG] [LOCAL ] BNH: Primary data saved (5044 records). [2025-10-16T17:42:41.603734] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-16T17:42:41.604144] [INFO ] [MAIN ] Update Progress: 312/2369 symbols completed. BNH took 30.1s. Estimated remaining: 4h 41m 4s. Rate: 7.3 symbols/min [2025-10-16T17:42:41.980591] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:42:42.044446] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:42:42.085974] [DEBUG] [LOCAL ] BNL: Loaded 47279 existing records from primary storage. [2025-10-16T17:42:42.086280] [INFO ] [MAIN ] BNL: Loaded 47279 existing records. [2025-10-16T17:42:42.265880] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:42:42.266096] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-16T17:42:42.266143] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-16T17:42:42.266573] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-16T17:42:42.266629] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-16T17:42:42.354073] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-16T17:42:42.653392] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:42:42.718481] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-16T17:42:42.725251] [INFO ] [REMOTE ] BN: Full fetch complete (76560 records). [2025-10-16T17:42:42.725434] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-16T17:42:42.726249] [FATAL] [VALIDATOR ] BN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:42:42.726372] [FATAL] [MAIN ] BN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:42:42.726415] [WARN ] [MAIN ] BN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:42:42.726454] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-16T17:42:42.726513] [DEBUG] [LOCAL ] BN: No primary data file found to delete. [2025-10-16T17:42:42.726548] [INFO ] [LOCAL ] BN: Starting deletion of derivative data. [2025-10-16T17:42:42.726752] [DEBUG] [LOCAL ] BN: Deleted derivative data file. [2025-10-16T17:42:42.726853] [INFO ] [MAIN ] Update Progress: 313/2369 symbols completed. BN took 36.0s. Estimated remaining: 4h 40m 10s. Rate: 7.3 symbols/min [2025-10-16T17:42:42.907352] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:42:42.961733] [DEBUG] [LOCAL ] BNS: Loaded 51484 existing records from primary storage. [2025-10-16T17:42:42.962115] [INFO ] [MAIN ] BNS: Loaded 51484 existing records. [2025-10-16T17:42:43.097471] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T17:42:43.147962] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-16T17:42:43.182356] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:42:43.182781] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-16T17:42:43.182839] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-16T17:42:43.183299] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-16T17:42:43.183378] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-16T17:42:43.607508] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:42:43.655510] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-16T17:42:43.942801] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-16T17:42:44.636971] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T17:42:44.643779] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-16T17:42:44.643906] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-16T17:42:44.744635] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-16T17:42:45.002305] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T17:42:45.080630] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-16T17:42:45.080736] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-16T17:42:45.081624] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-16T17:42:45.081697] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-16T17:42:45.083173] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 54147 (keeping 200 days of data) [2025-10-16T17:42:45.412549] [DEBUG] [LOCAL ] BMY: Primary data saved (54147 records). [2025-10-16T17:42:45.412716] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-16T17:42:45.413791] [INFO ] [MAIN ] Update Progress: 314/2369 symbols completed. BMY took 45.5s. Estimated remaining: 4h 39m 25s. Rate: 7.4 symbols/min [2025-10-16T17:42:45.547985] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-16T17:42:45.606415] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:42:45.613485] [DEBUG] [LOCAL ] BNT: Loaded 3485 existing records from primary storage. [2025-10-16T17:42:45.613772] [INFO ] [MAIN ] BNT: Loaded 3485 existing records. [2025-10-16T17:42:45.806670] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:42:45.806924] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-16T17:42:45.806974] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-16T17:42:45.807483] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-16T17:42:45.807550] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-16T17:42:46.162930] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T17:42:46.280974] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:42:46.342824] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-16T17:42:46.500669] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T17:42:46.757478] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-16T17:42:47.142872] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-16T17:42:47.604700] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-16T17:42:47.942835] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-16T17:42:48.387499] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T17:42:48.742809] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-16T17:42:49.313586] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-16T17:42:49.542876] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-16T17:42:50.166704] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-16T17:42:50.342801] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-16T17:42:50.886433] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-16T17:42:51.142812] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-16T17:42:51.590528] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-16T17:42:51.942815] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-16T17:42:52.388129] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T17:42:52.742860] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-16T17:42:53.542870] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-16T17:42:53.928155] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T17:42:54.100132] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T17:42:54.342834] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-16T17:42:54.735709] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-16T17:42:55.142811] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-16T17:42:55.485499] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-16T17:42:55.942831] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-16T17:42:56.742871] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-16T17:42:57.446334] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T17:42:57.542873] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-16T17:42:57.820873] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-16T17:42:58.145947] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T17:42:58.342802] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-16T17:42:59.142843] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-16T17:42:59.710349] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T17:42:59.942825] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-16T17:42:59.971263] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T17:43:00.402990] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T17:43:00.742805] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-16T17:43:01.542909] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-16T17:43:01.995350] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T17:43:02.301234] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T17:43:02.342839] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-16T17:43:03.142816] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-16T17:43:03.582471] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-16T17:43:03.940403] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T17:43:03.950567] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-16T17:43:04.556968] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-16T17:43:04.742868] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-16T17:43:05.380637] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-16T17:43:05.542817] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-16T17:43:06.342873] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-16T17:43:06.991046] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-16T17:43:06.992222] [INFO ] [REMOTE ] BNT: Full fetch complete (4725 records). [2025-10-16T17:43:06.992290] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-16T17:43:07.163981] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-16T17:43:07.407324] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-16T17:43:07.407417] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-16T17:43:07.407557] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-16T17:43:07.407627] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-16T17:43:07.408268] [DEBUG] [LOCAL ] BNT: Trimmed 4725 records to 3543 (keeping 200 days of data) [2025-10-16T17:43:07.410043] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-16T17:43:07.440519] [DEBUG] [LOCAL ] BNT: Primary data saved (3543 records). [2025-10-16T17:43:07.440600] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-16T17:43:07.440689] [INFO ] [MAIN ] Update Progress: 315/2369 symbols completed. BNT took 22.0s. Estimated remaining: 4h 40m 48s. Rate: 7.3 symbols/min [2025-10-16T17:43:07.621753] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:43:07.630739] [DEBUG] [LOCAL ] BNY: Loaded 7182 existing records from primary storage. [2025-10-16T17:43:07.630923] [INFO ] [MAIN ] BNY: Loaded 7182 existing records. [2025-10-16T17:43:07.825095] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:43:07.825324] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-16T17:43:07.825372] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-16T17:43:07.825515] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-16T17:43:07.825555] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-16T17:43:07.947944] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-16T17:43:08.178085] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:43:08.742793] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-16T17:43:08.826041] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T17:43:09.357323] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-16T17:43:09.358632] [INFO ] [REMOTE ] BNJ: Full fetch complete (4100 records). [2025-10-16T17:43:09.358753] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-16T17:43:09.553844] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-16T17:43:09.729706] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-16T17:43:09.729879] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-16T17:43:09.730075] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-16T17:43:09.730184] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-16T17:43:09.730837] [DEBUG] [LOCAL ] BNJ: Trimmed 4100 records to 2620 (keeping 200 days of data) [2025-10-16T17:43:09.772735] [DEBUG] [LOCAL ] BNJ: Primary data saved (2620 records). [2025-10-16T17:43:09.772966] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-16T17:43:09.773076] [INFO ] [MAIN ] Update Progress: 316/2369 symbols completed. BNJ took 29.1s. Estimated remaining: 4h 40m 1s. Rate: 7.3 symbols/min [2025-10-16T17:43:09.781854] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T17:43:09.953239] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:43:09.972420] [DEBUG] [LOCAL ] BOC: Loaded 18587 existing records from primary storage. [2025-10-16T17:43:09.972622] [INFO ] [MAIN ] BOC: Loaded 18587 existing records. [2025-10-16T17:43:10.147111] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:43:10.147278] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-16T17:43:10.147325] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-16T17:43:10.147485] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-16T17:43:10.147524] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-16T17:43:10.274423] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-16T17:43:10.350354] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-16T17:43:10.506873] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:43:11.026901] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T17:43:11.142804] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-16T17:43:11.942911] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-16T17:43:12.387880] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T17:43:12.742810] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-16T17:43:13.348339] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T17:43:13.542843] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-16T17:43:14.342875] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-16T17:43:14.407802] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T17:43:14.437153] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T17:43:15.142825] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-16T17:43:15.523787] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T17:43:15.719566] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T17:43:15.942857] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-16T17:43:16.555141] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-16T17:43:16.742862] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-16T17:43:17.185202] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-16T17:43:17.542875] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-16T17:43:18.342812] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-16T17:43:19.114579] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T17:43:19.142777] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-16T17:43:19.168573] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-16T17:43:19.942805] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-16T17:43:20.742821] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-16T17:43:20.788749] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T17:43:20.856363] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T17:43:21.542834] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-16T17:43:22.342795] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-16T17:43:22.444956] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T17:43:22.480241] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-16T17:43:22.897747] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-16T17:43:23.142848] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-16T17:43:23.942835] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-16T17:43:24.742824] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-16T17:43:24.813444] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T17:43:24.868774] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-16T17:43:25.289208] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T17:43:25.542879] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-16T17:43:26.342852] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-16T17:43:27.142787] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-16T17:43:27.330282] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T17:43:27.661516] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T17:43:27.667847] [INFO ] [REMOTE ] BNL: Full fetch complete (67284 records). [2025-10-16T17:43:27.667953] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-16T17:43:27.948777] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-16T17:43:27.977231] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T17:43:28.099516] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-16T17:43:28.099603] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-16T17:43:28.100515] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-16T17:43:28.100579] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-16T17:43:28.101899] [DEBUG] [LOCAL ] BNL: Trimmed 67284 records to 47629 (keeping 200 days of data) [2025-10-16T17:43:28.382531] [DEBUG] [LOCAL ] BNL: Primary data saved (47629 records). [2025-10-16T17:43:28.382680] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-16T17:43:28.382772] [INFO ] [MAIN ] Update Progress: 317/2369 symbols completed. BNL took 46.8s. Estimated remaining: 4h 41m 1s. Rate: 7.3 symbols/min [2025-10-16T17:43:28.742878] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-16T17:43:29.542832] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-16T17:43:29.652393] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-16T17:43:29.772248] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T17:43:30.019239] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-16T17:43:30.342907] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-16T17:43:31.142814] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-16T17:43:31.942859] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-16T17:43:32.106316] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-16T17:43:32.127361] [INFO ] [REMOTE ] BNS: Full fetch complete (74644 records). [2025-10-16T17:43:32.128429] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T17:43:32.128011] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-16T17:43:32.551640] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-16T17:43:32.551893] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-16T17:43:32.558494] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T17:43:32.558253] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-16T17:43:32.561030] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-16T17:43:32.562688] [DEBUG] [LOCAL ] BNS: Trimmed 74644 records to 51872 (keeping 200 days of data) [2025-10-16T17:43:32.743712] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-16T17:43:32.878629] [DEBUG] [LOCAL ] BNS: Primary data saved (51872 records). [2025-10-16T17:43:32.878799] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-16T17:43:32.878893] [INFO ] [MAIN ] Update Progress: 318/2369 symbols completed. BNS took 50.2s. Estimated remaining: 4h 40m 28s. Rate: 7.3 symbols/min [2025-10-16T17:43:33.542842] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-16T17:43:33.819678] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-16T17:43:34.129084] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T17:43:34.131258] [INFO ] [REMOTE ] BNY: Full fetch complete (10326 records). [2025-10-16T17:43:34.131765] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-16T17:43:34.132915] [FATAL] [VALIDATOR ] BNY: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:43:34.133009] [FATAL] [MAIN ] BNY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:43:34.133054] [WARN ] [MAIN ] BNY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:43:34.133096] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-16T17:43:34.133155] [DEBUG] [LOCAL ] BNY: No primary data file found to delete. [2025-10-16T17:43:34.133193] [INFO ] [LOCAL ] BNY: Starting deletion of derivative data. [2025-10-16T17:43:34.133342] [DEBUG] [LOCAL ] BNY: Deleted derivative data file. [2025-10-16T17:43:34.133445] [INFO ] [MAIN ] Update Progress: 319/2369 symbols completed. BNY took 26.7s. Estimated remaining: 4h 39m 36s. Rate: 7.3 symbols/min [2025-10-16T17:43:34.342885] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-16T17:43:35.362064] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T17:43:35.366440] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-16T17:43:36.365186] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T17:43:36.368005] [INFO ] [REMOTE ] BOC: Full fetch complete (25921 records). [2025-10-16T17:43:36.368081] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-16T17:43:36.730092] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-16T17:43:36.730208] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-16T17:43:36.730708] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-16T17:43:36.730770] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-16T17:43:36.731494] [DEBUG] [LOCAL ] BOC: Trimmed 25921 records to 18699 (keeping 200 days of data) [2025-10-16T17:43:36.849276] [DEBUG] [LOCAL ] BOC: Primary data saved (18699 records). [2025-10-16T17:43:36.849605] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-16T17:43:36.849706] [INFO ] [MAIN ] Update Progress: 320/2369 symbols completed. BOC took 27.1s. Estimated remaining: 4h 38m 52s. Rate: 7.3 symbols/min [2025-10-16T17:43:37.556625] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:43:37.566771] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:43:37.588155] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:43:37.611438] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:43:37.659146] [DEBUG] [LOCAL ] BOE: Loaded 18229 existing records from primary storage. [2025-10-16T17:43:37.660114] [INFO ] [MAIN ] BOE: Loaded 18229 existing records. [2025-10-16T17:43:37.746268] [DEBUG] [LOCAL ] BOH: Loaded 30544 existing records from primary storage. [2025-10-16T17:43:37.777284] [INFO ] [MAIN ] BOH: Loaded 30544 existing records. [2025-10-16T17:43:37.756258] [DEBUG] [LOCAL ] BOND: Loaded 32426 existing records from primary storage. [2025-10-16T17:43:37.771635] [DEBUG] [LOCAL ] BOOT: Loaded 39827 existing records from primary storage. [2025-10-16T17:43:37.788502] [INFO ] [MAIN ] BOND: Loaded 32426 existing records. [2025-10-16T17:43:37.793852] [INFO ] [MAIN ] BOOT: Loaded 39827 existing records. [2025-10-16T17:43:38.226618] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:43:38.313069] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-16T17:43:38.313220] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-16T17:43:38.318516] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-16T17:43:38.362707] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-16T17:43:38.452267] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:43:38.501627] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-16T17:43:38.540496] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:43:38.563902] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-16T17:43:38.551245] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-16T17:43:38.641627] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:43:38.641959] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-16T17:43:38.642032] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-16T17:43:38.642108] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-16T17:43:38.642270] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-16T17:43:38.630918] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-16T17:43:38.653471] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-16T17:43:38.675037] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-16T17:43:38.680994] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-16T17:43:38.741915] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-16T17:43:39.952926] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:43:39.987475] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-16T17:43:40.237155] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:43:40.298702] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:43:40.299139] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-16T17:43:40.326247] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-16T17:43:40.330125] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:43:40.332580] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-16T17:43:41.041363] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-16T17:43:41.046536] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-16T17:43:41.304124] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T17:43:41.315104] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-16T17:43:41.695943] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T17:43:41.702867] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-16T17:43:41.848673] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T17:43:41.856881] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-16T17:43:41.869859] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T17:43:42.284986] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T17:43:42.342858] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-16T17:43:42.693977] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T17:43:43.142866] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-16T17:43:43.471213] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T17:43:43.573161] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T17:43:43.942878] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-16T17:43:44.406179] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T17:43:44.742836] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-16T17:43:44.987356] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T17:43:45.542877] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-16T17:43:46.158426] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T17:43:46.342872] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-16T17:43:46.917436] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T17:43:47.142824] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-16T17:43:47.668539] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T17:43:47.942819] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-16T17:43:48.433594] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T17:43:48.742865] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-16T17:43:49.248421] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T17:43:49.339578] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T17:43:49.542937] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-16T17:43:50.342834] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-16T17:43:51.142843] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-16T17:43:51.285145] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T17:43:51.423807] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T17:43:51.942853] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-16T17:43:52.328283] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T17:43:52.742847] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-16T17:43:53.394114] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T17:43:53.496606] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-16T17:43:53.542765] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-16T17:43:54.203612] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-16T17:43:54.342948] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-16T17:43:55.142818] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-16T17:43:55.349595] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T17:43:55.942813] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-16T17:43:56.629184] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T17:43:56.742833] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-16T17:43:56.976898] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T17:43:57.313325] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T17:43:57.542882] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-16T17:43:58.342853] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-16T17:43:59.014547] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T17:43:59.142863] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-16T17:43:59.207517] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-16T17:43:59.942875] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-16T17:44:00.495343] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T17:44:00.742820] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-16T17:44:01.368451] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T17:44:01.542784] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-16T17:44:02.278463] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T17:44:02.342796] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-16T17:44:02.846939] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-16T17:44:03.142820] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-16T17:44:03.422988] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-16T17:44:03.942788] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-16T17:44:04.076955] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T17:44:04.744636] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-16T17:44:04.746597] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T17:44:05.542790] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-16T17:44:06.241527] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T17:44:06.246052] [INFO ] [REMOTE ] BOH: Full fetch complete (45324 records). [2025-10-16T17:44:06.246212] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-16T17:44:06.350462] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-16T17:44:06.666921] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-16T17:44:06.667028] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-16T17:44:06.667620] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-16T17:44:06.667704] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-16T17:44:06.668699] [DEBUG] [LOCAL ] BOH: Trimmed 45324 records to 30879 (keeping 200 days of data) [2025-10-16T17:44:06.856702] [DEBUG] [LOCAL ] BOH: Primary data saved (30879 records). [2025-10-16T17:44:06.856949] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-16T17:44:06.857069] [INFO ] [MAIN ] Update Progress: 321/2369 symbols completed. BOH took 30.0s. Estimated remaining: 4h 41m 4s. Rate: 7.3 symbols/min [2025-10-16T17:44:06.992141] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-16T17:44:07.072390] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:44:07.072566] [DEBUG] [LOCAL ] BORR: No existing data file found in primary storage. [2025-10-16T17:44:07.072604] [WARN ] [MAIN ] BORR: No existing data found, performing full refresh instead. [2025-10-16T17:44:07.072739] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-16T17:44:07.072784] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-16T17:44:07.072830] [DEBUG] [LOCAL ] BORR: No primary data file found to delete. [2025-10-16T17:44:07.072863] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-16T17:44:07.147997] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-16T17:44:07.438208] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:44:07.929988] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T17:44:07.942765] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-16T17:44:08.307334] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T17:44:08.742863] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-16T17:44:09.352245] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T17:44:09.542871] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-16T17:44:10.342806] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-16T17:44:10.599902] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T17:44:10.603013] [INFO ] [REMOTE ] BOE: Full fetch complete (26771 records). [2025-10-16T17:44:10.603084] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-16T17:44:10.926697] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-16T17:44:11.025198] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-16T17:44:11.025288] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-16T17:44:11.025840] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-16T17:44:11.025903] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-16T17:44:11.026698] [DEBUG] [LOCAL ] BOE: Trimmed 26771 records to 18339 (keeping 200 days of data) [2025-10-16T17:44:11.135402] [DEBUG] [LOCAL ] BOE: Primary data saved (18339 records). [2025-10-16T17:44:11.135535] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-16T17:44:11.135612] [INFO ] [MAIN ] Update Progress: 322/2369 symbols completed. BOE took 34.3s. Estimated remaining: 4h 40m 30s. Rate: 7.3 symbols/min [2025-10-16T17:44:11.147933] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-16T17:44:11.325509] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:44:11.346330] [DEBUG] [LOCAL ] BOW: Loaded 23268 existing records from primary storage. [2025-10-16T17:44:11.346611] [INFO ] [MAIN ] BOW: Loaded 23268 existing records. [2025-10-16T17:44:11.548947] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:44:11.549175] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-16T17:44:11.549229] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-16T17:44:11.549700] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-16T17:44:11.549758] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-16T17:44:11.927607] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T17:44:11.954330] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:44:11.950303] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-16T17:44:11.954547] [INFO ] [REMOTE ] BOND: Full fetch complete (46639 records). [2025-10-16T17:44:11.956020] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-16T17:44:12.345945] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-16T17:44:12.346031] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-16T17:44:12.346668] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-16T17:44:12.346731] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-16T17:44:12.347814] [DEBUG] [LOCAL ] BOND: Trimmed 46639 records to 32683 (keeping 200 days of data) [2025-10-16T17:44:12.554960] [DEBUG] [LOCAL ] BOND: Primary data saved (32683 records). [2025-10-16T17:44:12.555251] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-16T17:44:12.555354] [INFO ] [MAIN ] Update Progress: 323/2369 symbols completed. BOND took 35.7s. Estimated remaining: 4h 39m 39s. Rate: 7.3 symbols/min [2025-10-16T17:44:12.731211] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:44:12.742811] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-16T17:44:12.784675] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T17:44:12.810323] [DEBUG] [LOCAL ] BOX: Loaded 50190 existing records from primary storage. [2025-10-16T17:44:12.810680] [INFO ] [MAIN ] BOX: Loaded 50190 existing records. [2025-10-16T17:44:12.985614] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:44:12.985934] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-16T17:44:12.985981] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-16T17:44:12.986814] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-16T17:44:12.986872] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-16T17:44:13.343699] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:44:13.456015] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-16T17:44:13.460734] [INFO ] [REMOTE ] BOOT: Full fetch complete (60071 records). [2025-10-16T17:44:13.460834] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-16T17:44:13.543323] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-16T17:44:13.710571] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-16T17:44:13.871851] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-16T17:44:13.871933] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-16T17:44:13.872663] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-16T17:44:13.872724] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-16T17:44:13.873900] [DEBUG] [LOCAL ] BOOT: Trimmed 60071 records to 40066 (keeping 200 days of data) [2025-10-16T17:44:14.103435] [DEBUG] [LOCAL ] BOOT: Primary data saved (40066 records). [2025-10-16T17:44:14.103556] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-16T17:44:14.103629] [INFO ] [MAIN ] Update Progress: 324/2369 symbols completed. BOOT took 37.2s. Estimated remaining: 4h 38m 49s. Rate: 7.3 symbols/min [2025-10-16T17:44:14.268597] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:44:14.268810] [DEBUG] [LOCAL ] BP: No existing data file found in primary storage. [2025-10-16T17:44:14.268852] [WARN ] [MAIN ] BP: No existing data found, performing full refresh instead. [2025-10-16T17:44:14.268954] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-16T17:44:14.269024] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-16T17:44:14.269078] [DEBUG] [LOCAL ] BP: No primary data file found to delete. [2025-10-16T17:44:14.269119] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-16T17:44:14.347963] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-16T17:44:14.634802] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:44:15.142788] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-16T17:44:15.342139] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-16T17:44:15.342966] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T17:44:15.942817] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-16T17:44:16.742810] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-16T17:44:17.290499] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-16T17:44:17.359863] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T17:44:17.383986] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T17:44:17.542772] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-16T17:44:18.342879] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-16T17:44:18.927400] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T17:44:19.142825] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-16T17:44:19.577867] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T17:44:19.942854] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-16T17:44:20.742777] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-16T17:44:20.869946] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T17:44:21.542838] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-16T17:44:21.622810] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T17:44:22.259403] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T17:44:22.342841] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-16T17:44:23.142843] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-16T17:44:23.309636] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T17:44:23.942808] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-16T17:44:24.081146] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T17:44:24.742856] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-16T17:44:24.835675] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T17:44:24.972251] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T17:44:25.542813] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-16T17:44:26.348735] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-16T17:44:26.372156] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T17:44:27.142800] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-16T17:44:27.218239] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T17:44:27.942853] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-16T17:44:28.368415] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-16T17:44:28.742838] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-16T17:44:28.952984] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T17:44:29.132503] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T17:44:29.542814] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-16T17:44:30.342784] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-16T17:44:30.378139] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T17:44:30.875990] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-16T17:44:31.142876] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-16T17:44:31.942800] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-16T17:44:32.319245] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T17:44:32.651757] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T17:44:32.742810] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-16T17:44:33.542878] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-16T17:44:34.039460] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-16T17:44:34.342835] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-16T17:44:34.470690] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T17:44:34.898930] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T17:44:35.142794] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-16T17:44:35.196192] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T17:44:35.942883] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-16T17:44:36.745768] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-16T17:44:36.751684] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T17:44:37.542794] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-16T17:44:37.706839] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T17:44:38.074007] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T17:44:38.342828] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-16T17:44:38.877885] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T17:44:39.142823] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-16T17:44:39.942867] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-16T17:44:40.077673] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T17:44:40.270781] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T17:44:40.742884] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-16T17:44:41.542900] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-16T17:44:42.233329] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-16T17:44:42.342912] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-16T17:44:42.449870] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-16T17:44:42.457019] [INFO ] [REMOTE ] BORR: Full fetch complete (74628 records). [2025-10-16T17:44:42.457187] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-16T17:44:42.904001] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-16T17:44:42.904124] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-16T17:44:42.905288] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-16T17:44:42.905359] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-16T17:44:42.907388] [DEBUG] [LOCAL ] BORR: Trimmed 74628 records to 51498 (keeping 200 days of data) [2025-10-16T17:44:43.146614] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-16T17:44:43.235491] [DEBUG] [LOCAL ] BORR: Primary data saved (51498 records). [2025-10-16T17:44:43.235944] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-16T17:44:43.236136] [INFO ] [MAIN ] Update Progress: 325/2369 symbols completed. BORR took 36.4s. Estimated remaining: 4h 40m 52s. Rate: 7.3 symbols/min [2025-10-16T17:44:43.355011] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-16T17:44:43.375938] [INFO ] [REMOTE ] BOX: Full fetch complete (72322 records). [2025-10-16T17:44:43.386808] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-16T17:44:43.493068] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:44:43.665313] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T17:44:43.903868] [DEBUG] [LOCAL ] BR: Loaded 34787 existing records from primary storage. [2025-10-16T17:44:43.926524] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-16T17:44:43.926737] [INFO ] [MAIN ] BR: Loaded 34787 existing records. [2025-10-16T17:44:43.948149] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-16T17:44:43.947990] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-16T17:44:43.971500] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-16T17:44:44.003841] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-16T17:44:44.079801] [DEBUG] [LOCAL ] BOX: Trimmed 72322 records to 50563 (keeping 200 days of data) [2025-10-16T17:44:44.118921] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:44:44.168145] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-16T17:44:44.177415] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-16T17:44:44.205309] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-16T17:44:44.205894] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-16T17:44:44.704816] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:44:44.764570] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-16T17:44:44.804274] [DEBUG] [LOCAL ] BOX: Primary data saved (50563 records). [2025-10-16T17:44:44.804531] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-16T17:44:44.805319] [INFO ] [MAIN ] Update Progress: 326/2369 symbols completed. BOX took 32.2s. Estimated remaining: 4h 40m 2s. Rate: 7.3 symbols/min [2025-10-16T17:44:44.977115] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:44:45.027168] [DEBUG] [LOCAL ] BRBR: Loaded 51693 existing records from primary storage. [2025-10-16T17:44:45.027485] [INFO ] [MAIN ] BRBR: Loaded 51693 existing records. [2025-10-16T17:44:45.207252] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:44:45.207952] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-16T17:44:45.208036] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-16T17:44:45.219326] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-16T17:44:45.236464] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-16T17:44:45.299040] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-16T17:44:45.390866] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T17:44:45.430807] [INFO ] [REMOTE ] BOW: Full fetch complete (32129 records). [2025-10-16T17:44:45.463475] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-16T17:44:45.551809] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-16T17:44:45.820386] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:44:46.064491] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T17:44:46.084454] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-16T17:44:46.084533] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-16T17:44:46.085144] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-16T17:44:46.085246] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-16T17:44:46.086103] [DEBUG] [LOCAL ] BOW: Trimmed 32129 records to 23436 (keeping 200 days of data) [2025-10-16T17:44:46.217838] [DEBUG] [LOCAL ] BOW: Primary data saved (23436 records). [2025-10-16T17:44:46.217975] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-16T17:44:46.218075] [INFO ] [MAIN ] Update Progress: 327/2369 symbols completed. BOW took 35.1s. Estimated remaining: 4h 39m 11s. Rate: 7.3 symbols/min [2025-10-16T17:44:46.347991] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-16T17:44:46.392267] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:44:46.410389] [DEBUG] [LOCAL ] BRC: Loaded 18601 existing records from primary storage. [2025-10-16T17:44:46.410630] [INFO ] [MAIN ] BRC: Loaded 18601 existing records. [2025-10-16T17:44:46.587788] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:44:46.588031] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-16T17:44:46.588080] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-16T17:44:46.588483] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-16T17:44:46.588551] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-16T17:44:46.949901] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:44:47.142820] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-16T17:44:47.706991] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-16T17:44:47.942777] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-16T17:44:48.076748] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T17:44:48.297516] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T17:44:48.742865] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-16T17:44:49.542875] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-16T17:44:49.947948] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-16T17:44:49.954605] [INFO ] [REMOTE ] BP: Full fetch complete (77882 records). [2025-10-16T17:44:49.954741] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-16T17:44:50.355775] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-16T17:44:50.359712] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-16T17:44:50.359826] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-16T17:44:50.361507] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-16T17:44:50.361707] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-16T17:44:50.387053] [DEBUG] [LOCAL ] BP: Trimmed 77882 records to 54098 (keeping 200 days of data) [2025-10-16T17:44:50.388832] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T17:44:50.625094] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T17:44:50.737278] [DEBUG] [LOCAL ] BP: Primary data saved (54098 records). [2025-10-16T17:44:50.737433] [INFO ] [MAIN ] BP: Full history saved. [2025-10-16T17:44:50.737511] [INFO ] [MAIN ] Update Progress: 328/2369 symbols completed. BP took 36.6s. Estimated remaining: 4h 38m 40s. Rate: 7.3 symbols/min [2025-10-16T17:44:50.906723] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:44:50.941301] [DEBUG] [LOCAL ] BRCC: Loaded 40208 existing records from primary storage. [2025-10-16T17:44:50.941579] [INFO ] [MAIN ] BRCC: Loaded 40208 existing records. [2025-10-16T17:44:51.113961] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:44:51.114138] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-16T17:44:51.114184] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-16T17:44:51.114878] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-16T17:44:51.114934] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-16T17:44:51.148015] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-16T17:44:51.460945] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:44:51.942839] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-16T17:44:52.015719] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T17:44:52.034502] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T17:44:52.742842] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-16T17:44:53.212052] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T17:44:53.542830] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-16T17:44:53.865784] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T17:44:54.342871] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-16T17:44:54.542817] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T17:44:55.142864] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-16T17:44:55.420344] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T17:44:55.942815] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-16T17:44:56.739758] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T17:44:56.748035] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-16T17:44:57.072599] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T17:44:57.542826] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-16T17:44:58.266285] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T17:44:58.342822] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-16T17:44:59.142843] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-16T17:44:59.276522] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T17:44:59.844665] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T17:44:59.942769] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-16T17:45:00.320443] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T17:45:00.742811] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-16T17:45:01.542884] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-16T17:45:01.638408] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T17:45:02.062703] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T17:45:02.342812] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-16T17:45:03.142783] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-16T17:45:03.246056] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T17:45:03.656871] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T17:45:03.942816] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-16T17:45:04.742896] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-16T17:45:04.821937] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T17:45:05.542798] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-16T17:45:05.734308] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T17:45:05.811741] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T17:45:06.342835] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-16T17:45:06.873382] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T17:45:07.142813] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-16T17:45:07.942846] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-16T17:45:08.097687] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T17:45:08.353231] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T17:45:08.742801] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-16T17:45:09.045812] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-16T17:45:09.542869] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-16T17:45:10.215981] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T17:45:10.342789] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-16T17:45:10.622815] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T17:45:11.142821] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-16T17:45:11.942801] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-16T17:45:12.318023] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T17:45:12.383949] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-16T17:45:12.742797] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-16T17:45:13.436628] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T17:45:13.478000] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T17:45:13.542828] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-16T17:45:14.342868] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-16T17:45:15.142825] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-16T17:45:15.258119] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T17:45:15.442586] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T17:45:15.942827] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-16T17:45:16.166003] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-16T17:45:16.742834] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-16T17:45:17.468764] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T17:45:17.542798] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-16T17:45:17.776205] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-16T17:45:17.782978] [INFO ] [REMOTE ] BRBR: Full fetch complete (72917 records). [2025-10-16T17:45:17.783089] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-16T17:45:18.166450] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-16T17:45:18.166530] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-16T17:45:18.167346] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-16T17:45:18.167408] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-16T17:45:18.168742] [DEBUG] [LOCAL ] BRBR: Trimmed 72917 records to 52076 (keeping 200 days of data) [2025-10-16T17:45:18.363430] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-16T17:45:18.466771] [DEBUG] [LOCAL ] BRBR: Primary data saved (52076 records). [2025-10-16T17:45:18.466891] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-16T17:45:18.467565] [INFO ] [MAIN ] Update Progress: 329/2369 symbols completed. BRBR took 33.7s. Estimated remaining: 4h 40m 33s. Rate: 7.3 symbols/min [2025-10-16T17:45:18.637125] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:45:18.686698] [DEBUG] [LOCAL ] BRO: Loaded 52061 existing records from primary storage. [2025-10-16T17:45:18.687014] [INFO ] [MAIN ] BRO: Loaded 52061 existing records. [2025-10-16T17:45:18.863388] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:45:18.863636] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-16T17:45:18.863744] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-16T17:45:18.864924] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-16T17:45:18.864983] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-16T17:45:19.154666] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-16T17:45:19.160096] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-16T17:45:19.171932] [INFO ] [REMOTE ] BR: Full fetch complete (50042 records). [2025-10-16T17:45:19.182435] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-16T17:45:19.258083] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:45:19.446007] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T17:45:19.657711] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-16T17:45:19.657793] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-16T17:45:19.658435] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-16T17:45:19.658475] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-16T17:45:19.659573] [DEBUG] [LOCAL ] BR: Trimmed 50042 records to 35110 (keeping 200 days of data) [2025-10-16T17:45:19.879819] [DEBUG] [LOCAL ] BR: Primary data saved (35110 records). [2025-10-16T17:45:19.879962] [INFO ] [MAIN ] BR: Full history saved. [2025-10-16T17:45:19.880042] [INFO ] [MAIN ] Update Progress: 330/2369 symbols completed. BR took 36.6s. Estimated remaining: 4h 39m 43s. Rate: 7.3 symbols/min [2025-10-16T17:45:19.948038] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-16T17:45:20.049274] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:45:20.098167] [DEBUG] [LOCAL ] BROS: Loaded 53300 existing records from primary storage. [2025-10-16T17:45:20.098550] [INFO ] [MAIN ] BROS: Loaded 53300 existing records. [2025-10-16T17:45:20.274542] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:45:20.274788] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-16T17:45:20.274837] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-16T17:45:20.275637] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-16T17:45:20.275735] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-16T17:45:20.680917] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:45:20.742781] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-16T17:45:20.786537] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T17:45:20.998089] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T17:45:21.000986] [INFO ] [REMOTE ] BRC: Full fetch complete (28529 records). [2025-10-16T17:45:21.001087] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-16T17:45:21.360063] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-16T17:45:21.360139] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-16T17:45:21.360587] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-16T17:45:21.360628] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-16T17:45:21.361324] [DEBUG] [LOCAL ] BRC: Trimmed 28529 records to 18774 (keeping 200 days of data) [2025-10-16T17:45:21.473339] [DEBUG] [LOCAL ] BRC: Primary data saved (18774 records). [2025-10-16T17:45:21.473495] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-16T17:45:21.473580] [INFO ] [MAIN ] Update Progress: 331/2369 symbols completed. BRC took 35.3s. Estimated remaining: 4h 38m 54s. Rate: 7.3 symbols/min [2025-10-16T17:45:21.547883] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-16T17:45:21.640024] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:45:21.640243] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-16T17:45:21.640287] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-16T17:45:21.640396] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-16T17:45:21.640436] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-16T17:45:21.640477] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-16T17:45:21.640509] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-16T17:45:21.989028] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:45:22.342833] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-16T17:45:22.504359] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T17:45:22.539527] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:45:22.539865] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-16T17:45:22.539955] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:45:22.540001] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-16T17:45:22.540069] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:45:22.540141] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-16T17:45:22.540202] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-16T17:45:22.540237] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-16T17:45:22.540276] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-16T17:45:22.540320] [INFO ] [MAIN ] Update Progress: 332/2369 symbols completed. BRSL took 1.1s. Estimated remaining: 4h 38m 2s. Rate: 7.3 symbols/min [2025-10-16T17:45:22.704723] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:45:22.736567] [DEBUG] [LOCAL ] BRSP: Loaded 36808 existing records from primary storage. [2025-10-16T17:45:22.736859] [INFO ] [MAIN ] BRSP: Loaded 36808 existing records. [2025-10-16T17:45:22.913232] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:45:22.913418] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-16T17:45:22.913464] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-16T17:45:22.914111] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-16T17:45:22.914169] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-16T17:45:23.148227] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-16T17:45:23.364720] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:45:23.402067] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T17:45:23.942848] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-16T17:45:24.701578] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-16T17:45:24.707233] [INFO ] [REMOTE ] BRCC: Full fetch complete (57193 records). [2025-10-16T17:45:24.707413] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-16T17:45:24.708702] [FATAL] [VALIDATOR ] BRCC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:45:24.708836] [FATAL] [MAIN ] BRCC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:45:24.709132] [WARN ] [MAIN ] BRCC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:45:24.709226] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-16T17:45:24.709324] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-10-16T17:45:24.709391] [INFO ] [LOCAL ] BRCC: Starting deletion of derivative data. [2025-10-16T17:45:24.709589] [DEBUG] [LOCAL ] BRCC: Deleted derivative data file. [2025-10-16T17:45:24.710188] [INFO ] [MAIN ] Update Progress: 333/2369 symbols completed. BRCC took 34.0s. Estimated remaining: 4h 37m 17s. Rate: 7.3 symbols/min [2025-10-16T17:45:24.752348] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-16T17:45:24.915942] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:45:24.924102] [DEBUG] [LOCAL ] BRT: Loaded 5222 existing records from primary storage. [2025-10-16T17:45:24.924323] [INFO ] [MAIN ] BRT: Loaded 5222 existing records. [2025-10-16T17:45:25.096846] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:45:25.097124] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-16T17:45:25.097181] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-16T17:45:25.097429] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-16T17:45:25.097485] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-16T17:45:25.447861] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:45:25.490047] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T17:45:25.542807] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-16T17:45:26.196806] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-16T17:45:26.342818] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-16T17:45:26.490774] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T17:45:27.142807] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-16T17:45:27.588941] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-16T17:45:27.772175] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-16T17:45:27.942943] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-16T17:45:28.429716] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-16T17:45:28.742856] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-16T17:45:29.542874] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-16T17:45:29.862637] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T17:45:30.342859] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-16T17:45:31.142849] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-16T17:45:31.433481] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-16T17:45:31.562269] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-16T17:45:31.942817] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-16T17:45:32.252501] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-16T17:45:32.353684] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-16T17:45:32.742859] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-16T17:45:33.351694] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-16T17:45:33.542843] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-16T17:45:34.121059] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T17:45:34.342818] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-16T17:45:35.142851] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-16T17:45:35.609130] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T17:45:35.685840] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-16T17:45:35.942809] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-16T17:45:36.707669] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-16T17:45:36.742813] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-16T17:45:37.435911] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-16T17:45:37.542838] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-16T17:45:38.342797] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-16T17:45:38.413885] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T17:45:38.415350] [INFO ] [REMOTE ] BRT: Full fetch complete (6997 records). [2025-10-16T17:45:38.415428] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-16T17:45:38.415860] [FATAL] [VALIDATOR ] BRT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:45:38.415945] [FATAL] [MAIN ] BRT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:45:38.415992] [WARN ] [MAIN ] BRT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:45:38.416061] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-16T17:45:38.416124] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-16T17:45:38.416159] [INFO ] [LOCAL ] BRT: Starting deletion of derivative data. [2025-10-16T17:45:38.416301] [DEBUG] [LOCAL ] BRT: Deleted derivative data file. [2025-10-16T17:45:38.416383] [INFO ] [MAIN ] Update Progress: 334/2369 symbols completed. BRT took 13.7s. Estimated remaining: 4h 37m 42s. Rate: 7.3 symbols/min [2025-10-16T17:45:38.587865] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:45:38.608399] [DEBUG] [LOCAL ] BRW: Loaded 20981 existing records from primary storage. [2025-10-16T17:45:38.608692] [INFO ] [MAIN ] BRW: Loaded 20981 existing records. [2025-10-16T17:45:38.787564] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:45:38.787790] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-16T17:45:38.787849] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-16T17:45:38.788331] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-16T17:45:38.788385] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-16T17:45:39.161756] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:45:39.156321] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-16T17:45:39.942789] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-16T17:45:39.984902] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T17:45:40.742826] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-16T17:45:40.980314] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T17:45:41.059855] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-16T17:45:41.542836] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-16T17:45:41.941634] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-16T17:45:42.342824] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-16T17:45:43.142812] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-16T17:45:43.563942] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-16T17:45:43.619100] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T17:45:43.942839] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-16T17:45:44.316235] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T17:45:44.742835] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-16T17:45:44.905152] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T17:45:45.542850] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-16T17:45:45.699470] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T17:45:46.342816] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-16T17:45:47.142850] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-16T17:45:47.327124] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T17:45:47.765164] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T17:45:47.867748] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T17:45:47.942832] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-16T17:45:48.708912] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T17:45:48.742816] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-16T17:45:49.379424] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-16T17:45:49.542820] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-16T17:45:50.342845] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-16T17:45:51.142841] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-16T17:45:51.903752] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-16T17:45:51.935115] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T17:45:51.952233] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-16T17:45:51.965781] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T17:45:52.742880] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-16T17:45:53.542799] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-16T17:45:53.750457] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T17:45:54.233876] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:45:54.342802] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-16T17:45:55.142803] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-16T17:45:55.265028] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T17:45:55.319445] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T17:45:55.942823] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-16T17:45:56.286427] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T17:45:56.742831] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-16T17:45:57.456800] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T17:45:57.542772] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-16T17:45:57.860164] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-16T17:45:58.342875] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-16T17:45:58.709304] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T17:45:58.714304] [INFO ] [REMOTE ] BRSP: Full fetch complete (54315 records). [2025-10-16T17:45:58.714396] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-16T17:45:59.103348] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-16T17:45:59.103454] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-16T17:45:59.104333] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-16T17:45:59.104397] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-16T17:45:59.105846] [DEBUG] [LOCAL ] BRSP: Trimmed 54315 records to 37050 (keeping 200 days of data) [2025-10-16T17:45:59.158629] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-16T17:45:59.324536] [DEBUG] [LOCAL ] BRSP: Primary data saved (37050 records). [2025-10-16T17:45:59.324695] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-16T17:45:59.324786] [INFO ] [MAIN ] Update Progress: 335/2369 symbols completed. BRSP took 36.8s. Estimated remaining: 4h 38m 51s. Rate: 7.3 symbols/min [2025-10-16T17:45:59.508817] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:45:59.556691] [DEBUG] [LOCAL ] BRX: Loaded 51797 existing records from primary storage. [2025-10-16T17:45:59.557017] [INFO ] [MAIN ] BRX: Loaded 51797 existing records. [2025-10-16T17:45:59.734720] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:45:59.735592] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-16T17:45:59.735671] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-16T17:45:59.736526] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-16T17:45:59.736586] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-16T17:45:59.947917] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-16T17:46:00.108935] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:46:00.151676] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T17:46:00.462179] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T17:46:00.742813] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-16T17:46:01.542805] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-16T17:46:01.809401] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T17:46:01.813229] [INFO ] [REMOTE ] BRW: Full fetch complete (30323 records). [2025-10-16T17:46:01.813331] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-16T17:46:01.814120] [FATAL] [VALIDATOR ] BRW: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:46:01.814220] [FATAL] [MAIN ] BRW: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:46:01.814263] [WARN ] [MAIN ] BRW: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:46:01.814330] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-16T17:46:01.814416] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-16T17:46:01.814488] [INFO ] [LOCAL ] BRW: Starting deletion of derivative data. [2025-10-16T17:46:01.814601] [DEBUG] [LOCAL ] BRW: Deleted derivative data file. [2025-10-16T17:46:01.814697] [INFO ] [MAIN ] Update Progress: 336/2369 symbols completed. BRW took 23.4s. Estimated remaining: 4h 38m 8s. Rate: 7.3 symbols/min [2025-10-16T17:46:01.987429] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:46:01.987673] [DEBUG] [LOCAL ] BSAC: No existing data file found in primary storage. [2025-10-16T17:46:01.987782] [WARN ] [MAIN ] BSAC: No existing data found, performing full refresh instead. [2025-10-16T17:46:01.987939] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-16T17:46:01.988006] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-16T17:46:01.988063] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-10-16T17:46:01.988233] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-16T17:46:02.270980] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-16T17:46:02.354078] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-16T17:46:02.395109] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:46:02.928488] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:46:03.142815] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-16T17:46:03.942843] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-16T17:46:04.477065] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-16T17:46:04.742851] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-16T17:46:04.897397] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T17:46:05.123414] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T17:46:05.542804] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-16T17:46:06.342904] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-16T17:46:07.021172] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-16T17:46:07.077707] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T17:46:07.095406] [INFO ] [REMOTE ] BRO: Full fetch complete (74501 records). [2025-10-16T17:46:07.095565] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-16T17:46:07.096510] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T17:46:07.101710] [FATAL] [VALIDATOR ] BRO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:46:07.101802] [FATAL] [MAIN ] BRO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:46:07.101865] [WARN ] [MAIN ] BRO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:46:07.101937] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-16T17:46:07.101998] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-16T17:46:07.102033] [INFO ] [LOCAL ] BRO: Starting deletion of derivative data. [2025-10-16T17:46:07.102151] [DEBUG] [LOCAL ] BRO: Deleted derivative data file. [2025-10-16T17:46:07.102708] [INFO ] [MAIN ] Update Progress: 337/2369 symbols completed. BRO took 48.6s. Estimated remaining: 4h 37m 43s. Rate: 7.3 symbols/min [2025-10-16T17:46:07.147904] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-16T17:46:07.276005] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:46:07.308838] [DEBUG] [LOCAL ] BSBR: Loaded 35665 existing records from primary storage. [2025-10-16T17:46:07.309256] [INFO ] [MAIN ] BSBR: Loaded 35665 existing records. [2025-10-16T17:46:07.488680] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:46:07.488882] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-16T17:46:07.488928] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-16T17:46:07.489569] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-16T17:46:07.489639] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-16T17:46:07.843401] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:46:07.942796] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-16T17:46:08.461826] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T17:46:08.742797] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-16T17:46:08.951596] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T17:46:09.542848] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-16T17:46:09.911673] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T17:46:10.342819] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-16T17:46:11.142766] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-16T17:46:11.344777] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T17:46:11.351625] [INFO ] [REMOTE ] BROS: Full fetch complete (77245 records). [2025-10-16T17:46:11.351774] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-16T17:46:11.730152] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T17:46:11.783858] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-16T17:46:11.783945] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-16T17:46:11.784898] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-16T17:46:11.784962] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-16T17:46:11.786425] [DEBUG] [LOCAL ] BROS: Trimmed 77245 records to 53690 (keeping 200 days of data) [2025-10-16T17:46:11.950402] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-16T17:46:12.100987] [DEBUG] [LOCAL ] BROS: Primary data saved (53690 records). [2025-10-16T17:46:12.101119] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-16T17:46:12.101194] [INFO ] [MAIN ] Update Progress: 338/2369 symbols completed. BROS took 52.2s. Estimated remaining: 4h 37m 15s. Rate: 7.3 symbols/min [2025-10-16T17:46:12.274854] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:46:12.283890] [DEBUG] [LOCAL ] BSL: Loaded 8231 existing records from primary storage. [2025-10-16T17:46:12.284077] [INFO ] [MAIN ] BSL: Loaded 8231 existing records. [2025-10-16T17:46:12.470130] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:46:12.470432] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-16T17:46:12.470491] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-16T17:46:12.477950] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-16T17:46:12.489614] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-16T17:46:12.560152] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T17:46:12.747933] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-16T17:46:12.863002] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:46:12.953385] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-16T17:46:13.542833] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-16T17:46:14.038956] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-16T17:46:14.348213] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-16T17:46:14.366525] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T17:46:15.142807] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-16T17:46:15.716348] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T17:46:15.942854] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-16T17:46:16.319628] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T17:46:16.438707] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-16T17:46:16.742873] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-16T17:46:17.542800] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-16T17:46:17.955896] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T17:46:18.342830] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-16T17:46:18.352528] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T17:46:19.142826] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-16T17:46:19.878488] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T17:46:19.942883] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-16T17:46:20.437796] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T17:46:20.742859] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-16T17:46:21.475794] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T17:46:21.542795] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-16T17:46:21.723700] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T17:46:22.342865] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-16T17:46:22.916779] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T17:46:23.107577] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T17:46:23.142817] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-16T17:46:23.942824] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-16T17:46:24.246243] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T17:46:24.742834] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-16T17:46:25.542802] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-16T17:46:25.667135] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T17:46:25.739943] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T17:46:26.342787] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-16T17:46:26.397097] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-16T17:46:27.142813] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-16T17:46:27.942863] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-16T17:46:28.044733] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T17:46:28.221478] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T17:46:28.729795] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T17:46:28.742772] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-16T17:46:29.269246] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-16T17:46:29.542811] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-16T17:46:30.342807] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-16T17:46:30.963790] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T17:46:30.968263] [INFO ] [REMOTE ] BSBR: Full fetch complete (50684 records). [2025-10-16T17:46:30.968410] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-16T17:46:30.969200] [FATAL] [VALIDATOR ] BSBR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:46:30.969289] [FATAL] [MAIN ] BSBR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:46:30.969333] [WARN ] [MAIN ] BSBR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:46:30.969402] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-16T17:46:30.969469] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-10-16T17:46:30.969508] [INFO ] [LOCAL ] BSBR: Starting deletion of derivative data. [2025-10-16T17:46:30.969623] [DEBUG] [LOCAL ] BSBR: Deleted derivative data file. [2025-10-16T17:46:30.969731] [INFO ] [MAIN ] Update Progress: 339/2369 symbols completed. BSBR took 23.9s. Estimated remaining: 4h 38m 11s. Rate: 7.3 symbols/min [2025-10-16T17:46:31.147954] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-16T17:46:31.213072] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:46:31.213303] [DEBUG] [LOCAL ] BSM: No existing data file found in primary storage. [2025-10-16T17:46:31.213348] [WARN ] [MAIN ] BSM: No existing data found, performing full refresh instead. [2025-10-16T17:46:31.213460] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-16T17:46:31.213501] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-16T17:46:31.213541] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-16T17:46:31.213574] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-16T17:46:31.733994] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:46:31.861546] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T17:46:31.888727] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T17:46:31.942878] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-16T17:46:32.742825] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-16T17:46:33.469687] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T17:46:33.542797] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-16T17:46:33.911505] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T17:46:34.342867] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-16T17:46:34.891514] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T17:46:35.142821] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-16T17:46:35.622978] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T17:46:35.942795] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-16T17:46:36.031583] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T17:46:36.743588] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-16T17:46:36.746312] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T17:46:37.542853] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-16T17:46:38.123208] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T17:46:38.135902] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-16T17:46:38.342805] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-16T17:46:38.941996] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T17:46:39.142828] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-16T17:46:39.942883] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-16T17:46:40.742771] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-16T17:46:40.783689] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-16T17:46:40.790714] [INFO ] [REMOTE ] BRX: Full fetch complete (74754 records). [2025-10-16T17:46:40.790906] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-16T17:46:40.792024] [FATAL] [VALIDATOR ] BRX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:46:40.792121] [FATAL] [MAIN ] BRX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:46:40.792165] [WARN ] [MAIN ] BRX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:46:40.792238] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-16T17:46:40.792315] [DEBUG] [LOCAL ] BRX: No primary data file found to delete. [2025-10-16T17:46:40.792352] [INFO ] [LOCAL ] BRX: Starting deletion of derivative data. [2025-10-16T17:46:40.792539] [DEBUG] [LOCAL ] BRX: Deleted derivative data file. [2025-10-16T17:46:40.793450] [INFO ] [MAIN ] Update Progress: 340/2369 symbols completed. BRX took 41.5s. Estimated remaining: 4h 38m 12s. Rate: 7.3 symbols/min [2025-10-16T17:46:40.977930] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:46:41.004450] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T17:46:41.033073] [DEBUG] [LOCAL ] BST: Loaded 18867 existing records from primary storage. [2025-10-16T17:46:41.033437] [INFO ] [MAIN ] BST: Loaded 18867 existing records. [2025-10-16T17:46:41.227084] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:46:41.227545] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-16T17:46:41.227611] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-16T17:46:41.228697] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-16T17:46:41.228764] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-16T17:46:41.544844] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-16T17:46:41.581302] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T17:46:41.608725] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:46:41.610141] [INFO ] [REMOTE ] BSL: Full fetch complete (12938 records). [2025-10-16T17:46:41.610260] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-16T17:46:41.962790] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-16T17:46:41.962868] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-16T17:46:41.963154] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-16T17:46:41.963193] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-16T17:46:41.963630] [DEBUG] [LOCAL ] BSL: Trimmed 12938 records to 8327 (keeping 200 days of data) [2025-10-16T17:46:42.013298] [DEBUG] [LOCAL ] BSL: Primary data saved (8327 records). [2025-10-16T17:46:42.013442] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-16T17:46:42.013527] [INFO ] [MAIN ] Update Progress: 341/2369 symbols completed. BSL took 29.9s. Estimated remaining: 4h 37m 22s. Rate: 7.3 symbols/min [2025-10-16T17:46:42.176924] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:46:42.198799] [DEBUG] [LOCAL ] BSTZ: Loaded 24906 existing records from primary storage. [2025-10-16T17:46:42.199056] [INFO ] [MAIN ] BSTZ: Loaded 24906 existing records. [2025-10-16T17:46:42.345377] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-16T17:46:42.376293] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:46:42.376714] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-16T17:46:42.376778] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-16T17:46:42.377213] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-16T17:46:42.377272] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-16T17:46:42.681295] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T17:46:42.763841] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:46:43.142820] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-16T17:46:43.583406] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T17:46:43.942809] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-16T17:46:44.251719] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T17:46:44.653431] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T17:46:44.742824] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-16T17:46:45.542831] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-16T17:46:45.839699] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T17:46:46.342869] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-16T17:46:46.560238] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T17:46:47.126258] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T17:46:47.142775] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-16T17:46:47.942807] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-16T17:46:48.299831] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T17:46:48.742792] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-16T17:46:48.809087] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T17:46:49.542845] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-16T17:46:49.781129] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T17:46:49.785608] [INFO ] [REMOTE ] BSAC: Full fetch complete (44891 records). [2025-10-16T17:46:49.785771] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-16T17:46:50.160931] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-16T17:46:50.161012] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-16T17:46:50.161614] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-16T17:46:50.161690] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-16T17:46:50.162716] [DEBUG] [LOCAL ] BSAC: Trimmed 44891 records to 33148 (keeping 200 days of data) [2025-10-16T17:46:50.348456] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-16T17:46:50.348754] [DEBUG] [LOCAL ] BSAC: Primary data saved (33148 records). [2025-10-16T17:46:50.349906] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-16T17:46:50.350144] [INFO ] [MAIN ] Update Progress: 342/2369 symbols completed. BSAC took 48.5s. Estimated remaining: 4h 37m 15s. Rate: 7.3 symbols/min [2025-10-16T17:46:50.546366] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:46:50.595535] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-16T17:46:50.596114] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-10-16T17:46:50.701715] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T17:46:50.793612] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:46:50.793859] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-16T17:46:50.793907] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-16T17:46:50.794887] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-16T17:46:50.794945] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-16T17:46:51.140392] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:46:51.142771] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-16T17:46:51.799727] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T17:46:51.942879] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-16T17:46:52.687720] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T17:46:52.742794] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-16T17:46:52.950758] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T17:46:53.542867] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-16T17:46:54.089307] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T17:46:54.342847] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-16T17:46:54.545233] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-16T17:46:55.142815] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-16T17:46:55.942798] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-16T17:46:56.223058] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-16T17:46:56.577541] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T17:46:56.742808] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-16T17:46:57.155248] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T17:46:57.542853] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-16T17:46:58.158782] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T17:46:58.342843] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-16T17:46:59.142842] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-16T17:46:59.377983] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-16T17:46:59.379066] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T17:46:59.942839] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-16T17:47:00.258871] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T17:47:00.742859] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-16T17:47:01.542871] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-16T17:47:01.748512] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T17:47:01.959011] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T17:47:02.342872] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-16T17:47:02.574074] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T17:47:03.142893] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-16T17:47:03.284050] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T17:47:03.288241] [INFO ] [REMOTE ] BSM: Full fetch complete (47000 records). [2025-10-16T17:47:03.288355] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-16T17:47:03.664745] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-16T17:47:03.664823] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-16T17:47:03.665418] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-16T17:47:03.665460] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-16T17:47:03.666371] [DEBUG] [LOCAL ] BSM: Trimmed 47000 records to 32574 (keeping 200 days of data) [2025-10-16T17:47:03.855041] [DEBUG] [LOCAL ] BSM: Primary data saved (32574 records). [2025-10-16T17:47:03.855175] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-16T17:47:03.855243] [INFO ] [MAIN ] Update Progress: 343/2369 symbols completed. BSM took 32.9s. Estimated remaining: 4h 37m 38s. Rate: 7.3 symbols/min [2025-10-16T17:47:03.952890] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-16T17:47:04.026369] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:47:04.032923] [DEBUG] [LOCAL ] BTA: Loaded 5669 existing records from primary storage. [2025-10-16T17:47:04.033106] [INFO ] [MAIN ] BTA: Loaded 5669 existing records. [2025-10-16T17:47:04.225820] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:47:04.226630] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-16T17:47:04.227239] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-16T17:47:04.227154] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T17:47:04.231960] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-16T17:47:04.232050] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-16T17:47:04.589209] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:47:04.742836] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-16T17:47:05.542850] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-16T17:47:05.872702] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T17:47:06.035677] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-16T17:47:06.069045] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-16T17:47:06.342820] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-16T17:47:07.142788] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-16T17:47:07.596272] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T17:47:07.942785] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-16T17:47:08.220701] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T17:47:08.742810] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-16T17:47:09.303231] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T17:47:09.542803] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-16T17:47:09.636888] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T17:47:10.290788] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T17:47:10.342793] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-16T17:47:11.142806] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-16T17:47:11.889434] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T17:47:11.942770] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-16T17:47:12.217728] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-16T17:47:12.742842] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-16T17:47:12.762396] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T17:47:13.542823] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-16T17:47:14.342785] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-16T17:47:14.586035] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-16T17:47:14.735583] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-16T17:47:15.142835] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-16T17:47:15.524860] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-16T17:47:15.942871] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-16T17:47:16.742791] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-16T17:47:16.862861] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T17:47:17.129996] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T17:47:17.133245] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36512 records). [2025-10-16T17:47:17.133317] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-16T17:47:17.133935] [FATAL] [VALIDATOR ] BSTZ: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:47:17.134015] [FATAL] [MAIN ] BSTZ: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:47:17.134057] [WARN ] [MAIN ] BSTZ: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:47:17.134096] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-16T17:47:17.134150] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-16T17:47:17.134194] [INFO ] [LOCAL ] BSTZ: Starting deletion of derivative data. [2025-10-16T17:47:17.134346] [DEBUG] [LOCAL ] BSTZ: Deleted derivative data file. [2025-10-16T17:47:17.134431] [INFO ] [MAIN ] Update Progress: 344/2369 symbols completed. BSTZ took 35.1s. Estimated remaining: 4h 37m 59s. Rate: 7.3 symbols/min [2025-10-16T17:47:17.300408] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:47:17.316110] [DEBUG] [LOCAL ] BTCM: Loaded 16911 existing records from primary storage. [2025-10-16T17:47:17.316322] [INFO ] [MAIN ] BTCM: Loaded 16911 existing records. [2025-10-16T17:47:17.418339] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-16T17:47:17.494406] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:47:17.494568] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-16T17:47:17.494613] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-16T17:47:17.494971] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-10-16T17:47:17.495027] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-16T17:47:17.547903] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-16T17:47:17.843894] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:47:18.342807] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-16T17:47:18.510014] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T17:47:18.512534] [INFO ] [REMOTE ] BST: Full fetch complete (28400 records). [2025-10-16T17:47:18.512612] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-16T17:47:18.513084] [FATAL] [VALIDATOR ] BST: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:47:18.513172] [FATAL] [MAIN ] BST: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:47:18.513240] [WARN ] [MAIN ] BST: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:47:18.513310] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-16T17:47:18.513372] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-16T17:47:18.513407] [INFO ] [LOCAL ] BST: Starting deletion of derivative data. [2025-10-16T17:47:18.513535] [DEBUG] [LOCAL ] BST: Deleted derivative data file. [2025-10-16T17:47:18.513632] [INFO ] [MAIN ] Update Progress: 345/2369 symbols completed. BST took 37.7s. Estimated remaining: 4h 37m 11s. Rate: 7.3 symbols/min [2025-10-16T17:47:18.681456] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:47:18.728906] [DEBUG] [LOCAL ] BTE: Loaded 52736 existing records from primary storage. [2025-10-16T17:47:18.729221] [INFO ] [MAIN ] BTE: Loaded 52736 existing records. [2025-10-16T17:47:18.902196] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:47:18.902356] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-16T17:47:18.902402] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-16T17:47:18.903300] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-16T17:47:18.903358] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-16T17:47:19.147957] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-16T17:47:19.257131] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:47:19.446378] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T17:47:19.942824] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-16T17:47:20.543277] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-16T17:47:20.742906] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-16T17:47:21.059891] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-16T17:47:21.423698] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-16T17:47:21.542820] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-16T17:47:22.342934] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-16T17:47:22.905363] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T17:47:23.011696] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T17:47:23.142768] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-16T17:47:23.942897] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-16T17:47:24.524465] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T17:47:24.550114] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T17:47:24.742809] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-16T17:47:25.539840] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T17:47:25.542758] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-16T17:47:25.981635] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-16T17:47:26.342815] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-16T17:47:27.002092] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-16T17:47:27.142876] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-16T17:47:27.779590] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-16T17:47:27.942784] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-16T17:47:28.742803] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-16T17:47:29.144371] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T17:47:29.183619] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-16T17:47:29.190462] [INFO ] [REMOTE ] BSX: Full fetch complete (77856 records). [2025-10-16T17:47:29.190580] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-16T17:47:29.542820] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-16T17:47:29.586602] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-16T17:47:29.586721] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-16T17:47:29.587718] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-16T17:47:29.587906] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-16T17:47:29.589448] [DEBUG] [LOCAL ] BSX: Trimmed 77856 records to 54078 (keeping 200 days of data) [2025-10-16T17:47:29.913751] [DEBUG] [LOCAL ] BSX: Primary data saved (54078 records). [2025-10-16T17:47:29.913988] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-16T17:47:29.914583] [INFO ] [MAIN ] Update Progress: 346/2369 symbols completed. BSX took 39.6s. Estimated remaining: 4h 37m 21s. Rate: 7.3 symbols/min [2025-10-16T17:47:30.080984] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:47:30.129189] [DEBUG] [LOCAL ] BTI: Loaded 53596 existing records from primary storage. [2025-10-16T17:47:30.129496] [INFO ] [MAIN ] BTI: Loaded 53596 existing records. [2025-10-16T17:47:30.303229] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:47:30.303470] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-16T17:47:30.303517] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-16T17:47:30.304427] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-16T17:47:30.304498] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-16T17:47:30.346441] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-16T17:47:30.407160] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-16T17:47:30.665875] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:47:31.142811] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-16T17:47:31.942803] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-16T17:47:32.200106] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T17:47:32.399211] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-16T17:47:32.679073] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T17:47:32.742772] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-16T17:47:33.542889] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-16T17:47:34.255055] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T17:47:34.342810] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-16T17:47:34.381220] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T17:47:35.142817] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-16T17:47:35.942786] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-16T17:47:36.131866] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T17:47:36.495841] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-16T17:47:36.497297] [INFO ] [REMOTE ] BTA: Full fetch complete (9601 records). [2025-10-16T17:47:36.497364] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-16T17:47:36.745566] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-16T17:47:36.867033] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-16T17:47:36.867107] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-16T17:47:36.867330] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-16T17:47:36.867369] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-16T17:47:36.867834] [DEBUG] [LOCAL ] BTA: Trimmed 9601 records to 5735 (keeping 200 days of data) [2025-10-16T17:47:36.901974] [DEBUG] [LOCAL ] BTA: Primary data saved (5735 records). [2025-10-16T17:47:36.902080] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-16T17:47:36.902156] [INFO ] [MAIN ] Update Progress: 347/2369 symbols completed. BTA took 33.0s. Estimated remaining: 4h 37m 6s. Rate: 7.3 symbols/min [2025-10-16T17:47:37.072167] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:47:37.104669] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-16T17:47:37.119631] [DEBUG] [LOCAL ] BTO: Loaded 8850 existing records from primary storage. [2025-10-16T17:47:37.119843] [INFO ] [MAIN ] BTO: Loaded 8850 existing records. [2025-10-16T17:47:37.293668] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:47:37.293872] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-16T17:47:37.293919] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-16T17:47:37.294177] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-16T17:47:37.294234] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-16T17:47:37.547953] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-16T17:47:37.642729] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:47:38.342860] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-16T17:47:38.851102] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-16T17:47:38.903290] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-16T17:47:39.142829] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-16T17:47:39.461065] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-16T17:47:39.942821] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-16T17:47:40.567939] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T17:47:40.617407] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T17:47:40.742774] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-16T17:47:41.542830] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-16T17:47:42.342812] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-16T17:47:42.460621] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T17:47:42.499716] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T17:47:43.142801] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-16T17:47:43.942841] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-16T17:47:44.403958] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-16T17:47:44.674501] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T17:47:44.742778] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-16T17:47:44.856901] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T17:47:45.536342] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T17:47:45.542764] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-16T17:47:46.342794] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-16T17:47:46.440195] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T17:47:47.142827] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-16T17:47:47.942789] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-16T17:47:48.108098] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T17:47:48.133806] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T17:47:48.742811] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-16T17:47:49.542836] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-16T17:47:49.754744] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T17:47:49.896770] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T17:47:50.143235] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T17:47:50.342830] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-16T17:47:51.142823] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-16T17:47:51.525815] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T17:47:51.529622] [INFO ] [REMOTE ] BTCM: Full fetch complete (20267 records). [2025-10-16T17:47:51.529813] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-16T17:47:51.903822] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-16T17:47:51.903901] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-16T17:47:51.904362] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-16T17:47:51.904404] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-16T17:47:51.905027] [DEBUG] [LOCAL ] BTCM: Trimmed 20267 records to 17122 (keeping 200 days of data) [2025-10-16T17:47:51.944230] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-16T17:47:52.003617] [DEBUG] [LOCAL ] BTCM: Primary data saved (17122 records). [2025-10-16T17:47:52.003787] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-16T17:47:52.003870] [INFO ] [MAIN ] Update Progress: 348/2369 symbols completed. BTCM took 34.9s. Estimated remaining: 4h 37m 38s. Rate: 7.3 symbols/min [2025-10-16T17:47:52.172729] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:47:52.187364] [DEBUG] [LOCAL ] BTT: Loaded 15721 existing records from primary storage. [2025-10-16T17:47:52.187583] [INFO ] [MAIN ] BTT: Loaded 15721 existing records. [2025-10-16T17:47:52.368100] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:47:52.368310] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-16T17:47:52.368360] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-16T17:47:52.368842] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-16T17:47:52.368902] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-16T17:47:52.747140] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-16T17:47:52.747043] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:47:52.749632] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T17:47:53.162919] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-16T17:47:53.169814] [INFO ] [REMOTE ] BTE: Full fetch complete (76387 records). [2025-10-16T17:47:53.169929] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-16T17:47:53.553467] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-16T17:47:53.558519] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-16T17:47:53.558599] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-16T17:47:53.559483] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-16T17:47:53.559548] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-16T17:47:53.561295] [DEBUG] [LOCAL ] BTE: Trimmed 76387 records to 53118 (keeping 200 days of data) [2025-10-16T17:47:53.870910] [DEBUG] [LOCAL ] BTE: Primary data saved (53118 records). [2025-10-16T17:47:53.871049] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-16T17:47:53.871814] [INFO ] [MAIN ] Update Progress: 349/2369 symbols completed. BTE took 35.4s. Estimated remaining: 4h 36m 53s. Rate: 7.3 symbols/min [2025-10-16T17:47:54.040592] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:47:54.040821] [DEBUG] [LOCAL ] BTU: No existing data file found in primary storage. [2025-10-16T17:47:54.040868] [WARN ] [MAIN ] BTU: No existing data found, performing full refresh instead. [2025-10-16T17:47:54.040976] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-16T17:47:54.041017] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-16T17:47:54.041057] [DEBUG] [LOCAL ] BTU: No primary data file found to delete. [2025-10-16T17:47:54.041088] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-16T17:47:54.353275] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-16T17:47:54.396153] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:47:54.733325] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T17:47:54.889444] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-16T17:47:54.910109] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-16T17:47:55.142796] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-16T17:47:55.857312] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T17:47:55.942840] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-16T17:47:56.584000] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-16T17:47:56.742856] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-16T17:47:57.542818] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-16T17:47:57.713678] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-16T17:47:58.342836] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-16T17:47:58.354468] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T17:47:59.142819] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-16T17:47:59.840958] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-16T17:47:59.942794] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-16T17:48:00.276999] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-16T17:48:00.742821] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-16T17:48:01.021221] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-16T17:48:01.023236] [INFO ] [REMOTE ] BTO: Full fetch complete (13328 records). [2025-10-16T17:48:01.023334] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-16T17:48:01.425430] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-16T17:48:01.425529] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-16T17:48:01.425892] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-16T17:48:01.425957] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-16T17:48:01.426449] [DEBUG] [LOCAL ] BTO: Trimmed 13328 records to 8975 (keeping 200 days of data) [2025-10-16T17:48:01.480945] [DEBUG] [LOCAL ] BTO: Primary data saved (8975 records). [2025-10-16T17:48:01.481096] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-16T17:48:01.481202] [INFO ] [MAIN ] Update Progress: 350/2369 symbols completed. BTO took 24.6s. Estimated remaining: 4h 36m 41s. Rate: 7.3 symbols/min [2025-10-16T17:48:01.548098] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-16T17:48:01.657410] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:48:01.657602] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-16T17:48:01.657664] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-16T17:48:01.657789] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-16T17:48:01.657831] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-16T17:48:01.657871] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-16T17:48:01.657904] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-16T17:48:02.024139] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:48:02.342879] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-16T17:48:02.890287] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-16T17:48:03.151875] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-16T17:48:03.153102] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-16T17:48:03.322543] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:48:03.322829] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-16T17:48:03.322916] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:48:03.322988] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-16T17:48:03.323053] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:48:03.323122] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-16T17:48:03.323184] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-16T17:48:03.323220] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-16T17:48:03.323258] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-16T17:48:03.323303] [INFO ] [MAIN ] Update Progress: 351/2369 symbols completed. BTX took 1.8s. Estimated remaining: 4h 35m 56s. Rate: 7.3 symbols/min [2025-10-16T17:48:03.498194] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:48:03.528266] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-16T17:48:03.553787] [DEBUG] [LOCAL ] BTZ: Loaded 22588 existing records from primary storage. [2025-10-16T17:48:03.554013] [INFO ] [MAIN ] BTZ: Loaded 22588 existing records. [2025-10-16T17:48:03.728159] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:48:03.728345] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-16T17:48:03.728396] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-16T17:48:03.728887] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-16T17:48:03.728944] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-16T17:48:03.948082] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-16T17:48:04.093544] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:48:04.742825] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-16T17:48:05.101705] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T17:48:05.542818] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-16T17:48:06.342844] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-16T17:48:06.477591] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T17:48:07.032417] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-16T17:48:07.142805] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-16T17:48:07.794815] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T17:48:07.942833] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-16T17:48:08.467894] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T17:48:08.742813] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-16T17:48:09.551773] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-16T17:48:09.574459] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T17:48:10.265428] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T17:48:10.342780] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-16T17:48:10.412988] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T17:48:11.142842] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-16T17:48:11.942790] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-16T17:48:12.167302] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T17:48:12.405522] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-16T17:48:12.412394] [INFO ] [REMOTE ] BTI: Full fetch complete (77636 records). [2025-10-16T17:48:12.412516] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-16T17:48:12.748694] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-16T17:48:12.797539] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-16T17:48:12.797632] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-16T17:48:12.798545] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-16T17:48:12.798743] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-16T17:48:12.800324] [DEBUG] [LOCAL ] BTI: Trimmed 77636 records to 53986 (keeping 200 days of data) [2025-10-16T17:48:13.129370] [DEBUG] [LOCAL ] BTI: Primary data saved (53986 records). [2025-10-16T17:48:13.129530] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-16T17:48:13.130037] [INFO ] [MAIN ] Update Progress: 352/2369 symbols completed. BTI took 43.2s. Estimated remaining: 4h 35m 57s. Rate: 7.3 symbols/min [2025-10-16T17:48:13.294574] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:48:13.345160] [DEBUG] [LOCAL ] BUD: Loaded 52596 existing records from primary storage. [2025-10-16T17:48:13.345464] [INFO ] [MAIN ] BUD: Loaded 52596 existing records. [2025-10-16T17:48:13.521481] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:48:13.521902] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-16T17:48:13.522050] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-16T17:48:13.523059] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-16T17:48:13.523118] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-16T17:48:13.553334] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-16T17:48:13.843077] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-16T17:48:13.929187] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:48:13.968399] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-16T17:48:14.342825] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-16T17:48:14.770475] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T17:48:15.142808] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-16T17:48:15.942813] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-16T17:48:15.978793] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T17:48:16.194055] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-16T17:48:16.742893] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-16T17:48:17.542815] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-16T17:48:18.010524] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-16T17:48:18.342860] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-16T17:48:18.717481] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-16T17:48:18.902715] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T17:48:19.142876] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-16T17:48:19.948406] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-16T17:48:19.954304] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T17:48:20.075401] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T17:48:20.742872] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-16T17:48:21.542813] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-16T17:48:21.865392] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T17:48:21.899906] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-16T17:48:22.342777] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-16T17:48:22.930840] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T17:48:23.142832] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-16T17:48:23.353948] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T17:48:23.942902] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-16T17:48:24.580106] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T17:48:24.582012] [INFO ] [REMOTE ] BTT: Full fetch complete (22723 records). [2025-10-16T17:48:24.582129] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-16T17:48:24.582567] [FATAL] [VALIDATOR ] BTT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:48:24.582630] [FATAL] [MAIN ] BTT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:48:24.582704] [WARN ] [MAIN ] BTT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:48:24.582751] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-16T17:48:24.582820] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-16T17:48:24.582877] [INFO ] [LOCAL ] BTT: Starting deletion of derivative data. [2025-10-16T17:48:24.583003] [DEBUG] [LOCAL ] BTT: Deleted derivative data file. [2025-10-16T17:48:24.583085] [INFO ] [MAIN ] Update Progress: 353/2369 symbols completed. BTT took 32.6s. Estimated remaining: 4h 36m 7s. Rate: 7.3 symbols/min [2025-10-16T17:48:24.755340] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-16T17:48:24.756971] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:48:24.769054] [DEBUG] [LOCAL ] BUI: Loaded 11893 existing records from primary storage. [2025-10-16T17:48:24.769278] [INFO ] [MAIN ] BUI: Loaded 11893 existing records. [2025-10-16T17:48:24.944666] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:48:24.944859] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-16T17:48:24.944906] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-16T17:48:24.945209] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-16T17:48:24.945265] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-16T17:48:25.298891] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:48:25.329134] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-16T17:48:25.542813] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-16T17:48:26.342891] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-16T17:48:26.544968] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T17:48:27.034889] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-16T17:48:27.142800] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-16T17:48:27.340872] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T17:48:27.942841] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-16T17:48:28.184490] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-16T17:48:28.742854] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-16T17:48:29.450202] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T17:48:29.542796] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-16T17:48:30.318264] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T17:48:30.342776] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-16T17:48:31.142786] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-16T17:48:31.331450] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T17:48:31.338369] [INFO ] [REMOTE ] BTU: Full fetch complete (77264 records). [2025-10-16T17:48:31.338510] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-16T17:48:31.699767] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-16T17:48:31.731405] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-16T17:48:31.731493] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-16T17:48:31.732431] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-16T17:48:31.732496] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-16T17:48:31.733914] [DEBUG] [LOCAL ] BTU: Trimmed 77264 records to 53714 (keeping 200 days of data) [2025-10-16T17:48:31.960690] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-16T17:48:32.055155] [DEBUG] [LOCAL ] BTU: Primary data saved (53714 records). [2025-10-16T17:48:32.055296] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-16T17:48:32.055367] [INFO ] [MAIN ] Update Progress: 354/2369 symbols completed. BTU took 38.2s. Estimated remaining: 4h 35m 55s. Rate: 7.3 symbols/min [2025-10-16T17:48:32.226139] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:48:32.266368] [DEBUG] [LOCAL ] BUR: Loaded 45344 existing records from primary storage. [2025-10-16T17:48:32.266751] [INFO ] [MAIN ] BUR: Loaded 45344 existing records. [2025-10-16T17:48:32.445057] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:48:32.445427] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-16T17:48:32.445598] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-16T17:48:32.457940] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-16T17:48:32.475101] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-16T17:48:32.532277] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-16T17:48:32.626364] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T17:48:32.747938] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-16T17:48:32.859554] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:48:33.542815] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-16T17:48:34.277267] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T17:48:34.342792] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-16T17:48:34.502610] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T17:48:34.882562] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-16T17:48:35.142822] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-16T17:48:35.942832] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-16T17:48:36.657149] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T17:48:36.742793] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-16T17:48:37.149232] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T17:48:37.542814] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-16T17:48:38.236297] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T17:48:38.252374] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-16T17:48:38.342809] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-16T17:48:39.142794] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-16T17:48:39.392008] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T17:48:39.395385] [INFO ] [REMOTE ] BTZ: Full fetch complete (33397 records). [2025-10-16T17:48:39.395485] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-16T17:48:39.782025] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-16T17:48:39.797429] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-16T17:48:39.799985] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-16T17:48:39.801383] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-16T17:48:39.801447] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-16T17:48:39.802257] [DEBUG] [LOCAL ] BTZ: Trimmed 33397 records to 22717 (keeping 200 days of data) [2025-10-16T17:48:39.936092] [DEBUG] [LOCAL ] BTZ: Primary data saved (22717 records). [2025-10-16T17:48:39.936223] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-16T17:48:39.936328] [INFO ] [MAIN ] Update Progress: 355/2369 symbols completed. BTZ took 36.6s. Estimated remaining: 4h 35m 45s. Rate: 7.3 symbols/min [2025-10-16T17:48:39.948166] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-16T17:48:40.114116] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:48:40.154368] [DEBUG] [LOCAL ] BURL: Loaded 45707 existing records from primary storage. [2025-10-16T17:48:40.154689] [INFO ] [MAIN ] BURL: Loaded 45707 existing records. [2025-10-16T17:48:40.331260] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:48:40.331481] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-16T17:48:40.331529] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-16T17:48:40.332355] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-16T17:48:40.332414] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-16T17:48:40.682736] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:48:40.742787] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-16T17:48:41.542798] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-16T17:48:41.966417] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T17:48:42.342797] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-16T17:48:42.415403] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T17:48:42.479751] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T17:48:43.142895] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-16T17:48:43.914903] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T17:48:43.942781] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-16T17:48:44.037837] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-16T17:48:44.742886] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-16T17:48:45.542832] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-16T17:48:45.643594] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T17:48:45.828755] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T17:48:46.342869] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-16T17:48:46.704872] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T17:48:47.142814] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-16T17:48:47.547455] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T17:48:47.942852] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-16T17:48:48.733610] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T17:48:48.742775] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-16T17:48:49.542817] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-16T17:48:49.615997] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T17:48:50.342923] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-16T17:48:50.440561] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T17:48:51.142855] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-16T17:48:51.178030] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-16T17:48:51.184701] [INFO ] [REMOTE ] BUD: Full fetch complete (76495 records). [2025-10-16T17:48:51.184823] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-16T17:48:51.576568] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-16T17:48:51.576720] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-16T17:48:51.577561] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-16T17:48:51.577606] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-16T17:48:51.579022] [DEBUG] [LOCAL ] BUD: Trimmed 76495 records to 52981 (keeping 200 days of data) [2025-10-16T17:48:51.711494] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-16T17:48:51.849864] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T17:48:51.939659] [DEBUG] [LOCAL ] BUD: Primary data saved (52981 records). [2025-10-16T17:48:51.939798] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-16T17:48:51.940422] [INFO ] [MAIN ] Update Progress: 356/2369 symbols completed. BUD took 38.8s. Estimated remaining: 4h 35m 58s. Rate: 7.3 symbols/min [2025-10-16T17:48:51.950638] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-16T17:48:52.107344] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:48:52.107494] [DEBUG] [LOCAL ] BUXX: No existing data file found in primary storage. [2025-10-16T17:48:52.107530] [WARN ] [MAIN ] BUXX: No existing data found, performing full refresh instead. [2025-10-16T17:48:52.107661] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-16T17:48:52.107718] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-16T17:48:52.107763] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-16T17:48:52.107794] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-16T17:48:52.452147] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:48:52.742812] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-16T17:48:53.503362] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-16T17:48:53.542744] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-16T17:48:53.750702] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T17:48:54.342783] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-16T17:48:54.558759] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T17:48:55.088044] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T17:48:55.142818] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-16T17:48:55.942858] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-16T17:48:56.696938] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T17:48:56.742829] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-16T17:48:57.298540] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-16T17:48:57.542869] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-16T17:48:58.044100] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-16T17:48:58.342841] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-16T17:48:58.696872] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T17:48:59.093944] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T17:48:59.142816] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-16T17:48:59.732438] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-16T17:48:59.942823] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-16T17:49:00.742826] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-16T17:49:01.542788] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-16T17:49:01.654163] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T17:49:02.241810] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T17:49:02.244087] [INFO ] [REMOTE ] BUI: Full fetch complete (16648 records). [2025-10-16T17:49:02.244180] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-16T17:49:02.343525] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-16T17:49:02.630105] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-16T17:49:02.630268] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-16T17:49:02.631187] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-16T17:49:02.631348] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-16T17:49:02.632455] [DEBUG] [LOCAL ] BUI: Trimmed 16648 records to 12010 (keeping 200 days of data) [2025-10-16T17:49:02.714744] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T17:49:02.747487] [DEBUG] [LOCAL ] BUI: Primary data saved (12010 records). [2025-10-16T17:49:02.747725] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-16T17:49:02.747855] [INFO ] [MAIN ] Update Progress: 357/2369 symbols completed. BUI took 38.2s. Estimated remaining: 4h 36m 4s. Rate: 7.3 symbols/min [2025-10-16T17:49:03.142810] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-16T17:49:03.397112] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T17:49:03.942859] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-16T17:49:04.702835] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T17:49:04.742866] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-16T17:49:05.237739] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T17:49:05.542802] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-16T17:49:06.034860] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T17:49:06.342781] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-16T17:49:07.142813] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-16T17:49:07.208061] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T17:49:07.558363] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-16T17:49:07.563925] [INFO ] [REMOTE ] BURL: Full fetch complete (65887 records). [2025-10-16T17:49:07.564035] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-16T17:49:07.954049] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-16T17:49:07.950578] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-16T17:49:07.954182] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-16T17:49:07.955807] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-16T17:49:07.955947] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-16T17:49:07.957228] [DEBUG] [LOCAL ] BURL: Trimmed 65887 records to 46016 (keeping 200 days of data) [2025-10-16T17:49:08.146537] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T17:49:08.263766] [DEBUG] [LOCAL ] BURL: Primary data saved (46016 records). [2025-10-16T17:49:08.263945] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-16T17:49:08.264629] [INFO ] [MAIN ] Update Progress: 358/2369 symbols completed. BURL took 28.3s. Estimated remaining: 4h 35m 41s. Rate: 7.3 symbols/min [2025-10-16T17:49:08.742878] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-16T17:49:09.509521] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T17:49:09.515432] [INFO ] [REMOTE ] BUR: Full fetch complete (64226 records). [2025-10-16T17:49:09.515558] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-16T17:49:09.820952] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T17:49:09.876874] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-16T17:49:09.922903] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-16T17:49:09.922983] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-16T17:49:09.923792] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-16T17:49:09.923854] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-16T17:49:09.925172] [DEBUG] [LOCAL ] BUR: Trimmed 64226 records to 45717 (keeping 200 days of data) [2025-10-16T17:49:10.187862] [DEBUG] [LOCAL ] BUR: Primary data saved (45717 records). [2025-10-16T17:49:10.187994] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-16T17:49:10.188497] [INFO ] [MAIN ] Update Progress: 359/2369 symbols completed. BUR took 38.1s. Estimated remaining: 4h 34m 57s. Rate: 7.3 symbols/min [2025-10-16T17:49:10.758487] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T17:49:10.761859] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-16T17:49:11.613540] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-16T17:49:11.617365] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-16T17:49:12.575783] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T17:49:12.578022] [INFO ] [REMOTE ] BUXX: Full fetch complete (20598 records). [2025-10-16T17:49:12.578127] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-16T17:49:12.943178] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-16T17:49:12.943261] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-16T17:49:12.943676] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-16T17:49:12.943736] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-16T17:49:12.944615] [DEBUG] [LOCAL ] BUXX: Trimmed 20598 records to 15455 (keeping 200 days of data) [2025-10-16T17:49:13.034822] [DEBUG] [LOCAL ] BUXX: Primary data saved (15455 records). [2025-10-16T17:49:13.034959] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-16T17:49:13.035026] [INFO ] [MAIN ] Update Progress: 360/2369 symbols completed. BUXX took 21.1s. Estimated remaining: 4h 34m 19s. Rate: 7.3 symbols/min [2025-10-16T17:49:13.709787] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:49:13.717697] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:49:13.723924] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:49:13.722708] [DEBUG] [LOCAL ] BV: No existing data file found in primary storage. [2025-10-16T17:49:13.741133] [WARN ] [MAIN ] BV: No existing data found, performing full refresh instead. [2025-10-16T17:49:13.744082] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-16T17:49:13.745477] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-16T17:49:13.745306] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:49:13.745762] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-16T17:49:13.746141] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-16T17:49:14.085412] [DEBUG] [LOCAL ] BW: Loaded 40513 existing records from primary storage. [2025-10-16T17:49:14.089276] [DEBUG] [LOCAL ] BWA: Loaded 52138 existing records from primary storage. [2025-10-16T17:49:14.101991] [INFO ] [MAIN ] BW: Loaded 40513 existing records. [2025-10-16T17:49:14.102170] [INFO ] [MAIN ] BWA: Loaded 52138 existing records. [2025-10-16T17:49:14.103009] [DEBUG] [LOCAL ] BVN: Loaded 44301 existing records from primary storage. [2025-10-16T17:49:14.131120] [INFO ] [MAIN ] BVN: Loaded 44301 existing records. [2025-10-16T17:49:14.423938] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:49:14.484392] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-16T17:49:14.676108] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:49:14.719886] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-16T17:49:14.747197] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-16T17:49:14.763460] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:49:14.787863] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-16T17:49:14.793477] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:49:14.793784] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-16T17:49:14.793987] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-16T17:49:14.793891] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-16T17:49:14.794372] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-16T17:49:14.794436] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-16T17:49:14.799735] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-16T17:49:14.799953] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-16T17:49:14.838514] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-16T17:49:14.877862] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-16T17:49:15.848459] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:49:15.872751] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-16T17:49:15.944992] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:49:15.954557] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-16T17:49:15.975571] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:49:15.976634] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-16T17:49:16.035976] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T17:49:16.043160] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-16T17:49:17.281248] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T17:49:17.290549] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-16T17:49:17.310250] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T17:49:17.316312] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-16T17:49:17.367596] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T17:49:17.542829] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-16T17:49:17.602407] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T17:49:18.284987] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-16T17:49:18.342802] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-16T17:49:18.671297] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T17:49:18.837317] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T17:49:19.142820] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-16T17:49:19.947989] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-16T17:49:19.965748] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:49:20.470159] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T17:49:20.742832] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-16T17:49:20.922587] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-16T17:49:21.542862] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-16T17:49:22.342777] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-16T17:49:22.371843] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T17:49:22.751920] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T17:49:23.142861] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-16T17:49:23.417994] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-16T17:49:23.942835] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-16T17:49:24.738632] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T17:49:24.747218] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-16T17:49:25.542797] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-16T17:49:25.628045] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T17:49:26.342841] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-16T17:49:26.375414] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T17:49:27.081436] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T17:49:27.142887] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-16T17:49:27.872621] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T17:49:27.942822] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-16T17:49:28.310312] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T17:49:28.742872] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-16T17:49:29.229638] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T17:49:29.542828] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-16T17:49:30.212750] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T17:49:30.342863] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-16T17:49:30.997706] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T17:49:31.142843] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-16T17:49:31.662735] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T17:49:31.942838] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-16T17:49:32.498726] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T17:49:32.742831] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-16T17:49:33.443134] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T17:49:33.542789] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-16T17:49:34.284227] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T17:49:34.342774] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-16T17:49:34.873847] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T17:49:35.142841] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-16T17:49:35.942787] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-16T17:49:36.019631] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T17:49:36.744821] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-16T17:49:36.753591] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T17:49:37.325442] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T17:49:37.542808] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-16T17:49:38.005415] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T17:49:38.342819] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-16T17:49:39.142817] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-16T17:49:39.229372] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T17:49:39.944345] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T17:49:39.943176] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-16T17:49:40.449851] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T17:49:40.742840] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-16T17:49:41.243468] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T17:49:41.542879] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-16T17:49:42.057767] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T17:49:42.342805] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-16T17:49:43.142840] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-16T17:49:43.398382] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-16T17:49:43.404709] [INFO ] [REMOTE ] BW: Full fetch complete (59447 records). [2025-10-16T17:49:43.404817] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-16T17:49:43.783912] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-16T17:49:43.784016] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-16T17:49:43.784782] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-16T17:49:43.784926] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-16T17:49:43.798863] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T17:49:43.803802] [DEBUG] [LOCAL ] BW: Trimmed 59447 records to 40868 (keeping 200 days of data) [2025-10-16T17:49:43.804694] [INFO ] [REMOTE ] BV: Full fetch complete (54833 records). [2025-10-16T17:49:43.804948] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-16T17:49:43.967410] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-16T17:49:44.305249] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-16T17:49:44.305822] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-16T17:49:44.306986] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-16T17:49:44.307778] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-16T17:49:44.313813] [DEBUG] [LOCAL ] BV: Trimmed 54833 records to 38827 (keeping 200 days of data) [2025-10-16T17:49:44.584384] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T17:49:44.597233] [DEBUG] [LOCAL ] BW: Primary data saved (40868 records). [2025-10-16T17:49:44.605181] [INFO ] [MAIN ] BW: Full history saved. [2025-10-16T17:49:44.605289] [INFO ] [MAIN ] Update Progress: 361/2369 symbols completed. BW took 31.6s. Estimated remaining: 4h 36m 21s. Rate: 7.3 symbols/min [2025-10-16T17:49:44.765854] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-16T17:49:44.862012] [DEBUG] [LOCAL ] BV: Primary data saved (38827 records). [2025-10-16T17:49:44.886971] [INFO ] [MAIN ] BV: Full history saved. [2025-10-16T17:49:44.887098] [INFO ] [MAIN ] Update Progress: 362/2369 symbols completed. BV took 31.9s. Estimated remaining: 4h 35m 28s. Rate: 7.3 symbols/min [2025-10-16T17:49:44.886872] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:49:45.025145] [DEBUG] [LOCAL ] BWG: Loaded 12586 existing records from primary storage. [2025-10-16T17:49:45.043073] [INFO ] [MAIN ] BWG: Loaded 12586 existing records. [2025-10-16T17:49:45.144214] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:49:45.252563] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:49:45.253737] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-16T17:49:45.253835] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-16T17:49:45.254329] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-16T17:49:45.254402] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-16T17:49:45.397935] [DEBUG] [LOCAL ] BWLP: Loaded 32251 existing records from primary storage. [2025-10-16T17:49:45.434822] [INFO ] [MAIN ] BWLP: Loaded 32251 existing records. [2025-10-16T17:49:45.836709] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:49:45.845418] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-16T17:49:45.843060] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:49:45.847044] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T17:49:45.846346] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-16T17:49:45.853989] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-16T17:49:45.854955] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-16T17:49:45.855062] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-16T17:49:45.854912] [INFO ] [REMOTE ] BVN: Full fetch complete (63303 records). [2025-10-16T17:49:45.886052] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-16T17:49:46.536140] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:49:46.563256] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-16T17:49:46.636819] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-16T17:49:46.636921] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-16T17:49:46.637726] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-16T17:49:46.637805] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-16T17:49:46.639264] [DEBUG] [LOCAL ] BVN: Trimmed 63303 records to 44679 (keeping 200 days of data) [2025-10-16T17:49:46.765973] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-16T17:49:46.766239] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T17:49:46.951831] [DEBUG] [LOCAL ] BVN: Primary data saved (44679 records). [2025-10-16T17:49:46.951962] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-16T17:49:46.952064] [INFO ] [MAIN ] Update Progress: 363/2369 symbols completed. BVN took 33.9s. Estimated remaining: 4h 34m 46s. Rate: 7.3 symbols/min [2025-10-16T17:49:47.118135] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:49:47.127786] [DEBUG] [LOCAL ] BWMX: Loaded 7781 existing records from primary storage. [2025-10-16T17:49:47.127994] [INFO ] [MAIN ] BWMX: Loaded 7781 existing records. [2025-10-16T17:49:47.148119] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-16T17:49:47.309329] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:49:47.309548] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-16T17:49:47.309594] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-16T17:49:47.309794] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-16T17:49:47.309853] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-16T17:49:47.659716] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:49:47.942830] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-16T17:49:48.203176] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T17:49:48.742878] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-16T17:49:48.939545] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T17:49:49.124179] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T17:49:49.256314] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-16T17:49:49.542835] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-16T17:49:50.025771] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T17:49:50.342814] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-16T17:49:51.142842] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-16T17:49:51.744961] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T17:49:51.764854] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T17:49:51.942807] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-16T17:49:52.742862] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-16T17:49:52.769395] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T17:49:53.132030] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-16T17:49:53.542842] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-16T17:49:54.342839] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-16T17:49:55.060348] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T17:49:55.142792] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-16T17:49:55.231532] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T17:49:55.238468] [INFO ] [REMOTE ] BWA: Full fetch complete (75906 records). [2025-10-16T17:49:55.238601] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-16T17:49:55.621273] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-16T17:49:55.621349] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-16T17:49:55.622205] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-16T17:49:55.622267] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-16T17:49:55.623620] [DEBUG] [LOCAL ] BWA: Trimmed 75906 records to 52519 (keeping 200 days of data) [2025-10-16T17:49:55.845860] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-16T17:49:55.943148] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-16T17:49:55.960724] [DEBUG] [LOCAL ] BWA: Primary data saved (52519 records). [2025-10-16T17:49:55.960864] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-16T17:49:55.961242] [INFO ] [MAIN ] Update Progress: 364/2369 symbols completed. BWA took 42.9s. Estimated remaining: 4h 34m 42s. Rate: 7.3 symbols/min [2025-10-16T17:49:56.131290] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:49:56.139171] [DEBUG] [LOCAL ] BWNB: Loaded 4206 existing records from primary storage. [2025-10-16T17:49:56.139389] [INFO ] [MAIN ] BWNB: Loaded 4206 existing records. [2025-10-16T17:49:56.316175] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:49:56.316411] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-16T17:49:56.316457] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-16T17:49:56.316613] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-16T17:49:56.316705] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-16T17:49:56.664572] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:49:56.742774] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-16T17:49:57.315061] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T17:49:57.353325] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T17:49:57.542803] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-16T17:49:58.342827] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-16T17:49:59.147055] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-16T17:49:59.148636] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T17:49:59.158067] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-16T17:49:59.942796] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-16T17:50:00.043130] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T17:50:00.382059] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-16T17:50:00.742806] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-16T17:50:01.542813] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-16T17:50:01.684476] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T17:50:02.342902] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-16T17:50:02.996406] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-16T17:50:03.142832] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-16T17:50:03.211345] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T17:50:03.942815] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-16T17:50:04.742842] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-16T17:50:04.751962] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T17:50:04.881087] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T17:50:05.200071] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-16T17:50:05.542823] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-16T17:50:06.342794] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-16T17:50:06.423412] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T17:50:07.142837] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-16T17:50:07.185013] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-16T17:50:07.896796] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T17:50:07.942804] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-16T17:50:08.555700] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-16T17:50:08.742827] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-16T17:50:09.542830] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-16T17:50:10.034172] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-16T17:50:10.233631] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T17:50:10.342820] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-16T17:50:10.902579] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-16T17:50:11.142821] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-16T17:50:11.881080] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T17:50:11.942814] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-16T17:50:12.481215] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-16T17:50:12.742890] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-16T17:50:13.542832] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-16T17:50:13.572368] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T17:50:13.573716] [INFO ] [REMOTE ] BWMX: Full fetch complete (10045 records). [2025-10-16T17:50:13.573785] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-16T17:50:13.927801] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-16T17:50:13.927879] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-16T17:50:13.928080] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-16T17:50:13.928118] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-16T17:50:13.928528] [DEBUG] [LOCAL ] BWMX: Trimmed 10045 records to 7843 (keeping 200 days of data) [2025-10-16T17:50:13.974058] [DEBUG] [LOCAL ] BWMX: Primary data saved (7843 records). [2025-10-16T17:50:13.974165] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-16T17:50:13.974240] [INFO ] [MAIN ] Update Progress: 365/2369 symbols completed. BWMX took 27.0s. Estimated remaining: 4h 35m 28s. Rate: 7.3 symbols/min [2025-10-16T17:50:14.045073] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-16T17:50:14.155331] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:50:14.162927] [DEBUG] [LOCAL ] BWSN: Loaded 5154 existing records from primary storage. [2025-10-16T17:50:14.163124] [INFO ] [MAIN ] BWSN: Loaded 5154 existing records. [2025-10-16T17:50:14.336053] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:50:14.336280] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-16T17:50:14.336330] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-16T17:50:14.336477] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-16T17:50:14.336516] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-16T17:50:14.347895] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-16T17:50:14.692716] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:50:14.883407] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-16T17:50:15.142812] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-16T17:50:15.942818] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-16T17:50:16.623437] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-16T17:50:16.656102] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T17:50:16.742883] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-16T17:50:17.542849] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-16T17:50:17.581721] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T17:50:18.114696] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T17:50:18.342858] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-16T17:50:18.902335] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-16T17:50:18.903816] [INFO ] [REMOTE ] BWNB: Full fetch complete (5614 records). [2025-10-16T17:50:18.903907] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-16T17:50:19.152351] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-16T17:50:19.281344] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-16T17:50:19.281449] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-16T17:50:19.281697] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-16T17:50:19.281759] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-16T17:50:19.282191] [DEBUG] [LOCAL ] BWNB: Trimmed 5614 records to 4220 (keeping 200 days of data) [2025-10-16T17:50:19.310573] [DEBUG] [LOCAL ] BWNB: Primary data saved (4220 records). [2025-10-16T17:50:19.310754] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-16T17:50:19.310847] [INFO ] [MAIN ] Update Progress: 366/2369 symbols completed. BWNB took 23.3s. Estimated remaining: 4h 35m 4s. Rate: 7.3 symbols/min [2025-10-16T17:50:19.508903] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:50:19.552962] [DEBUG] [LOCAL ] BWXT: Loaded 47121 existing records from primary storage. [2025-10-16T17:50:19.553276] [INFO ] [MAIN ] BWXT: Loaded 47121 existing records. [2025-10-16T17:50:19.735572] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:50:19.735807] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-16T17:50:19.735856] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-16T17:50:19.736179] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-16T17:50:19.736218] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-16T17:50:19.947897] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-16T17:50:20.132312] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:50:20.633877] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T17:50:20.741047] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T17:50:20.743558] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-16T17:50:21.177185] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T17:50:21.542820] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-16T17:50:22.342832] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-16T17:50:22.868804] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T17:50:23.142816] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-16T17:50:23.942806] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-16T17:50:24.066286] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T17:50:24.161241] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-16T17:50:24.271077] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-16T17:50:24.742818] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-16T17:50:25.434353] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T17:50:25.435971] [INFO ] [REMOTE ] BWG: Full fetch complete (17772 records). [2025-10-16T17:50:25.436040] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-16T17:50:25.547874] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-16T17:50:25.815965] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-16T17:50:25.816046] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-16T17:50:25.816461] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-16T17:50:25.816502] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-16T17:50:25.817039] [DEBUG] [LOCAL ] BWG: Trimmed 17772 records to 12662 (keeping 200 days of data) [2025-10-16T17:50:25.892897] [DEBUG] [LOCAL ] BWG: Primary data saved (12662 records). [2025-10-16T17:50:25.893033] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-16T17:50:25.893109] [INFO ] [MAIN ] Update Progress: 367/2369 symbols completed. BWG took 41.3s. Estimated remaining: 4h 34m 46s. Rate: 7.3 symbols/min [2025-10-16T17:50:26.064758] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:50:26.124715] [DEBUG] [LOCAL ] BX: Loaded 53483 existing records from primary storage. [2025-10-16T17:50:26.125041] [INFO ] [MAIN ] BX: Loaded 53483 existing records. [2025-10-16T17:50:26.313389] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:50:26.313691] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-16T17:50:26.313750] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-16T17:50:26.314107] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-16T17:50:26.314147] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-16T17:50:26.347893] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-16T17:50:26.694613] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:50:27.109555] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T17:50:27.114267] [INFO ] [REMOTE ] BWLP: Full fetch complete (48043 records). [2025-10-16T17:50:27.114356] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-16T17:50:27.147393] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-16T17:50:27.207815] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T17:50:27.510802] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-16T17:50:27.510902] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-16T17:50:27.511613] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-16T17:50:27.511703] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-16T17:50:27.512817] [DEBUG] [LOCAL ] BWLP: Trimmed 48043 records to 32486 (keeping 200 days of data) [2025-10-16T17:50:27.703510] [DEBUG] [LOCAL ] BWLP: Primary data saved (32486 records). [2025-10-16T17:50:27.703668] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-16T17:50:27.703771] [INFO ] [MAIN ] Update Progress: 368/2369 symbols completed. BWLP took 42.8s. Estimated remaining: 4h 34m 3s. Rate: 7.3 symbols/min [2025-10-16T17:50:27.868608] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:50:27.883129] [DEBUG] [LOCAL ] BXC: Loaded 13669 existing records from primary storage. [2025-10-16T17:50:27.883354] [INFO ] [MAIN ] BXC: Loaded 13669 existing records. [2025-10-16T17:50:27.947894] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-16T17:50:28.059765] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:50:28.059994] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-16T17:50:28.060041] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-16T17:50:28.060214] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-16T17:50:28.060252] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-16T17:50:28.410434] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:50:28.742852] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-16T17:50:29.100308] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T17:50:29.184083] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-16T17:50:29.542791] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-16T17:50:29.797798] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T17:50:30.342830] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-16T17:50:31.142808] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-16T17:50:31.369216] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T17:50:31.414130] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T17:50:31.942857] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-16T17:50:32.742813] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-16T17:50:32.836372] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T17:50:33.312457] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-16T17:50:33.525685] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T17:50:33.542768] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-16T17:50:33.847888] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-16T17:50:34.342818] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-16T17:50:35.142832] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-16T17:50:35.942883] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-16T17:50:36.003243] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T17:50:36.393603] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-16T17:50:36.742848] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-16T17:50:37.429303] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-16T17:50:37.542794] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-16T17:50:37.737862] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T17:50:38.155588] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T17:50:38.342802] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-16T17:50:38.869335] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-16T17:50:39.142815] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-16T17:50:39.942814] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-16T17:50:40.742826] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-16T17:50:40.831824] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T17:50:41.193986] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T17:50:41.542825] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-16T17:50:41.901245] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T17:50:42.342876] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-16T17:50:42.923186] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T17:50:42.924389] [INFO ] [REMOTE ] BWSN: Full fetch complete (6368 records). [2025-10-16T17:50:42.924476] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-16T17:50:43.148438] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-16T17:50:43.295405] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-16T17:50:43.310130] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-16T17:50:43.319829] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-16T17:50:43.319915] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-16T17:50:43.322228] [DEBUG] [LOCAL ] BWSN: Trimmed 6368 records to 5203 (keeping 200 days of data) [2025-10-16T17:50:43.322100] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T17:50:43.363991] [DEBUG] [LOCAL ] BWSN: Primary data saved (5203 records). [2025-10-16T17:50:43.364082] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-16T17:50:43.364159] [INFO ] [MAIN ] Update Progress: 369/2369 symbols completed. BWSN took 29.4s. Estimated remaining: 4h 34m 35s. Rate: 7.3 symbols/min [2025-10-16T17:50:43.530306] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:50:43.575158] [DEBUG] [LOCAL ] BXMT: Loaded 47317 existing records from primary storage. [2025-10-16T17:50:43.575484] [INFO ] [MAIN ] BXMT: Loaded 47317 existing records. [2025-10-16T17:50:43.749189] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:50:43.749398] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-16T17:50:43.749444] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-16T17:50:43.749749] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-16T17:50:43.749807] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-16T17:50:43.948895] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-16T17:50:44.106215] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:50:44.742847] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-16T17:50:44.933435] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T17:50:45.170974] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T17:50:45.542820] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-16T17:50:46.207138] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-16T17:50:46.240471] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T17:50:46.342775] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-16T17:50:47.142813] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-16T17:50:47.942831] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-16T17:50:47.994917] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T17:50:48.627667] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T17:50:48.742836] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-16T17:50:49.542795] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-16T17:50:49.775518] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-16T17:50:50.343232] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-16T17:50:50.347543] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-16T17:50:50.589892] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T17:50:51.142819] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-16T17:50:51.919322] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T17:50:51.942786] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-16T17:50:52.742798] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-16T17:50:53.015787] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T17:50:53.542777] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-16T17:50:53.574144] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T17:50:53.711682] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T17:50:54.342808] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-16T17:50:55.142797] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-16T17:50:55.352374] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T17:50:55.738484] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T17:50:55.942811] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-16T17:50:56.742805] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-16T17:50:56.835823] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T17:50:57.003810] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T17:50:57.542869] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-16T17:50:58.344995] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-16T17:50:58.348030] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T17:50:58.890224] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-16T17:50:58.896718] [INFO ] [REMOTE ] BWXT: Full fetch complete (67926 records). [2025-10-16T17:50:58.896867] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-16T17:50:59.148141] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-16T17:50:59.286266] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-16T17:50:59.286350] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-16T17:50:59.287156] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-16T17:50:59.287219] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-16T17:50:59.288547] [DEBUG] [LOCAL ] BWXT: Trimmed 67926 records to 47497 (keeping 200 days of data) [2025-10-16T17:50:59.577286] [DEBUG] [LOCAL ] BWXT: Primary data saved (47497 records). [2025-10-16T17:50:59.577425] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-16T17:50:59.577913] [INFO ] [MAIN ] Update Progress: 370/2369 symbols completed. BWXT took 40.3s. Estimated remaining: 4h 35m 10s. Rate: 7.3 symbols/min [2025-10-16T17:50:59.744355] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:50:59.766059] [DEBUG] [LOCAL ] BXMX: Loaded 19492 existing records from primary storage. [2025-10-16T17:50:59.766375] [INFO ] [MAIN ] BXMX: Loaded 19492 existing records. [2025-10-16T17:50:59.945916] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:50:59.946008] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-16T17:50:59.946459] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-16T17:50:59.947292] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-16T17:50:59.947578] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-16T17:50:59.947636] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-16T17:51:00.299137] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:00.335699] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-16T17:51:00.340371] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T17:51:00.349333] [INFO ] [REMOTE ] BXC: Full fetch complete (18227 records). [2025-10-16T17:51:00.349601] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-16T17:51:00.714956] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-16T17:51:00.715042] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-16T17:51:00.715419] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-16T17:51:00.715458] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-16T17:51:00.716081] [DEBUG] [LOCAL ] BXC: Trimmed 18227 records to 13714 (keeping 200 days of data) [2025-10-16T17:51:00.748587] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-16T17:51:00.795196] [DEBUG] [LOCAL ] BXC: Primary data saved (13714 records). [2025-10-16T17:51:00.795303] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-16T17:51:00.795376] [INFO ] [MAIN ] Update Progress: 371/2369 symbols completed. BXC took 33.1s. Estimated remaining: 4h 34m 24s. Rate: 7.3 symbols/min [2025-10-16T17:51:00.965055] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:51:01.010801] [DEBUG] [LOCAL ] BXP: Loaded 49889 existing records from primary storage. [2025-10-16T17:51:01.011154] [INFO ] [MAIN ] BXP: Loaded 49889 existing records. [2025-10-16T17:51:01.195817] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:51:01.195980] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-16T17:51:01.196028] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-16T17:51:01.196708] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-16T17:51:01.196766] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-16T17:51:01.547125] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-16T17:51:01.553347] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:01.963829] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-16T17:51:02.342827] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-16T17:51:02.820060] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-16T17:51:02.873939] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T17:51:03.142796] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-16T17:51:03.945442] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-16T17:51:03.948466] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T17:51:04.742805] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-16T17:51:04.864016] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T17:51:04.912528] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T17:51:05.542808] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-16T17:51:06.342819] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-16T17:51:06.645458] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-16T17:51:06.652370] [INFO ] [REMOTE ] BX: Full fetch complete (77579 records). [2025-10-16T17:51:06.652512] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-16T17:51:07.046152] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-16T17:51:07.046286] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-16T17:51:07.047593] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-16T17:51:07.047880] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-16T17:51:07.050095] [DEBUG] [LOCAL ] BX: Trimmed 77579 records to 53873 (keeping 200 days of data) [2025-10-16T17:51:07.159106] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-16T17:51:07.205859] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T17:51:07.432847] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T17:51:07.453851] [DEBUG] [LOCAL ] BX: Primary data saved (53873 records). [2025-10-16T17:51:07.453951] [INFO ] [MAIN ] BX: Full history saved. [2025-10-16T17:51:07.454829] [INFO ] [MAIN ] Update Progress: 372/2369 symbols completed. BX took 41.6s. Estimated remaining: 4h 34m 7s. Rate: 7.3 symbols/min [2025-10-16T17:51:07.619908] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:51:07.712606] [DEBUG] [LOCAL ] BXSL: Loaded 48119 existing records from primary storage. [2025-10-16T17:51:07.713047] [INFO ] [MAIN ] BXSL: Loaded 48119 existing records. [2025-10-16T17:51:07.886231] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:51:07.886439] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-16T17:51:07.886494] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-16T17:51:07.886835] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-16T17:51:07.886891] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-16T17:51:07.949709] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-16T17:51:08.244386] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:08.742945] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-16T17:51:08.747149] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T17:51:09.544928] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T17:51:09.545084] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-16T17:51:10.342804] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-16T17:51:10.552367] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T17:51:10.696095] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T17:51:11.142836] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-16T17:51:11.948259] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-16T17:51:11.962687] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T17:51:12.261021] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T17:51:12.742816] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-16T17:51:13.542813] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-16T17:51:13.605437] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T17:51:13.868807] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T17:51:14.342834] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-16T17:51:14.714092] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T17:51:15.142823] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-16T17:51:15.942803] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-16T17:51:16.166073] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T17:51:16.742771] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-16T17:51:16.908220] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-16T17:51:16.948334] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T17:51:17.542789] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-16T17:51:18.342772] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-16T17:51:18.577978] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T17:51:18.584540] [INFO ] [REMOTE ] BXMT: Full fetch complete (69958 records). [2025-10-16T17:51:18.584702] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-16T17:51:18.990919] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-16T17:51:18.991037] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-16T17:51:18.991952] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-16T17:51:18.992167] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-16T17:51:18.994118] [DEBUG] [LOCAL ] BXMT: Trimmed 69958 records to 47685 (keeping 200 days of data) [2025-10-16T17:51:19.020526] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T17:51:19.149680] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-16T17:51:19.314741] [DEBUG] [LOCAL ] BXMT: Primary data saved (47685 records). [2025-10-16T17:51:19.314892] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-16T17:51:19.315491] [INFO ] [MAIN ] Update Progress: 373/2369 symbols completed. BXMT took 36.0s. Estimated remaining: 4h 34m 18s. Rate: 7.3 symbols/min [2025-10-16T17:51:19.485124] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:51:19.498742] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T17:51:19.524404] [DEBUG] [LOCAL ] BY: Loaded 21823 existing records from primary storage. [2025-10-16T17:51:19.524735] [INFO ] [MAIN ] BY: Loaded 21823 existing records. [2025-10-16T17:51:19.697461] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:51:19.697708] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-16T17:51:19.697764] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-16T17:51:19.697975] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-16T17:51:19.698013] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-16T17:51:19.947953] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-16T17:51:20.045351] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:20.742812] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-16T17:51:20.871002] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T17:51:21.542867] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-16T17:51:21.636451] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T17:51:21.869947] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T17:51:22.150299] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-16T17:51:22.342809] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-16T17:51:23.142802] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-16T17:51:23.255505] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-16T17:51:23.942848] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-16T17:51:24.147571] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T17:51:24.742773] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-16T17:51:24.816602] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T17:51:24.819463] [INFO ] [REMOTE ] BXMX: Full fetch complete (28804 records). [2025-10-16T17:51:24.819540] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-16T17:51:25.182351] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-16T17:51:25.182429] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-16T17:51:25.182909] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-16T17:51:25.182970] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-16T17:51:25.183718] [DEBUG] [LOCAL ] BXMX: Trimmed 28804 records to 19610 (keeping 200 days of data) [2025-10-16T17:51:25.297902] [DEBUG] [LOCAL ] BXMX: Primary data saved (19610 records). [2025-10-16T17:51:25.298037] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-16T17:51:25.298112] [INFO ] [MAIN ] Update Progress: 374/2369 symbols completed. BXMX took 25.7s. Estimated remaining: 4h 33m 58s. Rate: 7.3 symbols/min [2025-10-16T17:51:25.475773] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:51:25.515257] [DEBUG] [LOCAL ] BYD: Loaded 44894 existing records from primary storage. [2025-10-16T17:51:25.515533] [INFO ] [MAIN ] BYD: Loaded 44894 existing records. [2025-10-16T17:51:25.548037] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-16T17:51:25.693449] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:51:25.693727] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-16T17:51:25.693783] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-16T17:51:25.694116] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-16T17:51:25.694172] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-16T17:51:26.068517] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:26.284198] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T17:51:26.342769] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-16T17:51:26.421186] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T17:51:27.142847] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-16T17:51:27.781087] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T17:51:27.942826] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-16T17:51:28.721587] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T17:51:28.742772] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-16T17:51:29.542789] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-16T17:51:29.691820] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T17:51:30.152371] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T17:51:30.342833] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-16T17:51:31.018262] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T17:51:31.142830] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-16T17:51:31.651076] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T17:51:31.942814] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-16T17:51:32.510561] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T17:51:32.742788] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-16T17:51:33.030634] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T17:51:33.542831] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-16T17:51:34.230531] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T17:51:34.342794] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-16T17:51:34.646462] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T17:51:35.142821] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-16T17:51:35.947994] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-16T17:51:35.951866] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T17:51:36.449231] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T17:51:36.742854] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-16T17:51:37.485491] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T17:51:37.542775] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-16T17:51:37.715718] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T17:51:38.342880] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-16T17:51:39.130368] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T17:51:39.142771] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-16T17:51:39.843678] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T17:51:39.942787] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-16T17:51:40.742795] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-16T17:51:41.052618] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-16T17:51:41.059548] [INFO ] [REMOTE ] BXSL: Full fetch complete (69958 records). [2025-10-16T17:51:41.059710] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-16T17:51:41.255497] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T17:51:41.474529] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-16T17:51:41.474613] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-16T17:51:41.475494] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-16T17:51:41.475561] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-16T17:51:41.476913] [DEBUG] [LOCAL ] BXSL: Trimmed 69958 records to 48504 (keeping 200 days of data) [2025-10-16T17:51:41.567007] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-16T17:51:41.770951] [DEBUG] [LOCAL ] BXSL: Primary data saved (48504 records). [2025-10-16T17:51:41.771089] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-16T17:51:41.771681] [INFO ] [MAIN ] Update Progress: 375/2369 symbols completed. BXSL took 34.3s. Estimated remaining: 4h 34m 34s. Rate: 7.3 symbols/min [2025-10-16T17:51:41.935585] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:51:41.950410] [DEBUG] [LOCAL ] BYM: Loaded 11722 existing records from primary storage. [2025-10-16T17:51:41.950676] [INFO ] [MAIN ] BYM: Loaded 11722 existing records. [2025-10-16T17:51:42.127279] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:51:42.127548] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-16T17:51:42.127599] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-16T17:51:42.127795] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-16T17:51:42.127861] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-16T17:51:42.351299] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-16T17:51:42.507525] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:42.520002] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T17:51:42.726805] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T17:51:43.142826] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-16T17:51:43.942869] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-16T17:51:43.979543] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T17:51:44.037774] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T17:51:44.742820] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-16T17:51:45.542870] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-16T17:51:45.668427] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T17:51:45.733328] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T17:51:46.342866] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-16T17:51:46.899357] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T17:51:47.142831] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-16T17:51:47.942784] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-16T17:51:48.179472] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T17:51:48.186043] [INFO ] [REMOTE ] BXP: Full fetch complete (72200 records). [2025-10-16T17:51:48.186151] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-16T17:51:48.585293] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-16T17:51:48.585414] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-16T17:51:48.586308] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-16T17:51:48.586371] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-16T17:51:48.587671] [DEBUG] [LOCAL ] BXP: Trimmed 72200 records to 50256 (keeping 200 days of data) [2025-10-16T17:51:48.721846] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-16T17:51:48.753691] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T17:51:48.750443] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-16T17:51:48.960587] [DEBUG] [LOCAL ] BXP: Primary data saved (50256 records). [2025-10-16T17:51:48.960776] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-16T17:51:48.960896] [INFO ] [MAIN ] Update Progress: 376/2369 symbols completed. BXP took 48.2s. Estimated remaining: 4h 34m 20s. Rate: 7.3 symbols/min [2025-10-16T17:51:49.129415] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:51:49.161757] [DEBUG] [LOCAL ] BZH: Loaded 32426 existing records from primary storage. [2025-10-16T17:51:49.162071] [INFO ] [MAIN ] BZH: Loaded 32426 existing records. [2025-10-16T17:51:49.335206] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:51:49.335445] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-16T17:51:49.335492] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-16T17:51:49.335754] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-16T17:51:49.335811] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-16T17:51:49.546489] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-16T17:51:49.733248] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:49.741206] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T17:51:49.744376] [INFO ] [REMOTE ] BY: Full fetch complete (29734 records). [2025-10-16T17:51:49.744449] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-16T17:51:50.102579] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-16T17:51:50.102679] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-16T17:51:50.103121] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-16T17:51:50.103161] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-16T17:51:50.103854] [DEBUG] [LOCAL ] BY: Trimmed 29734 records to 21987 (keeping 200 days of data) [2025-10-16T17:51:50.233969] [DEBUG] [LOCAL ] BY: Primary data saved (21987 records). [2025-10-16T17:51:50.234093] [INFO ] [MAIN ] BY: Full history saved. [2025-10-16T17:51:50.234166] [INFO ] [MAIN ] Update Progress: 377/2369 symbols completed. BY took 30.9s. Estimated remaining: 4h 33m 34s. Rate: 7.3 symbols/min [2025-10-16T17:51:50.348017] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-16T17:51:50.410183] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:51:50.432791] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T17:51:50.473530] [DEBUG] [LOCAL ] C: Loaded 53740 existing records from primary storage. [2025-10-16T17:51:50.473879] [INFO ] [MAIN ] C: Loaded 53740 existing records. [2025-10-16T17:51:50.654300] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:51:50.654617] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-16T17:51:50.654732] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-16T17:51:50.655342] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-16T17:51:50.655423] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-16T17:51:51.012034] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:51.142777] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-16T17:51:51.776234] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T17:51:51.942825] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-16T17:51:52.742836] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-16T17:51:53.162832] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-16T17:51:53.508604] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T17:51:53.542775] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-16T17:51:53.630067] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T17:51:54.342809] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-16T17:51:55.082418] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-16T17:51:55.088144] [INFO ] [REMOTE ] BYD: Full fetch complete (65338 records). [2025-10-16T17:51:55.088268] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-16T17:51:55.150142] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-16T17:51:55.494467] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-16T17:51:55.494773] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-16T17:51:55.502720] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-16T17:51:55.515361] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-16T17:51:55.517434] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T17:51:55.526513] [DEBUG] [LOCAL ] BYD: Trimmed 65338 records to 45233 (keeping 200 days of data) [2025-10-16T17:51:55.801924] [DEBUG] [LOCAL ] BYD: Primary data saved (45233 records). [2025-10-16T17:51:55.802048] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-16T17:51:55.802544] [INFO ] [MAIN ] Update Progress: 378/2369 symbols completed. BYD took 30.5s. Estimated remaining: 4h 33m 12s. Rate: 7.3 symbols/min [2025-10-16T17:51:55.947829] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-16T17:51:55.979435] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:51:56.002910] [DEBUG] [LOCAL ] CAAP: Loaded 19831 existing records from primary storage. [2025-10-16T17:51:56.003159] [INFO ] [MAIN ] CAAP: Loaded 19831 existing records. [2025-10-16T17:51:56.116000] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-16T17:51:56.197342] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:51:56.197556] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-16T17:51:56.197604] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-16T17:51:56.197841] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-16T17:51:56.197896] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-16T17:51:56.548902] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:56.742799] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-16T17:51:57.288249] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T17:51:57.542823] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-16T17:51:57.896382] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T17:51:58.055980] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-16T17:51:58.342818] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-16T17:51:59.142786] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-16T17:51:59.361167] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-16T17:51:59.942787] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-16T17:51:59.955205] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-16T17:52:00.467403] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-16T17:52:00.742827] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-16T17:52:01.542850] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-16T17:52:01.700897] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T17:52:02.342910] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-16T17:52:02.410601] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T17:52:03.142946] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-16T17:52:03.801606] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T17:52:03.819145] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-16T17:52:03.942818] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-16T17:52:04.742810] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-16T17:52:05.389967] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T17:52:05.542813] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-16T17:52:06.342777] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-16T17:52:06.557805] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T17:52:06.859170] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-16T17:52:07.142790] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-16T17:52:07.185907] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T17:52:07.942784] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-16T17:52:08.094837] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-16T17:52:08.477510] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-16T17:52:08.742821] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-16T17:52:09.542816] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-16T17:52:09.738172] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T17:52:10.342873] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-16T17:52:11.142869] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-16T17:52:11.408173] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-16T17:52:11.466944] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T17:52:11.942784] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-16T17:52:11.982585] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T17:52:11.984399] [INFO ] [REMOTE ] BYM: Full fetch complete (17475 records). [2025-10-16T17:52:11.984468] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-16T17:52:12.340529] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-16T17:52:12.340611] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-16T17:52:12.341062] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-16T17:52:12.341126] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-16T17:52:12.341634] [DEBUG] [LOCAL ] BYM: Trimmed 17475 records to 11798 (keeping 200 days of data) [2025-10-16T17:52:12.411359] [DEBUG] [LOCAL ] BYM: Primary data saved (11798 records). [2025-10-16T17:52:12.411511] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-16T17:52:12.411603] [INFO ] [MAIN ] Update Progress: 379/2369 symbols completed. BYM took 30.6s. Estimated remaining: 4h 33m 48s. Rate: 7.3 symbols/min [2025-10-16T17:52:12.582679] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:52:12.582884] [DEBUG] [LOCAL ] CABO: No existing data file found in primary storage. [2025-10-16T17:52:12.582926] [WARN ] [MAIN ] CABO: No existing data found, performing full refresh instead. [2025-10-16T17:52:12.583065] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-16T17:52:12.583113] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-16T17:52:12.583157] [DEBUG] [LOCAL ] CABO: No primary data file found to delete. [2025-10-16T17:52:12.583189] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-16T17:52:12.745884] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-16T17:52:12.935707] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:52:13.542813] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-16T17:52:14.066472] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-16T17:52:14.098537] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T17:52:14.112073] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T17:52:14.342828] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-16T17:52:15.142817] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-16T17:52:15.885860] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T17:52:15.942802] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-16T17:52:16.742793] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-16T17:52:16.851166] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-16T17:52:17.061054] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-16T17:52:17.542786] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-16T17:52:17.645021] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-16T17:52:18.342834] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-16T17:52:18.811406] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T17:52:19.091374] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-16T17:52:19.142778] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-16T17:52:19.942819] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-16T17:52:20.428550] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-16T17:52:20.432798] [INFO ] [REMOTE ] BZH: Full fetch complete (47238 records). [2025-10-16T17:52:20.432893] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-16T17:52:20.748018] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-16T17:52:20.812007] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-16T17:52:20.812101] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-16T17:52:20.812740] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-16T17:52:20.812803] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-16T17:52:20.813957] [DEBUG] [LOCAL ] BZH: Trimmed 47238 records to 32633 (keeping 200 days of data) [2025-10-16T17:52:21.009673] [DEBUG] [LOCAL ] BZH: Primary data saved (32633 records). [2025-10-16T17:52:21.009810] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-16T17:52:21.009890] [INFO ] [MAIN ] Update Progress: 380/2369 symbols completed. BZH took 32.0s. Estimated remaining: 4h 33m 41s. Rate: 7.3 symbols/min [2025-10-16T17:52:21.174213] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:52:21.196260] [DEBUG] [LOCAL ] CACI: Loaded 23152 existing records from primary storage. [2025-10-16T17:52:21.196524] [INFO ] [MAIN ] CACI: Loaded 23152 existing records. [2025-10-16T17:52:21.367619] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:52:21.367824] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-16T17:52:21.367873] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-16T17:52:21.368059] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-16T17:52:21.368100] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-16T17:52:21.546156] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-16T17:52:21.735233] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:52:21.836487] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T17:52:21.838043] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T17:52:22.342794] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-16T17:52:22.685377] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T17:52:23.142814] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-16T17:52:23.942802] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-16T17:52:24.367948] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-16T17:52:24.395779] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-16T17:52:24.742809] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-16T17:52:25.085200] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-16T17:52:25.542882] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-16T17:52:25.829409] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T17:52:26.342840] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-16T17:52:26.526509] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T17:52:26.529764] [INFO ] [REMOTE ] CAAP: Full fetch complete (27912 records). [2025-10-16T17:52:26.529838] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-16T17:52:26.909728] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-16T17:52:26.909805] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-16T17:52:26.910302] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-16T17:52:26.910342] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-16T17:52:26.911085] [DEBUG] [LOCAL ] CAAP: Trimmed 27912 records to 20020 (keeping 200 days of data) [2025-10-16T17:52:27.027615] [DEBUG] [LOCAL ] CAAP: Primary data saved (20020 records). [2025-10-16T17:52:27.027759] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-16T17:52:27.027838] [INFO ] [MAIN ] Update Progress: 381/2369 symbols completed. CAAP took 31.2s. Estimated remaining: 4h 33m 21s. Rate: 7.3 symbols/min [2025-10-16T17:52:27.147888] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-16T17:52:27.198946] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:52:27.241867] [DEBUG] [LOCAL ] CADE: Loaded 49483 existing records from primary storage. [2025-10-16T17:52:27.242196] [INFO ] [MAIN ] CADE: Loaded 49483 existing records. [2025-10-16T17:52:27.420604] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:52:27.420856] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-16T17:52:27.420914] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-16T17:52:27.421114] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-16T17:52:27.421151] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-16T17:52:27.766925] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:52:27.942779] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-16T17:52:28.317113] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T17:52:28.742785] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-16T17:52:28.883574] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-16T17:52:29.287236] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-16T17:52:29.310670] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T17:52:29.542838] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-16T17:52:30.342807] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-16T17:52:31.094972] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T17:52:31.142808] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-16T17:52:31.942798] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-16T17:52:32.293099] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-16T17:52:32.428999] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T17:52:32.742823] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-16T17:52:33.093602] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T17:52:33.542882] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-16T17:52:34.342813] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-16T17:52:34.875082] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-16T17:52:34.997981] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T17:52:35.142829] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-16T17:52:35.792721] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T17:52:35.942773] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-16T17:52:36.742890] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-16T17:52:37.282809] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T17:52:37.313064] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-16T17:52:37.319880] [INFO ] [REMOTE ] C: Full fetch complete (77918 records). [2025-10-16T17:52:37.320009] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-16T17:52:37.547990] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-16T17:52:37.720431] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-16T17:52:37.720610] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-16T17:52:37.721584] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-16T17:52:37.721748] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-16T17:52:37.728524] [DEBUG] [LOCAL ] C: Trimmed 77918 records to 54130 (keeping 200 days of data) [2025-10-16T17:52:37.736916] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T17:52:38.072313] [DEBUG] [LOCAL ] C: Primary data saved (54130 records). [2025-10-16T17:52:38.072482] [INFO ] [MAIN ] C: Full history saved. [2025-10-16T17:52:38.072570] [INFO ] [MAIN ] Update Progress: 382/2369 symbols completed. C took 47.8s. Estimated remaining: 4h 33m 28s. Rate: 7.3 symbols/min [2025-10-16T17:52:38.238566] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:52:38.274865] [DEBUG] [LOCAL ] CAE: Loaded 39206 existing records from primary storage. [2025-10-16T17:52:38.275139] [INFO ] [MAIN ] CAE: Loaded 39206 existing records. [2025-10-16T17:52:38.352050] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-16T17:52:38.459236] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:52:38.459467] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-16T17:52:38.459549] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-16T17:52:38.459856] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-16T17:52:38.459922] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-16T17:52:38.817361] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:52:39.142813] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-16T17:52:39.272050] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T17:52:39.335615] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T17:52:39.942865] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-16T17:52:40.632021] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T17:52:40.742784] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-16T17:52:40.973368] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T17:52:41.542820] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-16T17:52:42.209608] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T17:52:42.342789] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-16T17:52:42.664289] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T17:52:43.142820] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-16T17:52:43.571408] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T17:52:43.942779] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-16T17:52:44.250634] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T17:52:44.742864] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-16T17:52:45.471584] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T17:52:45.495845] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-16T17:52:45.542765] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-16T17:52:46.342792] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-16T17:52:46.565571] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-16T17:52:47.142826] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-16T17:52:47.470984] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T17:52:47.942846] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-16T17:52:48.696060] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T17:52:48.742774] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-16T17:52:48.848919] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T17:52:49.542837] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-16T17:52:49.584357] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T17:52:49.586172] [INFO ] [REMOTE ] CABO: Full fetch complete (23180 records). [2025-10-16T17:52:49.586240] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-16T17:52:49.949808] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-16T17:52:49.949888] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-16T17:52:49.950345] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-16T17:52:49.950407] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-16T17:52:49.951259] [DEBUG] [LOCAL ] CABO: Trimmed 23180 records to 16869 (keeping 200 days of data) [2025-10-16T17:52:50.047915] [DEBUG] [LOCAL ] CABO: Primary data saved (16869 records). [2025-10-16T17:52:50.048063] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-16T17:52:50.048146] [INFO ] [MAIN ] Update Progress: 383/2369 symbols completed. CABO took 37.6s. Estimated remaining: 4h 33m 39s. Rate: 7.3 symbols/min [2025-10-16T17:52:50.213930] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:52:50.219877] [DEBUG] [LOCAL ] CAF: Loaded 3465 existing records from primary storage. [2025-10-16T17:52:50.220065] [INFO ] [MAIN ] CAF: Loaded 3465 existing records. [2025-10-16T17:52:50.357445] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-16T17:52:50.397915] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:52:50.398103] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-16T17:52:50.398156] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-16T17:52:50.398295] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-16T17:52:50.398332] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-16T17:52:50.763579] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:52:50.776057] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T17:52:51.142835] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-16T17:52:51.942795] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-16T17:52:51.977675] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T17:52:52.006924] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T17:52:52.662899] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T17:52:52.742821] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-16T17:52:53.542823] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-16T17:52:53.800671] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T17:52:53.803024] [INFO ] [REMOTE ] CACI: Full fetch complete (38136 records). [2025-10-16T17:52:53.803105] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-16T17:52:53.803578] [FATAL] [VALIDATOR ] CACI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:52:53.803689] [FATAL] [MAIN ] CACI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:52:53.803740] [WARN ] [MAIN ] CACI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:52:53.803806] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-16T17:52:53.803870] [DEBUG] [LOCAL ] CACI: No primary data file found to delete. [2025-10-16T17:52:53.803910] [INFO ] [LOCAL ] CACI: Starting deletion of derivative data. [2025-10-16T17:52:53.804098] [DEBUG] [LOCAL ] CACI: Deleted derivative data file. [2025-10-16T17:52:53.804188] [INFO ] [MAIN ] Update Progress: 384/2369 symbols completed. CACI took 32.8s. Estimated remaining: 4h 33m 7s. Rate: 7.3 symbols/min [2025-10-16T17:52:53.991070] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:52:54.058205] [DEBUG] [LOCAL ] CAG: Loaded 53665 existing records from primary storage. [2025-10-16T17:52:54.058721] [INFO ] [MAIN ] CAG: Loaded 53665 existing records. [2025-10-16T17:52:54.327110] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:52:54.327409] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-16T17:52:54.327484] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-16T17:52:54.328128] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-16T17:52:54.328198] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-16T17:52:54.348046] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-16T17:52:54.869105] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:52:55.131301] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T17:52:55.138315] [INFO ] [REMOTE ] CADE: Full fetch complete (70539 records). [2025-10-16T17:52:55.138490] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-16T17:52:55.151133] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-16T17:52:55.556361] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-16T17:52:55.556441] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-16T17:52:55.557261] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-16T17:52:55.557323] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-16T17:52:55.558613] [DEBUG] [LOCAL ] CADE: Trimmed 70539 records to 49873 (keeping 200 days of data) [2025-10-16T17:52:55.628322] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T17:52:55.880052] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T17:52:55.900594] [DEBUG] [LOCAL ] CADE: Primary data saved (49873 records). [2025-10-16T17:52:55.900763] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-16T17:52:55.901232] [INFO ] [MAIN ] Update Progress: 385/2369 symbols completed. CADE took 28.9s. Estimated remaining: 4h 32m 27s. Rate: 7.3 symbols/min [2025-10-16T17:52:55.948014] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-16T17:52:56.073554] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:52:56.127907] [DEBUG] [LOCAL ] CAH: Loaded 51461 existing records from primary storage. [2025-10-16T17:52:56.128205] [INFO ] [MAIN ] CAH: Loaded 51461 existing records. [2025-10-16T17:52:56.301709] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:52:56.301942] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-16T17:52:56.301989] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-16T17:52:56.302349] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-16T17:52:56.302388] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-16T17:52:56.417451] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-16T17:52:56.661965] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:52:56.742792] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-16T17:52:57.542865] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-16T17:52:58.342805] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-16T17:52:58.416612] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T17:52:59.142797] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-16T17:52:59.234206] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T17:52:59.524927] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-16T17:52:59.548441] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T17:52:59.942816] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-16T17:53:00.742798] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-16T17:53:01.065391] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T17:53:01.542825] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-16T17:53:02.342848] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-16T17:53:02.514466] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T17:53:03.012384] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-16T17:53:03.141258] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T17:53:03.150670] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-16T17:53:03.942810] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-16T17:53:04.512498] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T17:53:04.740476] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T17:53:04.748465] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-16T17:53:05.232606] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-16T17:53:05.542810] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-16T17:53:06.002229] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T17:53:06.342787] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-16T17:53:06.731553] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-16T17:53:07.142810] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-16T17:53:07.942848] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-16T17:53:08.512885] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T17:53:08.742817] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-16T17:53:08.801431] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T17:53:09.542804] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-16T17:53:10.342846] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-16T17:53:10.458781] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T17:53:11.112772] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T17:53:11.142796] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-16T17:53:11.524030] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T17:53:11.942814] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-16T17:53:12.742820] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-16T17:53:12.908486] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T17:53:13.320522] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T17:53:13.322089] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T17:53:13.323760] [INFO ] [REMOTE ] CAF: Full fetch complete (5547 records). [2025-10-16T17:53:13.332709] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-16T17:53:13.547951] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-16T17:53:13.734339] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-16T17:53:13.734426] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-16T17:53:13.734600] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-16T17:53:13.734661] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-16T17:53:13.735036] [DEBUG] [LOCAL ] CAF: Trimmed 5547 records to 3501 (keeping 200 days of data) [2025-10-16T17:53:13.757206] [DEBUG] [LOCAL ] CAF: Primary data saved (3501 records). [2025-10-16T17:53:13.757359] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-16T17:53:13.757447] [INFO ] [MAIN ] Update Progress: 386/2369 symbols completed. CAF took 23.7s. Estimated remaining: 4h 33m 8s. Rate: 7.3 symbols/min [2025-10-16T17:53:13.922703] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:53:13.922842] [DEBUG] [LOCAL ] CAL: No existing data file found in primary storage. [2025-10-16T17:53:13.922899] [WARN ] [MAIN ] CAL: No existing data found, performing full refresh instead. [2025-10-16T17:53:13.923003] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-16T17:53:13.923046] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-16T17:53:13.923087] [DEBUG] [LOCAL ] CAL: No primary data file found to delete. [2025-10-16T17:53:13.923120] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-16T17:53:14.268066] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:53:14.342781] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-16T17:53:15.142798] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-16T17:53:15.256093] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T17:53:15.794006] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T17:53:15.942825] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-16T17:53:16.466843] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T17:53:16.742835] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-16T17:53:17.283162] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T17:53:17.543170] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-16T17:53:18.245474] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T17:53:18.342779] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-16T17:53:19.148748] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-16T17:53:19.154286] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T17:53:19.877835] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T17:53:19.942827] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-16T17:53:20.559142] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T17:53:20.742887] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-16T17:53:21.256007] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T17:53:21.542812] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-16T17:53:22.208390] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T17:53:22.342856] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-16T17:53:22.977788] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T17:53:22.983076] [INFO ] [REMOTE ] CAE: Full fetch complete (56475 records). [2025-10-16T17:53:22.983176] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-16T17:53:23.151564] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-16T17:53:23.370206] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-16T17:53:23.370280] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-16T17:53:23.370983] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-16T17:53:23.371045] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-16T17:53:23.372147] [DEBUG] [LOCAL ] CAE: Trimmed 56475 records to 39534 (keeping 200 days of data) [2025-10-16T17:53:23.591235] [DEBUG] [LOCAL ] CAE: Primary data saved (39534 records). [2025-10-16T17:53:23.591362] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-16T17:53:23.592154] [INFO ] [MAIN ] Update Progress: 387/2369 symbols completed. CAE took 45.5s. Estimated remaining: 4h 33m 8s. Rate: 7.3 symbols/min [2025-10-16T17:53:23.764450] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:53:23.796536] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T17:53:23.836745] [DEBUG] [LOCAL ] CALX: Loaded 37642 existing records from primary storage. [2025-10-16T17:53:23.837018] [INFO ] [MAIN ] CALX: Loaded 37642 existing records. [2025-10-16T17:53:23.947876] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-16T17:53:24.013406] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:53:24.013614] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-16T17:53:24.013696] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-16T17:53:24.013957] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-16T17:53:24.013996] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-16T17:53:24.363513] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:53:24.742779] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-16T17:53:24.811622] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T17:53:25.542842] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-16T17:53:25.620849] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T17:53:26.342869] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-16T17:53:26.470049] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T17:53:27.142854] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-16T17:53:27.180639] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T17:53:27.942823] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-16T17:53:28.140004] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-16T17:53:28.380802] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T17:53:28.742824] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-16T17:53:29.260702] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T17:53:29.542875] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-16T17:53:30.342802] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-16T17:53:30.413735] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T17:53:30.420371] [INFO ] [REMOTE ] CAH: Full fetch complete (74835 records). [2025-10-16T17:53:30.420489] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-16T17:53:30.827275] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-16T17:53:30.827354] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-16T17:53:30.828250] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-16T17:53:30.828311] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-16T17:53:30.829896] [DEBUG] [LOCAL ] CAH: Trimmed 74835 records to 51839 (keeping 200 days of data) [2025-10-16T17:53:31.150573] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-16T17:53:31.174426] [DEBUG] [LOCAL ] CAH: Primary data saved (51839 records). [2025-10-16T17:53:31.178008] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-16T17:53:31.178435] [INFO ] [MAIN ] Update Progress: 388/2369 symbols completed. CAH took 35.3s. Estimated remaining: 4h 32m 56s. Rate: 7.3 symbols/min [2025-10-16T17:53:31.194085] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T17:53:31.356639] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:53:31.383184] [DEBUG] [LOCAL ] CANG: Loaded 26919 existing records from primary storage. [2025-10-16T17:53:31.383428] [INFO ] [MAIN ] CANG: Loaded 26919 existing records. [2025-10-16T17:53:31.553784] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:53:31.553966] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-16T17:53:31.554013] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-16T17:53:31.554198] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-16T17:53:31.554254] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-16T17:53:31.920291] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:53:31.942767] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-16T17:53:32.414864] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-16T17:53:32.517190] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T17:53:32.742825] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-16T17:53:33.270845] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T17:53:33.542848] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-16T17:53:34.089208] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T17:53:34.342833] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-16T17:53:35.084389] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T17:53:35.142771] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-16T17:53:35.476083] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T17:53:35.942841] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-16T17:53:36.742845] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-16T17:53:37.035012] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T17:53:37.102393] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T17:53:37.542816] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-16T17:53:38.284868] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T17:53:38.342776] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-16T17:53:39.142801] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-16T17:53:39.198114] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T17:53:39.707438] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-16T17:53:39.942840] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-16T17:53:40.376549] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T17:53:40.742784] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-16T17:53:41.140815] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T17:53:41.542865] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-16T17:53:42.342854] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-16T17:53:42.410534] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T17:53:42.604204] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T17:53:43.142824] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-16T17:53:43.942836] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-16T17:53:44.194341] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T17:53:44.361728] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-16T17:53:44.367252] [INFO ] [REMOTE ] CAL: Full fetch complete (61880 records). [2025-10-16T17:53:44.367344] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-16T17:53:44.741101] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-16T17:53:44.741188] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-16T17:53:44.741952] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-16T17:53:44.742021] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-16T17:53:44.742808] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-16T17:53:44.744481] [DEBUG] [LOCAL ] CAL: Trimmed 61880 records to 43267 (keeping 200 days of data) [2025-10-16T17:53:44.868820] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T17:53:45.029020] [DEBUG] [LOCAL ] CAL: Primary data saved (43267 records). [2025-10-16T17:53:45.029153] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-16T17:53:45.029223] [INFO ] [MAIN ] Update Progress: 389/2369 symbols completed. CAL took 31.3s. Estimated remaining: 4h 33m 17s. Rate: 7.2 symbols/min [2025-10-16T17:53:45.198974] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:53:45.206833] [DEBUG] [LOCAL ] CAPL: Loaded 5642 existing records from primary storage. [2025-10-16T17:53:45.207040] [INFO ] [MAIN ] CAPL: Loaded 5642 existing records. [2025-10-16T17:53:45.379936] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:53:45.380136] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-16T17:53:45.380183] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-16T17:53:45.380324] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-16T17:53:45.380361] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-16T17:53:45.548102] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-16T17:53:45.727271] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:53:46.078089] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T17:53:46.342852] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-16T17:53:47.142782] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-16T17:53:47.300323] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T17:53:47.307236] [INFO ] [REMOTE ] CAG: Full fetch complete (77823 records). [2025-10-16T17:53:47.307354] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-16T17:53:47.474183] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T17:53:47.733831] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-16T17:53:47.734036] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-16T17:53:47.735035] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-16T17:53:47.735165] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-16T17:53:47.736729] [DEBUG] [LOCAL ] CAG: Trimmed 77823 records to 54055 (keeping 200 days of data) [2025-10-16T17:53:47.924110] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-16T17:53:47.951483] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-16T17:53:48.068203] [DEBUG] [LOCAL ] CAG: Primary data saved (54055 records). [2025-10-16T17:53:48.068342] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-16T17:53:48.069185] [INFO ] [MAIN ] Update Progress: 390/2369 symbols completed. CAG took 54.3s. Estimated remaining: 4h 32m 42s. Rate: 7.3 symbols/min [2025-10-16T17:53:48.239720] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:53:48.291020] [DEBUG] [LOCAL ] CARR: Loaded 53602 existing records from primary storage. [2025-10-16T17:53:48.291352] [INFO ] [MAIN ] CARR: Loaded 53602 existing records. [2025-10-16T17:53:48.467937] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:53:48.468153] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-16T17:53:48.468199] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-16T17:53:48.468371] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-16T17:53:48.468409] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-16T17:53:48.728452] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T17:53:48.747364] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-16T17:53:48.832100] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:53:49.542862] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-16T17:53:50.204192] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T17:53:50.342795] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-16T17:53:50.907803] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T17:53:51.142786] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-16T17:53:51.170150] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T17:53:51.942821] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-16T17:53:52.742781] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-16T17:53:52.812085] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T17:53:53.161635] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-16T17:53:53.407260] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T17:53:53.542800] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-16T17:53:54.342838] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-16T17:53:55.142855] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-16T17:53:55.282947] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T17:53:55.682890] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T17:53:55.880939] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T17:53:55.942807] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-16T17:53:56.742813] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-16T17:53:57.441502] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T17:53:57.446963] [INFO ] [REMOTE ] CALX: Full fetch complete (54280 records). [2025-10-16T17:53:57.447108] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-16T17:53:57.546676] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-16T17:53:57.825126] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-16T17:53:57.825225] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-16T17:53:57.825971] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-16T17:53:57.826035] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-16T17:53:57.827116] [DEBUG] [LOCAL ] CALX: Trimmed 54280 records to 37885 (keeping 200 days of data) [2025-10-16T17:53:58.036810] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T17:53:58.074045] [DEBUG] [LOCAL ] CALX: Primary data saved (37885 records). [2025-10-16T17:53:58.074183] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-16T17:53:58.074945] [INFO ] [MAIN ] Update Progress: 391/2369 symbols completed. CALX took 34.5s. Estimated remaining: 4h 32m 42s. Rate: 7.3 symbols/min [2025-10-16T17:53:58.248135] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:53:58.287576] [DEBUG] [LOCAL ] CARS: Loaded 39797 existing records from primary storage. [2025-10-16T17:53:58.287884] [INFO ] [MAIN ] CARS: Loaded 39797 existing records. [2025-10-16T17:53:58.349917] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-16T17:53:58.399184] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T17:53:58.482202] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:53:58.482453] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-16T17:53:58.482504] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-16T17:53:58.482790] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-16T17:53:58.482862] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-16T17:53:58.825217] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:53:59.142837] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-16T17:53:59.410886] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T17:53:59.781161] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-16T17:53:59.942824] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-16T17:54:00.742859] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-16T17:54:01.344159] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-16T17:54:01.347950] [INFO ] [REMOTE ] CANG: Full fetch complete (39693 records). [2025-10-16T17:54:01.348023] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-16T17:54:01.548723] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-16T17:54:01.714123] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-16T17:54:01.714203] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-16T17:54:01.714795] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-16T17:54:01.714870] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-16T17:54:01.715874] [DEBUG] [LOCAL ] CANG: Trimmed 39693 records to 27143 (keeping 200 days of data) [2025-10-16T17:54:01.882215] [DEBUG] [LOCAL ] CANG: Primary data saved (27143 records). [2025-10-16T17:54:01.882448] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-16T17:54:01.882577] [INFO ] [MAIN ] Update Progress: 392/2369 symbols completed. CANG took 30.7s. Estimated remaining: 4h 32m 11s. Rate: 7.3 symbols/min [2025-10-16T17:54:02.106292] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:54:02.183595] [DEBUG] [LOCAL ] CAT: Loaded 52958 existing records from primary storage. [2025-10-16T17:54:02.184105] [INFO ] [MAIN ] CAT: Loaded 52958 existing records. [2025-10-16T17:54:02.275184] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-16T17:54:02.345903] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-16T17:54:02.494142] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:54:02.495276] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-16T17:54:02.495335] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-16T17:54:02.495568] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-16T17:54:02.495683] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-16T17:54:02.751719] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-16T17:54:02.966806] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:54:03.142813] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-16T17:54:03.784933] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T17:54:03.942809] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-16T17:54:04.742841] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-16T17:54:04.947126] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-16T17:54:04.964477] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T17:54:05.542782] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-16T17:54:06.342790] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-16T17:54:06.713511] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T17:54:06.843627] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-16T17:54:06.968636] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T17:54:07.142807] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-16T17:54:07.942814] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-16T17:54:08.744018] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T17:54:08.743011] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-16T17:54:09.334123] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-16T17:54:09.542877] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-16T17:54:09.778383] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T17:54:10.342826] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-16T17:54:10.853209] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T17:54:11.142820] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-16T17:54:11.942814] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-16T17:54:12.140437] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T17:54:12.247558] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T17:54:12.659532] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T17:54:12.660859] [INFO ] [REMOTE ] CAPL: Full fetch complete (8753 records). [2025-10-16T17:54:12.660931] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-16T17:54:12.747935] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-16T17:54:13.017220] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-16T17:54:13.017356] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-16T17:54:13.017583] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-16T17:54:13.017624] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-16T17:54:13.018152] [DEBUG] [LOCAL ] CAPL: Trimmed 8753 records to 5684 (keeping 200 days of data) [2025-10-16T17:54:13.051754] [DEBUG] [LOCAL ] CAPL: Primary data saved (5684 records). [2025-10-16T17:54:13.051906] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-16T17:54:13.051998] [INFO ] [MAIN ] Update Progress: 393/2369 symbols completed. CAPL took 28.0s. Estimated remaining: 4h 32m 18s. Rate: 7.3 symbols/min [2025-10-16T17:54:13.220215] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:54:13.229598] [DEBUG] [LOCAL ] CATO: Loaded 6687 existing records from primary storage. [2025-10-16T17:54:13.229810] [INFO ] [MAIN ] CATO: Loaded 6687 existing records. [2025-10-16T17:54:13.400938] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:54:13.401132] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-16T17:54:13.401179] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-16T17:54:13.401409] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-16T17:54:13.401465] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-16T17:54:13.550598] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-16T17:54:13.754527] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:54:14.326091] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T17:54:14.342783] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-16T17:54:15.142891] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-16T17:54:15.374229] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T17:54:15.408296] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T17:54:15.942819] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-16T17:54:16.742859] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-16T17:54:17.386876] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-16T17:54:17.433375] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T17:54:17.542821] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-16T17:54:17.785466] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T17:54:18.259905] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-16T17:54:18.342843] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-16T17:54:19.142866] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-16T17:54:19.948124] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-16T17:54:19.963421] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T17:54:20.473804] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T17:54:20.742799] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-16T17:54:21.542779] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-16T17:54:21.731117] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T17:54:22.133491] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:54:22.342850] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-16T17:54:22.977154] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T17:54:23.043497] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T17:54:23.142853] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-16T17:54:23.942814] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-16T17:54:24.588569] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T17:54:24.742795] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-16T17:54:25.542876] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-16T17:54:26.090410] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-16T17:54:26.097232] [INFO ] [REMOTE ] CARR: Full fetch complete (77772 records). [2025-10-16T17:54:26.097397] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-16T17:54:26.356849] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-16T17:54:26.481032] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T17:54:26.536456] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-16T17:54:26.537070] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T17:54:26.539340] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-16T17:54:26.538897] [INFO ] [REMOTE ] CARS: Full fetch complete (56340 records). [2025-10-16T17:54:26.539512] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-16T17:54:26.540822] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-16T17:54:26.541009] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-16T17:54:26.663805] [DEBUG] [LOCAL ] CARR: Trimmed 77772 records to 53992 (keeping 200 days of data) [2025-10-16T17:54:27.079293] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-16T17:54:27.079974] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-16T17:54:27.081259] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-16T17:54:27.081341] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-16T17:54:27.090050] [DEBUG] [LOCAL ] CARS: Trimmed 56340 records to 40101 (keeping 200 days of data) [2025-10-16T17:54:27.151355] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-16T17:54:27.454128] [DEBUG] [LOCAL ] CARS: Primary data saved (40101 records). [2025-10-16T17:54:27.459833] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-16T17:54:27.462482] [INFO ] [MAIN ] Update Progress: 394/2369 symbols completed. CARS took 29.4s. Estimated remaining: 4h 32m 40s. Rate: 7.2 symbols/min [2025-10-16T17:54:27.705092] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:54:27.717741] [DEBUG] [LOCAL ] CARR: Primary data saved (53992 records). [2025-10-16T17:54:27.717899] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-16T17:54:27.718700] [INFO ] [MAIN ] Update Progress: 395/2369 symbols completed. CARR took 39.6s. Estimated remaining: 4h 31m 52s. Rate: 7.3 symbols/min [2025-10-16T17:54:27.816078] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-16T17:54:27.923516] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:54:27.939085] [DEBUG] [LOCAL ] CAVA: Loaded 53567 existing records from primary storage. [2025-10-16T17:54:27.939401] [INFO ] [MAIN ] CAVA: Loaded 53567 existing records. [2025-10-16T17:54:27.950469] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-16T17:54:28.125952] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:54:28.136614] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-16T17:54:28.136716] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-16T17:54:28.137022] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-16T17:54:28.137080] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-16T17:54:28.289990] [DEBUG] [LOCAL ] CB: Loaded 49940 existing records from primary storage. [2025-10-16T17:54:28.325067] [INFO ] [MAIN ] CB: Loaded 49940 existing records. [2025-10-16T17:54:28.553943] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-16T17:54:28.691771] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:54:28.699126] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:54:28.700179] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-16T17:54:28.700251] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-16T17:54:28.700474] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-16T17:54:28.700609] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-16T17:54:28.747324] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-16T17:54:29.122772] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-10-16T17:54:29.127296] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:54:29.542869] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-16T17:54:30.342883] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-16T17:54:30.873349] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-16T17:54:31.142804] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-16T17:54:31.324385] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T17:54:31.942847] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-16T17:54:32.086545] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T17:54:32.410291] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T17:54:32.742785] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-16T17:54:32.854684] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T17:54:33.542838] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-16T17:54:34.342787] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-16T17:54:34.381128] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T17:54:35.142886] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-16T17:54:35.447095] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-16T17:54:35.893254] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T17:54:35.942794] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-16T17:54:36.748002] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-16T17:54:36.771952] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T17:54:37.548290] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-16T17:54:37.565331] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T17:54:37.598154] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-16T17:54:38.342867] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-16T17:54:39.142829] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-16T17:54:39.671216] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-16T17:54:39.942815] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-16T17:54:40.179558] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T17:54:40.742849] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-16T17:54:41.104872] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-16T17:54:41.542872] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-16T17:54:41.939723] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-16T17:54:42.050898] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T17:54:42.342832] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-16T17:54:43.142846] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-16T17:54:43.696374] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-16T17:54:43.868321] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T17:54:43.948036] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-16T17:54:43.960350] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T17:54:44.742851] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-16T17:54:45.542834] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-16T17:54:46.119892] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-16T17:54:46.211366] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T17:54:46.342830] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-16T17:54:47.142803] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-16T17:54:47.407835] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T17:54:47.918033] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T17:54:47.919375] [INFO ] [REMOTE ] CATO: Full fetch complete (10922 records). [2025-10-16T17:54:47.919444] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-16T17:54:47.950212] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-16T17:54:48.280659] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-16T17:54:48.280762] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-16T17:54:48.281045] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-16T17:54:48.281086] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-16T17:54:48.281573] [DEBUG] [LOCAL ] CATO: Trimmed 10922 records to 6736 (keeping 200 days of data) [2025-10-16T17:54:48.320253] [DEBUG] [LOCAL ] CATO: Primary data saved (6736 records). [2025-10-16T17:54:48.320381] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-16T17:54:48.320462] [INFO ] [MAIN ] Update Progress: 396/2369 symbols completed. CATO took 35.3s. Estimated remaining: 4h 32m 45s. Rate: 7.2 symbols/min [2025-10-16T17:54:48.489985] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:54:48.521336] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-16T17:54:48.539914] [DEBUG] [LOCAL ] CBAN: Loaded 10503 existing records from primary storage. [2025-10-16T17:54:48.540129] [INFO ] [MAIN ] CBAN: Loaded 10503 existing records. [2025-10-16T17:54:48.714088] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:54:48.714295] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-16T17:54:48.714340] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-16T17:54:48.714484] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-16T17:54:48.714521] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-16T17:54:48.747981] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-16T17:54:49.069864] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:54:49.542836] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-16T17:54:49.659612] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T17:54:50.342872] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-16T17:54:51.142853] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-16T17:54:51.209762] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-16T17:54:51.216442] [INFO ] [REMOTE ] CAT: Full fetch complete (76877 records). [2025-10-16T17:54:51.216603] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-16T17:54:51.612174] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-16T17:54:51.612282] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-16T17:54:51.613230] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-16T17:54:51.613314] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-16T17:54:51.615054] [DEBUG] [LOCAL ] CAT: Trimmed 76877 records to 53348 (keeping 200 days of data) [2025-10-16T17:54:51.736638] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-16T17:54:51.944620] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-16T17:54:51.994736] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T17:54:52.004308] [DEBUG] [LOCAL ] CAT: Primary data saved (53348 records). [2025-10-16T17:54:52.004390] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-16T17:54:52.004788] [INFO ] [MAIN ] Update Progress: 397/2369 symbols completed. CAT took 50.1s. Estimated remaining: 4h 32m 14s. Rate: 7.2 symbols/min [2025-10-16T17:54:52.152518] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T17:54:52.742823] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-16T17:54:53.542848] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-16T17:54:53.646053] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T17:54:53.899713] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-16T17:54:54.342822] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-16T17:54:55.106950] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T17:54:55.142822] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-16T17:54:55.266604] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T17:54:55.942827] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-16T17:54:56.742773] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-16T17:54:56.893772] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T17:54:57.083678] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-16T17:54:57.542814] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-16T17:54:58.233384] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T17:54:58.239863] [INFO ] [REMOTE ] CB: Full fetch complete (72808 records). [2025-10-16T17:54:58.240001] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-16T17:54:58.346309] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-16T17:54:58.635563] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-16T17:54:58.635678] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-16T17:54:58.636569] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-16T17:54:58.636635] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-16T17:54:58.638054] [DEBUG] [LOCAL ] CB: Trimmed 72808 records to 50327 (keeping 200 days of data) [2025-10-16T17:54:58.950622] [DEBUG] [LOCAL ] CB: Primary data saved (50327 records). [2025-10-16T17:54:58.950780] [INFO ] [MAIN ] CB: Full history saved. [2025-10-16T17:54:58.950862] [INFO ] [MAIN ] Update Progress: 398/2369 symbols completed. CB took 31.2s. Estimated remaining: 4h 31m 59s. Rate: 7.2 symbols/min [2025-10-16T17:54:59.232698] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T17:54:59.236186] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-16T17:54:59.520262] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-16T17:54:59.527518] [INFO ] [REMOTE ] CAVA: Full fetch complete (77463 records). [2025-10-16T17:54:59.527689] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-16T17:54:59.935397] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-16T17:54:59.935480] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-16T17:54:59.936415] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-16T17:54:59.936480] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-16T17:54:59.937989] [DEBUG] [LOCAL ] CAVA: Trimmed 77463 records to 53956 (keeping 200 days of data) [2025-10-16T17:55:00.149701] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T17:55:00.154425] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-16T17:55:00.265943] [DEBUG] [LOCAL ] CAVA: Primary data saved (53956 records). [2025-10-16T17:55:00.266081] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-16T17:55:00.266840] [INFO ] [MAIN ] Update Progress: 399/2369 symbols completed. CAVA took 32.8s. Estimated remaining: 4h 31m 16s. Rate: 7.3 symbols/min [2025-10-16T17:55:00.914335] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T17:55:00.916939] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-16T17:55:01.749925] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-16T17:55:01.753141] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-16T17:55:02.693835] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-16T17:55:02.696745] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-16T17:55:03.198785] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-16T17:55:03.201444] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-16T17:55:03.989853] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T17:55:03.991562] [INFO ] [REMOTE ] CBAN: Full fetch complete (16209 records). [2025-10-16T17:55:03.991638] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-16T17:55:04.356698] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-16T17:55:04.356790] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-16T17:55:04.357068] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-16T17:55:04.357109] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-16T17:55:04.357577] [DEBUG] [LOCAL ] CBAN: Trimmed 16209 records to 10553 (keeping 200 days of data) [2025-10-16T17:55:04.417995] [DEBUG] [LOCAL ] CBAN: Primary data saved (10553 records). [2025-10-16T17:55:04.418114] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-16T17:55:04.418192] [INFO ] [MAIN ] Update Progress: 400/2369 symbols completed. CBAN took 16.1s. Estimated remaining: 4h 30m 48s. Rate: 7.3 symbols/min [2025-10-16T17:55:04.925067] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:05.112820] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:05.156476] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-16T17:55:05.140504] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:05.156621] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-16T17:55:05.160337] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:05.161032] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-16T17:55:05.161161] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-16T17:55:05.167747] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-16T17:55:05.167669] [DEBUG] [LOCAL ] CBL: Loaded 16293 existing records from primary storage. [2025-10-16T17:55:05.168830] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-16T17:55:05.200132] [INFO ] [MAIN ] CBL: Loaded 16293 existing records. [2025-10-16T17:55:05.277986] [DEBUG] [LOCAL ] CBNA: Loaded 2920 existing records from primary storage. [2025-10-16T17:55:05.301901] [INFO ] [MAIN ] CBNA: Loaded 2920 existing records. [2025-10-16T17:55:05.601517] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:55:05.684739] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-16T17:55:05.739759] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-16T17:55:05.779616] [DEBUG] [LOCAL ] CBRE: Loaded 50361 existing records from primary storage. [2025-10-16T17:55:05.799341] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-16T17:55:05.799515] [INFO ] [MAIN ] CBRE: Loaded 50361 existing records. [2025-10-16T17:55:05.838479] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:55:05.854450] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-16T17:55:05.869454] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-16T17:55:05.901441] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-16T17:55:05.928766] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-16T17:55:05.939768] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-16T17:55:06.244617] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:06.316092] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-16T17:55:06.376805] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:55:06.455397] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-16T17:55:06.521587] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-16T17:55:06.597721] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-16T17:55:06.648084] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-16T17:55:06.659562] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:55:06.713776] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-16T17:55:06.794403] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:55:06.931565] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:06.952979] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:06.878993] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-16T17:55:06.962187] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:55:06.965756] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-16T17:55:06.962021] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-16T17:55:06.972430] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-16T17:55:06.978585] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-16T17:55:06.989029] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-16T17:55:07.017544] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-16T17:55:07.021141] [INFO ] [MAIN ] Update Progress: 401/2369 symbols completed. CBO took 2.6s. Estimated remaining: 4h 30m 12s. Rate: 7.3 symbols/min [2025-10-16T17:55:07.381612] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:07.385435] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-16T17:55:07.408126] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:07.408355] [DEBUG] [LOCAL ] CBT: No existing data file found in primary storage. [2025-10-16T17:55:07.408408] [WARN ] [MAIN ] CBT: No existing data found, performing full refresh instead. [2025-10-16T17:55:07.408543] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-16T17:55:07.408596] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-16T17:55:07.408673] [DEBUG] [LOCAL ] CBT: No primary data file found to delete. [2025-10-16T17:55:07.408736] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-16T17:55:07.703052] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T17:55:07.707533] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-16T17:55:07.784815] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:07.942778] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-16T17:55:08.124311] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-16T17:55:08.222573] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T17:55:08.742867] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-16T17:55:09.301358] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T17:55:09.336880] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T17:55:09.415459] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T17:55:09.542818] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-16T17:55:10.342792] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-16T17:55:10.497972] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T17:55:10.788945] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T17:55:11.142818] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-16T17:55:11.942824] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-16T17:55:12.392391] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-16T17:55:12.747938] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-16T17:55:12.764463] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:55:13.063115] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-16T17:55:13.542830] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-16T17:55:14.085740] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-16T17:55:14.342812] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-16T17:55:15.142787] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-16T17:55:15.347144] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-16T17:55:15.942858] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-16T17:55:16.676011] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T17:55:16.742779] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-16T17:55:17.212312] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T17:55:17.542849] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-16T17:55:17.809481] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-16T17:55:17.984719] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T17:55:18.342853] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-16T17:55:19.142795] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-16T17:55:19.634933] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T17:55:19.654194] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T17:55:19.942876] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-16T17:55:20.742811] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-16T17:55:21.283168] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-16T17:55:21.522628] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T17:55:21.542775] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-16T17:55:22.342832] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-16T17:55:23.142796] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-16T17:55:23.199922] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T17:55:23.331726] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T17:55:23.578544] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T17:55:23.942823] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-16T17:55:24.742822] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-16T17:55:25.542825] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-16T17:55:25.733448] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T17:55:25.779838] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T17:55:26.342828] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-16T17:55:26.872682] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T17:55:27.142792] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-16T17:55:27.291375] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T17:55:27.942830] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-16T17:55:28.447032] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-16T17:55:28.447931] [INFO ] [REMOTE ] CBNA: Full fetch complete (4401 records). [2025-10-16T17:55:28.447999] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-16T17:55:28.627061] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T17:55:28.747928] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-16T17:55:28.852411] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-16T17:55:28.852484] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-16T17:55:28.852628] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-16T17:55:28.852705] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-16T17:55:28.853073] [DEBUG] [LOCAL ] CBNA: Trimmed 4401 records to 2936 (keeping 200 days of data) [2025-10-16T17:55:28.869560] [DEBUG] [LOCAL ] CBNA: Primary data saved (2936 records). [2025-10-16T17:55:28.869626] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-16T17:55:28.869731] [INFO ] [MAIN ] Update Progress: 402/2369 symbols completed. CBNA took 24.4s. Estimated remaining: 4h 31m 10s. Rate: 7.3 symbols/min [2025-10-16T17:55:29.036089] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:29.057191] [DEBUG] [LOCAL ] CBU: Loaded 22717 existing records from primary storage. [2025-10-16T17:55:29.057430] [INFO ] [MAIN ] CBU: Loaded 22717 existing records. [2025-10-16T17:55:29.231580] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:55:29.231842] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-16T17:55:29.231934] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-16T17:55:29.232159] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-16T17:55:29.232226] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-16T17:55:29.547922] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-16T17:55:29.603503] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:30.071099] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T17:55:30.342867] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-16T17:55:30.887949] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T17:55:31.142825] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-16T17:55:31.562176] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T17:55:31.942844] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-16T17:55:32.742863] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-16T17:55:33.072906] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T17:55:33.123420] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T17:55:33.453430] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T17:55:33.542827] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-16T17:55:34.342798] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-16T17:55:35.142820] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-16T17:55:35.321752] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T17:55:35.347239] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-16T17:55:35.942848] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-16T17:55:36.084166] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T17:55:36.742871] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-16T17:55:36.868760] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T17:55:36.871339] [INFO ] [REMOTE ] CBL: Full fetch complete (25139 records). [2025-10-16T17:55:36.871428] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-16T17:55:37.249725] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-16T17:55:37.249834] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-16T17:55:37.250353] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-16T17:55:37.250396] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-16T17:55:37.251338] [DEBUG] [LOCAL ] CBL: Trimmed 25139 records to 16377 (keeping 200 days of data) [2025-10-16T17:55:37.350844] [DEBUG] [LOCAL ] CBL: Primary data saved (16377 records). [2025-10-16T17:55:37.351160] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-16T17:55:37.351279] [INFO ] [MAIN ] Update Progress: 403/2369 symbols completed. CBL took 32.9s. Estimated remaining: 4h 31m 3s. Rate: 7.3 symbols/min [2025-10-16T17:55:37.523090] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:37.523250] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-16T17:55:37.523307] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-16T17:55:37.523431] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-16T17:55:37.523502] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-16T17:55:37.523562] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-16T17:55:37.523596] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-16T17:55:37.553733] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-16T17:55:37.881206] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:37.985487] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T17:55:38.342820] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-16T17:55:38.540783] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:55:38.541129] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-16T17:55:38.541215] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:55:38.541282] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-16T17:55:38.541346] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:55:38.541416] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-16T17:55:38.541480] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-16T17:55:38.541515] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-16T17:55:38.541553] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-16T17:55:38.541598] [INFO ] [MAIN ] Update Progress: 404/2369 symbols completed. CBX took 1.2s. Estimated remaining: 4h 30m 20s. Rate: 7.3 symbols/min [2025-10-16T17:55:38.715843] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:38.716130] [DEBUG] [LOCAL ] CBZ: No existing data file found in primary storage. [2025-10-16T17:55:38.716182] [WARN ] [MAIN ] CBZ: No existing data found, performing full refresh instead. [2025-10-16T17:55:38.716295] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-16T17:55:38.716337] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-16T17:55:38.716378] [DEBUG] [LOCAL ] CBZ: No primary data file found to delete. [2025-10-16T17:55:38.716410] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-16T17:55:38.881404] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T17:55:39.098520] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:39.142779] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-16T17:55:39.942838] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-16T17:55:40.048958] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T17:55:40.742859] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-16T17:55:41.542857] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-16T17:55:41.619296] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T17:55:42.133744] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T17:55:42.329813] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T17:55:42.342816] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-16T17:55:43.142832] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-16T17:55:43.618416] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T17:55:43.942856] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-16T17:55:44.742809] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-16T17:55:44.953006] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T17:55:45.050771] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-16T17:55:45.057088] [INFO ] [REMOTE ] CBRE: Full fetch complete (73840 records). [2025-10-16T17:55:45.057207] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-16T17:55:45.484495] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-16T17:55:45.484621] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-16T17:55:45.485911] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-16T17:55:45.485985] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-16T17:55:45.488092] [DEBUG] [LOCAL ] CBRE: Trimmed 73840 records to 50735 (keeping 200 days of data) [2025-10-16T17:55:45.551989] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-16T17:55:45.836969] [DEBUG] [LOCAL ] CBRE: Primary data saved (50735 records). [2025-10-16T17:55:45.837185] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-16T17:55:45.837298] [INFO ] [MAIN ] Update Progress: 405/2369 symbols completed. CBRE took 41.4s. Estimated remaining: 4h 30m 7s. Rate: 7.3 symbols/min [2025-10-16T17:55:46.021818] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:46.038558] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T17:55:46.102521] [DEBUG] [LOCAL ] CC: Loaded 53013 existing records from primary storage. [2025-10-16T17:55:46.103157] [INFO ] [MAIN ] CC: Loaded 53013 existing records. [2025-10-16T17:55:46.289831] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:55:46.290133] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-16T17:55:46.290189] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-16T17:55:46.290486] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-16T17:55:46.290540] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-16T17:55:46.347990] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-16T17:55:46.574349] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T17:55:46.716502] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:47.142878] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-16T17:55:47.549100] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T17:55:47.942845] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-16T17:55:48.742842] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-16T17:55:48.870985] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T17:55:48.902926] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T17:55:49.542786] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-16T17:55:49.599988] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T17:55:50.342826] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-16T17:55:50.527092] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T17:55:51.142804] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-16T17:55:51.624462] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-16T17:55:51.942833] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-16T17:55:52.409981] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T17:55:52.742822] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-16T17:55:52.996085] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T17:55:53.000435] [INFO ] [REMOTE ] CBT: Full fetch complete (45867 records). [2025-10-16T17:55:53.000521] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-16T17:55:53.365217] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-16T17:55:53.365291] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-16T17:55:53.365910] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-16T17:55:53.365972] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-16T17:55:53.366920] [DEBUG] [LOCAL ] CBT: Trimmed 45867 records to 31366 (keeping 200 days of data) [2025-10-16T17:55:53.543723] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-16T17:55:53.567461] [DEBUG] [LOCAL ] CBT: Primary data saved (31366 records). [2025-10-16T17:55:53.567599] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-16T17:55:53.567706] [INFO ] [MAIN ] Update Progress: 406/2369 symbols completed. CBT took 46.5s. Estimated remaining: 4h 29m 57s. Rate: 7.3 symbols/min [2025-10-16T17:55:53.755727] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:53.809031] [DEBUG] [LOCAL ] CCI: Loaded 53117 existing records from primary storage. [2025-10-16T17:55:53.809364] [INFO ] [MAIN ] CCI: Loaded 53117 existing records. [2025-10-16T17:55:53.989301] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:55:53.989604] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-16T17:55:53.989788] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-16T17:55:53.990359] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-16T17:55:53.990416] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-16T17:55:54.126929] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T17:55:54.358492] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-16T17:55:54.400964] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:54.415095] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T17:55:55.142823] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-16T17:55:55.484739] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T17:55:55.942807] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-16T17:55:56.387210] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-16T17:55:56.390492] [INFO ] [REMOTE ] CBU: Full fetch complete (32561 records). [2025-10-16T17:55:56.390569] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-16T17:55:56.748670] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-16T17:55:56.812206] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-16T17:55:56.812282] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-16T17:55:56.812790] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-16T17:55:56.812851] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-16T17:55:56.813616] [DEBUG] [LOCAL ] CBU: Trimmed 32561 records to 22932 (keeping 200 days of data) [2025-10-16T17:55:56.952503] [DEBUG] [LOCAL ] CBU: Primary data saved (22932 records). [2025-10-16T17:55:56.952635] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-16T17:55:56.952803] [INFO ] [MAIN ] Update Progress: 407/2369 symbols completed. CBU took 28.1s. Estimated remaining: 4h 29m 25s. Rate: 7.3 symbols/min [2025-10-16T17:55:57.123711] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:57.123866] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-16T17:55:57.123904] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-16T17:55:57.124015] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-16T17:55:57.124056] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-16T17:55:57.124101] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-16T17:55:57.124135] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-16T17:55:57.491133] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:57.547913] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-16T17:55:57.563112] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:55:57.979464] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-16T17:55:58.342780] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-16T17:55:58.582795] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T17:55:58.762147] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-16T17:55:59.142836] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-16T17:55:59.474337] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-16T17:55:59.942862] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-16T17:56:00.742811] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-16T17:56:01.431835] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-16T17:56:01.542811] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-16T17:56:01.888486] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-16T17:56:02.342811] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-16T17:56:02.940477] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-16T17:56:03.142805] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-16T17:56:03.578087] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-16T17:56:03.733551] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:56:03.942797] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-16T17:56:04.330988] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-16T17:56:04.742806] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-16T17:56:05.542855] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-16T17:56:05.878758] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-16T17:56:06.262796] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T17:56:06.342824] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-16T17:56:07.142867] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-16T17:56:07.831303] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T17:56:07.836341] [INFO ] [REMOTE ] CBZ: Full fetch complete (46127 records). [2025-10-16T17:56:07.836444] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-16T17:56:07.946197] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-16T17:56:08.220326] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-16T17:56:08.220440] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-16T17:56:08.221446] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-16T17:56:08.221511] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-16T17:56:08.222722] [DEBUG] [LOCAL ] CBZ: Trimmed 46127 records to 34513 (keeping 200 days of data) [2025-10-16T17:56:08.415381] [DEBUG] [LOCAL ] CBZ: Primary data saved (34513 records). [2025-10-16T17:56:08.415519] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-16T17:56:08.415589] [INFO ] [MAIN ] Update Progress: 408/2369 symbols completed. CBZ took 29.9s. Estimated remaining: 4h 29m 32s. Rate: 7.3 symbols/min [2025-10-16T17:56:08.583115] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:56:08.598345] [DEBUG] [LOCAL ] CCIF: Loaded 15528 existing records from primary storage. [2025-10-16T17:56:08.598537] [INFO ] [MAIN ] CCIF: Loaded 15528 existing records. [2025-10-16T17:56:08.750422] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-16T17:56:08.780154] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:56:08.781491] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-16T17:56:08.781610] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-16T17:56:08.781949] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-16T17:56:08.782006] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-16T17:56:09.139053] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:56:09.173086] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-16T17:56:09.542847] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-16T17:56:09.596243] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T17:56:09.641874] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T17:56:10.342854] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-16T17:56:10.414620] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T17:56:10.612557] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-16T17:56:11.142811] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-16T17:56:11.942821] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-16T17:56:12.743290] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-16T17:56:12.745709] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T17:56:13.185243] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T17:56:13.369805] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T17:56:13.542821] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-16T17:56:14.342824] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-16T17:56:15.142804] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-16T17:56:15.302488] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T17:56:15.696590] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T17:56:15.942783] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-16T17:56:16.266907] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T17:56:16.742833] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-16T17:56:17.477774] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T17:56:17.542770] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-16T17:56:18.204779] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T17:56:18.342780] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-16T17:56:19.142783] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-16T17:56:19.523868] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T17:56:19.908381] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T17:56:19.942793] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-16T17:56:19.960334] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T17:56:20.742897] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-16T17:56:21.542784] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-16T17:56:21.572132] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T17:56:21.573283] [INFO ] [REMOTE ] CCIA: Full fetch complete (2163 records). [2025-10-16T17:56:21.573369] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-16T17:56:21.764583] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-16T17:56:21.764961] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:56:21.765165] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:56:21.765284] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-16T17:56:21.780837] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-16T17:56:21.781875] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-16T17:56:21.791802] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-16T17:56:21.791961] [INFO ] [MAIN ] Update Progress: 409/2369 symbols completed. CCIA took 24.8s. Estimated remaining: 4h 29m 48s. Rate: 7.3 symbols/min [2025-10-16T17:56:21.828104] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-16T17:56:21.981020] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:56:22.030955] [DEBUG] [LOCAL ] CCJ: Loaded 53688 existing records from primary storage. [2025-10-16T17:56:22.031269] [INFO ] [MAIN ] CCJ: Loaded 53688 existing records. [2025-10-16T17:56:22.215827] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:56:22.216268] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-16T17:56:22.216323] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-16T17:56:22.216823] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-16T17:56:22.216894] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-16T17:56:22.345505] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-16T17:56:22.463254] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-16T17:56:22.587663] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:56:23.142827] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-16T17:56:23.942778] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-16T17:56:24.095907] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-16T17:56:24.742839] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-16T17:56:25.218309] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-16T17:56:25.467633] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T17:56:25.542798] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-16T17:56:25.856388] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T17:56:26.342828] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-16T17:56:26.532180] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T17:56:27.142860] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-16T17:56:27.942880] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-16T17:56:28.288319] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-16T17:56:28.469847] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-16T17:56:28.555327] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T17:56:28.742829] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-16T17:56:29.542852] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-16T17:56:30.275077] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T17:56:30.342802] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-16T17:56:30.477423] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T17:56:31.142853] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-16T17:56:31.819090] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T17:56:31.844463] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-16T17:56:31.942805] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-16T17:56:32.742784] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-16T17:56:32.772101] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T17:56:33.542881] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-16T17:56:34.342843] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-16T17:56:34.539989] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T17:56:34.553070] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-16T17:56:34.552881] [INFO ] [REMOTE ] CC: Full fetch complete (76077 records). [2025-10-16T17:56:34.553282] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-16T17:56:34.555538] [INFO ] [REMOTE ] CCIF: Full fetch complete (21887 records). [2025-10-16T17:56:34.555671] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-16T17:56:35.153707] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-16T17:56:35.333726] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-16T17:56:35.348824] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-16T17:56:35.352788] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-16T17:56:35.352867] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-16T17:56:35.353144] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-16T17:56:35.353454] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-16T17:56:35.354534] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-16T17:56:35.354774] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-16T17:56:35.354876] [DEBUG] [LOCAL ] CCIF: Trimmed 21887 records to 15625 (keeping 200 days of data) [2025-10-16T17:56:35.390822] [DEBUG] [LOCAL ] CC: Trimmed 76077 records to 53400 (keeping 200 days of data) [2025-10-16T17:56:35.621075] [DEBUG] [LOCAL ] CCIF: Primary data saved (15625 records). [2025-10-16T17:56:35.630114] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-16T17:56:35.630503] [INFO ] [MAIN ] Update Progress: 410/2369 symbols completed. CCIF took 27.2s. Estimated remaining: 4h 30m 7s. Rate: 7.3 symbols/min [2025-10-16T17:56:35.841786] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:56:35.889896] [DEBUG] [LOCAL ] CCK: Loaded 46451 existing records from primary storage. [2025-10-16T17:56:35.893179] [INFO ] [MAIN ] CCK: Loaded 46451 existing records. [2025-10-16T17:56:36.153299] [DEBUG] [LOCAL ] CC: Primary data saved (53400 records). [2025-10-16T17:56:36.142400] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:56:36.153666] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-16T17:56:36.153525] [INFO ] [MAIN ] CC: Full history saved. [2025-10-16T17:56:36.153838] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-16T17:56:36.155107] [INFO ] [MAIN ] Update Progress: 411/2369 symbols completed. CC took 50.3s. Estimated remaining: 4h 29m 22s. Rate: 7.3 symbols/min [2025-10-16T17:56:36.160759] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-16T17:56:36.166973] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-16T17:56:36.483104] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:56:36.705699] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:56:36.722034] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-16T17:56:36.725058] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-16T17:56:36.751901] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-16T17:56:36.774596] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-16T17:56:36.774925] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-16T17:56:36.950288] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:56:36.950469] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-16T17:56:36.950516] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-16T17:56:36.950736] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-16T17:56:36.950793] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-16T17:56:37.315036] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:56:37.322346] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-16T17:56:37.329136] [INFO ] [REMOTE ] CCI: Full fetch complete (77108 records). [2025-10-16T17:56:37.329238] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-16T17:56:37.553587] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-16T17:56:37.729541] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-16T17:56:37.729614] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-16T17:56:37.730477] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-16T17:56:37.730535] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-16T17:56:37.731924] [DEBUG] [LOCAL ] CCI: Trimmed 77108 records to 53506 (keeping 200 days of data) [2025-10-16T17:56:38.056349] [DEBUG] [LOCAL ] CCI: Primary data saved (53506 records). [2025-10-16T17:56:38.056477] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-16T17:56:38.057130] [INFO ] [MAIN ] Update Progress: 412/2369 symbols completed. CCI took 44.5s. Estimated remaining: 4h 28m 43s. Rate: 7.3 symbols/min [2025-10-16T17:56:38.242292] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:56:38.288710] [DEBUG] [LOCAL ] CCO: Loaded 48392 existing records from primary storage. [2025-10-16T17:56:38.289195] [INFO ] [MAIN ] CCO: Loaded 48392 existing records. [2025-10-16T17:56:38.472454] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:56:38.496535] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-16T17:56:38.497388] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-16T17:56:38.498378] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T17:56:38.508446] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-16T17:56:38.509478] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-16T17:56:38.509713] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-16T17:56:38.837322] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-16T17:56:38.920340] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:56:39.142867] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-16T17:56:39.845353] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-16T17:56:39.942908] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-16T17:56:40.191305] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T17:56:40.501932] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T17:56:40.742853] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-16T17:56:41.542894] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-16T17:56:42.241311] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-16T17:56:42.344540] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-16T17:56:42.349939] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T17:56:42.807035] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T17:56:43.142814] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-16T17:56:43.942821] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-16T17:56:44.480967] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-16T17:56:44.742852] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-16T17:56:45.050272] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-16T17:56:45.319145] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T17:56:45.542854] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-16T17:56:45.988964] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-16T17:56:46.342850] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-16T17:56:47.142894] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-16T17:56:47.853337] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-16T17:56:47.890066] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T17:56:47.942778] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-16T17:56:48.602828] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T17:56:48.742800] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-16T17:56:49.335885] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-16T17:56:49.542824] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-16T17:56:50.153905] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T17:56:50.342838] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-16T17:56:51.072871] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T17:56:51.142799] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-16T17:56:51.942836] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-16T17:56:52.742832] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-16T17:56:52.785079] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-16T17:56:53.542846] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-16T17:56:54.084465] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-16T17:56:54.123115] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T17:56:54.342832] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-16T17:56:55.154474] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-16T17:56:55.157422] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (4.01 seconds). [2025-10-16T17:56:55.799770] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-16T17:56:55.850898] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T17:56:55.942767] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-16T17:56:56.322547] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-16T17:56:56.742863] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-16T17:56:57.542826] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-16T17:56:58.227166] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T17:56:58.272602] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-16T17:56:58.342791] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-16T17:56:59.142807] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-16T17:56:59.503327] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-16T17:56:59.883738] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T17:56:59.942766] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-16T17:57:00.699123] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T17:57:00.742777] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-16T17:57:01.542845] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-16T17:57:01.707209] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T17:57:02.342812] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-16T17:57:02.941489] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-16T17:57:03.142817] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-16T17:57:03.749595] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-16T17:57:03.783534] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T17:57:03.789675] [INFO ] [REMOTE ] CCK: Full fetch complete (67844 records). [2025-10-16T17:57:03.789813] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-16T17:57:03.961428] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-16T17:57:04.176792] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-16T17:57:04.176864] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-16T17:57:04.177694] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-16T17:57:04.177758] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-16T17:57:04.179010] [DEBUG] [LOCAL ] CCK: Trimmed 67844 records to 46797 (keeping 200 days of data) [2025-10-16T17:57:04.471912] [DEBUG] [LOCAL ] CCK: Primary data saved (46797 records). [2025-10-16T17:57:04.472077] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-16T17:57:04.472622] [INFO ] [MAIN ] Update Progress: 413/2369 symbols completed. CCK took 28.8s. Estimated remaining: 4h 30m 1s. Rate: 7.2 symbols/min [2025-10-16T17:57:04.646467] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:57:04.675689] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T17:57:04.692519] [DEBUG] [LOCAL ] CCRD: Loaded 9504 existing records from primary storage. [2025-10-16T17:57:04.692780] [INFO ] [MAIN ] CCRD: Loaded 9504 existing records. [2025-10-16T17:57:04.754519] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-16T17:57:04.877383] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:57:04.877593] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-16T17:57:04.877662] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-16T17:57:04.877864] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-16T17:57:04.877905] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-16T17:57:05.237759] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:57:05.542886] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-16T17:57:06.342858] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-16T17:57:06.435044] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-16T17:57:06.571467] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T17:57:07.046734] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T17:57:07.053153] [INFO ] [REMOTE ] CCO: Full fetch complete (67100 records). [2025-10-16T17:57:07.053295] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-16T17:57:07.148410] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-16T17:57:07.362486] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T17:57:07.455407] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-16T17:57:07.455483] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-16T17:57:07.456259] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-16T17:57:07.456321] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-16T17:57:07.457627] [DEBUG] [LOCAL ] CCO: Trimmed 67100 records to 48741 (keeping 200 days of data) [2025-10-16T17:57:07.724835] [DEBUG] [LOCAL ] CCO: Primary data saved (48741 records). [2025-10-16T17:57:07.724993] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-16T17:57:07.725613] [INFO ] [MAIN ] Update Progress: 414/2369 symbols completed. CCO took 29.7s. Estimated remaining: 4h 29m 29s. Rate: 7.3 symbols/min [2025-10-16T17:57:07.903521] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:57:07.935222] [DEBUG] [LOCAL ] CCS: Loaded 30343 existing records from primary storage. [2025-10-16T17:57:07.935519] [INFO ] [MAIN ] CCS: Loaded 30343 existing records. [2025-10-16T17:57:07.947916] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-16T17:57:08.121511] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:57:08.121785] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-16T17:57:08.121838] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-16T17:57:08.122173] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-16T17:57:08.122212] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-16T17:57:08.479265] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:57:08.639913] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T17:57:08.742817] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-16T17:57:09.318677] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T17:57:09.500763] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-16T17:57:09.542793] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-16T17:57:10.342836] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-16T17:57:11.142856] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-16T17:57:11.720441] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-16T17:57:11.727401] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-16T17:57:11.727557] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-16T17:57:11.834998] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-16T17:57:11.950221] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-16T17:57:12.149121] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-16T17:57:12.149192] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-16T17:57:12.150060] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-16T17:57:12.150121] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-16T17:57:12.151495] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 54190 (keeping 200 days of data) [2025-10-16T17:57:12.474629] [DEBUG] [LOCAL ] CCL: Primary data saved (54190 records). [2025-10-16T17:57:12.474780] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-16T17:57:12.474858] [INFO ] [MAIN ] Update Progress: 415/2369 symbols completed. CCL took 36.3s. Estimated remaining: 4h 29m 4s. Rate: 7.3 symbols/min [2025-10-16T17:57:12.661071] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:57:12.662720] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-16T17:57:12.669686] [INFO ] [REMOTE ] CCJ: Full fetch complete (77839 records). [2025-10-16T17:57:12.669856] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-16T17:57:12.747003] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-16T17:57:12.845946] [DEBUG] [LOCAL ] CCU: Loaded 22294 existing records from primary storage. [2025-10-16T17:57:12.868494] [INFO ] [MAIN ] CCU: Loaded 22294 existing records. [2025-10-16T17:57:13.245381] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:57:13.264591] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-16T17:57:13.264766] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-16T17:57:13.265926] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-16T17:57:13.266231] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-16T17:57:13.266150] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-16T17:57:13.266335] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-16T17:57:13.266888] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-16T17:57:13.267230] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-16T17:57:13.303574] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T17:57:13.380269] [DEBUG] [LOCAL ] CCJ: Trimmed 77839 records to 54078 (keeping 200 days of data) [2025-10-16T17:57:13.554453] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-16T17:57:13.576493] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T17:57:13.806758] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:57:14.007955] [DEBUG] [LOCAL ] CCJ: Primary data saved (54078 records). [2025-10-16T17:57:14.008094] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-16T17:57:14.008830] [INFO ] [MAIN ] Update Progress: 416/2369 symbols completed. CCJ took 52.2s. Estimated remaining: 4h 28m 24s. Rate: 7.3 symbols/min [2025-10-16T17:57:14.172442] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:57:14.172613] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-16T17:57:14.172677] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-16T17:57:14.172790] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-16T17:57:14.172830] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-16T17:57:14.172871] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-16T17:57:14.172903] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-16T17:57:14.348133] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-16T17:57:14.523692] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:57:14.866818] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T17:57:15.142853] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-16T17:57:15.551767] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-16T17:57:15.630753] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T17:57:15.942798] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-16T17:57:16.539827] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T17:57:16.742824] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-16T17:57:17.542852] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-16T17:57:17.765087] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-10-16T17:57:18.097008] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T17:57:18.342819] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-16T17:57:18.560079] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-16T17:57:19.142854] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-16T17:57:19.356272] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-10-16T17:57:19.942823] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-16T17:57:20.742790] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-16T17:57:20.981251] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-16T17:57:21.467690] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T17:57:21.542846] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-16T17:57:22.342806] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-16T17:57:22.543626] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T17:57:22.662673] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-16T17:57:23.142820] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-16T17:57:23.408588] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-16T17:57:23.942835] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-16T17:57:24.742795] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-16T17:57:24.796997] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T17:57:25.542841] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-16T17:57:25.973435] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-16T17:57:26.342883] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-16T17:57:26.375056] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-16T17:57:27.142841] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-16T17:57:27.583968] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:57:27.584263] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-16T17:57:27.584354] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:57:27.584428] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-16T17:57:27.584496] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:57:27.584683] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-16T17:57:27.584795] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-16T17:57:27.590524] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-16T17:57:27.600583] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-16T17:57:27.600745] [INFO ] [MAIN ] Update Progress: 417/2369 symbols completed. CCZ took 13.6s. Estimated remaining: 4h 28m 41s. Rate: 7.3 symbols/min [2025-10-16T17:57:27.634880] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T17:57:27.782049] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:57:27.835063] [DEBUG] [LOCAL ] CDE: Loaded 53643 existing records from primary storage. [2025-10-16T17:57:27.835369] [INFO ] [MAIN ] CDE: Loaded 53643 existing records. [2025-10-16T17:57:27.947983] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-16T17:57:28.027366] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:57:28.027590] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-16T17:57:28.027664] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-16T17:57:28.027892] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-16T17:57:28.027949] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-16T17:57:28.372754] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:57:28.742814] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-16T17:57:29.346601] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T17:57:29.542820] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-16T17:57:29.804377] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T17:57:29.981043] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T17:57:30.342833] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-16T17:57:31.142811] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-16T17:57:31.942805] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-16T17:57:32.282551] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T17:57:32.540070] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T17:57:32.742806] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-16T17:57:33.030181] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T17:57:33.542866] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-16T17:57:33.670006] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T17:57:34.342822] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-16T17:57:34.561872] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T17:57:34.563483] [INFO ] [REMOTE ] CCRD: Full fetch complete (11920 records). [2025-10-16T17:57:34.563555] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-16T17:57:34.931446] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-16T17:57:34.931566] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-16T17:57:34.931948] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-16T17:57:34.932015] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-16T17:57:34.932839] [DEBUG] [LOCAL ] CCRD: Trimmed 11920 records to 9580 (keeping 200 days of data) [2025-10-16T17:57:34.999314] [DEBUG] [LOCAL ] CCRD: Primary data saved (9580 records). [2025-10-16T17:57:34.999446] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-16T17:57:34.999528] [INFO ] [MAIN ] Update Progress: 418/2369 symbols completed. CCRD took 30.5s. Estimated remaining: 4h 28m 29s. Rate: 7.3 symbols/min [2025-10-16T17:57:35.171244] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:57:35.153214] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-16T17:57:35.183008] [DEBUG] [LOCAL ] CDLR: Loaded 10075 existing records from primary storage. [2025-10-16T17:57:35.183214] [INFO ] [MAIN ] CDLR: Loaded 10075 existing records. [2025-10-16T17:57:35.360041] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:57:35.360320] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-16T17:57:35.360391] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-16T17:57:35.360552] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-16T17:57:35.360612] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-16T17:57:35.727521] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:57:35.942781] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-16T17:57:36.124458] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T17:57:36.353937] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T17:57:36.742874] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-16T17:57:36.872373] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T17:57:37.542790] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-16T17:57:37.622023] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T17:57:38.074063] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-16T17:57:38.342826] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-16T17:57:39.142870] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-16T17:57:39.739131] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T17:57:39.942799] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-16T17:57:40.167396] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T17:57:40.581897] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-16T17:57:40.742825] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-16T17:57:41.542836] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-16T17:57:41.668775] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T17:57:41.671303] [INFO ] [REMOTE ] CCU: Full fetch complete (32486 records). [2025-10-16T17:57:41.671394] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-16T17:57:42.036093] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-16T17:57:42.036166] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-16T17:57:42.036723] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-16T17:57:42.036784] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-16T17:57:42.037512] [DEBUG] [LOCAL ] CCU: Trimmed 32486 records to 22447 (keeping 200 days of data) [2025-10-16T17:57:42.171591] [DEBUG] [LOCAL ] CCU: Primary data saved (22447 records). [2025-10-16T17:57:42.171821] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-16T17:57:42.171944] [INFO ] [MAIN ] Update Progress: 419/2369 symbols completed. CCU took 29.7s. Estimated remaining: 4h 28m 16s. Rate: 7.3 symbols/min [2025-10-16T17:57:42.339790] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:57:42.342802] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-16T17:57:42.377790] [DEBUG] [LOCAL ] CDP: Loaded 42531 existing records from primary storage. [2025-10-16T17:57:42.378060] [INFO ] [MAIN ] CDP: Loaded 42531 existing records. [2025-10-16T17:57:42.556516] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:57:42.556746] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-16T17:57:42.556802] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-16T17:57:42.557074] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-16T17:57:42.557114] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-16T17:57:42.884145] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T17:57:42.942766] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:57:43.142789] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-16T17:57:43.942776] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-16T17:57:44.287471] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-16T17:57:44.684924] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T17:57:44.742781] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-16T17:57:44.868668] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T17:57:45.542858] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-16T17:57:46.209942] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T17:57:46.233376] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T17:57:46.342769] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-16T17:57:47.142799] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-16T17:57:47.659922] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T17:57:47.942857] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-16T17:57:48.742788] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-16T17:57:48.968196] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T17:57:49.141252] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-16T17:57:49.542882] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-16T17:57:50.043262] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T17:57:50.047290] [INFO ] [REMOTE ] CCS: Full fetch complete (44867 records). [2025-10-16T17:57:50.047615] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-16T17:57:50.349066] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-16T17:57:50.421320] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-16T17:57:50.601846] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-16T17:57:50.601961] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-16T17:57:50.602797] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-16T17:57:50.602874] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-16T17:57:50.604203] [DEBUG] [LOCAL ] CCS: Trimmed 44867 records to 30488 (keeping 200 days of data) [2025-10-16T17:57:50.833771] [DEBUG] [LOCAL ] CCS: Primary data saved (30488 records). [2025-10-16T17:57:50.833928] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-16T17:57:50.834013] [INFO ] [MAIN ] Update Progress: 420/2369 symbols completed. CCS took 43.1s. Estimated remaining: 4h 28m 9s. Rate: 7.3 symbols/min [2025-10-16T17:57:51.023679] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:57:51.047354] [DEBUG] [LOCAL ] CDRE: Loaded 24933 existing records from primary storage. [2025-10-16T17:57:51.047616] [INFO ] [MAIN ] CDRE: Loaded 24933 existing records. [2025-10-16T17:57:51.147960] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-16T17:57:51.234553] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:57:51.234873] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-16T17:57:51.234931] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-16T17:57:51.235217] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-16T17:57:51.235275] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-16T17:57:51.597158] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:57:51.788749] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-16T17:57:51.808033] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T17:57:51.942774] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-16T17:57:52.742812] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-16T17:57:53.515718] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T17:57:53.542792] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-16T17:57:53.620831] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T17:57:54.342816] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-16T17:57:55.126437] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T17:57:55.142763] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-16T17:57:55.197681] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T17:57:55.942835] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-16T17:57:56.455113] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T17:57:56.742850] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-16T17:57:57.542793] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-16T17:57:57.802230] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T17:57:58.040848] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T17:57:58.342806] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-16T17:57:59.024323] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T17:57:59.142786] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-16T17:57:59.942836] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-16T17:58:00.148542] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T17:58:00.215317] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T17:58:00.742816] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-16T17:58:00.847944] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T17:58:01.542851] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-16T17:58:02.342850] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-16T17:58:02.614435] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-16T17:58:02.671759] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T17:58:03.131734] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-16T17:58:03.142776] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-16T17:58:03.942847] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-16T17:58:04.202474] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T17:58:04.205108] [INFO ] [REMOTE ] CDLR: Full fetch complete (13931 records). [2025-10-16T17:58:04.205190] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-16T17:58:04.585363] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-16T17:58:04.585459] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-16T17:58:04.585985] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-16T17:58:04.586080] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-16T17:58:04.586794] [DEBUG] [LOCAL ] CDLR: Trimmed 13931 records to 10199 (keeping 200 days of data) [2025-10-16T17:58:04.655507] [DEBUG] [LOCAL ] CDLR: Primary data saved (10199 records). [2025-10-16T17:58:04.655747] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-16T17:58:04.655877] [INFO ] [MAIN ] Update Progress: 421/2369 symbols completed. CDLR took 29.7s. Estimated remaining: 4h 28m 27s. Rate: 7.3 symbols/min [2025-10-16T17:58:04.747967] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-16T17:58:04.831749] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:58:04.883797] [DEBUG] [LOCAL ] CE: Loaded 51344 existing records from primary storage. [2025-10-16T17:58:04.884227] [INFO ] [MAIN ] CE: Loaded 51344 existing records. [2025-10-16T17:58:05.064732] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:58:05.065193] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-16T17:58:05.065259] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-16T17:58:05.065497] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-16T17:58:05.065555] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-16T17:58:05.447095] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:58:05.542845] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-16T17:58:05.862937] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T17:58:06.342810] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-16T17:58:06.525709] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T17:58:06.545156] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T17:58:07.142843] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-16T17:58:07.942826] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-16T17:58:08.141692] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T17:58:08.669083] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T17:58:08.676057] [INFO ] [REMOTE ] CDP: Full fetch complete (62029 records). [2025-10-16T17:58:08.676189] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-16T17:58:08.755689] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-16T17:58:09.076234] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-16T17:58:09.076314] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-16T17:58:09.077111] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-16T17:58:09.077174] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-16T17:58:09.078392] [DEBUG] [LOCAL ] CDP: Trimmed 62029 records to 42851 (keeping 200 days of data) [2025-10-16T17:58:09.356514] [DEBUG] [LOCAL ] CDP: Primary data saved (42851 records). [2025-10-16T17:58:09.356665] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-16T17:58:09.357249] [INFO ] [MAIN ] Update Progress: 422/2369 symbols completed. CDP took 27.2s. Estimated remaining: 4h 28m 2s. Rate: 7.3 symbols/min [2025-10-16T17:58:09.531978] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:58:09.561456] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-16T17:58:09.568124] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T17:58:09.581866] [DEBUG] [LOCAL ] CEE: Loaded 5365 existing records from primary storage. [2025-10-16T17:58:09.582612] [INFO ] [MAIN ] CEE: Loaded 5365 existing records. [2025-10-16T17:58:09.765273] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:58:09.765487] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-16T17:58:09.765543] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-16T17:58:09.766132] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-16T17:58:09.766189] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-16T17:58:10.131042] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:58:10.342805] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-16T17:58:10.589383] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T17:58:10.724545] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T17:58:11.142885] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-16T17:58:11.897439] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T17:58:11.942825] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-16T17:58:12.240015] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T17:58:12.742839] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-16T17:58:13.382326] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T17:58:13.542807] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-16T17:58:14.342789] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-16T17:58:14.443235] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T17:58:15.053212] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T17:58:15.104442] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-16T17:58:15.113294] [INFO ] [REMOTE ] CDE: Full fetch complete (77781 records). [2025-10-16T17:58:15.113458] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-16T17:58:15.148040] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-16T17:58:15.516745] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-16T17:58:15.516874] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-16T17:58:15.517811] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-16T17:58:15.517896] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-16T17:58:15.519413] [DEBUG] [LOCAL ] CDE: Trimmed 77781 records to 54033 (keeping 200 days of data) [2025-10-16T17:58:15.830242] [DEBUG] [LOCAL ] CDE: Primary data saved (54033 records). [2025-10-16T17:58:15.830379] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-16T17:58:15.831060] [INFO ] [MAIN ] Update Progress: 423/2369 symbols completed. CDE took 48.2s. Estimated remaining: 4h 27m 46s. Rate: 7.3 symbols/min [2025-10-16T17:58:15.947956] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-16T17:58:16.003103] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:58:16.031867] [DEBUG] [LOCAL ] CEPU: Loaded 26707 existing records from primary storage. [2025-10-16T17:58:16.032183] [INFO ] [MAIN ] CEPU: Loaded 26707 existing records. [2025-10-16T17:58:16.214269] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:58:16.214527] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-16T17:58:16.214599] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-16T17:58:16.214810] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-16T17:58:16.214883] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-16T17:58:16.575105] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:58:16.579574] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-16T17:58:16.742782] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-16T17:58:16.898987] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T17:58:17.413031] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T17:58:17.542887] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-16T17:58:18.342853] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-16T17:58:18.649338] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T17:58:19.142856] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-16T17:58:19.942829] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-16T17:58:20.317161] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T17:58:20.363935] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-16T17:58:20.742858] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-16T17:58:20.946533] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-16T17:58:21.542873] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-16T17:58:21.927629] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-16T17:58:22.342791] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-16T17:58:23.142791] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-16T17:58:23.233544] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T17:58:23.471373] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T17:58:23.638698] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-16T17:58:23.942821] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-16T17:58:24.742846] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-16T17:58:24.932918] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-16T17:58:25.542782] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-16T17:58:25.600452] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T17:58:26.342793] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-16T17:58:27.005023] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-16T17:58:27.142839] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-16T17:58:27.217139] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T17:58:27.539735] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-16T17:58:27.942830] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-16T17:58:28.742777] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-16T17:58:29.177496] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T17:58:29.228761] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T17:58:29.542866] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-16T17:58:30.342792] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-16T17:58:30.580932] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-16T17:58:31.051229] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T17:58:31.142841] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-16T17:58:31.942770] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-16T17:58:32.191554] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T17:58:32.378473] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T17:58:32.742856] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-16T17:58:33.542902] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-16T17:58:33.824037] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-16T17:58:33.828317] [INFO ] [REMOTE ] CDRE: Full fetch complete (35110 records). [2025-10-16T17:58:33.828494] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-16T17:58:34.224284] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-16T17:58:34.224390] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-16T17:58:34.225106] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-16T17:58:34.225172] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-16T17:58:34.226358] [DEBUG] [LOCAL ] CDRE: Trimmed 35110 records to 25091 (keeping 200 days of data) [2025-10-16T17:58:34.344176] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-16T17:58:34.391369] [DEBUG] [LOCAL ] CDRE: Primary data saved (25091 records). [2025-10-16T17:58:34.391578] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-16T17:58:34.391707] [INFO ] [MAIN ] Update Progress: 424/2369 symbols completed. CDRE took 43.6s. Estimated remaining: 4h 28m 25s. Rate: 7.2 symbols/min [2025-10-16T17:58:34.583317] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:58:34.602727] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T17:58:34.660982] [DEBUG] [LOCAL ] CF: Loaded 52155 existing records from primary storage. [2025-10-16T17:58:34.661535] [INFO ] [MAIN ] CF: Loaded 52155 existing records. [2025-10-16T17:58:34.850721] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:58:34.851025] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-16T17:58:34.851079] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-16T17:58:34.851474] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-16T17:58:34.851548] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-16T17:58:35.147935] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-16T17:58:35.148182] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T17:58:35.190141] [INFO ] [REMOTE ] CEE: Full fetch complete (10144 records). [2025-10-16T17:58:35.196878] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-16T17:58:35.415056] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:58:35.654100] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-16T17:58:35.654179] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-16T17:58:35.654463] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-16T17:58:35.654502] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-16T17:58:35.654935] [DEBUG] [LOCAL ] CEE: Trimmed 10144 records to 5411 (keeping 200 days of data) [2025-10-16T17:58:35.685513] [DEBUG] [LOCAL ] CEE: Primary data saved (5411 records). [2025-10-16T17:58:35.685606] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-16T17:58:35.685705] [INFO ] [MAIN ] Update Progress: 425/2369 symbols completed. CEE took 26.3s. Estimated remaining: 4h 27m 44s. Rate: 7.3 symbols/min [2025-10-16T17:58:35.848523] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:58:35.899883] [DEBUG] [LOCAL ] CFG: Loaded 53623 existing records from primary storage. [2025-10-16T17:58:35.900250] [INFO ] [MAIN ] CFG: Loaded 53623 existing records. [2025-10-16T17:58:35.953855] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-16T17:58:36.074900] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:58:36.075109] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-16T17:58:36.075156] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-16T17:58:36.075393] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-16T17:58:36.075449] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-16T17:58:36.452344] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:58:36.742845] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-16T17:58:36.941494] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T17:58:37.542791] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-16T17:58:37.771107] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-16T17:58:38.194730] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T17:58:38.342794] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-16T17:58:39.150700] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-16T17:58:39.186713] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T17:58:39.831192] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T17:58:39.942821] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-16T17:58:40.210348] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T17:58:40.742834] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-16T17:58:41.500303] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T17:58:41.533702] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T17:58:41.542758] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-16T17:58:42.342846] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-16T17:58:42.517612] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T17:58:43.142842] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-16T17:58:43.942830] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-16T17:58:44.072447] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T17:58:44.435177] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T17:58:44.742856] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-16T17:58:45.255357] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T17:58:45.542829] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-16T17:58:46.342806] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-16T17:58:46.559728] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T17:58:46.769018] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-16T17:58:46.773199] [INFO ] [REMOTE ] CEPU: Full fetch complete (39545 records). [2025-10-16T17:58:46.773301] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-16T17:58:46.773842] [FATAL] [VALIDATOR ] CEPU: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:58:46.773931] [FATAL] [MAIN ] CEPU: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:58:46.773974] [WARN ] [MAIN ] CEPU: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:58:46.774036] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-16T17:58:46.774121] [DEBUG] [LOCAL ] CEPU: No primary data file found to delete. [2025-10-16T17:58:46.774176] [INFO ] [LOCAL ] CEPU: Starting deletion of derivative data. [2025-10-16T17:58:46.774465] [DEBUG] [LOCAL ] CEPU: Deleted derivative data file. [2025-10-16T17:58:46.774555] [INFO ] [MAIN ] Update Progress: 426/2369 symbols completed. CEPU took 30.9s. Estimated remaining: 4h 27m 49s. Rate: 7.3 symbols/min [2025-10-16T17:58:46.941239] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:58:46.941435] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-16T17:58:46.941474] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-16T17:58:46.941582] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-16T17:58:46.941624] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-16T17:58:46.941704] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-16T17:58:46.941748] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-16T17:58:47.151994] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-16T17:58:47.287007] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:58:47.942777] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-16T17:58:48.116130] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T17:58:48.128244] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:58:48.128479] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-16T17:58:48.128565] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:58:48.128611] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-16T17:58:48.128777] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:58:48.128852] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-16T17:58:48.128934] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-16T17:58:48.129013] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-16T17:58:48.129063] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-16T17:58:48.129108] [INFO ] [MAIN ] Update Progress: 427/2369 symbols completed. CFND took 1.4s. Estimated remaining: 4h 27m 9s. Rate: 7.3 symbols/min [2025-10-16T17:58:48.295161] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:58:48.330314] [DEBUG] [LOCAL ] CFR: Loaded 32574 existing records from primary storage. [2025-10-16T17:58:48.330568] [INFO ] [MAIN ] CFR: Loaded 32574 existing records. [2025-10-16T17:58:48.509215] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:58:48.509462] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-16T17:58:48.509512] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-16T17:58:48.509938] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-16T17:58:48.509994] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-16T17:58:48.746537] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-16T17:58:48.862530] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:58:49.108173] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T17:58:49.114624] [INFO ] [REMOTE ] CE: Full fetch complete (74863 records). [2025-10-16T17:58:49.114768] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-16T17:58:49.497091] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-16T17:58:49.497167] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-16T17:58:49.498206] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-16T17:58:49.498268] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-16T17:58:49.500058] [DEBUG] [LOCAL ] CE: Trimmed 74863 records to 51713 (keeping 200 days of data) [2025-10-16T17:58:49.553350] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-16T17:58:49.805888] [DEBUG] [LOCAL ] CE: Primary data saved (51713 records). [2025-10-16T17:58:49.806036] [INFO ] [MAIN ] CE: Full history saved. [2025-10-16T17:58:49.806481] [INFO ] [MAIN ] Update Progress: 428/2369 symbols completed. CE took 45.2s. Estimated remaining: 4h 26m 31s. Rate: 7.3 symbols/min [2025-10-16T17:58:49.971793] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:58:50.011455] [DEBUG] [LOCAL ] CGAU: Loaded 43550 existing records from primary storage. [2025-10-16T17:58:50.011816] [INFO ] [MAIN ] CGAU: Loaded 43550 existing records. [2025-10-16T17:58:50.190291] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:58:50.190505] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-16T17:58:50.190571] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-16T17:58:50.191259] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-16T17:58:50.191317] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-16T17:58:50.364766] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-16T17:58:50.569334] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:58:50.710472] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T17:58:51.142819] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-16T17:58:51.266592] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T17:58:51.771298] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T17:58:51.942809] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-16T17:58:52.742803] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-16T17:58:52.877122] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T17:58:52.956882] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-16T17:58:53.542785] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-16T17:58:54.350156] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-16T17:58:54.355853] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T17:58:54.932873] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T17:58:55.142832] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-16T17:58:55.436287] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T17:58:55.942827] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-16T17:58:56.563573] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T17:58:56.742794] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-16T17:58:57.542867] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-16T17:58:57.766975] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T17:58:58.173987] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T17:58:58.342805] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-16T17:58:59.142798] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-16T17:58:59.286705] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T17:58:59.888202] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T17:58:59.942820] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-16T17:59:00.742801] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-16T17:59:00.819780] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T17:59:01.382843] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T17:59:01.542877] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-16T17:59:02.315629] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T17:59:02.342779] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-16T17:59:03.142877] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-16T17:59:03.645192] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-16T17:59:03.942808] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-16T17:59:03.978663] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T17:59:04.703867] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T17:59:04.742797] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-16T17:59:05.123622] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T17:59:05.542874] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-16T17:59:06.248109] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T17:59:06.342827] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-16T17:59:06.999372] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T17:59:07.142826] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-16T17:59:07.859170] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T17:59:07.942783] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-16T17:59:08.541335] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-16T17:59:08.550695] [INFO ] [REMOTE ] CF: Full fetch complete (75572 records). [2025-10-16T17:59:08.550910] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-16T17:59:08.745843] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-16T17:59:08.985452] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-16T17:59:08.985536] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-16T17:59:08.986764] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-16T17:59:08.986829] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-16T17:59:08.988295] [DEBUG] [LOCAL ] CF: Trimmed 75572 records to 52532 (keeping 200 days of data) [2025-10-16T17:59:09.311231] [DEBUG] [LOCAL ] CF: Primary data saved (52532 records). [2025-10-16T17:59:09.311454] [INFO ] [MAIN ] CF: Full history saved. [2025-10-16T17:59:09.312337] [INFO ] [MAIN ] Update Progress: 429/2369 symbols completed. CF took 34.9s. Estimated remaining: 4h 27m 14s. Rate: 7.3 symbols/min [2025-10-16T17:59:09.435299] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T17:59:09.528402] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:59:09.531308] [DEBUG] [LOCAL ] CGV: Loaded 1398 existing records from primary storage. [2025-10-16T17:59:09.531444] [INFO ] [MAIN ] CGV: Loaded 1398 existing records. [2025-10-16T17:59:09.551101] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-16T17:59:09.710138] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:59:09.710382] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-16T17:59:09.710431] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-16T17:59:09.710603] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-16T17:59:09.710695] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-16T17:59:10.070301] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:59:10.093867] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T17:59:10.342809] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-16T17:59:11.142844] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-16T17:59:11.389143] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T17:59:11.473939] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T17:59:11.494304] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-16T17:59:11.942938] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-16T17:59:12.742809] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-16T17:59:13.258734] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T17:59:13.542850] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-16T17:59:14.342086] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T17:59:14.352407] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-16T17:59:14.781976] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T17:59:14.806560] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-16T17:59:15.142825] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-16T17:59:15.407624] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-16T17:59:15.942817] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-16T17:59:16.742794] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-16T17:59:17.542894] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-16T17:59:17.926982] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-16T17:59:17.928918] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-16T17:59:17.958385] [INFO ] [REMOTE ] CFG: Full fetch complete (77755 records). [2025-10-16T17:59:17.960242] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T17:59:17.960522] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-16T17:59:18.352379] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-16T17:59:18.396549] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-16T17:59:18.396697] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-16T17:59:18.397800] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-16T17:59:18.397867] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-16T17:59:18.399899] [DEBUG] [LOCAL ] CFG: Trimmed 77755 records to 54013 (keeping 200 days of data) [2025-10-16T17:59:18.752806] [DEBUG] [LOCAL ] CFG: Primary data saved (54013 records). [2025-10-16T17:59:18.753053] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-16T17:59:18.753842] [INFO ] [MAIN ] Update Progress: 430/2369 symbols completed. CFG took 43.1s. Estimated remaining: 4h 27m 11s. Rate: 7.3 symbols/min [2025-10-16T17:59:18.931226] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:59:18.963159] [DEBUG] [LOCAL ] CHCT: Loaded 24209 existing records from primary storage. [2025-10-16T17:59:18.963565] [INFO ] [MAIN ] CHCT: Loaded 24209 existing records. [2025-10-16T17:59:19.146839] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-16T17:59:19.151349] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:59:19.152772] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-16T17:59:19.152833] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-16T17:59:19.153311] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-16T17:59:19.153371] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-16T17:59:19.508372] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:59:19.942830] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-16T17:59:20.742818] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-16T17:59:20.828327] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T17:59:21.340685] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-16T17:59:21.415711] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (3.06 seconds). [2025-10-16T17:59:21.422683] [INFO ] [REMOTE ] CGAU: Full fetch complete (61699 records). [2025-10-16T17:59:21.422804] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-16T17:59:21.547979] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-16T17:59:21.845752] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-16T17:59:21.845915] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-16T17:59:21.846775] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-16T17:59:21.846890] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-16T17:59:21.862726] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T17:59:21.869584] [DEBUG] [LOCAL ] CGAU: Trimmed 61699 records to 43931 (keeping 200 days of data) [2025-10-16T17:59:22.120996] [DEBUG] [LOCAL ] CGAU: Primary data saved (43931 records). [2025-10-16T17:59:22.121125] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-16T17:59:22.121488] [INFO ] [MAIN ] Update Progress: 431/2369 symbols completed. CGAU took 32.3s. Estimated remaining: 4h 26m 41s. Rate: 7.3 symbols/min [2025-10-16T17:59:22.189368] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-16T17:59:22.295702] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:59:22.345297] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-16T17:59:22.347508] [DEBUG] [LOCAL ] CHD: Loaded 52319 existing records from primary storage. [2025-10-16T17:59:22.347970] [INFO ] [MAIN ] CHD: Loaded 52319 existing records. [2025-10-16T17:59:22.531054] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:59:22.531304] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-16T17:59:22.531361] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-16T17:59:22.531766] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-16T17:59:22.531822] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-16T17:59:22.872452] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:59:23.142819] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-16T17:59:23.692939] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T17:59:23.942846] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-16T17:59:24.355774] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T17:59:24.699555] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T17:59:24.742774] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-16T17:59:25.542857] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-16T17:59:26.347929] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-16T17:59:26.366218] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:59:26.644349] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T17:59:27.142839] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-16T17:59:27.676765] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T17:59:27.680701] [INFO ] [REMOTE ] CFR: Full fetch complete (48389 records). [2025-10-16T17:59:27.680817] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-16T17:59:27.947964] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-16T17:59:28.055898] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-16T17:59:28.055974] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-16T17:59:28.056660] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-16T17:59:28.056724] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-16T17:59:28.057685] [DEBUG] [LOCAL ] CFR: Trimmed 48389 records to 32885 (keeping 200 days of data) [2025-10-16T17:59:28.269188] [DEBUG] [LOCAL ] CFR: Primary data saved (32885 records). [2025-10-16T17:59:28.270920] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-16T17:59:28.275505] [INFO ] [MAIN ] Update Progress: 432/2369 symbols completed. CFR took 40.1s. Estimated remaining: 4h 26m 23s. Rate: 7.3 symbols/min [2025-10-16T17:59:28.307982] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T17:59:28.449257] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:59:28.465558] [DEBUG] [LOCAL ] CHE: Loaded 15315 existing records from primary storage. [2025-10-16T17:59:28.465825] [INFO ] [MAIN ] CHE: Loaded 15315 existing records. [2025-10-16T17:59:28.642205] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:59:28.642436] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-16T17:59:28.642491] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-16T17:59:28.642736] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-16T17:59:28.642797] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-16T17:59:28.747936] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-16T17:59:29.003428] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:59:29.175158] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-16T17:59:29.551358] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-16T17:59:29.568466] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T17:59:30.342902] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-16T17:59:30.691387] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T17:59:31.142807] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-16T17:59:31.478691] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-16T17:59:31.918616] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T17:59:31.942771] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-16T17:59:32.742803] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-16T17:59:33.542779] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-16T17:59:33.777319] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T17:59:33.936060] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T17:59:34.340891] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-16T17:59:34.343790] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-16T17:59:35.142887] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-16T17:59:35.262565] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T17:59:35.942862] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-16T17:59:36.742837] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-16T17:59:37.000019] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T17:59:37.081790] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-16T17:59:37.537157] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-16T17:59:37.542770] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-16T17:59:38.342863] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-16T17:59:39.142776] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-16T17:59:39.216998] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T17:59:39.388436] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T17:59:39.942798] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-16T17:59:39.978807] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T17:59:40.742805] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-16T17:59:41.527210] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-16T17:59:41.542766] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-16T17:59:41.970783] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-16T17:59:42.342830] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-16T17:59:42.791484] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T17:59:43.142804] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-16T17:59:43.338847] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T17:59:43.942784] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-16T17:59:44.179518] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T17:59:44.742868] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-16T17:59:45.542837] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-16T17:59:45.676918] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T17:59:45.791506] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T17:59:46.342879] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-16T17:59:46.754227] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-16T17:59:46.795415] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-16T17:59:46.797021] [INFO ] [REMOTE ] CGV: Full fetch complete (2277 records). [2025-10-16T17:59:46.797111] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-16T17:59:47.146819] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-16T17:59:47.173161] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-16T17:59:47.173252] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-16T17:59:47.173380] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-16T17:59:47.173421] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-16T17:59:47.173810] [DEBUG] [LOCAL ] CGV: Trimmed 2277 records to 1404 (keeping 200 days of data) [2025-10-16T17:59:47.182860] [DEBUG] [LOCAL ] CGV: Primary data saved (1404 records). [2025-10-16T17:59:47.182928] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-16T17:59:47.183022] [INFO ] [MAIN ] Update Progress: 433/2369 symbols completed. CGV took 37.9s. Estimated remaining: 4h 27m 2s. Rate: 7.2 symbols/min [2025-10-16T17:59:47.359053] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:59:47.404568] [DEBUG] [LOCAL ] CHGG: Loaded 47763 existing records from primary storage. [2025-10-16T17:59:47.404899] [INFO ] [MAIN ] CHGG: Loaded 47763 existing records. [2025-10-16T17:59:47.593009] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:59:47.593315] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-16T17:59:47.593366] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-16T17:59:47.593719] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-16T17:59:47.593778] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-16T17:59:47.943351] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-16T17:59:47.984810] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:59:47.993866] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T17:59:48.742791] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-16T17:59:49.023483] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T17:59:49.542865] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-16T17:59:50.342803] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-16T17:59:50.510780] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-16T17:59:50.517522] [INFO ] [REMOTE ] CHD: Full fetch complete (74850 records). [2025-10-16T17:59:50.517784] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-16T17:59:50.653441] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T17:59:50.933903] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-16T17:59:50.933998] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-16T17:59:50.935001] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-16T17:59:50.935083] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-16T17:59:50.936491] [DEBUG] [LOCAL ] CHD: Trimmed 74850 records to 52698 (keeping 200 days of data) [2025-10-16T17:59:51.149496] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-16T17:59:51.259131] [DEBUG] [LOCAL ] CHD: Primary data saved (52698 records). [2025-10-16T17:59:51.259282] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-16T17:59:51.259764] [INFO ] [MAIN ] Update Progress: 434/2369 symbols completed. CHD took 29.1s. Estimated remaining: 4h 26m 35s. Rate: 7.3 symbols/min [2025-10-16T17:59:51.451007] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:59:51.488475] [DEBUG] [LOCAL ] CHH: Loaded 32425 existing records from primary storage. [2025-10-16T17:59:51.488868] [INFO ] [MAIN ] CHH: Loaded 32425 existing records. [2025-10-16T17:59:51.572254] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-16T17:59:51.607999] [INFO ] [REMOTE ] CHCT: Full fetch complete (34754 records). [2025-10-16T17:59:51.618761] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-16T17:59:51.770702] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:59:51.791571] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-16T17:59:51.791732] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-16T17:59:51.797468] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-16T17:59:51.797572] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-16T17:59:51.965491] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-16T17:59:52.395420] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-16T17:59:52.403009] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-16T17:59:52.407192] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-16T17:59:52.407286] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-16T17:59:52.479534] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T17:59:52.500360] [DEBUG] [LOCAL ] CHCT: Trimmed 34754 records to 24391 (keeping 200 days of data) [2025-10-16T17:59:52.500085] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:59:52.652324] [DEBUG] [LOCAL ] CHCT: Primary data saved (24391 records). [2025-10-16T17:59:52.652459] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-16T17:59:52.652538] [INFO ] [MAIN ] Update Progress: 435/2369 symbols completed. CHCT took 33.9s. Estimated remaining: 4h 25m 56s. Rate: 7.3 symbols/min [2025-10-16T17:59:52.747988] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-16T17:59:52.819573] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:59:52.819863] [DEBUG] [LOCAL ] CHMI: No existing data file found in primary storage. [2025-10-16T17:59:52.819907] [WARN ] [MAIN ] CHMI: No existing data found, performing full refresh instead. [2025-10-16T17:59:52.820018] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-16T17:59:52.820060] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-16T17:59:52.820100] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-10-16T17:59:52.820131] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-16T17:59:53.162944] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:59:53.542793] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-16T17:59:53.641477] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T17:59:53.760401] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T17:59:54.342806] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-16T17:59:54.576873] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T17:59:55.142815] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-16T17:59:55.942813] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-16T17:59:56.043242] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T17:59:56.093348] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T17:59:56.742828] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-16T17:59:57.278780] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T17:59:57.542859] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-16T17:59:58.204011] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T17:59:58.342831] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-16T17:59:58.773135] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-16T17:59:58.776929] [INFO ] [REMOTE ] CHE: Full fetch complete (20397 records). [2025-10-16T17:59:58.777019] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-16T17:59:59.146686] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-16T17:59:59.146989] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-16T17:59:59.147222] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-16T17:59:59.148632] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-16T17:59:59.159547] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-16T17:59:59.163094] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T17:59:59.168486] [DEBUG] [LOCAL ] CHE: Trimmed 20397 records to 15454 (keeping 200 days of data) [2025-10-16T17:59:59.265063] [DEBUG] [LOCAL ] CHE: Primary data saved (15454 records). [2025-10-16T17:59:59.265206] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-16T17:59:59.265304] [INFO ] [MAIN ] Update Progress: 436/2369 symbols completed. CHE took 31.0s. Estimated remaining: 4h 25m 41s. Rate: 7.3 symbols/min [2025-10-16T17:59:59.430581] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:59:59.430796] [DEBUG] [LOCAL ] CHN: No existing data file found in primary storage. [2025-10-16T17:59:59.430840] [WARN ] [MAIN ] CHN: No existing data found, performing full refresh instead. [2025-10-16T17:59:59.430949] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-16T17:59:59.430993] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-16T17:59:59.431075] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-10-16T17:59:59.431128] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-16T17:59:59.784455] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:59:59.942788] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-16T18:00:00.686979] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T18:00:00.742888] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-16T18:00:00.958199] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T18:00:01.542810] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-16T18:00:01.671310] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-16T18:00:02.342836] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-16T18:00:03.142834] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-16T18:00:03.405277] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T18:00:03.602210] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-16T18:00:03.942846] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-16T18:00:04.566572] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:00:04.742879] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-16T18:00:05.542797] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-16T18:00:05.740320] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T18:00:06.039294] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T18:00:06.180392] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-16T18:00:06.342843] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-16T18:00:07.142878] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-16T18:00:07.737988] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T18:00:07.749100] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-16T18:00:07.942809] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-16T18:00:08.742843] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-16T18:00:09.542868] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-16T18:00:09.697867] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T18:00:09.766529] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T18:00:10.342812] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-16T18:00:11.058412] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T18:00:11.142807] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-16T18:00:11.942788] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-16T18:00:12.058479] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-16T18:00:12.293679] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-16T18:00:12.742815] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-16T18:00:13.542823] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-16T18:00:13.961274] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-16T18:00:14.342771] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-16T18:00:14.411566] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T18:00:14.529017] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T18:00:14.710725] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-16T18:00:15.142807] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-16T18:00:15.942883] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-16T18:00:16.742825] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-16T18:00:17.072422] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T18:00:17.102213] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T18:00:17.542817] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-16T18:00:17.938840] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T18:00:18.342821] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-16T18:00:19.053850] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T18:00:19.142773] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-16T18:00:19.942869] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-16T18:00:20.020906] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T18:00:20.457784] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T18:00:20.571397] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T18:00:20.742789] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-16T18:00:21.542826] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-16T18:00:21.826141] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-16T18:00:22.342809] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-16T18:00:22.965300] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T18:00:23.115856] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T18:00:23.122127] [INFO ] [REMOTE ] CHGG: Full fetch complete (70309 records). [2025-10-16T18:00:23.122308] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-16T18:00:23.151429] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-16T18:00:23.547513] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-16T18:00:23.547599] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-16T18:00:23.548469] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-16T18:00:23.548545] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-16T18:00:23.549987] [DEBUG] [LOCAL ] CHGG: Trimmed 70309 records to 48094 (keeping 200 days of data) [2025-10-16T18:00:23.815198] [DEBUG] [LOCAL ] CHGG: Primary data saved (48094 records). [2025-10-16T18:00:23.815330] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-16T18:00:23.816018] [INFO ] [MAIN ] Update Progress: 437/2369 symbols completed. CHGG took 36.6s. Estimated remaining: 4h 26m 45s. Rate: 7.2 symbols/min [2025-10-16T18:00:23.942781] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-16T18:00:24.025315] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T18:00:24.742831] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-16T18:00:25.027102] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T18:00:25.542780] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-16T18:00:25.572969] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T18:00:25.575931] [INFO ] [REMOTE ] CHMI: Full fetch complete (31735 records). [2025-10-16T18:00:25.576008] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-16T18:00:25.576495] [FATAL] [VALIDATOR ] CHMI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:00:25.576576] [FATAL] [MAIN ] CHMI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:00:25.576619] [WARN ] [MAIN ] CHMI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:00:25.576704] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-16T18:00:25.576766] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-10-16T18:00:25.576813] [INFO ] [LOCAL ] CHMI: Starting deletion of derivative data. [2025-10-16T18:00:25.576879] [DEBUG] [LOCAL ] CHMI: No derivative data file found to delete. [2025-10-16T18:00:25.576937] [INFO ] [MAIN ] Update Progress: 438/2369 symbols completed. CHMI took 32.9s. Estimated remaining: 4h 26m 8s. Rate: 7.3 symbols/min [2025-10-16T18:00:26.147395] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-16T18:00:26.148719] [INFO ] [REMOTE ] CHN: Full fetch complete (7555 records). [2025-10-16T18:00:26.148790] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-16T18:00:26.371420] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-16T18:00:26.529433] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-16T18:00:26.529503] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-16T18:00:26.529718] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-16T18:00:26.529778] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-16T18:00:26.530154] [DEBUG] [LOCAL ] CHN: Trimmed 7555 records to 5044 (keeping 200 days of data) [2025-10-16T18:00:26.558537] [DEBUG] [LOCAL ] CHN: Primary data saved (5044 records). [2025-10-16T18:00:26.558613] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-16T18:00:26.558704] [INFO ] [MAIN ] Update Progress: 439/2369 symbols completed. CHN took 27.3s. Estimated remaining: 4h 25m 27s. Rate: 7.3 symbols/min [2025-10-16T18:00:27.757512] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T18:00:27.768315] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-16T18:00:29.184873] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T18:00:29.191704] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-16T18:00:30.565621] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T18:00:30.570816] [INFO ] [REMOTE ] CHH: Full fetch complete (47510 records). [2025-10-16T18:00:30.570940] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-16T18:00:30.959554] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-16T18:00:30.959631] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-16T18:00:30.960363] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-16T18:00:30.960415] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-16T18:00:30.961456] [DEBUG] [LOCAL ] CHH: Trimmed 47510 records to 32689 (keeping 200 days of data) [2025-10-16T18:00:31.168518] [DEBUG] [LOCAL ] CHH: Primary data saved (32689 records). [2025-10-16T18:00:31.168731] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-16T18:00:31.169276] [INFO ] [MAIN ] Update Progress: 440/2369 symbols completed. CHH took 39.9s. Estimated remaining: 4h 25m 3s. Rate: 7.3 symbols/min [2025-10-16T18:00:31.718511] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:00:31.819009] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:00:31.889230] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:00:31.889595] [DEBUG] [LOCAL ] CHT: No existing data file found in primary storage. [2025-10-16T18:00:31.894242] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:00:31.890025] [WARN ] [MAIN ] CHT: No existing data found, performing full refresh instead. [2025-10-16T18:00:31.895603] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-16T18:00:31.896204] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-16T18:00:31.896552] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-16T18:00:31.896676] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-16T18:00:32.188031] [DEBUG] [LOCAL ] CHPT: Loaded 47661 existing records from primary storage. [2025-10-16T18:00:32.230217] [INFO ] [MAIN ] CHPT: Loaded 47661 existing records. [2025-10-16T18:00:32.291437] [DEBUG] [LOCAL ] CHWY: Loaded 53655 existing records from primary storage. [2025-10-16T18:00:32.301903] [INFO ] [MAIN ] CHWY: Loaded 53655 existing records. [2025-10-16T18:00:32.303015] [DEBUG] [LOCAL ] CI: Loaded 49737 existing records from primary storage. [2025-10-16T18:00:32.362545] [INFO ] [MAIN ] CI: Loaded 49737 existing records. [2025-10-16T18:00:32.643460] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:00:32.709766] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-16T18:00:32.928398] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:00:32.896872] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:00:32.942304] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-16T18:00:32.943790] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-16T18:00:32.959039] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-16T18:00:32.963496] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-16T18:00:32.963377] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:00:32.963763] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-16T18:00:32.963807] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-16T18:00:32.964231] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-16T18:00:32.964314] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-16T18:00:32.969658] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-16T18:00:32.977313] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-16T18:00:32.977413] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-16T18:00:33.023806] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-16T18:00:33.988181] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:00:34.011785] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-16T18:00:34.000786] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-16T18:00:34.069180] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-16T18:00:34.160040] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:00:34.139443] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:00:34.161110] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-16T18:00:34.161564] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-16T18:00:34.910227] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T18:00:34.913968] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-16T18:00:35.970158] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T18:00:35.974880] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-16T18:00:36.006217] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-16T18:00:36.018768] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-16T18:00:36.055519] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-16T18:00:36.066974] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-16T18:00:36.297426] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-16T18:00:36.309130] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-16T18:00:37.102283] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T18:00:37.106952] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-16T18:00:37.715007] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T18:00:37.725938] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-16T18:00:37.831553] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T18:00:37.876624] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T18:00:38.051400] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T18:00:38.342812] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-16T18:00:39.102556] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T18:00:39.142773] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-16T18:00:39.937385] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T18:00:39.946423] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-16T18:00:40.742786] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-16T18:00:40.955551] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T18:00:41.542783] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-16T18:00:41.804255] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T18:00:42.131413] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-16T18:00:42.342793] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-16T18:00:43.142807] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-16T18:00:43.195306] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T18:00:43.942776] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-16T18:00:44.344481] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T18:00:44.344052] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T18:00:44.742807] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-16T18:00:45.542803] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-16T18:00:45.692954] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T18:00:46.342784] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-16T18:00:46.545544] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-16T18:00:46.885245] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-16T18:00:47.142833] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-16T18:00:47.942871] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-16T18:00:48.721743] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-16T18:00:48.742787] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-16T18:00:49.020572] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T18:00:49.542809] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-16T18:00:49.932871] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-16T18:00:50.342810] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-16T18:00:50.708899] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T18:00:51.142814] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-16T18:00:51.165443] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T18:00:51.585399] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-16T18:00:51.942825] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-16T18:00:52.755162] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-16T18:00:52.757699] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T18:00:52.958501] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T18:00:53.542815] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-16T18:00:54.342808] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-16T18:00:54.880294] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-16T18:00:55.142776] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-16T18:00:55.152333] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T18:00:55.155102] [INFO ] [REMOTE ] CHT: Full fetch complete (27630 records). [2025-10-16T18:00:55.155180] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-16T18:00:55.537894] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-16T18:00:55.538024] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-16T18:00:55.538515] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-16T18:00:55.538640] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-16T18:00:55.551016] [DEBUG] [LOCAL ] CHT: Trimmed 27630 records to 19654 (keeping 200 days of data) [2025-10-16T18:00:55.573552] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-16T18:00:55.698478] [DEBUG] [LOCAL ] CHT: Primary data saved (19654 records). [2025-10-16T18:00:55.698629] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-16T18:00:55.698742] [INFO ] [MAIN ] Update Progress: 441/2369 symbols completed. CHT took 24.5s. Estimated remaining: 4h 26m 6s. Rate: 7.2 symbols/min [2025-10-16T18:00:55.869246] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:00:55.869473] [DEBUG] [LOCAL ] CIA: No existing data file found in primary storage. [2025-10-16T18:00:55.869536] [WARN ] [MAIN ] CIA: No existing data found, performing full refresh instead. [2025-10-16T18:00:55.869676] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-16T18:00:55.869732] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-16T18:00:55.869781] [DEBUG] [LOCAL ] CIA: No primary data file found to delete. [2025-10-16T18:00:55.869816] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-16T18:00:55.948034] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-16T18:00:56.227398] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:00:56.742908] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-16T18:00:57.098086] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-16T18:00:57.542853] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-16T18:00:57.689022] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T18:00:58.350416] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-16T18:00:58.358737] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-16T18:00:59.142793] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-16T18:00:59.205131] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T18:00:59.942820] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-16T18:01:00.754254] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-16T18:01:00.760403] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-16T18:01:01.329306] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-16T18:01:01.336780] [INFO ] [REMOTE ] CHWY: Full fetch complete (77778 records). [2025-10-16T18:01:01.336957] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-16T18:01:01.559539] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-16T18:01:01.793139] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-16T18:01:01.793461] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-16T18:01:01.804404] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-16T18:01:01.804721] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-16T18:01:01.806801] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T18:01:01.812009] [DEBUG] [LOCAL ] CHWY: Trimmed 77778 records to 54045 (keeping 200 days of data) [2025-10-16T18:01:01.936067] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-16T18:01:02.175989] [DEBUG] [LOCAL ] CHWY: Primary data saved (54045 records). [2025-10-16T18:01:02.176126] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-16T18:01:02.176205] [INFO ] [MAIN ] Update Progress: 442/2369 symbols completed. CHWY took 31.0s. Estimated remaining: 4h 25m 50s. Rate: 7.2 symbols/min [2025-10-16T18:01:02.340801] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:01:02.342788] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-16T18:01:02.371772] [DEBUG] [LOCAL ] CIB: Loaded 30426 existing records from primary storage. [2025-10-16T18:01:02.372071] [INFO ] [MAIN ] CIB: Loaded 30426 existing records. [2025-10-16T18:01:02.548480] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:01:02.548639] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-16T18:01:02.548726] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-16T18:01:02.549262] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-16T18:01:02.549320] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-16T18:01:02.910853] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:01:03.142821] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-16T18:01:03.482936] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-16T18:01:03.942810] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-16T18:01:04.080553] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T18:01:04.131401] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T18:01:04.742787] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-16T18:01:04.848603] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T18:01:05.542820] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-16T18:01:06.175052] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T18:01:06.191755] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-16T18:01:06.342840] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-16T18:01:07.142875] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-16T18:01:07.942819] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-16T18:01:08.070540] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T18:01:08.259899] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T18:01:08.729535] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T18:01:08.735827] [INFO ] [REMOTE ] CI: Full fetch complete (72145 records). [2025-10-16T18:01:08.735983] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-16T18:01:08.747966] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-16T18:01:09.130122] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-16T18:01:09.130203] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-16T18:01:09.131039] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-16T18:01:09.131105] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-16T18:01:09.132483] [DEBUG] [LOCAL ] CI: Trimmed 72145 records to 50066 (keeping 200 days of data) [2025-10-16T18:01:09.441180] [DEBUG] [LOCAL ] CI: Primary data saved (50066 records). [2025-10-16T18:01:09.441327] [INFO ] [MAIN ] CI: Full history saved. [2025-10-16T18:01:09.442103] [INFO ] [MAIN ] Update Progress: 443/2369 symbols completed. CI took 38.3s. Estimated remaining: 4h 25m 37s. Rate: 7.3 symbols/min [2025-10-16T18:01:09.549875] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-16T18:01:09.626316] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:01:09.626603] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-16T18:01:09.626743] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-16T18:01:09.626883] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-16T18:01:09.626962] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-16T18:01:09.634949] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-16T18:01:09.635537] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-16T18:01:09.635935] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-16T18:01:09.997126] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:01:10.342827] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-16T18:01:10.797550] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T18:01:11.142813] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-16T18:01:11.942818] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-16T18:01:12.067274] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T18:01:12.074608] [INFO ] [REMOTE ] CHPT: Full fetch complete (71397 records). [2025-10-16T18:01:12.074862] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-16T18:01:12.075803] [FATAL] [VALIDATOR ] CHPT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:01:12.075928] [FATAL] [MAIN ] CHPT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:01:12.076001] [WARN ] [MAIN ] CHPT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:01:12.076058] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-16T18:01:12.076128] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-16T18:01:12.076176] [INFO ] [LOCAL ] CHPT: Starting deletion of derivative data. [2025-10-16T18:01:12.076379] [DEBUG] [LOCAL ] CHPT: Deleted derivative data file. [2025-10-16T18:01:12.077253] [INFO ] [MAIN ] Update Progress: 444/2369 symbols completed. CHPT took 40.9s. Estimated remaining: 4h 25m 5s. Rate: 7.3 symbols/min [2025-10-16T18:01:12.247249] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:01:12.297810] [DEBUG] [LOCAL ] CIEN: Loaded 52151 existing records from primary storage. [2025-10-16T18:01:12.298162] [INFO ] [MAIN ] CIEN: Loaded 52151 existing records. [2025-10-16T18:01:12.477558] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:01:12.477939] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-16T18:01:12.478021] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-16T18:01:12.478957] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-16T18:01:12.479017] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-16T18:01:12.680022] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T18:01:12.750362] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-16T18:01:12.937766] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T18:01:12.945761] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:01:13.414140] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-16T18:01:13.542837] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-16T18:01:14.051574] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-16T18:01:14.342874] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-16T18:01:15.142798] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-16T18:01:15.398705] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T18:01:15.450709] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-16T18:01:15.942799] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-16T18:01:16.742858] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-16T18:01:16.968289] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T18:01:17.210599] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-16T18:01:17.542847] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-16T18:01:18.342888] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-16T18:01:19.143690] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-16T18:01:19.146831] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T18:01:19.187147] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T18:01:19.607577] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-16T18:01:19.942866] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-16T18:01:20.742796] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-16T18:01:20.828473] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T18:01:20.830456] [INFO ] [REMOTE ] CIA: Full fetch complete (23418 records). [2025-10-16T18:01:20.830524] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-16T18:01:21.188324] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-16T18:01:21.188397] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-16T18:01:21.188851] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-16T18:01:21.188942] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-16T18:01:21.189524] [DEBUG] [LOCAL ] CIA: Trimmed 23418 records to 16720 (keeping 200 days of data) [2025-10-16T18:01:21.284163] [DEBUG] [LOCAL ] CIA: Primary data saved (16720 records). [2025-10-16T18:01:21.284297] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-16T18:01:21.284385] [INFO ] [MAIN ] Update Progress: 445/2369 symbols completed. CIA took 25.6s. Estimated remaining: 4h 25m 0s. Rate: 7.3 symbols/min [2025-10-16T18:01:21.452422] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:01:21.458164] [DEBUG] [LOCAL ] CIF: Loaded 4024 existing records from primary storage. [2025-10-16T18:01:21.458337] [INFO ] [MAIN ] CIF: Loaded 4024 existing records. [2025-10-16T18:01:21.547942] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-16T18:01:21.643370] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:01:21.643537] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-16T18:01:21.643583] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-16T18:01:21.643795] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-16T18:01:21.643852] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-16T18:01:22.012256] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:01:22.342848] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-16T18:01:22.785840] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-16T18:01:22.818335] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-16T18:01:22.982388] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T18:01:23.142846] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-16T18:01:23.942846] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-16T18:01:24.433030] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T18:01:24.448258] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-16T18:01:24.742817] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-16T18:01:25.542832] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-16T18:01:25.811209] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T18:01:26.254677] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T18:01:26.342775] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-16T18:01:27.142866] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-16T18:01:27.942845] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-16T18:01:28.144831] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-16T18:01:28.206005] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T18:01:28.521083] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T18:01:28.742879] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-16T18:01:29.253529] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-16T18:01:29.542876] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-16T18:01:30.342907] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-16T18:01:31.142830] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-16T18:01:31.283164] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T18:01:31.460721] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T18:01:31.886420] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T18:01:31.942830] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-16T18:01:32.742838] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-16T18:01:33.477121] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T18:01:33.542796] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-16T18:01:33.637035] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T18:01:34.028365] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-16T18:01:34.342862] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-16T18:01:35.142884] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-16T18:01:35.630563] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-16T18:01:35.942838] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-16T18:01:35.985498] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T18:01:36.462549] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-16T18:01:36.463272] [INFO ] [REMOTE ] CICB: Full fetch complete (1984 records). [2025-10-16T18:01:36.463341] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-16T18:01:36.635638] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-16T18:01:36.635865] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:01:36.635948] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:01:36.636036] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-16T18:01:36.636131] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-16T18:01:36.636195] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-16T18:01:36.636254] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-16T18:01:36.636329] [INFO ] [MAIN ] Update Progress: 446/2369 symbols completed. CICB took 27.2s. Estimated remaining: 4h 25m 23s. Rate: 7.2 symbols/min [2025-10-16T18:01:36.747908] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-16T18:01:36.821489] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:01:36.861756] [DEBUG] [LOCAL ] CIG: Loaded 44317 existing records from primary storage. [2025-10-16T18:01:36.862086] [INFO ] [MAIN ] CIG: Loaded 44317 existing records. [2025-10-16T18:01:37.035903] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:01:37.036132] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-16T18:01:37.036186] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-16T18:01:37.036960] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-16T18:01:37.037044] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-16T18:01:37.414550] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:01:37.542767] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-16T18:01:38.325217] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T18:01:38.342767] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-16T18:01:38.509795] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-16T18:01:39.142856] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-16T18:01:39.662164] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-16T18:01:39.942842] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-16T18:01:40.103574] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T18:01:40.742824] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-16T18:01:41.097928] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-16T18:01:41.102075] [INFO ] [REMOTE ] CIB: Full fetch complete (45131 records). [2025-10-16T18:01:41.102174] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-16T18:01:41.476495] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-16T18:01:41.476579] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-16T18:01:41.477433] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-16T18:01:41.477496] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-16T18:01:41.478451] [DEBUG] [LOCAL ] CIB: Trimmed 45131 records to 30684 (keeping 200 days of data) [2025-10-16T18:01:41.563783] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-16T18:01:41.656916] [DEBUG] [LOCAL ] CIB: Primary data saved (30684 records). [2025-10-16T18:01:41.657048] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-16T18:01:41.657128] [INFO ] [MAIN ] Update Progress: 447/2369 symbols completed. CIB took 39.5s. Estimated remaining: 4h 25m 0s. Rate: 7.3 symbols/min [2025-10-16T18:01:41.827146] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:01:41.842344] [DEBUG] [LOCAL ] CII: Loaded 15321 existing records from primary storage. [2025-10-16T18:01:41.842578] [INFO ] [MAIN ] CII: Loaded 15321 existing records. [2025-10-16T18:01:42.019680] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:01:42.019922] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-16T18:01:42.019977] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-16T18:01:42.020301] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-16T18:01:42.020357] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-16T18:01:42.300906] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T18:01:42.347926] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-16T18:01:42.383469] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:01:42.406577] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T18:01:43.142887] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-16T18:01:43.942793] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-16T18:01:44.234537] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T18:01:44.269536] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T18:01:44.742827] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-16T18:01:45.097905] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T18:01:45.511459] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-16T18:01:45.542775] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-16T18:01:46.342803] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-16T18:01:46.394521] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-16T18:01:46.844304] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-16T18:01:47.142810] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-16T18:01:47.603401] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T18:01:47.942829] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-16T18:01:48.583534] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T18:01:48.742791] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-16T18:01:49.297871] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-16T18:01:49.542811] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-16T18:01:50.342878] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-16T18:01:51.142857] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-16T18:01:51.240256] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T18:01:51.405557] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-16T18:01:51.942831] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-16T18:01:52.706614] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T18:01:52.742817] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-16T18:01:53.093505] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T18:01:53.542779] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-16T18:01:54.342798] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-16T18:01:54.435494] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T18:01:54.591215] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T18:01:55.073407] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T18:01:55.074383] [INFO ] [REMOTE ] CIF: Full fetch complete (6594 records). [2025-10-16T18:01:55.074471] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-16T18:01:55.148005] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-16T18:01:55.455472] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-16T18:01:55.455553] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-16T18:01:55.455772] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-16T18:01:55.455836] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-16T18:01:55.456306] [DEBUG] [LOCAL ] CIF: Trimmed 6594 records to 4057 (keeping 200 days of data) [2025-10-16T18:01:55.482072] [DEBUG] [LOCAL ] CIF: Primary data saved (4057 records). [2025-10-16T18:01:55.482212] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-16T18:01:55.482293] [INFO ] [MAIN ] Update Progress: 448/2369 symbols completed. CIF took 34.2s. Estimated remaining: 4h 25m 16s. Rate: 7.2 symbols/min [2025-10-16T18:01:55.675759] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:01:55.716626] [DEBUG] [LOCAL ] CIM: Loaded 37688 existing records from primary storage. [2025-10-16T18:01:55.717000] [INFO ] [MAIN ] CIM: Loaded 37688 existing records. [2025-10-16T18:01:55.915324] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:01:55.915580] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-16T18:01:55.915630] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-16T18:01:55.916438] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-16T18:01:55.916501] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-16T18:01:55.951718] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-16T18:01:56.272274] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:01:56.742839] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-16T18:01:56.884795] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T18:01:57.056974] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-16T18:01:57.064088] [INFO ] [REMOTE ] CIEN: Full fetch complete (75821 records). [2025-10-16T18:01:57.064263] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-16T18:01:57.460108] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-16T18:01:57.460201] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-16T18:01:57.461180] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-16T18:01:57.461251] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-16T18:01:57.462749] [DEBUG] [LOCAL ] CIEN: Trimmed 75821 records to 52535 (keeping 200 days of data) [2025-10-16T18:01:57.545682] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-16T18:01:57.771511] [DEBUG] [LOCAL ] CIEN: Primary data saved (52535 records). [2025-10-16T18:01:57.771670] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-16T18:01:57.772521] [INFO ] [MAIN ] Update Progress: 449/2369 symbols completed. CIEN took 45.7s. Estimated remaining: 4h 24m 42s. Rate: 7.3 symbols/min [2025-10-16T18:01:57.951329] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:01:57.977046] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T18:01:57.987802] [DEBUG] [LOCAL ] CIMN: Loaded 2756 existing records from primary storage. [2025-10-16T18:01:57.988439] [INFO ] [MAIN ] CIMN: Loaded 2756 existing records. [2025-10-16T18:01:58.166660] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:01:58.166932] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-16T18:01:58.166993] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-16T18:01:58.167263] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-16T18:01:58.167325] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-16T18:01:58.349312] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-16T18:01:58.538713] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:01:58.559755] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T18:01:59.142865] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-16T18:01:59.685885] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-16T18:01:59.724822] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T18:01:59.942858] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-16T18:02:00.742865] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-16T18:02:01.542830] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-16T18:02:01.646622] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T18:02:02.007200] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T18:02:02.023141] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T18:02:02.342821] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-16T18:02:03.142848] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-16T18:02:03.747967] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-16T18:02:03.942786] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-16T18:02:04.154622] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T18:02:04.235735] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-16T18:02:04.742812] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-16T18:02:05.278280] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-16T18:02:05.542890] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-16T18:02:06.342834] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-16T18:02:07.114790] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T18:02:07.142799] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-16T18:02:07.360260] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T18:02:07.942812] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-16T18:02:08.573372] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T18:02:08.742863] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-16T18:02:09.437291] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T18:02:09.543013] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-16T18:02:10.349275] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-16T18:02:10.373278] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T18:02:10.413914] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-16T18:02:11.142852] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-16T18:02:11.785497] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-16T18:02:11.942818] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-16T18:02:12.067588] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T18:02:12.422086] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-16T18:02:12.742846] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-16T18:02:13.542849] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-16T18:02:14.318010] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T18:02:14.342847] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-16T18:02:15.142823] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-16T18:02:15.314658] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-16T18:02:15.321163] [INFO ] [REMOTE ] CIG: Full fetch complete (61897 records). [2025-10-16T18:02:15.321353] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-16T18:02:15.322293] [FATAL] [VALIDATOR ] CIG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:02:15.322403] [FATAL] [MAIN ] CIG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:02:15.322448] [WARN ] [MAIN ] CIG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:02:15.322540] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-16T18:02:15.322610] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-16T18:02:15.322677] [INFO ] [LOCAL ] CIG: Starting deletion of derivative data. [2025-10-16T18:02:15.322925] [DEBUG] [LOCAL ] CIG: Deleted derivative data file. [2025-10-16T18:02:15.323590] [INFO ] [MAIN ] Update Progress: 450/2369 symbols completed. CIG took 38.7s. Estimated remaining: 4h 25m 13s. Rate: 7.2 symbols/min [2025-10-16T18:02:15.519574] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:02:15.519759] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-16T18:02:15.519803] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-16T18:02:15.519934] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-16T18:02:15.519994] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-16T18:02:15.520041] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-16T18:02:15.520074] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-16T18:02:15.558441] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-16T18:02:15.860611] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T18:02:15.932260] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:02:15.942769] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-16T18:02:16.742849] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-16T18:02:16.792210] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T18:02:17.542814] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-16T18:02:18.168132] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T18:02:18.201538] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T18:02:18.342885] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-16T18:02:19.142836] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-16T18:02:19.798720] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T18:02:19.942821] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-16T18:02:20.043156] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T18:02:20.272281] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-16T18:02:20.742873] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-16T18:02:21.174474] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T18:02:21.542863] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-16T18:02:22.342824] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-16T18:02:22.805364] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-16T18:02:23.117725] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T18:02:23.142829] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-16T18:02:23.942862] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-16T18:02:24.537593] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T18:02:24.545586] [INFO ] [REMOTE ] CIM: Full fetch complete (55049 records). [2025-10-16T18:02:24.545798] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-16T18:02:24.673402] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T18:02:24.770123] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-16T18:02:25.005915] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-16T18:02:25.006002] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-16T18:02:25.006728] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-16T18:02:25.006982] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-16T18:02:25.008178] [DEBUG] [LOCAL ] CIM: Trimmed 55049 records to 37990 (keeping 200 days of data) [2025-10-16T18:02:25.279025] [DEBUG] [LOCAL ] CIM: Primary data saved (37990 records). [2025-10-16T18:02:25.279197] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-16T18:02:25.279321] [INFO ] [MAIN ] Update Progress: 451/2369 symbols completed. CIM took 29.8s. Estimated remaining: 4h 25m 12s. Rate: 7.2 symbols/min [2025-10-16T18:02:25.394545] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T18:02:25.470506] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:02:25.470736] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-16T18:02:25.470783] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-16T18:02:25.470897] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-16T18:02:25.470937] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-16T18:02:25.470978] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-16T18:02:25.471009] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-16T18:02:25.547951] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-16T18:02:25.840121] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:02:26.342820] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-16T18:02:26.698268] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-16T18:02:26.701086] [INFO ] [REMOTE ] CII: Full fetch complete (22921 records). [2025-10-16T18:02:26.701165] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-16T18:02:27.001694] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T18:02:27.003064] [INFO ] [REMOTE ] CIMN: Full fetch complete (3933 records). [2025-10-16T18:02:27.003507] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-16T18:02:27.152179] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-16T18:02:27.193943] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-16T18:02:27.215179] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-16T18:02:27.224923] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-16T18:02:27.227783] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-16T18:02:27.254630] [DEBUG] [LOCAL ] CII: Trimmed 22921 records to 15443 (keeping 200 days of data) [2025-10-16T18:02:27.609875] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-16T18:02:27.609991] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-16T18:02:27.613563] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-16T18:02:27.616886] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-16T18:02:27.620255] [DEBUG] [LOCAL ] CIMN: Trimmed 3933 records to 2780 (keeping 200 days of data) [2025-10-16T18:02:27.649106] [DEBUG] [LOCAL ] CII: Primary data saved (15443 records). [2025-10-16T18:02:27.655050] [INFO ] [MAIN ] CII: Full history saved. [2025-10-16T18:02:27.656355] [INFO ] [MAIN ] Update Progress: 452/2369 symbols completed. CII took 46.0s. Estimated remaining: 4h 24m 39s. Rate: 7.2 symbols/min [2025-10-16T18:02:27.656233] [DEBUG] [LOCAL ] CIMN: Primary data saved (2780 records). [2025-10-16T18:02:27.699947] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-16T18:02:27.725284] [INFO ] [MAIN ] Update Progress: 453/2369 symbols completed. CIMN took 30.0s. Estimated remaining: 4h 23m 56s. Rate: 7.3 symbols/min [2025-10-16T18:02:27.848065] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T18:02:27.944774] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-16T18:02:28.122528] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:02:28.128085] [DEBUG] [LOCAL ] CINT: No existing data file found in primary storage. [2025-10-16T18:02:28.138762] [WARN ] [MAIN ] CINT: No existing data found, performing full refresh instead. [2025-10-16T18:02:28.206478] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:02:28.207103] [DEBUG] [LOCAL ] CIO: No existing data file found in primary storage. [2025-10-16T18:02:28.207197] [WARN ] [MAIN ] CIO: No existing data found, performing full refresh instead. [2025-10-16T18:02:28.207367] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-16T18:02:28.207421] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-16T18:02:28.207474] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-10-16T18:02:28.207516] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-16T18:02:28.206909] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-16T18:02:28.270025] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-16T18:02:28.283959] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-10-16T18:02:28.284074] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-16T18:02:28.462599] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-16T18:02:28.753174] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-16T18:02:29.009786] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:02:29.117010] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:02:29.120557] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:02:29.121146] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-16T18:02:29.121248] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:02:29.121301] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-16T18:02:29.121357] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:02:29.121424] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-16T18:02:29.121483] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-16T18:02:29.121534] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-16T18:02:29.121600] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-16T18:02:29.121687] [INFO ] [MAIN ] Update Progress: 454/2369 symbols completed. CIMP took 3.8s. Estimated remaining: 4h 23m 18s. Rate: 7.3 symbols/min [2025-10-16T18:02:29.306725] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:02:29.306944] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-10-16T18:02:29.306982] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-10-16T18:02:29.307104] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-16T18:02:29.307156] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-16T18:02:29.307238] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-16T18:02:29.307306] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-16T18:02:29.553331] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-16T18:02:29.673203] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:02:30.024602] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T18:02:30.343037] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-16T18:02:31.142805] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-16T18:02:31.377514] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T18:02:31.942864] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-16T18:02:32.494881] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T18:02:32.708136] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T18:02:32.742825] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-16T18:02:33.542834] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-16T18:02:33.800980] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-16T18:02:34.327764] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T18:02:34.342778] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-16T18:02:35.142808] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-16T18:02:35.237965] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T18:02:35.942838] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-16T18:02:36.206022] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T18:02:36.742852] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-16T18:02:36.896675] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T18:02:37.385319] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T18:02:37.542864] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-16T18:02:38.300936] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T18:02:38.342831] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-16T18:02:39.142840] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-16T18:02:39.408826] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T18:02:39.942830] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-16T18:02:40.180546] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T18:02:40.742822] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-16T18:02:41.022034] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T18:02:41.542827] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-16T18:02:41.764073] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T18:02:42.342814] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-16T18:02:43.062142] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T18:02:43.142792] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-16T18:02:43.285359] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T18:02:43.942825] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-16T18:02:43.978379] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T18:02:44.742850] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-16T18:02:45.291920] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T18:02:45.542813] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-16T18:02:45.740035] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T18:02:46.022155] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-16T18:02:46.023410] [INFO ] [REMOTE ] CIMO: Full fetch complete (4783 records). [2025-10-16T18:02:46.023500] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-16T18:02:46.024135] [FATAL] [VALIDATOR ] CIMO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:02:46.024244] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:02:46.024303] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:02:46.024372] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-16T18:02:46.024456] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-16T18:02:46.024524] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-16T18:02:46.024587] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-16T18:02:46.024722] [INFO ] [MAIN ] Update Progress: 455/2369 symbols completed. CIMO took 30.7s. Estimated remaining: 4h 23m 47s. Rate: 7.3 symbols/min [2025-10-16T18:02:46.224018] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:02:46.277227] [DEBUG] [LOCAL ] CIVI: Loaded 52699 existing records from primary storage. [2025-10-16T18:02:46.277549] [INFO ] [MAIN ] CIVI: Loaded 52699 existing records. [2025-10-16T18:02:46.347957] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-16T18:02:46.465963] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:02:46.466179] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-16T18:02:46.466228] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-16T18:02:46.467064] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-16T18:02:46.467132] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-16T18:02:46.837231] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:02:47.142842] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-16T18:02:47.184934] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T18:02:47.942815] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-16T18:02:48.742780] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-16T18:02:48.791183] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T18:02:49.152191] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-16T18:02:49.542855] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-16T18:02:49.843025] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T18:02:50.342850] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-16T18:02:51.039637] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T18:02:51.142828] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-16T18:02:51.785813] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T18:02:51.942805] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-16T18:02:52.242213] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T18:02:52.742858] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-16T18:02:53.449805] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T18:02:53.542836] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-16T18:02:53.874324] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T18:02:54.342837] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-16T18:02:54.441865] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-16T18:02:55.142831] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-16T18:02:55.777013] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T18:02:55.942798] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-16T18:02:56.238456] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T18:02:56.742904] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-16T18:02:57.126800] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-16T18:02:57.512942] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T18:02:57.542767] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-16T18:02:58.342804] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-16T18:02:58.723049] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T18:02:59.142845] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-16T18:02:59.688029] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-16T18:02:59.692384] [INFO ] [REMOTE ] CINT: Full fetch complete (28124 records). [2025-10-16T18:02:59.692477] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-16T18:02:59.946681] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-16T18:03:00.079418] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-16T18:03:00.079494] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-16T18:03:00.080041] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-16T18:03:00.080103] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-16T18:03:00.080850] [DEBUG] [LOCAL ] CINT: Trimmed 28124 records to 20157 (keeping 200 days of data) [2025-10-16T18:03:00.197676] [DEBUG] [LOCAL ] CINT: Primary data saved (20157 records). [2025-10-16T18:03:00.197823] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-16T18:03:00.197898] [INFO ] [MAIN ] Update Progress: 456/2369 symbols completed. CINT took 32.5s. Estimated remaining: 4h 24m 3s. Rate: 7.2 symbols/min [2025-10-16T18:03:00.373435] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:03:00.373768] [DEBUG] [LOCAL ] CL: No existing data file found in primary storage. [2025-10-16T18:03:00.373872] [WARN ] [MAIN ] CL: No existing data found, performing full refresh instead. [2025-10-16T18:03:00.374013] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-16T18:03:00.374127] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-16T18:03:00.374195] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-10-16T18:03:00.374231] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-16T18:03:00.534178] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T18:03:00.748071] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-16T18:03:00.780757] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:03:01.542853] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-16T18:03:02.179991] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T18:03:02.183559] [INFO ] [REMOTE ] CIO: Full fetch complete (29388 records). [2025-10-16T18:03:02.183671] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-16T18:03:02.184158] [FATAL] [VALIDATOR ] CIO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:03:02.184240] [FATAL] [MAIN ] CIO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:03:02.184282] [WARN ] [MAIN ] CIO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:03:02.184325] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-16T18:03:02.184379] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-10-16T18:03:02.184414] [INFO ] [LOCAL ] CIO: Starting deletion of derivative data. [2025-10-16T18:03:02.184452] [DEBUG] [LOCAL ] CIO: No derivative data file found to delete. [2025-10-16T18:03:02.184503] [INFO ] [MAIN ] Update Progress: 457/2369 symbols completed. CIO took 34.4s. Estimated remaining: 4h 23m 29s. Rate: 7.3 symbols/min [2025-10-16T18:03:02.350273] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-16T18:03:02.379981] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:03:02.413199] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-16T18:03:02.453634] [DEBUG] [LOCAL ] CLB: Loaded 33430 existing records from primary storage. [2025-10-16T18:03:02.454010] [INFO ] [MAIN ] CLB: Loaded 33430 existing records. [2025-10-16T18:03:02.647516] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:03:02.648639] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T18:03:02.648909] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-16T18:03:02.652486] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-16T18:03:02.652718] [INFO ] [REMOTE ] CION: Full fetch complete (40407 records). [2025-10-16T18:03:02.652815] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-16T18:03:02.653500] [FATAL] [VALIDATOR ] CION: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:03:02.653554] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-16T18:03:02.653972] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-16T18:03:02.653902] [FATAL] [MAIN ] CION: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:03:02.687301] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:03:02.725154] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-16T18:03:02.736199] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-16T18:03:02.756869] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-10-16T18:03:02.757073] [DEBUG] [LOCAL ] CION: No derivative data file found to delete. [2025-10-16T18:03:02.757173] [INFO ] [MAIN ] Update Progress: 458/2369 symbols completed. CION took 33.6s. Estimated remaining: 4h 22m 48s. Rate: 7.3 symbols/min [2025-10-16T18:03:03.134024] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:03:03.147846] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-16T18:03:03.230997] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:03:03.236448] [DEBUG] [LOCAL ] CLCO: Loaded 13176 existing records from primary storage. [2025-10-16T18:03:03.236612] [INFO ] [MAIN ] CLCO: Loaded 13176 existing records. [2025-10-16T18:03:03.411621] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:03:03.411901] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-16T18:03:03.411962] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-16T18:03:03.412212] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-16T18:03:03.412252] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-16T18:03:03.767249] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:03:03.942785] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-16T18:03:04.196437] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T18:03:04.738371] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T18:03:04.748961] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-16T18:03:04.888063] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T18:03:05.542860] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-16T18:03:06.236129] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T18:03:06.342884] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-16T18:03:07.127665] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T18:03:07.142766] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-16T18:03:07.506567] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T18:03:07.942839] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-16T18:03:08.742806] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-16T18:03:08.977247] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-16T18:03:09.542802] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-16T18:03:09.839468] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T18:03:09.923432] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-16T18:03:10.342792] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-16T18:03:11.142842] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-16T18:03:11.480392] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-16T18:03:11.942787] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-16T18:03:12.024826] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T18:03:12.128148] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T18:03:12.742810] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-16T18:03:13.460248] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T18:03:13.542782] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-16T18:03:14.342783] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-16T18:03:14.625460] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T18:03:15.142874] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-16T18:03:15.541150] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T18:03:15.611701] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T18:03:15.942832] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-16T18:03:16.314906] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T18:03:16.742818] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-16T18:03:17.542823] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-16T18:03:17.914333] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T18:03:18.205340] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T18:03:18.342829] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-16T18:03:19.058328] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T18:03:19.142789] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-16T18:03:19.877709] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T18:03:19.942848] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-16T18:03:20.391840] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-16T18:03:20.742909] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-16T18:03:21.462414] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T18:03:21.542811] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-16T18:03:22.342846] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-16T18:03:22.374186] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T18:03:22.381193] [INFO ] [REMOTE ] CIVI: Full fetch complete (75998 records). [2025-10-16T18:03:22.381365] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-16T18:03:22.784256] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-16T18:03:22.784365] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-16T18:03:22.785371] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-16T18:03:22.785441] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-16T18:03:22.786937] [DEBUG] [LOCAL ] CIVI: Trimmed 75998 records to 53088 (keeping 200 days of data) [2025-10-16T18:03:23.110108] [DEBUG] [LOCAL ] CIVI: Primary data saved (53088 records). [2025-10-16T18:03:23.110237] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-16T18:03:23.110686] [INFO ] [MAIN ] Update Progress: 459/2369 symbols completed. CIVI took 37.1s. Estimated remaining: 4h 23m 30s. Rate: 7.2 symbols/min [2025-10-16T18:03:23.148108] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-16T18:03:23.283516] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:03:23.308058] [DEBUG] [LOCAL ] CLDT: Loaded 25429 existing records from primary storage. [2025-10-16T18:03:23.308331] [INFO ] [MAIN ] CLDT: Loaded 25429 existing records. [2025-10-16T18:03:23.489370] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:03:23.489608] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-16T18:03:23.489706] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-16T18:03:23.490351] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-16T18:03:23.490461] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-16T18:03:23.643585] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-16T18:03:23.810552] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T18:03:23.941857] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:03:23.942768] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-16T18:03:24.195039] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T18:03:24.742864] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-16T18:03:25.216492] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T18:03:25.542847] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-16T18:03:26.342796] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-16T18:03:26.671503] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-16T18:03:26.737954] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T18:03:27.142805] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-16T18:03:27.254392] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T18:03:27.942837] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-16T18:03:28.747940] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-16T18:03:28.766201] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T18:03:29.438579] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T18:03:29.542839] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-16T18:03:29.710376] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T18:03:30.342873] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-16T18:03:30.958374] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T18:03:30.973105] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-16T18:03:31.142833] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-16T18:03:31.942849] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-16T18:03:32.413718] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-16T18:03:32.420366] [INFO ] [REMOTE ] CLB: Full fetch complete (47140 records). [2025-10-16T18:03:32.420544] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-16T18:03:32.748008] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-16T18:03:32.819610] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-16T18:03:32.826587] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-16T18:03:32.827799] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-16T18:03:32.828072] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T18:03:32.828513] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-16T18:03:32.832932] [DEBUG] [LOCAL ] CLB: Trimmed 47140 records to 33709 (keeping 200 days of data) [2025-10-16T18:03:33.043904] [DEBUG] [LOCAL ] CLB: Primary data saved (33709 records). [2025-10-16T18:03:33.044072] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-16T18:03:33.044169] [INFO ] [MAIN ] Update Progress: 460/2369 symbols completed. CLB took 30.9s. Estimated remaining: 4h 23m 29s. Rate: 7.2 symbols/min [2025-10-16T18:03:33.211593] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:03:33.261484] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-16T18:03:33.261801] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-16T18:03:33.437944] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:03:33.438143] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-16T18:03:33.438190] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-16T18:03:33.439003] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-16T18:03:33.439061] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-16T18:03:33.544608] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-16T18:03:33.748387] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T18:03:33.791092] [INFO ] [REMOTE ] CL: Full fetch complete (77811 records). [2025-10-16T18:03:33.802425] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-16T18:03:33.905576] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:03:34.238673] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-16T18:03:34.238770] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-16T18:03:34.240044] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-16T18:03:34.240112] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-16T18:03:34.241714] [DEBUG] [LOCAL ] CL: Trimmed 77811 records to 54039 (keeping 200 days of data) [2025-10-16T18:03:34.350700] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-16T18:03:34.581509] [DEBUG] [LOCAL ] CL: Primary data saved (54039 records). [2025-10-16T18:03:34.581685] [INFO ] [MAIN ] CL: Full history saved. [2025-10-16T18:03:34.581775] [INFO ] [MAIN ] Update Progress: 461/2369 symbols completed. CL took 34.4s. Estimated remaining: 4h 22m 53s. Rate: 7.3 symbols/min [2025-10-16T18:03:34.754507] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T18:03:34.778715] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:03:34.806740] [DEBUG] [LOCAL ] CLH: Loaded 27821 existing records from primary storage. [2025-10-16T18:03:34.807040] [INFO ] [MAIN ] CLH: Loaded 27821 existing records. [2025-10-16T18:03:34.984872] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:03:34.985090] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-16T18:03:34.985136] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-16T18:03:34.985773] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-16T18:03:34.985837] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-16T18:03:35.157260] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-16T18:03:35.349330] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:03:35.942824] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-16T18:03:36.430381] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-16T18:03:36.457162] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T18:03:36.742818] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-16T18:03:37.355265] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T18:03:37.542793] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-16T18:03:37.845149] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T18:03:38.173225] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-16T18:03:38.342826] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-16T18:03:39.142791] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-16T18:03:39.532492] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T18:03:39.537027] [INFO ] [REMOTE ] CLCO: Full fetch complete (22794 records). [2025-10-16T18:03:39.537126] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-16T18:03:39.537732] [FATAL] [VALIDATOR ] CLCO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:03:39.537829] [FATAL] [MAIN ] CLCO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:03:39.537883] [WARN ] [MAIN ] CLCO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:03:39.537983] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-16T18:03:39.538064] [DEBUG] [LOCAL ] CLCO: No primary data file found to delete. [2025-10-16T18:03:39.538112] [INFO ] [LOCAL ] CLCO: Starting deletion of derivative data. [2025-10-16T18:03:39.538321] [DEBUG] [LOCAL ] CLCO: Deleted derivative data file. [2025-10-16T18:03:39.538426] [INFO ] [MAIN ] Update Progress: 462/2369 symbols completed. CLCO took 36.8s. Estimated remaining: 4h 22m 31s. Rate: 7.3 symbols/min [2025-10-16T18:03:39.720496] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:03:39.720750] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-10-16T18:03:39.720797] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-10-16T18:03:39.720917] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-16T18:03:39.720956] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-16T18:03:39.720997] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-16T18:03:39.721029] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-16T18:03:39.947907] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-16T18:03:40.081717] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:03:40.742824] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-16T18:03:40.984789] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-16T18:03:41.444482] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T18:03:41.543059] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-16T18:03:41.545357] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-16T18:03:42.342845] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-16T18:03:43.142819] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-16T18:03:43.348431] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T18:03:43.759143] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-16T18:03:43.942783] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-16T18:03:44.511888] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T18:03:44.742820] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-16T18:03:44.877119] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T18:03:45.542875] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-16T18:03:46.237301] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T18:03:46.342852] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-16T18:03:46.742418] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T18:03:47.142894] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-16T18:03:47.942788] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-16T18:03:48.333555] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T18:03:48.430586] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-16T18:03:48.648098] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-16T18:03:48.742817] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-16T18:03:49.542958] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-16T18:03:50.344123] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-16T18:03:50.345758] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T18:03:50.761036] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-16T18:03:51.143027] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-16T18:03:51.734263] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T18:03:51.915491] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T18:03:51.942808] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-16T18:03:52.685070] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T18:03:52.742825] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-16T18:03:53.304051] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-16T18:03:53.542852] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-16T18:03:54.342845] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-16T18:03:54.371630] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T18:03:55.142880] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-16T18:03:55.942856] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-16T18:03:56.553312] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-16T18:03:56.618465] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T18:03:56.740337] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T18:03:56.743170] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-16T18:03:57.542830] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-16T18:03:58.018223] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T18:03:58.021982] [INFO ] [REMOTE ] CLDT: Full fetch complete (37426 records). [2025-10-16T18:03:58.022085] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-16T18:03:58.184274] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T18:03:58.359212] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-16T18:03:58.445673] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-16T18:03:58.445761] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-16T18:03:58.446328] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-16T18:03:58.446367] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-16T18:03:58.447174] [DEBUG] [LOCAL ] CLDT: Trimmed 37426 records to 25627 (keeping 200 days of data) [2025-10-16T18:03:58.589222] [DEBUG] [LOCAL ] CLDT: Primary data saved (25627 records). [2025-10-16T18:03:58.589348] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-16T18:03:58.589426] [INFO ] [MAIN ] Update Progress: 463/2369 symbols completed. CLDT took 35.5s. Estimated remaining: 4h 23m 7s. Rate: 7.2 symbols/min [2025-10-16T18:03:58.765444] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:03:58.815536] [DEBUG] [LOCAL ] CLS: Loaded 53583 existing records from primary storage. [2025-10-16T18:03:58.815881] [INFO ] [MAIN ] CLS: Loaded 53583 existing records. [2025-10-16T18:03:58.995692] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:03:58.995944] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-16T18:03:58.995998] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-16T18:03:58.996188] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-16T18:03:58.996244] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-16T18:03:59.147917] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-16T18:03:59.257433] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T18:03:59.369980] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:03:59.942819] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-16T18:04:00.742865] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-16T18:04:00.771384] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T18:04:00.773051] [INFO ] [REMOTE ] CLPR: Full fetch complete (16147 records). [2025-10-16T18:04:00.773123] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-16T18:04:00.773548] [FATAL] [VALIDATOR ] CLPR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:04:00.773634] [FATAL] [MAIN ] CLPR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:04:00.773741] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:04:00.773829] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-16T18:04:00.773906] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-16T18:04:00.773947] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-10-16T18:04:00.773986] [DEBUG] [LOCAL ] CLPR: No derivative data file found to delete. [2025-10-16T18:04:00.774040] [INFO ] [MAIN ] Update Progress: 464/2369 symbols completed. CLPR took 21.2s. Estimated remaining: 4h 22m 34s. Rate: 7.3 symbols/min [2025-10-16T18:04:00.956416] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:04:00.956528] [DEBUG] [LOCAL ] CLVT: No existing data file found in primary storage. [2025-10-16T18:04:00.956566] [WARN ] [MAIN ] CLVT: No existing data found, performing full refresh instead. [2025-10-16T18:04:00.956700] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-16T18:04:00.956753] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-16T18:04:00.956797] [DEBUG] [LOCAL ] CLVT: No primary data file found to delete. [2025-10-16T18:04:00.956832] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-16T18:04:01.344122] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:04:01.542885] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-16T18:04:01.582892] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-16T18:04:02.342896] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-16T18:04:02.679000] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T18:04:03.111920] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T18:04:03.142785] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-16T18:04:03.942835] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-16T18:04:04.299771] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-16T18:04:04.656171] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T18:04:04.742832] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-16T18:04:05.469765] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T18:04:05.542768] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-16T18:04:06.342817] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-16T18:04:07.048426] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-16T18:04:07.142766] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-16T18:04:07.213942] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T18:04:07.942792] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-16T18:04:08.351497] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T18:04:08.742858] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-16T18:04:09.117317] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-16T18:04:09.447198] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T18:04:09.542821] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-16T18:04:10.000515] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T18:04:10.342873] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-16T18:04:10.963480] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T18:04:11.142906] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-16T18:04:11.942788] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-16T18:04:12.399476] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-16T18:04:12.525764] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-16T18:04:12.742868] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-16T18:04:13.542871] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-16T18:04:13.906692] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T18:04:14.345181] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-16T18:04:14.351950] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-16T18:04:14.954719] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T18:04:15.142827] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-16T18:04:15.825130] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T18:04:15.942846] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-16T18:04:16.742824] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-16T18:04:17.242226] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-16T18:04:17.249900] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-16T18:04:17.250110] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-16T18:04:17.548014] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-16T18:04:17.715114] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-16T18:04:17.715237] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-16T18:04:17.716314] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-16T18:04:17.716383] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-16T18:04:17.717972] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 54131 (keeping 200 days of data) [2025-10-16T18:04:17.961174] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-16T18:04:17.966800] [INFO ] [REMOTE ] CLH: Full fetch complete (42109 records). [2025-10-16T18:04:17.967811] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-16T18:04:18.474300] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-16T18:04:18.475004] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-16T18:04:18.476069] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-16T18:04:18.476628] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-16T18:04:18.481991] [DEBUG] [LOCAL ] CLH: Trimmed 42109 records to 28054 (keeping 200 days of data) [2025-10-16T18:04:18.609812] [DEBUG] [LOCAL ] CLF: Primary data saved (54131 records). [2025-10-16T18:04:18.618942] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-16T18:04:18.627226] [INFO ] [MAIN ] Update Progress: 465/2369 symbols completed. CLF took 45.6s. Estimated remaining: 4h 23m 5s. Rate: 7.2 symbols/min [2025-10-16T18:04:18.634972] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-16T18:04:18.705209] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-16T18:04:18.863938] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:04:18.934507] [DEBUG] [LOCAL ] CLW: Loaded 21508 existing records from primary storage. [2025-10-16T18:04:18.936834] [INFO ] [MAIN ] CLW: Loaded 21508 existing records. [2025-10-16T18:04:19.132995] [DEBUG] [LOCAL ] CLH: Primary data saved (28054 records). [2025-10-16T18:04:19.150595] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-16T18:04:19.168680] [INFO ] [MAIN ] Update Progress: 466/2369 symbols completed. CLH took 44.6s. Estimated remaining: 4h 22m 25s. Rate: 7.3 symbols/min [2025-10-16T18:04:19.182564] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:04:19.249772] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-16T18:04:19.256349] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-16T18:04:19.282982] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-16T18:04:19.288416] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-16T18:04:19.455053] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:04:19.838774] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:04:19.839472] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-16T18:04:19.843313] [DEBUG] [LOCAL ] CLX: Loaded 51677 existing records from primary storage. [2025-10-16T18:04:19.841888] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-16T18:04:19.850778] [INFO ] [MAIN ] CLX: Loaded 51677 existing records. [2025-10-16T18:04:19.953767] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-16T18:04:20.035843] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:04:20.036072] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-16T18:04:20.036121] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-16T18:04:20.036303] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-16T18:04:20.036343] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-16T18:04:20.390023] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:04:20.742869] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-16T18:04:20.878021] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-16T18:04:21.247613] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T18:04:21.355843] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T18:04:21.542829] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-16T18:04:22.079715] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T18:04:22.342826] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-16T18:04:22.462337] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T18:04:23.142816] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-16T18:04:23.942803] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-16T18:04:24.101290] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-16T18:04:24.274462] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T18:04:24.742828] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-16T18:04:25.542857] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-16T18:04:26.209832] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-16T18:04:26.342809] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-16T18:04:26.482544] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T18:04:26.932813] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T18:04:27.142844] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-16T18:04:27.942849] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-16T18:04:28.227764] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-16T18:04:28.633100] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-16T18:04:28.742810] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-16T18:04:29.399321] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T18:04:29.542827] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-16T18:04:30.342896] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-16T18:04:31.010071] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-16T18:04:31.142817] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-16T18:04:31.381556] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T18:04:31.560528] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T18:04:31.942809] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-16T18:04:32.742787] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-16T18:04:33.090590] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-16T18:04:33.542820] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-16T18:04:33.828180] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T18:04:34.252622] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T18:04:34.342807] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-16T18:04:34.989039] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-16T18:04:35.142954] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-16T18:04:35.837878] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T18:04:35.942816] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-16T18:04:36.629286] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T18:04:36.742814] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-16T18:04:36.859848] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T18:04:37.542858] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-16T18:04:38.342787] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-16T18:04:38.551987] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T18:04:39.147696] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-16T18:04:39.156429] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-16T18:04:39.163405] [INFO ] [REMOTE ] CLS: Full fetch complete (77682 records). [2025-10-16T18:04:39.163507] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-16T18:04:39.553745] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-16T18:04:39.553821] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-16T18:04:39.554725] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-16T18:04:39.554787] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-16T18:04:39.556226] [DEBUG] [LOCAL ] CLS: Trimmed 77682 records to 53972 (keeping 200 days of data) [2025-10-16T18:04:39.879819] [DEBUG] [LOCAL ] CLS: Primary data saved (53972 records). [2025-10-16T18:04:39.879942] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-16T18:04:39.880405] [INFO ] [MAIN ] Update Progress: 467/2369 symbols completed. CLS took 41.3s. Estimated remaining: 4h 23m 7s. Rate: 7.2 symbols/min [2025-10-16T18:04:39.955775] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-16T18:04:40.053781] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:04:40.096949] [DEBUG] [LOCAL ] CM: Loaded 48739 existing records from primary storage. [2025-10-16T18:04:40.097239] [INFO ] [MAIN ] CM: Loaded 48739 existing records. [2025-10-16T18:04:40.251031] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-16T18:04:40.321131] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:04:40.321526] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-16T18:04:40.321599] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-16T18:04:40.322117] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-16T18:04:40.322177] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-16T18:04:40.670584] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:04:40.711709] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T18:04:40.718225] [INFO ] [REMOTE ] CLVT: Full fetch complete (75402 records). [2025-10-16T18:04:40.718341] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-16T18:04:40.750019] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-16T18:04:41.116971] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-16T18:04:41.122299] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-16T18:04:41.130113] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-16T18:04:41.130725] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-16T18:04:41.131562] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T18:04:41.137679] [DEBUG] [LOCAL ] CLVT: Trimmed 75402 records to 52319 (keeping 200 days of data) [2025-10-16T18:04:41.422084] [DEBUG] [LOCAL ] CLVT: Primary data saved (52319 records). [2025-10-16T18:04:41.422233] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-16T18:04:41.422306] [INFO ] [MAIN ] Update Progress: 468/2369 symbols completed. CLVT took 40.6s. Estimated remaining: 4h 22m 31s. Rate: 7.2 symbols/min [2025-10-16T18:04:41.547913] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-16T18:04:41.595618] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:04:41.638940] [DEBUG] [LOCAL ] CMA: Loaded 50122 existing records from primary storage. [2025-10-16T18:04:41.639231] [INFO ] [MAIN ] CMA: Loaded 50122 existing records. [2025-10-16T18:04:41.818848] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:04:41.819098] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-16T18:04:41.819148] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-16T18:04:41.819338] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-16T18:04:41.819385] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-16T18:04:42.175570] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:04:42.342817] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-16T18:04:42.487454] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T18:04:42.701727] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T18:04:43.142809] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-16T18:04:43.942776] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-16T18:04:44.039063] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T18:04:44.394788] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T18:04:44.397576] [INFO ] [REMOTE ] CLW: Full fetch complete (33882 records). [2025-10-16T18:04:44.397670] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-16T18:04:44.757794] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-16T18:04:44.773535] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-16T18:04:44.774343] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-16T18:04:44.774998] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-16T18:04:44.775073] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-16T18:04:44.776248] [DEBUG] [LOCAL ] CLW: Trimmed 33882 records to 21658 (keeping 200 days of data) [2025-10-16T18:04:44.903247] [DEBUG] [LOCAL ] CLW: Primary data saved (21658 records). [2025-10-16T18:04:44.903369] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-16T18:04:44.903443] [INFO ] [MAIN ] Update Progress: 469/2369 symbols completed. CLW took 26.3s. Estimated remaining: 4h 22m 3s. Rate: 7.3 symbols/min [2025-10-16T18:04:45.070679] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:04:45.098606] [DEBUG] [LOCAL ] CMBT: Loaded 26155 existing records from primary storage. [2025-10-16T18:04:45.098985] [INFO ] [MAIN ] CMBT: Loaded 26155 existing records. [2025-10-16T18:04:45.303159] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:04:45.303374] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-16T18:04:45.303421] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-16T18:04:45.303589] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-16T18:04:45.303626] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-16T18:04:45.548474] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-16T18:04:45.675240] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:04:45.703916] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-16T18:04:46.342857] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-16T18:04:46.691066] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-16T18:04:47.109447] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T18:04:47.142780] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-16T18:04:47.611157] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T18:04:47.942856] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-16T18:04:48.750267] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-16T18:04:48.756407] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T18:04:49.476109] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T18:04:49.528382] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T18:04:49.542771] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-16T18:04:50.342796] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-16T18:04:50.439699] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T18:04:51.142814] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-16T18:04:51.942785] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-16T18:04:52.100881] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T18:04:52.235826] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T18:04:52.742842] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-16T18:04:53.542801] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-16T18:04:53.611089] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T18:04:53.843825] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T18:04:54.342816] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-16T18:04:55.142881] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-16T18:04:55.197630] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T18:04:55.203967] [INFO ] [REMOTE ] CLX: Full fetch complete (73228 records). [2025-10-16T18:04:55.204100] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-16T18:04:55.204956] [FATAL] [VALIDATOR ] CLX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:04:55.205058] [FATAL] [MAIN ] CLX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:04:55.205120] [WARN ] [MAIN ] CLX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:04:55.205192] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-16T18:04:55.205257] [DEBUG] [LOCAL ] CLX: No primary data file found to delete. [2025-10-16T18:04:55.205306] [INFO ] [LOCAL ] CLX: Starting deletion of derivative data. [2025-10-16T18:04:55.205542] [DEBUG] [LOCAL ] CLX: Deleted derivative data file. [2025-10-16T18:04:55.205637] [INFO ] [MAIN ] Update Progress: 470/2369 symbols completed. CLX took 36.0s. Estimated remaining: 4h 22m 3s. Rate: 7.2 symbols/min [2025-10-16T18:04:55.406522] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:04:55.447864] [DEBUG] [LOCAL ] CMC: Loaded 45483 existing records from primary storage. [2025-10-16T18:04:55.448237] [INFO ] [MAIN ] CMC: Loaded 45483 existing records. [2025-10-16T18:04:55.633838] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:04:55.634041] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-16T18:04:55.634091] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-16T18:04:55.634353] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-16T18:04:55.634411] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-16T18:04:55.968910] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-16T18:04:55.998515] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:04:56.036170] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T18:04:56.220001] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T18:04:56.742924] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-16T18:04:57.444385] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T18:04:57.542823] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-16T18:04:58.342847] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-16T18:04:58.537585] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T18:04:58.761986] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T18:04:59.142786] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-16T18:04:59.432048] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T18:04:59.942861] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-16T18:05:00.495560] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T18:05:00.742811] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-16T18:05:01.159586] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T18:05:01.542877] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-16T18:05:02.342802] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-16T18:05:02.623265] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-16T18:05:02.988546] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-16T18:05:03.142862] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-16T18:05:03.942839] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-16T18:05:04.036291] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T18:05:04.742874] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-16T18:05:05.044737] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T18:05:05.552066] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-16T18:05:05.557498] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T18:05:06.342851] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-16T18:05:06.593604] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T18:05:07.148028] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-16T18:05:07.170853] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T18:05:07.942894] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-16T18:05:08.078393] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T18:05:08.742891] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-16T18:05:09.030159] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T18:05:09.036435] [INFO ] [REMOTE ] CMBT: Full fetch complete (32891 records). [2025-10-16T18:05:09.036526] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-16T18:05:09.395122] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-16T18:05:09.395201] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-16T18:05:09.395765] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-16T18:05:09.395827] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-16T18:05:09.396596] [DEBUG] [LOCAL ] CMBT: Trimmed 32891 records to 26529 (keeping 200 days of data) [2025-10-16T18:05:09.542790] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-16T18:05:09.548936] [DEBUG] [LOCAL ] CMBT: Primary data saved (26529 records). [2025-10-16T18:05:09.549083] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-16T18:05:09.549942] [INFO ] [MAIN ] Update Progress: 471/2369 symbols completed. CMBT took 24.6s. Estimated remaining: 4h 22m 20s. Rate: 7.2 symbols/min [2025-10-16T18:05:09.719965] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:05:09.727400] [DEBUG] [LOCAL ] CMCM: Loaded 4788 existing records from primary storage. [2025-10-16T18:05:09.727626] [INFO ] [MAIN ] CMCM: Loaded 4788 existing records. [2025-10-16T18:05:09.917871] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:05:09.933178] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-16T18:05:09.961038] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-16T18:05:09.964463] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-16T18:05:09.978075] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-16T18:05:09.979318] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-16T18:05:10.364811] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:05:10.375749] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-16T18:05:10.381952] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T18:05:11.142806] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-16T18:05:11.211732] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T18:05:11.942894] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-16T18:05:11.976932] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T18:05:12.742940] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-16T18:05:12.901413] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T18:05:13.542795] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-16T18:05:13.610405] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T18:05:14.113953] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T18:05:14.143021] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-16T18:05:14.342830] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-16T18:05:15.142863] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-16T18:05:15.942871] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-16T18:05:16.018232] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T18:05:16.280885] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-16T18:05:16.742795] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-16T18:05:16.969684] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T18:05:17.542818] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-16T18:05:18.342869] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-16T18:05:18.689301] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-16T18:05:18.695937] [INFO ] [REMOTE ] CMA: Full fetch complete (73420 records). [2025-10-16T18:05:18.696047] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-16T18:05:18.871088] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-16T18:05:19.115937] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-16T18:05:19.116032] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-16T18:05:19.116927] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-16T18:05:19.117008] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-16T18:05:19.142960] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-16T18:05:19.144531] [DEBUG] [LOCAL ] CMA: Trimmed 73420 records to 50512 (keeping 200 days of data) [2025-10-16T18:05:19.146467] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T18:05:19.458200] [DEBUG] [LOCAL ] CMA: Primary data saved (50512 records). [2025-10-16T18:05:19.458332] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-16T18:05:19.458959] [INFO ] [MAIN ] Update Progress: 472/2369 symbols completed. CMA took 38.0s. Estimated remaining: 4h 22m 18s. Rate: 7.2 symbols/min [2025-10-16T18:05:19.627503] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:05:19.627710] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-16T18:05:19.627759] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-16T18:05:19.627862] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-16T18:05:19.627903] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-16T18:05:19.627943] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-16T18:05:19.627974] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-16T18:05:19.953107] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-16T18:05:19.974186] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:05:20.742803] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-16T18:05:20.965109] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:05:20.965509] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-16T18:05:20.994196] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:05:20.994442] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-16T18:05:20.994506] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:05:20.994593] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-16T18:05:20.994731] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-16T18:05:20.994801] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-16T18:05:21.003085] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-16T18:05:21.006220] [INFO ] [MAIN ] Update Progress: 473/2369 symbols completed. CMDB took 1.5s. Estimated remaining: 4h 21m 42s. Rate: 7.2 symbols/min [2025-10-16T18:05:21.034737] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-16T18:05:21.300310] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:05:21.387265] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-10-16T18:05:21.387691] [INFO ] [MAIN ] CMG: Loaded 53721 existing records. [2025-10-16T18:05:21.543215] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-16T18:05:21.681403] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:05:21.684033] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T18:05:21.684441] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-16T18:05:21.684576] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-16T18:05:21.693774] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-16T18:05:21.694582] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-16T18:05:21.712022] [INFO ] [REMOTE ] CM: Full fetch complete (69834 records). [2025-10-16T18:05:21.724240] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-16T18:05:22.325200] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-16T18:05:22.347006] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-16T18:05:22.483582] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:05:22.529903] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-16T18:05:22.529995] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-16T18:05:22.530945] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-16T18:05:22.531014] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-16T18:05:22.532489] [DEBUG] [LOCAL ] CM: Trimmed 69834 records to 49077 (keeping 200 days of data) [2025-10-16T18:05:22.836630] [DEBUG] [LOCAL ] CM: Primary data saved (49077 records). [2025-10-16T18:05:22.836819] [INFO ] [MAIN ] CM: Full history saved. [2025-10-16T18:05:22.837274] [INFO ] [MAIN ] Update Progress: 474/2369 symbols completed. CM took 43.0s. Estimated remaining: 4h 21m 8s. Rate: 7.3 symbols/min [2025-10-16T18:05:23.011990] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:05:23.052585] [DEBUG] [LOCAL ] CMI: Loaded 41687 existing records from primary storage. [2025-10-16T18:05:23.052919] [INFO ] [MAIN ] CMI: Loaded 41687 existing records. [2025-10-16T18:05:23.150611] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-16T18:05:23.233677] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:05:23.233896] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-16T18:05:23.233945] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-16T18:05:23.234170] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-16T18:05:23.234228] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-16T18:05:23.591513] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:05:23.668605] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-16T18:05:23.942896] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-16T18:05:24.250910] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-16T18:05:24.742906] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-16T18:05:25.542834] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-16T18:05:26.103251] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-16T18:05:26.234474] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-16T18:05:26.342832] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-16T18:05:26.373964] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T18:05:26.380158] [INFO ] [REMOTE ] CMC: Full fetch complete (67127 records). [2025-10-16T18:05:26.380264] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-16T18:05:26.753634] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-16T18:05:26.753742] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-16T18:05:26.754548] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-16T18:05:26.754589] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-16T18:05:26.755848] [DEBUG] [LOCAL ] CMC: Trimmed 67127 records to 45871 (keeping 200 days of data) [2025-10-16T18:05:27.028960] [DEBUG] [LOCAL ] CMC: Primary data saved (45871 records). [2025-10-16T18:05:27.029128] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-16T18:05:27.029228] [INFO ] [MAIN ] Update Progress: 475/2369 symbols completed. CMC took 31.8s. Estimated remaining: 4h 20m 44s. Rate: 7.3 symbols/min [2025-10-16T18:05:27.147997] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-16T18:05:27.198333] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:05:27.231973] [DEBUG] [LOCAL ] CMP: Loaded 35832 existing records from primary storage. [2025-10-16T18:05:27.232264] [INFO ] [MAIN ] CMP: Loaded 35832 existing records. [2025-10-16T18:05:27.411242] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:05:27.411446] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-16T18:05:27.411493] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-16T18:05:27.411712] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-16T18:05:27.411769] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-16T18:05:27.780507] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T18:05:27.784559] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:05:27.942861] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-16T18:05:28.344892] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-16T18:05:28.742814] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-16T18:05:29.151524] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-16T18:05:29.542831] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-16T18:05:29.920513] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T18:05:30.342878] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-16T18:05:31.142805] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-16T18:05:31.467135] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-16T18:05:31.690914] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T18:05:31.703192] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-16T18:05:31.942827] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-16T18:05:32.487203] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-16T18:05:32.742824] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-16T18:05:33.542829] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-16T18:05:34.342820] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-16T18:05:34.936699] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-16T18:05:34.987108] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T18:05:35.142829] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-16T18:05:35.762515] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:05:35.942782] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-16T18:05:36.561968] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:05:36.742820] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-16T18:05:37.360898] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T18:05:37.542813] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-16T18:05:38.342785] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-16T18:05:38.391334] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T18:05:38.408316] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T18:05:39.142813] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-16T18:05:39.645450] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T18:05:39.942806] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-16T18:05:40.742787] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-16T18:05:40.863083] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T18:05:41.402714] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T18:05:41.403953] [INFO ] [REMOTE ] CMCM: Full fetch complete (6915 records). [2025-10-16T18:05:41.404024] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-16T18:05:41.404416] [FATAL] [VALIDATOR ] CMCM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:05:41.404514] [FATAL] [MAIN ] CMCM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:05:41.404586] [WARN ] [MAIN ] CMCM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:05:41.404707] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-16T18:05:41.404786] [DEBUG] [LOCAL ] CMCM: No primary data file found to delete. [2025-10-16T18:05:41.404822] [INFO ] [LOCAL ] CMCM: Starting deletion of derivative data. [2025-10-16T18:05:41.404950] [DEBUG] [LOCAL ] CMCM: Deleted derivative data file. [2025-10-16T18:05:41.405034] [INFO ] [MAIN ] Update Progress: 476/2369 symbols completed. CMCM took 31.9s. Estimated remaining: 4h 20m 60s. Rate: 7.3 symbols/min [2025-10-16T18:05:41.549711] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-16T18:05:41.574301] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:05:41.614274] [DEBUG] [LOCAL ] CMPO: Loaded 38834 existing records from primary storage. [2025-10-16T18:05:41.614544] [INFO ] [MAIN ] CMPO: Loaded 38834 existing records. [2025-10-16T18:05:41.786348] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:05:41.786588] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-16T18:05:41.786634] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-16T18:05:41.786902] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-16T18:05:41.786957] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-16T18:05:42.131303] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:05:42.342771] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-16T18:05:42.523333] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-16T18:05:43.142853] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-16T18:05:43.216456] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T18:05:43.741133] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T18:05:43.942805] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-16T18:05:44.742838] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-16T18:05:45.095209] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-16T18:05:45.362394] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T18:05:45.542836] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-16T18:05:45.931380] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T18:05:46.342833] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-16T18:05:47.142785] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-16T18:05:47.590841] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-16T18:05:47.659783] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T18:05:47.942841] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-16T18:05:48.742796] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-16T18:05:48.883791] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T18:05:49.542845] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-16T18:05:50.182431] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T18:05:50.216401] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-16T18:05:50.342837] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-16T18:05:50.905575] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-16T18:05:51.142816] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-16T18:05:51.942826] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-16T18:05:52.568883] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T18:05:52.735547] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-16T18:05:52.746175] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-16T18:05:53.113759] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T18:05:53.542819] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-16T18:05:54.342790] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-16T18:05:54.462184] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T18:05:54.934740] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T18:05:55.142810] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-16T18:05:55.942823] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-16T18:05:56.483522] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-16T18:05:56.742854] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-16T18:05:56.915529] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-16T18:05:56.991272] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-16T18:05:56.997730] [INFO ] [REMOTE ] CMI: Full fetch complete (60828 records). [2025-10-16T18:05:56.997881] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-16T18:05:57.405265] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-16T18:05:57.405414] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-16T18:05:57.406562] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-16T18:05:57.406630] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-16T18:05:57.408432] [DEBUG] [LOCAL ] CMI: Trimmed 60828 records to 42011 (keeping 200 days of data) [2025-10-16T18:05:57.542947] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-16T18:05:57.700617] [DEBUG] [LOCAL ] CMI: Primary data saved (42011 records). [2025-10-16T18:05:57.700843] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-16T18:05:57.701402] [INFO ] [MAIN ] Update Progress: 477/2369 symbols completed. CMI took 34.9s. Estimated remaining: 4h 21m 23s. Rate: 7.2 symbols/min [2025-10-16T18:05:58.261505] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T18:05:58.268754] [INFO ] [REMOTE ] CMG: Full fetch complete (77893 records). [2025-10-16T18:05:58.269008] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-16T18:05:58.352320] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-16T18:05:58.497751] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T18:05:58.729811] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-16T18:05:58.729954] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-16T18:05:58.730943] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-16T18:05:58.731007] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-16T18:05:58.732600] [DEBUG] [LOCAL ] CMG: Trimmed 77893 records to 54111 (keeping 200 days of data) [2025-10-16T18:05:59.054801] [DEBUG] [LOCAL ] CMG: Primary data saved (54111 records). [2025-10-16T18:05:59.054951] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-16T18:05:59.055577] [INFO ] [MAIN ] Update Progress: 478/2369 symbols completed. CMG took 38.0s. Estimated remaining: 4h 20m 48s. Rate: 7.3 symbols/min [2025-10-16T18:05:59.142877] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-16T18:05:59.956339] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T18:05:59.964440] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-16T18:06:00.687778] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T18:06:00.742781] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-16T18:06:01.648713] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T18:06:01.658120] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-16T18:06:02.094410] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T18:06:02.342884] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-16T18:06:03.052535] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T18:06:03.142842] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-16T18:06:03.670197] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T18:06:03.942933] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-16T18:06:04.320085] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T18:06:04.324563] [INFO ] [REMOTE ] CMPO: Full fetch complete (58547 records). [2025-10-16T18:06:04.324731] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-16T18:06:04.704858] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-16T18:06:04.704949] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-16T18:06:04.705703] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-16T18:06:04.705763] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-16T18:06:04.708786] [DEBUG] [LOCAL ] CMPO: Trimmed 58547 records to 39076 (keeping 200 days of data) [2025-10-16T18:06:04.929834] [DEBUG] [LOCAL ] CMPO: Primary data saved (39076 records). [2025-10-16T18:06:04.929950] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-16T18:06:04.930560] [INFO ] [MAIN ] Update Progress: 479/2369 symbols completed. CMPO took 23.5s. Estimated remaining: 4h 20m 30s. Rate: 7.3 symbols/min [2025-10-16T18:06:05.216181] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-16T18:06:05.220152] [INFO ] [REMOTE ] CMP: Full fetch complete (51755 records). [2025-10-16T18:06:05.220236] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-16T18:06:05.607910] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-16T18:06:05.608005] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-16T18:06:05.608804] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-16T18:06:05.608881] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-16T18:06:05.609896] [DEBUG] [LOCAL ] CMP: Trimmed 51755 records to 36020 (keeping 200 days of data) [2025-10-16T18:06:05.811335] [DEBUG] [LOCAL ] CMP: Primary data saved (36020 records). [2025-10-16T18:06:05.811464] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-16T18:06:05.811540] [INFO ] [MAIN ] Update Progress: 480/2369 symbols completed. CMP took 38.8s. Estimated remaining: 4h 19m 53s. Rate: 7.3 symbols/min [2025-10-16T18:06:06.450120] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:06:06.496824] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:06:06.493774] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:06:06.508298] [DEBUG] [LOCAL ] CMSA: No existing data file found in primary storage. [2025-10-16T18:06:06.531852] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:06:06.532441] [WARN ] [MAIN ] CMSA: No existing data found, performing full refresh instead. [2025-10-16T18:06:06.533175] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-16T18:06:06.533248] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-16T18:06:06.533566] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-16T18:06:06.533619] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-16T18:06:06.650790] [DEBUG] [LOCAL ] CMSC: Loaded 4881 existing records from primary storage. [2025-10-16T18:06:06.654638] [INFO ] [MAIN ] CMSC: Loaded 4881 existing records. [2025-10-16T18:06:06.824044] [DEBUG] [LOCAL ] CMRE: Loaded 35851 existing records from primary storage. [2025-10-16T18:06:06.929399] [INFO ] [MAIN ] CMRE: Loaded 35851 existing records. [2025-10-16T18:06:07.228158] [DEBUG] [LOCAL ] CMS: Loaded 52615 existing records from primary storage. [2025-10-16T18:06:07.256240] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:06:07.337690] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-16T18:06:07.372731] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-16T18:06:07.337367] [INFO ] [MAIN ] CMS: Loaded 52615 existing records. [2025-10-16T18:06:07.404200] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-16T18:06:07.413167] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-16T18:06:07.413015] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:06:07.413634] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-16T18:06:07.403868] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:06:07.452182] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-16T18:06:07.484831] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-16T18:06:07.518677] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-16T18:06:07.531965] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-16T18:06:07.885567] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:06:07.925072] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-16T18:06:07.974470] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-16T18:06:08.037036] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-16T18:06:08.037275] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-16T18:06:08.336162] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T18:06:08.429789] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-16T18:06:08.566517] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:06:08.581219] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-16T18:06:08.570517] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:06:08.635843] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-16T18:06:08.842825] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:06:08.843226] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-16T18:06:09.112693] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T18:06:09.114392] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-16T18:06:09.190989] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-16T18:06:09.542886] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-16T18:06:09.702686] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T18:06:10.069519] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T18:06:10.141258] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-16T18:06:10.342804] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-16T18:06:10.705060] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-16T18:06:10.719558] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-16T18:06:11.142813] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-16T18:06:11.664237] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-16T18:06:11.942811] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-16T18:06:12.742899] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-16T18:06:13.077547] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T18:06:13.542905] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-16T18:06:14.342823] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-16T18:06:14.418718] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T18:06:14.494248] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T18:06:14.908315] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T18:06:15.142837] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-16T18:06:15.942819] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-16T18:06:16.598541] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T18:06:16.742817] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-16T18:06:17.520984] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T18:06:17.542795] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-16T18:06:17.956785] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T18:06:18.342854] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-16T18:06:18.997386] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-16T18:06:19.142836] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-16T18:06:19.324574] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T18:06:19.942822] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-16T18:06:20.659530] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-16T18:06:20.740602] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T18:06:20.747575] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-16T18:06:21.379098] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T18:06:21.542835] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-16T18:06:22.342817] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-16T18:06:23.142810] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-16T18:06:23.170795] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T18:06:23.448549] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-16T18:06:23.622441] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-16T18:06:23.942809] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-16T18:06:24.591088] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-16T18:06:24.742854] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-16T18:06:25.542822] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-16T18:06:26.099966] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-16T18:06:26.334847] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T18:06:26.345226] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-16T18:06:26.669833] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-16T18:06:27.142823] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-16T18:06:27.861138] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T18:06:27.942864] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-16T18:06:28.516705] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T18:06:28.742835] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-16T18:06:29.542827] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-16T18:06:30.151431] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T18:06:30.166542] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-16T18:06:30.342812] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-16T18:06:31.142814] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-16T18:06:31.942787] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-16T18:06:32.162849] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T18:06:32.386147] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T18:06:32.401120] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-16T18:06:32.742806] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-16T18:06:33.474001] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T18:06:33.475078] [INFO ] [REMOTE ] CMSC: Full fetch complete (7107 records). [2025-10-16T18:06:33.475146] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-16T18:06:33.548029] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-16T18:06:33.829802] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-16T18:06:33.829876] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-16T18:06:33.830074] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-16T18:06:33.830115] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-16T18:06:33.830497] [DEBUG] [LOCAL ] CMSC: Trimmed 7107 records to 4906 (keeping 200 days of data) [2025-10-16T18:06:33.859947] [DEBUG] [LOCAL ] CMSC: Primary data saved (4906 records). [2025-10-16T18:06:33.860067] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-16T18:06:33.860160] [INFO ] [MAIN ] Update Progress: 481/2369 symbols completed. CMSC took 28.0s. Estimated remaining: 4h 21m 2s. Rate: 7.2 symbols/min [2025-10-16T18:06:34.030252] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:06:34.040144] [DEBUG] [LOCAL ] CMSD: Loaded 7835 existing records from primary storage. [2025-10-16T18:06:34.040350] [INFO ] [MAIN ] CMSD: Loaded 7835 existing records. [2025-10-16T18:06:34.215861] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:06:34.216083] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-16T18:06:34.216134] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-16T18:06:34.216319] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-16T18:06:34.216376] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-16T18:06:34.355117] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-16T18:06:34.578452] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:06:35.000080] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T18:06:35.019551] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T18:06:35.020869] [INFO ] [REMOTE ] CMSA: Full fetch complete (5061 records). [2025-10-16T18:06:35.020955] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-16T18:06:35.147928] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-16T18:06:35.388087] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-16T18:06:35.388201] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-16T18:06:35.388382] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-16T18:06:35.388422] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-16T18:06:35.388818] [DEBUG] [LOCAL ] CMSA: Trimmed 5061 records to 3562 (keeping 200 days of data) [2025-10-16T18:06:35.410265] [DEBUG] [LOCAL ] CMSA: Primary data saved (3562 records). [2025-10-16T18:06:35.410338] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-16T18:06:35.410400] [INFO ] [MAIN ] Update Progress: 482/2369 symbols completed. CMSA took 29.6s. Estimated remaining: 4h 20m 27s. Rate: 7.2 symbols/min [2025-10-16T18:06:35.575684] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:06:35.610860] [DEBUG] [LOCAL ] CMTG: Loaded 35854 existing records from primary storage. [2025-10-16T18:06:35.611126] [INFO ] [MAIN ] CMTG: Loaded 35854 existing records. [2025-10-16T18:06:35.784354] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:06:35.784550] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-16T18:06:35.784597] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-16T18:06:35.784832] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-16T18:06:35.784889] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-16T18:06:35.945105] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-16T18:06:36.136007] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:06:36.742845] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-16T18:06:37.092909] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T18:06:37.127848] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-16T18:06:37.542869] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-16T18:06:38.023229] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T18:06:38.342867] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-16T18:06:38.556977] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T18:06:39.142825] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-16T18:06:39.643495] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T18:06:39.942879] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-16T18:06:40.742807] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-16T18:06:40.864794] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T18:06:41.342061] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T18:06:41.542792] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-16T18:06:42.151273] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T18:06:42.342850] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-16T18:06:43.069595] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T18:06:43.076316] [INFO ] [REMOTE ] CMS: Full fetch complete (76218 records). [2025-10-16T18:06:43.076449] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-16T18:06:43.150425] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-16T18:06:43.488967] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-16T18:06:43.489069] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-16T18:06:43.490112] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-16T18:06:43.490178] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-16T18:06:43.491790] [DEBUG] [LOCAL ] CMS: Trimmed 76218 records to 52994 (keeping 200 days of data) [2025-10-16T18:06:43.648479] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T18:06:43.861126] [DEBUG] [LOCAL ] CMS: Primary data saved (52994 records). [2025-10-16T18:06:43.861289] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-16T18:06:43.862024] [INFO ] [MAIN ] Update Progress: 483/2369 symbols completed. CMS took 38.0s. Estimated remaining: 4h 20m 20s. Rate: 7.2 symbols/min [2025-10-16T18:06:43.951053] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-16T18:06:44.036146] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:06:44.046330] [DEBUG] [LOCAL ] CMU: Loaded 6330 existing records from primary storage. [2025-10-16T18:06:44.046560] [INFO ] [MAIN ] CMU: Loaded 6330 existing records. [2025-10-16T18:06:44.219166] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:06:44.219420] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-16T18:06:44.219473] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-16T18:06:44.219613] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-16T18:06:44.219691] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-16T18:06:44.654119] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:06:44.742890] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-16T18:06:44.924966] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-16T18:06:44.930569] [INFO ] [REMOTE ] CMRE: Full fetch complete (51194 records). [2025-10-16T18:06:44.930715] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-16T18:06:45.308419] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-16T18:06:45.404936] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-16T18:06:45.405015] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-16T18:06:45.405882] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-16T18:06:45.405949] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-16T18:06:45.407161] [DEBUG] [LOCAL ] CMRE: Trimmed 51194 records to 36175 (keeping 200 days of data) [2025-10-16T18:06:45.543253] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-16T18:06:45.545732] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T18:06:45.662937] [DEBUG] [LOCAL ] CMRE: Primary data saved (36175 records). [2025-10-16T18:06:45.663091] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-16T18:06:45.663560] [INFO ] [MAIN ] Update Progress: 484/2369 symbols completed. CMRE took 39.9s. Estimated remaining: 4h 19m 46s. Rate: 7.3 symbols/min [2025-10-16T18:06:45.833040] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:06:45.865363] [DEBUG] [LOCAL ] CNA: Loaded 32932 existing records from primary storage. [2025-10-16T18:06:45.865706] [INFO ] [MAIN ] CNA: Loaded 32932 existing records. [2025-10-16T18:06:46.040091] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:06:46.040298] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-16T18:06:46.040345] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-16T18:06:46.040563] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-16T18:06:46.040688] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-16T18:06:46.166496] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-16T18:06:46.348027] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-16T18:06:46.399511] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:06:46.944414] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-16T18:06:47.142870] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-16T18:06:47.942853] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-16T18:06:48.457878] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T18:06:48.742834] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-16T18:06:49.198300] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T18:06:49.346909] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-16T18:06:49.542823] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-16T18:06:50.337315] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T18:06:50.342761] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-16T18:06:50.851861] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-16T18:06:51.142852] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-16T18:06:51.942829] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-16T18:06:52.339399] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T18:06:52.385392] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-16T18:06:52.742840] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-16T18:06:53.374726] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T18:06:53.542813] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-16T18:06:54.342812] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-16T18:06:54.374373] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T18:06:54.942452] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T18:06:55.142819] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-16T18:06:55.942817] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-16T18:06:56.565372] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:06:56.742784] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-16T18:06:57.333104] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T18:06:57.542863] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-16T18:06:58.024675] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-16T18:06:58.227980] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T18:06:58.342814] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-16T18:06:59.057172] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T18:06:59.142830] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-16T18:06:59.761868] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-16T18:06:59.942858] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-16T18:07:00.742795] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-16T18:07:00.877275] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T18:07:01.406301] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-16T18:07:01.542834] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-16T18:07:02.342831] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-16T18:07:03.022146] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T18:07:03.056237] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T18:07:03.142881] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-16T18:07:03.912736] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-16T18:07:03.942773] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-16T18:07:04.734531] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T18:07:04.736099] [INFO ] [REMOTE ] CMSD: Full fetch complete (11795 records). [2025-10-16T18:07:04.736181] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-16T18:07:04.748055] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-16T18:07:05.117279] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-16T18:07:05.117409] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-16T18:07:05.118073] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-16T18:07:05.118145] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-16T18:07:05.119246] [DEBUG] [LOCAL ] CMSD: Trimmed 11795 records to 7871 (keeping 200 days of data) [2025-10-16T18:07:05.174786] [DEBUG] [LOCAL ] CMSD: Primary data saved (7871 records). [2025-10-16T18:07:05.175001] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-16T18:07:05.175140] [INFO ] [MAIN ] Update Progress: 485/2369 symbols completed. CMSD took 31.3s. Estimated remaining: 4h 20m 22s. Rate: 7.2 symbols/min [2025-10-16T18:07:05.360795] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:07:05.424984] [DEBUG] [LOCAL ] CNC: Loaded 53770 existing records from primary storage. [2025-10-16T18:07:05.425553] [INFO ] [MAIN ] CNC: Loaded 53770 existing records. [2025-10-16T18:07:05.543599] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-16T18:07:05.544711] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-16T18:07:05.673831] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:07:05.674168] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-16T18:07:05.674235] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-16T18:07:05.674766] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-16T18:07:05.674836] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-16T18:07:06.187864] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:07:06.342936] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-16T18:07:07.010727] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T18:07:07.142850] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-16T18:07:07.569861] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T18:07:07.778537] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-16T18:07:07.942801] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-16T18:07:08.610859] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T18:07:08.611905] [INFO ] [REMOTE ] CMU: Full fetch complete (9536 records). [2025-10-16T18:07:08.611973] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-16T18:07:08.747963] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-16T18:07:09.008913] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-16T18:07:09.009000] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-16T18:07:09.009229] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-16T18:07:09.009268] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-16T18:07:09.009842] [DEBUG] [LOCAL ] CMU: Trimmed 9536 records to 6366 (keeping 200 days of data) [2025-10-16T18:07:09.047970] [DEBUG] [LOCAL ] CMU: Primary data saved (6366 records). [2025-10-16T18:07:09.048121] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-16T18:07:09.048206] [INFO ] [MAIN ] Update Progress: 486/2369 symbols completed. CMU took 25.2s. Estimated remaining: 4h 19m 56s. Rate: 7.2 symbols/min [2025-10-16T18:07:09.226325] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:07:09.226525] [DEBUG] [LOCAL ] CNF: No existing data file found in primary storage. [2025-10-16T18:07:09.226563] [WARN ] [MAIN ] CNF: No existing data found, performing full refresh instead. [2025-10-16T18:07:09.226709] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-16T18:07:09.226762] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-16T18:07:09.226806] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-16T18:07:09.226861] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-16T18:07:09.548055] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-16T18:07:09.589198] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:07:10.207544] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T18:07:10.342827] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-16T18:07:11.080038] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T18:07:11.148398] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-16T18:07:11.162061] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T18:07:11.942780] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-16T18:07:12.653024] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T18:07:12.727281] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-16T18:07:12.742830] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-16T18:07:13.542815] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-16T18:07:14.106010] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T18:07:14.110453] [INFO ] [REMOTE ] CMTG: Full fetch complete (53421 records). [2025-10-16T18:07:14.110615] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-16T18:07:14.354629] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-16T18:07:14.525175] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-16T18:07:14.525264] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-16T18:07:14.526059] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-16T18:07:14.526124] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-16T18:07:14.527370] [DEBUG] [LOCAL ] CMTG: Trimmed 53421 records to 36073 (keeping 200 days of data) [2025-10-16T18:07:14.728474] [DEBUG] [LOCAL ] CMTG: Primary data saved (36073 records). [2025-10-16T18:07:14.728944] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-16T18:07:14.729227] [INFO ] [MAIN ] Update Progress: 487/2369 symbols completed. CMTG took 39.3s. Estimated remaining: 4h 19m 38s. Rate: 7.2 symbols/min [2025-10-16T18:07:14.906979] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T18:07:14.933455] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:07:15.000792] [DEBUG] [LOCAL ] CNH: Loaded 53552 existing records from primary storage. [2025-10-16T18:07:15.001340] [INFO ] [MAIN ] CNH: Loaded 53552 existing records. [2025-10-16T18:07:15.055794] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-16T18:07:15.148019] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-16T18:07:15.219539] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:07:15.220015] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-16T18:07:15.220073] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-16T18:07:15.220480] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-16T18:07:15.220538] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-16T18:07:15.641409] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:07:15.942844] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-16T18:07:16.287054] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-16T18:07:16.308740] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T18:07:16.742812] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-16T18:07:17.542855] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-16T18:07:18.103281] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T18:07:18.107572] [INFO ] [REMOTE ] CNA: Full fetch complete (46057 records). [2025-10-16T18:07:18.107724] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-16T18:07:18.348071] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-16T18:07:18.499734] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-16T18:07:18.499878] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-16T18:07:18.500670] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-16T18:07:18.500738] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-16T18:07:18.502053] [DEBUG] [LOCAL ] CNA: Trimmed 46057 records to 33156 (keeping 200 days of data) [2025-10-16T18:07:18.700435] [DEBUG] [LOCAL ] CNA: Primary data saved (33156 records). [2025-10-16T18:07:18.700591] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-16T18:07:18.701056] [INFO ] [MAIN ] Update Progress: 488/2369 symbols completed. CNA took 33.0s. Estimated remaining: 4h 19m 13s. Rate: 7.3 symbols/min [2025-10-16T18:07:18.868557] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:07:18.919860] [DEBUG] [LOCAL ] CNI: Loaded 51698 existing records from primary storage. [2025-10-16T18:07:18.920186] [INFO ] [MAIN ] CNI: Loaded 51698 existing records. [2025-10-16T18:07:19.138130] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:07:19.138410] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-16T18:07:19.138463] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-16T18:07:19.138933] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-16T18:07:19.138991] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-16T18:07:19.170293] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-16T18:07:19.502534] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:07:19.532485] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-16T18:07:19.903241] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T18:07:19.942821] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-16T18:07:20.148310] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-16T18:07:20.509752] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T18:07:20.742862] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-16T18:07:21.542867] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-16T18:07:22.342800] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-16T18:07:22.448354] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T18:07:22.844758] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T18:07:23.142859] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-16T18:07:23.942845] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-16T18:07:24.162163] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-16T18:07:24.742779] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-16T18:07:24.846797] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T18:07:25.546194] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-16T18:07:25.548976] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T18:07:26.309449] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T18:07:26.342768] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-16T18:07:26.599043] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T18:07:27.142794] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-16T18:07:27.942825] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-16T18:07:27.953993] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T18:07:28.103282] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T18:07:28.742829] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-16T18:07:29.539050] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T18:07:29.548161] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-16T18:07:30.310460] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T18:07:30.342841] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-16T18:07:30.362832] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-16T18:07:31.142874] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-16T18:07:31.942855] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-16T18:07:32.186165] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T18:07:32.708431] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T18:07:32.742769] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-16T18:07:32.853589] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T18:07:33.542867] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-16T18:07:34.344041] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-16T18:07:34.349464] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T18:07:34.449076] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-16T18:07:35.142863] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-16T18:07:35.942892] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-16T18:07:36.277863] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T18:07:36.279703] [INFO ] [REMOTE ] CNF: Full fetch complete (13090 records). [2025-10-16T18:07:36.279868] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-16T18:07:36.421487] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-16T18:07:36.706722] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-16T18:07:36.706802] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-16T18:07:36.707086] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-16T18:07:36.707124] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-16T18:07:36.707605] [DEBUG] [LOCAL ] CNF: Trimmed 13090 records to 10646 (keeping 200 days of data) [2025-10-16T18:07:36.748870] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-16T18:07:36.766980] [DEBUG] [LOCAL ] CNF: Primary data saved (10646 records). [2025-10-16T18:07:36.767118] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-16T18:07:36.767190] [INFO ] [MAIN ] Update Progress: 489/2369 symbols completed. CNF took 27.7s. Estimated remaining: 4h 19m 42s. Rate: 7.2 symbols/min [2025-10-16T18:07:36.934440] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:07:36.934631] [DEBUG] [LOCAL ] CNK: No existing data file found in primary storage. [2025-10-16T18:07:36.934705] [WARN ] [MAIN ] CNK: No existing data found, performing full refresh instead. [2025-10-16T18:07:36.934821] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-16T18:07:36.934863] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-16T18:07:36.934904] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-10-16T18:07:36.934940] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-16T18:07:37.288414] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:07:37.547902] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-16T18:07:37.567334] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T18:07:38.342851] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-16T18:07:38.525382] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T18:07:39.004011] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T18:07:39.142796] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-16T18:07:39.628222] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T18:07:39.942814] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-16T18:07:40.742951] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-16T18:07:41.512462] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T18:07:41.542767] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-16T18:07:41.716167] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-16T18:07:42.208712] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T18:07:42.342816] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-16T18:07:42.803015] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T18:07:43.142876] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-16T18:07:43.942803] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-16T18:07:44.003662] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T18:07:44.586929] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T18:07:44.742814] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-16T18:07:45.542848] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-16T18:07:45.933070] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-16T18:07:46.342934] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-16T18:07:46.518494] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T18:07:47.119464] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T18:07:47.142779] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-16T18:07:47.767339] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T18:07:47.942819] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-16T18:07:48.742863] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-16T18:07:49.033051] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-16T18:07:49.542795] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-16T18:07:49.578764] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T18:07:50.342870] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-16T18:07:50.471759] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T18:07:50.478080] [INFO ] [REMOTE ] CNH: Full fetch complete (77315 records). [2025-10-16T18:07:50.478204] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-16T18:07:50.478966] [FATAL] [VALIDATOR ] CNH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:07:50.479062] [FATAL] [MAIN ] CNH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:07:50.479106] [WARN ] [MAIN ] CNH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:07:50.479145] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-16T18:07:50.479225] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-16T18:07:50.479271] [INFO ] [LOCAL ] CNH: Starting deletion of derivative data. [2025-10-16T18:07:50.479405] [DEBUG] [LOCAL ] CNH: Deleted derivative data file. [2025-10-16T18:07:50.479493] [INFO ] [MAIN ] Update Progress: 490/2369 symbols completed. CNH took 35.8s. Estimated remaining: 4h 19m 55s. Rate: 7.2 symbols/min [2025-10-16T18:07:50.651352] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:07:50.701373] [DEBUG] [LOCAL ] CNM: Loaded 51035 existing records from primary storage. [2025-10-16T18:07:50.701722] [INFO ] [MAIN ] CNM: Loaded 51035 existing records. [2025-10-16T18:07:50.873191] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:07:50.873438] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-16T18:07:50.873486] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-16T18:07:50.873931] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-16T18:07:50.873986] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-16T18:07:51.152521] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-16T18:07:51.248737] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:07:51.280696] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T18:07:51.942851] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-16T18:07:52.723868] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-16T18:07:52.742762] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-16T18:07:52.798534] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T18:07:53.542847] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-16T18:07:53.770376] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-16T18:07:53.776881] [INFO ] [REMOTE ] CNI: Full fetch complete (74842 records). [2025-10-16T18:07:53.777008] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-16T18:07:54.166425] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-16T18:07:54.166504] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-16T18:07:54.167394] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-16T18:07:54.167457] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-16T18:07:54.169019] [DEBUG] [LOCAL ] CNI: Trimmed 74842 records to 52078 (keeping 200 days of data) [2025-10-16T18:07:54.358178] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-16T18:07:54.509213] [DEBUG] [LOCAL ] CNI: Primary data saved (52078 records). [2025-10-16T18:07:54.509391] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-16T18:07:54.509902] [INFO ] [MAIN ] Update Progress: 491/2369 symbols completed. CNI took 35.8s. Estimated remaining: 4h 19m 30s. Rate: 7.2 symbols/min [2025-10-16T18:07:54.679239] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:07:54.714255] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T18:07:54.749875] [DEBUG] [LOCAL ] CNMD: Loaded 32127 existing records from primary storage. [2025-10-16T18:07:54.750140] [INFO ] [MAIN ] CNMD: Loaded 32127 existing records. [2025-10-16T18:07:54.926456] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:07:54.926795] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-16T18:07:54.926868] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-16T18:07:54.927241] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-16T18:07:54.927307] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-16T18:07:55.110162] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T18:07:55.151888] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-16T18:07:55.423759] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:07:55.942828] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-16T18:07:55.999232] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T18:07:56.226055] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T18:07:56.232849] [INFO ] [REMOTE ] CNC: Full fetch complete (77847 records). [2025-10-16T18:07:56.232973] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-16T18:07:56.617731] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-16T18:07:56.617804] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-16T18:07:56.618705] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-16T18:07:56.618767] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-16T18:07:56.620193] [DEBUG] [LOCAL ] CNC: Trimmed 77847 records to 54160 (keeping 200 days of data) [2025-10-16T18:07:56.783968] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-16T18:07:56.944388] [DEBUG] [LOCAL ] CNC: Primary data saved (54160 records). [2025-10-16T18:07:56.944535] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-16T18:07:56.945215] [INFO ] [MAIN ] Update Progress: 492/2369 symbols completed. CNC took 51.8s. Estimated remaining: 4h 18m 60s. Rate: 7.2 symbols/min [2025-10-16T18:07:57.119373] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:07:57.158573] [DEBUG] [LOCAL ] CNNE: Loaded 35946 existing records from primary storage. [2025-10-16T18:07:57.158889] [INFO ] [MAIN ] CNNE: Loaded 35946 existing records. [2025-10-16T18:07:57.339810] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:07:57.340088] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-16T18:07:57.340218] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-16T18:07:57.345786] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-16T18:07:57.354864] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-16T18:07:57.398528] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T18:07:57.548579] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-16T18:07:57.728613] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:07:58.236115] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T18:07:58.342836] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-16T18:07:58.975205] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T18:07:59.142886] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-16T18:07:59.526675] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T18:07:59.942824] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-16T18:08:00.742818] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-16T18:08:00.878187] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T18:08:01.375927] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T18:08:01.542784] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-16T18:08:01.836862] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T18:08:02.342802] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-16T18:08:02.679573] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T18:08:03.142857] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-16T18:08:03.943044] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-16T18:08:03.948955] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T18:08:04.637466] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T18:08:04.742799] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-16T18:08:05.118254] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T18:08:05.542888] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-16T18:08:05.865682] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T18:08:06.342789] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-16T18:08:06.917274] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T18:08:07.142854] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-16T18:08:07.416258] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-16T18:08:07.942808] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-16T18:08:08.742814] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-16T18:08:08.868106] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T18:08:09.282676] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T18:08:09.542829] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-16T18:08:10.284134] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T18:08:10.342784] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-16T18:08:11.092113] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T18:08:11.142774] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-16T18:08:11.612599] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-16T18:08:11.942861] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-16T18:08:12.612181] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T18:08:12.742871] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-16T18:08:13.241263] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T18:08:13.542806] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-16T18:08:14.342841] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-16T18:08:14.456692] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-16T18:08:14.463405] [INFO ] [REMOTE ] CNK: Full fetch complete (76153 records). [2025-10-16T18:08:14.463515] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-16T18:08:14.855860] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-16T18:08:14.855974] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-16T18:08:14.856907] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-16T18:08:14.856982] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-16T18:08:14.858633] [DEBUG] [LOCAL ] CNK: Trimmed 76153 records to 53289 (keeping 200 days of data) [2025-10-16T18:08:14.988776] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T18:08:15.143793] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-16T18:08:15.233341] [DEBUG] [LOCAL ] CNK: Primary data saved (53289 records). [2025-10-16T18:08:15.233501] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-16T18:08:15.233578] [INFO ] [MAIN ] Update Progress: 493/2369 symbols completed. CNK took 38.5s. Estimated remaining: 4h 19m 29s. Rate: 7.2 symbols/min [2025-10-16T18:08:15.404853] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:08:15.441672] [DEBUG] [LOCAL ] CNO: Loaded 40648 existing records from primary storage. [2025-10-16T18:08:15.442022] [INFO ] [MAIN ] CNO: Loaded 40648 existing records. [2025-10-16T18:08:15.620336] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:08:15.620581] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-16T18:08:15.620681] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-16T18:08:15.621027] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-16T18:08:15.621165] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-16T18:08:15.893513] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T18:08:15.943630] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-16T18:08:16.030557] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:08:16.742789] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-16T18:08:17.022139] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T18:08:17.163522] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T18:08:17.542811] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-16T18:08:18.136024] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T18:08:18.342809] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-16T18:08:18.683455] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T18:08:19.142807] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-16T18:08:19.905807] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T18:08:19.942771] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-16T18:08:20.266879] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T18:08:20.742821] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-16T18:08:21.542810] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-16T18:08:21.615600] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T18:08:21.620363] [INFO ] [REMOTE ] CNNE: Full fetch complete (50560 records). [2025-10-16T18:08:21.620463] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-16T18:08:22.000719] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-16T18:08:22.000824] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-16T18:08:22.001630] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-16T18:08:22.001768] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-16T18:08:22.019793] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T18:08:22.026309] [DEBUG] [LOCAL ] CNNE: Trimmed 50560 records to 36234 (keeping 200 days of data) [2025-10-16T18:08:22.268043] [DEBUG] [LOCAL ] CNNE: Primary data saved (36234 records). [2025-10-16T18:08:22.268252] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-16T18:08:22.268395] [INFO ] [MAIN ] Update Progress: 494/2369 symbols completed. CNNE took 25.3s. Estimated remaining: 4h 19m 16s. Rate: 7.2 symbols/min [2025-10-16T18:08:22.347945] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-16T18:08:22.463601] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:08:22.515574] [DEBUG] [LOCAL ] CNP: Loaded 53480 existing records from primary storage. [2025-10-16T18:08:22.515932] [INFO ] [MAIN ] CNP: Loaded 53480 existing records. [2025-10-16T18:08:22.724626] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:08:22.724853] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-16T18:08:22.724901] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-16T18:08:22.725092] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-16T18:08:22.725131] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-16T18:08:23.141269] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:08:23.150406] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-16T18:08:23.167739] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T18:08:23.423416] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-16T18:08:23.427686] [INFO ] [REMOTE ] CNMD: Full fetch complete (47223 records). [2025-10-16T18:08:23.427781] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-16T18:08:23.835145] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-16T18:08:23.835241] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-16T18:08:23.836001] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-16T18:08:23.836067] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-16T18:08:23.837563] [DEBUG] [LOCAL ] CNMD: Trimmed 47223 records to 32319 (keeping 200 days of data) [2025-10-16T18:08:23.943730] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-16T18:08:24.035629] [DEBUG] [LOCAL ] CNMD: Primary data saved (32319 records). [2025-10-16T18:08:24.035791] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-16T18:08:24.036159] [INFO ] [MAIN ] Update Progress: 495/2369 symbols completed. CNMD took 29.5s. Estimated remaining: 4h 18m 43s. Rate: 7.2 symbols/min [2025-10-16T18:08:24.199176] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:08:24.248691] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-10-16T18:08:24.249064] [INFO ] [MAIN ] CNQ: Loaded 53582 existing records. [2025-10-16T18:08:24.431880] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:08:24.432051] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-16T18:08:24.432099] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-16T18:08:24.432306] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-16T18:08:24.432363] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-16T18:08:24.743698] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-16T18:08:24.804611] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:08:24.839772] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T18:08:25.542784] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-16T18:08:25.703590] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T18:08:26.195494] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T18:08:26.342803] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-16T18:08:27.139538] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T18:08:27.150099] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-16T18:08:27.572871] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T18:08:27.942856] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-16T18:08:28.742811] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-16T18:08:29.084880] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-16T18:08:29.542794] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-16T18:08:29.574824] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T18:08:30.003088] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T18:08:30.342815] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-16T18:08:31.142794] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-16T18:08:31.309797] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T18:08:31.576000] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T18:08:31.942821] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-16T18:08:32.128338] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T18:08:32.742871] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-16T18:08:33.542779] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-16T18:08:33.752154] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T18:08:33.869846] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T18:08:34.342864] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-16T18:08:35.142791] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-16T18:08:35.312617] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-16T18:08:35.942810] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-16T18:08:36.047561] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T18:08:36.707285] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T18:08:36.742804] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-16T18:08:37.542781] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-16T18:08:37.633272] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T18:08:38.304400] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T18:08:38.342777] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-16T18:08:38.898003] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T18:08:39.142819] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-16T18:08:39.859794] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T18:08:39.865130] [INFO ] [REMOTE ] CNO: Full fetch complete (60834 records). [2025-10-16T18:08:39.865275] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-16T18:08:39.947939] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-16T18:08:40.247344] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-16T18:08:40.247428] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-16T18:08:40.248250] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-16T18:08:40.248317] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-16T18:08:40.249571] [DEBUG] [LOCAL ] CNO: Trimmed 60834 records to 40958 (keeping 200 days of data) [2025-10-16T18:08:40.493158] [DEBUG] [LOCAL ] CNO: Primary data saved (40958 records). [2025-10-16T18:08:40.493313] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-16T18:08:40.493406] [INFO ] [MAIN ] Update Progress: 496/2369 symbols completed. CNO took 25.3s. Estimated remaining: 4h 19m 6s. Rate: 7.2 symbols/min [2025-10-16T18:08:40.658473] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:08:40.658710] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-16T18:08:40.658759] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-16T18:08:40.658893] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-16T18:08:40.658961] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-16T18:08:40.659021] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-16T18:08:40.659065] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-16T18:08:40.748784] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-16T18:08:41.025329] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:08:41.056817] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-16T18:08:41.542852] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-16T18:08:41.803502] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:08:41.803834] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-16T18:08:41.804041] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:08:41.804133] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-16T18:08:41.832311] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:08:41.832966] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-16T18:08:41.834104] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T18:08:41.834207] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-16T18:08:41.844806] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-16T18:08:41.845233] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-16T18:08:41.845636] [INFO ] [MAIN ] Update Progress: 497/2369 symbols completed. CNR took 1.4s. Estimated remaining: 4h 18m 31s. Rate: 7.2 symbols/min [2025-10-16T18:08:42.022964] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:08:42.045113] [DEBUG] [LOCAL ] CNS: Loaded 21154 existing records from primary storage. [2025-10-16T18:08:42.045366] [INFO ] [MAIN ] CNS: Loaded 21154 existing records. [2025-10-16T18:08:42.232455] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:08:42.232760] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-16T18:08:42.232931] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-16T18:08:42.233194] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-16T18:08:42.233320] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-16T18:08:42.347148] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-16T18:08:42.566585] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T18:08:42.656019] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:08:43.142814] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-16T18:08:43.942779] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-16T18:08:44.180796] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T18:08:44.373713] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-16T18:08:44.742816] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-16T18:08:45.529784] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T18:08:45.542778] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-16T18:08:46.342851] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-16T18:08:46.437707] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T18:08:47.142812] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-16T18:08:47.180044] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T18:08:47.903105] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T18:08:47.910616] [INFO ] [REMOTE ] CNM: Full fetch complete (73758 records). [2025-10-16T18:08:47.910824] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-16T18:08:47.950368] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-16T18:08:48.360342] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-16T18:08:48.360426] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-16T18:08:48.361364] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-16T18:08:48.361439] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-16T18:08:48.362871] [DEBUG] [LOCAL ] CNM: Trimmed 73758 records to 51414 (keeping 200 days of data) [2025-10-16T18:08:48.669016] [DEBUG] [LOCAL ] CNM: Primary data saved (51414 records). [2025-10-16T18:08:48.669160] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-16T18:08:48.670004] [INFO ] [MAIN ] Update Progress: 498/2369 symbols completed. CNM took 58.2s. Estimated remaining: 4h 18m 18s. Rate: 7.2 symbols/min [2025-10-16T18:08:48.745265] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-16T18:08:48.847753] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:08:48.898035] [DEBUG] [LOCAL ] CNX: Loaded 51367 existing records from primary storage. [2025-10-16T18:08:48.898576] [INFO ] [MAIN ] CNX: Loaded 51367 existing records. [2025-10-16T18:08:49.112403] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:08:49.115486] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-16T18:08:49.115324] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-16T18:08:49.115685] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-16T18:08:49.126517] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-16T18:08:49.126578] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-16T18:08:49.484757] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:08:49.542774] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-16T18:08:49.568682] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T18:08:49.860815] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T18:08:50.342839] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-16T18:08:50.954440] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T18:08:50.997822] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T18:08:51.142816] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-16T18:08:51.942848] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-16T18:08:52.376563] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-16T18:08:52.742857] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-16T18:08:53.430239] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T18:08:53.542833] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-16T18:08:53.888738] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T18:08:54.343016] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-16T18:08:55.144138] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-16T18:08:55.149951] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T18:08:55.443504] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T18:08:55.942811] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-16T18:08:56.742829] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-16T18:08:57.102191] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-16T18:08:57.431723] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T18:08:57.542791] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-16T18:08:57.638332] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T18:08:58.342813] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-16T18:08:59.142814] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-16T18:08:59.359572] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T18:08:59.947939] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-16T18:08:59.964865] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T18:09:00.660540] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T18:09:00.742792] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-16T18:09:01.155631] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-16T18:09:01.542814] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-16T18:09:02.342787] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-16T18:09:02.451843] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T18:09:02.753033] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-16T18:09:03.142782] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-16T18:09:03.942798] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-16T18:09:04.166155] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T18:09:04.173200] [INFO ] [REMOTE ] CNP: Full fetch complete (77548 records). [2025-10-16T18:09:04.173350] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-16T18:09:04.615064] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-16T18:09:04.615182] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-16T18:09:04.616437] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-16T18:09:04.616533] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-16T18:09:04.618286] [DEBUG] [LOCAL ] CNP: Trimmed 77548 records to 53869 (keeping 200 days of data) [2025-10-16T18:09:04.748704] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-16T18:09:04.895038] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T18:09:05.014109] [DEBUG] [LOCAL ] CNP: Primary data saved (53869 records). [2025-10-16T18:09:05.014252] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-16T18:09:05.014971] [INFO ] [MAIN ] Update Progress: 499/2369 symbols completed. CNP took 42.7s. Estimated remaining: 4h 18m 40s. Rate: 7.2 symbols/min [2025-10-16T18:09:05.184737] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:09:05.223420] [DEBUG] [LOCAL ] CODI: Loaded 41441 existing records from primary storage. [2025-10-16T18:09:05.223775] [INFO ] [MAIN ] CODI: Loaded 41441 existing records. [2025-10-16T18:09:05.407615] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:09:05.407860] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-16T18:09:05.407923] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-16T18:09:05.408293] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-16T18:09:05.408349] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-16T18:09:05.550406] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-16T18:09:05.772157] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:09:05.799408] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-16T18:09:06.021676] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T18:09:06.342875] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-16T18:09:07.142864] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-16T18:09:07.681418] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-16T18:09:07.688358] [INFO ] [REMOTE ] CNQ: Full fetch complete (77739 records). [2025-10-16T18:09:07.688492] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-16T18:09:07.950229] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-16T18:09:08.122315] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-16T18:09:08.122444] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-16T18:09:08.123505] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-16T18:09:08.123588] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-16T18:09:08.125155] [DEBUG] [LOCAL ] CNQ: Trimmed 77739 records to 53972 (keeping 200 days of data) [2025-10-16T18:09:08.398536] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-16T18:09:08.398156] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T18:09:08.416223] [INFO ] [REMOTE ] CNS: Full fetch complete (30884 records). [2025-10-16T18:09:08.424920] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-16T18:09:08.744188] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-16T18:09:08.935227] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-16T18:09:08.937535] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-16T18:09:08.939520] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-16T18:09:08.941580] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-16T18:09:08.945667] [DEBUG] [LOCAL ] CNS: Trimmed 30884 records to 21369 (keeping 200 days of data) [2025-10-16T18:09:09.022986] [DEBUG] [LOCAL ] CNQ: Primary data saved (53972 records). [2025-10-16T18:09:09.032942] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-16T18:09:09.061852] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T18:09:09.060772] [INFO ] [MAIN ] Update Progress: 500/2369 symbols completed. CNQ took 45.0s. Estimated remaining: 4h 18m 15s. Rate: 7.2 symbols/min [2025-10-16T18:09:09.257780] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:09:09.289682] [DEBUG] [LOCAL ] CNS: Primary data saved (21369 records). [2025-10-16T18:09:09.289823] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-16T18:09:09.289900] [INFO ] [MAIN ] Update Progress: 501/2369 symbols completed. CNS took 27.4s. Estimated remaining: 4h 17m 37s. Rate: 7.3 symbols/min [2025-10-16T18:09:09.477121] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:09:09.493049] [DEBUG] [LOCAL ] COF: Loaded 53622 existing records from primary storage. [2025-10-16T18:09:09.493450] [INFO ] [MAIN ] COF: Loaded 53622 existing records. [2025-10-16T18:09:09.555774] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-16T18:09:09.680599] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:09:09.681166] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-16T18:09:09.681237] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-16T18:09:09.681728] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-16T18:09:09.681797] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-16T18:09:09.953315] [DEBUG] [LOCAL ] COHR: Loaded 53381 existing records from primary storage. [2025-10-16T18:09:09.979815] [INFO ] [MAIN ] COHR: Loaded 53381 existing records. [2025-10-16T18:09:10.223801] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:09:10.265898] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:09:10.266255] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-16T18:09:10.266405] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-16T18:09:10.266674] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-16T18:09:10.266734] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-16T18:09:10.347889] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-16T18:09:10.657215] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T18:09:10.704948] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-16T18:09:10.734858] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:09:11.142809] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-16T18:09:11.942807] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-16T18:09:12.052074] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T18:09:12.156803] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T18:09:12.742813] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-16T18:09:13.542836] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-16T18:09:13.666999] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T18:09:14.342820] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-16T18:09:14.473858] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T18:09:15.142887] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-16T18:09:15.474667] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-16T18:09:15.660898] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T18:09:15.942815] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-16T18:09:16.742844] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-16T18:09:17.068098] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-16T18:09:17.542792] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-16T18:09:17.758758] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T18:09:17.788215] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T18:09:18.342813] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-16T18:09:19.142780] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-16T18:09:19.488628] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T18:09:19.942835] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-16T18:09:20.365045] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-16T18:09:20.742850] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-16T18:09:20.954141] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-16T18:09:20.960902] [INFO ] [REMOTE ] CNX: Full fetch complete (74939 records). [2025-10-16T18:09:20.961053] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-16T18:09:21.344244] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-16T18:09:21.344327] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-16T18:09:21.345236] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-16T18:09:21.345300] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-16T18:09:21.346719] [DEBUG] [LOCAL ] CNX: Trimmed 74939 records to 51742 (keeping 200 days of data) [2025-10-16T18:09:21.543274] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-16T18:09:21.646215] [DEBUG] [LOCAL ] CNX: Primary data saved (51742 records). [2025-10-16T18:09:21.646347] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-16T18:09:21.647048] [INFO ] [MAIN ] Update Progress: 502/2369 symbols completed. CNX took 33.0s. Estimated remaining: 4h 17m 44s. Rate: 7.2 symbols/min [2025-10-16T18:09:21.821108] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:09:21.874186] [DEBUG] [LOCAL ] COLD: Loaded 52391 existing records from primary storage. [2025-10-16T18:09:21.874501] [INFO ] [MAIN ] COLD: Loaded 52391 existing records. [2025-10-16T18:09:22.054280] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:09:22.054801] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-16T18:09:22.055060] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-16T18:09:22.055400] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-16T18:09:22.055530] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-16T18:09:22.212755] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-16T18:09:22.342893] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-16T18:09:22.412755] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T18:09:22.491812] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:09:23.142834] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-16T18:09:23.383283] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T18:09:23.950574] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-16T18:09:23.956395] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T18:09:24.456479] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T18:09:24.742872] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-16T18:09:25.542837] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-16T18:09:25.696261] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T18:09:26.342796] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-16T18:09:26.422321] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T18:09:27.142820] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-16T18:09:27.224008] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T18:09:27.942803] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-16T18:09:28.006768] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-16T18:09:28.742843] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-16T18:09:28.981153] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-16T18:09:29.125147] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-16T18:09:29.542805] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-16T18:09:30.342771] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-16T18:09:30.556391] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T18:09:30.836165] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T18:09:31.142865] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-16T18:09:31.942840] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-16T18:09:32.025313] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T18:09:32.277037] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T18:09:32.742814] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-16T18:09:33.542795] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-16T18:09:34.002853] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T18:09:34.342795] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-16T18:09:34.395805] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T18:09:34.401804] [INFO ] [REMOTE ] CODI: Full fetch complete (52860 records). [2025-10-16T18:09:34.401913] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-16T18:09:34.787214] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-16T18:09:34.787319] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-16T18:09:34.788139] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-16T18:09:34.788222] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-16T18:09:34.789597] [DEBUG] [LOCAL ] CODI: Trimmed 52860 records to 41807 (keeping 200 days of data) [2025-10-16T18:09:35.058979] [DEBUG] [LOCAL ] CODI: Primary data saved (41807 records). [2025-10-16T18:09:35.059757] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-16T18:09:35.059881] [INFO ] [MAIN ] Update Progress: 503/2369 symbols completed. CODI took 30.0s. Estimated remaining: 4h 17m 55s. Rate: 7.2 symbols/min [2025-10-16T18:09:35.061177] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T18:09:35.147102] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-16T18:09:35.253743] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:09:35.303551] [DEBUG] [LOCAL ] COMP: Loaded 53406 existing records from primary storage. [2025-10-16T18:09:35.303967] [INFO ] [MAIN ] COMP: Loaded 53406 existing records. [2025-10-16T18:09:35.476094] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:09:35.476334] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-16T18:09:35.476406] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-16T18:09:35.476834] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-16T18:09:35.476891] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-16T18:09:35.822487] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:09:35.942789] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-16T18:09:36.455323] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-16T18:09:36.742809] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-16T18:09:37.542849] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-16T18:09:37.601322] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-16T18:09:37.679764] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T18:09:38.342794] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-16T18:09:38.449368] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T18:09:38.878865] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T18:09:39.142884] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-16T18:09:39.949096] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-16T18:09:39.959569] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T18:09:40.742820] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-16T18:09:41.453390] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-16T18:09:41.460305] [INFO ] [REMOTE ] COHR: Full fetch complete (77056 records). [2025-10-16T18:09:41.460453] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-16T18:09:41.461466] [FATAL] [VALIDATOR ] COHR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:09:41.461619] [FATAL] [MAIN ] COHR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:09:41.461815] [WARN ] [MAIN ] COHR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:09:41.461931] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-16T18:09:41.462001] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-16T18:09:41.462105] [INFO ] [LOCAL ] COHR: Starting deletion of derivative data. [2025-10-16T18:09:41.462275] [DEBUG] [LOCAL ] COHR: Deleted derivative data file. [2025-10-16T18:09:41.462848] [INFO ] [MAIN ] Update Progress: 504/2369 symbols completed. COHR took 32.2s. Estimated remaining: 4h 17m 39s. Rate: 7.2 symbols/min [2025-10-16T18:09:41.553696] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-16T18:09:41.645192] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:09:41.675531] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T18:09:41.728730] [DEBUG] [LOCAL ] CON: Loaded 38935 existing records from primary storage. [2025-10-16T18:09:41.729086] [INFO ] [MAIN ] CON: Loaded 38935 existing records. [2025-10-16T18:09:41.905451] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:09:41.905681] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-16T18:09:41.905739] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-16T18:09:41.905971] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-16T18:09:41.906008] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-16T18:09:42.263178] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:09:42.342795] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-16T18:09:42.677300] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-16T18:09:42.965604] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T18:09:43.142814] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-16T18:09:43.942808] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-16T18:09:44.006570] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T18:09:44.356772] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-16T18:09:44.364332] [INFO ] [REMOTE ] COF: Full fetch complete (77647 records). [2025-10-16T18:09:44.364472] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-16T18:09:44.759474] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-16T18:09:44.755383] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-16T18:09:44.759913] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-16T18:09:44.762425] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-16T18:09:44.762635] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-16T18:09:44.795066] [DEBUG] [LOCAL ] COF: Trimmed 77647 records to 54012 (keeping 200 days of data) [2025-10-16T18:09:44.796668] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T18:09:45.146728] [DEBUG] [LOCAL ] COF: Primary data saved (54012 records). [2025-10-16T18:09:45.146879] [INFO ] [MAIN ] COF: Full history saved. [2025-10-16T18:09:45.147237] [INFO ] [MAIN ] Update Progress: 505/2369 symbols completed. COF took 36.1s. Estimated remaining: 4h 17m 14s. Rate: 7.2 symbols/min [2025-10-16T18:09:45.312016] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:09:45.339979] [DEBUG] [LOCAL ] COOK: Loaded 24994 existing records from primary storage. [2025-10-16T18:09:45.340278] [INFO ] [MAIN ] COOK: Loaded 24994 existing records. [2025-10-16T18:09:45.525537] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:09:45.525841] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-16T18:09:45.525900] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-16T18:09:45.526133] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-16T18:09:45.526188] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-16T18:09:45.548052] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-16T18:09:45.880485] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:09:45.911631] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T18:09:46.342820] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-16T18:09:46.953254] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T18:09:47.142843] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-16T18:09:47.647260] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T18:09:47.942815] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-16T18:09:48.346456] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T18:09:48.742812] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-16T18:09:49.205546] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-16T18:09:49.542859] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-16T18:09:50.342806] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-16T18:09:50.579586] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T18:09:50.812579] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T18:09:51.142850] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-16T18:09:51.942848] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-16T18:09:52.372605] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-16T18:09:52.742830] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-16T18:09:53.116744] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T18:09:53.247402] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-16T18:09:53.340276] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-16T18:09:53.542821] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-16T18:09:54.342898] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-16T18:09:55.142822] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-16T18:09:55.283822] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T18:09:55.866867] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-16T18:09:55.932809] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T18:09:55.942772] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-16T18:09:56.742859] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-16T18:09:57.464208] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T18:09:57.531507] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T18:09:57.542761] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-16T18:09:58.342831] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-16T18:09:58.954948] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T18:09:59.142874] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-16T18:09:59.942848] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-16T18:10:00.094005] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T18:10:00.128132] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T18:10:00.742810] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-16T18:10:01.542872] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-16T18:10:02.301135] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-16T18:10:02.308071] [INFO ] [REMOTE ] COLD: Full fetch complete (74737 records). [2025-10-16T18:10:02.308226] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-16T18:10:02.352335] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-16T18:10:02.716309] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-16T18:10:02.721723] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-16T18:10:02.731362] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-16T18:10:02.731520] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-16T18:10:02.733461] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-16T18:10:02.740223] [DEBUG] [LOCAL ] COLD: Trimmed 74737 records to 52781 (keeping 200 days of data) [2025-10-16T18:10:03.021728] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-16T18:10:03.116906] [DEBUG] [LOCAL ] COLD: Primary data saved (52781 records). [2025-10-16T18:10:03.117087] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-16T18:10:03.117784] [INFO ] [MAIN ] Update Progress: 506/2369 symbols completed. COLD took 41.5s. Estimated remaining: 4h 17m 42s. Rate: 7.2 symbols/min [2025-10-16T18:10:03.148462] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-16T18:10:03.290185] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:10:03.344357] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-16T18:10:03.344701] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-10-16T18:10:03.519333] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:10:03.519534] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-16T18:10:03.519580] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-16T18:10:03.519783] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-16T18:10:03.519839] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-16T18:10:03.870964] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:10:03.942779] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-16T18:10:04.111763] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T18:10:04.182109] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T18:10:04.742822] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-16T18:10:05.542794] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-16T18:10:05.704109] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T18:10:06.342854] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-16T18:10:06.443131] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T18:10:07.015903] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T18:10:07.021998] [INFO ] [REMOTE ] CON: Full fetch complete (56944 records). [2025-10-16T18:10:07.022126] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-16T18:10:07.144530] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-16T18:10:07.398024] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T18:10:07.491572] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-16T18:10:07.491677] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-16T18:10:07.492433] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-16T18:10:07.492475] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-16T18:10:07.493506] [DEBUG] [LOCAL ] CON: Trimmed 56944 records to 39243 (keeping 200 days of data) [2025-10-16T18:10:07.722316] [DEBUG] [LOCAL ] CON: Primary data saved (39243 records). [2025-10-16T18:10:07.722448] [INFO ] [MAIN ] CON: Full history saved. [2025-10-16T18:10:07.722525] [INFO ] [MAIN ] Update Progress: 507/2369 symbols completed. CON took 26.3s. Estimated remaining: 4h 17m 20s. Rate: 7.2 symbols/min [2025-10-16T18:10:07.913440] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:10:07.942817] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-16T18:10:07.957492] [DEBUG] [LOCAL ] COR: Loaded 46611 existing records from primary storage. [2025-10-16T18:10:07.958021] [INFO ] [MAIN ] COR: Loaded 46611 existing records. [2025-10-16T18:10:08.128554] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:10:08.128744] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-16T18:10:08.128813] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-16T18:10:08.129171] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-16T18:10:08.129215] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-16T18:10:08.465015] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:10:08.742814] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-16T18:10:09.171479] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-16T18:10:09.542854] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-16T18:10:09.814793] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T18:10:10.274085] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T18:10:10.342808] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-16T18:10:11.148064] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-16T18:10:11.162471] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T18:10:11.942790] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-16T18:10:12.196504] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T18:10:12.742793] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-16T18:10:12.990417] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-16T18:10:13.542849] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-16T18:10:13.875793] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T18:10:14.233310] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-16T18:10:14.342819] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-16T18:10:15.142786] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-16T18:10:15.533300] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-16T18:10:15.902745] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T18:10:15.942778] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-16T18:10:16.742787] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-16T18:10:17.106309] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T18:10:17.118114] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T18:10:17.126059] [INFO ] [REMOTE ] COOK: Full fetch complete (33194 records). [2025-10-16T18:10:17.126246] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-16T18:10:17.126550] [INFO ] [REMOTE ] COMP: Full fetch complete (77392 records). [2025-10-16T18:10:17.170016] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-16T18:10:17.546711] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-16T18:10:17.819382] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-16T18:10:17.824614] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-16T18:10:17.842799] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-16T18:10:17.852598] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-16T18:10:17.902970] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-16T18:10:17.903201] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-16T18:10:17.903131] [DEBUG] [LOCAL ] COOK: Trimmed 33194 records to 25126 (keeping 200 days of data) [2025-10-16T18:10:17.904374] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-16T18:10:17.904468] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-16T18:10:17.947184] [DEBUG] [LOCAL ] COMP: Trimmed 77392 records to 53796 (keeping 200 days of data) [2025-10-16T18:10:18.143978] [DEBUG] [LOCAL ] COOK: Primary data saved (25126 records). [2025-10-16T18:10:18.144609] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-16T18:10:18.144964] [INFO ] [MAIN ] Update Progress: 508/2369 symbols completed. COOK took 33.0s. Estimated remaining: 4h 17m 19s. Rate: 7.2 symbols/min [2025-10-16T18:10:18.372154] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:10:18.533738] [DEBUG] [LOCAL ] COTY: Loaded 53271 existing records from primary storage. [2025-10-16T18:10:18.539794] [INFO ] [MAIN ] COTY: Loaded 53271 existing records. [2025-10-16T18:10:18.669592] [DEBUG] [LOCAL ] COMP: Primary data saved (53796 records). [2025-10-16T18:10:18.729992] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-16T18:10:18.763805] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:10:18.773384] [INFO ] [MAIN ] Update Progress: 509/2369 symbols completed. COMP took 43.7s. Estimated remaining: 4h 16m 43s. Rate: 7.2 symbols/min [2025-10-16T18:10:18.778976] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-16T18:10:18.806009] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-16T18:10:18.834212] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-16T18:10:18.843117] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-16T18:10:18.865963] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-16T18:10:18.896741] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-16T18:10:19.125764] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:10:19.327768] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:10:19.328298] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-16T18:10:19.373347] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-16T18:10:19.400516] [DEBUG] [LOCAL ] COUR: Loaded 49310 existing records from primary storage. [2025-10-16T18:10:19.400897] [INFO ] [MAIN ] COUR: Loaded 49310 existing records. [2025-10-16T18:10:19.603849] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:10:19.604097] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-16T18:10:19.604161] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-16T18:10:19.604564] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-16T18:10:19.604621] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-16T18:10:19.947982] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-16T18:10:20.028412] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:10:20.742783] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-16T18:10:21.031703] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-16T18:10:21.212505] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T18:10:21.542822] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-16T18:10:21.636794] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T18:10:22.052254] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T18:10:22.342840] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-16T18:10:23.142828] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-16T18:10:23.613489] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-16T18:10:23.942875] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-16T18:10:24.214632] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-16T18:10:24.742815] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-16T18:10:24.806605] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T18:10:25.542832] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-16T18:10:25.828369] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T18:10:26.342793] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-16T18:10:26.561441] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T18:10:27.142867] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-16T18:10:27.238676] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T18:10:27.942879] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-16T18:10:28.017104] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T18:10:28.746372] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-16T18:10:28.751153] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T18:10:29.477937] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T18:10:29.542777] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-16T18:10:30.342878] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-16T18:10:30.414198] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T18:10:31.142847] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-16T18:10:31.395221] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T18:10:31.942792] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-16T18:10:32.399637] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-16T18:10:32.623143] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T18:10:32.742845] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-16T18:10:33.542800] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-16T18:10:33.648167] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T18:10:34.295902] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T18:10:34.342775] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-16T18:10:35.142814] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-16T18:10:35.272733] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T18:10:35.889222] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T18:10:35.942797] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-16T18:10:36.549724] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T18:10:36.742854] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-16T18:10:37.259583] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T18:10:37.265453] [INFO ] [REMOTE ] COR: Full fetch complete (68592 records). [2025-10-16T18:10:37.265632] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-16T18:10:37.548030] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-16T18:10:37.690860] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-16T18:10:37.690988] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-16T18:10:37.692479] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-16T18:10:37.692554] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-16T18:10:37.694503] [DEBUG] [LOCAL ] COR: Trimmed 68592 records to 46937 (keeping 200 days of data) [2025-10-16T18:10:38.014939] [DEBUG] [LOCAL ] COR: Primary data saved (46937 records). [2025-10-16T18:10:38.015156] [INFO ] [MAIN ] COR: Full history saved. [2025-10-16T18:10:38.016174] [INFO ] [MAIN ] Update Progress: 510/2369 symbols completed. COR took 30.3s. Estimated remaining: 4h 17m 15s. Rate: 7.2 symbols/min [2025-10-16T18:10:38.206832] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:10:38.267492] [DEBUG] [LOCAL ] CP: Loaded 53238 existing records from primary storage. [2025-10-16T18:10:38.267958] [INFO ] [MAIN ] CP: Loaded 53238 existing records. [2025-10-16T18:10:38.358245] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-16T18:10:38.465365] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:10:38.465702] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-16T18:10:38.465938] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-16T18:10:38.485993] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-16T18:10:38.486767] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-16T18:10:38.488244] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T18:10:38.564626] [INFO ] [REMOTE ] COP: Full fetch complete (77906 records). [2025-10-16T18:10:38.576198] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-16T18:10:38.728616] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T18:10:39.187548] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-16T18:10:39.205798] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:10:39.304866] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-16T18:10:39.304947] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-16T18:10:39.305900] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-16T18:10:39.305964] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-16T18:10:39.307399] [DEBUG] [LOCAL ] COP: Trimmed 77906 records to 54117 (keeping 200 days of data) [2025-10-16T18:10:39.631864] [DEBUG] [LOCAL ] COP: Primary data saved (54117 records). [2025-10-16T18:10:39.632148] [INFO ] [MAIN ] COP: Full history saved. [2025-10-16T18:10:39.633001] [INFO ] [MAIN ] Update Progress: 511/2369 symbols completed. COP took 36.5s. Estimated remaining: 4h 16m 42s. Rate: 7.2 symbols/min [2025-10-16T18:10:39.797924] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:10:39.827361] [DEBUG] [LOCAL ] CPA: Loaded 28423 existing records from primary storage. [2025-10-16T18:10:39.827677] [INFO ] [MAIN ] CPA: Loaded 28423 existing records. [2025-10-16T18:10:39.947928] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-16T18:10:40.013268] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:10:40.013741] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-16T18:10:40.013823] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-16T18:10:40.014050] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-16T18:10:40.014108] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-16T18:10:40.368920] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:10:40.397177] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-16T18:10:40.504421] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T18:10:40.742819] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-16T18:10:41.519941] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T18:10:41.542769] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-16T18:10:42.342808] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-16T18:10:42.414576] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T18:10:43.097621] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T18:10:43.142778] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-16T18:10:43.466232] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T18:10:43.942867] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-16T18:10:44.742840] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-16T18:10:44.827224] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T18:10:45.542842] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-16T18:10:45.679434] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T18:10:46.342797] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-16T18:10:46.405320] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T18:10:47.142782] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-16T18:10:47.669524] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-16T18:10:47.715405] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T18:10:47.942846] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-16T18:10:48.742818] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-16T18:10:48.962905] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T18:10:49.086938] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T18:10:49.542834] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-16T18:10:50.342891] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-16T18:10:50.563616] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T18:10:51.142910] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-16T18:10:51.415339] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T18:10:51.673327] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T18:10:51.942799] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-16T18:10:52.742809] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-16T18:10:53.542908] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-16T18:10:54.290615] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T18:10:54.342815] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-16T18:10:54.982883] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T18:10:55.142803] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-16T18:10:55.942313] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T18:10:55.949676] [INFO ] [REMOTE ] COTY: Full fetch complete (77290 records). [2025-10-16T18:10:55.949812] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-16T18:10:56.379271] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-16T18:10:56.379398] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-16T18:10:56.380594] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-16T18:10:56.380751] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-16T18:10:56.382365] [DEBUG] [LOCAL ] COTY: Trimmed 77290 records to 53658 (keeping 200 days of data) [2025-10-16T18:10:56.525393] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (5.38 seconds). [2025-10-16T18:10:56.526572] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T18:10:56.571850] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-16T18:10:56.745436] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-16T18:10:56.770608] [DEBUG] [LOCAL ] COTY: Primary data saved (53658 records). [2025-10-16T18:10:56.770776] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-16T18:10:56.770873] [INFO ] [MAIN ] Update Progress: 512/2369 symbols completed. COTY took 38.6s. Estimated remaining: 4h 17m 6s. Rate: 7.2 symbols/min [2025-10-16T18:10:56.943871] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:10:56.944052] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-16T18:10:56.944089] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-16T18:10:56.944200] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-16T18:10:56.944241] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-16T18:10:56.944280] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-16T18:10:56.944313] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-16T18:10:57.351220] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (5.41 seconds). [2025-10-16T18:10:57.383030] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:10:57.390099] [INFO ] [REMOTE ] COUR: Full fetch complete (71042 records). [2025-10-16T18:10:57.390250] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-16T18:10:57.547966] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-16T18:10:57.811605] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-16T18:10:57.811810] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-16T18:10:57.812691] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-16T18:10:57.812915] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-16T18:10:57.832954] [DEBUG] [LOCAL ] COUR: Trimmed 71042 records to 49681 (keeping 200 days of data) [2025-10-16T18:10:57.835249] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T18:10:58.176973] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T18:10:58.183615] [DEBUG] [LOCAL ] COUR: Primary data saved (49681 records). [2025-10-16T18:10:58.183969] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-16T18:10:58.194278] [INFO ] [MAIN ] Update Progress: 513/2369 symbols completed. COUR took 39.4s. Estimated remaining: 4h 16m 33s. Rate: 7.2 symbols/min [2025-10-16T18:10:58.304441] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-16T18:10:58.351773] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-16T18:10:58.379688] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:10:58.411885] [DEBUG] [LOCAL ] CPAY: Loaded 30434 existing records from primary storage. [2025-10-16T18:10:58.412201] [INFO ] [MAIN ] CPAY: Loaded 30434 existing records. [2025-10-16T18:10:58.592741] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:10:58.593004] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-16T18:10:58.593056] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-16T18:10:58.593397] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-16T18:10:58.593453] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-16T18:10:58.778469] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-16T18:10:58.971937] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:10:59.142815] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-16T18:10:59.445059] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-16T18:10:59.942896] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-16T18:11:00.742855] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-16T18:11:01.097472] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-16T18:11:01.360976] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T18:11:01.542891] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-16T18:11:02.342835] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-16T18:11:02.766165] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-16T18:11:03.055546] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T18:11:03.142808] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-16T18:11:03.942818] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-16T18:11:04.540211] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T18:11:04.742800] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-16T18:11:05.398753] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T18:11:05.542796] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-16T18:11:06.337142] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T18:11:06.346185] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-16T18:11:06.943366] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T18:11:07.142822] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-16T18:11:07.672215] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T18:11:07.942827] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-16T18:11:08.339702] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-16T18:11:08.509921] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T18:11:08.742821] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-16T18:11:09.542832] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-16T18:11:10.342875] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-16T18:11:10.566098] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T18:11:10.631341] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-16T18:11:10.765048] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-16T18:11:11.142829] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-16T18:11:11.942801] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-16T18:11:12.742790] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-16T18:11:12.865068] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T18:11:12.871882] [INFO ] [REMOTE ] CP: Full fetch complete (77299 records). [2025-10-16T18:11:12.872036] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-16T18:11:13.264483] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-16T18:11:13.264584] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-16T18:11:13.265718] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-16T18:11:13.265846] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-16T18:11:13.267490] [DEBUG] [LOCAL ] CP: Trimmed 77299 records to 53628 (keeping 200 days of data) [2025-10-16T18:11:13.380944] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T18:11:13.570612] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-16T18:11:13.618468] [DEBUG] [LOCAL ] CP: Primary data saved (53628 records). [2025-10-16T18:11:13.618586] [INFO ] [MAIN ] CP: Full history saved. [2025-10-16T18:11:13.619321] [INFO ] [MAIN ] Update Progress: 514/2369 symbols completed. CP took 35.6s. Estimated remaining: 4h 16m 50s. Rate: 7.2 symbols/min [2025-10-16T18:11:13.784024] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:11:13.801249] [DEBUG] [LOCAL ] CPF: Loaded 15271 existing records from primary storage. [2025-10-16T18:11:13.801440] [INFO ] [MAIN ] CPF: Loaded 15271 existing records. [2025-10-16T18:11:14.008180] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:11:14.008383] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-16T18:11:14.008456] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-16T18:11:14.008910] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-16T18:11:14.009027] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-16T18:11:14.092372] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-16T18:11:14.122053] [INFO ] [REMOTE ] CPA: Full fetch complete (41436 records). [2025-10-16T18:11:14.122396] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-16T18:11:14.353323] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-16T18:11:14.749801] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:11:14.760435] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-16T18:11:14.760808] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-16T18:11:14.761945] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-16T18:11:14.762083] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-16T18:11:14.763271] [DEBUG] [LOCAL ] CPA: Trimmed 41436 records to 28578 (keeping 200 days of data) [2025-10-16T18:11:14.959994] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T18:11:14.963793] [DEBUG] [LOCAL ] CPA: Primary data saved (28578 records). [2025-10-16T18:11:14.971749] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-16T18:11:14.974936] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T18:11:14.974826] [INFO ] [MAIN ] Update Progress: 515/2369 symbols completed. CPA took 35.3s. Estimated remaining: 4h 16m 17s. Rate: 7.2 symbols/min [2025-10-16T18:11:15.148558] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:11:15.148711] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-16T18:11:15.165132] [DEBUG] [LOCAL ] CPK: Loaded 13940 existing records from primary storage. [2025-10-16T18:11:15.165386] [INFO ] [MAIN ] CPK: Loaded 13940 existing records. [2025-10-16T18:11:15.341951] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:11:15.342170] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-16T18:11:15.342245] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-16T18:11:15.342560] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-16T18:11:15.342603] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-16T18:11:15.698912] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:11:15.942858] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-16T18:11:16.298778] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-16T18:11:16.611171] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T18:11:16.742875] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-16T18:11:17.164824] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-16T18:11:17.542894] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-16T18:11:18.342815] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-16T18:11:18.832707] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T18:11:19.142826] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-16T18:11:19.540393] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T18:11:19.942781] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-16T18:11:20.127130] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T18:11:20.742844] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-16T18:11:20.998989] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T18:11:21.268233] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-16T18:11:21.269106] [INFO ] [REMOTE ] CPAC: Full fetch complete (1808 records). [2025-10-16T18:11:21.269174] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-16T18:11:21.448211] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T18:11:21.448412] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:11:21.448481] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:11:21.448532] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-16T18:11:21.448589] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-16T18:11:21.448626] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-16T18:11:21.448712] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-16T18:11:21.448781] [INFO ] [MAIN ] Update Progress: 516/2369 symbols completed. CPAC took 24.7s. Estimated remaining: 4h 16m 2s. Rate: 7.2 symbols/min [2025-10-16T18:11:21.550580] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-16T18:11:21.623184] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:11:21.671748] [DEBUG] [LOCAL ] CPNG: Loaded 53679 existing records from primary storage. [2025-10-16T18:11:21.672067] [INFO ] [MAIN ] CPNG: Loaded 53679 existing records. [2025-10-16T18:11:21.847566] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:11:21.847772] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-16T18:11:21.847820] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-16T18:11:21.848569] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-16T18:11:21.848625] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-16T18:11:22.195268] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:11:22.342782] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-16T18:11:22.669150] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T18:11:23.142864] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-16T18:11:23.767255] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-16T18:11:23.942819] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-16T18:11:24.323254] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-16T18:11:24.742789] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-16T18:11:24.803179] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-16T18:11:25.542859] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-16T18:11:26.342795] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-16T18:11:26.557805] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T18:11:26.743613] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-16T18:11:27.040801] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-16T18:11:27.142807] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-16T18:11:27.865744] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T18:11:27.942797] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-16T18:11:28.742872] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-16T18:11:29.542847] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-16T18:11:29.970198] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T18:11:30.005793] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-16T18:11:30.342831] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-16T18:11:30.734552] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T18:11:31.142815] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-16T18:11:31.942824] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-16T18:11:32.272450] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T18:11:32.445563] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-16T18:11:32.682738] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T18:11:32.742810] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-16T18:11:33.542808] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-16T18:11:33.652082] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T18:11:34.342808] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-16T18:11:35.142791] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-16T18:11:35.212105] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T18:11:35.697364] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-16T18:11:35.942833] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-16T18:11:36.391413] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T18:11:36.742848] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-16T18:11:37.542818] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-16T18:11:38.110295] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T18:11:38.114738] [INFO ] [REMOTE ] CPAY: Full fetch complete (44918 records). [2025-10-16T18:11:38.114914] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-16T18:11:38.269783] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-16T18:11:38.343591] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-16T18:11:38.459794] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-16T18:11:38.579672] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-16T18:11:38.579780] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-16T18:11:38.580625] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-16T18:11:38.580710] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-16T18:11:38.581715] [DEBUG] [LOCAL ] CPAY: Trimmed 44918 records to 30724 (keeping 200 days of data) [2025-10-16T18:11:38.784898] [DEBUG] [LOCAL ] CPAY: Primary data saved (30724 records). [2025-10-16T18:11:38.785040] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-16T18:11:38.785124] [INFO ] [MAIN ] Update Progress: 517/2369 symbols completed. CPAY took 40.6s. Estimated remaining: 4h 16m 26s. Rate: 7.2 symbols/min [2025-10-16T18:11:39.143005] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-16T18:11:39.222390] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T18:11:39.942811] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-16T18:11:40.674227] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T18:11:40.742798] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-16T18:11:40.831503] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T18:11:41.388339] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T18:11:41.542808] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-16T18:11:42.342793] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-16T18:11:42.645806] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T18:11:42.648430] [INFO ] [REMOTE ] CPK: Full fetch complete (18501 records). [2025-10-16T18:11:42.648502] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-16T18:11:43.009861] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-16T18:11:43.009935] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-16T18:11:43.010309] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-16T18:11:43.010347] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-16T18:11:43.010904] [DEBUG] [LOCAL ] CPK: Trimmed 18501 records to 14061 (keeping 200 days of data) [2025-10-16T18:11:43.098176] [DEBUG] [LOCAL ] CPK: Primary data saved (14061 records). [2025-10-16T18:11:43.098308] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-16T18:11:43.098383] [INFO ] [MAIN ] Update Progress: 518/2369 symbols completed. CPK took 28.1s. Estimated remaining: 4h 16m 3s. Rate: 7.2 symbols/min [2025-10-16T18:11:43.142889] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-16T18:11:44.098969] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T18:11:44.104214] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-16T18:11:44.557974] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-16T18:11:44.742830] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-16T18:11:45.033384] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T18:11:45.542876] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-16T18:11:46.216995] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-16T18:11:46.342834] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-16T18:11:46.818541] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-16T18:11:47.142781] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-16T18:11:47.313230] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T18:11:47.315857] [INFO ] [REMOTE ] CPF: Full fetch complete (23633 records). [2025-10-16T18:11:47.315928] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-16T18:11:47.673556] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-16T18:11:47.673723] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-16T18:11:47.674268] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-16T18:11:47.674329] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-16T18:11:47.675044] [DEBUG] [LOCAL ] CPF: Trimmed 23633 records to 15396 (keeping 200 days of data) [2025-10-16T18:11:47.764773] [DEBUG] [LOCAL ] CPF: Primary data saved (15396 records). [2025-10-16T18:11:47.764904] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-16T18:11:47.764979] [INFO ] [MAIN ] Update Progress: 519/2369 symbols completed. CPF took 34.1s. Estimated remaining: 4h 15m 42s. Rate: 7.2 symbols/min [2025-10-16T18:11:49.228693] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-16T18:11:49.240220] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-16T18:11:51.637618] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-16T18:11:51.644438] [INFO ] [REMOTE ] CPNG: Full fetch complete (77780 records). [2025-10-16T18:11:51.644561] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-16T18:11:52.031257] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-16T18:11:52.031342] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-16T18:11:52.032263] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-16T18:11:52.032326] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-16T18:11:52.033858] [DEBUG] [LOCAL ] CPNG: Trimmed 77780 records to 54069 (keeping 200 days of data) [2025-10-16T18:11:52.353847] [DEBUG] [LOCAL ] CPNG: Primary data saved (54069 records). [2025-10-16T18:11:52.354018] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-16T18:11:52.354115] [INFO ] [MAIN ] Update Progress: 520/2369 symbols completed. CPNG took 30.9s. Estimated remaining: 4h 15m 21s. Rate: 7.2 symbols/min [2025-10-16T18:11:52.993363] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:11:53.083154] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:11:53.087336] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:11:53.107154] [DEBUG] [LOCAL ] CPT: No existing data file found in primary storage. [2025-10-16T18:11:53.116563] [WARN ] [MAIN ] CPT: No existing data found, performing full refresh instead. [2025-10-16T18:11:53.118677] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:11:53.122894] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-16T18:11:53.123949] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-16T18:11:53.124109] [DEBUG] [LOCAL ] CPT: No primary data file found to delete. [2025-10-16T18:11:53.124160] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-16T18:11:53.234243] [DEBUG] [LOCAL ] CPS: Loaded 25220 existing records from primary storage. [2025-10-16T18:11:53.252873] [INFO ] [MAIN ] CPS: Loaded 25220 existing records. [2025-10-16T18:11:53.267373] [DEBUG] [LOCAL ] CQP: Loaded 18825 existing records from primary storage. [2025-10-16T18:11:53.310080] [INFO ] [MAIN ] CQP: Loaded 18825 existing records. [2025-10-16T18:11:53.720230] [DEBUG] [LOCAL ] CPRI: Loaded 52475 existing records from primary storage. [2025-10-16T18:11:53.877144] [INFO ] [MAIN ] CPRI: Loaded 52475 existing records. [2025-10-16T18:11:53.866101] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:11:53.985091] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-16T18:11:53.999187] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-16T18:11:53.967851] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:11:54.016373] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-16T18:11:54.017028] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-16T18:11:54.016838] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-16T18:11:54.020902] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:11:54.080456] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-16T18:11:54.119765] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-16T18:11:54.140625] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-16T18:11:54.153383] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-16T18:11:54.357211] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:11:54.403115] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-16T18:11:54.460155] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-16T18:11:54.495520] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-16T18:11:54.567720] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-16T18:11:55.118519] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:11:55.182499] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-16T18:11:55.173318] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:11:55.195367] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-16T18:11:55.358090] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:11:55.358614] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-16T18:11:55.496039] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T18:11:55.504098] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-16T18:11:56.346174] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T18:11:56.350583] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-16T18:11:56.364047] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T18:11:56.368527] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-16T18:11:56.711143] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T18:11:56.720048] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-16T18:11:56.955002] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T18:11:56.965593] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-16T18:11:57.372188] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T18:11:57.377262] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-16T18:11:57.461306] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T18:11:57.467271] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-16T18:11:58.213814] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T18:11:58.222441] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-16T18:11:58.293349] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T18:11:58.318440] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T18:11:58.336709] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T18:11:58.342754] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-16T18:11:59.142791] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-16T18:11:59.372199] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T18:11:59.532702] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T18:11:59.942872] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-16T18:12:00.742846] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-16T18:12:00.839484] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T18:12:01.361537] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T18:12:01.542805] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-16T18:12:02.342864] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-16T18:12:02.587011] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T18:12:02.870944] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T18:12:03.142838] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-16T18:12:03.346778] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T18:12:03.942823] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-16T18:12:04.433547] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T18:12:04.742813] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-16T18:12:04.810979] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T18:12:05.542848] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-16T18:12:06.342851] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-16T18:12:06.510724] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T18:12:06.667853] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T18:12:07.142882] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-16T18:12:07.942816] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-16T18:12:08.070776] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T18:12:08.236876] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T18:12:08.742858] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-16T18:12:09.327211] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T18:12:09.542866] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-16T18:12:10.036101] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T18:12:10.342826] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-16T18:12:10.710347] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T18:12:11.142871] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-16T18:12:11.942899] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-16T18:12:11.975745] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-16T18:12:12.112197] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T18:12:12.622457] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-16T18:12:12.742829] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-16T18:12:13.542771] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-16T18:12:13.612560] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T18:12:14.342881] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-16T18:12:14.687606] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T18:12:15.142821] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-16T18:12:15.878985] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T18:12:15.942786] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-16T18:12:16.654360] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T18:12:16.742877] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-16T18:12:17.542827] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-16T18:12:17.600545] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T18:12:18.347356] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-16T18:12:18.365300] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T18:12:18.661268] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T18:12:19.142867] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-16T18:12:19.942789] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-16T18:12:20.272083] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T18:12:20.343802] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T18:12:20.349505] [INFO ] [REMOTE ] CPT: Full fetch complete (64487 records). [2025-10-16T18:12:20.349681] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-16T18:12:20.743569] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-16T18:12:20.807790] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-16T18:12:20.807943] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-16T18:12:20.808994] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-16T18:12:20.809098] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-16T18:12:20.817446] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T18:12:20.820681] [DEBUG] [LOCAL ] CPT: Trimmed 64487 records to 44888 (keeping 200 days of data) [2025-10-16T18:12:20.821316] [INFO ] [REMOTE ] CPS: Full fetch complete (36191 records). [2025-10-16T18:12:20.821423] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-16T18:12:20.822769] [FATAL] [VALIDATOR ] CPS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:12:20.822920] [FATAL] [MAIN ] CPS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:12:20.823009] [WARN ] [MAIN ] CPS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:12:20.823100] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-16T18:12:20.823198] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-10-16T18:12:20.823280] [INFO ] [LOCAL ] CPS: Starting deletion of derivative data. [2025-10-16T18:12:20.823525] [DEBUG] [LOCAL ] CPS: Deleted derivative data file. [2025-10-16T18:12:20.823675] [INFO ] [MAIN ] Update Progress: 521/2369 symbols completed. CPS took 28.5s. Estimated remaining: 4h 16m 24s. Rate: 7.2 symbols/min [2025-10-16T18:12:21.100451] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:12:21.135797] [DEBUG] [LOCAL ] CR: Loaded 24087 existing records from primary storage. [2025-10-16T18:12:21.136797] [INFO ] [MAIN ] CR: Loaded 24087 existing records. [2025-10-16T18:12:21.352551] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:12:21.355558] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-16T18:12:21.355626] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-16T18:12:21.356209] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-16T18:12:21.356297] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-16T18:12:21.560126] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-16T18:12:21.715603] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T18:12:21.757000] [INFO ] [REMOTE ] CQP: Full fetch complete (29818 records). [2025-10-16T18:12:21.768475] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-16T18:12:21.784189] [FATAL] [VALIDATOR ] CQP: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:12:21.792052] [FATAL] [MAIN ] CQP: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:12:21.792378] [WARN ] [MAIN ] CQP: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:12:21.809813] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-16T18:12:21.857582] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-16T18:12:21.895028] [INFO ] [LOCAL ] CQP: Starting deletion of derivative data. [2025-10-16T18:12:21.892394] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:12:21.906210] [DEBUG] [LOCAL ] CQP: Deleted derivative data file. [2025-10-16T18:12:21.907150] [INFO ] [MAIN ] Update Progress: 522/2369 symbols completed. CQP took 29.5s. Estimated remaining: 4h 15m 50s. Rate: 7.2 symbols/min [2025-10-16T18:12:21.991097] [DEBUG] [LOCAL ] CPT: Primary data saved (44888 records). [2025-10-16T18:12:22.010667] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-16T18:12:22.013233] [INFO ] [MAIN ] Update Progress: 523/2369 symbols completed. CPT took 29.6s. Estimated remaining: 4h 15m 13s. Rate: 7.2 symbols/min [2025-10-16T18:12:22.195865] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:12:22.261513] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:12:22.265306] [DEBUG] [LOCAL ] CRBD: Loaded 8927 existing records from primary storage. [2025-10-16T18:12:22.265739] [INFO ] [MAIN ] CRBD: Loaded 8927 existing records. [2025-10-16T18:12:22.348695] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-16T18:12:22.486550] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:12:22.486847] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-16T18:12:22.486897] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-16T18:12:22.487352] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-16T18:12:22.500985] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-16T18:12:22.658134] [DEBUG] [LOCAL ] CRBG: Loaded 52586 existing records from primary storage. [2025-10-16T18:12:22.673935] [INFO ] [MAIN ] CRBG: Loaded 52586 existing records. [2025-10-16T18:12:23.065346] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:12:23.098681] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-16T18:12:23.100028] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-16T18:12:23.117475] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-16T18:12:23.117592] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-16T18:12:23.158397] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:12:23.176680] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-16T18:12:23.497179] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:12:23.527451] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T18:12:23.546779] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-16T18:12:23.942884] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-16T18:12:24.129042] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T18:12:24.742891] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-16T18:12:25.552455] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-16T18:12:25.572077] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T18:12:26.335313] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T18:12:26.345359] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-16T18:12:26.387873] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T18:12:27.142861] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-16T18:12:27.762551] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T18:12:27.769569] [INFO ] [REMOTE ] CPRI: Full fetch complete (76209 records). [2025-10-16T18:12:27.769757] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-16T18:12:27.963775] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-16T18:12:28.181990] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-16T18:12:28.182077] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-16T18:12:28.183001] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-16T18:12:28.183069] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-16T18:12:28.184530] [DEBUG] [LOCAL ] CPRI: Trimmed 76209 records to 52846 (keeping 200 days of data) [2025-10-16T18:12:28.492465] [DEBUG] [LOCAL ] CPRI: Primary data saved (52846 records). [2025-10-16T18:12:28.492670] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-16T18:12:28.492793] [INFO ] [MAIN ] Update Progress: 524/2369 symbols completed. CPRI took 36.1s. Estimated remaining: 4h 14m 58s. Rate: 7.2 symbols/min [2025-10-16T18:12:28.668562] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:12:28.709303] [DEBUG] [LOCAL ] CRC: Loaded 44068 existing records from primary storage. [2025-10-16T18:12:28.709604] [INFO ] [MAIN ] CRC: Loaded 44068 existing records. [2025-10-16T18:12:28.751977] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-16T18:12:28.898232] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:12:28.898489] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-16T18:12:28.898723] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-16T18:12:28.908386] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-16T18:12:28.913774] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-16T18:12:28.970913] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T18:12:29.281173] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T18:12:29.334328] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:12:29.474621] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-16T18:12:29.542798] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-16T18:12:30.342825] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-16T18:12:31.111253] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T18:12:31.142776] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-16T18:12:31.188232] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-16T18:12:31.942806] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-16T18:12:32.345807] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T18:12:32.742825] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-16T18:12:33.231173] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T18:12:33.542810] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-16T18:12:34.157950] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:12:34.342814] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-16T18:12:34.382024] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T18:12:35.142836] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-16T18:12:35.793488] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T18:12:35.942797] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-16T18:12:36.742802] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-16T18:12:36.913128] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T18:12:36.974785] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T18:12:37.286406] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-16T18:12:37.542859] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-16T18:12:38.256668] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-16T18:12:38.342804] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-16T18:12:39.142830] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-16T18:12:39.409052] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T18:12:39.942854] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-16T18:12:40.732608] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T18:12:40.730944] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T18:12:40.745617] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-16T18:12:41.542866] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-16T18:12:42.342838] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-16T18:12:42.374407] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T18:12:43.147954] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-16T18:12:43.166813] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T18:12:43.195541] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T18:12:43.942840] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-16T18:12:43.962752] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T18:12:44.585850] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-16T18:12:44.742861] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-16T18:12:45.542865] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-16T18:12:46.153539] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T18:12:46.342854] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-16T18:12:46.535632] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T18:12:47.140341] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-16T18:12:47.142855] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-16T18:12:47.942880] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-16T18:12:48.609301] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T18:12:48.742820] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-16T18:12:49.490861] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T18:12:49.542796] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-16T18:12:49.772897] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-16T18:12:50.010849] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-16T18:12:50.012312] [INFO ] [REMOTE ] CRBD: Full fetch complete (13383 records). [2025-10-16T18:12:50.012379] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-16T18:12:50.348039] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-16T18:12:50.387908] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-16T18:12:50.388013] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-16T18:12:50.388417] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-16T18:12:50.388480] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-16T18:12:50.389079] [DEBUG] [LOCAL ] CRBD: Trimmed 13383 records to 8956 (keeping 200 days of data) [2025-10-16T18:12:50.442915] [DEBUG] [LOCAL ] CRBD: Primary data saved (8956 records). [2025-10-16T18:12:50.443024] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-16T18:12:50.443100] [INFO ] [MAIN ] Update Progress: 525/2369 symbols completed. CRBD took 28.5s. Estimated remaining: 4h 15m 38s. Rate: 7.2 symbols/min [2025-10-16T18:12:50.612270] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:12:50.612425] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-16T18:12:50.612462] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-16T18:12:50.612613] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-16T18:12:50.612679] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-16T18:12:50.612739] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-16T18:12:50.612784] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-16T18:12:50.980832] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:12:51.142812] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-16T18:12:51.942882] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-16T18:12:52.192932] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T18:12:52.326749] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-16T18:12:52.742816] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-16T18:12:53.542839] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-16T18:12:53.596212] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T18:12:53.729131] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:12:53.729392] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-16T18:12:53.729473] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:12:53.729522] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-16T18:12:53.729559] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:12:53.729623] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-16T18:12:53.729720] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-16T18:12:53.729764] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-16T18:12:53.729804] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-16T18:12:53.729849] [INFO ] [MAIN ] Update Progress: 526/2369 symbols completed. CRCL took 3.3s. Estimated remaining: 4h 15m 12s. Rate: 7.2 symbols/min [2025-10-16T18:12:53.897161] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:12:53.945219] [DEBUG] [LOCAL ] CRGY: Loaded 52507 existing records from primary storage. [2025-10-16T18:12:53.945550] [INFO ] [MAIN ] CRGY: Loaded 52507 existing records. [2025-10-16T18:12:54.136574] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:12:54.136831] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-16T18:12:54.136920] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-16T18:12:54.137197] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-16T18:12:54.137253] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-16T18:12:54.348276] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-16T18:12:54.500224] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:12:54.529842] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T18:12:55.142813] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-16T18:12:55.942786] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-16T18:12:55.988425] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T18:12:56.742785] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-16T18:12:56.851562] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T18:12:57.139073] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-16T18:12:57.542806] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-16T18:12:58.311022] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T18:12:58.342774] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-16T18:12:59.142788] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-16T18:12:59.294916] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T18:12:59.301882] [INFO ] [REMOTE ] CRBG: Full fetch complete (76027 records). [2025-10-16T18:12:59.302006] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-16T18:12:59.710092] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-16T18:12:59.710271] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-16T18:12:59.711426] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-16T18:12:59.711544] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-16T18:12:59.713149] [DEBUG] [LOCAL ] CRBG: Trimmed 76027 records to 52976 (keeping 200 days of data) [2025-10-16T18:12:59.946297] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-16T18:13:00.062076] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T18:13:00.090791] [DEBUG] [LOCAL ] CRBG: Primary data saved (52976 records). [2025-10-16T18:13:00.091488] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-16T18:13:00.091612] [INFO ] [MAIN ] Update Progress: 527/2369 symbols completed. CRBG took 38.1s. Estimated remaining: 4h 14m 57s. Rate: 7.2 symbols/min [2025-10-16T18:13:00.259413] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:00.259590] [DEBUG] [LOCAL ] CRH: No existing data file found in primary storage. [2025-10-16T18:13:00.259628] [WARN ] [MAIN ] CRH: No existing data found, performing full refresh instead. [2025-10-16T18:13:00.259760] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-16T18:13:00.259801] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-16T18:13:00.259841] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-10-16T18:13:00.259873] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-16T18:13:00.621222] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:00.742803] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-16T18:13:00.787224] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T18:13:01.289340] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T18:13:01.293220] [INFO ] [REMOTE ] CR: Full fetch complete (34738 records). [2025-10-16T18:13:01.293345] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-16T18:13:01.551550] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-16T18:13:01.663784] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-16T18:13:01.663865] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-16T18:13:01.664428] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-16T18:13:01.664470] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-16T18:13:01.665934] [DEBUG] [LOCAL ] CR: Trimmed 34738 records to 24311 (keeping 200 days of data) [2025-10-16T18:13:01.832384] [DEBUG] [LOCAL ] CR: Primary data saved (24311 records). [2025-10-16T18:13:01.832596] [INFO ] [MAIN ] CR: Full history saved. [2025-10-16T18:13:01.832936] [INFO ] [MAIN ] Update Progress: 528/2369 symbols completed. CR took 41.0s. Estimated remaining: 4h 14m 25s. Rate: 7.2 symbols/min [2025-10-16T18:13:02.029359] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:02.080140] [DEBUG] [LOCAL ] CRI: Loaded 49669 existing records from primary storage. [2025-10-16T18:13:02.080612] [INFO ] [MAIN ] CRI: Loaded 49669 existing records. [2025-10-16T18:13:02.270194] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:13:02.270559] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-16T18:13:02.270625] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-16T18:13:02.272228] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-16T18:13:02.272293] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-16T18:13:02.345436] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-16T18:13:02.665726] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:02.755791] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-16T18:13:03.142900] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-16T18:13:03.179182] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T18:13:03.864731] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T18:13:03.871719] [INFO ] [REMOTE ] CRC: Full fetch complete (62903 records). [2025-10-16T18:13:03.871839] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-16T18:13:03.947989] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-16T18:13:04.254056] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-16T18:13:04.254150] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-16T18:13:04.255323] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-16T18:13:04.255392] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-16T18:13:04.256854] [DEBUG] [LOCAL ] CRC: Trimmed 62903 records to 44395 (keeping 200 days of data) [2025-10-16T18:13:04.525176] [DEBUG] [LOCAL ] CRC: Primary data saved (44395 records). [2025-10-16T18:13:04.525318] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-16T18:13:04.525409] [INFO ] [MAIN ] Update Progress: 529/2369 symbols completed. CRC took 36.0s. Estimated remaining: 4h 13m 58s. Rate: 7.2 symbols/min [2025-10-16T18:13:04.695870] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:04.744938] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-16T18:13:04.748306] [DEBUG] [LOCAL ] CRK: Loaded 52246 existing records from primary storage. [2025-10-16T18:13:04.748774] [INFO ] [MAIN ] CRK: Loaded 52246 existing records. [2025-10-16T18:13:04.930710] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:13:04.931025] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-16T18:13:04.931075] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-16T18:13:04.954790] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-16T18:13:04.954882] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-16T18:13:05.058025] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-16T18:13:05.326508] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:05.548020] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-16T18:13:05.560954] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T18:13:06.122495] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T18:13:06.342885] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-16T18:13:07.142841] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-16T18:13:07.336765] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T18:13:07.942808] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-16T18:13:08.080333] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T18:13:08.383159] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-16T18:13:08.742807] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-16T18:13:09.531588] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T18:13:09.542763] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-16T18:13:10.335506] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T18:13:10.344206] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-16T18:13:11.077686] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T18:13:11.142796] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-16T18:13:11.723969] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T18:13:11.942806] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-16T18:13:12.742792] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-16T18:13:12.780751] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T18:13:13.542817] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-16T18:13:13.848673] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-16T18:13:14.028018] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T18:13:14.342871] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-16T18:13:15.142818] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-16T18:13:15.217077] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T18:13:15.795478] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T18:13:15.942809] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-16T18:13:16.742840] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-16T18:13:16.778095] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T18:13:17.542813] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-16T18:13:17.842337] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T18:13:18.350717] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-16T18:13:18.370603] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T18:13:19.026635] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T18:13:19.142825] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-16T18:13:19.942792] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-16T18:13:20.260800] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-16T18:13:20.742810] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-16T18:13:20.902206] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T18:13:21.542809] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-16T18:13:21.613357] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T18:13:22.040028] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T18:13:22.342803] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-16T18:13:22.888982] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T18:13:23.142800] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-16T18:13:23.942831] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-16T18:13:24.037591] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T18:13:24.514486] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T18:13:24.742818] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-16T18:13:25.490790] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T18:13:25.542826] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-16T18:13:26.342824] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-16T18:13:26.525217] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T18:13:26.829596] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T18:13:27.142831] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-16T18:13:27.942839] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-16T18:13:28.596042] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-16T18:13:28.742788] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-16T18:13:28.971705] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T18:13:29.542774] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-16T18:13:29.651266] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T18:13:30.342842] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-16T18:13:30.793055] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-16T18:13:31.142788] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-16T18:13:31.208790] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T18:13:31.216869] [INFO ] [REMOTE ] CRGY: Full fetch complete (76146 records). [2025-10-16T18:13:31.217010] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-16T18:13:31.610258] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-16T18:13:31.610370] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-16T18:13:31.611455] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-16T18:13:31.611617] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-16T18:13:31.613382] [DEBUG] [LOCAL ] CRGY: Trimmed 76146 records to 52897 (keeping 200 days of data) [2025-10-16T18:13:31.737476] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T18:13:31.942799] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-16T18:13:31.965748] [DEBUG] [LOCAL ] CRGY: Primary data saved (52897 records). [2025-10-16T18:13:31.965844] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-16T18:13:31.965918] [INFO ] [MAIN ] Update Progress: 530/2369 symbols completed. CRGY took 38.2s. Estimated remaining: 4h 14m 56s. Rate: 7.2 symbols/min [2025-10-16T18:13:32.131803] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:32.175880] [DEBUG] [LOCAL ] CRL: Loaded 42812 existing records from primary storage. [2025-10-16T18:13:32.176208] [INFO ] [MAIN ] CRL: Loaded 42812 existing records. [2025-10-16T18:13:32.349124] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:13:32.349334] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-16T18:13:32.349411] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-16T18:13:32.349695] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-16T18:13:32.349755] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-16T18:13:32.707081] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:32.735024] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T18:13:32.745205] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-16T18:13:33.542843] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-16T18:13:33.907455] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-16T18:13:34.342789] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-16T18:13:34.360184] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T18:13:34.366152] [INFO ] [REMOTE ] CRI: Full fetch complete (70982 records). [2025-10-16T18:13:34.366268] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-16T18:13:34.755356] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-16T18:13:34.755450] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-16T18:13:34.756374] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-16T18:13:34.756441] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-16T18:13:34.757865] [DEBUG] [LOCAL ] CRI: Trimmed 70982 records to 50021 (keeping 200 days of data) [2025-10-16T18:13:35.010140] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T18:13:35.030408] [INFO ] [REMOTE ] CRK: Full fetch complete (75834 records). [2025-10-16T18:13:35.032844] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-16T18:13:35.164211] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-16T18:13:35.221558] [DEBUG] [LOCAL ] CRI: Primary data saved (50021 records). [2025-10-16T18:13:35.232013] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-16T18:13:35.243057] [INFO ] [MAIN ] Update Progress: 531/2369 symbols completed. CRI took 33.4s. Estimated remaining: 4h 14m 30s. Rate: 7.2 symbols/min [2025-10-16T18:13:35.593592] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:35.593809] [DEBUG] [LOCAL ] CRM: No existing data file found in primary storage. [2025-10-16T18:13:35.593881] [WARN ] [MAIN ] CRM: No existing data found, performing full refresh instead. [2025-10-16T18:13:35.604664] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-16T18:13:35.615007] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-16T18:13:35.632453] [DEBUG] [LOCAL ] CRM: No primary data file found to delete. [2025-10-16T18:13:35.642075] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-16T18:13:35.800436] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-16T18:13:35.800579] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-16T18:13:35.801586] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-16T18:13:35.801995] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-16T18:13:35.941436] [DEBUG] [LOCAL ] CRK: Trimmed 75834 records to 52635 (keeping 200 days of data) [2025-10-16T18:13:36.259507] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:36.268969] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-16T18:13:36.410949] [DEBUG] [LOCAL ] CRK: Primary data saved (52635 records). [2025-10-16T18:13:36.426514] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-16T18:13:36.429492] [INFO ] [MAIN ] Update Progress: 532/2369 symbols completed. CRK took 31.9s. Estimated remaining: 4h 13m 57s. Rate: 7.2 symbols/min [2025-10-16T18:13:36.498085] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-16T18:13:36.542965] [INFO ] [REMOTE ] CRH: Full fetch complete (77538 records). [2025-10-16T18:13:36.548827] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-16T18:13:36.635601] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:36.859141] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T18:13:36.901419] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-16T18:13:37.006442] [DEBUG] [LOCAL ] CRS: Loaded 43214 existing records from primary storage. [2025-10-16T18:13:37.039410] [INFO ] [MAIN ] CRS: Loaded 43214 existing records. [2025-10-16T18:13:37.158833] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-16T18:13:37.170176] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-16T18:13:37.196069] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-16T18:13:37.196427] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-16T18:13:37.260534] [DEBUG] [LOCAL ] CRH: Trimmed 77538 records to 53831 (keeping 200 days of data) [2025-10-16T18:13:37.283447] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:13:37.284287] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-16T18:13:37.284376] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-16T18:13:37.285332] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-16T18:13:37.285393] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-16T18:13:37.758369] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:37.759924] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-16T18:13:37.982546] [DEBUG] [LOCAL ] CRH: Primary data saved (53831 records). [2025-10-16T18:13:37.982710] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-16T18:13:37.982792] [INFO ] [MAIN ] Update Progress: 533/2369 symbols completed. CRH took 37.9s. Estimated remaining: 4h 13m 26s. Rate: 7.2 symbols/min [2025-10-16T18:13:38.147778] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:38.154019] [DEBUG] [LOCAL ] CRT: Loaded 4885 existing records from primary storage. [2025-10-16T18:13:38.154211] [INFO ] [MAIN ] CRT: Loaded 4885 existing records. [2025-10-16T18:13:38.330998] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:13:38.331366] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-16T18:13:38.331548] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-16T18:13:38.331927] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-16T18:13:38.331991] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-16T18:13:38.694450] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:38.711229] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-16T18:13:38.724574] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T18:13:38.772667] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-10-16T18:13:38.905686] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T18:13:39.142837] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-16T18:13:39.311156] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-16T18:13:39.942902] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-16T18:13:40.461980] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-16T18:13:40.499812] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-16T18:13:40.742810] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-16T18:13:41.332892] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T18:13:41.542833] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-16T18:13:41.653859] [DEBUG] [REMOTE ] CRL: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-16T18:13:41.654121] [WARN ] [REMOTE ] CRL: No data returned for month 2025-03 [2025-10-16T18:13:41.654207] [FATAL] [REMOTE ] CRL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:13:41.654288] [FATAL] [MAIN ] CRL: Failed to fetch primary data. [2025-10-16T18:13:41.654324] [WARN ] [MAIN ] CRL: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:13:41.654361] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-16T18:13:41.654432] [DEBUG] [LOCAL ] CRL: No primary data file found to delete. [2025-10-16T18:13:41.654469] [INFO ] [LOCAL ] CRL: Starting deletion of derivative data. [2025-10-16T18:13:41.654625] [DEBUG] [LOCAL ] CRL: Deleted derivative data file. [2025-10-16T18:13:41.654736] [INFO ] [MAIN ] Update Progress: 534/2369 symbols completed. CRL took 9.7s. Estimated remaining: 4h 13m 2s. Rate: 7.3 symbols/min [2025-10-16T18:13:41.828670] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:41.866819] [DEBUG] [LOCAL ] CSAN: Loaded 42170 existing records from primary storage. [2025-10-16T18:13:41.867099] [INFO ] [MAIN ] CSAN: Loaded 42170 existing records. [2025-10-16T18:13:42.046314] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:13:42.046537] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-16T18:13:42.046586] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-16T18:13:42.047115] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-16T18:13:42.047172] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-16T18:13:42.348010] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-16T18:13:42.400761] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:43.142845] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-16T18:13:43.735801] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-16T18:13:43.942883] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-16T18:13:44.551775] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-16T18:13:44.742964] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-16T18:13:45.325367] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T18:13:45.426802] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-16T18:13:45.542785] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-16T18:13:46.001930] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-16T18:13:46.342834] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-16T18:13:47.012362] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-16T18:13:47.142846] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-16T18:13:47.731694] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-16T18:13:47.942834] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-16T18:13:48.742856] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-16T18:13:49.031976] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T18:13:49.326915] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-16T18:13:49.542819] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-16T18:13:50.342797] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-16T18:13:51.049817] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-16T18:13:51.142787] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-16T18:13:51.751507] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-16T18:13:51.752734] [INFO ] [REMOTE ] CRT: Full fetch complete (7350 records). [2025-10-16T18:13:51.752829] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-16T18:13:51.753276] [FATAL] [VALIDATOR ] CRT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:13:51.753377] [FATAL] [MAIN ] CRT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:13:51.753453] [WARN ] [MAIN ] CRT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:13:51.753527] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-16T18:13:51.753591] [DEBUG] [LOCAL ] CRT: No primary data file found to delete. [2025-10-16T18:13:51.753690] [INFO ] [LOCAL ] CRT: Starting deletion of derivative data. [2025-10-16T18:13:51.753822] [DEBUG] [LOCAL ] CRT: Deleted derivative data file. [2025-10-16T18:13:51.753918] [INFO ] [MAIN ] Update Progress: 535/2369 symbols completed. CRT took 13.8s. Estimated remaining: 4h 12m 60s. Rate: 7.2 symbols/min [2025-10-16T18:13:51.952726] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-16T18:13:51.956125] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:51.989948] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-16T18:13:52.024053] [DEBUG] [LOCAL ] CSL: Loaded 31478 existing records from primary storage. [2025-10-16T18:13:52.024309] [INFO ] [MAIN ] CSL: Loaded 31478 existing records. [2025-10-16T18:13:52.199906] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:13:52.200127] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-16T18:13:52.200183] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-16T18:13:52.200842] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-16T18:13:52.200899] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-16T18:13:52.579323] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:52.742853] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-16T18:13:53.351112] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T18:13:53.542835] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-16T18:13:54.342881] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-16T18:13:54.677679] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T18:13:54.970708] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-16T18:13:55.142819] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-16T18:13:55.863980] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T18:13:55.942813] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-16T18:13:56.335091] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T18:13:56.742804] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-16T18:13:57.481629] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T18:13:57.542826] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-16T18:13:57.718680] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T18:13:58.342851] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-16T18:13:58.924936] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T18:13:59.142826] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-16T18:13:59.857939] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T18:13:59.942859] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-16T18:14:00.742848] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-16T18:14:01.542859] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-16T18:14:01.602415] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T18:14:01.845008] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-16T18:14:01.954336] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T18:14:02.342809] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-16T18:14:02.779679] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T18:14:03.142797] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-16T18:14:03.942846] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-16T18:14:04.750633] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-16T18:14:04.770952] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-16T18:14:04.816670] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T18:14:05.113336] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T18:14:05.542852] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-16T18:14:06.342842] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-16T18:14:06.723891] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T18:14:07.142842] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-16T18:14:07.716594] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T18:14:07.942782] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-16T18:14:08.534317] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.99 seconds). [2025-10-16T18:14:08.687165] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T18:14:08.742797] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-16T18:14:09.542862] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-16T18:14:09.678772] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T18:14:10.342820] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-16T18:14:10.653210] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-16T18:14:11.142805] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-16T18:14:11.352594] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-16T18:14:11.938669] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T18:14:11.947968] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-16T18:14:11.991011] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T18:14:12.742810] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-16T18:14:13.542825] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-16T18:14:14.342793] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T18:14:14.342998] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-16T18:14:14.518623] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-16T18:14:14.589977] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-16T18:14:15.142815] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-16T18:14:15.370618] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-16T18:14:15.942838] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-16T18:14:16.505988] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T18:14:16.512172] [INFO ] [REMOTE ] CSAN: Full fetch complete (60440 records). [2025-10-16T18:14:16.512305] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-16T18:14:16.749100] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-16T18:14:16.897396] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-16T18:14:16.897481] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-16T18:14:16.898307] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-16T18:14:16.898369] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-16T18:14:16.899569] [DEBUG] [LOCAL ] CSAN: Trimmed 60440 records to 42492 (keeping 200 days of data) [2025-10-16T18:14:17.133898] [DEBUG] [LOCAL ] CSAN: Primary data saved (42492 records). [2025-10-16T18:14:17.134032] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-16T18:14:17.134109] [INFO ] [MAIN ] Update Progress: 536/2369 symbols completed. CSAN took 35.5s. Estimated remaining: 4h 13m 50s. Rate: 7.2 symbols/min [2025-10-16T18:14:17.302484] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:14:17.316079] [DEBUG] [LOCAL ] CSR: Loaded 13403 existing records from primary storage. [2025-10-16T18:14:17.316364] [INFO ] [MAIN ] CSR: Loaded 13403 existing records. [2025-10-16T18:14:17.493435] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:14:17.493728] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-16T18:14:17.493803] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-16T18:14:17.494291] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-16T18:14:17.494355] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-16T18:14:17.555434] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-16T18:14:17.666376] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T18:14:17.882595] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:14:18.237843] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T18:14:18.342790] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-16T18:14:19.142801] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-16T18:14:19.942846] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-16T18:14:19.977402] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T18:14:20.064765] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-16T18:14:20.085529] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-16T18:14:20.742855] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-16T18:14:21.305234] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T18:14:21.542862] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-16T18:14:22.193314] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T18:14:22.198564] [INFO ] [REMOTE ] CRS: Full fetch complete (62322 records). [2025-10-16T18:14:22.198734] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-16T18:14:22.199483] [FATAL] [VALIDATOR ] CRS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:14:22.199569] [FATAL] [MAIN ] CRS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:14:22.199611] [WARN ] [MAIN ] CRS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:14:22.199675] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-16T18:14:22.199752] [DEBUG] [LOCAL ] CRS: No primary data file found to delete. [2025-10-16T18:14:22.199789] [INFO ] [LOCAL ] CRS: Starting deletion of derivative data. [2025-10-16T18:14:22.199975] [DEBUG] [LOCAL ] CRS: Deleted derivative data file. [2025-10-16T18:14:22.200064] [INFO ] [MAIN ] Update Progress: 537/2369 symbols completed. CRS took 45.8s. Estimated remaining: 4h 13m 30s. Rate: 7.2 symbols/min [2025-10-16T18:14:22.374356] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:14:22.349585] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-16T18:14:22.419030] [DEBUG] [LOCAL ] CSTM: Loaded 47572 existing records from primary storage. [2025-10-16T18:14:22.419376] [INFO ] [MAIN ] CSTM: Loaded 47572 existing records. [2025-10-16T18:14:22.597079] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:14:22.597293] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-16T18:14:22.597355] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-16T18:14:22.598064] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-16T18:14:22.598122] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-16T18:14:22.876471] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T18:14:22.902780] [INFO ] [REMOTE ] CSL: Full fetch complete (45623 records). [2025-10-16T18:14:22.918856] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-16T18:14:23.023767] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:14:23.160664] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-16T18:14:23.289444] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T18:14:23.381475] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-16T18:14:23.381564] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-16T18:14:23.382433] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-16T18:14:23.382501] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-16T18:14:23.383735] [DEBUG] [LOCAL ] CSL: Trimmed 45623 records to 31764 (keeping 200 days of data) [2025-10-16T18:14:23.582334] [DEBUG] [LOCAL ] CSL: Primary data saved (31764 records). [2025-10-16T18:14:23.582474] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-16T18:14:23.582551] [INFO ] [MAIN ] Update Progress: 538/2369 symbols completed. CSL took 31.8s. Estimated remaining: 4h 12m 59s. Rate: 7.2 symbols/min [2025-10-16T18:14:23.755183] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:14:23.773511] [DEBUG] [LOCAL ] CSV: Loaded 12707 existing records from primary storage. [2025-10-16T18:14:23.773801] [INFO ] [MAIN ] CSV: Loaded 12707 existing records. [2025-10-16T18:14:23.947634] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-16T18:14:23.958149] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:14:23.959427] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-16T18:14:23.959478] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-16T18:14:23.959871] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-16T18:14:23.959930] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-16T18:14:24.321126] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:14:24.742860] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-16T18:14:24.881779] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T18:14:24.952179] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T18:14:24.959097] [INFO ] [REMOTE ] CRM: Full fetch complete (77944 records). [2025-10-16T18:14:24.959245] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-16T18:14:25.385787] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-16T18:14:25.386401] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-16T18:14:25.386707] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T18:14:25.387958] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-16T18:14:25.390875] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-16T18:14:25.392590] [DEBUG] [LOCAL ] CRM: Trimmed 77944 records to 54160 (keeping 200 days of data) [2025-10-16T18:14:25.582509] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-16T18:14:25.757143] [DEBUG] [LOCAL ] CRM: Primary data saved (54160 records). [2025-10-16T18:14:25.757293] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-16T18:14:25.757370] [INFO ] [MAIN ] Update Progress: 539/2369 symbols completed. CRM took 50.5s. Estimated remaining: 4h 12m 30s. Rate: 7.2 symbols/min [2025-10-16T18:14:25.925779] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:14:25.925936] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-16T18:14:25.925975] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-16T18:14:25.926084] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-16T18:14:25.926126] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-16T18:14:25.926169] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-16T18:14:25.926202] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-16T18:14:26.309211] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:14:26.310246] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T18:14:26.342794] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-16T18:14:27.142826] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-16T18:14:27.302711] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-16T18:14:27.308085] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:14:27.308416] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-16T18:14:27.308516] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:14:27.308573] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-16T18:14:27.308628] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:14:27.308732] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-16T18:14:27.308860] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-16T18:14:27.308948] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-16T18:14:27.309043] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-16T18:14:27.309121] [INFO ] [MAIN ] Update Progress: 540/2369 symbols completed. CSW took 1.6s. Estimated remaining: 4h 11m 58s. Rate: 7.3 symbols/min [2025-10-16T18:14:27.488137] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:14:27.496906] [DEBUG] [LOCAL ] CTBB: Loaded 6784 existing records from primary storage. [2025-10-16T18:14:27.497167] [INFO ] [MAIN ] CTBB: Loaded 6784 existing records. [2025-10-16T18:14:27.679083] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:14:27.679337] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-16T18:14:27.679392] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-16T18:14:27.679683] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-16T18:14:27.679743] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-16T18:14:27.951078] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-16T18:14:28.035507] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:14:28.742827] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-16T18:14:29.542853] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-16T18:14:29.672674] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T18:14:29.691552] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T18:14:30.346807] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-16T18:14:30.347982] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-16T18:14:31.142829] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-16T18:14:31.335559] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T18:14:31.942815] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-16T18:14:32.317440] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T18:14:32.648119] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T18:14:32.742821] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-16T18:14:33.455781] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T18:14:33.542799] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-16T18:14:34.342838] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-16T18:14:34.394717] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T18:14:34.956481] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T18:14:35.142815] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-16T18:14:35.942840] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-16T18:14:36.056065] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T18:14:36.742858] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-16T18:14:37.332102] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T18:14:37.542883] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-16T18:14:37.677386] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T18:14:38.066542] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-16T18:14:38.342846] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-16T18:14:39.142909] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-16T18:14:39.280212] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T18:14:39.283959] [INFO ] [REMOTE ] CSR: Full fetch complete (17984 records). [2025-10-16T18:14:39.284070] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-16T18:14:39.649615] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-16T18:14:39.649720] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-16T18:14:39.650124] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-16T18:14:39.650164] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-16T18:14:39.650763] [DEBUG] [LOCAL ] CSR: Trimmed 17984 records to 13529 (keeping 200 days of data) [2025-10-16T18:14:39.737021] [DEBUG] [LOCAL ] CSR: Primary data saved (13529 records). [2025-10-16T18:14:39.737191] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-16T18:14:39.737285] [INFO ] [MAIN ] Update Progress: 541/2369 symbols completed. CSR took 22.6s. Estimated remaining: 4h 12m 4s. Rate: 7.3 symbols/min [2025-10-16T18:14:39.915623] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:14:39.922328] [DEBUG] [LOCAL ] CTDD: Loaded 5471 existing records from primary storage. [2025-10-16T18:14:39.922557] [INFO ] [MAIN ] CTDD: Loaded 5471 existing records. [2025-10-16T18:14:39.952685] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-16T18:14:40.113349] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-16T18:14:40.117697] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:14:40.121000] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-16T18:14:40.121069] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-16T18:14:40.121319] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-16T18:14:40.121377] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-16T18:14:40.484038] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:14:40.742830] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-16T18:14:40.772196] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T18:14:41.459878] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T18:14:41.542853] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-16T18:14:42.342792] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-16T18:14:42.476977] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-16T18:14:42.995517] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-16T18:14:43.142824] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-16T18:14:43.942803] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-16T18:14:44.127345] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T18:14:44.742785] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-16T18:14:45.542773] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-16T18:14:45.595464] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T18:14:45.633962] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-16T18:14:46.245134] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-16T18:14:46.342835] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-16T18:14:47.142810] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-16T18:14:47.239703] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T18:14:47.942805] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-16T18:14:48.529729] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-16T18:14:48.742883] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-16T18:14:48.795779] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T18:14:49.213888] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-16T18:14:49.542853] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-16T18:14:50.258199] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T18:14:50.342821] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-16T18:14:51.142823] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-16T18:14:51.519343] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T18:14:51.898049] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-16T18:14:51.942827] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-16T18:14:52.742819] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-16T18:14:52.908853] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T18:14:53.166734] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-16T18:14:53.542833] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-16T18:14:54.343096] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-16T18:14:54.420837] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T18:14:54.821467] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-16T18:14:55.142837] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-16T18:14:55.942820] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-16T18:14:56.019052] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T18:14:56.559076] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T18:14:56.742806] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-16T18:14:57.522816] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T18:14:57.524714] [INFO ] [REMOTE ] CSV: Full fetch complete (19181 records). [2025-10-16T18:14:57.524795] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-16T18:14:57.547925] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-16T18:14:57.895558] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-16T18:14:57.895635] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-16T18:14:57.896137] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-16T18:14:57.896199] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-16T18:14:57.896754] [DEBUG] [LOCAL ] CSV: Trimmed 19181 records to 12746 (keeping 200 days of data) [2025-10-16T18:14:57.972623] [DEBUG] [LOCAL ] CSV: Primary data saved (12746 records). [2025-10-16T18:14:57.972778] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-16T18:14:57.972855] [INFO ] [MAIN ] Update Progress: 542/2369 symbols completed. CSV took 34.4s. Estimated remaining: 4h 12m 30s. Rate: 7.2 symbols/min [2025-10-16T18:14:58.143626] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:14:58.143803] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-16T18:14:58.143845] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-16T18:14:58.143962] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-16T18:14:58.144004] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-16T18:14:58.144046] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-16T18:14:58.144079] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-16T18:14:58.352170] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-16T18:14:58.420829] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T18:14:58.514123] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:14:59.142852] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-16T18:14:59.799106] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T18:14:59.861144] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T18:14:59.862348] [INFO ] [REMOTE ] CTBB: Full fetch complete (10283 records). [2025-10-16T18:14:59.862415] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-16T18:14:59.948089] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-16T18:15:00.245431] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-16T18:15:00.245505] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-16T18:15:00.245797] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-16T18:15:00.245862] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-16T18:15:00.246289] [DEBUG] [LOCAL ] CTBB: Trimmed 10283 records to 6801 (keeping 200 days of data) [2025-10-16T18:15:00.286112] [DEBUG] [LOCAL ] CTBB: Primary data saved (6801 records). [2025-10-16T18:15:00.286210] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-16T18:15:00.286287] [INFO ] [MAIN ] Update Progress: 543/2369 symbols completed. CTBB took 33.0s. Estimated remaining: 4h 12m 1s. Rate: 7.2 symbols/min [2025-10-16T18:15:00.454931] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:15:00.476373] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-16T18:15:00.487936] [DEBUG] [LOCAL ] CTO: Loaded 27682 existing records from primary storage. [2025-10-16T18:15:00.488216] [INFO ] [MAIN ] CTO: Loaded 27682 existing records. [2025-10-16T18:15:00.674592] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:15:00.674864] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-16T18:15:00.674921] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-16T18:15:00.675533] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-16T18:15:00.675627] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-16T18:15:00.748103] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-16T18:15:01.046045] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:15:01.542816] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-16T18:15:01.770344] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:15:01.770667] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-16T18:15:01.770757] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:15:01.770811] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-16T18:15:01.770871] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:15:01.770943] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-16T18:15:01.771005] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-16T18:15:01.771041] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-16T18:15:01.771080] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-16T18:15:01.771126] [INFO ] [MAIN ] Update Progress: 544/2369 symbols completed. CTEV took 3.8s. Estimated remaining: 4h 11m 30s. Rate: 7.3 symbols/min [2025-10-16T18:15:01.940738] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:15:01.972731] [DEBUG] [LOCAL ] CTOS: Loaded 37188 existing records from primary storage. [2025-10-16T18:15:01.972996] [INFO ] [MAIN ] CTOS: Loaded 37188 existing records. [2025-10-16T18:15:02.148416] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:15:02.148734] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-16T18:15:02.148792] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-16T18:15:02.149417] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-16T18:15:02.149477] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-16T18:15:02.347947] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-16T18:15:02.539586] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:15:02.630728] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T18:15:03.142811] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-16T18:15:03.843903] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T18:15:03.942798] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-16T18:15:04.562719] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T18:15:04.742829] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-16T18:15:05.181333] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-16T18:15:05.239222] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-16T18:15:05.542806] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-16T18:15:06.342838] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-16T18:15:07.142800] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-16T18:15:07.230506] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T18:15:07.543847] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T18:15:07.942842] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-16T18:15:08.311412] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T18:15:08.742911] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-16T18:15:09.389421] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T18:15:09.542820] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-16T18:15:10.025959] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T18:15:10.342812] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-16T18:15:10.445933] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T18:15:11.142825] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-16T18:15:11.560171] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T18:15:11.834215] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-16T18:15:11.942821] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-16T18:15:12.742835] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-16T18:15:13.114768] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T18:15:13.542821] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-16T18:15:14.162540] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T18:15:14.198511] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T18:15:14.342865] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-16T18:15:15.142837] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-16T18:15:15.942823] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-16T18:15:16.087584] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T18:15:16.409036] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T18:15:16.742861] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-16T18:15:17.295520] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-16T18:15:17.296822] [INFO ] [REMOTE ] CTDD: Full fetch complete (8092 records). [2025-10-16T18:15:17.296899] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-16T18:15:17.547214] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-16T18:15:17.689635] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-16T18:15:17.689745] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-16T18:15:17.690000] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-16T18:15:17.690038] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-16T18:15:17.690430] [DEBUG] [LOCAL ] CTDD: Trimmed 8092 records to 5483 (keeping 200 days of data) [2025-10-16T18:15:17.725137] [DEBUG] [LOCAL ] CTDD: Primary data saved (5483 records). [2025-10-16T18:15:17.725291] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-16T18:15:17.725378] [INFO ] [MAIN ] Update Progress: 545/2369 symbols completed. CTDD took 38.0s. Estimated remaining: 4h 11m 48s. Rate: 7.2 symbols/min [2025-10-16T18:15:17.881172] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-16T18:15:17.935859] [INFO ] [REMOTE ] CSTM: Full fetch complete (69509 records). [2025-10-16T18:15:17.937445] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:15:17.937946] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-16T18:15:18.333348] [DEBUG] [LOCAL ] CTRA: Loaded 53648 existing records from primary storage. [2025-10-16T18:15:18.344952] [INFO ] [MAIN ] CTRA: Loaded 53648 existing records. [2025-10-16T18:15:18.344736] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-16T18:15:18.523417] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-16T18:15:18.543984] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-16T18:15:18.545225] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-16T18:15:18.545624] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-16T18:15:18.635959] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:15:18.636539] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-16T18:15:18.636466] [DEBUG] [LOCAL ] CSTM: Trimmed 69509 records to 47940 (keeping 200 days of data) [2025-10-16T18:15:18.636683] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-16T18:15:18.637964] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-16T18:15:18.638029] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-16T18:15:19.191175] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T18:15:19.292246] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-16T18:15:19.298572] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:15:19.374283] [DEBUG] [LOCAL ] CSTM: Primary data saved (47940 records). [2025-10-16T18:15:19.374502] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-16T18:15:19.374611] [INFO ] [MAIN ] Update Progress: 546/2369 symbols completed. CSTM took 57.2s. Estimated remaining: 4h 11m 17s. Rate: 7.3 symbols/min [2025-10-16T18:15:19.565361] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:15:19.621827] [DEBUG] [LOCAL ] CTRE: Loaded 49482 existing records from primary storage. [2025-10-16T18:15:19.622379] [INFO ] [MAIN ] CTRE: Loaded 49482 existing records. [2025-10-16T18:15:19.828768] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:15:19.854384] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-16T18:15:19.854575] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-16T18:15:19.856291] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-16T18:15:19.856222] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T18:15:19.856478] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-16T18:15:19.949023] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-16T18:15:20.261083] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:15:20.503261] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T18:15:20.742831] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-16T18:15:21.090530] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T18:15:21.542815] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-16T18:15:22.342843] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-16T18:15:22.398032] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T18:15:22.584183] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T18:15:23.142853] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-16T18:15:23.623037] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T18:15:23.942808] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-16T18:15:24.742783] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-16T18:15:24.875380] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T18:15:25.542860] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-16T18:15:26.128509] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-16T18:15:26.133293] [INFO ] [REMOTE ] CTO: Full fetch complete (41613 records). [2025-10-16T18:15:26.133426] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-16T18:15:26.347945] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-16T18:15:26.559523] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-16T18:15:26.559869] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-16T18:15:26.562373] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T18:15:26.563368] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-16T18:15:26.576600] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-16T18:15:26.578568] [DEBUG] [LOCAL ] CTO: Trimmed 41613 records to 27883 (keeping 200 days of data) [2025-10-16T18:15:26.753255] [DEBUG] [LOCAL ] CTO: Primary data saved (27883 records). [2025-10-16T18:15:26.753404] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-16T18:15:26.753485] [INFO ] [MAIN ] Update Progress: 547/2369 symbols completed. CTO took 26.5s. Estimated remaining: 4h 11m 6s. Rate: 7.3 symbols/min [2025-10-16T18:15:26.927910] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:15:26.928282] [DEBUG] [LOCAL ] CTRI: No existing data file found in primary storage. [2025-10-16T18:15:26.928388] [WARN ] [MAIN ] CTRI: No existing data found, performing full refresh instead. [2025-10-16T18:15:26.928613] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-16T18:15:26.928751] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-16T18:15:26.928866] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-16T18:15:26.928928] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-16T18:15:27.149856] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-16T18:15:27.310587] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:15:27.340707] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-16T18:15:27.620010] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-16T18:15:27.942847] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-16T18:15:28.742799] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-16T18:15:28.967696] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-16T18:15:29.542914] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-16T18:15:29.725177] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T18:15:30.193737] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T18:15:30.342835] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-16T18:15:31.142857] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-16T18:15:31.231102] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T18:15:31.942827] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-16T18:15:32.179209] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T18:15:32.407577] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-16T18:15:32.413127] [INFO ] [REMOTE ] CTOS: Full fetch complete (53623 records). [2025-10-16T18:15:32.413276] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-16T18:15:32.414154] [FATAL] [VALIDATOR ] CTOS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:15:32.414264] [FATAL] [MAIN ] CTOS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:15:32.414336] [WARN ] [MAIN ] CTOS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:15:32.414435] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-16T18:15:32.414515] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-16T18:15:32.414552] [INFO ] [LOCAL ] CTOS: Starting deletion of derivative data. [2025-10-16T18:15:32.414706] [DEBUG] [LOCAL ] CTOS: Deleted derivative data file. [2025-10-16T18:15:32.414795] [INFO ] [MAIN ] Update Progress: 548/2369 symbols completed. CTOS took 30.6s. Estimated remaining: 4h 10m 49s. Rate: 7.3 symbols/min [2025-10-16T18:15:32.590670] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:15:32.609861] [DEBUG] [LOCAL ] CTS: Loaded 19649 existing records from primary storage. [2025-10-16T18:15:32.610199] [INFO ] [MAIN ] CTS: Loaded 19649 existing records. [2025-10-16T18:15:32.747910] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-16T18:15:32.788438] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:15:32.789528] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-16T18:15:32.789601] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-16T18:15:32.790252] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-16T18:15:32.790313] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-16T18:15:33.141095] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:15:33.542800] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-16T18:15:34.022972] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-16T18:15:34.052777] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T18:15:34.342822] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-16T18:15:35.142800] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-16T18:15:35.395899] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T18:15:35.660232] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T18:15:35.942816] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-16T18:15:36.097125] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T18:15:36.742780] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-16T18:15:36.989277] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T18:15:37.482159] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T18:15:37.542841] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-16T18:15:38.342854] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-16T18:15:39.126247] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T18:15:39.142806] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-16T18:15:39.370571] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T18:15:39.942859] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-16T18:15:40.435422] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T18:15:40.557691] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T18:15:40.742806] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-16T18:15:41.542838] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-16T18:15:42.012153] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T18:15:42.342887] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-16T18:15:43.142810] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-16T18:15:43.440806] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T18:15:43.590183] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T18:15:43.942821] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-16T18:15:44.742851] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-16T18:15:44.896725] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T18:15:45.247413] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T18:15:45.474756] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T18:15:45.542822] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-16T18:15:46.342844] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-16T18:15:47.142790] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-16T18:15:47.289042] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T18:15:47.414190] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-16T18:15:47.942863] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-16T18:15:48.153062] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-16T18:15:48.742804] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-16T18:15:49.542841] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-16T18:15:49.605420] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T18:15:50.342983] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-16T18:15:50.553740] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T18:15:50.598426] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T18:15:51.142886] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-16T18:15:51.926970] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T18:15:51.934201] [INFO ] [REMOTE ] CTRE: Full fetch complete (71022 records). [2025-10-16T18:15:51.934463] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-16T18:15:51.935777] [FATAL] [VALIDATOR ] CTRE: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:15:51.935890] [FATAL] [MAIN ] CTRE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:15:51.935963] [WARN ] [MAIN ] CTRE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:15:51.936054] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-16T18:15:51.936135] [DEBUG] [LOCAL ] CTRE: No primary data file found to delete. [2025-10-16T18:15:51.936181] [INFO ] [LOCAL ] CTRE: Starting deletion of derivative data. [2025-10-16T18:15:51.936336] [DEBUG] [LOCAL ] CTRE: Deleted derivative data file. [2025-10-16T18:15:51.937593] [INFO ] [MAIN ] Update Progress: 549/2369 symbols completed. CTRE took 32.6s. Estimated remaining: 4h 11m 18s. Rate: 7.2 symbols/min [2025-10-16T18:15:51.950691] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-16T18:15:52.130135] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:15:52.196113] [DEBUG] [LOCAL ] CTVA: Loaded 53298 existing records from primary storage. [2025-10-16T18:15:52.196612] [INFO ] [MAIN ] CTVA: Loaded 53298 existing records. [2025-10-16T18:15:52.360996] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T18:15:52.426665] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:15:52.426983] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-16T18:15:52.427037] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-16T18:15:52.428033] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-16T18:15:52.428097] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-16T18:15:52.749889] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-16T18:15:52.848146] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:15:53.418869] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T18:15:53.542855] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-16T18:15:54.337842] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T18:15:54.348137] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-16T18:15:54.430599] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T18:15:55.142819] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-16T18:15:55.942841] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-16T18:15:56.065849] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T18:15:56.278286] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-16T18:15:56.742825] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-16T18:15:57.545567] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-16T18:15:57.553278] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T18:15:57.814402] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T18:15:57.818727] [INFO ] [REMOTE ] CTS: Full fetch complete (27097 records). [2025-10-16T18:15:57.818861] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-16T18:15:58.202470] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-16T18:15:58.202553] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-16T18:15:58.203108] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-16T18:15:58.203171] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-16T18:15:58.204003] [DEBUG] [LOCAL ] CTS: Trimmed 27097 records to 19832 (keeping 200 days of data) [2025-10-16T18:15:58.334081] [DEBUG] [LOCAL ] CTS: Primary data saved (19832 records). [2025-10-16T18:15:58.334202] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-16T18:15:58.334280] [INFO ] [MAIN ] Update Progress: 550/2369 symbols completed. CTS took 25.9s. Estimated remaining: 4h 11m 3s. Rate: 7.2 symbols/min [2025-10-16T18:15:58.347928] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-16T18:15:58.504936] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:15:58.505127] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-16T18:15:58.505164] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-16T18:15:58.505275] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-16T18:15:58.505316] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-16T18:15:58.505356] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-16T18:15:58.505387] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-16T18:15:58.863618] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:15:58.885596] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T18:15:59.142880] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-16T18:15:59.468376] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-16T18:15:59.942806] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-16T18:16:00.121102] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T18:16:00.742866] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-16T18:16:01.527584] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T18:16:01.542772] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-16T18:16:01.854381] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-16T18:16:02.342859] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-16T18:16:02.432407] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T18:16:02.608548] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-16T18:16:03.142844] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-16T18:16:03.942792] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-16T18:16:04.742794] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-16T18:16:05.012916] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-16T18:16:05.121732] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-16T18:16:05.129109] [INFO ] [REMOTE ] CTRA: Full fetch complete (77821 records). [2025-10-16T18:16:05.129282] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-16T18:16:05.542910] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-16T18:16:05.544448] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-16T18:16:05.544661] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-16T18:16:05.545710] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-16T18:16:05.545888] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-16T18:16:05.547591] [DEBUG] [LOCAL ] CTRA: Trimmed 77821 records to 54038 (keeping 200 days of data) [2025-10-16T18:16:05.670872] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T18:16:05.914869] [DEBUG] [LOCAL ] CTRA: Primary data saved (54038 records). [2025-10-16T18:16:05.915008] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-16T18:16:05.915087] [INFO ] [MAIN ] Update Progress: 551/2369 symbols completed. CTRA took 48.2s. Estimated remaining: 4h 10m 53s. Rate: 7.2 symbols/min [2025-10-16T18:16:06.007620] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-16T18:16:06.085202] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:16:06.130672] [DEBUG] [LOCAL ] CUBE: Loaded 50909 existing records from primary storage. [2025-10-16T18:16:06.131009] [INFO ] [MAIN ] CUBE: Loaded 50909 existing records. [2025-10-16T18:16:06.303673] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:16:06.303902] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-16T18:16:06.303957] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-16T18:16:06.304908] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-16T18:16:06.304965] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-16T18:16:06.347976] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-16T18:16:06.692926] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:16:07.142871] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-16T18:16:07.472291] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-16T18:16:07.942797] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-16T18:16:08.292812] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-16T18:16:08.742837] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-16T18:16:09.542816] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-16T18:16:09.672567] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T18:16:10.304433] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T18:16:10.342778] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-16T18:16:11.005144] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T18:16:11.142784] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-16T18:16:11.942788] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-16T18:16:12.053686] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T18:16:12.359271] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-16T18:16:12.742790] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-16T18:16:12.804538] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T18:16:12.811549] [INFO ] [REMOTE ] CTRI: Full fetch complete (53266 records). [2025-10-16T18:16:12.811747] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-16T18:16:12.812446] [FATAL] [VALIDATOR ] CTRI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:16:12.812548] [FATAL] [MAIN ] CTRI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:16:12.812591] [WARN ] [MAIN ] CTRI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:16:12.812629] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-16T18:16:12.812750] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-16T18:16:12.812810] [INFO ] [LOCAL ] CTRI: Starting deletion of derivative data. [2025-10-16T18:16:12.812858] [DEBUG] [LOCAL ] CTRI: No derivative data file found to delete. [2025-10-16T18:16:12.812914] [INFO ] [MAIN ] Update Progress: 552/2369 symbols completed. CTRI took 46.1s. Estimated remaining: 4h 10m 40s. Rate: 7.2 symbols/min [2025-10-16T18:16:13.014477] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:16:13.040681] [DEBUG] [LOCAL ] CUBI: Loaded 27163 existing records from primary storage. [2025-10-16T18:16:13.040946] [INFO ] [MAIN ] CUBI: Loaded 27163 existing records. [2025-10-16T18:16:13.116915] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-16T18:16:13.239272] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:16:13.239535] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-16T18:16:13.239585] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-16T18:16:13.240059] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-16T18:16:13.240115] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-16T18:16:13.547947] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-16T18:16:13.585964] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:16:14.342886] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-16T18:16:14.705816] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-16T18:16:15.142810] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-16T18:16:15.260356] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T18:16:15.942820] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-16T18:16:16.288590] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-16T18:16:16.742835] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-16T18:16:16.968395] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T18:16:17.120209] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-16T18:16:17.120983] [INFO ] [REMOTE ] CUBB: Full fetch complete (965 records). [2025-10-16T18:16:17.121054] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-16T18:16:17.303425] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-16T18:16:17.303634] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:16:17.303726] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:16:17.303799] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-16T18:16:17.303863] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-16T18:16:17.303900] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-16T18:16:17.303990] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-16T18:16:17.304063] [INFO ] [MAIN ] Update Progress: 553/2369 symbols completed. CUBB took 19.0s. Estimated remaining: 4h 10m 19s. Rate: 7.3 symbols/min [2025-10-16T18:16:17.478286] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:16:17.524679] [DEBUG] [LOCAL ] CUK: Loaded 51046 existing records from primary storage. [2025-10-16T18:16:17.525004] [INFO ] [MAIN ] CUK: Loaded 51046 existing records. [2025-10-16T18:16:17.553196] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-16T18:16:17.701172] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:16:17.701402] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-16T18:16:17.701449] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-16T18:16:17.702249] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-16T18:16:17.702309] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-16T18:16:18.046704] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:16:18.342866] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-16T18:16:19.142789] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-16T18:16:19.270618] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T18:16:19.582731] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T18:16:19.942801] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-16T18:16:20.742812] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-16T18:16:20.832577] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T18:16:21.542822] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-16T18:16:21.655569] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T18:16:21.920528] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-16T18:16:22.342812] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-16T18:16:23.142843] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-16T18:16:23.266726] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T18:16:23.369767] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T18:16:23.942840] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-16T18:16:24.742824] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-16T18:16:25.152404] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T18:16:25.542813] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-16T18:16:25.601478] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T18:16:26.266873] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T18:16:26.342789] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-16T18:16:27.142856] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-16T18:16:27.362372] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T18:16:27.942793] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-16T18:16:28.056891] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-16T18:16:28.630473] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T18:16:28.742782] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-16T18:16:29.045552] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T18:16:29.542813] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-16T18:16:30.342879] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-16T18:16:30.742634] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T18:16:31.142783] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-16T18:16:31.178262] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-16T18:16:31.184767] [INFO ] [REMOTE ] CTVA: Full fetch complete (76821 records). [2025-10-16T18:16:31.184903] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-16T18:16:31.186539] [FATAL] [VALIDATOR ] CTVA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:16:31.186629] [FATAL] [MAIN ] CTVA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:16:31.186723] [WARN ] [MAIN ] CTVA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:16:31.186793] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-16T18:16:31.186854] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-16T18:16:31.186888] [INFO ] [LOCAL ] CTVA: Starting deletion of derivative data. [2025-10-16T18:16:31.187041] [DEBUG] [LOCAL ] CTVA: Deleted derivative data file. [2025-10-16T18:16:31.188017] [INFO ] [MAIN ] Update Progress: 554/2369 symbols completed. CTVA took 39.3s. Estimated remaining: 4h 10m 29s. Rate: 7.2 symbols/min [2025-10-16T18:16:31.360829] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:16:31.361095] [DEBUG] [LOCAL ] CULP: No existing data file found in primary storage. [2025-10-16T18:16:31.361150] [WARN ] [MAIN ] CULP: No existing data found, performing full refresh instead. [2025-10-16T18:16:31.361267] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-16T18:16:31.361321] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-16T18:16:31.361373] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-16T18:16:31.361406] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-16T18:16:31.729753] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:16:31.942855] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-16T18:16:32.184084] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-16T18:16:32.742789] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-16T18:16:32.934763] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T18:16:33.090548] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-16T18:16:33.542806] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-16T18:16:34.269595] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T18:16:34.342772] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-16T18:16:34.588314] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T18:16:35.142801] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-16T18:16:35.921196] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T18:16:35.942776] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-16T18:16:36.216327] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T18:16:36.742823] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-16T18:16:37.279604] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T18:16:37.542830] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-16T18:16:37.684546] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T18:16:38.250084] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T18:16:38.342829] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-16T18:16:39.142886] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-16T18:16:39.399987] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T18:16:39.942873] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-16T18:16:40.705348] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T18:16:40.742770] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-16T18:16:41.212589] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T18:16:41.542842] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-16T18:16:42.342836] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-16T18:16:42.439572] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T18:16:42.520742] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T18:16:42.524243] [INFO ] [REMOTE ] CUBI: Full fetch complete (39206 records). [2025-10-16T18:16:42.524346] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-16T18:16:42.794235] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-16T18:16:42.901787] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-16T18:16:42.901878] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-16T18:16:42.902489] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-16T18:16:42.902528] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-16T18:16:42.903442] [DEBUG] [LOCAL ] CUBI: Trimmed 39206 records to 27422 (keeping 200 days of data) [2025-10-16T18:16:43.056763] [DEBUG] [LOCAL ] CUBI: Primary data saved (27422 records). [2025-10-16T18:16:43.056893] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-16T18:16:43.056972] [INFO ] [MAIN ] Update Progress: 555/2369 symbols completed. CUBI took 30.2s. Estimated remaining: 4h 10m 33s. Rate: 7.2 symbols/min [2025-10-16T18:16:43.147950] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-16T18:16:43.239238] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:16:43.271278] [DEBUG] [LOCAL ] CURB: Loaded 32854 existing records from primary storage. [2025-10-16T18:16:43.271544] [INFO ] [MAIN ] CURB: Loaded 32854 existing records. [2025-10-16T18:16:43.447012] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:16:43.447238] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-16T18:16:43.447284] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-16T18:16:43.447483] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-16T18:16:43.447539] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-16T18:16:43.789943] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:16:43.942822] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-16T18:16:44.341690] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T18:16:44.742796] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-16T18:16:45.075274] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-16T18:16:45.082002] [INFO ] [REMOTE ] CUBE: Full fetch complete (73240 records). [2025-10-16T18:16:45.082125] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-16T18:16:45.497270] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-16T18:16:45.497400] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-16T18:16:45.498325] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-16T18:16:45.498391] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-16T18:16:45.500032] [DEBUG] [LOCAL ] CUBE: Trimmed 73240 records to 51290 (keeping 200 days of data) [2025-10-16T18:16:45.553992] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-16T18:16:45.814856] [DEBUG] [LOCAL ] CUBE: Primary data saved (51290 records). [2025-10-16T18:16:45.814994] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-16T18:16:45.815074] [INFO ] [MAIN ] Update Progress: 556/2369 symbols completed. CUBE took 39.9s. Estimated remaining: 4h 10m 7s. Rate: 7.2 symbols/min [2025-10-16T18:16:45.986024] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:16:46.014960] [DEBUG] [LOCAL ] CURV: Loaded 26989 existing records from primary storage. [2025-10-16T18:16:46.015284] [INFO ] [MAIN ] CURV: Loaded 26989 existing records. [2025-10-16T18:16:46.208084] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:16:46.213782] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-16T18:16:46.214102] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-16T18:16:46.214037] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-16T18:16:46.216488] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-16T18:16:46.218753] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-16T18:16:46.347918] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-16T18:16:46.589716] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:16:46.635577] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-16T18:16:47.073111] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T18:16:47.142799] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-16T18:16:47.942802] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-16T18:16:48.343188] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T18:16:48.639477] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T18:16:48.742814] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-16T18:16:49.542831] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-16T18:16:50.342802] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-16T18:16:50.366254] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T18:16:51.142840] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-16T18:16:51.441365] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-16T18:16:51.782042] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T18:16:51.942787] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-16T18:16:52.043207] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T18:16:52.397005] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-16T18:16:52.742796] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-16T18:16:53.126746] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-16T18:16:53.542837] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-16T18:16:54.342837] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-16T18:16:54.773691] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-16T18:16:55.142838] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-16T18:16:55.345494] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T18:16:55.353142] [INFO ] [REMOTE ] CUK: Full fetch complete (74298 records). [2025-10-16T18:16:55.353398] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-16T18:16:55.750232] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-16T18:16:55.750310] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-16T18:16:55.751269] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-16T18:16:55.751335] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-16T18:16:55.752793] [DEBUG] [LOCAL ] CUK: Trimmed 74298 records to 51433 (keeping 200 days of data) [2025-10-16T18:16:55.952384] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-16T18:16:56.056926] [DEBUG] [LOCAL ] CUK: Primary data saved (51433 records). [2025-10-16T18:16:56.057086] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-16T18:16:56.057809] [INFO ] [MAIN ] Update Progress: 557/2369 symbols completed. CUK took 38.8s. Estimated remaining: 4h 10m 5s. Rate: 7.2 symbols/min [2025-10-16T18:16:56.366491] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T18:16:56.541227] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-16T18:16:56.742844] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-16T18:16:57.542807] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-16T18:16:57.773181] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T18:16:58.342796] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-16T18:16:58.918365] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T18:16:59.142784] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-16T18:16:59.460322] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T18:16:59.652379] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-16T18:16:59.653310] [INFO ] [REMOTE ] CULP: Full fetch complete (4573 records). [2025-10-16T18:16:59.653381] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-16T18:16:59.947910] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-16T18:17:00.015943] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-16T18:17:00.016017] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-16T18:17:00.016167] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-16T18:17:00.016208] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-16T18:17:00.016557] [DEBUG] [LOCAL ] CULP: Trimmed 4573 records to 2930 (keeping 200 days of data) [2025-10-16T18:17:00.032870] [DEBUG] [LOCAL ] CULP: Primary data saved (2930 records). [2025-10-16T18:17:00.032952] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-16T18:17:00.033017] [INFO ] [MAIN ] Update Progress: 558/2369 symbols completed. CULP took 28.8s. Estimated remaining: 4h 9m 42s. Rate: 7.3 symbols/min [2025-10-16T18:17:00.742864] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-16T18:17:00.962869] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-16T18:17:01.542892] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-16T18:17:02.265881] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T18:17:02.342785] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-16T18:17:02.512434] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T18:17:03.142817] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-16T18:17:03.520041] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T18:17:03.942919] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-16T18:17:04.008892] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T18:17:04.742925] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-16T18:17:05.297928] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T18:17:05.542862] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-16T18:17:05.766204] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-16T18:17:06.342924] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-16T18:17:06.905366] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T18:17:07.142784] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-16T18:17:07.430161] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T18:17:07.942825] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-16T18:17:08.580992] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T18:17:08.742830] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-16T18:17:08.923413] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T18:17:09.542875] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-16T18:17:10.148777] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T18:17:10.342830] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-16T18:17:10.916256] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T18:17:10.920393] [INFO ] [REMOTE ] CURV: Full fetch complete (38707 records). [2025-10-16T18:17:10.920484] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-16T18:17:10.921053] [FATAL] [VALIDATOR ] CURV: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:17:10.921136] [FATAL] [MAIN ] CURV: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:17:10.921179] [WARN ] [MAIN ] CURV: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:17:10.921245] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-16T18:17:10.921306] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-10-16T18:17:10.921352] [INFO ] [LOCAL ] CURV: Starting deletion of derivative data. [2025-10-16T18:17:10.921525] [DEBUG] [LOCAL ] CURV: Deleted derivative data file. [2025-10-16T18:17:10.921669] [INFO ] [MAIN ] Update Progress: 559/2369 symbols completed. CURV took 25.1s. Estimated remaining: 4h 9m 43s. Rate: 7.2 symbols/min [2025-10-16T18:17:11.535120] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T18:17:11.540389] [INFO ] [REMOTE ] CURB: Full fetch complete (47331 records). [2025-10-16T18:17:11.540521] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-16T18:17:11.957578] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-16T18:17:11.957682] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-16T18:17:11.958400] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-16T18:17:11.958442] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-16T18:17:11.959449] [DEBUG] [LOCAL ] CURB: Trimmed 47331 records to 33087 (keeping 200 days of data) [2025-10-16T18:17:12.157614] [DEBUG] [LOCAL ] CURB: Primary data saved (33087 records). [2025-10-16T18:17:12.157794] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-16T18:17:12.157880] [INFO ] [MAIN ] Update Progress: 560/2369 symbols completed. CURB took 29.1s. Estimated remaining: 4h 9m 12s. Rate: 7.3 symbols/min [2025-10-16T18:17:12.898816] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:17:12.906903] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:17:12.905106] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:17:12.917835] [DEBUG] [LOCAL ] CVE: No existing data file found in primary storage. [2025-10-16T18:17:12.933125] [WARN ] [MAIN ] CVE: No existing data found, performing full refresh instead. [2025-10-16T18:17:12.939900] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-16T18:17:12.939428] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:17:12.940150] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-16T18:17:12.940436] [DEBUG] [LOCAL ] CVE: No primary data file found to delete. [2025-10-16T18:17:12.940630] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-16T18:17:13.033140] [DEBUG] [LOCAL ] CVEO: Loaded 15382 existing records from primary storage. [2025-10-16T18:17:13.056467] [INFO ] [MAIN ] CVEO: Loaded 15382 existing records. [2025-10-16T18:17:13.326938] [DEBUG] [LOCAL ] CVI: Loaded 46660 existing records from primary storage. [2025-10-16T18:17:13.462409] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:17:13.456862] [INFO ] [MAIN ] CVI: Loaded 46660 existing records. [2025-10-16T18:17:13.479794] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-16T18:17:13.540627] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-16T18:17:13.579847] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-16T18:17:13.574469] [DEBUG] [LOCAL ] CUZ: Loaded 49639 existing records from primary storage. [2025-10-16T18:17:13.579958] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-16T18:17:13.642288] [INFO ] [MAIN ] CUZ: Loaded 49639 existing records. [2025-10-16T18:17:13.839857] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:17:13.966003] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:17:13.902338] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-16T18:17:14.015616] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-16T18:17:14.081736] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-16T18:17:14.173686] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-16T18:17:14.190227] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-16T18:17:14.173608] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:17:14.205525] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-16T18:17:14.205702] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-16T18:17:14.255852] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-16T18:17:14.291764] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-16T18:17:14.543324] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:17:14.574012] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-16T18:17:15.115598] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:17:15.126815] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-16T18:17:15.147982] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:17:15.148270] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-16T18:17:15.408618] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T18:17:15.411835] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-16T18:17:15.921847] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-16T18:17:15.932723] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-16T18:17:16.155078] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T18:17:16.157324] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-16T18:17:16.384604] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T18:17:16.750497] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-16T18:17:16.755426] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T18:17:16.960053] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T18:17:17.334000] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T18:17:17.542810] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-16T18:17:18.344183] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-16T18:17:18.346566] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T18:17:18.518737] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T18:17:19.142858] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-16T18:17:19.942795] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-16T18:17:20.144060] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T18:17:20.655027] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T18:17:20.687379] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T18:17:20.742822] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-16T18:17:21.542831] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-16T18:17:22.214264] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T18:17:22.342810] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-16T18:17:23.034049] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T18:17:23.142783] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-16T18:17:23.830492] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T18:17:23.942794] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-16T18:17:24.350023] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T18:17:24.742831] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-16T18:17:25.542801] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-16T18:17:25.894620] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T18:17:26.342773] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-16T18:17:26.456198] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T18:17:26.886288] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T18:17:27.142810] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-16T18:17:27.942784] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-16T18:17:28.259717] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-16T18:17:28.742808] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-16T18:17:28.852853] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-16T18:17:29.267467] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T18:17:29.542832] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-16T18:17:30.342791] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-16T18:17:30.558972] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T18:17:30.607020] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T18:17:31.142832] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-16T18:17:31.743693] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T18:17:31.942825] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-16T18:17:32.742783] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-16T18:17:33.094164] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-16T18:17:33.189103] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T18:17:33.542811] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-16T18:17:34.228072] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T18:17:34.342784] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-16T18:17:34.498303] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T18:17:35.142805] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-16T18:17:35.583445] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T18:17:35.942812] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-16T18:17:36.742803] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-16T18:17:36.867843] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T18:17:37.343070] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T18:17:37.542781] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-16T18:17:37.651364] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-16T18:17:38.342884] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-16T18:17:39.132148] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T18:17:39.142839] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-16T18:17:39.799257] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T18:17:39.942800] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-16T18:17:40.724554] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-16T18:17:40.742781] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-16T18:17:40.928929] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T18:17:41.542862] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-16T18:17:42.342847] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-16T18:17:42.484786] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T18:17:43.142873] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-16T18:17:43.238368] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T18:17:43.272579] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T18:17:43.282587] [INFO ] [REMOTE ] CVI: Full fetch complete (67274 records). [2025-10-16T18:17:43.282922] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-16T18:17:43.693268] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-16T18:17:43.693377] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-16T18:17:43.694520] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-16T18:17:43.694587] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-16T18:17:43.696410] [DEBUG] [LOCAL ] CVI: Trimmed 67274 records to 47001 (keeping 200 days of data) [2025-10-16T18:17:43.943586] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-16T18:17:43.992312] [DEBUG] [LOCAL ] CVI: Primary data saved (47001 records). [2025-10-16T18:17:43.992505] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-16T18:17:43.992602] [INFO ] [MAIN ] Update Progress: 561/2369 symbols completed. CVI took 31.8s. Estimated remaining: 4h 10m 19s. Rate: 7.2 symbols/min [2025-10-16T18:17:44.171117] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:17:44.171464] [DEBUG] [LOCAL ] CVLG: No existing data file found in primary storage. [2025-10-16T18:17:44.171509] [WARN ] [MAIN ] CVLG: No existing data found, performing full refresh instead. [2025-10-16T18:17:44.171707] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-16T18:17:44.171762] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-16T18:17:44.171806] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-16T18:17:44.171854] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-16T18:17:44.544700] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:17:44.742837] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-16T18:17:44.867960] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T18:17:44.870752] [INFO ] [REMOTE ] CVEO: Full fetch complete (20713 records). [2025-10-16T18:17:44.870871] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-16T18:17:44.871549] [FATAL] [VALIDATOR ] CVEO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:17:44.871680] [FATAL] [MAIN ] CVEO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:17:44.871743] [WARN ] [MAIN ] CVEO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:17:44.871815] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-16T18:17:44.871975] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-16T18:17:44.872036] [INFO ] [LOCAL ] CVEO: Starting deletion of derivative data. [2025-10-16T18:17:44.872391] [DEBUG] [LOCAL ] CVEO: Deleted derivative data file. [2025-10-16T18:17:44.872495] [INFO ] [MAIN ] Update Progress: 562/2369 symbols completed. CVEO took 32.7s. Estimated remaining: 4h 9m 47s. Rate: 7.2 symbols/min [2025-10-16T18:17:45.061786] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:17:45.062058] [DEBUG] [LOCAL ] CVNA: No existing data file found in primary storage. [2025-10-16T18:17:45.062138] [WARN ] [MAIN ] CVNA: No existing data found, performing full refresh instead. [2025-10-16T18:17:45.062622] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-16T18:17:45.062714] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-16T18:17:45.062773] [DEBUG] [LOCAL ] CVNA: No primary data file found to delete. [2025-10-16T18:17:45.062810] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-16T18:17:45.181391] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-16T18:17:45.508995] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:17:45.542777] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-16T18:17:46.130356] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T18:17:46.137829] [INFO ] [REMOTE ] CUZ: Full fetch complete (70920 records). [2025-10-16T18:17:46.138076] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-16T18:17:46.353795] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-16T18:17:46.563544] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-16T18:17:46.563670] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-16T18:17:46.564996] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-16T18:17:46.565064] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-16T18:17:46.566958] [DEBUG] [LOCAL ] CUZ: Trimmed 70920 records to 50005 (keeping 200 days of data) [2025-10-16T18:17:46.907263] [DEBUG] [LOCAL ] CUZ: Primary data saved (50005 records). [2025-10-16T18:17:46.907513] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-16T18:17:46.907678] [INFO ] [MAIN ] Update Progress: 563/2369 symbols completed. CUZ took 34.7s. Estimated remaining: 4h 9m 19s. Rate: 7.2 symbols/min [2025-10-16T18:17:47.099596] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:17:47.142850] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-16T18:17:47.158925] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T18:17:47.179352] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T18:17:47.199912] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-16T18:17:47.200351] [INFO ] [MAIN ] CVS: Loaded 53694 existing records. [2025-10-16T18:17:47.380821] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:17:47.381076] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-16T18:17:47.381129] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-16T18:17:47.381395] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-16T18:17:47.381457] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-16T18:17:47.747147] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:17:47.942840] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-16T18:17:48.742896] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-16T18:17:49.065146] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-16T18:17:49.072784] [INFO ] [REMOTE ] CVE: Full fetch complete (77716 records). [2025-10-16T18:17:49.072968] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-16T18:17:49.474672] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-16T18:17:49.474803] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-16T18:17:49.476282] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-16T18:17:49.476350] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-16T18:17:49.478367] [DEBUG] [LOCAL ] CVE: Trimmed 77716 records to 53952 (keeping 200 days of data) [2025-10-16T18:17:49.547445] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-16T18:17:49.869331] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-16T18:17:49.873582] [DEBUG] [LOCAL ] CVE: Primary data saved (53952 records). [2025-10-16T18:17:49.884860] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-16T18:17:49.885017] [INFO ] [MAIN ] Update Progress: 564/2369 symbols completed. CVE took 37.7s. Estimated remaining: 4h 8m 53s. Rate: 7.3 symbols/min [2025-10-16T18:17:50.071595] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:17:50.138134] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-16T18:17:50.138560] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-16T18:17:50.342590] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:17:50.343337] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-16T18:17:50.343113] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-16T18:17:50.352879] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-16T18:17:50.356860] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-16T18:17:50.356940] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-16T18:17:50.357468] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-16T18:17:50.760464] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:17:51.082411] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-16T18:17:51.142800] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-16T18:17:51.942858] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-16T18:17:52.238397] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-16T18:17:52.719110] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T18:17:52.742834] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-16T18:17:53.057730] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-16T18:17:53.542830] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-16T18:17:54.342906] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-16T18:17:54.911751] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-16T18:17:55.058994] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T18:17:55.080617] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T18:17:55.142823] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-16T18:17:55.942798] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-16T18:17:56.272854] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T18:17:56.742867] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-16T18:17:57.542810] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-16T18:17:57.641058] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T18:17:57.810947] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-16T18:17:58.342848] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-16T18:17:59.142844] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-16T18:17:59.750771] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-16T18:17:59.942790] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-16T18:18:00.355751] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-16T18:18:00.742990] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-16T18:18:01.542792] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-16T18:18:01.628675] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-16T18:18:02.333961] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-16T18:18:02.345587] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-16T18:18:02.722554] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T18:18:02.909071] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-16T18:18:03.142881] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-16T18:18:03.942893] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-16T18:18:04.289569] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-16T18:18:04.531399] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-16T18:18:04.742800] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-16T18:18:05.044581] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-16T18:18:05.341079] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-16T18:18:05.542832] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-16T18:18:06.342855] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-16T18:18:06.373941] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T18:18:07.142814] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-16T18:18:07.942787] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-16T18:18:08.423947] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-16T18:18:08.742828] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-16T18:18:08.991556] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-16T18:18:09.109952] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T18:18:09.113050] [INFO ] [REMOTE ] CVLG: Full fetch complete (21345 records). [2025-10-16T18:18:09.113173] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-16T18:18:09.471016] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-16T18:18:09.471090] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-16T18:18:09.471537] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-16T18:18:09.471577] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-16T18:18:09.472156] [DEBUG] [LOCAL ] CVLG: Trimmed 21345 records to 15699 (keeping 200 days of data) [2025-10-16T18:18:09.555475] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-16T18:18:09.570448] [DEBUG] [LOCAL ] CVLG: Primary data saved (15699 records). [2025-10-16T18:18:09.570680] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-16T18:18:09.570832] [INFO ] [MAIN ] Update Progress: 565/2369 symbols completed. CVLG took 25.6s. Estimated remaining: 4h 9m 22s. Rate: 7.2 symbols/min [2025-10-16T18:18:09.738503] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:18:09.761470] [DEBUG] [LOCAL ] CW: Loaded 22100 existing records from primary storage. [2025-10-16T18:18:09.761761] [INFO ] [MAIN ] CW: Loaded 22100 existing records. [2025-10-16T18:18:09.932990] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:18:09.933201] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-16T18:18:09.933249] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-16T18:18:09.933526] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-16T18:18:09.933581] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-16T18:18:10.273912] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:18:10.342781] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-16T18:18:10.578118] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T18:18:11.142878] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-16T18:18:11.332026] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T18:18:11.429343] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T18:18:11.942813] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-16T18:18:12.742821] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-16T18:18:13.401516] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:18:13.542818] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-16T18:18:13.836017] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-16T18:18:14.342787] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-16T18:18:15.142864] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-16T18:18:15.912209] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-16T18:18:15.942814] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-16T18:18:16.462951] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (3.72 seconds). [2025-10-16T18:18:16.742819] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-16T18:18:17.113877] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-16T18:18:17.139099] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T18:18:17.521069] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-16T18:18:17.542754] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-16T18:18:18.342782] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-16T18:18:18.424889] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T18:18:18.731434] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T18:18:19.142814] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-16T18:18:19.942800] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-16T18:18:20.580270] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-16T18:18:20.742776] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-16T18:18:20.813173] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T18:18:21.153975] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-16T18:18:21.542812] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-16T18:18:22.342787] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-16T18:18:22.436043] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T18:18:22.443904] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-16T18:18:22.444116] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-16T18:18:22.852822] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-16T18:18:22.853006] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-16T18:18:22.854069] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-16T18:18:22.854227] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-16T18:18:22.856124] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 54084 (keeping 200 days of data) [2025-10-16T18:18:23.110630] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-16T18:18:23.144408] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-16T18:18:23.252634] [DEBUG] [LOCAL ] CVS: Primary data saved (54084 records). [2025-10-16T18:18:23.252812] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-16T18:18:23.253579] [INFO ] [MAIN ] Update Progress: 566/2369 symbols completed. CVS took 36.3s. Estimated remaining: 4h 9m 31s. Rate: 7.2 symbols/min [2025-10-16T18:18:23.458049] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:18:23.529387] [DEBUG] [LOCAL ] CWAN: Loaded 52616 existing records from primary storage. [2025-10-16T18:18:23.529863] [INFO ] [MAIN ] CWAN: Loaded 52616 existing records. [2025-10-16T18:18:23.806691] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:18:23.807018] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-16T18:18:23.807092] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-16T18:18:23.807504] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-16T18:18:23.807579] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-16T18:18:23.953056] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-16T18:18:24.294961] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:18:24.398042] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-16T18:18:24.404958] [INFO ] [REMOTE ] CVNA: Full fetch complete (76387 records). [2025-10-16T18:18:24.405139] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-16T18:18:24.406021] [FATAL] [VALIDATOR ] CVNA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:18:24.406137] [FATAL] [MAIN ] CVNA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:18:24.406191] [WARN ] [MAIN ] CVNA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:18:24.406474] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-16T18:18:24.406557] [DEBUG] [LOCAL ] CVNA: No primary data file found to delete. [2025-10-16T18:18:24.406629] [INFO ] [LOCAL ] CVNA: Starting deletion of derivative data. [2025-10-16T18:18:24.406783] [DEBUG] [LOCAL ] CVNA: No derivative data file found to delete. [2025-10-16T18:18:24.406881] [INFO ] [MAIN ] Update Progress: 567/2369 symbols completed. CVNA took 39.5s. Estimated remaining: 4h 8m 60s. Rate: 7.2 symbols/min [2025-10-16T18:18:24.618852] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:18:24.633901] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T18:18:24.676011] [DEBUG] [LOCAL ] CWEN: Loaded 45322 existing records from primary storage. [2025-10-16T18:18:24.676303] [INFO ] [MAIN ] CWEN: Loaded 45322 existing records. [2025-10-16T18:18:24.749956] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-16T18:18:24.853512] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:18:24.853756] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-16T18:18:24.853809] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-16T18:18:24.853984] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-16T18:18:24.854021] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-16T18:18:25.203971] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:18:25.542819] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-16T18:18:26.358551] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-16T18:18:26.361777] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-16T18:18:26.432195] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T18:18:26.598008] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T18:18:27.142860] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-16T18:18:27.730334] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T18:18:27.942806] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-16T18:18:28.422990] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T18:18:28.742875] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-16T18:18:29.542870] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-16T18:18:30.171946] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-16T18:18:30.220065] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T18:18:30.342805] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-16T18:18:31.142803] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-16T18:18:31.195841] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T18:18:31.942795] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-16T18:18:32.742809] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-16T18:18:33.070412] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-16T18:18:33.243883] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.90 seconds). [2025-10-16T18:18:33.542817] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-16T18:18:34.342849] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-16T18:18:34.603931] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-10-16T18:18:35.142810] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-16T18:18:35.221411] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T18:18:35.229733] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-16T18:18:35.229939] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-16T18:18:35.668558] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (2.93 seconds). [2025-10-16T18:18:35.694754] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-16T18:18:35.699421] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-16T18:18:35.710156] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-16T18:18:35.711995] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-16T18:18:35.712094] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-16T18:18:35.713906] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 54150 (keeping 200 days of data) [2025-10-16T18:18:35.952224] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-16T18:18:36.050212] [DEBUG] [LOCAL ] CVX: Primary data saved (54150 records). [2025-10-16T18:18:36.050345] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-16T18:18:36.051321] [INFO ] [MAIN ] Update Progress: 568/2369 symbols completed. CVX took 46.2s. Estimated remaining: 4h 9m 2s. Rate: 7.2 symbols/min [2025-10-16T18:18:36.226306] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:18:36.281787] [DEBUG] [LOCAL ] CWH: Loaded 51349 existing records from primary storage. [2025-10-16T18:18:36.282298] [INFO ] [MAIN ] CWH: Loaded 51349 existing records. [2025-10-16T18:18:36.472700] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:18:36.473060] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-16T18:18:36.473167] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-16T18:18:36.473525] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-16T18:18:36.473598] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-16T18:18:36.645969] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T18:18:36.747946] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-16T18:18:36.882589] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:18:37.542799] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-16T18:18:37.627688] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T18:18:38.342783] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-16T18:18:38.466776] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T18:18:38.555183] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-16T18:18:38.558464] [INFO ] [REMOTE ] CW: Full fetch complete (33033 records). [2025-10-16T18:18:38.558574] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-16T18:18:38.559202] [FATAL] [VALIDATOR ] CW: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:18:38.559292] [FATAL] [MAIN ] CW: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:18:38.559357] [WARN ] [MAIN ] CW: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:18:38.559431] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-16T18:18:38.559495] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-10-16T18:18:38.559532] [INFO ] [LOCAL ] CW: Starting deletion of derivative data. [2025-10-16T18:18:38.559687] [DEBUG] [LOCAL ] CW: Deleted derivative data file. [2025-10-16T18:18:38.559777] [INFO ] [MAIN ] Update Progress: 569/2369 symbols completed. CW took 29.0s. Estimated remaining: 4h 8m 35s. Rate: 7.2 symbols/min [2025-10-16T18:18:38.761789] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:18:38.812352] [DEBUG] [LOCAL ] CWK: Loaded 49628 existing records from primary storage. [2025-10-16T18:18:38.812764] [INFO ] [MAIN ] CWK: Loaded 49628 existing records. [2025-10-16T18:18:39.025112] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:18:39.025407] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-16T18:18:39.025483] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-16T18:18:39.025806] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-16T18:18:39.025867] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-16T18:18:39.145178] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-16T18:18:39.420754] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:18:39.749850] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T18:18:39.942836] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-16T18:18:40.263580] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T18:18:40.742867] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-16T18:18:41.542791] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-16T18:18:41.706052] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T18:18:42.349679] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-16T18:18:42.355383] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T18:18:42.994253] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T18:18:43.142832] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-16T18:18:43.942840] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-16T18:18:44.031299] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T18:18:44.233390] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T18:18:44.742821] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-16T18:18:45.542861] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-16T18:18:45.760405] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T18:18:46.055452] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T18:18:46.342834] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-16T18:18:47.142874] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-16T18:18:47.719143] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-16T18:18:47.942786] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-16T18:18:48.261680] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T18:18:48.286006] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-16T18:18:48.742910] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-16T18:18:49.542796] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-16T18:18:49.649094] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T18:18:50.084132] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T18:18:50.342875] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-16T18:18:50.897759] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T18:18:51.142845] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-16T18:18:51.800010] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T18:18:51.942821] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-16T18:18:52.742802] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-16T18:18:52.869857] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T18:18:53.485855] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-16T18:18:53.492677] [INFO ] [REMOTE ] CWAN: Full fetch complete (75552 records). [2025-10-16T18:18:53.492841] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-16T18:18:53.552229] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-16T18:18:53.898182] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-16T18:18:53.898272] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-16T18:18:53.899344] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-16T18:18:53.899419] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-16T18:18:53.901029] [DEBUG] [LOCAL ] CWAN: Trimmed 75552 records to 53002 (keeping 200 days of data) [2025-10-16T18:18:54.145037] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T18:18:54.256789] [DEBUG] [LOCAL ] CWAN: Primary data saved (53002 records). [2025-10-16T18:18:54.256928] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-16T18:18:54.257536] [INFO ] [MAIN ] Update Progress: 570/2369 symbols completed. CWAN took 31.0s. Estimated remaining: 4h 8m 50s. Rate: 7.2 symbols/min [2025-10-16T18:18:54.350780] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-16T18:18:54.433353] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:18:54.463307] [DEBUG] [LOCAL ] CWT: Loaded 28121 existing records from primary storage. [2025-10-16T18:18:54.463570] [INFO ] [MAIN ] CWT: Loaded 28121 existing records. [2025-10-16T18:18:54.650859] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:18:54.651057] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-16T18:18:54.651104] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-16T18:18:54.651275] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-16T18:18:54.651315] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-16T18:18:55.023451] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:18:55.142860] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-16T18:18:55.527054] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T18:18:55.625855] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T18:18:55.942808] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-16T18:18:56.662617] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T18:18:56.669176] [INFO ] [REMOTE ] CWEN: Full fetch complete (65474 records). [2025-10-16T18:18:56.669324] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-16T18:18:56.752346] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-16T18:18:57.085330] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-16T18:18:57.085424] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-16T18:18:57.086275] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-16T18:18:57.086338] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-16T18:18:57.087574] [DEBUG] [LOCAL ] CWEN: Trimmed 65474 records to 45638 (keeping 200 days of data) [2025-10-16T18:18:57.359305] [DEBUG] [LOCAL ] CWEN: Primary data saved (45638 records). [2025-10-16T18:18:57.359430] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-16T18:18:57.359505] [INFO ] [MAIN ] Update Progress: 571/2369 symbols completed. CWEN took 33.0s. Estimated remaining: 4h 8m 26s. Rate: 7.2 symbols/min [2025-10-16T18:18:57.544046] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:18:57.544463] [DEBUG] [LOCAL ] CX: No existing data file found in primary storage. [2025-10-16T18:18:57.544187] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-16T18:18:57.545457] [WARN ] [MAIN ] CX: No existing data found, performing full refresh instead. [2025-10-16T18:18:57.545725] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-16T18:18:57.545800] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-16T18:18:57.546017] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-10-16T18:18:57.546090] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-16T18:18:57.903835] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-16T18:18:57.956445] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:18:58.149359] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T18:18:58.342843] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-16T18:18:58.402917] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-16T18:18:59.142840] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-16T18:18:59.833133] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T18:18:59.942841] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-16T18:19:00.362806] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-16T18:19:00.742812] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-16T18:19:01.542782] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-16T18:19:01.754130] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T18:19:01.786299] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T18:19:02.342842] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-16T18:19:03.110071] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T18:19:03.142849] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-16T18:19:03.942795] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-16T18:19:04.057478] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T18:19:04.742844] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-16T18:19:04.907853] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-16T18:19:04.969089] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T18:19:05.542859] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-16T18:19:06.119686] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T18:19:06.342838] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-16T18:19:07.142853] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-16T18:19:07.457866] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T18:19:07.928431] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T18:19:07.942767] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-16T18:19:08.742767] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-16T18:19:08.907806] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-16T18:19:08.914160] [INFO ] [REMOTE ] CWH: Full fetch complete (73212 records). [2025-10-16T18:19:08.914314] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-16T18:19:09.315610] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-16T18:19:09.315822] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-16T18:19:09.316815] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-16T18:19:09.316995] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-16T18:19:09.347033] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T18:19:09.347176] [DEBUG] [LOCAL ] CWH: Trimmed 73212 records to 51694 (keeping 200 days of data) [2025-10-16T18:19:09.564955] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-16T18:19:09.671698] [DEBUG] [LOCAL ] CWH: Primary data saved (51694 records). [2025-10-16T18:19:09.671853] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-16T18:19:09.672769] [INFO ] [MAIN ] Update Progress: 572/2369 symbols completed. CWH took 33.6s. Estimated remaining: 4h 8m 30s. Rate: 7.2 symbols/min [2025-10-16T18:19:09.848072] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:19:09.858165] [DEBUG] [LOCAL ] CXE: Loaded 6145 existing records from primary storage. [2025-10-16T18:19:09.858424] [INFO ] [MAIN ] CXE: Loaded 6145 existing records. [2025-10-16T18:19:10.031802] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:19:10.032073] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-16T18:19:10.032194] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-16T18:19:10.032393] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-16T18:19:10.032449] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-16T18:19:10.385816] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-16T18:19:10.412811] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:19:10.429040] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T18:19:11.142793] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-16T18:19:11.272845] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T18:19:11.942787] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-16T18:19:12.138567] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T18:19:12.145540] [INFO ] [REMOTE ] CWK: Full fetch complete (71291 records). [2025-10-16T18:19:12.145798] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-16T18:19:12.292841] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T18:19:12.563574] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-16T18:19:12.563675] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-16T18:19:12.564553] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-16T18:19:12.564595] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-16T18:19:12.565887] [DEBUG] [LOCAL ] CWK: Trimmed 71291 records to 49995 (keeping 200 days of data) [2025-10-16T18:19:12.759851] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-16T18:19:12.848737] [DEBUG] [LOCAL ] CWK: Primary data saved (49995 records). [2025-10-16T18:19:12.848905] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-16T18:19:12.849705] [INFO ] [MAIN ] Update Progress: 573/2369 symbols completed. CWK took 34.3s. Estimated remaining: 4h 8m 6s. Rate: 7.2 symbols/min [2025-10-16T18:19:13.015092] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:19:13.022090] [DEBUG] [LOCAL ] CXH: Loaded 4432 existing records from primary storage. [2025-10-16T18:19:13.022298] [INFO ] [MAIN ] CXH: Loaded 4432 existing records. [2025-10-16T18:19:13.197255] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:19:13.197496] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-16T18:19:13.197546] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-16T18:19:13.197733] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-16T18:19:13.197790] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-16T18:19:13.502558] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T18:19:13.549908] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-16T18:19:13.590223] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:19:13.680728] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T18:19:14.342810] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-16T18:19:14.784511] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T18:19:15.142804] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-16T18:19:15.740302] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T18:19:15.942869] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-16T18:19:15.985732] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-16T18:19:16.742956] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-16T18:19:17.542842] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-16T18:19:18.007878] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-16T18:19:18.062270] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-16T18:19:18.111327] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T18:19:18.342822] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-16T18:19:19.142809] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-16T18:19:19.942821] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-16T18:19:19.962420] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T18:19:20.081625] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T18:19:20.400489] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-16T18:19:20.742876] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-16T18:19:21.542829] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-16T18:19:21.571127] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T18:19:22.342842] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-16T18:19:22.836837] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T18:19:23.142869] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-16T18:19:23.162008] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T18:19:23.942829] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-16T18:19:24.422004] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-16T18:19:24.422499] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T18:19:24.429040] [INFO ] [REMOTE ] CWT: Full fetch complete (41075 records). [2025-10-16T18:19:24.429145] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-16T18:19:24.756179] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-16T18:19:24.809225] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-16T18:19:24.809319] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-16T18:19:24.810099] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-16T18:19:24.810166] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-16T18:19:24.811261] [DEBUG] [LOCAL ] CWT: Trimmed 41075 records to 28331 (keeping 200 days of data) [2025-10-16T18:19:24.985878] [DEBUG] [LOCAL ] CWT: Primary data saved (28331 records). [2025-10-16T18:19:24.986024] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-16T18:19:24.986151] [INFO ] [MAIN ] Update Progress: 574/2369 symbols completed. CWT took 30.7s. Estimated remaining: 4h 8m 9s. Rate: 7.2 symbols/min [2025-10-16T18:19:25.194550] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:19:25.237976] [DEBUG] [LOCAL ] CXM: Loaded 47569 existing records from primary storage. [2025-10-16T18:19:25.238283] [INFO ] [MAIN ] CXM: Loaded 47569 existing records. [2025-10-16T18:19:25.415241] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:19:25.415436] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-16T18:19:25.415483] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-16T18:19:25.415696] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-16T18:19:25.415795] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-16T18:19:25.545292] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-16T18:19:25.651823] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T18:19:25.820918] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:19:25.973088] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-16T18:19:26.342817] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-16T18:19:27.142836] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-16T18:19:27.909374] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T18:19:27.942826] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-16T18:19:28.742858] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-16T18:19:28.881501] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T18:19:29.378940] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-16T18:19:29.411040] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T18:19:29.542781] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-16T18:19:30.342831] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-16T18:19:30.984730] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T18:19:31.104222] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T18:19:31.142828] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-16T18:19:31.942871] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-16T18:19:32.742806] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-16T18:19:32.982545] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T18:19:33.150308] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T18:19:33.504770] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T18:19:33.542866] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-16T18:19:34.342818] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-16T18:19:35.127302] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-16T18:19:35.142812] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-16T18:19:35.446349] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T18:19:35.703728] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-16T18:19:35.942781] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-16T18:19:36.691991] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T18:19:36.742769] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-16T18:19:37.445202] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-16T18:19:37.542791] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-16T18:19:38.101201] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-16T18:19:38.343008] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-16T18:19:39.142821] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-16T18:19:39.717587] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T18:19:39.942802] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-16T18:19:39.988081] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T18:19:40.742831] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-16T18:19:41.239276] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-16T18:19:41.240573] [INFO ] [REMOTE ] CXE: Full fetch complete (11472 records). [2025-10-16T18:19:41.240665] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-16T18:19:41.545034] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-16T18:19:41.635080] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-16T18:19:41.635307] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-16T18:19:41.637005] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T18:19:41.636085] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-16T18:19:41.645979] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-16T18:19:41.647266] [DEBUG] [LOCAL ] CXE: Trimmed 11472 records to 6167 (keeping 200 days of data) [2025-10-16T18:19:41.681616] [DEBUG] [LOCAL ] CXE: Primary data saved (6167 records). [2025-10-16T18:19:41.681720] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-16T18:19:41.681801] [INFO ] [MAIN ] Update Progress: 575/2369 symbols completed. CXE took 32.0s. Estimated remaining: 4h 8m 27s. Rate: 7.2 symbols/min [2025-10-16T18:19:41.847754] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:19:41.878505] [DEBUG] [LOCAL ] CXT: Loaded 31065 existing records from primary storage. [2025-10-16T18:19:41.878800] [INFO ] [MAIN ] CXT: Loaded 31065 existing records. [2025-10-16T18:19:42.054536] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:19:42.054826] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-16T18:19:42.054883] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-16T18:19:42.055220] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-16T18:19:42.055287] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-16T18:19:42.159072] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-16T18:19:42.347970] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-16T18:19:42.407451] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:19:42.805539] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-16T18:19:43.142828] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-16T18:19:43.942865] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-16T18:19:44.742798] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-16T18:19:44.824123] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T18:19:45.192822] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-16T18:19:45.193602] [INFO ] [REMOTE ] CXH: Full fetch complete (5318 records). [2025-10-16T18:19:45.193819] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-16T18:19:45.194176] [FATAL] [VALIDATOR ] CXH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:19:45.194256] [FATAL] [MAIN ] CXH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:19:45.194298] [WARN ] [MAIN ] CXH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:19:45.194363] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-16T18:19:45.194423] [DEBUG] [LOCAL ] CXH: No primary data file found to delete. [2025-10-16T18:19:45.194456] [INFO ] [LOCAL ] CXH: Starting deletion of derivative data. [2025-10-16T18:19:45.194608] [DEBUG] [LOCAL ] CXH: Deleted derivative data file. [2025-10-16T18:19:45.194728] [INFO ] [MAIN ] Update Progress: 576/2369 symbols completed. CXH took 32.3s. Estimated remaining: 4h 8m 4s. Rate: 7.2 symbols/min [2025-10-16T18:19:45.362347] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:19:45.406025] [DEBUG] [LOCAL ] CXW: Loaded 43921 existing records from primary storage. [2025-10-16T18:19:45.406309] [INFO ] [MAIN ] CXW: Loaded 43921 existing records. [2025-10-16T18:19:45.544608] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-16T18:19:45.586877] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:19:45.587160] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-16T18:19:45.587212] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-16T18:19:45.587438] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-16T18:19:45.587527] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-16T18:19:45.887895] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-16T18:19:45.998532] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:19:46.342827] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-16T18:19:47.142816] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-16T18:19:47.203445] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T18:19:47.826441] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T18:19:47.832848] [INFO ] [REMOTE ] CX: Full fetch complete (76197 records). [2025-10-16T18:19:47.833042] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-16T18:19:47.833933] [FATAL] [VALIDATOR ] CX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:19:47.834020] [FATAL] [MAIN ] CX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:19:47.834088] [WARN ] [MAIN ] CX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:19:47.834159] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-16T18:19:47.834223] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-10-16T18:19:47.834259] [INFO ] [LOCAL ] CX: Starting deletion of derivative data. [2025-10-16T18:19:47.834298] [DEBUG] [LOCAL ] CX: No derivative data file found to delete. [2025-10-16T18:19:47.834353] [INFO ] [MAIN ] Update Progress: 577/2369 symbols completed. CX took 50.5s. Estimated remaining: 4h 7m 38s. Rate: 7.2 symbols/min [2025-10-16T18:19:47.947924] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-16T18:19:48.001025] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:19:48.028518] [DEBUG] [LOCAL ] CYD: Loaded 26842 existing records from primary storage. [2025-10-16T18:19:48.028847] [INFO ] [MAIN ] CYD: Loaded 26842 existing records. [2025-10-16T18:19:48.210007] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:19:48.210355] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-16T18:19:48.210428] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-16T18:19:48.210744] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-16T18:19:48.225602] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-16T18:19:48.260036] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-16T18:19:48.581720] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:19:48.742821] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-16T18:19:49.478347] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T18:19:49.542844] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-16T18:19:50.258731] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T18:19:50.342770] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-16T18:19:50.961828] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T18:19:51.142813] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-16T18:19:51.802722] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:19:51.942811] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-16T18:19:52.206704] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T18:19:52.742868] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-16T18:19:53.542825] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-16T18:19:53.579263] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T18:19:53.647751] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T18:19:54.146487] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-16T18:19:54.342841] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-16T18:19:55.142838] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-16T18:19:55.824954] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T18:19:55.830994] [INFO ] [REMOTE ] CXM: Full fetch complete (68666 records). [2025-10-16T18:19:55.831151] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-16T18:19:55.947967] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-16T18:19:56.235336] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-16T18:19:56.235429] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-16T18:19:56.236446] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-16T18:19:56.236514] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-16T18:19:56.237925] [DEBUG] [LOCAL ] CXM: Trimmed 68666 records to 47906 (keeping 200 days of data) [2025-10-16T18:19:56.339354] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T18:19:56.549885] [DEBUG] [LOCAL ] CXM: Primary data saved (47906 records). [2025-10-16T18:19:56.550041] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-16T18:19:56.550763] [INFO ] [MAIN ] Update Progress: 578/2369 symbols completed. CXM took 31.6s. Estimated remaining: 4h 7m 31s. Rate: 7.2 symbols/min [2025-10-16T18:19:56.714385] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:19:56.742830] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-16T18:19:56.759589] [DEBUG] [LOCAL ] CYH: Loaded 47734 existing records from primary storage. [2025-10-16T18:19:56.759922] [INFO ] [MAIN ] CYH: Loaded 47734 existing records. [2025-10-16T18:19:56.934948] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:19:56.935182] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-16T18:19:56.935229] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-16T18:19:56.935632] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-16T18:19:56.935727] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-16T18:19:57.298134] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:19:57.542185] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T18:19:57.550765] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-16T18:19:57.878042] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T18:19:58.342848] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-16T18:19:59.142810] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-16T18:19:59.304344] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T18:19:59.696484] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T18:19:59.942871] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-16T18:20:00.742862] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-16T18:20:00.836214] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T18:20:01.108169] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T18:20:01.542820] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-16T18:20:02.342865] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-16T18:20:02.567257] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T18:20:02.876679] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T18:20:03.142806] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-16T18:20:03.942829] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-16T18:20:04.380378] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-16T18:20:04.742819] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-16T18:20:04.775603] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T18:20:05.210098] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T18:20:05.542809] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-16T18:20:05.982756] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-16T18:20:06.342829] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-16T18:20:06.838447] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T18:20:07.142794] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-16T18:20:07.481884] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T18:20:07.942815] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-16T18:20:08.742795] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-16T18:20:08.826226] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T18:20:08.890426] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T18:20:09.542817] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-16T18:20:09.685697] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T18:20:10.342836] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-16T18:20:10.953200] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T18:20:11.142848] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-16T18:20:11.942886] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-16T18:20:12.098286] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-16T18:20:12.455472] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T18:20:12.742810] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-16T18:20:13.494881] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T18:20:13.542798] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-16T18:20:14.018353] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T18:20:14.342814] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-16T18:20:15.142787] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-16T18:20:15.261415] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T18:20:15.482500] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T18:20:15.942855] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-16T18:20:16.742827] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-16T18:20:17.519633] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T18:20:17.542774] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-16T18:20:18.221217] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T18:20:18.342781] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-16T18:20:18.360413] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (3.22 seconds). [2025-10-16T18:20:19.035433] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T18:20:19.142801] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-16T18:20:19.615591] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-16T18:20:19.620224] [INFO ] [REMOTE ] CXT: Full fetch complete (45733 records). [2025-10-16T18:20:19.620380] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-16T18:20:19.948009] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-16T18:20:19.998273] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-16T18:20:19.998359] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-16T18:20:19.999194] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-16T18:20:19.999257] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-16T18:20:20.000239] [DEBUG] [LOCAL ] CXT: Trimmed 45733 records to 31299 (keeping 200 days of data) [2025-10-16T18:20:20.188349] [DEBUG] [LOCAL ] CXT: Primary data saved (31299 records). [2025-10-16T18:20:20.188531] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-16T18:20:20.188631] [INFO ] [MAIN ] Update Progress: 579/2369 symbols completed. CXT took 38.5s. Estimated remaining: 4h 8m 10s. Rate: 7.2 symbols/min [2025-10-16T18:20:20.354669] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:20:20.404722] [DEBUG] [LOCAL ] D: Loaded 53646 existing records from primary storage. [2025-10-16T18:20:20.405057] [INFO ] [MAIN ] D: Loaded 53646 existing records. [2025-10-16T18:20:20.582570] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:20:20.582801] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-16T18:20:20.582853] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-16T18:20:20.583071] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-16T18:20:20.583129] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-16T18:20:20.752724] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-16T18:20:20.958388] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:20:20.983854] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T18:20:21.552109] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-16T18:20:21.554280] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T18:20:21.560599] [INFO ] [REMOTE ] CYH: Full fetch complete (69937 records). [2025-10-16T18:20:21.560749] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-16T18:20:21.948472] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-16T18:20:21.948636] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-16T18:20:21.949765] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-16T18:20:21.949887] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-16T18:20:21.951230] [DEBUG] [LOCAL ] CYH: Trimmed 69937 records to 48083 (keeping 200 days of data) [2025-10-16T18:20:22.162413] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T18:20:22.242930] [DEBUG] [LOCAL ] CYH: Primary data saved (48083 records). [2025-10-16T18:20:22.243059] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-16T18:20:22.243810] [INFO ] [MAIN ] Update Progress: 580/2369 symbols completed. CYH took 25.7s. Estimated remaining: 4h 7m 43s. Rate: 7.2 symbols/min [2025-10-16T18:20:22.347189] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-16T18:20:22.416733] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:20:22.432018] [DEBUG] [LOCAL ] DAC: Loaded 12616 existing records from primary storage. [2025-10-16T18:20:22.432246] [INFO ] [MAIN ] DAC: Loaded 12616 existing records. [2025-10-16T18:20:22.605923] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:20:22.606158] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-16T18:20:22.606239] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-16T18:20:22.606415] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-16T18:20:22.606456] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-16T18:20:22.958436] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:20:23.142789] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-16T18:20:23.168882] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T18:20:23.268048] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T18:20:23.272094] [INFO ] [REMOTE ] CYD: Full fetch complete (34852 records). [2025-10-16T18:20:23.272187] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-16T18:20:23.272774] [FATAL] [VALIDATOR ] CYD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:20:23.272861] [FATAL] [MAIN ] CYD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:20:23.272905] [WARN ] [MAIN ] CYD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:20:23.272943] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-16T18:20:23.272999] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-16T18:20:23.273035] [INFO ] [LOCAL ] CYD: Starting deletion of derivative data. [2025-10-16T18:20:23.273175] [DEBUG] [LOCAL ] CYD: Deleted derivative data file. [2025-10-16T18:20:23.273261] [INFO ] [MAIN ] Update Progress: 581/2369 symbols completed. CYD took 35.4s. Estimated remaining: 4h 7m 12s. Rate: 7.2 symbols/min [2025-10-16T18:20:23.436005] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:20:23.485119] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-16T18:20:23.485438] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-16T18:20:23.656624] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:20:23.656887] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-16T18:20:23.656938] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-16T18:20:23.657123] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-16T18:20:23.657160] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-16T18:20:23.943432] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-16T18:20:24.052956] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:20:24.214410] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T18:20:24.742881] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-16T18:20:25.313638] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-16T18:20:25.542805] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-16T18:20:26.342835] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-16T18:20:26.394570] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T18:20:27.152041] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-16T18:20:27.174036] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T18:20:27.940123] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T18:20:27.945272] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-16T18:20:27.947336] [INFO ] [REMOTE ] CXW: Full fetch complete (64990 records). [2025-10-16T18:20:27.947480] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-16T18:20:28.280094] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T18:20:28.361715] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-16T18:20:28.361818] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-16T18:20:28.362781] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-16T18:20:28.362846] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-16T18:20:28.364323] [DEBUG] [LOCAL ] CXW: Trimmed 64990 records to 44193 (keeping 200 days of data) [2025-10-16T18:20:28.613145] [DEBUG] [LOCAL ] CXW: Primary data saved (44193 records). [2025-10-16T18:20:28.613275] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-16T18:20:28.614036] [INFO ] [MAIN ] Update Progress: 582/2369 symbols completed. CXW took 43.4s. Estimated remaining: 4h 6m 55s. Rate: 7.2 symbols/min [2025-10-16T18:20:28.748027] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-16T18:20:28.796583] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:20:28.796802] [DEBUG] [LOCAL ] DAN: No existing data file found in primary storage. [2025-10-16T18:20:28.796844] [WARN ] [MAIN ] DAN: No existing data found, performing full refresh instead. [2025-10-16T18:20:28.796980] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-16T18:20:28.797021] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-16T18:20:28.797060] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-16T18:20:28.797091] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-16T18:20:29.156071] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:20:29.543162] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-16T18:20:29.825679] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-16T18:20:30.342808] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-16T18:20:30.927272] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-16T18:20:30.970852] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T18:20:31.142818] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-16T18:20:31.942803] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-16T18:20:32.192051] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-16T18:20:32.742790] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-16T18:20:33.055084] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-16T18:20:33.141063] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T18:20:33.542839] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-16T18:20:34.349527] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-16T18:20:34.369376] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T18:20:35.142812] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-16T18:20:35.863348] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-16T18:20:35.884397] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T18:20:35.942768] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-16T18:20:35.967153] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T18:20:36.631990] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-16T18:20:36.742804] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-16T18:20:37.542859] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-16T18:20:37.720860] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T18:20:38.342811] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-16T18:20:39.086616] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T18:20:39.142802] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-16T18:20:39.942813] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-16T18:20:40.312004] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T18:20:40.381142] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-16T18:20:40.742808] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-16T18:20:41.542805] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-16T18:20:42.202170] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-16T18:20:42.329272] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-16T18:20:42.350126] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-16T18:20:42.369447] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T18:20:43.142834] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-16T18:20:43.942867] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-16T18:20:44.445966] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-16T18:20:44.516262] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T18:20:44.742847] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-16T18:20:44.877939] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-16T18:20:45.542817] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-16T18:20:46.342793] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-16T18:20:46.621801] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-16T18:20:47.142894] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-16T18:20:47.723054] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-16T18:20:47.780127] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T18:20:47.935272] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T18:20:47.942790] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-16T18:20:48.742863] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-16T18:20:49.542905] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-16T18:20:49.576709] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T18:20:50.342920] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-16T18:20:50.594778] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-16T18:20:51.142826] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-16T18:20:51.661396] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-16T18:20:51.727208] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T18:20:51.942850] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-16T18:20:52.717226] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T18:20:52.748221] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-16T18:20:52.765231] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T18:20:53.542873] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-16T18:20:54.342844] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-16T18:20:54.449525] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-16T18:20:54.455758] [INFO ] [REMOTE ] DAN: Full fetch complete (70887 records). [2025-10-16T18:20:54.455891] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-16T18:20:54.456628] [FATAL] [VALIDATOR ] DAN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:20:54.456756] [FATAL] [MAIN ] DAN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:20:54.456799] [WARN ] [MAIN ] DAN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:20:54.456838] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-16T18:20:54.456909] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-16T18:20:54.456965] [INFO ] [LOCAL ] DAN: Starting deletion of derivative data. [2025-10-16T18:20:54.457009] [DEBUG] [LOCAL ] DAN: No derivative data file found to delete. [2025-10-16T18:20:54.457065] [INFO ] [MAIN ] Update Progress: 583/2369 symbols completed. DAN took 25.8s. Estimated remaining: 4h 7m 40s. Rate: 7.2 symbols/min [2025-10-16T18:20:54.627925] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:20:54.646720] [DEBUG] [LOCAL ] DAO: Loaded 19797 existing records from primary storage. [2025-10-16T18:20:54.646966] [INFO ] [MAIN ] DAO: Loaded 19797 existing records. [2025-10-16T18:20:54.817877] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:20:54.818081] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-16T18:20:54.818129] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-16T18:20:54.818308] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-16T18:20:54.818365] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-16T18:20:55.155715] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-16T18:20:55.160536] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:20:55.514230] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T18:20:55.935173] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-16T18:20:55.942802] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-16T18:20:56.432660] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-16T18:20:56.742813] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-16T18:20:57.408760] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T18:20:57.542790] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-16T18:20:57.651769] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T18:20:57.653976] [INFO ] [REMOTE ] DAC: Full fetch complete (19366 records). [2025-10-16T18:20:57.654059] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-16T18:20:58.026971] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-16T18:20:58.027059] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-16T18:20:58.027523] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-16T18:20:58.027564] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-16T18:20:58.028183] [DEBUG] [LOCAL ] DAC: Trimmed 19366 records to 12709 (keeping 200 days of data) [2025-10-16T18:20:58.109739] [DEBUG] [LOCAL ] DAC: Primary data saved (12709 records). [2025-10-16T18:20:58.109885] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-16T18:20:58.109980] [INFO ] [MAIN ] Update Progress: 584/2369 symbols completed. DAC took 35.9s. Estimated remaining: 4h 7m 18s. Rate: 7.2 symbols/min [2025-10-16T18:20:58.303358] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:20:58.352405] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-16T18:20:58.370679] [DEBUG] [LOCAL ] DAR: Loaded 51991 existing records from primary storage. [2025-10-16T18:20:58.374105] [INFO ] [MAIN ] DAR: Loaded 51991 existing records. [2025-10-16T18:20:58.437937] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T18:20:58.496105] [INFO ] [REMOTE ] D: Full fetch complete (77813 records). [2025-10-16T18:20:58.504271] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-16T18:20:58.695498] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:20:58.720367] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-16T18:20:58.723433] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-16T18:20:58.723848] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-16T18:20:58.723915] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-16T18:20:59.152622] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-16T18:20:59.370395] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:20:59.374211] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-16T18:20:59.374288] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-16T18:20:59.375521] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-16T18:20:59.375584] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-16T18:20:59.377039] [DEBUG] [LOCAL ] D: Trimmed 77813 records to 54036 (keeping 200 days of data) [2025-10-16T18:20:59.495109] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T18:20:59.728815] [DEBUG] [LOCAL ] D: Primary data saved (54036 records). [2025-10-16T18:20:59.729014] [INFO ] [MAIN ] D: Full history saved. [2025-10-16T18:20:59.729970] [INFO ] [MAIN ] Update Progress: 585/2369 symbols completed. D took 39.5s. Estimated remaining: 4h 6m 49s. Rate: 7.2 symbols/min [2025-10-16T18:20:59.916297] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:20:59.942811] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-16T18:20:59.957256] [DEBUG] [LOCAL ] DAVA: Loaded 41847 existing records from primary storage. [2025-10-16T18:20:59.957522] [INFO ] [MAIN ] DAVA: Loaded 41847 existing records. [2025-10-16T18:21:00.132388] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:21:00.132631] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-16T18:21:00.132728] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-16T18:21:00.133156] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-16T18:21:00.133217] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-16T18:21:00.489426] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:21:00.742812] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-16T18:21:01.542964] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-16T18:21:01.768592] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-16T18:21:01.859575] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T18:21:01.931247] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T18:21:02.186958] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-16T18:21:02.342821] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-16T18:21:03.142815] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-16T18:21:03.729926] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T18:21:03.942825] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-16T18:21:04.600565] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:21:04.742834] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-16T18:21:05.281103] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T18:21:05.542824] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-16T18:21:06.343138] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-16T18:21:06.425702] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-16T18:21:06.814957] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-16T18:21:06.822067] [INFO ] [REMOTE ] DAL: Full fetch complete (77931 records). [2025-10-16T18:21:06.822265] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-16T18:21:07.148052] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-16T18:21:07.269937] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-16T18:21:07.270029] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-16T18:21:07.271015] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-16T18:21:07.271087] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-16T18:21:07.272771] [DEBUG] [LOCAL ] DAL: Trimmed 77931 records to 54143 (keeping 200 days of data) [2025-10-16T18:21:07.604543] [DEBUG] [LOCAL ] DAL: Primary data saved (54143 records). [2025-10-16T18:21:07.604722] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-16T18:21:07.604819] [INFO ] [MAIN ] Update Progress: 586/2369 symbols completed. DAL took 44.3s. Estimated remaining: 4h 6m 39s. Rate: 7.2 symbols/min [2025-10-16T18:21:07.808739] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:21:07.810746] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T18:21:07.810873] [DEBUG] [LOCAL ] DAY: No existing data file found in primary storage. [2025-10-16T18:21:07.819940] [WARN ] [MAIN ] DAY: No existing data found, performing full refresh instead. [2025-10-16T18:21:07.820583] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-16T18:21:07.820694] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-16T18:21:07.821045] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-16T18:21:07.821100] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-16T18:21:07.948021] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-16T18:21:08.186520] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:21:08.558340] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T18:21:08.742876] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-16T18:21:09.542779] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-16T18:21:09.666225] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T18:21:10.020340] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T18:21:10.342817] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-16T18:21:10.375276] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T18:21:11.142842] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-16T18:21:11.556287] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T18:21:11.942826] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-16T18:21:12.487241] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T18:21:12.742786] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-16T18:21:12.846079] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-16T18:21:13.542810] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-16T18:21:14.051182] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T18:21:14.342869] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-16T18:21:14.524182] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T18:21:15.142856] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-16T18:21:15.942857] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-16T18:21:16.012794] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T18:21:16.097521] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T18:21:16.742849] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-16T18:21:17.508896] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T18:21:17.542908] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-16T18:21:18.342835] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-16T18:21:18.474860] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T18:21:18.512125] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T18:21:19.142824] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-16T18:21:19.789253] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T18:21:19.942817] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-16T18:21:20.249063] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T18:21:20.742813] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-16T18:21:20.903957] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T18:21:21.542834] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-16T18:21:22.347157] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-16T18:21:22.352730] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T18:21:23.149938] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-16T18:21:23.168815] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T18:21:23.303118] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T18:21:23.305495] [INFO ] [REMOTE ] DAO: Full fetch complete (32174 records). [2025-10-16T18:21:23.305570] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-16T18:21:23.306082] [FATAL] [VALIDATOR ] DAO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:21:23.306165] [FATAL] [MAIN ] DAO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:21:23.306207] [WARN ] [MAIN ] DAO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:21:23.306246] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-16T18:21:23.306334] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-16T18:21:23.306387] [INFO ] [LOCAL ] DAO: Starting deletion of derivative data. [2025-10-16T18:21:23.306554] [DEBUG] [LOCAL ] DAO: Deleted derivative data file. [2025-10-16T18:21:23.306660] [INFO ] [MAIN ] Update Progress: 587/2369 symbols completed. DAO took 28.8s. Estimated remaining: 4h 6m 53s. Rate: 7.2 symbols/min [2025-10-16T18:21:23.503407] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:21:23.555928] [DEBUG] [LOCAL ] DB: Loaded 52503 existing records from primary storage. [2025-10-16T18:21:23.556232] [INFO ] [MAIN ] DB: Loaded 52503 existing records. [2025-10-16T18:21:23.732464] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:21:23.732755] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-16T18:21:23.732807] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-16T18:21:23.733008] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-16T18:21:23.733073] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-16T18:21:23.948031] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-16T18:21:24.101435] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:21:24.719426] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T18:21:24.742774] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-16T18:21:25.542805] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-16T18:21:25.695337] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T18:21:26.342801] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-16T18:21:26.423286] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T18:21:26.886021] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T18:21:27.142811] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-16T18:21:27.903816] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T18:21:27.942828] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-16T18:21:28.742788] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-16T18:21:28.863559] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T18:21:29.158478] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T18:21:29.542861] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-16T18:21:30.071194] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T18:21:30.342821] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-16T18:21:31.142848] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-16T18:21:31.293340] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T18:21:31.942823] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-16T18:21:32.006968] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T18:21:32.012822] [INFO ] [REMOTE ] DAVA: Full fetch complete (56679 records). [2025-10-16T18:21:32.012978] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-16T18:21:32.015692] [FATAL] [VALIDATOR ] DAVA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:21:32.015811] [FATAL] [MAIN ] DAVA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:21:32.015911] [WARN ] [MAIN ] DAVA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:21:32.016006] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-16T18:21:32.016089] [DEBUG] [LOCAL ] DAVA: No primary data file found to delete. [2025-10-16T18:21:32.016127] [INFO ] [LOCAL ] DAVA: Starting deletion of derivative data. [2025-10-16T18:21:32.016276] [DEBUG] [LOCAL ] DAVA: Deleted derivative data file. [2025-10-16T18:21:32.016367] [INFO ] [MAIN ] Update Progress: 588/2369 symbols completed. DAVA took 32.3s. Estimated remaining: 4h 6m 46s. Rate: 7.2 symbols/min [2025-10-16T18:21:32.190486] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:21:32.190719] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-16T18:21:32.190773] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-16T18:21:32.190853] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-16T18:21:32.190890] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-16T18:21:32.190931] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-16T18:21:32.190965] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-16T18:21:32.584687] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:21:32.627343] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T18:21:32.742815] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-16T18:21:33.256856] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T18:21:33.542906] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-16T18:21:34.117470] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-16T18:21:34.342843] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-16T18:21:35.142787] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-16T18:21:35.251952] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T18:21:35.915195] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T18:21:35.921847] [INFO ] [REMOTE ] DAR: Full fetch complete (74961 records). [2025-10-16T18:21:35.921976] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-16T18:21:35.953226] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-16T18:21:36.237780] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T18:21:36.332964] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-16T18:21:36.333047] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-16T18:21:36.333951] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-16T18:21:36.334014] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-16T18:21:36.335455] [DEBUG] [LOCAL ] DAR: Trimmed 74961 records to 52380 (keeping 200 days of data) [2025-10-16T18:21:36.647945] [DEBUG] [LOCAL ] DAR: Primary data saved (52380 records). [2025-10-16T18:21:36.648105] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-16T18:21:36.648762] [INFO ] [MAIN ] Update Progress: 589/2369 symbols completed. DAR took 38.5s. Estimated remaining: 4h 6m 27s. Rate: 7.2 symbols/min [2025-10-16T18:21:36.747885] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-16T18:21:36.821745] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:21:36.862043] [DEBUG] [LOCAL ] DBI: Loaded 43916 existing records from primary storage. [2025-10-16T18:21:36.862372] [INFO ] [MAIN ] DBI: Loaded 43916 existing records. [2025-10-16T18:21:37.034583] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:21:37.034831] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-16T18:21:37.034880] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-16T18:21:37.035069] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-16T18:21:37.035106] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-16T18:21:37.379761] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:21:37.542831] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-16T18:21:37.683267] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T18:21:38.064285] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-16T18:21:38.342829] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-16T18:21:38.517938] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T18:21:39.142797] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-16T18:21:39.942798] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-16T18:21:40.329026] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T18:21:40.406283] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T18:21:40.742829] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-16T18:21:41.542793] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-16T18:21:41.628348] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T18:21:41.667223] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T18:21:42.342804] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-16T18:21:43.142800] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-16T18:21:43.325062] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T18:21:43.555993] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-16T18:21:43.942868] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-16T18:21:44.522464] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T18:21:44.687677] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T18:21:44.742768] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-16T18:21:45.542791] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-16T18:21:45.775093] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T18:21:46.342864] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-16T18:21:46.972866] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T18:21:46.978967] [INFO ] [REMOTE ] DAY: Full fetch complete (71352 records). [2025-10-16T18:21:46.979091] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-16T18:21:46.979971] [FATAL] [VALIDATOR ] DAY: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:21:46.980089] [FATAL] [MAIN ] DAY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:21:46.980153] [WARN ] [MAIN ] DAY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:21:46.980237] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-16T18:21:46.980349] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-16T18:21:46.980420] [INFO ] [LOCAL ] DAY: Starting deletion of derivative data. [2025-10-16T18:21:46.980510] [DEBUG] [LOCAL ] DAY: No derivative data file found to delete. [2025-10-16T18:21:46.980606] [INFO ] [MAIN ] Update Progress: 590/2369 symbols completed. DAY took 39.4s. Estimated remaining: 4h 6m 25s. Rate: 7.2 symbols/min [2025-10-16T18:21:47.147898] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-16T18:21:47.187890] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:21:47.188160] [DEBUG] [LOCAL ] DBL: No existing data file found in primary storage. [2025-10-16T18:21:47.188208] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-10-16T18:21:47.188314] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-16T18:21:47.188356] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-16T18:21:47.188399] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-16T18:21:47.188432] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-16T18:21:47.620031] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:21:47.634791] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T18:21:47.942825] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-16T18:21:48.742792] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-16T18:21:48.927963] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T18:21:48.957855] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T18:21:49.542781] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-16T18:21:49.867270] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T18:21:50.342863] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-16T18:21:51.031593] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T18:21:51.093804] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T18:21:51.142849] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-16T18:21:51.942819] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-16T18:21:52.742782] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-16T18:21:53.044087] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-16T18:21:53.303275] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-16T18:21:53.340777] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T18:21:53.542821] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-16T18:21:54.149054] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T18:21:54.342813] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-16T18:21:55.142782] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-16T18:21:55.534922] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T18:21:55.942785] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-16T18:21:55.959719] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-16T18:21:56.742836] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-16T18:21:57.092550] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T18:21:57.147496] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-16T18:21:57.542818] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-16T18:21:58.342785] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-16T18:21:58.499348] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T18:21:58.502719] [INFO ] [REMOTE ] DBD: Full fetch complete (31524 records). [2025-10-16T18:21:58.502804] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-16T18:21:58.503266] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:21:58.503375] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:21:58.503453] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:21:58.503541] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-16T18:21:58.503608] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-16T18:21:58.503667] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-16T18:21:58.503735] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-16T18:21:58.503793] [INFO ] [MAIN ] Update Progress: 591/2369 symbols completed. DBD took 26.5s. Estimated remaining: 4h 6m 26s. Rate: 7.2 symbols/min [2025-10-16T18:21:58.683583] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:21:58.731037] [DEBUG] [LOCAL ] DBRG: Loaded 49905 existing records from primary storage. [2025-10-16T18:21:58.731335] [INFO ] [MAIN ] DBRG: Loaded 49905 existing records. [2025-10-16T18:21:58.904478] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:21:58.904723] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-16T18:21:58.904781] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-16T18:21:58.904989] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-16T18:21:58.905056] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-16T18:21:59.151553] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-16T18:21:59.254359] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:21:59.942783] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-16T18:22:00.013787] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-16T18:22:00.376303] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-16T18:22:00.742837] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-16T18:22:01.486293] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T18:22:01.542829] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-16T18:22:01.627631] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T18:22:02.342870] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-16T18:22:03.110358] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T18:22:03.151524] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-16T18:22:03.156931] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T18:22:03.780639] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-16T18:22:03.942822] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-16T18:22:04.742870] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-16T18:22:05.542792] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-16T18:22:05.764313] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T18:22:06.002770] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T18:22:06.342835] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-16T18:22:06.397037] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T18:22:06.398556] [INFO ] [REMOTE ] DBL: Full fetch complete (12719 records). [2025-10-16T18:22:06.398633] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-16T18:22:06.753068] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-16T18:22:06.753145] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-16T18:22:06.753440] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-16T18:22:06.753479] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-16T18:22:06.753996] [DEBUG] [LOCAL ] DBL: Trimmed 12719 records to 9490 (keeping 200 days of data) [2025-10-16T18:22:06.811393] [DEBUG] [LOCAL ] DBL: Primary data saved (9490 records). [2025-10-16T18:22:06.811529] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-16T18:22:06.811602] [INFO ] [MAIN ] Update Progress: 592/2369 symbols completed. DBL took 19.8s. Estimated remaining: 4h 6m 18s. Rate: 7.2 symbols/min [2025-10-16T18:22:06.984355] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:22:07.019317] [DEBUG] [LOCAL ] DCI: Loaded 37027 existing records from primary storage. [2025-10-16T18:22:07.019592] [INFO ] [MAIN ] DCI: Loaded 37027 existing records. [2025-10-16T18:22:07.147970] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-16T18:22:07.203672] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:22:07.203934] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-16T18:22:07.204079] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-16T18:22:07.204363] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-16T18:22:07.204419] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-16T18:22:07.557665] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:22:07.770529] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T18:22:07.942828] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-16T18:22:08.742875] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-16T18:22:09.181515] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-16T18:22:09.189003] [INFO ] [REMOTE ] DB: Full fetch complete (75378 records). [2025-10-16T18:22:09.189202] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-16T18:22:09.547407] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-16T18:22:09.751763] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-16T18:22:09.751954] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-16T18:22:09.753941] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-16T18:22:09.754210] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-16T18:22:09.756971] [DEBUG] [LOCAL ] DB: Trimmed 75378 records to 52892 (keeping 200 days of data) [2025-10-16T18:22:09.891684] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T18:22:10.262155] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T18:22:10.285427] [DEBUG] [LOCAL ] DB: Primary data saved (52892 records). [2025-10-16T18:22:10.285572] [INFO ] [MAIN ] DB: Full history saved. [2025-10-16T18:22:10.286384] [INFO ] [MAIN ] Update Progress: 593/2369 symbols completed. DB took 47.0s. Estimated remaining: 4h 5m 55s. Rate: 7.2 symbols/min [2025-10-16T18:22:10.353625] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-16T18:22:10.463508] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:22:10.480291] [DEBUG] [LOCAL ] DCO: Loaded 14597 existing records from primary storage. [2025-10-16T18:22:10.480520] [INFO ] [MAIN ] DCO: Loaded 14597 existing records. [2025-10-16T18:22:10.659714] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:22:10.659950] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-16T18:22:10.660010] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-16T18:22:10.660207] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-16T18:22:10.660264] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-16T18:22:11.029140] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:22:11.142776] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-16T18:22:11.699412] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-16T18:22:11.914074] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T18:22:11.945952] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-16T18:22:11.950066] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-16T18:22:12.742818] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-16T18:22:13.034420] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T18:22:13.542852] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-16T18:22:14.342905] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-16T18:22:14.685498] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-16T18:22:14.828930] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T18:22:15.137994] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T18:22:15.142758] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-16T18:22:15.941877] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T18:22:15.944411] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-16T18:22:16.742861] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-16T18:22:17.443700] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T18:22:17.512888] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T18:22:17.542775] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-16T18:22:18.342824] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-16T18:22:19.083395] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T18:22:19.142783] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-16T18:22:19.942807] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-16T18:22:20.071081] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T18:22:20.111784] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-16T18:22:20.742823] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-16T18:22:21.195295] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-16T18:22:21.542793] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-16T18:22:21.559296] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T18:22:22.342824] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-16T18:22:23.142792] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-16T18:22:23.265921] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T18:22:23.418517] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T18:22:23.942881] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-16T18:22:24.751407] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-16T18:22:24.788856] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T18:22:24.866372] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-16T18:22:25.542838] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-16T18:22:26.208270] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-16T18:22:26.342799] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-16T18:22:26.416133] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T18:22:27.142783] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-16T18:22:27.458244] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T18:22:27.942890] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-16T18:22:28.506562] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T18:22:28.742811] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-16T18:22:29.415978] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T18:22:29.421187] [INFO ] [REMOTE ] DBI: Full fetch complete (65227 records). [2025-10-16T18:22:29.421324] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-16T18:22:29.549035] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-16T18:22:29.704121] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T18:22:29.735615] [INFO ] [REMOTE ] DCO: Full fetch complete (19461 records). [2025-10-16T18:22:29.741332] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-16T18:22:29.762368] [FATAL] [VALIDATOR ] DCO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:22:29.785539] [FATAL] [MAIN ] DCO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:22:29.796285] [WARN ] [MAIN ] DCO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:22:29.841215] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-16T18:22:29.857202] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-16T18:22:29.857326] [INFO ] [LOCAL ] DCO: Starting deletion of derivative data. [2025-10-16T18:22:29.857540] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-16T18:22:29.857711] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-16T18:22:29.858568] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-16T18:22:29.858612] [DEBUG] [LOCAL ] DCO: Deleted derivative data file. [2025-10-16T18:22:29.858741] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-16T18:22:29.859124] [INFO ] [MAIN ] Update Progress: 594/2369 symbols completed. DCO took 19.6s. Estimated remaining: 4h 6m 20s. Rate: 7.2 symbols/min [2025-10-16T18:22:29.960816] [DEBUG] [LOCAL ] DBI: Trimmed 65227 records to 44191 (keeping 200 days of data) [2025-10-16T18:22:30.127221] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:22:30.341060] [DEBUG] [LOCAL ] DBI: Primary data saved (44191 records). [2025-10-16T18:22:30.339439] [DEBUG] [LOCAL ] DD: Loaded 52926 existing records from primary storage. [2025-10-16T18:22:30.341433] [INFO ] [MAIN ] DD: Loaded 52926 existing records. [2025-10-16T18:22:30.341317] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-16T18:22:30.362549] [INFO ] [MAIN ] Update Progress: 595/2369 symbols completed. DBI took 53.7s. Estimated remaining: 4h 5m 49s. Rate: 7.2 symbols/min [2025-10-16T18:22:30.383129] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-16T18:22:30.675135] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:22:30.699081] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-16T18:22:30.699009] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:22:30.699445] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-16T18:22:30.699691] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-16T18:22:30.699747] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-16T18:22:31.076676] [DEBUG] [LOCAL ] DDD: Loaded 50928 existing records from primary storage. [2025-10-16T18:22:31.102550] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:22:31.102798] [INFO ] [MAIN ] DDD: Loaded 50928 existing records. [2025-10-16T18:22:31.147146] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-16T18:22:31.306027] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:22:31.318064] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-16T18:22:31.318856] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-16T18:22:31.318731] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T18:22:31.325783] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-16T18:22:31.326057] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-16T18:22:31.726270] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:22:31.942801] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-16T18:22:32.213123] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T18:22:32.742813] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-16T18:22:33.010835] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-16T18:22:33.443838] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T18:22:33.542794] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-16T18:22:34.116592] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-16T18:22:34.342812] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-16T18:22:35.018153] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T18:22:35.142807] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-16T18:22:35.942798] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-16T18:22:36.114837] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T18:22:36.742843] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-16T18:22:36.803432] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T18:22:36.809440] [INFO ] [REMOTE ] DBRG: Full fetch complete (72109 records). [2025-10-16T18:22:36.809566] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-16T18:22:36.810389] [FATAL] [VALIDATOR ] DBRG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:22:36.810480] [FATAL] [MAIN ] DBRG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:22:36.810524] [WARN ] [MAIN ] DBRG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:22:36.810562] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-16T18:22:36.810616] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-10-16T18:22:36.810678] [INFO ] [LOCAL ] DBRG: Starting deletion of derivative data. [2025-10-16T18:22:36.810818] [DEBUG] [LOCAL ] DBRG: Deleted derivative data file. [2025-10-16T18:22:36.811336] [INFO ] [MAIN ] Update Progress: 596/2369 symbols completed. DBRG took 38.3s. Estimated remaining: 4h 5m 35s. Rate: 7.2 symbols/min [2025-10-16T18:22:36.979375] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:22:37.014175] [DEBUG] [LOCAL ] DDL: Loaded 36922 existing records from primary storage. [2025-10-16T18:22:37.014441] [INFO ] [MAIN ] DDL: Loaded 36922 existing records. [2025-10-16T18:22:37.191832] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:22:37.192159] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-16T18:22:37.192247] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-16T18:22:37.192597] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-16T18:22:37.192706] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-16T18:22:37.546199] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-16T18:22:37.582847] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T18:22:37.638317] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:22:37.824955] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T18:22:38.342847] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-16T18:22:39.030891] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T18:22:39.142843] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-16T18:22:39.942816] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-16T18:22:40.101329] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T18:22:40.493040] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T18:22:40.742840] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-16T18:22:41.542865] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-16T18:22:41.690130] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T18:22:42.322274] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T18:22:42.342769] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-16T18:22:43.142813] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-16T18:22:43.715573] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-16T18:22:43.942854] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-16T18:22:44.353596] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-16T18:22:44.742890] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-16T18:22:45.026149] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T18:22:45.325534] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T18:22:45.542880] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-16T18:22:46.195951] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T18:22:46.342802] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-16T18:22:47.012422] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T18:22:47.142820] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-16T18:22:47.942860] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-16T18:22:48.195521] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T18:22:48.371824] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-16T18:22:48.742844] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-16T18:22:49.517143] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T18:22:49.542799] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-16T18:22:50.201355] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T18:22:50.342838] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-16T18:22:51.134068] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T18:22:51.143008] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-16T18:22:51.942821] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-16T18:22:52.099209] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T18:22:52.742823] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-16T18:22:53.542867] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-16T18:23:05.351639] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (13.41 seconds). [2025-10-16T18:23:05.359530] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-16T18:23:06.274448] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (15.13 seconds). [2025-10-16T18:23:06.287578] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-16T18:23:06.384315] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (12.84 seconds). [2025-10-16T18:23:06.396807] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-16T18:23:07.175433] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (14.43 seconds). [2025-10-16T18:23:07.179921] [INFO ] [REMOTE ] DCI: Full fetch complete (53348 records). [2025-10-16T18:23:07.180052] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-16T18:23:07.180835] [FATAL] [VALIDATOR ] DCI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:23:07.180931] [FATAL] [MAIN ] DCI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:23:07.180975] [WARN ] [MAIN ] DCI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:23:07.181015] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-16T18:23:07.181094] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-16T18:23:07.181131] [INFO ] [LOCAL ] DCI: Starting deletion of derivative data. [2025-10-16T18:23:07.181266] [DEBUG] [LOCAL ] DCI: Deleted derivative data file. [2025-10-16T18:23:07.181370] [INFO ] [MAIN ] Update Progress: 597/2369 symbols completed. DCI took 1m 0s. Estimated remaining: 4h 6m 32s. Rate: 7.2 symbols/min [2025-10-16T18:23:07.374793] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T18:23:07.381271] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-16T18:23:07.896967] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T18:23:07.908536] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-16T18:23:08.516123] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T18:23:08.522927] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-16T18:23:08.570927] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T18:23:08.579506] [INFO ] [REMOTE ] DD: Full fetch complete (76594 records). [2025-10-16T18:23:08.579742] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-16T18:23:09.019004] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-16T18:23:09.019181] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-16T18:23:09.020298] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-16T18:23:09.020391] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-16T18:23:09.054222] [DEBUG] [LOCAL ] DD: Trimmed 76594 records to 53314 (keeping 200 days of data) [2025-10-16T18:23:09.056028] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (2.77 seconds). [2025-10-16T18:23:09.069017] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-16T18:23:09.407863] [DEBUG] [LOCAL ] DD: Primary data saved (53314 records). [2025-10-16T18:23:09.408002] [INFO ] [MAIN ] DD: Full history saved. [2025-10-16T18:23:09.408905] [INFO ] [MAIN ] Update Progress: 598/2369 symbols completed. DD took 39.5s. Estimated remaining: 4h 6m 5s. Rate: 7.2 symbols/min [2025-10-16T18:23:10.107177] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-16T18:23:10.118539] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-16T18:23:10.697495] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T18:23:10.708861] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-16T18:23:11.752766] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T18:23:11.760382] [INFO ] [REMOTE ] DDL: Full fetch complete (53522 records). [2025-10-16T18:23:11.760584] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-16T18:23:12.203281] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-16T18:23:12.203384] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-16T18:23:12.204397] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-16T18:23:12.204462] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-16T18:23:12.205558] [DEBUG] [LOCAL ] DDL: Trimmed 53522 records to 37285 (keeping 200 days of data) [2025-10-16T18:23:12.414957] [DEBUG] [LOCAL ] DDL: Primary data saved (37285 records). [2025-10-16T18:23:12.415262] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-16T18:23:12.415382] [INFO ] [MAIN ] Update Progress: 599/2369 symbols completed. DDL took 35.6s. Estimated remaining: 4h 5m 41s. Rate: 7.2 symbols/min [2025-10-16T18:23:12.523597] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T18:23:12.534624] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-16T18:23:14.286756] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T18:23:14.298637] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-16T18:23:15.944720] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T18:23:15.950853] [INFO ] [REMOTE ] DDD: Full fetch complete (73552 records). [2025-10-16T18:23:15.950970] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-16T18:23:15.951598] [FATAL] [VALIDATOR ] DDD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:23:15.951702] [FATAL] [MAIN ] DDD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:23:15.951748] [WARN ] [MAIN ] DDD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:23:15.951810] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-16T18:23:15.951873] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-10-16T18:23:15.951910] [INFO ] [LOCAL ] DDD: Starting deletion of derivative data. [2025-10-16T18:23:15.952037] [DEBUG] [LOCAL ] DDD: Deleted derivative data file. [2025-10-16T18:23:15.952122] [INFO ] [MAIN ] Update Progress: 600/2369 symbols completed. DDD took 45.6s. Estimated remaining: 4h 5m 19s. Rate: 7.2 symbols/min [2025-10-16T18:23:16.584934] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:16.633066] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:16.659870] [DEBUG] [LOCAL ] DDT: No existing data file found in primary storage. [2025-10-16T18:23:16.692297] [WARN ] [MAIN ] DDT: No existing data found, performing full refresh instead. [2025-10-16T18:23:16.692570] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-16T18:23:16.692137] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:16.710663] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:16.692686] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-16T18:23:16.710907] [DEBUG] [LOCAL ] DDS: No existing data file found in primary storage. [2025-10-16T18:23:16.711160] [WARN ] [MAIN ] DDS: No existing data found, performing full refresh instead. [2025-10-16T18:23:16.711912] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-16T18:23:16.711815] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-16T18:23:16.712201] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-16T18:23:16.712041] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-16T18:23:16.718429] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-16T18:23:16.734474] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-16T18:23:17.195464] [DEBUG] [LOCAL ] DEA: Loaded 40436 existing records from primary storage. [2025-10-16T18:23:17.249833] [INFO ] [MAIN ] DEA: Loaded 40436 existing records. [2025-10-16T18:23:17.412823] [DEBUG] [LOCAL ] DE: Loaded 47661 existing records from primary storage. [2025-10-16T18:23:17.437714] [INFO ] [MAIN ] DE: Loaded 47661 existing records. [2025-10-16T18:23:17.664577] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:17.688979] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-16T18:23:17.851198] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:23:17.848313] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:17.855033] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-16T18:23:17.855395] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-16T18:23:17.878385] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-16T18:23:17.897679] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-16T18:23:17.907935] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-16T18:23:17.980817] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:23:18.018123] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-16T18:23:18.047040] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-16T18:23:18.049571] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-16T18:23:18.054965] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-16T18:23:18.596958] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:18.606223] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T18:23:18.624777] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-16T18:23:18.624213] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-16T18:23:18.726285] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:18.726708] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-16T18:23:18.991293] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T18:23:18.994775] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-16T18:23:19.068482] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-16T18:23:19.069966] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-16T18:23:19.517763] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T18:23:19.518882] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-16T18:23:19.862700] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T18:23:19.865777] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-16T18:23:19.912736] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-16T18:23:19.913969] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-16T18:23:20.376432] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T18:23:20.386951] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-16T18:23:20.488042] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T18:23:20.489981] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-16T18:23:20.598591] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-16T18:23:20.608908] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-16T18:23:20.753525] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T18:23:20.756602] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-16T18:23:20.813284] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-16T18:23:20.814340] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-16T18:23:21.137272] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-16T18:23:21.138383] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-16T18:23:21.643248] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-16T18:23:21.646877] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-16T18:23:21.660739] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-16T18:23:21.662240] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-16T18:23:22.025886] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-16T18:23:22.027596] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-16T18:23:22.030763] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T18:23:22.041529] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-16T18:23:22.262709] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T18:23:22.271805] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-16T18:23:22.438076] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T18:23:22.441968] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-16T18:23:22.522363] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-16T18:23:22.523446] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-16T18:23:22.877505] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-16T18:23:22.878297] [INFO ] [REMOTE ] DDT: Full fetch complete (2838 records). [2025-10-16T18:23:22.878365] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-16T18:23:23.239370] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T18:23:23.246087] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-16T18:23:23.246169] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-16T18:23:23.246317] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-16T18:23:23.249451] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-16T18:23:23.250312] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-16T18:23:23.251268] [DEBUG] [LOCAL ] DDT: Trimmed 2838 records to 2095 (keeping 200 days of data) [2025-10-16T18:23:23.264756] [DEBUG] [LOCAL ] DDT: Primary data saved (2095 records). [2025-10-16T18:23:23.264824] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-16T18:23:23.264885] [INFO ] [MAIN ] Update Progress: 601/2369 symbols completed. DDT took 7.3s. Estimated remaining: 4h 5m 8s. Rate: 7.2 symbols/min [2025-10-16T18:23:23.444688] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:23.477045] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T18:23:23.512506] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T18:23:23.512922] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-16T18:23:23.531063] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-16T18:23:23.550087] [DEBUG] [LOCAL ] DEC: Loaded 30346 existing records from primary storage. [2025-10-16T18:23:23.550446] [INFO ] [MAIN ] DEC: Loaded 30346 existing records. [2025-10-16T18:23:23.779816] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:23:23.780044] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-16T18:23:23.780093] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-16T18:23:23.780296] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-16T18:23:23.780353] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-16T18:23:24.176008] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:24.183926] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-16T18:23:24.184997] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T18:23:24.742819] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-16T18:23:24.951936] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T18:23:25.024728] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T18:23:25.055478] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T18:23:25.542848] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-16T18:23:25.665259] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-16T18:23:26.342830] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-16T18:23:27.142810] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-16T18:23:27.260931] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T18:23:27.305934] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-16T18:23:27.942805] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-16T18:23:28.724961] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T18:23:28.742778] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-16T18:23:28.873757] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T18:23:29.542847] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-16T18:23:29.774013] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T18:23:30.342882] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-16T18:23:31.142823] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-16T18:23:31.302280] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T18:23:31.942786] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-16T18:23:31.995260] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T18:23:32.189752] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T18:23:32.742835] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-16T18:23:33.542878] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-16T18:23:33.763245] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T18:23:33.945032] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T18:23:34.342821] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-16T18:23:34.965382] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T18:23:35.142865] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-16T18:23:35.917430] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-16T18:23:35.942785] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-16T18:23:36.146536] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-16T18:23:36.742830] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-16T18:23:37.047483] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T18:23:37.542841] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-16T18:23:37.569639] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T18:23:37.571256] [INFO ] [REMOTE ] DDS: Full fetch complete (18645 records). [2025-10-16T18:23:37.571347] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-16T18:23:37.929503] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-16T18:23:37.929599] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-16T18:23:37.930073] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-16T18:23:37.930130] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-16T18:23:37.930826] [DEBUG] [LOCAL ] DDS: Trimmed 18645 records to 12801 (keeping 200 days of data) [2025-10-16T18:23:38.012212] [DEBUG] [LOCAL ] DDS: Primary data saved (12801 records). [2025-10-16T18:23:38.012359] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-16T18:23:38.012433] [INFO ] [MAIN ] Update Progress: 602/2369 symbols completed. DDS took 22.1s. Estimated remaining: 4h 5m 18s. Rate: 7.2 symbols/min [2025-10-16T18:23:38.176721] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:38.229090] [DEBUG] [LOCAL ] DECK: Loaded 53297 existing records from primary storage. [2025-10-16T18:23:38.229436] [INFO ] [MAIN ] DECK: Loaded 53297 existing records. [2025-10-16T18:23:38.347910] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-16T18:23:38.405321] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:23:38.405521] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-16T18:23:38.405569] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-16T18:23:38.405783] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-16T18:23:38.405840] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-16T18:23:38.764123] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:38.878133] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T18:23:39.142856] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-16T18:23:39.823101] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T18:23:39.942846] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-16T18:23:40.512418] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T18:23:40.742805] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-16T18:23:41.543020] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-16T18:23:41.801305] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-16T18:23:41.854990] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T18:23:42.342858] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-16T18:23:42.658796] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T18:23:43.142783] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-16T18:23:43.942833] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-16T18:23:44.027359] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T18:23:44.523299] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T18:23:44.528435] [INFO ] [REMOTE ] DEA: Full fetch complete (61685 records). [2025-10-16T18:23:44.528578] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-16T18:23:44.529391] [FATAL] [VALIDATOR ] DEA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:23:44.529501] [FATAL] [MAIN ] DEA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:23:44.529543] [WARN ] [MAIN ] DEA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:23:44.529582] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-16T18:23:44.529662] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-16T18:23:44.529721] [INFO ] [LOCAL ] DEA: Starting deletion of derivative data. [2025-10-16T18:23:44.529864] [DEBUG] [LOCAL ] DEA: Deleted derivative data file. [2025-10-16T18:23:44.529953] [INFO ] [MAIN ] Update Progress: 603/2369 symbols completed. DEA took 28.6s. Estimated remaining: 4h 5m 4s. Rate: 7.2 symbols/min [2025-10-16T18:23:44.698564] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:44.698782] [DEBUG] [LOCAL ] DEI: No existing data file found in primary storage. [2025-10-16T18:23:44.698836] [WARN ] [MAIN ] DEI: No existing data found, performing full refresh instead. [2025-10-16T18:23:44.698943] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-16T18:23:44.698983] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-16T18:23:44.699023] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-10-16T18:23:44.699056] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-16T18:23:44.752534] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-16T18:23:45.045587] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:45.542833] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-16T18:23:45.757686] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T18:23:46.342869] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-16T18:23:46.482213] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T18:23:46.826761] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T18:23:47.142850] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-16T18:23:47.772931] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-16T18:23:47.942837] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-16T18:23:48.336429] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T18:23:48.742857] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-16T18:23:49.542854] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-16T18:23:49.874060] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-16T18:23:49.880589] [INFO ] [REMOTE ] DE: Full fetch complete (69869 records). [2025-10-16T18:23:49.880785] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-16T18:23:50.282696] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-16T18:23:50.282827] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-16T18:23:50.283706] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-16T18:23:50.283838] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-16T18:23:50.307286] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T18:23:50.315975] [DEBUG] [LOCAL ] DE: Trimmed 69869 records to 48037 (keeping 200 days of data) [2025-10-16T18:23:50.372520] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-16T18:23:50.615635] [DEBUG] [LOCAL ] DE: Primary data saved (48037 records). [2025-10-16T18:23:50.615791] [INFO ] [MAIN ] DE: Full history saved. [2025-10-16T18:23:50.615867] [INFO ] [MAIN ] Update Progress: 604/2369 symbols completed. DE took 34.7s. Estimated remaining: 4h 4m 50s. Rate: 7.2 symbols/min [2025-10-16T18:23:50.788057] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:50.841783] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-16T18:23:50.842083] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-10-16T18:23:51.017204] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:23:51.017404] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-16T18:23:51.017489] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-16T18:23:51.017783] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-16T18:23:51.017872] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-16T18:23:51.144485] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-16T18:23:51.397628] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:51.428022] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T18:23:51.764730] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T18:23:51.942791] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-16T18:23:52.151091] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T18:23:52.742811] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-16T18:23:53.542846] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-16T18:23:54.046371] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T18:23:54.342807] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-16T18:23:54.502720] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-16T18:23:55.142802] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-16T18:23:55.328179] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T18:23:55.438118] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T18:23:55.442701] [INFO ] [REMOTE ] DEC: Full fetch complete (44340 records). [2025-10-16T18:23:55.442823] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-16T18:23:55.815178] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-16T18:23:55.815248] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-16T18:23:55.815944] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-16T18:23:55.816009] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-16T18:23:55.817092] [DEBUG] [LOCAL ] DEC: Trimmed 44340 records to 30584 (keeping 200 days of data) [2025-10-16T18:23:55.962785] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-16T18:23:56.001339] [DEBUG] [LOCAL ] DEC: Primary data saved (30584 records). [2025-10-16T18:23:56.001441] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-16T18:23:56.001517] [INFO ] [MAIN ] Update Progress: 605/2369 symbols completed. DEC took 32.7s. Estimated remaining: 4h 4m 33s. Rate: 7.2 symbols/min [2025-10-16T18:23:56.168859] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:56.215527] [DEBUG] [LOCAL ] DEO: Loaded 49216 existing records from primary storage. [2025-10-16T18:23:56.215847] [INFO ] [MAIN ] DEO: Loaded 49216 existing records. [2025-10-16T18:23:56.390298] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:23:56.390546] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-16T18:23:56.390595] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-16T18:23:56.390797] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-16T18:23:56.390853] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-16T18:23:56.769401] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-16T18:23:56.774543] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:57.114402] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T18:23:57.542830] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-16T18:23:57.716442] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T18:23:58.342834] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-16T18:23:59.090099] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-16T18:23:59.142819] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-16T18:23:59.367021] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T18:23:59.928188] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T18:23:59.942764] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-16T18:24:00.742880] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-16T18:24:01.292602] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-16T18:24:01.341718] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T18:24:01.542816] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-16T18:24:02.115448] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T18:24:02.342827] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-16T18:24:03.142895] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-16T18:24:03.199994] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T18:24:03.942817] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-16T18:24:04.136672] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-16T18:24:04.742819] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-16T18:24:05.364604] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-16T18:24:05.544860] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-16T18:24:05.553014] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T18:24:06.164105] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:24:06.342823] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-16T18:24:07.142861] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-16T18:24:07.942779] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-16T18:24:08.001419] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-16T18:24:08.087877] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T18:24:08.520312] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T18:24:08.742821] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-16T18:24:09.542870] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-16T18:24:09.695443] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T18:24:09.704920] [INFO ] [REMOTE ] DEI: Full fetch complete (69888 records). [2025-10-16T18:24:09.705114] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-16T18:24:10.250378] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-16T18:24:10.250505] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-16T18:24:10.252324] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-16T18:24:10.252418] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-16T18:24:10.254495] [DEBUG] [LOCAL ] DEI: Trimmed 69888 records to 48658 (keeping 200 days of data) [2025-10-16T18:24:10.345151] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-16T18:24:10.713206] [DEBUG] [LOCAL ] DEI: Primary data saved (48658 records). [2025-10-16T18:24:10.713486] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-16T18:24:10.713605] [INFO ] [MAIN ] Update Progress: 606/2369 symbols completed. DEI took 26.2s. Estimated remaining: 4h 4m 43s. Rate: 7.2 symbols/min [2025-10-16T18:24:10.941933] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:24:10.977473] [DEBUG] [LOCAL ] DFH: Loaded 32196 existing records from primary storage. [2025-10-16T18:24:10.977931] [INFO ] [MAIN ] DFH: Loaded 32196 existing records. [2025-10-16T18:24:11.197448] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:24:11.197920] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-16T18:24:11.198039] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-16T18:24:11.198275] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-16T18:24:11.198427] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-16T18:24:11.458491] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-16T18:24:11.534958] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-16T18:24:11.626975] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:24:11.815894] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-16T18:24:11.942800] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-16T18:24:12.343489] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T18:24:12.742904] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-16T18:24:13.542891] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-16T18:24:13.702140] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-16T18:24:13.964262] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-16T18:24:14.115151] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T18:24:14.342816] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-16T18:24:14.780599] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T18:24:15.142808] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-16T18:24:15.942876] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-16T18:24:16.218918] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T18:24:16.742838] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-16T18:24:17.467510] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-16T18:24:17.542312] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T18:24:17.552927] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-16T18:24:18.342791] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-16T18:24:18.616075] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-16T18:24:19.142838] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-16T18:24:19.473979] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T18:24:19.796992] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-16T18:24:19.942804] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-16T18:24:20.742839] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-16T18:24:20.927021] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T18:24:21.542906] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-16T18:24:22.021843] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T18:24:22.249928] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-16T18:24:22.342830] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-16T18:24:23.142813] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-16T18:24:23.611163] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-16T18:24:23.618104] [INFO ] [REMOTE ] DECK: Full fetch complete (77068 records). [2025-10-16T18:24:23.618255] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-16T18:24:23.954565] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-16T18:24:24.015160] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-16T18:24:24.015242] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-16T18:24:24.016207] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-16T18:24:24.016271] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-16T18:24:24.017801] [DEBUG] [LOCAL ] DECK: Trimmed 77068 records to 53687 (keeping 200 days of data) [2025-10-16T18:24:24.343856] [DEBUG] [LOCAL ] DECK: Primary data saved (53687 records). [2025-10-16T18:24:24.344008] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-16T18:24:24.344124] [INFO ] [MAIN ] Update Progress: 607/2369 symbols completed. DECK took 46.3s. Estimated remaining: 4h 4m 50s. Rate: 7.2 symbols/min [2025-10-16T18:24:24.512764] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:24:24.536192] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T18:24:24.571469] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-16T18:24:24.585634] [DEBUG] [LOCAL ] DFIN: Loaded 22637 existing records from primary storage. [2025-10-16T18:24:24.585817] [INFO ] [REMOTE ] DELL: Full fetch complete (77525 records). [2025-10-16T18:24:24.586254] [INFO ] [MAIN ] DFIN: Loaded 22637 existing records. [2025-10-16T18:24:24.586130] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-16T18:24:24.648910] [FATAL] [VALIDATOR ] DELL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:24:24.664962] [FATAL] [MAIN ] DELL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:24:24.682944] [WARN ] [MAIN ] DELL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:24:24.685128] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-16T18:24:24.685527] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-10-16T18:24:24.696208] [INFO ] [LOCAL ] DELL: Starting deletion of derivative data. [2025-10-16T18:24:24.711794] [DEBUG] [LOCAL ] DELL: Deleted derivative data file. [2025-10-16T18:24:24.724803] [INFO ] [MAIN ] Update Progress: 608/2369 symbols completed. DELL took 34.1s. Estimated remaining: 4h 4m 19s. Rate: 7.2 symbols/min [2025-10-16T18:24:24.744986] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-16T18:24:24.787990] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:24:24.788315] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-16T18:24:24.798584] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-16T18:24:24.831692] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-16T18:24:24.837235] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-16T18:24:25.089760] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:24:25.227055] [DEBUG] [LOCAL ] DFP: Loaded 11194 existing records from primary storage. [2025-10-16T18:24:25.227381] [INFO ] [MAIN ] DFP: Loaded 11194 existing records. [2025-10-16T18:24:25.429709] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:24:25.488459] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:24:25.488711] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-16T18:24:25.488793] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-16T18:24:25.489015] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-16T18:24:25.489070] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-16T18:24:25.550403] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-16T18:24:25.838405] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:24:26.144638] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-16T18:24:26.223020] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T18:24:26.342789] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-16T18:24:26.792373] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T18:24:27.142823] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-16T18:24:27.788246] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T18:24:27.942857] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-16T18:24:28.402783] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T18:24:28.742842] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-16T18:24:29.542787] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-16T18:24:29.775310] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T18:24:29.975718] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-16T18:24:29.982390] [INFO ] [REMOTE ] DEO: Full fetch complete (71722 records). [2025-10-16T18:24:29.982537] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-16T18:24:30.353229] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-16T18:24:30.439219] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-16T18:24:30.439496] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-16T18:24:30.440702] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-16T18:24:30.440792] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-16T18:24:30.442333] [DEBUG] [LOCAL ] DEO: Trimmed 71722 records to 49588 (keeping 200 days of data) [2025-10-16T18:24:30.561843] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T18:24:30.785050] [DEBUG] [LOCAL ] DEO: Primary data saved (49588 records). [2025-10-16T18:24:30.785260] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-16T18:24:30.785984] [INFO ] [MAIN ] Update Progress: 609/2369 symbols completed. DEO took 34.8s. Estimated remaining: 4h 4m 4s. Rate: 7.2 symbols/min [2025-10-16T18:24:30.965925] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:24:30.966115] [DEBUG] [LOCAL ] DG: No existing data file found in primary storage. [2025-10-16T18:24:30.966155] [WARN ] [MAIN ] DG: No existing data found, performing full refresh instead. [2025-10-16T18:24:30.966297] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-16T18:24:30.966339] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-16T18:24:30.966383] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-10-16T18:24:30.966416] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-16T18:24:31.155294] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-16T18:24:31.230324] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T18:24:31.340600] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:24:31.942834] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-16T18:24:32.673222] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T18:24:32.690549] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T18:24:32.742779] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-16T18:24:33.542865] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-16T18:24:34.219226] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T18:24:34.342791] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-16T18:24:34.431320] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-16T18:24:35.142804] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-16T18:24:35.599581] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T18:24:35.942783] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-16T18:24:36.025507] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T18:24:36.416246] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-16T18:24:36.742815] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-16T18:24:37.542811] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-16T18:24:38.342783] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-16T18:24:38.744922] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T18:24:38.872447] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-16T18:24:39.142792] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-16T18:24:39.188997] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T18:24:39.942831] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-16T18:24:40.349909] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T18:24:40.353998] [INFO ] [REMOTE ] DFH: Full fetch complete (47779 records). [2025-10-16T18:24:40.354220] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-16T18:24:40.355269] [FATAL] [VALIDATOR ] DFH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:24:40.355358] [FATAL] [MAIN ] DFH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:24:40.355426] [WARN ] [MAIN ] DFH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:24:40.355501] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-16T18:24:40.355609] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-10-16T18:24:40.355694] [INFO ] [LOCAL ] DFH: Starting deletion of derivative data. [2025-10-16T18:24:40.356272] [DEBUG] [LOCAL ] DFH: Deleted derivative data file. [2025-10-16T18:24:40.356368] [INFO ] [MAIN ] Update Progress: 610/2369 symbols completed. DFH took 29.6s. Estimated remaining: 4h 3m 59s. Rate: 7.2 symbols/min [2025-10-16T18:24:40.538291] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:24:40.585357] [DEBUG] [LOCAL ] DGX: Loaded 44657 existing records from primary storage. [2025-10-16T18:24:40.585746] [INFO ] [MAIN ] DGX: Loaded 44657 existing records. [2025-10-16T18:24:40.764568] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-16T18:24:40.770513] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:24:40.771996] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-16T18:24:40.772065] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-16T18:24:40.772301] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-16T18:24:40.772358] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-16T18:24:41.145393] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:24:41.249032] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T18:24:41.542782] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-16T18:24:41.665704] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-16T18:24:42.342855] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-16T18:24:42.693401] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T18:24:42.893394] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T18:24:43.142818] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-16T18:24:43.939111] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-16T18:24:43.942756] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-16T18:24:44.743900] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-16T18:24:44.745372] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T18:24:45.542824] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-16T18:24:46.225321] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T18:24:46.226888] [INFO ] [REMOTE ] DFP: Full fetch complete (15841 records). [2025-10-16T18:24:46.226957] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-16T18:24:46.351250] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-16T18:24:46.594129] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-16T18:24:46.594247] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-16T18:24:46.594783] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-16T18:24:46.594903] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-16T18:24:46.595758] [DEBUG] [LOCAL ] DFP: Trimmed 15841 records to 11238 (keeping 200 days of data) [2025-10-16T18:24:46.681995] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T18:24:46.708687] [DEBUG] [LOCAL ] DFP: Primary data saved (11238 records). [2025-10-16T18:24:46.708882] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-16T18:24:46.708982] [INFO ] [MAIN ] Update Progress: 611/2369 symbols completed. DFP took 22.0s. Estimated remaining: 4h 3m 45s. Rate: 7.2 symbols/min [2025-10-16T18:24:46.875546] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:24:46.895936] [DEBUG] [LOCAL ] DHF: Loaded 21070 existing records from primary storage. [2025-10-16T18:24:46.896190] [INFO ] [MAIN ] DHF: Loaded 21070 existing records. [2025-10-16T18:24:47.069620] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:24:47.069887] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-16T18:24:47.069937] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-16T18:24:47.070109] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-16T18:24:47.070149] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-16T18:24:47.148121] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-16T18:24:47.424831] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:24:47.942857] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-16T18:24:48.357841] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T18:24:48.427927] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-16T18:24:48.631021] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-16T18:24:48.742843] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-16T18:24:49.542799] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-16T18:24:49.714597] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T18:24:50.342836] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-16T18:24:51.142819] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-16T18:24:51.235308] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T18:24:51.258448] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T18:24:51.942828] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-16T18:24:51.977246] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-16T18:24:52.742834] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-16T18:24:53.494196] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T18:24:53.543747] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-16T18:24:53.545604] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T18:24:54.342804] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-16T18:24:55.142804] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-16T18:24:55.472552] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-16T18:24:55.544682] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T18:24:55.942862] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-16T18:24:56.278877] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T18:24:56.742873] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-16T18:24:57.542801] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-16T18:24:57.764546] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T18:24:58.342852] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-16T18:24:58.430380] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T18:24:58.782788] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-16T18:24:59.142865] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-16T18:24:59.791587] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-16T18:24:59.942796] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-16T18:25:00.742863] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-16T18:25:01.122426] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T18:25:01.127173] [INFO ] [REMOTE ] DFIN: Full fetch complete (33397 records). [2025-10-16T18:25:01.127342] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-16T18:25:01.526853] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-16T18:25:01.566459] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-16T18:25:01.580971] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-16T18:25:01.581060] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-16T18:25:01.581708] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-16T18:25:01.582199] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-16T18:25:01.583787] [DEBUG] [LOCAL ] DFIN: Trimmed 33397 records to 22789 (keeping 200 days of data) [2025-10-16T18:25:01.723010] [DEBUG] [LOCAL ] DFIN: Primary data saved (22789 records). [2025-10-16T18:25:01.723169] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-16T18:25:01.723252] [INFO ] [MAIN ] Update Progress: 612/2369 symbols completed. DFIN took 37.4s. Estimated remaining: 4h 3m 56s. Rate: 7.2 symbols/min [2025-10-16T18:25:01.907768] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:25:01.907972] [DEBUG] [LOCAL ] DHI: No existing data file found in primary storage. [2025-10-16T18:25:01.908040] [WARN ] [MAIN ] DHI: No existing data found, performing full refresh instead. [2025-10-16T18:25:01.908252] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-16T18:25:01.908337] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-16T18:25:01.925336] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-16T18:25:01.926053] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-16T18:25:01.959523] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T18:25:02.279931] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:25:02.342846] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-16T18:25:03.142955] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-16T18:25:03.184713] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T18:25:03.942815] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-16T18:25:04.383235] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-16T18:25:04.742784] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-16T18:25:04.908914] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T18:25:05.490833] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T18:25:05.542774] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-16T18:25:06.342890] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-16T18:25:06.665229] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-16T18:25:07.142842] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-16T18:25:07.382822] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T18:25:07.766495] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T18:25:07.942805] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-16T18:25:08.024180] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T18:25:08.742870] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-16T18:25:08.951004] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T18:25:09.542836] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-16T18:25:10.275366] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T18:25:10.342824] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-16T18:25:11.142828] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-16T18:25:11.225739] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T18:25:11.942835] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-16T18:25:12.190439] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T18:25:12.219208] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T18:25:12.742836] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-16T18:25:13.542815] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-16T18:25:13.600220] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T18:25:13.880226] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T18:25:14.342861] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-16T18:25:15.142796] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-16T18:25:15.443873] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T18:25:15.552416] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T18:25:15.942844] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-16T18:25:16.578075] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T18:25:16.584264] [INFO ] [REMOTE ] DGX: Full fetch complete (65309 records). [2025-10-16T18:25:16.584443] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-16T18:25:16.744836] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-16T18:25:16.987224] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-16T18:25:16.987297] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-16T18:25:16.988134] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-16T18:25:16.988196] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-16T18:25:16.989477] [DEBUG] [LOCAL ] DGX: Trimmed 65309 records to 44978 (keeping 200 days of data) [2025-10-16T18:25:17.272694] [DEBUG] [LOCAL ] DGX: Primary data saved (44978 records). [2025-10-16T18:25:17.272824] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-16T18:25:17.273737] [INFO ] [MAIN ] Update Progress: 613/2369 symbols completed. DGX took 36.9s. Estimated remaining: 4h 4m 8s. Rate: 7.2 symbols/min [2025-10-16T18:25:17.456932] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:25:17.513065] [DEBUG] [LOCAL ] DHR: Loaded 53378 existing records from primary storage. [2025-10-16T18:25:17.513394] [INFO ] [MAIN ] DHR: Loaded 53378 existing records. [2025-10-16T18:25:17.543967] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-16T18:25:17.704227] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:25:17.705130] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-16T18:25:17.705229] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-16T18:25:17.705764] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T18:25:17.708919] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-16T18:25:17.709189] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-16T18:25:17.729854] [INFO ] [REMOTE ] DHF: Full fetch complete (30004 records). [2025-10-16T18:25:17.777268] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-16T18:25:18.028570] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-16T18:25:18.344172] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-16T18:25:18.519900] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:25:18.598417] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-16T18:25:18.598500] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-16T18:25:18.599143] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-16T18:25:18.599207] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-16T18:25:18.600046] [DEBUG] [LOCAL ] DHF: Trimmed 30004 records to 21169 (keeping 200 days of data) [2025-10-16T18:25:18.722570] [DEBUG] [LOCAL ] DHF: Primary data saved (21169 records). [2025-10-16T18:25:18.722750] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-16T18:25:18.722844] [INFO ] [MAIN ] Update Progress: 614/2369 symbols completed. DHF took 32.0s. Estimated remaining: 4h 3m 40s. Rate: 7.2 symbols/min [2025-10-16T18:25:18.888090] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:25:18.933297] [DEBUG] [LOCAL ] DHT: Loaded 47932 existing records from primary storage. [2025-10-16T18:25:18.933597] [INFO ] [MAIN ] DHT: Loaded 47932 existing records. [2025-10-16T18:25:19.109228] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:25:19.109451] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-16T18:25:19.109504] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-16T18:25:19.109993] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-16T18:25:19.110051] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-16T18:25:19.152762] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-16T18:25:19.468263] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:25:19.526770] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T18:25:19.942818] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-16T18:25:20.742918] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-16T18:25:20.945247] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T18:25:20.985767] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-16T18:25:21.466425] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T18:25:21.473486] [INFO ] [REMOTE ] DG: Full fetch complete (77352 records). [2025-10-16T18:25:21.473611] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-16T18:25:21.547618] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-16T18:25:21.943034] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-16T18:25:21.943228] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-16T18:25:21.944306] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-16T18:25:21.944468] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-16T18:25:21.948327] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-16T18:25:21.960140] [DEBUG] [LOCAL ] DG: Trimmed 77352 records to 53667 (keeping 200 days of data) [2025-10-16T18:25:22.297191] [DEBUG] [LOCAL ] DG: Primary data saved (53667 records). [2025-10-16T18:25:22.297359] [INFO ] [MAIN ] DG: Full history saved. [2025-10-16T18:25:22.297446] [INFO ] [MAIN ] Update Progress: 615/2369 symbols completed. DG took 51.5s. Estimated remaining: 4h 3m 18s. Rate: 7.2 symbols/min [2025-10-16T18:25:22.351281] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-16T18:25:22.464993] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:25:22.479030] [DEBUG] [LOCAL ] DHX: Loaded 13388 existing records from primary storage. [2025-10-16T18:25:22.479248] [INFO ] [MAIN ] DHX: Loaded 13388 existing records. [2025-10-16T18:25:22.649925] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:25:22.650135] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-16T18:25:22.650181] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-16T18:25:22.650331] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-16T18:25:22.650369] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-16T18:25:22.994273] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:25:23.142779] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-16T18:25:23.698261] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-16T18:25:23.800695] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T18:25:23.942821] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-16T18:25:24.049453] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-16T18:25:24.742803] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-16T18:25:25.542792] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-16T18:25:25.791424] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-16T18:25:26.342826] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-16T18:25:26.663630] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T18:25:26.920986] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T18:25:27.079250] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T18:25:27.142766] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-16T18:25:27.942831] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-16T18:25:28.742883] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-16T18:25:28.794208] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T18:25:29.542817] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-16T18:25:30.031875] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-16T18:25:30.342777] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-16T18:25:30.553938] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T18:25:31.009781] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T18:25:31.142854] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-16T18:25:31.448518] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T18:25:31.942829] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-16T18:25:32.742800] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-16T18:25:32.820541] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T18:25:33.264800] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T18:25:33.542871] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-16T18:25:34.342831] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-16T18:25:34.784760] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-16T18:25:34.990226] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-16T18:25:35.152172] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-16T18:25:35.157665] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T18:25:35.842888] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-16T18:25:35.942838] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-16T18:25:36.742826] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-16T18:25:36.868017] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T18:25:37.542816] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-16T18:25:38.342865] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-16T18:25:39.117679] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-16T18:25:39.142822] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-16T18:25:39.247058] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-16T18:25:39.254924] [INFO ] [REMOTE ] DHI: Full fetch complete (77397 records). [2025-10-16T18:25:39.255211] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-16T18:25:39.663944] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-16T18:25:39.664188] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-16T18:25:39.665529] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-16T18:25:39.665632] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-16T18:25:39.698022] [DEBUG] [LOCAL ] DHI: Trimmed 77397 records to 53756 (keeping 200 days of data) [2025-10-16T18:25:39.697856] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-16T18:25:39.943210] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-16T18:25:40.046485] [DEBUG] [LOCAL ] DHI: Primary data saved (53756 records). [2025-10-16T18:25:40.046620] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-16T18:25:40.046723] [INFO ] [MAIN ] Update Progress: 616/2369 symbols completed. DHI took 38.3s. Estimated remaining: 4h 3m 37s. Rate: 7.2 symbols/min [2025-10-16T18:25:40.215865] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:25:40.230231] [DEBUG] [LOCAL ] DIAX: Loaded 13028 existing records from primary storage. [2025-10-16T18:25:40.230447] [INFO ] [MAIN ] DIAX: Loaded 13028 existing records. [2025-10-16T18:25:40.411214] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:25:40.411466] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-16T18:25:40.411526] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-16T18:25:40.411741] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-16T18:25:40.411796] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-16T18:25:40.715618] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T18:25:40.752592] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-16T18:25:40.788857] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:25:40.961780] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T18:25:41.542824] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-16T18:25:42.342804] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-16T18:25:42.548809] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-16T18:25:42.549516] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-16T18:25:43.142814] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-16T18:25:43.862488] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T18:25:43.942820] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-16T18:25:44.742778] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-16T18:25:45.035919] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T18:25:45.350063] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T18:25:45.367543] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-16T18:25:45.542801] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-16T18:25:46.248035] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-16T18:25:46.342782] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-16T18:25:47.142789] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-16T18:25:47.264123] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-16T18:25:47.895130] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-16T18:25:47.942778] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-16T18:25:48.742799] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-16T18:25:48.950693] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-16T18:25:49.542815] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-16T18:25:50.231869] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T18:25:50.342778] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-16T18:25:50.434430] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T18:25:51.142842] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-16T18:25:51.942805] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-16T18:25:52.000132] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T18:25:52.006878] [INFO ] [REMOTE ] DHT: Full fetch complete (69787 records). [2025-10-16T18:25:52.007029] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-16T18:25:52.007938] [FATAL] [VALIDATOR ] DHT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:25:52.008020] [FATAL] [MAIN ] DHT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:25:52.008087] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:25:52.008162] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-16T18:25:52.008233] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-10-16T18:25:52.008293] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-10-16T18:25:52.008441] [DEBUG] [LOCAL ] DHT: Deleted derivative data file. [2025-10-16T18:25:52.008532] [INFO ] [MAIN ] Update Progress: 617/2369 symbols completed. DHT took 33.3s. Estimated remaining: 4h 3m 39s. Rate: 7.2 symbols/min [2025-10-16T18:25:52.187359] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:25:52.227502] [DEBUG] [LOCAL ] DIN: Loaded 37272 existing records from primary storage. [2025-10-16T18:25:52.227818] [INFO ] [MAIN ] DIN: Loaded 37272 existing records. [2025-10-16T18:25:52.412016] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:25:52.412240] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-16T18:25:52.412319] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-16T18:25:52.412576] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-16T18:25:52.412633] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-16T18:25:52.753609] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-16T18:25:52.780103] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:25:52.858050] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T18:25:52.861355] [INFO ] [REMOTE ] DHX: Full fetch complete (21468 records). [2025-10-16T18:25:52.861484] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-16T18:25:53.108268] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T18:25:53.271897] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-16T18:25:53.272014] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-16T18:25:53.272558] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-16T18:25:53.272598] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-16T18:25:53.273155] [DEBUG] [LOCAL ] DHX: Trimmed 21468 records to 13573 (keeping 200 days of data) [2025-10-16T18:25:53.338847] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T18:25:53.358764] [DEBUG] [LOCAL ] DHX: Primary data saved (13573 records). [2025-10-16T18:25:53.358937] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-16T18:25:53.359031] [INFO ] [MAIN ] Update Progress: 618/2369 symbols completed. DHX took 31.1s. Estimated remaining: 4h 3m 11s. Rate: 7.2 symbols/min [2025-10-16T18:25:53.524356] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:25:53.553923] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-16T18:25:53.576599] [DEBUG] [LOCAL ] DINO: Loaded 52842 existing records from primary storage. [2025-10-16T18:25:53.576972] [INFO ] [MAIN ] DINO: Loaded 52842 existing records. [2025-10-16T18:25:53.749263] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:25:53.749462] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-16T18:25:53.749510] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-16T18:25:53.750398] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-16T18:25:53.750456] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-16T18:25:54.098786] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:25:54.330079] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T18:25:54.342771] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-16T18:25:55.142808] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-16T18:25:55.283536] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T18:25:55.942862] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-16T18:25:56.431218] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-16T18:25:56.547527] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-16T18:25:56.742795] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-16T18:25:57.542817] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-16T18:25:58.342845] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-16T18:25:58.384864] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T18:25:59.142784] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-16T18:25:59.336313] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T18:25:59.456573] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-16T18:25:59.942843] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-16T18:26:00.320990] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-16T18:26:00.742851] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-16T18:26:00.841348] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T18:26:00.849163] [INFO ] [REMOTE ] DHR: Full fetch complete (77435 records). [2025-10-16T18:26:00.849353] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-16T18:26:01.301265] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-16T18:26:01.301358] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-16T18:26:01.302515] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-16T18:26:01.302601] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-16T18:26:01.304290] [DEBUG] [LOCAL ] DHR: Trimmed 77435 records to 53768 (keeping 200 days of data) [2025-10-16T18:26:01.550434] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-16T18:26:01.697465] [DEBUG] [LOCAL ] DHR: Primary data saved (53768 records). [2025-10-16T18:26:01.697636] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-16T18:26:01.698455] [INFO ] [MAIN ] Update Progress: 619/2369 symbols completed. DHR took 44.4s. Estimated remaining: 4h 3m 2s. Rate: 7.2 symbols/min [2025-10-16T18:26:01.908029] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:26:01.969533] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-16T18:26:01.969919] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-16T18:26:02.177283] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:26:02.178514] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-16T18:26:02.178686] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-16T18:26:02.179805] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-16T18:26:02.179863] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-16T18:26:02.344867] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-16T18:26:02.477449] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T18:26:02.470625] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T18:26:02.530355] [INFO ] [REMOTE ] DIAX: Full fetch complete (17720 records). [2025-10-16T18:26:02.533378] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-16T18:26:02.752069] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:26:03.058005] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-16T18:26:03.058087] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-16T18:26:03.058542] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-16T18:26:03.058584] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-16T18:26:03.059239] [DEBUG] [LOCAL ] DIAX: Trimmed 17720 records to 13091 (keeping 200 days of data) [2025-10-16T18:26:03.140226] [DEBUG] [LOCAL ] DIAX: Primary data saved (13091 records). [2025-10-16T18:26:03.140358] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-16T18:26:03.140439] [INFO ] [MAIN ] Update Progress: 620/2369 symbols completed. DIAX took 23.1s. Estimated remaining: 4h 2m 35s. Rate: 7.2 symbols/min [2025-10-16T18:26:03.151545] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-16T18:26:03.312091] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:26:03.312267] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-16T18:26:03.312305] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-16T18:26:03.312417] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-16T18:26:03.312456] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-16T18:26:03.312496] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-16T18:26:03.312527] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-16T18:26:03.668334] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:26:03.942818] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-16T18:26:04.127136] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T18:26:04.742863] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-16T18:26:05.535931] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T18:26:05.544282] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-16T18:26:05.603813] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-16T18:26:06.256058] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T18:26:06.311781] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T18:26:06.342784] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-16T18:26:07.142831] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-16T18:26:07.571180] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-16T18:26:07.942848] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-16T18:26:08.072805] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T18:26:08.250753] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-16T18:26:08.742822] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-16T18:26:09.210675] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-16T18:26:09.542866] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-16T18:26:10.342816] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-16T18:26:10.772685] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-16T18:26:11.114814] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T18:26:11.142802] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-16T18:26:11.492602] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-16T18:26:11.942803] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-16T18:26:12.742836] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-16T18:26:13.293859] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T18:26:13.542828] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-16T18:26:14.342888] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-16T18:26:14.925600] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T18:26:15.142794] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-16T18:26:15.233283] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-16T18:26:15.752063] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T18:26:15.942814] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-16T18:26:16.070544] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T18:26:16.371033] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-16T18:26:16.742812] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-16T18:26:17.542829] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-16T18:26:17.814071] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-16T18:26:18.342812] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-16T18:26:18.469635] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T18:26:19.142821] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-16T18:26:19.572273] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-16T18:26:19.942823] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-16T18:26:20.639717] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-16T18:26:20.742771] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-16T18:26:21.544817] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-16T18:26:21.543142] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-16T18:26:22.342810] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-16T18:26:22.639907] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-16T18:26:23.066823] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-16T18:26:23.142775] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-16T18:26:23.192776] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T18:26:23.942832] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-16T18:26:24.742844] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-16T18:26:25.190943] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T18:26:25.542785] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-16T18:26:25.605254] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-16T18:26:26.342821] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-16T18:26:26.524052] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T18:26:26.934669] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T18:26:26.935535] [INFO ] [REMOTE ] DIVY: Full fetch complete (1700 records). [2025-10-16T18:26:26.935607] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-16T18:26:27.126798] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-16T18:26:27.127083] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:26:27.127284] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:26:27.127434] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-16T18:26:27.127527] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-16T18:26:27.127740] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-16T18:26:27.127869] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-16T18:26:27.127965] [INFO ] [MAIN ] Update Progress: 621/2369 symbols completed. DIVY took 24.0s. Estimated remaining: 4h 3m 10s. Rate: 7.2 symbols/min [2025-10-16T18:26:27.148389] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-16T18:26:27.270921] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T18:26:27.335823] [INFO ] [REMOTE ] DIN: Full fetch complete (55112 records). [2025-10-16T18:26:27.338473] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:26:27.338907] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-16T18:26:27.711910] [DEBUG] [LOCAL ] DK: Loaded 49447 existing records from primary storage. [2025-10-16T18:26:27.729161] [INFO ] [MAIN ] DK: Loaded 49447 existing records. [2025-10-16T18:26:27.939426] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-16T18:26:27.944760] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-16T18:26:27.944813] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-16T18:26:27.946441] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-16T18:26:27.958941] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-16T18:26:28.020974] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:26:28.021394] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-16T18:26:28.021732] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-16T18:26:28.021962] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-16T18:26:28.022246] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-16T18:26:28.022138] [DEBUG] [LOCAL ] DIN: Trimmed 55112 records to 37519 (keeping 200 days of data) [2025-10-16T18:26:28.508907] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:26:28.652778] [DEBUG] [LOCAL ] DIN: Primary data saved (37519 records). [2025-10-16T18:26:28.652991] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-16T18:26:28.653104] [INFO ] [MAIN ] Update Progress: 622/2369 symbols completed. DIN took 36.6s. Estimated remaining: 4h 2m 43s. Rate: 7.2 symbols/min [2025-10-16T18:26:28.752504] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-16T18:26:28.842579] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:26:28.863586] [DEBUG] [LOCAL ] DKL: Loaded 17546 existing records from primary storage. [2025-10-16T18:26:28.863959] [INFO ] [MAIN ] DKL: Loaded 17546 existing records. [2025-10-16T18:26:29.058132] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:26:29.058576] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-16T18:26:29.058873] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-16T18:26:29.059180] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-16T18:26:29.059251] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-16T18:26:29.204448] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-16T18:26:29.535918] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:26:29.542782] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-16T18:26:30.342789] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-16T18:26:30.437405] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T18:26:30.517361] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-16T18:26:30.735820] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T18:26:31.142842] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-16T18:26:31.869803] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T18:26:31.942841] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-16T18:26:32.747967] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-16T18:26:32.771767] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T18:26:33.542888] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-16T18:26:34.225214] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-16T18:26:34.342810] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-16T18:26:34.624397] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T18:26:34.643880] [INFO ] [REMOTE ] DINO: Full fetch complete (76730 records). [2025-10-16T18:26:34.658838] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-16T18:26:34.660836] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T18:26:35.076284] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-16T18:26:35.076399] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-16T18:26:35.077856] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-16T18:26:35.077934] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-16T18:26:35.080060] [DEBUG] [LOCAL ] DINO: Trimmed 76730 records to 53216 (keeping 200 days of data) [2025-10-16T18:26:35.145095] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-16T18:26:35.430209] [DEBUG] [LOCAL ] DINO: Primary data saved (53216 records). [2025-10-16T18:26:35.430436] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-16T18:26:35.431341] [INFO ] [MAIN ] Update Progress: 623/2369 symbols completed. DINO took 42.1s. Estimated remaining: 4h 2m 30s. Rate: 7.2 symbols/min [2025-10-16T18:26:35.603851] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:26:35.653395] [DEBUG] [LOCAL ] DKS: Loaded 49719 existing records from primary storage. [2025-10-16T18:26:35.653734] [INFO ] [MAIN ] DKS: Loaded 49719 existing records. [2025-10-16T18:26:35.842033] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:26:35.842443] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-16T18:26:35.842499] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-16T18:26:35.842764] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-16T18:26:35.842820] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-16T18:26:35.943890] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-16T18:26:36.221559] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:26:36.233359] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T18:26:36.707065] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-16T18:26:36.742773] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-16T18:26:37.547876] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-16T18:26:37.563120] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T18:26:38.342859] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-16T18:26:38.739115] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-16T18:26:39.142842] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-16T18:26:39.410432] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-16T18:26:39.517882] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-16T18:26:39.942817] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-16T18:26:40.742833] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-16T18:26:41.321999] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-16T18:26:41.542854] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-16T18:26:41.682631] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T18:26:42.044579] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-16T18:26:42.051842] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-16T18:26:42.051952] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-16T18:26:42.344241] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-16T18:26:42.454578] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-16T18:26:42.454709] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-16T18:26:42.455768] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-16T18:26:42.455915] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-16T18:26:42.457690] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 54178 (keeping 200 days of data) [2025-10-16T18:26:42.579753] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-16T18:26:42.841479] [DEBUG] [LOCAL ] DIS: Primary data saved (54178 records). [2025-10-16T18:26:42.841613] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-16T18:26:42.842534] [INFO ] [MAIN ] Update Progress: 624/2369 symbols completed. DIS took 41.1s. Estimated remaining: 4h 2m 19s. Rate: 7.2 symbols/min [2025-10-16T18:26:43.012612] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:26:43.046004] [DEBUG] [LOCAL ] DLB: Loaded 32247 existing records from primary storage. [2025-10-16T18:26:43.046272] [INFO ] [MAIN ] DLB: Loaded 32247 existing records. [2025-10-16T18:26:43.145160] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-16T18:26:43.222760] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:26:43.222961] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-16T18:26:43.223008] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-16T18:26:43.223681] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-16T18:26:43.223738] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-16T18:26:43.543367] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T18:26:43.601589] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:26:43.942811] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-16T18:26:44.742826] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-16T18:26:44.827102] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T18:26:45.444377] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T18:26:45.542787] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-16T18:26:45.599400] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T18:26:46.342843] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-16T18:26:47.142857] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-16T18:26:47.220531] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T18:26:47.942878] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-16T18:26:48.125533] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T18:26:48.257554] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-16T18:26:48.742820] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-16T18:26:49.045744] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T18:26:49.518842] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T18:26:49.542777] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-16T18:26:50.342820] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-16T18:26:51.070246] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T18:26:51.142810] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-16T18:26:51.815537] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T18:26:51.942860] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-16T18:26:52.742856] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-16T18:26:52.925506] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T18:26:53.321701] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T18:26:53.542851] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-16T18:26:54.342864] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-16T18:26:54.478628] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T18:26:55.059634] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T18:26:55.142875] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-16T18:26:55.425941] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T18:26:55.942853] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-16T18:26:56.742850] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-16T18:26:56.845184] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-16T18:26:56.885789] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T18:26:57.542855] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-16T18:26:57.891942] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T18:26:58.184372] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T18:26:58.342862] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-16T18:26:59.142840] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-16T18:26:59.156796] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T18:26:59.942838] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-16T18:27:00.742861] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-16T18:27:00.915807] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T18:27:01.542846] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-16T18:27:01.641883] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T18:27:01.684986] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T18:27:01.686994] [INFO ] [REMOTE ] DKL: Full fetch complete (27855 records). [2025-10-16T18:27:01.687092] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-16T18:27:01.687578] [FATAL] [VALIDATOR ] DKL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:27:01.687704] [FATAL] [MAIN ] DKL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:27:01.687758] [WARN ] [MAIN ] DKL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:27:01.687801] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-16T18:27:01.687858] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-10-16T18:27:01.687968] [INFO ] [LOCAL ] DKL: Starting deletion of derivative data. [2025-10-16T18:27:01.688261] [DEBUG] [LOCAL ] DKL: Deleted derivative data file. [2025-10-16T18:27:01.688354] [INFO ] [MAIN ] Update Progress: 625/2369 symbols completed. DKL took 33.0s. Estimated remaining: 4h 2m 40s. Rate: 7.2 symbols/min [2025-10-16T18:27:01.858012] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:27:01.865725] [DEBUG] [LOCAL ] DLNG: Loaded 6188 existing records from primary storage. [2025-10-16T18:27:01.865954] [INFO ] [MAIN ] DLNG: Loaded 6188 existing records. [2025-10-16T18:27:02.058857] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:27:02.059121] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-16T18:27:02.059177] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-16T18:27:02.059744] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-16T18:27:02.059851] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-16T18:27:02.350848] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-16T18:27:02.458495] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:27:03.142861] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-16T18:27:03.261093] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T18:27:03.268335] [INFO ] [REMOTE ] DK: Full fetch complete (70972 records). [2025-10-16T18:27:03.268536] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-16T18:27:03.678398] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-16T18:27:03.678474] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-16T18:27:03.679397] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-16T18:27:03.679461] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-16T18:27:03.681022] [DEBUG] [LOCAL ] DK: Trimmed 70972 records to 49758 (keeping 200 days of data) [2025-10-16T18:27:03.947596] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-16T18:27:03.982057] [DEBUG] [LOCAL ] DK: Primary data saved (49758 records). [2025-10-16T18:27:03.982302] [INFO ] [MAIN ] DK: Full history saved. [2025-10-16T18:27:03.982394] [INFO ] [MAIN ] Update Progress: 626/2369 symbols completed. DK took 36.9s. Estimated remaining: 4h 2m 15s. Rate: 7.2 symbols/min [2025-10-16T18:27:04.158581] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:27:04.158911] [DEBUG] [LOCAL ] DLR: No existing data file found in primary storage. [2025-10-16T18:27:04.159031] [WARN ] [MAIN ] DLR: No existing data found, performing full refresh instead. [2025-10-16T18:27:04.159163] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-16T18:27:04.159231] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-16T18:27:04.159369] [DEBUG] [LOCAL ] DLR: No primary data file found to delete. [2025-10-16T18:27:04.159500] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-16T18:27:04.549193] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:27:04.543799] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T18:27:04.588859] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-16T18:27:04.742780] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-16T18:27:04.890532] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-16T18:27:05.542844] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-16T18:27:06.037149] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T18:27:06.342831] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-16T18:27:06.550707] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T18:27:07.142809] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-16T18:27:07.727008] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T18:27:07.942917] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-16T18:27:08.148595] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T18:27:08.742845] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-16T18:27:09.056581] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T18:27:09.542861] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-16T18:27:10.342842] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-16T18:27:10.591477] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T18:27:10.887007] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T18:27:11.142844] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-16T18:27:11.805997] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:27:11.830332] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-16T18:27:11.942858] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-16T18:27:12.470702] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-16T18:27:12.742850] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-16T18:27:13.497701] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-16T18:27:13.542778] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-16T18:27:14.099868] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-16T18:27:14.342813] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-16T18:27:15.013533] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-16T18:27:15.142825] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-16T18:27:15.824032] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-16T18:27:15.942820] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-16T18:27:16.742803] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-16T18:27:17.542798] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-16T18:27:17.912381] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-16T18:27:17.918882] [INFO ] [REMOTE ] DKS: Full fetch complete (71806 records). [2025-10-16T18:27:17.919045] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-16T18:27:18.342679] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-16T18:27:18.343141] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-16T18:27:18.342985] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-16T18:27:18.344725] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-16T18:27:18.345025] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-16T18:27:18.348579] [DEBUG] [LOCAL ] DKS: Trimmed 71806 records to 50058 (keeping 200 days of data) [2025-10-16T18:27:18.637017] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T18:27:18.740338] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-16T18:27:18.777098] [DEBUG] [LOCAL ] DKS: Primary data saved (50058 records). [2025-10-16T18:27:18.777312] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-16T18:27:18.778293] [INFO ] [MAIN ] Update Progress: 627/2369 symbols completed. DKS took 43.3s. Estimated remaining: 4h 2m 25s. Rate: 7.2 symbols/min [2025-10-16T18:27:18.974070] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:27:18.988284] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T18:27:19.011167] [DEBUG] [LOCAL ] DLX: Loaded 28382 existing records from primary storage. [2025-10-16T18:27:19.011442] [INFO ] [MAIN ] DLX: Loaded 28382 existing records. [2025-10-16T18:27:19.150290] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-16T18:27:19.191282] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:27:19.191529] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-16T18:27:19.191579] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-16T18:27:19.191912] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-16T18:27:19.191968] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-16T18:27:19.585723] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:27:19.942823] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-16T18:27:20.742875] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-16T18:27:20.769577] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T18:27:20.771486] [INFO ] [REMOTE ] DLNG: Full fetch complete (11734 records). [2025-10-16T18:27:20.771581] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-16T18:27:21.196126] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-16T18:27:21.196303] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-16T18:27:21.196748] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-16T18:27:21.196936] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-16T18:27:21.213871] [DEBUG] [LOCAL ] DLNG: Trimmed 11734 records to 6230 (keeping 200 days of data) [2025-10-16T18:27:21.242426] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-16T18:27:21.275499] [DEBUG] [LOCAL ] DLNG: Primary data saved (6230 records). [2025-10-16T18:27:21.275621] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-16T18:27:21.275741] [INFO ] [MAIN ] Update Progress: 628/2369 symbols completed. DLNG took 19.6s. Estimated remaining: 4h 2m 0s. Rate: 7.2 symbols/min [2025-10-16T18:27:21.443620] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:27:21.443813] [DEBUG] [LOCAL ] DLY: No existing data file found in primary storage. [2025-10-16T18:27:21.443860] [WARN ] [MAIN ] DLY: No existing data found, performing full refresh instead. [2025-10-16T18:27:21.443977] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-16T18:27:21.444018] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-16T18:27:21.444058] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-10-16T18:27:21.444089] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-16T18:27:21.552539] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-16T18:27:21.816481] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:27:22.103082] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T18:27:22.107879] [INFO ] [REMOTE ] DLB: Full fetch complete (47294 records). [2025-10-16T18:27:22.107992] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-16T18:27:22.348939] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-16T18:27:22.483308] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-16T18:27:22.483395] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-16T18:27:22.484161] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-16T18:27:22.484226] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-16T18:27:22.485386] [DEBUG] [LOCAL ] DLB: Trimmed 47294 records to 32489 (keeping 200 days of data) [2025-10-16T18:27:22.682957] [DEBUG] [LOCAL ] DLB: Primary data saved (32489 records). [2025-10-16T18:27:22.683095] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-16T18:27:22.683172] [INFO ] [MAIN ] Update Progress: 629/2369 symbols completed. DLB took 39.8s. Estimated remaining: 4h 1m 33s. Rate: 7.2 symbols/min [2025-10-16T18:27:22.854559] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:27:22.866378] [DEBUG] [LOCAL ] DMA: No existing data file found in primary storage. [2025-10-16T18:27:22.867425] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T18:27:22.866982] [WARN ] [MAIN ] DMA: No existing data found, performing full refresh instead. [2025-10-16T18:27:22.872435] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-16T18:27:22.872486] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-16T18:27:22.872531] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-10-16T18:27:22.872565] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-16T18:27:23.147875] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-16T18:27:23.236689] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:27:23.570568] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-16T18:27:23.942818] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-16T18:27:24.742852] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-16T18:27:25.008514] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T18:27:25.069939] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T18:27:25.173845] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-16T18:27:25.542847] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-16T18:27:26.342867] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-16T18:27:27.142846] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-16T18:27:27.202278] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-16T18:27:27.236795] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T18:27:27.695079] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T18:27:27.942816] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-16T18:27:28.497851] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-16T18:27:28.742897] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-16T18:27:29.377381] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-16T18:27:29.542847] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-16T18:27:30.342860] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-16T18:27:30.526619] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T18:27:31.142819] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-16T18:27:31.718405] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T18:27:31.720252] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T18:27:31.942843] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-16T18:27:32.742807] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-16T18:27:33.542788] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-16T18:27:33.847686] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T18:27:33.957476] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-16T18:27:34.342851] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-16T18:27:34.485506] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-16T18:27:34.659686] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-16T18:27:35.142815] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-16T18:27:35.942870] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-16T18:27:36.365314] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T18:27:36.742821] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-16T18:27:37.542823] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-16T18:27:37.759575] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T18:27:37.789990] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T18:27:38.306679] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T18:27:38.342878] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-16T18:27:39.142856] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-16T18:27:39.616562] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T18:27:39.942846] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-16T18:27:40.742860] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-16T18:27:40.878405] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T18:27:41.248820] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-16T18:27:41.542794] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-16T18:27:41.662579] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-16T18:27:42.342803] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-16T18:27:42.850559] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-16T18:27:43.052161] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T18:27:43.142783] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-16T18:27:43.942805] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-16T18:27:44.371283] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T18:27:44.722476] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T18:27:44.742772] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-16T18:27:45.542822] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-16T18:27:45.583554] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T18:27:45.590219] [INFO ] [REMOTE ] DLR: Full fetch complete (74149 records). [2025-10-16T18:27:45.590399] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-16T18:27:45.986833] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-16T18:27:45.986934] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-16T18:27:45.987976] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-16T18:27:45.988042] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-16T18:27:45.989578] [DEBUG] [LOCAL ] DLR: Trimmed 74149 records to 51052 (keeping 200 days of data) [2025-10-16T18:27:46.311524] [DEBUG] [LOCAL ] DLR: Primary data saved (51052 records). [2025-10-16T18:27:46.311696] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-16T18:27:46.311786] [INFO ] [MAIN ] Update Progress: 630/2369 symbols completed. DLR took 42.3s. Estimated remaining: 4h 2m 7s. Rate: 7.2 symbols/min [2025-10-16T18:27:46.348042] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-16T18:27:46.486941] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:27:46.499589] [DEBUG] [LOCAL ] DMB: Loaded 10304 existing records from primary storage. [2025-10-16T18:27:46.499859] [INFO ] [MAIN ] DMB: Loaded 10304 existing records. [2025-10-16T18:27:46.682025] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:27:46.682389] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-16T18:27:46.682468] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-16T18:27:46.682763] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-16T18:27:46.682822] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-16T18:27:46.969852] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-16T18:27:47.078872] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:27:47.142787] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-16T18:27:47.253298] [DEBUG] [REMOTE ] DMB: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-16T18:27:47.253676] [WARN ] [REMOTE ] DMB: No data returned for month 2024-12 [2025-10-16T18:27:47.253749] [FATAL] [REMOTE ] DMB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:27:47.253815] [FATAL] [MAIN ] DMB: Failed to fetch primary data. [2025-10-16T18:27:47.253880] [WARN ] [MAIN ] DMB: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:27:47.253951] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-16T18:27:47.254015] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-16T18:27:47.254051] [INFO ] [LOCAL ] DMB: Starting deletion of derivative data. [2025-10-16T18:27:47.254187] [DEBUG] [LOCAL ] DMB: Deleted derivative data file. [2025-10-16T18:27:47.254287] [INFO ] [MAIN ] Update Progress: 631/2369 symbols completed. DMB took 0.9s. Estimated remaining: 4h 1m 38s. Rate: 7.2 symbols/min [2025-10-16T18:27:47.426938] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:27:47.439065] [DEBUG] [LOCAL ] DMO: Loaded 9967 existing records from primary storage. [2025-10-16T18:27:47.439292] [INFO ] [MAIN ] DMO: Loaded 9967 existing records. [2025-10-16T18:27:47.613437] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-16T18:27:47.633313] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:27:47.638607] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-16T18:27:47.638993] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-16T18:27:47.639187] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-16T18:27:47.639243] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-16T18:27:47.954432] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-16T18:27:47.994402] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:27:48.742806] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-16T18:27:49.162912] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T18:27:49.166179] [INFO ] [REMOTE ] DLX: Full fetch complete (41308 records). [2025-10-16T18:27:49.166268] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-16T18:27:49.481781] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T18:27:49.548090] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-16T18:27:49.549623] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-16T18:27:49.549709] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-16T18:27:49.550376] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-16T18:27:49.550520] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-16T18:27:49.551563] [DEBUG] [LOCAL ] DLX: Trimmed 41308 records to 28520 (keeping 200 days of data) [2025-10-16T18:27:49.723067] [DEBUG] [LOCAL ] DLX: Primary data saved (28520 records). [2025-10-16T18:27:49.723235] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-16T18:27:49.723330] [INFO ] [MAIN ] Update Progress: 632/2369 symbols completed. DLX took 30.9s. Estimated remaining: 4h 1m 13s. Rate: 7.2 symbols/min [2025-10-16T18:27:49.893081] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:27:49.893232] [DEBUG] [LOCAL ] DNA: No existing data file found in primary storage. [2025-10-16T18:27:49.893286] [WARN ] [MAIN ] DNA: No existing data found, performing full refresh instead. [2025-10-16T18:27:49.893392] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-16T18:27:49.893441] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-16T18:27:49.893482] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-10-16T18:27:49.893517] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-16T18:27:50.249122] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:27:50.342773] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-16T18:27:50.351883] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T18:27:51.142802] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-16T18:27:51.942785] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-16T18:27:52.001319] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-16T18:27:52.125874] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T18:27:52.640339] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-16T18:27:52.742880] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-16T18:27:53.542820] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-16T18:27:54.342817] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-16T18:27:54.399882] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T18:27:54.401999] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T18:27:54.787392] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-16T18:27:55.142816] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-16T18:27:55.942447] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T18:27:55.943269] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-16T18:27:56.742834] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-16T18:27:57.153846] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T18:27:57.542826] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-16T18:27:58.148292] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-16T18:27:58.342790] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-16T18:27:58.390240] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T18:27:58.940699] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T18:27:59.142862] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-16T18:27:59.942815] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-16T18:28:00.051989] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T18:28:00.055966] [INFO ] [REMOTE ] DLY: Full fetch complete (28557 records). [2025-10-16T18:28:00.056068] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-16T18:28:00.425768] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-16T18:28:00.425842] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-16T18:28:00.426385] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-16T18:28:00.426443] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-16T18:28:00.427107] [DEBUG] [LOCAL ] DLY: Trimmed 28557 records to 20735 (keeping 200 days of data) [2025-10-16T18:28:00.552825] [DEBUG] [LOCAL ] DLY: Primary data saved (20735 records). [2025-10-16T18:28:00.552945] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-16T18:28:00.553015] [INFO ] [MAIN ] Update Progress: 633/2369 symbols completed. DLY took 39.3s. Estimated remaining: 4h 1m 12s. Rate: 7.2 symbols/min [2025-10-16T18:28:00.726675] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:28:00.747502] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-16T18:28:00.766803] [DEBUG] [LOCAL ] DNOW: Loaded 43750 existing records from primary storage. [2025-10-16T18:28:00.767120] [INFO ] [MAIN ] DNOW: Loaded 43750 existing records. [2025-10-16T18:28:00.948080] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:28:00.955283] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-16T18:28:00.955360] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-16T18:28:00.955581] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T18:28:00.959003] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-16T18:28:00.959077] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-16T18:28:01.311542] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:28:01.542845] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-16T18:28:01.547441] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T18:28:01.549965] [INFO ] [REMOTE ] DMA: Full fetch complete (6730 records). [2025-10-16T18:28:01.550055] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-16T18:28:01.903439] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-16T18:28:01.903513] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-16T18:28:01.903717] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-16T18:28:01.903777] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-16T18:28:01.904150] [DEBUG] [LOCAL ] DMA: Trimmed 6730 records to 4772 (keeping 200 days of data) [2025-10-16T18:28:01.932866] [DEBUG] [LOCAL ] DMA: Primary data saved (4772 records). [2025-10-16T18:28:01.933010] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-16T18:28:01.933083] [INFO ] [MAIN ] Update Progress: 634/2369 symbols completed. DMA took 39.2s. Estimated remaining: 4h 0m 44s. Rate: 7.2 symbols/min [2025-10-16T18:28:02.100614] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:28:02.132731] [DEBUG] [LOCAL ] DNP: Loaded 33232 existing records from primary storage. [2025-10-16T18:28:02.133022] [INFO ] [MAIN ] DNP: Loaded 33232 existing records. [2025-10-16T18:28:02.308036] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:28:02.308235] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-16T18:28:02.308307] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-16T18:28:02.309061] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-16T18:28:02.309134] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-16T18:28:02.351129] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-16T18:28:02.664845] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:28:03.142852] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-16T18:28:03.162806] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T18:28:03.367227] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T18:28:03.942807] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-16T18:28:04.596284] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T18:28:04.742812] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-16T18:28:05.410444] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-16T18:28:05.548941] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-16T18:28:05.568314] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T18:28:06.342832] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-16T18:28:06.816615] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T18:28:07.142888] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-16T18:28:07.154703] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T18:28:07.942895] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-16T18:28:08.662147] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T18:28:08.706433] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T18:28:08.742816] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-16T18:28:09.482410] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T18:28:09.484094] [INFO ] [REMOTE ] DMO: Full fetch complete (14523 records). [2025-10-16T18:28:09.484180] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-16T18:28:09.547954] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-16T18:28:09.847222] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-16T18:28:09.847311] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-16T18:28:09.847681] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-16T18:28:09.847746] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-16T18:28:09.848466] [DEBUG] [LOCAL ] DMO: Trimmed 14523 records to 9999 (keeping 200 days of data) [2025-10-16T18:28:09.909967] [DEBUG] [LOCAL ] DMO: Primary data saved (9999 records). [2025-10-16T18:28:09.910110] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-16T18:28:09.910192] [INFO ] [MAIN ] Update Progress: 635/2369 symbols completed. DMO took 22.7s. Estimated remaining: 4h 0m 35s. Rate: 7.2 symbols/min [2025-10-16T18:28:10.079562] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:28:10.130475] [DEBUG] [LOCAL ] DOC: Loaded 53554 existing records from primary storage. [2025-10-16T18:28:10.130812] [INFO ] [MAIN ] DOC: Loaded 53554 existing records. [2025-10-16T18:28:10.306054] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:28:10.306278] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-16T18:28:10.306324] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-16T18:28:10.306525] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-16T18:28:10.306580] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-16T18:28:10.348056] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-16T18:28:10.653233] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:28:11.060820] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T18:28:11.142812] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-16T18:28:11.904109] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T18:28:11.942777] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-16T18:28:12.366961] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T18:28:12.742796] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-16T18:28:13.513813] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T18:28:13.542784] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-16T18:28:13.764362] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T18:28:14.342824] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-16T18:28:14.995214] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T18:28:15.142778] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-16T18:28:15.752802] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T18:28:15.942813] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-16T18:28:16.601999] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:28:16.742812] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-16T18:28:17.542819] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-16T18:28:17.837511] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T18:28:18.186241] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T18:28:18.342816] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-16T18:28:18.608610] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-16T18:28:19.142884] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-16T18:28:19.942890] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-16T18:28:20.261116] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T18:28:20.742791] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-16T18:28:20.863813] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T18:28:20.940104] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T18:28:21.542838] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-16T18:28:22.342778] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-16T18:28:22.513719] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T18:28:23.142826] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-16T18:28:23.319949] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T18:28:23.360306] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-16T18:28:23.942888] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-16T18:28:24.742884] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-16T18:28:24.801488] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-16T18:28:25.542827] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-16T18:28:25.731563] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T18:28:26.342900] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-16T18:28:27.142478] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T18:28:27.152748] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-16T18:28:27.942840] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-16T18:28:28.408801] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-16T18:28:28.481782] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T18:28:28.742882] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-16T18:28:29.542836] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-16T18:28:29.894579] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (5.15 seconds). [2025-10-16T18:28:29.952702] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T18:28:30.342843] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-16T18:28:30.643044] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-16T18:28:30.847738] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T18:28:31.142809] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-16T18:28:31.611711] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T18:28:31.942810] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-16T18:28:32.144077] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T18:28:32.148374] [INFO ] [REMOTE ] DNP: Full fetch complete (48870 records). [2025-10-16T18:28:32.148473] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-16T18:28:32.516171] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-16T18:28:32.516249] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-16T18:28:32.516967] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-16T18:28:32.517042] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-16T18:28:32.518230] [DEBUG] [LOCAL ] DNP: Trimmed 48870 records to 33479 (keeping 200 days of data) [2025-10-16T18:28:32.722607] [DEBUG] [LOCAL ] DNP: Primary data saved (33479 records). [2025-10-16T18:28:32.722765] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-16T18:28:32.722849] [INFO ] [MAIN ] Update Progress: 636/2369 symbols completed. DNP took 30.8s. Estimated remaining: 4h 1m 6s. Rate: 7.2 symbols/min [2025-10-16T18:28:32.747958] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-16T18:28:32.905504] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:28:32.905682] [DEBUG] [LOCAL ] DOCN: No existing data file found in primary storage. [2025-10-16T18:28:32.905740] [WARN ] [MAIN ] DOCN: No existing data found, performing full refresh instead. [2025-10-16T18:28:32.905863] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-16T18:28:32.905938] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-16T18:28:32.906000] [DEBUG] [LOCAL ] DOCN: No primary data file found to delete. [2025-10-16T18:28:32.906048] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-16T18:28:33.289291] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:28:33.542832] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-16T18:28:34.083689] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-16T18:28:34.090200] [INFO ] [REMOTE ] DNA: Full fetch complete (71278 records). [2025-10-16T18:28:34.090332] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-16T18:28:34.342853] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-16T18:28:34.483251] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-16T18:28:34.483353] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-16T18:28:34.484372] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-16T18:28:34.484486] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-16T18:28:34.512733] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T18:28:34.511490] [DEBUG] [LOCAL ] DNA: Trimmed 71278 records to 48954 (keeping 200 days of data) [2025-10-16T18:28:34.796555] [DEBUG] [LOCAL ] DNA: Primary data saved (48954 records). [2025-10-16T18:28:34.796801] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-16T18:28:34.796925] [INFO ] [MAIN ] Update Progress: 637/2369 symbols completed. DNA took 45.1s. Estimated remaining: 4h 0m 41s. Rate: 7.2 symbols/min [2025-10-16T18:28:34.821545] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T18:28:35.142821] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-16T18:28:35.942849] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-16T18:28:36.217892] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T18:28:36.473181] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T18:28:36.742839] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-16T18:28:37.442434] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T18:28:37.542848] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-16T18:28:38.224784] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T18:28:38.342768] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-16T18:28:39.073577] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T18:28:39.142776] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-16T18:28:39.836425] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T18:28:39.942790] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-16T18:28:40.742795] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-16T18:28:40.823113] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T18:28:40.829064] [INFO ] [REMOTE ] DNOW: Full fetch complete (63344 records). [2025-10-16T18:28:40.829179] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-16T18:28:41.214718] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-16T18:28:41.214825] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-16T18:28:41.215748] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-16T18:28:41.215813] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-16T18:28:41.217167] [DEBUG] [LOCAL ] DNOW: Trimmed 63344 records to 44124 (keeping 200 days of data) [2025-10-16T18:28:41.471947] [DEBUG] [LOCAL ] DNOW: Primary data saved (44124 records). [2025-10-16T18:28:41.472075] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-16T18:28:41.472151] [INFO ] [MAIN ] Update Progress: 638/2369 symbols completed. DNOW took 40.9s. Estimated remaining: 4h 0m 28s. Rate: 7.2 symbols/min [2025-10-16T18:28:42.003705] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-16T18:28:42.014914] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-16T18:28:42.687555] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-16T18:28:42.698236] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-16T18:28:43.949266] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-16T18:28:43.956191] [INFO ] [REMOTE ] DOC: Full fetch complete (77570 records). [2025-10-16T18:28:43.956310] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-16T18:28:44.351264] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-16T18:28:44.351403] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-16T18:28:44.352543] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-16T18:28:44.362301] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-16T18:28:44.381233] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T18:28:44.392918] [DEBUG] [LOCAL ] DOC: Trimmed 77570 records to 53944 (keeping 200 days of data) [2025-10-16T18:28:44.392820] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-16T18:28:44.725902] [DEBUG] [LOCAL ] DOC: Primary data saved (53944 records). [2025-10-16T18:28:44.726350] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-16T18:28:44.726451] [INFO ] [MAIN ] Update Progress: 639/2369 symbols completed. DOC took 34.8s. Estimated remaining: 4h 0m 6s. Rate: 7.2 symbols/min [2025-10-16T18:28:46.261394] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-16T18:28:46.271937] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-16T18:28:48.113177] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T18:28:48.129102] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-16T18:28:49.963914] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T18:28:49.975343] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-16T18:28:51.776419] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-16T18:28:51.787869] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-16T18:28:53.745807] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T18:28:53.752491] [INFO ] [REMOTE ] DOCN: Full fetch complete (72657 records). [2025-10-16T18:28:53.752616] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-16T18:28:54.133595] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-16T18:28:54.133704] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-16T18:28:54.134608] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-16T18:28:54.134677] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-16T18:28:54.136211] [DEBUG] [LOCAL ] DOCN: Trimmed 72657 records to 51421 (keeping 200 days of data) [2025-10-16T18:28:54.435309] [DEBUG] [LOCAL ] DOCN: Primary data saved (51421 records). [2025-10-16T18:28:54.435453] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-16T18:28:54.435526] [INFO ] [MAIN ] Update Progress: 640/2369 symbols completed. DOCN took 21.7s. Estimated remaining: 4h 0m 1s. Rate: 7.2 symbols/min [2025-10-16T18:28:54.965703] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:28:55.086242] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:28:55.072937] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:28:55.145516] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:28:55.178476] [DEBUG] [LOCAL ] DOUG: Loaded 34244 existing records from primary storage. [2025-10-16T18:28:55.179076] [INFO ] [MAIN ] DOUG: Loaded 34244 existing records. [2025-10-16T18:28:55.366445] [DEBUG] [LOCAL ] DOV: Loaded 45611 existing records from primary storage. [2025-10-16T18:28:55.385382] [INFO ] [MAIN ] DOV: Loaded 45611 existing records. [2025-10-16T18:28:55.480932] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:28:55.475457] [DEBUG] [LOCAL ] DOLE: Loaded 39209 existing records from primary storage. [2025-10-16T18:28:55.501586] [DEBUG] [LOCAL ] DOCS: Loaded 50742 existing records from primary storage. [2025-10-16T18:28:55.521395] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-16T18:28:55.532082] [INFO ] [MAIN ] DOLE: Loaded 39209 existing records. [2025-10-16T18:28:55.531968] [INFO ] [MAIN ] DOCS: Loaded 50742 existing records. [2025-10-16T18:28:55.526720] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-16T18:28:55.557180] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-16T18:28:55.628574] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-16T18:28:55.879254] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:28:55.916219] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-16T18:28:55.975889] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-16T18:28:56.050258] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:28:56.069319] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-16T18:28:56.069462] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-16T18:28:56.100327] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-16T18:28:56.069784] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-16T18:28:56.153425] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-16T18:28:56.193032] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-16T18:28:56.261109] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:28:56.463379] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-16T18:28:56.479076] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-16T18:28:56.499384] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-16T18:28:56.515619] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-16T18:28:56.777306] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:28:56.828425] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-16T18:28:57.304292] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:28:57.361526] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:28:57.369424] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-16T18:28:57.399192] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-16T18:28:57.479997] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:28:57.480285] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-16T18:28:58.479982] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-16T18:28:58.487015] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-16T18:28:58.535562] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T18:28:58.544686] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-16T18:28:58.636088] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T18:28:58.644464] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-16T18:28:58.762353] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T18:28:58.772738] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-16T18:28:59.447130] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T18:28:59.454579] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-16T18:28:59.876195] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T18:28:59.884000] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-16T18:28:59.908495] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T18:28:59.918476] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-16T18:29:00.418171] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T18:29:00.428339] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-16T18:29:00.445784] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T18:29:00.452277] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-16T18:29:01.216233] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T18:29:01.223781] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-16T18:29:01.247310] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T18:29:01.255590] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-16T18:29:01.500107] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T18:29:01.507970] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-16T18:29:02.316584] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-16T18:29:02.326513] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-16T18:29:02.541272] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T18:29:02.552113] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-16T18:29:02.605255] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T18:29:02.614101] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-16T18:29:02.646615] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T18:29:02.656407] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-16T18:29:03.835367] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T18:29:03.865744] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-16T18:29:03.867145] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T18:29:03.942774] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-16T18:29:04.033906] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T18:29:04.742850] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-16T18:29:04.788315] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-16T18:29:05.423616] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T18:29:05.541455] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T18:29:05.551483] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-16T18:29:05.892052] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T18:29:06.342799] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-16T18:29:07.142805] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-16T18:29:07.202215] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T18:29:07.413995] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T18:29:07.942869] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-16T18:29:08.469608] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T18:29:08.742839] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-16T18:29:09.497085] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T18:29:09.542840] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-16T18:29:10.074202] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T18:29:10.342818] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-16T18:29:11.142799] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-16T18:29:11.214795] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T18:29:11.583417] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T18:29:11.942820] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-16T18:29:12.742858] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-16T18:29:13.280946] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-16T18:29:13.350764] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T18:29:13.542803] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-16T18:29:13.964088] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T18:29:14.342863] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-16T18:29:15.142838] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-16T18:29:15.253574] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T18:29:15.942840] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-16T18:29:16.094901] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T18:29:16.127146] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T18:29:16.742831] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-16T18:29:17.318442] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T18:29:17.542811] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-16T18:29:18.225581] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T18:29:18.342794] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-16T18:29:18.944377] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-16T18:29:18.949875] [INFO ] [REMOTE ] DOUG: Full fetch complete (50450 records). [2025-10-16T18:29:18.950045] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-16T18:29:19.150694] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-16T18:29:19.360776] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-16T18:29:19.360864] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-16T18:29:19.361592] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-16T18:29:19.361635] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-16T18:29:19.362903] [DEBUG] [LOCAL ] DOUG: Trimmed 50450 records to 34428 (keeping 200 days of data) [2025-10-16T18:29:19.567790] [DEBUG] [LOCAL ] DOUG: Primary data saved (34428 records). [2025-10-16T18:29:19.567921] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-16T18:29:19.567999] [INFO ] [MAIN ] Update Progress: 641/2369 symbols completed. DOUG took 25.1s. Estimated remaining: 4h 0m 38s. Rate: 7.2 symbols/min [2025-10-16T18:29:19.735407] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:29:19.785096] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-16T18:29:19.785410] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-16T18:29:19.943901] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-16T18:29:19.968019] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:29:19.968408] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-16T18:29:19.968588] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-16T18:29:19.968988] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-16T18:29:19.969046] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-16T18:29:20.343540] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:29:20.355845] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T18:29:20.739773] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T18:29:20.748444] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-16T18:29:20.750218] [INFO ] [REMOTE ] DOLE: Full fetch complete (54631 records). [2025-10-16T18:29:20.750348] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-16T18:29:21.151100] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-16T18:29:21.151200] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-16T18:29:21.152137] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-16T18:29:21.152217] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-16T18:29:21.153462] [DEBUG] [LOCAL ] DOLE: Trimmed 54631 records to 39478 (keeping 200 days of data) [2025-10-16T18:29:21.396530] [DEBUG] [LOCAL ] DOLE: Primary data saved (39478 records). [2025-10-16T18:29:21.396708] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-16T18:29:21.396804] [INFO ] [MAIN ] Update Progress: 642/2369 symbols completed. DOLE took 26.9s. Estimated remaining: 4h 0m 12s. Rate: 7.2 symbols/min [2025-10-16T18:29:21.562793] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-16T18:29:21.590566] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:29:21.609202] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T18:29:21.615728] [INFO ] [REMOTE ] DOV: Full fetch complete (65837 records). [2025-10-16T18:29:21.616392] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-16T18:29:21.726296] [DEBUG] [LOCAL ] DPG: Loaded 13576 existing records from primary storage. [2025-10-16T18:29:21.732243] [INFO ] [MAIN ] DPG: Loaded 13576 existing records. [2025-10-16T18:29:22.118842] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:29:22.129382] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-16T18:29:22.146823] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-16T18:29:22.164230] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-16T18:29:22.182080] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-16T18:29:22.281452] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-16T18:29:22.297348] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-16T18:29:22.308610] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-16T18:29:22.314356] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-16T18:29:22.367913] [DEBUG] [LOCAL ] DOV: Trimmed 65837 records to 45966 (keeping 200 days of data) [2025-10-16T18:29:22.660788] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:29:22.661871] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-16T18:29:22.830387] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-16T18:29:22.904746] [DEBUG] [LOCAL ] DOV: Primary data saved (45966 records). [2025-10-16T18:29:22.904882] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-16T18:29:22.904963] [INFO ] [MAIN ] Update Progress: 643/2369 symbols completed. DOV took 28.4s. Estimated remaining: 3h 59m 46s. Rate: 7.2 symbols/min [2025-10-16T18:29:23.070184] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:29:23.110548] [DEBUG] [LOCAL ] DQ: Loaded 43738 existing records from primary storage. [2025-10-16T18:29:23.110867] [INFO ] [MAIN ] DQ: Loaded 43738 existing records. [2025-10-16T18:29:23.153598] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-16T18:29:23.292726] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:29:23.292937] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-16T18:29:23.292991] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-16T18:29:23.293262] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-16T18:29:23.293372] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-16T18:29:23.421786] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-16T18:29:23.643210] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T18:29:23.702723] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:29:23.942811] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-16T18:29:24.742842] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-16T18:29:25.012506] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T18:29:25.325901] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T18:29:25.331478] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T18:29:25.542813] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-16T18:29:26.342822] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-16T18:29:26.962727] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T18:29:27.142843] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-16T18:29:27.942839] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-16T18:29:28.169053] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-16T18:29:28.724990] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T18:29:28.742763] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-16T18:29:28.887457] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T18:29:28.893801] [INFO ] [REMOTE ] DOCS: Full fetch complete (74031 records). [2025-10-16T18:29:28.893911] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-16T18:29:29.279995] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-16T18:29:29.280092] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-16T18:29:29.281165] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-16T18:29:29.281230] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-16T18:29:29.282606] [DEBUG] [LOCAL ] DOCS: Trimmed 74031 records to 51081 (keeping 200 days of data) [2025-10-16T18:29:29.496296] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-16T18:29:29.557002] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-16T18:29:29.595395] [DEBUG] [LOCAL ] DOCS: Primary data saved (51081 records). [2025-10-16T18:29:29.595525] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-16T18:29:29.596747] [INFO ] [MAIN ] Update Progress: 644/2369 symbols completed. DOCS took 35.2s. Estimated remaining: 3h 59m 33s. Rate: 7.2 symbols/min [2025-10-16T18:29:29.790640] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:29:29.829638] [DEBUG] [LOCAL ] DRD: Loaded 37717 existing records from primary storage. [2025-10-16T18:29:29.829951] [INFO ] [MAIN ] DRD: Loaded 37717 existing records. [2025-10-16T18:29:30.002889] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:29:30.003081] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-16T18:29:30.003128] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-16T18:29:30.003335] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-16T18:29:30.003390] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-16T18:29:30.347140] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:29:30.347237] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-16T18:29:31.142873] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-16T18:29:31.225555] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T18:29:31.278629] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-16T18:29:31.942865] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-16T18:29:32.287987] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T18:29:32.742809] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-16T18:29:32.821945] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T18:29:33.542852] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-16T18:29:33.910719] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T18:29:34.342817] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-16T18:29:34.465883] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T18:29:35.142815] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-16T18:29:35.900963] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T18:29:35.942766] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-16T18:29:36.075754] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T18:29:36.742882] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-16T18:29:37.502999] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T18:29:37.542768] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-16T18:29:38.342804] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-16T18:29:38.471993] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T18:29:38.976934] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T18:29:39.142780] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-16T18:29:39.250807] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T18:29:39.942849] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-16T18:29:40.588203] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T18:29:40.742893] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-16T18:29:40.808177] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T18:29:41.542890] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-16T18:29:42.342861] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-16T18:29:42.905033] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-16T18:29:43.071934] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T18:29:43.142774] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-16T18:29:43.258755] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T18:29:43.942841] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-16T18:29:44.709928] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-16T18:29:44.712795] [INFO ] [REMOTE ] DPG: Full fetch complete (19051 records). [2025-10-16T18:29:44.712919] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-16T18:29:44.746574] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-16T18:29:44.900613] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T18:29:45.152271] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-16T18:29:45.152399] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-16T18:29:45.153504] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-16T18:29:45.153584] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-16T18:29:45.154825] [DEBUG] [LOCAL ] DPG: Trimmed 19051 records to 13660 (keeping 200 days of data) [2025-10-16T18:29:45.244226] [DEBUG] [LOCAL ] DPG: Primary data saved (13660 records). [2025-10-16T18:29:45.244431] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-16T18:29:45.244531] [INFO ] [MAIN ] Update Progress: 645/2369 symbols completed. DPG took 23.8s. Estimated remaining: 3h 59m 44s. Rate: 7.2 symbols/min [2025-10-16T18:29:45.429247] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:29:45.480364] [DEBUG] [LOCAL ] DRH: Loaded 50410 existing records from primary storage. [2025-10-16T18:29:45.481077] [INFO ] [MAIN ] DRH: Loaded 50410 existing records. [2025-10-16T18:29:45.550133] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-16T18:29:45.670986] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:29:45.671195] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-16T18:29:45.671244] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-16T18:29:45.671463] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-16T18:29:45.671520] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-16T18:29:46.010679] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:29:46.342878] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-16T18:29:46.817185] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-16T18:29:47.145445] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-16T18:29:47.148434] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-16T18:29:47.852825] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T18:29:47.942886] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-16T18:29:48.509436] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T18:29:48.742804] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-16T18:29:48.972048] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T18:29:49.542852] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-16T18:29:50.342822] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-16T18:29:50.805142] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-16T18:29:51.007894] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T18:29:51.142780] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-16T18:29:51.529900] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T18:29:51.942804] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-16T18:29:52.399451] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-16T18:29:52.742885] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-16T18:29:53.542862] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-16T18:29:54.199099] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-16T18:29:54.342784] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-16T18:29:54.465176] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T18:29:54.471300] [INFO ] [REMOTE ] DQ: Full fetch complete (63576 records). [2025-10-16T18:29:54.471411] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-16T18:29:54.852588] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-16T18:29:54.852709] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-16T18:29:54.853600] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-16T18:29:54.853692] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-16T18:29:54.854938] [DEBUG] [LOCAL ] DQ: Trimmed 63576 records to 44086 (keeping 200 days of data) [2025-10-16T18:29:55.109306] [DEBUG] [LOCAL ] DQ: Primary data saved (44086 records). [2025-10-16T18:29:55.109463] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-16T18:29:55.110119] [INFO ] [MAIN ] Update Progress: 646/2369 symbols completed. DQ took 32.2s. Estimated remaining: 3h 59m 40s. Rate: 7.2 symbols/min [2025-10-16T18:29:55.152273] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-16T18:29:55.293371] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:29:55.312539] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T18:29:55.367136] [DEBUG] [LOCAL ] DRI: Loaded 47693 existing records from primary storage. [2025-10-16T18:29:55.367433] [INFO ] [MAIN ] DRI: Loaded 47693 existing records. [2025-10-16T18:29:55.540829] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:29:55.541045] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-16T18:29:55.541092] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-16T18:29:55.541275] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-16T18:29:55.541313] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-16T18:29:55.887249] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:29:55.942773] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-16T18:29:56.489930] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-16T18:29:56.521211] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T18:29:56.742845] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-16T18:29:57.278324] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T18:29:57.542842] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-16T18:29:58.189949] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T18:29:58.342828] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-16T18:29:59.142885] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-16T18:29:59.371197] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T18:29:59.942823] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-16T18:30:00.150275] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T18:30:00.418472] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-16T18:30:00.742799] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-16T18:30:01.542789] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-16T18:30:01.871768] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-16T18:30:02.342859] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-16T18:30:02.945971] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T18:30:03.142804] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-16T18:30:03.633505] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.89 seconds). [2025-10-16T18:30:03.640587] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-16T18:30:03.640787] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-16T18:30:03.947951] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-16T18:30:04.025431] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-16T18:30:04.025521] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-16T18:30:04.026535] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-16T18:30:04.026602] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-16T18:30:04.028105] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 54123 (keeping 200 days of data) [2025-10-16T18:30:04.276973] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T18:30:04.398882] [DEBUG] [LOCAL ] DOW: Primary data saved (54123 records). [2025-10-16T18:30:04.399034] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-16T18:30:04.399121] [INFO ] [MAIN ] Update Progress: 647/2369 symbols completed. DOW took 44.8s. Estimated remaining: 3h 59m 34s. Rate: 7.2 symbols/min [2025-10-16T18:30:04.581154] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:30:04.592615] [DEBUG] [LOCAL ] DRLL: Loaded 9148 existing records from primary storage. [2025-10-16T18:30:04.592877] [INFO ] [MAIN ] DRLL: Loaded 9148 existing records. [2025-10-16T18:30:04.749333] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-16T18:30:04.812334] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T18:30:04.809856] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:30:04.822508] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-16T18:30:04.822758] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-16T18:30:04.823252] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-16T18:30:04.823318] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-16T18:30:05.181254] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:30:05.485388] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T18:30:05.542815] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-16T18:30:06.267605] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T18:30:06.342821] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-16T18:30:06.724016] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T18:30:07.142800] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-16T18:30:07.912922] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-16T18:30:07.942785] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-16T18:30:08.075814] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T18:30:08.742864] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-16T18:30:09.542837] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-16T18:30:09.916240] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-16T18:30:09.921683] [INFO ] [REMOTE ] DRD: Full fetch complete (51075 records). [2025-10-16T18:30:09.921789] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-16T18:30:09.922487] [FATAL] [VALIDATOR ] DRD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:30:09.922586] [FATAL] [MAIN ] DRD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:30:09.922687] [WARN ] [MAIN ] DRD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:30:09.922776] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-16T18:30:09.922851] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-10-16T18:30:09.922902] [INFO ] [LOCAL ] DRD: Starting deletion of derivative data. [2025-10-16T18:30:09.923084] [DEBUG] [LOCAL ] DRD: Deleted derivative data file. [2025-10-16T18:30:09.923615] [INFO ] [MAIN ] Update Progress: 648/2369 symbols completed. DRD took 40.3s. Estimated remaining: 3h 59m 18s. Rate: 7.2 symbols/min [2025-10-16T18:30:10.090088] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:30:10.121676] [DEBUG] [LOCAL ] DSL: Loaded 28822 existing records from primary storage. [2025-10-16T18:30:10.121983] [INFO ] [MAIN ] DSL: Loaded 28822 existing records. [2025-10-16T18:30:10.297549] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:30:10.297841] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-16T18:30:10.297938] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-16T18:30:10.298261] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-16T18:30:10.298322] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-16T18:30:10.352452] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-16T18:30:10.617905] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-16T18:30:10.702261] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:30:11.015214] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T18:30:11.021210] [INFO ] [REMOTE ] DRH: Full fetch complete (71742 records). [2025-10-16T18:30:11.021321] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-16T18:30:11.022102] [FATAL] [VALIDATOR ] DRH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:30:11.022198] [FATAL] [MAIN ] DRH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:30:11.022271] [WARN ] [MAIN ] DRH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:30:11.022358] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-16T18:30:11.022434] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-16T18:30:11.022477] [INFO ] [LOCAL ] DRH: Starting deletion of derivative data. [2025-10-16T18:30:11.022707] [DEBUG] [LOCAL ] DRH: Deleted derivative data file. [2025-10-16T18:30:11.023289] [INFO ] [MAIN ] Update Progress: 649/2369 symbols completed. DRH took 25.8s. Estimated remaining: 3h 58m 51s. Rate: 7.2 symbols/min [2025-10-16T18:30:11.143012] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-16T18:30:11.148518] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T18:30:11.207611] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:30:11.222618] [DEBUG] [LOCAL ] DSM: Loaded 14125 existing records from primary storage. [2025-10-16T18:30:11.222882] [INFO ] [MAIN ] DSM: Loaded 14125 existing records. [2025-10-16T18:30:11.394517] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:30:11.394768] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-16T18:30:11.394826] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-16T18:30:11.394985] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-16T18:30:11.395041] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-16T18:30:11.743064] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:30:11.942792] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-16T18:30:12.548102] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T18:30:12.590930] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-16T18:30:12.742787] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-16T18:30:13.542794] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-16T18:30:13.943850] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T18:30:14.342816] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-16T18:30:14.435260] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T18:30:15.142806] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-16T18:30:15.942837] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-16T18:30:15.967910] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T18:30:16.000621] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T18:30:16.742803] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-16T18:30:17.168378] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T18:30:17.337855] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-16T18:30:17.542855] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-16T18:30:18.342811] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-16T18:30:19.142807] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-16T18:30:19.942798] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-16T18:30:20.137384] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T18:30:20.211696] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-16T18:30:20.330787] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T18:30:20.411594] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T18:30:20.742796] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-16T18:30:21.542809] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-16T18:30:21.685707] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T18:30:22.342852] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-16T18:30:22.855821] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-16T18:30:22.966497] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T18:30:23.142809] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-16T18:30:23.942859] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-16T18:30:24.573726] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-16T18:30:24.747874] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-16T18:30:24.760591] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T18:30:25.542816] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-16T18:30:25.972057] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T18:30:26.342825] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-16T18:30:26.768987] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T18:30:27.142815] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-16T18:30:27.766444] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T18:30:27.942809] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-16T18:30:28.264374] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T18:30:28.742780] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-16T18:30:28.930348] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T18:30:29.542823] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-16T18:30:29.731984] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T18:30:30.342814] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-16T18:30:30.625971] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T18:30:31.142810] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-16T18:30:31.252068] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T18:30:31.942894] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-16T18:30:32.023105] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T18:30:32.024578] [INFO ] [REMOTE ] DRLL: Full fetch complete (14707 records). [2025-10-16T18:30:32.024668] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-16T18:30:32.025180] [FATAL] [VALIDATOR ] DRLL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:30:32.025270] [FATAL] [MAIN ] DRLL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:30:32.025328] [WARN ] [MAIN ] DRLL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:30:32.025369] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-16T18:30:32.025494] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-16T18:30:32.025549] [INFO ] [LOCAL ] DRLL: Starting deletion of derivative data. [2025-10-16T18:30:32.025709] [DEBUG] [LOCAL ] DRLL: Deleted derivative data file. [2025-10-16T18:30:32.025800] [INFO ] [MAIN ] Update Progress: 650/2369 symbols completed. DRLL took 27.6s. Estimated remaining: 3h 59m 16s. Rate: 7.2 symbols/min [2025-10-16T18:30:32.192579] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:30:32.196831] [DEBUG] [LOCAL ] DSMC: Loaded 1837 existing records from primary storage. [2025-10-16T18:30:32.196987] [INFO ] [MAIN ] DSMC: Loaded 1837 existing records. [2025-10-16T18:30:32.368951] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:30:32.369133] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-16T18:30:32.369183] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-16T18:30:32.369310] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-16T18:30:32.369348] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-16T18:30:32.746825] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-16T18:30:32.755929] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:30:32.824345] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T18:30:33.542792] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-16T18:30:33.777970] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T18:30:34.342888] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-16T18:30:34.900786] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T18:30:35.142805] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-16T18:30:35.189707] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T18:30:35.942842] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-16T18:30:36.505733] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T18:30:36.510024] [INFO ] [REMOTE ] DSL: Full fetch complete (41450 records). [2025-10-16T18:30:36.510190] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-16T18:30:36.510888] [FATAL] [VALIDATOR ] DSL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:30:36.511005] [FATAL] [MAIN ] DSL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:30:36.511082] [WARN ] [MAIN ] DSL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:30:36.511177] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-16T18:30:36.511256] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-10-16T18:30:36.511293] [INFO ] [LOCAL ] DSL: Starting deletion of derivative data. [2025-10-16T18:30:36.511409] [DEBUG] [LOCAL ] DSL: Deleted derivative data file. [2025-10-16T18:30:36.511497] [INFO ] [MAIN ] Update Progress: 651/2369 symbols completed. DSL took 26.6s. Estimated remaining: 3h 58m 57s. Rate: 7.2 symbols/min [2025-10-16T18:30:36.696099] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:30:36.719806] [DEBUG] [LOCAL ] DSU: Loaded 23007 existing records from primary storage. [2025-10-16T18:30:36.720088] [INFO ] [MAIN ] DSU: Loaded 23007 existing records. [2025-10-16T18:30:36.753999] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-16T18:30:36.922960] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:30:36.923218] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-16T18:30:36.923280] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-16T18:30:36.923469] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-16T18:30:36.923538] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-16T18:30:37.312030] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:30:37.316587] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-16T18:30:37.542787] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-16T18:30:37.584945] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T18:30:38.343011] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-16T18:30:38.918427] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T18:30:39.144628] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-16T18:30:39.145545] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-16T18:30:39.942802] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-16T18:30:40.248751] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T18:30:40.375521] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-16T18:30:40.742805] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-16T18:30:41.510469] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T18:30:41.542825] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-16T18:30:42.342789] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-16T18:30:42.608124] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-16T18:30:43.142843] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-16T18:30:43.207538] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-16T18:30:43.942855] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-16T18:30:44.727707] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T18:30:44.729508] [INFO ] [REMOTE ] DSM: Full fetch complete (23904 records). [2025-10-16T18:30:44.729579] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-16T18:30:44.750110] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-16T18:30:45.149552] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-16T18:30:45.151597] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T18:30:45.150130] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-16T18:30:45.162958] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-16T18:30:45.163522] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-16T18:30:45.164869] [DEBUG] [LOCAL ] DSM: Trimmed 23904 records to 14194 (keeping 200 days of data) [2025-10-16T18:30:45.264839] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-16T18:30:45.270109] [DEBUG] [LOCAL ] DSM: Primary data saved (14194 records). [2025-10-16T18:30:45.270281] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-16T18:30:45.270373] [INFO ] [MAIN ] Update Progress: 652/2369 symbols completed. DSM took 34.2s. Estimated remaining: 3h 58m 50s. Rate: 7.2 symbols/min [2025-10-16T18:30:45.470135] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:30:45.495164] [DEBUG] [LOCAL ] DSX: Loaded 23924 existing records from primary storage. [2025-10-16T18:30:45.495467] [INFO ] [MAIN ] DSX: Loaded 23924 existing records. [2025-10-16T18:30:45.548021] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-16T18:30:45.695246] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:30:45.695507] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-16T18:30:45.695558] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-16T18:30:45.695802] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-16T18:30:45.695861] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-16T18:30:46.046690] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:30:46.342888] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-16T18:30:47.142869] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-16T18:30:47.423588] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-16T18:30:47.534015] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T18:30:47.901399] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T18:30:47.942776] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-16T18:30:48.742780] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-16T18:30:49.063840] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T18:30:49.306710] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T18:30:49.542812] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-16T18:30:49.904423] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-16T18:30:50.342858] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-16T18:30:51.142821] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-16T18:30:51.585181] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-16T18:30:51.600491] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T18:30:51.942863] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-16T18:30:52.742826] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-16T18:30:52.769313] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T18:30:52.775373] [INFO ] [REMOTE ] DRI: Full fetch complete (69172 records). [2025-10-16T18:30:52.775539] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-16T18:30:52.776529] [FATAL] [VALIDATOR ] DRI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:30:52.776685] [FATAL] [MAIN ] DRI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:30:52.776952] [WARN ] [MAIN ] DRI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:30:52.777045] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-16T18:30:52.777130] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-16T18:30:52.777169] [INFO ] [LOCAL ] DRI: Starting deletion of derivative data. [2025-10-16T18:30:52.777332] [DEBUG] [LOCAL ] DRI: Deleted derivative data file. [2025-10-16T18:30:52.778223] [INFO ] [MAIN ] Update Progress: 653/2369 symbols completed. DRI took 57.7s. Estimated remaining: 3h 58m 40s. Rate: 7.2 symbols/min [2025-10-16T18:30:52.956469] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:30:52.956678] [DEBUG] [LOCAL ] DT: No existing data file found in primary storage. [2025-10-16T18:30:52.956733] [WARN ] [MAIN ] DT: No existing data found, performing full refresh instead. [2025-10-16T18:30:52.956875] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-16T18:30:52.956949] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-16T18:30:52.957012] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-10-16T18:30:52.957048] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-16T18:30:53.215070] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-16T18:30:53.357295] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:30:53.542870] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-16T18:30:54.342883] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-16T18:30:55.149574] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-16T18:30:55.156398] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T18:30:55.459591] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T18:30:55.509124] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-16T18:30:55.942789] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-16T18:30:56.742827] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-16T18:30:57.099190] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T18:30:57.542834] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-16T18:30:57.789139] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-16T18:30:58.342801] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-16T18:30:58.561861] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-16T18:30:59.142782] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-16T18:30:59.274893] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-16T18:30:59.669518] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-16T18:30:59.942818] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-16T18:31:00.742836] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-16T18:31:01.354637] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-16T18:31:01.548007] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-16T18:31:01.558815] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T18:31:02.050692] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-16T18:31:02.051489] [INFO ] [REMOTE ] DSMC: Full fetch complete (2849 records). [2025-10-16T18:31:02.051578] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-16T18:31:02.052016] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:31:02.052100] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:31:02.052144] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:31:02.052210] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-16T18:31:02.052272] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-16T18:31:02.052307] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-10-16T18:31:02.052556] [DEBUG] [LOCAL ] DSMC: Deleted derivative data file. [2025-10-16T18:31:02.052671] [INFO ] [MAIN ] Update Progress: 654/2369 symbols completed. DSMC took 30.0s. Estimated remaining: 3h 58m 34s. Rate: 7.2 symbols/min [2025-10-16T18:31:02.222555] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:02.230220] [DEBUG] [LOCAL ] DTB: Loaded 5012 existing records from primary storage. [2025-10-16T18:31:02.230421] [INFO ] [MAIN ] DTB: Loaded 5012 existing records. [2025-10-16T18:31:02.347996] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-16T18:31:02.408633] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:31:02.408866] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-16T18:31:02.408916] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-16T18:31:02.409176] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-16T18:31:02.409232] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-16T18:31:02.763565] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:03.142807] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-16T18:31:03.730550] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T18:31:03.733998] [INFO ] [REMOTE ] DSU: Full fetch complete (33124 records). [2025-10-16T18:31:03.734142] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-16T18:31:03.948036] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-16T18:31:04.121174] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-16T18:31:04.121261] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-16T18:31:04.121953] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-16T18:31:04.122031] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-16T18:31:04.123015] [DEBUG] [LOCAL ] DSU: Trimmed 33124 records to 23202 (keeping 200 days of data) [2025-10-16T18:31:04.265941] [DEBUG] [LOCAL ] DSU: Primary data saved (23202 records). [2025-10-16T18:31:04.266073] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-16T18:31:04.266153] [INFO ] [MAIN ] Update Progress: 655/2369 symbols completed. DSU took 27.8s. Estimated remaining: 3h 58m 9s. Rate: 7.2 symbols/min [2025-10-16T18:31:04.441373] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:04.441721] [DEBUG] [LOCAL ] DTE: No existing data file found in primary storage. [2025-10-16T18:31:04.447552] [WARN ] [MAIN ] DTE: No existing data found, performing full refresh instead. [2025-10-16T18:31:04.458197] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T18:31:04.458487] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-16T18:31:04.470231] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-16T18:31:04.471066] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-16T18:31:04.470832] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-10-16T18:31:04.471270] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-16T18:31:04.748231] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-16T18:31:04.839099] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:05.542869] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-16T18:31:05.570492] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T18:31:06.342822] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-16T18:31:07.142809] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-16T18:31:07.205877] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T18:31:07.803709] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:31:07.818562] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T18:31:07.942818] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-16T18:31:08.742885] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-16T18:31:09.542791] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-16T18:31:09.598467] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T18:31:10.342823] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-16T18:31:10.372212] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T18:31:10.817229] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T18:31:10.871753] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-16T18:31:11.142838] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-16T18:31:11.942854] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-16T18:31:12.499692] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T18:31:12.742819] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-16T18:31:12.995864] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T18:31:13.320129] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-16T18:31:13.542840] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-16T18:31:14.342840] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-16T18:31:15.142818] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-16T18:31:15.218280] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T18:31:15.942802] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-16T18:31:16.053586] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T18:31:16.108394] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T18:31:16.742820] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-16T18:31:17.320768] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T18:31:17.542816] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-16T18:31:17.655571] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-16T18:31:18.035469] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-16T18:31:18.342826] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-16T18:31:18.951074] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T18:31:19.142817] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-16T18:31:19.646132] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-16T18:31:19.942825] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-16T18:31:20.418467] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-16T18:31:20.742842] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-16T18:31:21.383793] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T18:31:21.385474] [INFO ] [REMOTE ] DTB: Full fetch complete (6651 records). [2025-10-16T18:31:21.385581] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-16T18:31:21.547767] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-16T18:31:21.750360] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-16T18:31:21.750435] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-16T18:31:21.750625] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-16T18:31:21.750700] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-16T18:31:21.751128] [DEBUG] [LOCAL ] DTB: Trimmed 6651 records to 5017 (keeping 200 days of data) [2025-10-16T18:31:21.785380] [DEBUG] [LOCAL ] DTB: Primary data saved (5017 records). [2025-10-16T18:31:21.785542] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-16T18:31:21.785669] [INFO ] [MAIN ] Update Progress: 656/2369 symbols completed. DTB took 19.7s. Estimated remaining: 3h 58m 25s. Rate: 7.2 symbols/min [2025-10-16T18:31:21.955570] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:21.955791] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-16T18:31:21.955834] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-16T18:31:21.955945] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-16T18:31:21.955985] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-16T18:31:21.956025] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-16T18:31:21.956057] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-16T18:31:22.314843] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:22.342773] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-16T18:31:22.931834] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-16T18:31:23.137397] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T18:31:23.147465] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-16T18:31:23.942820] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-16T18:31:24.549926] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T18:31:24.748012] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-16T18:31:24.769943] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T18:31:25.542812] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-16T18:31:26.342810] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-16T18:31:26.650998] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-16T18:31:26.871293] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T18:31:27.142839] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-16T18:31:27.621035] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-16T18:31:27.942861] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-16T18:31:28.742780] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-16T18:31:29.024962] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-16T18:31:29.082023] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-16T18:31:29.555511] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-16T18:31:29.586272] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T18:31:29.990439] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-16T18:31:30.342883] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-16T18:31:31.142837] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-16T18:31:31.194841] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-16T18:31:31.573241] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-16T18:31:31.942855] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-16T18:31:32.742811] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-16T18:31:32.876713] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T18:31:32.880928] [INFO ] [REMOTE ] DSX: Full fetch complete (35841 records). [2025-10-16T18:31:32.881043] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-16T18:31:33.264034] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-16T18:31:33.264138] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-16T18:31:33.264847] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-16T18:31:33.264911] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-16T18:31:33.265942] [DEBUG] [LOCAL ] DSX: Trimmed 35841 records to 24160 (keeping 200 days of data) [2025-10-16T18:31:33.411256] [DEBUG] [LOCAL ] DSX: Primary data saved (24160 records). [2025-10-16T18:31:33.411396] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-16T18:31:33.411478] [INFO ] [MAIN ] Update Progress: 657/2369 symbols completed. DSX took 48.1s. Estimated remaining: 3h 58m 25s. Rate: 7.2 symbols/min [2025-10-16T18:31:33.551123] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-16T18:31:33.585689] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:33.594938] [DEBUG] [LOCAL ] DTG: Loaded 5805 existing records from primary storage. [2025-10-16T18:31:33.595188] [INFO ] [MAIN ] DTG: Loaded 5805 existing records. [2025-10-16T18:31:33.771222] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:31:33.771417] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-16T18:31:33.771464] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-16T18:31:33.771627] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-16T18:31:33.771712] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-16T18:31:34.130956] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:34.345014] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-16T18:31:34.345200] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-16T18:31:34.581727] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T18:31:35.142840] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-16T18:31:35.490971] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-16T18:31:35.702407] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T18:31:35.942846] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-16T18:31:36.721104] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-16T18:31:36.742797] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-16T18:31:37.416370] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T18:31:37.542795] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-16T18:31:37.874930] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-16T18:31:38.342810] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-16T18:31:39.142840] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-16T18:31:39.434526] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-16T18:31:39.942796] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-16T18:31:40.054395] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T18:31:40.212960] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-16T18:31:40.742882] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-16T18:31:41.284115] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-16T18:31:41.542878] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-16T18:31:41.981458] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-16T18:31:41.982225] [INFO ] [REMOTE ] DTF: Full fetch complete (1779 records). [2025-10-16T18:31:41.982293] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-16T18:31:42.175276] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-16T18:31:42.175479] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:31:42.175549] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:31:42.175624] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-16T18:31:42.175728] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-16T18:31:42.175775] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-16T18:31:42.175821] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-16T18:31:42.175878] [INFO ] [MAIN ] Update Progress: 658/2369 symbols completed. DTF took 20.4s. Estimated remaining: 3h 58m 18s. Rate: 7.2 symbols/min [2025-10-16T18:31:42.348151] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-16T18:31:42.351132] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:42.351995] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-16T18:31:42.352039] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-16T18:31:42.352149] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-16T18:31:42.352191] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-16T18:31:42.352234] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-16T18:31:42.352266] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-16T18:31:42.728743] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:43.142832] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-16T18:31:43.332284] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:31:43.332638] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-16T18:31:43.332760] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:31:43.332809] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-16T18:31:43.332845] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:31:43.332913] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-16T18:31:43.332977] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-16T18:31:43.333015] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-16T18:31:43.333058] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-16T18:31:43.333121] [INFO ] [MAIN ] Update Progress: 659/2369 symbols completed. DTK took 1.2s. Estimated remaining: 3h 57m 51s. Rate: 7.2 symbols/min [2025-10-16T18:31:43.536087] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:43.585280] [DEBUG] [LOCAL ] DTM: Loaded 43930 existing records from primary storage. [2025-10-16T18:31:43.585587] [INFO ] [MAIN ] DTM: Loaded 43930 existing records. [2025-10-16T18:31:43.796186] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:31:43.796419] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-16T18:31:43.796467] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-16T18:31:43.796682] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-16T18:31:43.796739] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-16T18:31:43.947973] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-16T18:31:44.199373] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:44.228613] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T18:31:44.742818] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-16T18:31:45.542839] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-16T18:31:45.953751] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-16T18:31:45.960711] [INFO ] [REMOTE ] DT: Full fetch complete (76867 records). [2025-10-16T18:31:45.960864] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-16T18:31:46.354169] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-16T18:31:46.358839] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-16T18:31:46.360398] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-16T18:31:46.361717] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-16T18:31:46.362039] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-16T18:31:46.363893] [DEBUG] [LOCAL ] DT: Trimmed 76867 records to 53331 (keeping 200 days of data) [2025-10-16T18:31:46.492187] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T18:31:46.719730] [DEBUG] [LOCAL ] DT: Primary data saved (53331 records). [2025-10-16T18:31:46.719889] [INFO ] [MAIN ] DT: Full history saved. [2025-10-16T18:31:46.720020] [INFO ] [MAIN ] Update Progress: 660/2369 symbols completed. DT took 53.9s. Estimated remaining: 3h 57m 30s. Rate: 7.2 symbols/min [2025-10-16T18:31:46.900382] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:46.935063] [DEBUG] [LOCAL ] DTW: Loaded 4821 existing records from primary storage. [2025-10-16T18:31:46.932223] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T18:31:46.935381] [INFO ] [MAIN ] DTW: Loaded 4821 existing records. [2025-10-16T18:31:47.118993] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-16T18:31:47.148043] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-16T18:31:47.156046] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:31:47.158042] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-16T18:31:47.158098] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-16T18:31:47.158263] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-16T18:31:47.158322] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-16T18:31:47.517536] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:47.942819] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-16T18:31:48.506892] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-16T18:31:48.742798] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-16T18:31:48.837219] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T18:31:49.223610] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-16T18:31:49.542829] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-16T18:31:50.342813] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-16T18:31:50.801428] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-16T18:31:51.065250] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T18:31:51.142814] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-16T18:31:51.942821] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-16T18:31:52.742785] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-16T18:31:52.777561] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T18:31:52.841458] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T18:31:53.320442] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-16T18:31:53.542827] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-16T18:31:54.225002] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-16T18:31:54.342851] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-16T18:31:55.142827] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-16T18:31:55.863149] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T18:31:55.869580] [INFO ] [REMOTE ] DTE: Full fetch complete (69004 records). [2025-10-16T18:31:55.869790] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-16T18:31:55.947910] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-16T18:31:56.267425] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T18:31:56.330080] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-16T18:31:56.330578] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-16T18:31:56.331528] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-16T18:31:56.331601] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-16T18:31:56.333007] [DEBUG] [LOCAL ] DTE: Trimmed 69004 records to 47720 (keeping 200 days of data) [2025-10-16T18:31:56.617537] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-16T18:31:56.644448] [DEBUG] [LOCAL ] DTE: Primary data saved (47720 records). [2025-10-16T18:31:56.644596] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-16T18:31:56.644693] [INFO ] [MAIN ] Update Progress: 661/2369 symbols completed. DTE took 52.4s. Estimated remaining: 3h 57m 25s. Rate: 7.2 symbols/min [2025-10-16T18:31:56.751395] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-16T18:31:56.832195] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:56.884711] [DEBUG] [LOCAL ] DUK: Loaded 53437 existing records from primary storage. [2025-10-16T18:31:56.885057] [INFO ] [MAIN ] DUK: Loaded 53437 existing records. [2025-10-16T18:31:57.067133] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:31:57.067412] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-16T18:31:57.067472] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-16T18:31:57.067847] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-16T18:31:57.067903] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-16T18:31:57.427722] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:57.429061] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T18:31:57.542822] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-16T18:31:58.342818] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-16T18:31:59.142783] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-16T18:31:59.192726] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T18:31:59.194126] [INFO ] [REMOTE ] DTG: Full fetch complete (8669 records). [2025-10-16T18:31:59.194197] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-16T18:31:59.194555] [FATAL] [VALIDATOR ] DTG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:31:59.194637] [FATAL] [MAIN ] DTG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:31:59.194718] [WARN ] [MAIN ] DTG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:31:59.194759] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-16T18:31:59.194812] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-16T18:31:59.194847] [INFO ] [LOCAL ] DTG: Starting deletion of derivative data. [2025-10-16T18:31:59.194960] [DEBUG] [LOCAL ] DTG: Deleted derivative data file. [2025-10-16T18:31:59.195023] [INFO ] [MAIN ] Update Progress: 662/2369 symbols completed. DTG took 25.8s. Estimated remaining: 3h 57m 2s. Rate: 7.2 symbols/min [2025-10-16T18:31:59.376722] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:59.377092] [DEBUG] [LOCAL ] DUKB: No existing data file found in primary storage. [2025-10-16T18:31:59.377280] [WARN ] [MAIN ] DUKB: No existing data found, performing full refresh instead. [2025-10-16T18:31:59.377442] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-16T18:31:59.377490] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-16T18:31:59.377586] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-16T18:31:59.377700] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-16T18:31:59.699373] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-16T18:31:59.794241] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:59.942829] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-16T18:32:00.671975] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-16T18:32:00.742825] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-16T18:32:00.923234] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T18:32:01.542891] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-16T18:32:01.580278] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T18:32:02.342859] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-16T18:32:02.991491] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T18:32:03.115197] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T18:32:03.142788] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-16T18:32:03.942885] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-16T18:32:04.419494] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-16T18:32:04.744677] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-16T18:32:04.747360] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T18:32:05.402084] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-16T18:32:05.542838] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-16T18:32:06.342823] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-16T18:32:06.903948] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T18:32:07.142844] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-16T18:32:07.364127] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T18:32:07.748176] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-16T18:32:07.942836] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-16T18:32:08.538091] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T18:32:08.742822] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-16T18:32:09.542802] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-16T18:32:10.142722] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-16T18:32:10.333256] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T18:32:10.342792] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-16T18:32:10.992573] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-16T18:32:11.142857] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-16T18:32:11.942837] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-16T18:32:12.033754] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T18:32:12.742801] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-16T18:32:13.318909] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-16T18:32:13.542827] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-16T18:32:13.826746] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T18:32:14.342814] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-16T18:32:14.837766] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T18:32:15.142811] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-16T18:32:15.702842] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-16T18:32:15.942852] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-16T18:32:16.296397] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T18:32:16.742844] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-16T18:32:17.297357] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T18:32:17.528064] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T18:32:17.542767] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-16T18:32:18.231042] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-16T18:32:18.342830] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-16T18:32:19.142835] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-16T18:32:19.615503] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-16T18:32:19.942884] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-16T18:32:20.140483] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T18:32:20.146542] [INFO ] [REMOTE ] DTM: Full fetch complete (65047 records). [2025-10-16T18:32:20.146727] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-16T18:32:20.560208] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-16T18:32:20.560279] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-16T18:32:20.561235] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-16T18:32:20.561299] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-16T18:32:20.562495] [DEBUG] [LOCAL ] DTM: Trimmed 65047 records to 44243 (keeping 200 days of data) [2025-10-16T18:32:20.749905] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-16T18:32:20.841220] [DEBUG] [LOCAL ] DTM: Primary data saved (44243 records). [2025-10-16T18:32:20.841347] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-16T18:32:20.841423] [INFO ] [MAIN ] Update Progress: 663/2369 symbols completed. DTM took 37.5s. Estimated remaining: 3h 57m 28s. Rate: 7.2 symbols/min [2025-10-16T18:32:21.008583] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:32:21.059275] [DEBUG] [LOCAL ] DV: Loaded 51301 existing records from primary storage. [2025-10-16T18:32:21.059613] [INFO ] [MAIN ] DV: Loaded 51301 existing records. [2025-10-16T18:32:21.237978] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:32:21.238262] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-16T18:32:21.238311] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-16T18:32:21.238835] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-16T18:32:21.238893] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-16T18:32:21.365495] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T18:32:21.546556] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-16T18:32:21.612039] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:32:21.748558] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T18:32:22.109136] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-16T18:32:22.342833] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-16T18:32:22.874405] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-16T18:32:22.875865] [INFO ] [REMOTE ] DTW: Full fetch complete (7199 records). [2025-10-16T18:32:22.875957] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-16T18:32:23.148183] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-16T18:32:23.281487] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-16T18:32:23.281571] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-16T18:32:23.281833] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-16T18:32:23.281896] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-16T18:32:23.282336] [DEBUG] [LOCAL ] DTW: Trimmed 7199 records to 4840 (keeping 200 days of data) [2025-10-16T18:32:23.315246] [DEBUG] [LOCAL ] DTW: Primary data saved (4840 records). [2025-10-16T18:32:23.315396] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-16T18:32:23.315484] [INFO ] [MAIN ] Update Progress: 664/2369 symbols completed. DTW took 36.6s. Estimated remaining: 3h 57m 5s. Rate: 7.2 symbols/min [2025-10-16T18:32:23.509924] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:32:23.551976] [DEBUG] [LOCAL ] DVA: Loaded 41059 existing records from primary storage. [2025-10-16T18:32:23.552268] [INFO ] [MAIN ] DVA: Loaded 41059 existing records. [2025-10-16T18:32:23.728926] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:32:23.729206] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-16T18:32:23.729255] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-16T18:32:23.729427] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-16T18:32:23.729465] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-16T18:32:23.861550] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-16T18:32:23.895526] [INFO ] [REMOTE ] DUKB: Full fetch complete (9292 records). [2025-10-16T18:32:23.948103] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-16T18:32:23.920738] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-16T18:32:24.263726] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:32:24.528242] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-16T18:32:24.528324] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-16T18:32:24.528628] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-16T18:32:24.528804] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-16T18:32:24.529300] [DEBUG] [LOCAL ] DUKB: Trimmed 9292 records to 6305 (keeping 200 days of data) [2025-10-16T18:32:24.570287] [DEBUG] [LOCAL ] DUKB: Primary data saved (6305 records). [2025-10-16T18:32:24.570422] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-16T18:32:24.570495] [INFO ] [MAIN ] Update Progress: 665/2369 symbols completed. DUKB took 25.4s. Estimated remaining: 3h 56m 38s. Rate: 7.2 symbols/min [2025-10-16T18:32:24.741526] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:32:24.741696] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-10-16T18:32:24.741782] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-10-16T18:32:24.741894] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-16T18:32:24.741936] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-16T18:32:24.742020] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-16T18:32:24.742059] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-16T18:32:24.753022] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-16T18:32:25.096494] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:32:25.542835] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-16T18:32:25.706835] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T18:32:26.134867] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T18:32:26.342832] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-16T18:32:27.142835] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-16T18:32:27.349109] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T18:32:27.614068] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T18:32:27.942861] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-16T18:32:28.593985] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T18:32:28.742874] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-16T18:32:29.542829] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-16T18:32:29.693122] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T18:32:29.965283] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T18:32:30.342870] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-16T18:32:31.142898] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-16T18:32:31.368382] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-16T18:32:31.942788] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-16T18:32:32.057584] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T18:32:32.742882] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-16T18:32:32.906618] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T18:32:33.455006] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T18:32:33.542888] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-16T18:32:34.342881] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-16T18:32:34.549190] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T18:32:35.142833] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-16T18:32:35.315434] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T18:32:35.470876] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T18:32:35.942860] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-16T18:32:36.742807] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-16T18:32:36.901004] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T18:32:37.542911] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-16T18:32:37.590523] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T18:32:38.342824] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-16T18:32:38.692360] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T18:32:39.142829] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-16T18:32:39.315466] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T18:32:39.544166] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-16T18:32:39.942835] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-16T18:32:40.378871] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-16T18:32:40.385714] [INFO ] [REMOTE ] DUK: Full fetch complete (77566 records). [2025-10-16T18:32:40.385840] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-16T18:32:40.747981] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-16T18:32:40.768395] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-16T18:32:40.768548] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-16T18:32:40.769628] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-16T18:32:40.769916] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-16T18:32:40.771825] [DEBUG] [LOCAL ] DUK: Trimmed 77566 records to 53827 (keeping 200 days of data) [2025-10-16T18:32:40.911375] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T18:32:41.156624] [DEBUG] [LOCAL ] DUK: Primary data saved (53827 records). [2025-10-16T18:32:41.156794] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-16T18:32:41.157373] [INFO ] [MAIN ] Update Progress: 666/2369 symbols completed. DUK took 44.5s. Estimated remaining: 3h 56m 51s. Rate: 7.2 symbols/min [2025-10-16T18:32:41.326441] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:32:41.383251] [DEBUG] [LOCAL ] DX: Loaded 52502 existing records from primary storage. [2025-10-16T18:32:41.383607] [INFO ] [MAIN ] DX: Loaded 52502 existing records. [2025-10-16T18:32:41.552937] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-16T18:32:41.558894] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:32:41.559996] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-16T18:32:41.560048] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-16T18:32:41.560248] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-16T18:32:41.560304] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-16T18:32:41.913164] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:32:42.272459] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T18:32:42.342791] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-16T18:32:43.142866] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-16T18:32:43.294860] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T18:32:43.534299] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-16T18:32:43.942817] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-16T18:32:44.742783] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-16T18:32:44.819943] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T18:32:45.542852] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-16T18:32:46.342884] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-16T18:32:46.470152] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T18:32:46.885202] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (2.94 seconds). [2025-10-16T18:32:47.142840] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-16T18:32:47.808460] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-16T18:32:47.942821] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-16T18:32:48.742805] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-16T18:32:49.151115] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T18:32:49.542905] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-16T18:32:50.129254] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (3.79 seconds). [2025-10-16T18:32:50.181402] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-16T18:32:50.342817] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-16T18:32:50.810913] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-16T18:32:50.903559] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T18:32:51.142821] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-16T18:32:51.942837] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-16T18:32:52.073501] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T18:32:52.742892] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-16T18:32:53.249880] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-16T18:32:53.542867] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-16T18:32:53.955451] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-16T18:32:54.342828] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-16T18:32:55.142802] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-16T18:32:55.396072] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-16T18:32:55.403109] [INFO ] [REMOTE ] DV: Full fetch complete (73872 records). [2025-10-16T18:32:55.403252] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-16T18:32:55.814339] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-16T18:32:55.814439] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-16T18:32:55.815967] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-16T18:32:55.816057] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-16T18:32:55.817497] [DEBUG] [LOCAL ] DV: Trimmed 73872 records to 51681 (keeping 200 days of data) [2025-10-16T18:32:56.129808] [DEBUG] [LOCAL ] DV: Primary data saved (51681 records). [2025-10-16T18:32:56.129940] [INFO ] [MAIN ] DV: Full history saved. [2025-10-16T18:32:56.130018] [INFO ] [MAIN ] Update Progress: 667/2369 symbols completed. DV took 35.3s. Estimated remaining: 3h 56m 59s. Rate: 7.2 symbols/min [2025-10-16T18:32:56.307181] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:32:56.343406] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-16T18:32:56.355891] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-16T18:32:56.396078] [DEBUG] [LOCAL ] DXC: Loaded 49875 existing records from primary storage. [2025-10-16T18:32:56.396582] [INFO ] [MAIN ] DXC: Loaded 49875 existing records. [2025-10-16T18:32:56.579168] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T18:32:56.602307] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:32:56.606324] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-16T18:32:56.606468] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-16T18:32:56.606557] [INFO ] [REMOTE ] DVA: Full fetch complete (59807 records). [2025-10-16T18:32:56.606959] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-16T18:32:56.607233] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-16T18:32:56.607458] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-16T18:32:57.422214] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-16T18:32:57.425542] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:32:57.427817] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-16T18:32:57.427380] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (4.68 seconds). [2025-10-16T18:32:57.427878] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-16T18:32:57.429748] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-16T18:32:57.440523] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-16T18:32:57.442141] [DEBUG] [LOCAL ] DVA: Trimmed 59807 records to 41337 (keeping 200 days of data) [2025-10-16T18:32:57.544472] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-16T18:32:57.723876] [DEBUG] [LOCAL ] DVA: Primary data saved (41337 records). [2025-10-16T18:32:57.724030] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-16T18:32:57.724684] [INFO ] [MAIN ] Update Progress: 668/2369 symbols completed. DVA took 34.4s. Estimated remaining: 3h 56m 34s. Rate: 7.2 symbols/min [2025-10-16T18:32:57.947071] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:32:57.995157] [DEBUG] [LOCAL ] DXYZ: Loaded 37126 existing records from primary storage. [2025-10-16T18:32:57.995441] [INFO ] [MAIN ] DXYZ: Loaded 37126 existing records. [2025-10-16T18:32:58.179336] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:32:58.179609] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-16T18:32:58.179690] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-16T18:32:58.179912] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-16T18:32:58.179967] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-16T18:32:58.544696] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:32:58.562029] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-16T18:32:58.578239] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-16T18:32:58.611846] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T18:32:58.992580] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T18:32:59.142835] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-16T18:32:59.942847] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-16T18:33:00.742785] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-16T18:33:00.950855] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T18:33:01.016135] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-16T18:33:01.515792] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T18:33:01.542784] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-16T18:33:02.226901] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T18:33:02.342802] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-16T18:33:03.083754] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T18:33:03.149503] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-16T18:33:03.153743] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T18:33:03.161058] [INFO ] [REMOTE ] DVN: Full fetch complete (77879 records). [2025-10-16T18:33:03.161187] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-16T18:33:03.544614] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-16T18:33:03.544725] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-16T18:33:03.545741] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-16T18:33:03.545805] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-16T18:33:03.547365] [DEBUG] [LOCAL ] DVN: Trimmed 77879 records to 54089 (keeping 200 days of data) [2025-10-16T18:33:03.870669] [DEBUG] [LOCAL ] DVN: Primary data saved (54089 records). [2025-10-16T18:33:03.870807] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-16T18:33:03.870882] [INFO ] [MAIN ] Update Progress: 669/2369 symbols completed. DVN took 39.3s. Estimated remaining: 3h 56m 20s. Rate: 7.2 symbols/min [2025-10-16T18:33:03.947895] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-16T18:33:04.039755] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:33:04.068623] [DEBUG] [LOCAL ] DY: Loaded 28456 existing records from primary storage. [2025-10-16T18:33:04.068952] [INFO ] [MAIN ] DY: Loaded 28456 existing records. [2025-10-16T18:33:04.244169] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:33:04.244427] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-16T18:33:04.244487] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-16T18:33:04.244782] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-16T18:33:04.244840] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-16T18:33:04.584816] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:33:04.742891] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-16T18:33:05.467374] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-16T18:33:05.542795] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-16T18:33:06.007858] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T18:33:06.340624] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T18:33:06.354435] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-16T18:33:07.142786] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-16T18:33:07.251486] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T18:33:07.884863] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T18:33:07.942789] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-16T18:33:08.742815] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-16T18:33:08.809529] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T18:33:09.042904] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T18:33:09.542815] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-16T18:33:10.342782] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-16T18:33:10.529182] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T18:33:11.142791] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-16T18:33:11.304048] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T18:33:11.942781] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-16T18:33:12.267275] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T18:33:12.743592] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-16T18:33:12.746006] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T18:33:12.856037] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T18:33:13.542827] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-16T18:33:14.342810] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-16T18:33:14.726688] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-16T18:33:15.044885] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T18:33:15.142801] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-16T18:33:15.942879] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-16T18:33:15.980919] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T18:33:16.616814] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T18:33:16.742788] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-16T18:33:17.542830] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-16T18:33:17.763992] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T18:33:17.829140] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-16T18:33:17.835362] [INFO ] [REMOTE ] DX: Full fetch complete (75428 records). [2025-10-16T18:33:17.835486] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-16T18:33:17.836323] [FATAL] [VALIDATOR ] DX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:33:17.836413] [FATAL] [MAIN ] DX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:33:17.836456] [WARN ] [MAIN ] DX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:33:17.836494] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-16T18:33:17.836548] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-16T18:33:17.836597] [INFO ] [LOCAL ] DX: Starting deletion of derivative data. [2025-10-16T18:33:17.836795] [DEBUG] [LOCAL ] DX: Deleted derivative data file. [2025-10-16T18:33:17.837324] [INFO ] [MAIN ] Update Progress: 670/2369 symbols completed. DX took 36.7s. Estimated remaining: 3h 56m 26s. Rate: 7.2 symbols/min [2025-10-16T18:33:18.009215] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:33:18.043215] [DEBUG] [LOCAL ] E: Loaded 33280 existing records from primary storage. [2025-10-16T18:33:18.043489] [INFO ] [MAIN ] E: Loaded 33280 existing records. [2025-10-16T18:33:18.215831] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:33:18.216060] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-16T18:33:18.216107] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-16T18:33:18.216309] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-16T18:33:18.216377] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-16T18:33:18.353341] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-16T18:33:18.569737] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:33:19.089383] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T18:33:19.142776] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-16T18:33:19.226501] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T18:33:19.942818] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-16T18:33:20.337426] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T18:33:20.742835] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-16T18:33:21.355966] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T18:33:21.542834] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-16T18:33:21.875441] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T18:33:22.342858] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-16T18:33:23.144336] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-16T18:33:23.157283] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T18:33:23.464109] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T18:33:23.942818] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-16T18:33:24.742784] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-16T18:33:24.919533] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T18:33:25.374280] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T18:33:25.543131] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-16T18:33:25.546573] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T18:33:26.342832] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-16T18:33:27.142819] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-16T18:33:27.416540] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T18:33:27.942813] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-16T18:33:28.076477] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T18:33:28.355493] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T18:33:28.742817] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-16T18:33:29.542820] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-16T18:33:29.713433] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-16T18:33:29.720130] [INFO ] [REMOTE ] DXC: Full fetch complete (70064 records). [2025-10-16T18:33:29.720303] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-16T18:33:30.137398] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-16T18:33:30.137568] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-16T18:33:30.138521] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-16T18:33:30.138597] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-16T18:33:30.168385] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T18:33:30.178286] [DEBUG] [LOCAL ] DXC: Trimmed 70064 records to 50260 (keeping 200 days of data) [2025-10-16T18:33:30.345706] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-16T18:33:30.476184] [DEBUG] [LOCAL ] DXC: Primary data saved (50260 records). [2025-10-16T18:33:30.476331] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-16T18:33:30.476411] [INFO ] [MAIN ] Update Progress: 671/2369 symbols completed. DXC took 34.3s. Estimated remaining: 3h 56m 28s. Rate: 7.2 symbols/min [2025-10-16T18:33:30.644774] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:33:30.663781] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T18:33:30.705390] [DEBUG] [LOCAL ] EAF: Loaded 41701 existing records from primary storage. [2025-10-16T18:33:30.705718] [INFO ] [MAIN ] EAF: Loaded 41701 existing records. [2025-10-16T18:33:30.876136] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:33:30.876405] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-16T18:33:30.876459] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-16T18:33:30.876700] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-16T18:33:30.876758] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-16T18:33:31.149257] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-16T18:33:31.255998] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:33:31.942848] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-16T18:33:32.177115] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T18:33:32.611534] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T18:33:32.742802] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-16T18:33:33.240151] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T18:33:33.542812] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-16T18:33:33.983491] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T18:33:34.342881] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-16T18:33:35.004541] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:33:35.142808] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-16T18:33:35.942817] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-16T18:33:36.007263] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T18:33:36.626416] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T18:33:36.742818] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-16T18:33:36.940849] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T18:33:36.944432] [INFO ] [REMOTE ] DY: Full fetch complete (43507 records). [2025-10-16T18:33:36.944598] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-16T18:33:37.343902] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-16T18:33:37.343979] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-16T18:33:37.344728] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-16T18:33:37.344790] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-16T18:33:37.345683] [DEBUG] [LOCAL ] DY: Trimmed 43507 records to 28641 (keeping 200 days of data) [2025-10-16T18:33:37.522635] [DEBUG] [LOCAL ] DY: Primary data saved (28641 records). [2025-10-16T18:33:37.522820] [INFO ] [MAIN ] DY: Full history saved. [2025-10-16T18:33:37.522906] [INFO ] [MAIN ] Update Progress: 672/2369 symbols completed. DY took 33.7s. Estimated remaining: 3h 56m 17s. Rate: 7.2 symbols/min [2025-10-16T18:33:37.554442] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-16T18:33:37.693877] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:33:37.694070] [DEBUG] [LOCAL ] EAI: No existing data file found in primary storage. [2025-10-16T18:33:37.694111] [WARN ] [MAIN ] EAI: No existing data found, performing full refresh instead. [2025-10-16T18:33:37.694232] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-16T18:33:37.694312] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-16T18:33:37.694364] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-16T18:33:37.694398] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-16T18:33:38.055297] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:33:38.342836] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-16T18:33:38.703774] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T18:33:38.710239] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57244 records). [2025-10-16T18:33:38.710423] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-16T18:33:39.104741] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-16T18:33:39.104836] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-16T18:33:39.105897] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-16T18:33:39.123935] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-16T18:33:39.126024] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T18:33:39.134016] [DEBUG] [LOCAL ] DXYZ: Trimmed 57244 records to 37483 (keeping 200 days of data) [2025-10-16T18:33:39.187412] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-16T18:33:39.360348] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37483 records). [2025-10-16T18:33:39.360524] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-16T18:33:39.360631] [INFO ] [MAIN ] Update Progress: 673/2369 symbols completed. DXYZ took 41.6s. Estimated remaining: 3h 55m 52s. Rate: 7.2 symbols/min [2025-10-16T18:33:39.536072] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:33:39.565172] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T18:33:39.596476] [DEBUG] [LOCAL ] EARN: Loaded 28609 existing records from primary storage. [2025-10-16T18:33:39.596784] [INFO ] [MAIN ] EARN: Loaded 28609 existing records. [2025-10-16T18:33:39.767930] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:33:39.768173] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-16T18:33:39.768221] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-16T18:33:39.768411] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-16T18:33:39.768467] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-16T18:33:39.952607] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-16T18:33:40.121614] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:33:40.540344] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T18:33:40.742837] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-16T18:33:41.315061] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T18:33:41.542812] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-16T18:33:42.221735] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T18:33:42.342792] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-16T18:33:43.142805] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-16T18:33:43.287092] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T18:33:43.695296] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T18:33:43.942869] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-16T18:33:44.625539] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T18:33:44.742833] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-16T18:33:45.354819] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T18:33:45.542865] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-16T18:33:46.162731] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T18:33:46.342792] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-16T18:33:47.142790] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-16T18:33:47.188064] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T18:33:47.192283] [INFO ] [REMOTE ] E: Full fetch complete (47860 records). [2025-10-16T18:33:47.192407] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-16T18:33:47.564402] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-16T18:33:47.564495] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-16T18:33:47.565243] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-16T18:33:47.565307] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-16T18:33:47.566398] [DEBUG] [LOCAL ] E: Trimmed 47860 records to 33514 (keeping 200 days of data) [2025-10-16T18:33:47.778144] [DEBUG] [LOCAL ] E: Primary data saved (33514 records). [2025-10-16T18:33:47.778312] [INFO ] [MAIN ] E: Full history saved. [2025-10-16T18:33:47.778446] [INFO ] [MAIN ] Update Progress: 674/2369 symbols completed. E took 29.9s. Estimated remaining: 3h 55m 44s. Rate: 7.2 symbols/min [2025-10-16T18:33:47.955709] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-16T18:33:47.958619] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:33:47.959717] [DEBUG] [LOCAL ] EAT: No existing data file found in primary storage. [2025-10-16T18:33:47.959774] [WARN ] [MAIN ] EAT: No existing data found, performing full refresh instead. [2025-10-16T18:33:47.959927] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-16T18:33:47.959984] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-16T18:33:47.960029] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-10-16T18:33:47.960063] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-16T18:33:48.240060] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T18:33:48.330031] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-16T18:33:48.392275] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:33:48.742874] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-16T18:33:49.409738] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T18:33:49.542779] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-16T18:33:50.342918] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-16T18:33:50.772080] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-16T18:33:50.846346] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T18:33:51.142852] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-16T18:33:51.942856] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-16T18:33:52.055823] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T18:33:52.249054] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-16T18:33:52.370131] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-16T18:33:52.742792] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-16T18:33:53.542779] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-16T18:33:53.855967] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T18:33:54.342855] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-16T18:33:54.957847] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-16T18:33:55.142846] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-16T18:33:55.284225] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T18:33:55.505358] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-16T18:33:55.942842] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-16T18:33:56.506096] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-16T18:33:56.742824] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-16T18:33:57.542820] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-16T18:33:58.230845] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T18:33:58.235350] [INFO ] [REMOTE ] EAF: Full fetch complete (62663 records). [2025-10-16T18:33:58.235506] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-16T18:33:58.347987] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-16T18:33:58.637151] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-16T18:33:58.637256] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-16T18:33:58.638126] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-16T18:33:58.638187] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-16T18:33:58.639459] [DEBUG] [LOCAL ] EAF: Trimmed 62663 records to 41935 (keeping 200 days of data) [2025-10-16T18:33:58.872132] [DEBUG] [LOCAL ] EAF: Primary data saved (41935 records). [2025-10-16T18:33:58.872427] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-16T18:33:58.872520] [INFO ] [MAIN ] Update Progress: 675/2369 symbols completed. EAF took 28.4s. Estimated remaining: 3h 55m 42s. Rate: 7.2 symbols/min [2025-10-16T18:33:59.040174] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:33:59.073160] [DEBUG] [LOCAL ] EB: Loaded 36538 existing records from primary storage. [2025-10-16T18:33:59.073487] [INFO ] [MAIN ] EB: Loaded 36538 existing records. [2025-10-16T18:33:59.153451] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-16T18:33:59.258904] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:33:59.259435] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-16T18:33:59.259547] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-16T18:33:59.259974] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-16T18:33:59.260108] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-16T18:33:59.596064] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-16T18:33:59.693940] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-16T18:33:59.693590] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:33:59.698034] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T18:33:59.942878] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-16T18:34:00.742819] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-16T18:34:01.235094] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-16T18:34:01.341192] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T18:34:01.542809] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-16T18:34:02.342815] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-16T18:34:02.935015] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-16T18:34:03.018136] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T18:34:03.142822] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-16T18:34:03.942835] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-16T18:34:04.742856] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-16T18:34:04.785427] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T18:34:04.814851] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T18:34:05.542813] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-16T18:34:06.119453] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-16T18:34:06.342801] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-16T18:34:06.625801] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T18:34:07.142815] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-16T18:34:07.897809] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T18:34:07.942803] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-16T18:34:08.724021] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T18:34:08.742776] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-16T18:34:08.937024] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T18:34:09.542842] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-16T18:34:10.008363] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-16T18:34:10.012481] [INFO ] [REMOTE ] EARN: Full fetch complete (45523 records). [2025-10-16T18:34:10.012609] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-16T18:34:10.273087] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T18:34:10.345222] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-16T18:34:10.434263] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-16T18:34:10.434360] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-16T18:34:10.435066] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-16T18:34:10.435130] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-16T18:34:10.436201] [DEBUG] [LOCAL ] EARN: Trimmed 45523 records to 28794 (keeping 200 days of data) [2025-10-16T18:34:10.608044] [DEBUG] [LOCAL ] EARN: Primary data saved (28794 records). [2025-10-16T18:34:10.608343] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-16T18:34:10.608448] [INFO ] [MAIN ] Update Progress: 676/2369 symbols completed. EARN took 31.2s. Estimated remaining: 3h 55m 42s. Rate: 7.2 symbols/min [2025-10-16T18:34:10.776016] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:34:10.776273] [DEBUG] [LOCAL ] EBF: No existing data file found in primary storage. [2025-10-16T18:34:10.776319] [WARN ] [MAIN ] EBF: No existing data found, performing full refresh instead. [2025-10-16T18:34:10.776398] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-16T18:34:10.776435] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-16T18:34:10.776475] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-16T18:34:10.776508] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-16T18:34:11.124456] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:34:11.142780] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-16T18:34:11.898400] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T18:34:11.899565] [INFO ] [REMOTE ] EAI: Full fetch complete (6020 records). [2025-10-16T18:34:11.899636] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-16T18:34:11.955017] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-16T18:34:12.275752] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-16T18:34:12.275847] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-16T18:34:12.276025] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-16T18:34:12.276064] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-16T18:34:12.276431] [DEBUG] [LOCAL ] EAI: Trimmed 6020 records to 3998 (keeping 200 days of data) [2025-10-16T18:34:12.332639] [DEBUG] [LOCAL ] EAI: Primary data saved (3998 records). [2025-10-16T18:34:12.332791] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-16T18:34:12.332990] [INFO ] [MAIN ] Update Progress: 677/2369 symbols completed. EAI took 34.8s. Estimated remaining: 3h 55m 17s. Rate: 7.2 symbols/min [2025-10-16T18:34:12.335331] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-16T18:34:12.742924] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-16T18:34:13.547248] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-16T18:34:13.550685] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T18:34:14.195179] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T18:34:14.342817] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-16T18:34:14.917850] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T18:34:15.142860] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-16T18:34:15.948121] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-16T18:34:15.969100] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T18:34:16.126316] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T18:34:16.742876] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-16T18:34:17.484500] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T18:34:17.542967] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-16T18:34:17.886698] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T18:34:18.342909] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-16T18:34:18.689044] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T18:34:19.142887] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-16T18:34:19.575483] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T18:34:19.942873] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-16T18:34:20.742787] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-16T18:34:20.930151] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T18:34:21.289255] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T18:34:21.543526] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-16T18:34:21.545766] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T18:34:22.342822] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-16T18:34:22.961923] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T18:34:23.142817] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-16T18:34:23.757967] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T18:34:23.942849] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-16T18:34:24.200163] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T18:34:24.742880] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-16T18:34:25.465446] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T18:34:25.471853] [INFO ] [REMOTE ] EAT: Full fetch complete (72382 records). [2025-10-16T18:34:25.471984] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-16T18:34:25.547978] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-16T18:34:25.853290] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-16T18:34:25.853382] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-16T18:34:25.854313] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-16T18:34:25.854379] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-16T18:34:25.855797] [DEBUG] [LOCAL ] EAT: Trimmed 72382 records to 50215 (keeping 200 days of data) [2025-10-16T18:34:26.180728] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-16T18:34:26.205904] [DEBUG] [LOCAL ] EAT: Primary data saved (50215 records). [2025-10-16T18:34:26.206010] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-16T18:34:26.206072] [INFO ] [MAIN ] Update Progress: 678/2369 symbols completed. EAT took 38.4s. Estimated remaining: 3h 55m 23s. Rate: 7.2 symbols/min [2025-10-16T18:34:26.342779] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-16T18:34:26.643569] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T18:34:27.142835] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-16T18:34:27.931364] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T18:34:27.935482] [INFO ] [REMOTE ] EB: Full fetch complete (55075 records). [2025-10-16T18:34:27.935571] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-16T18:34:27.936332] [FATAL] [VALIDATOR ] EB: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:34:27.936417] [FATAL] [MAIN ] EB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:34:27.936461] [WARN ] [MAIN ] EB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:34:27.936500] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-16T18:34:27.936556] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-16T18:34:27.936593] [INFO ] [LOCAL ] EB: Starting deletion of derivative data. [2025-10-16T18:34:27.936784] [DEBUG] [LOCAL ] EB: Deleted derivative data file. [2025-10-16T18:34:27.936877] [INFO ] [MAIN ] Update Progress: 679/2369 symbols completed. EB took 29.1s. Estimated remaining: 3h 54m 58s. Rate: 7.2 symbols/min [2025-10-16T18:34:28.199572] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T18:34:28.204133] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-16T18:34:29.368485] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T18:34:29.373559] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-16T18:34:30.403764] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T18:34:30.408064] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-16T18:34:31.473499] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T18:34:31.477519] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-16T18:34:32.515155] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T18:34:32.518053] [INFO ] [REMOTE ] EBF: Full fetch complete (27716 records). [2025-10-16T18:34:32.518123] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-16T18:34:32.518606] [FATAL] [VALIDATOR ] EBF: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:34:32.518753] [FATAL] [MAIN ] EBF: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:34:32.518883] [WARN ] [MAIN ] EBF: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:34:32.518973] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-16T18:34:32.519038] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-16T18:34:32.519072] [INFO ] [LOCAL ] EBF: Starting deletion of derivative data. [2025-10-16T18:34:32.519110] [DEBUG] [LOCAL ] EBF: No derivative data file found to delete. [2025-10-16T18:34:32.519161] [INFO ] [MAIN ] Update Progress: 680/2369 symbols completed. EBF took 21.9s. Estimated remaining: 3h 54m 40s. Rate: 7.2 symbols/min [2025-10-16T18:34:33.045799] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:34:33.186916] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:34:33.212378] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:34:33.233854] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:34:33.269846] [DEBUG] [LOCAL ] ECAT: Loaded 29496 existing records from primary storage. [2025-10-16T18:34:33.279381] [INFO ] [MAIN ] ECAT: Loaded 29496 existing records. [2025-10-16T18:34:33.387490] [DEBUG] [LOCAL ] EBR: Loaded 43297 existing records from primary storage. [2025-10-16T18:34:33.421699] [INFO ] [MAIN ] EBR: Loaded 43297 existing records. [2025-10-16T18:34:33.449315] [DEBUG] [LOCAL ] EC: Loaded 49000 existing records from primary storage. [2025-10-16T18:34:33.495933] [INFO ] [MAIN ] EC: Loaded 49000 existing records. [2025-10-16T18:34:33.603841] [DEBUG] [LOCAL ] EBS: Loaded 46759 existing records from primary storage. [2025-10-16T18:34:33.649888] [INFO ] [MAIN ] EBS: Loaded 46759 existing records. [2025-10-16T18:34:33.740926] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:34:33.872582] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-16T18:34:33.918684] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:34:33.924045] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-16T18:34:33.952301] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-16T18:34:33.934743] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-16T18:34:33.967845] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-16T18:34:33.973047] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-16T18:34:33.997226] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-16T18:34:34.073717] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-16T18:34:34.099537] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:34:34.205065] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-16T18:34:34.179765] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:34:34.224046] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-16T18:34:34.256595] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-16T18:34:34.269680] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-16T18:34:34.281968] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-16T18:34:34.275187] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-16T18:34:34.287685] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-16T18:34:34.287244] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-16T18:34:35.515029] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:34:35.584927] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-16T18:34:35.596437] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:34:35.589453] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:34:35.602009] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-16T18:34:35.603690] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-16T18:34:35.686881] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:34:35.687221] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-16T18:34:36.973744] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T18:34:36.979280] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-16T18:34:37.335517] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T18:34:37.345983] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-16T18:34:37.414365] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T18:34:37.423665] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-16T18:34:37.785781] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-16T18:34:37.795825] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-16T18:34:37.892635] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T18:34:37.898598] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-16T18:34:38.559971] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T18:34:38.569133] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-16T18:34:38.622373] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T18:34:39.116188] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T18:34:39.143181] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-16T18:34:39.143996] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T18:34:39.942824] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-16T18:34:39.982882] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T18:34:40.607115] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T18:34:40.742852] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-16T18:34:41.257910] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T18:34:41.542858] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-16T18:34:42.238358] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T18:34:42.342795] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-16T18:34:42.821391] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T18:34:43.142819] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-16T18:34:43.942790] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-16T18:34:44.287964] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T18:34:44.356491] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-16T18:34:44.742808] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-16T18:34:45.185155] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-16T18:34:45.542829] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-16T18:34:46.088023] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T18:34:46.342888] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-16T18:34:46.696298] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T18:34:47.142815] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-16T18:34:47.906355] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T18:34:47.942767] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-16T18:34:48.232826] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T18:34:48.742819] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-16T18:34:49.542845] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-16T18:34:49.636160] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T18:34:50.342793] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-16T18:34:50.809668] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-16T18:34:50.878174] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T18:34:51.142807] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-16T18:34:51.696406] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T18:34:51.942798] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-16T18:34:52.742825] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-16T18:34:53.019047] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T18:34:53.238514] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-16T18:34:53.542807] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-16T18:34:54.083730] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T18:34:54.342823] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-16T18:34:54.527388] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T18:34:55.142843] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-16T18:34:55.942794] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-16T18:34:55.982872] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T18:34:56.731828] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T18:34:56.742774] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-16T18:34:57.295171] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T18:34:57.542821] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-16T18:34:58.333148] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T18:34:58.339735] [INFO ] [REMOTE ] EBR: Full fetch complete (62597 records). [2025-10-16T18:34:58.339882] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-16T18:34:58.353436] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-16T18:34:58.720853] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-16T18:34:58.720931] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-16T18:34:58.721759] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-16T18:34:58.721834] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-16T18:34:58.723085] [DEBUG] [LOCAL ] EBR: Trimmed 62597 records to 43627 (keeping 200 days of data) [2025-10-16T18:34:58.981283] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T18:34:59.014901] [DEBUG] [LOCAL ] EBR: Primary data saved (43627 records). [2025-10-16T18:34:59.015045] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-16T18:34:59.015160] [INFO ] [MAIN ] Update Progress: 681/2369 symbols completed. EBR took 26.5s. Estimated remaining: 3h 55m 17s. Rate: 7.2 symbols/min [2025-10-16T18:34:59.149881] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-16T18:34:59.180930] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:34:59.181071] [DEBUG] [LOCAL ] ECC: No existing data file found in primary storage. [2025-10-16T18:34:59.181108] [WARN ] [MAIN ] ECC: No existing data found, performing full refresh instead. [2025-10-16T18:34:59.181214] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-16T18:34:59.181254] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-16T18:34:59.181296] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-10-16T18:34:59.181340] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-16T18:34:59.521719] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:34:59.942781] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-16T18:35:00.289242] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-16T18:35:00.506612] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T18:35:00.742787] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-16T18:35:01.542826] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-16T18:35:02.066977] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-16T18:35:02.212260] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T18:35:02.342820] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-16T18:35:02.776956] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-16T18:35:02.780619] [INFO ] [REMOTE ] ECAT: Full fetch complete (42815 records). [2025-10-16T18:35:02.780733] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-16T18:35:02.781305] [FATAL] [VALIDATOR ] ECAT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:35:02.781411] [FATAL] [MAIN ] ECAT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:35:02.781458] [WARN ] [MAIN ] ECAT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:35:02.781504] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-16T18:35:02.781569] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-10-16T18:35:02.781671] [INFO ] [LOCAL ] ECAT: Starting deletion of derivative data. [2025-10-16T18:35:02.781892] [DEBUG] [LOCAL ] ECAT: Deleted derivative data file. [2025-10-16T18:35:02.781980] [INFO ] [MAIN ] Update Progress: 682/2369 symbols completed. ECAT took 30.3s. Estimated remaining: 3h 54m 57s. Rate: 7.2 symbols/min [2025-10-16T18:35:02.947050] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:35:02.947245] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-16T18:35:02.947282] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-16T18:35:02.947391] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-16T18:35:02.947431] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-16T18:35:02.947472] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-16T18:35:02.947503] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-16T18:35:03.153601] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-16T18:35:03.298775] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:35:03.942854] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-16T18:35:03.997723] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T18:35:04.588241] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-16T18:35:04.742801] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-16T18:35:04.924230] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T18:35:05.542815] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-16T18:35:06.132078] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T18:35:06.342815] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-16T18:35:06.932065] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T18:35:06.937995] [INFO ] [REMOTE ] EBS: Full fetch complete (67444 records). [2025-10-16T18:35:06.938148] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-16T18:35:07.148063] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-16T18:35:07.328081] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-16T18:35:07.328169] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-16T18:35:07.329083] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-16T18:35:07.329153] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-16T18:35:07.330499] [DEBUG] [LOCAL ] EBS: Trimmed 67444 records to 47095 (keeping 200 days of data) [2025-10-16T18:35:07.583232] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-16T18:35:07.597097] [DEBUG] [LOCAL ] EBS: Primary data saved (47095 records). [2025-10-16T18:35:07.597237] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-16T18:35:07.597343] [INFO ] [MAIN ] Update Progress: 683/2369 symbols completed. EBS took 35.1s. Estimated remaining: 3h 54m 40s. Rate: 7.2 symbols/min [2025-10-16T18:35:07.771386] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:35:07.777451] [DEBUG] [LOCAL ] ECCU: Loaded 2218 existing records from primary storage. [2025-10-16T18:35:07.777716] [INFO ] [MAIN ] ECCU: Loaded 2218 existing records. [2025-10-16T18:35:07.954988] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-16T18:35:07.958023] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:35:07.958465] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-16T18:35:07.958749] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-16T18:35:07.959600] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-16T18:35:07.959687] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-16T18:35:08.359940] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-16T18:35:08.405602] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:35:08.521213] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T18:35:08.742876] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-16T18:35:09.066034] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-16T18:35:09.542869] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-16T18:35:09.868331] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-16T18:35:10.342828] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-16T18:35:11.142803] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-16T18:35:11.560131] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-16T18:35:11.942815] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-16T18:35:12.251854] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-16T18:35:12.474765] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-16T18:35:12.742801] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-16T18:35:13.073310] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-16T18:35:13.542842] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-16T18:35:14.342824] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-16T18:35:15.142811] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-16T18:35:15.454254] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T18:35:15.616322] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-16T18:35:15.942782] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-16T18:35:16.131526] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T18:35:16.212105] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-16T18:35:16.742805] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-16T18:35:17.542862] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-16T18:35:18.342824] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-16T18:35:18.415276] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T18:35:18.830320] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T18:35:18.940664] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-16T18:35:19.142822] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-16T18:35:19.942903] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-16T18:35:20.502245] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T18:35:20.742857] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-16T18:35:20.827924] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T18:35:20.834243] [INFO ] [REMOTE ] EC: Full fetch complete (71927 records). [2025-10-16T18:35:20.834389] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-16T18:35:21.237027] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-16T18:35:21.237100] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-16T18:35:21.238081] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-16T18:35:21.238144] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-16T18:35:21.239447] [DEBUG] [LOCAL ] EC: Trimmed 71927 records to 49335 (keeping 200 days of data) [2025-10-16T18:35:21.327870] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T18:35:21.525199] [DEBUG] [LOCAL ] EC: Primary data saved (49335 records). [2025-10-16T18:35:21.525334] [INFO ] [MAIN ] EC: Full history saved. [2025-10-16T18:35:21.525412] [INFO ] [MAIN ] Update Progress: 684/2369 symbols completed. EC took 49.0s. Estimated remaining: 3h 54m 46s. Rate: 7.2 symbols/min [2025-10-16T18:35:21.547922] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-16T18:35:21.703753] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:35:21.704987] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-16T18:35:21.705162] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-16T18:35:21.705351] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-16T18:35:21.705405] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-16T18:35:21.705450] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-16T18:35:21.705482] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-16T18:35:22.063751] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-16T18:35:22.070017] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:35:22.071103] [INFO ] [REMOTE ] ECCC: Full fetch complete (1296 records). [2025-10-16T18:35:22.071174] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-16T18:35:22.243408] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-16T18:35:22.243571] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:35:22.243638] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:35:22.243728] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-16T18:35:22.243790] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-16T18:35:22.243825] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-16T18:35:22.243864] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-16T18:35:22.243917] [INFO ] [MAIN ] Update Progress: 685/2369 symbols completed. ECCC took 19.5s. Estimated remaining: 3h 54m 18s. Rate: 7.2 symbols/min [2025-10-16T18:35:22.347934] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-16T18:35:22.410506] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:35:22.410765] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-16T18:35:22.410814] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-16T18:35:22.410920] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-16T18:35:22.410960] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-16T18:35:22.411003] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-16T18:35:22.411034] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-16T18:35:22.787005] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:35:22.985630] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-16T18:35:23.142802] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-16T18:35:23.783685] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-16T18:35:23.942836] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-16T18:35:24.384299] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-16T18:35:24.742832] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-16T18:35:25.024538] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-16T18:35:25.542842] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-16T18:35:25.898991] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-16T18:35:26.342833] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-16T18:35:27.142817] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-16T18:35:27.782331] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-16T18:35:27.942822] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-16T18:35:28.054376] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T18:35:28.351691] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-16T18:35:28.742883] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-16T18:35:29.073169] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-16T18:35:29.542861] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-16T18:35:30.072226] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-16T18:35:30.342833] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-16T18:35:30.657393] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-16T18:35:31.142810] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-16T18:35:31.474540] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-16T18:35:31.942816] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-16T18:35:32.282258] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-16T18:35:32.742861] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-16T18:35:33.542863] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-16T18:35:34.056580] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-16T18:35:34.328162] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T18:35:34.342770] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-16T18:35:35.142832] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-16T18:35:35.493303] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-16T18:35:35.942785] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-16T18:35:36.046150] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T18:35:36.226103] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-16T18:35:36.742915] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-16T18:35:37.542858] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-16T18:35:37.849083] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-16T18:35:38.342788] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-16T18:35:38.446102] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T18:35:38.712029] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-16T18:35:39.142812] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-16T18:35:39.506158] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-16T18:35:39.942870] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-16T18:35:40.488292] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-16T18:35:40.742831] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-16T18:35:41.217461] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-16T18:35:41.542820] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-16T18:35:41.842283] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-16T18:35:42.342803] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-16T18:35:42.656408] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-16T18:35:43.142813] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-16T18:35:43.512191] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-16T18:35:43.512980] [INFO ] [REMOTE ] ECCU: Full fetch complete (4357 records). [2025-10-16T18:35:43.513048] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-16T18:35:43.513401] [FATAL] [VALIDATOR ] ECCU: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:35:43.513481] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:35:43.513524] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:35:43.513590] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-16T18:35:43.513674] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-16T18:35:43.513729] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-10-16T18:35:43.513946] [DEBUG] [LOCAL ] ECCU: Deleted derivative data file. [2025-10-16T18:35:43.514032] [INFO ] [MAIN ] Update Progress: 686/2369 symbols completed. ECCU took 35.9s. Estimated remaining: 3h 54m 42s. Rate: 7.2 symbols/min [2025-10-16T18:35:43.682354] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:35:43.714383] [DEBUG] [LOCAL ] ECG: Loaded 33179 existing records from primary storage. [2025-10-16T18:35:43.714729] [INFO ] [MAIN ] ECG: Loaded 33179 existing records. [2025-10-16T18:35:43.890490] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:35:43.890717] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-16T18:35:43.890772] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-16T18:35:43.890961] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-16T18:35:43.891015] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-16T18:35:43.949891] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-16T18:35:44.257600] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:35:44.742826] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-16T18:35:45.542802] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-16T18:35:45.637983] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T18:35:45.644129] [INFO ] [REMOTE ] ECC: Full fetch complete (61459 records). [2025-10-16T18:35:45.644248] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-16T18:35:45.992896] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-16T18:35:46.041139] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-16T18:35:46.041236] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-16T18:35:46.042212] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-16T18:35:46.042285] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-16T18:35:46.043695] [DEBUG] [LOCAL ] ECC: Trimmed 61459 records to 43644 (keeping 200 days of data) [2025-10-16T18:35:46.302660] [DEBUG] [LOCAL ] ECC: Primary data saved (43644 records). [2025-10-16T18:35:46.302805] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-16T18:35:46.302897] [INFO ] [MAIN ] Update Progress: 687/2369 symbols completed. ECC took 47.3s. Estimated remaining: 3h 54m 20s. Rate: 7.2 symbols/min [2025-10-16T18:35:46.348025] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-16T18:35:46.484148] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:35:46.507829] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T18:35:46.557690] [DEBUG] [LOCAL ] ECL: Loaded 46668 existing records from primary storage. [2025-10-16T18:35:46.558011] [INFO ] [MAIN ] ECL: Loaded 46668 existing records. [2025-10-16T18:35:46.732412] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:35:46.732667] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-16T18:35:46.732730] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-16T18:35:46.733016] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-16T18:35:46.733072] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-16T18:35:46.907512] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-16T18:35:47.092388] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:35:47.142802] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-16T18:35:47.942890] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-16T18:35:48.599982] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:35:48.742831] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-16T18:35:49.084274] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-16T18:35:49.542862] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-16T18:35:49.888124] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T18:35:49.899516] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-16T18:35:50.342875] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-16T18:35:50.852349] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-16T18:35:51.142866] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-16T18:35:51.675741] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-16T18:35:51.676453] [INFO ] [REMOTE ] ECCW: Full fetch complete (1412 records). [2025-10-16T18:35:51.676520] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-16T18:35:51.854151] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-16T18:35:51.854355] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:35:51.854403] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:35:51.854469] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-16T18:35:51.854533] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-16T18:35:51.854568] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-16T18:35:51.854608] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-16T18:35:51.854686] [INFO ] [MAIN ] Update Progress: 688/2369 symbols completed. ECCW took 30.3s. Estimated remaining: 3h 54m 5s. Rate: 7.2 symbols/min [2025-10-16T18:35:51.948072] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-16T18:35:52.027398] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:35:52.027579] [DEBUG] [LOCAL ] ECO: No existing data file found in primary storage. [2025-10-16T18:35:52.027621] [WARN ] [MAIN ] ECO: No existing data found, performing full refresh instead. [2025-10-16T18:35:52.027754] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-16T18:35:52.027796] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-16T18:35:52.027884] [DEBUG] [LOCAL ] ECO: No primary data file found to delete. [2025-10-16T18:35:52.027924] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-16T18:35:52.382223] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:35:52.742864] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-16T18:35:53.542852] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-16T18:35:53.703067] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T18:35:54.037444] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T18:35:54.038170] [INFO ] [REMOTE ] ECCX: Full fetch complete (1453 records). [2025-10-16T18:35:54.038238] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-16T18:35:54.038560] [FATAL] [VALIDATOR ] ECCX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:35:54.038639] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:35:54.038745] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:35:54.038811] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-16T18:35:54.038872] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-16T18:35:54.038905] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-16T18:35:54.038943] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-16T18:35:54.038992] [INFO ] [MAIN ] Update Progress: 689/2369 symbols completed. ECCX took 31.8s. Estimated remaining: 3h 53m 41s. Rate: 7.2 symbols/min [2025-10-16T18:35:54.214132] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:35:54.237708] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T18:35:54.284472] [DEBUG] [LOCAL ] ECVT: Loaded 43302 existing records from primary storage. [2025-10-16T18:35:54.284807] [INFO ] [MAIN ] ECVT: Loaded 43302 existing records. [2025-10-16T18:35:54.348369] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-16T18:35:54.466545] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:35:54.466788] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-16T18:35:54.466839] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-16T18:35:54.467039] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-16T18:35:54.467096] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-16T18:35:54.810983] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:35:55.142855] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-16T18:35:55.942806] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-16T18:35:56.090543] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T18:35:56.291961] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T18:35:56.742827] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-16T18:35:57.441434] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T18:35:57.542832] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-16T18:35:57.966751] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-16T18:35:58.342821] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-16T18:35:59.142840] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-16T18:35:59.183151] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T18:35:59.773788] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T18:35:59.942797] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-16T18:36:00.581602] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T18:36:00.742811] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-16T18:36:01.290080] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T18:36:01.542822] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-16T18:36:02.342848] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-16T18:36:02.614343] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T18:36:02.979331] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T18:36:03.142810] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-16T18:36:03.477950] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T18:36:03.942812] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-16T18:36:04.742784] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-16T18:36:04.928521] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T18:36:05.180853] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T18:36:05.542802] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-16T18:36:05.787677] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T18:36:06.342831] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-16T18:36:06.892635] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T18:36:07.142798] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-16T18:36:07.837964] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T18:36:07.942812] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-16T18:36:08.092410] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T18:36:08.742803] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-16T18:36:09.377507] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T18:36:09.542804] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-16T18:36:09.777755] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T18:36:10.342866] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-16T18:36:10.983531] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T18:36:11.069336] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T18:36:11.142856] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-16T18:36:11.942786] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-16T18:36:12.422441] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T18:36:12.742818] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-16T18:36:12.886607] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-16T18:36:13.542835] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-16T18:36:14.019215] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T18:36:14.023525] [INFO ] [REMOTE ] ECG: Full fetch complete (51029 records). [2025-10-16T18:36:14.023618] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-16T18:36:14.348096] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-16T18:36:14.420828] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-16T18:36:14.420937] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-16T18:36:14.421948] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-16T18:36:14.422070] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-16T18:36:14.423442] [DEBUG] [LOCAL ] ECG: Trimmed 51029 records to 33440 (keeping 200 days of data) [2025-10-16T18:36:14.616370] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T18:36:14.644099] [DEBUG] [LOCAL ] ECG: Primary data saved (33440 records). [2025-10-16T18:36:14.644256] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-16T18:36:14.644343] [INFO ] [MAIN ] Update Progress: 690/2369 symbols completed. ECG took 31.1s. Estimated remaining: 3h 54m 3s. Rate: 7.2 symbols/min [2025-10-16T18:36:14.812495] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:36:14.812754] [DEBUG] [LOCAL ] ED: No existing data file found in primary storage. [2025-10-16T18:36:14.812808] [WARN ] [MAIN ] ED: No existing data found, performing full refresh instead. [2025-10-16T18:36:14.812929] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-16T18:36:14.812970] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-16T18:36:14.813011] [DEBUG] [LOCAL ] ED: No primary data file found to delete. [2025-10-16T18:36:14.813044] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-16T18:36:15.153534] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-16T18:36:15.173546] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:36:15.942834] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-16T18:36:16.175729] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T18:36:16.742825] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-16T18:36:16.900736] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T18:36:17.542887] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-16T18:36:17.749721] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T18:36:18.296255] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T18:36:18.342800] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-16T18:36:18.734379] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T18:36:19.142856] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-16T18:36:19.917857] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T18:36:19.942877] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-16T18:36:20.467063] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T18:36:20.742867] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-16T18:36:20.791873] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-16T18:36:21.542794] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-16T18:36:22.275674] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T18:36:22.342908] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-16T18:36:22.979141] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T18:36:23.142887] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-16T18:36:23.942820] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-16T18:36:24.033412] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T18:36:24.742799] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-16T18:36:24.844449] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T18:36:25.109839] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T18:36:25.112695] [INFO ] [REMOTE ] ECO: Full fetch complete (28440 records). [2025-10-16T18:36:25.112797] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-16T18:36:25.482889] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-16T18:36:25.482979] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-16T18:36:25.483556] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-16T18:36:25.483598] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-16T18:36:25.484435] [DEBUG] [LOCAL ] ECO: Trimmed 28440 records to 18306 (keeping 200 days of data) [2025-10-16T18:36:25.561599] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-16T18:36:25.597142] [DEBUG] [LOCAL ] ECO: Primary data saved (18306 records). [2025-10-16T18:36:25.597301] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-16T18:36:25.597376] [INFO ] [MAIN ] Update Progress: 691/2369 symbols completed. ECO took 33.7s. Estimated remaining: 3h 54m 1s. Rate: 7.2 symbols/min [2025-10-16T18:36:25.762314] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:36:25.792001] [DEBUG] [LOCAL ] EDD: Loaded 26779 existing records from primary storage. [2025-10-16T18:36:25.792348] [INFO ] [MAIN ] EDD: Loaded 26779 existing records. [2025-10-16T18:36:25.978091] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:36:25.978310] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-16T18:36:25.978357] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-16T18:36:25.978565] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-16T18:36:25.978621] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-16T18:36:26.334257] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:36:26.347920] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-16T18:36:26.362167] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T18:36:27.038076] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T18:36:27.142810] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-16T18:36:27.942860] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-16T18:36:27.975415] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T18:36:28.742858] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-16T18:36:28.761148] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-16T18:36:28.767277] [INFO ] [REMOTE ] ECL: Full fetch complete (68286 records). [2025-10-16T18:36:28.767488] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-16T18:36:29.144780] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-16T18:36:29.144877] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-16T18:36:29.145756] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-16T18:36:29.145823] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-16T18:36:29.147226] [DEBUG] [LOCAL ] ECL: Trimmed 68286 records to 47037 (keeping 200 days of data) [2025-10-16T18:36:29.455287] [DEBUG] [LOCAL ] ECL: Primary data saved (47037 records). [2025-10-16T18:36:29.455451] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-16T18:36:29.455564] [INFO ] [MAIN ] Update Progress: 692/2369 symbols completed. ECL took 43.2s. Estimated remaining: 3h 53m 41s. Rate: 7.2 symbols/min [2025-10-16T18:36:29.544422] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-16T18:36:29.650217] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:36:29.671033] [DEBUG] [LOCAL ] EDF: Loaded 13052 existing records from primary storage. [2025-10-16T18:36:29.671296] [INFO ] [MAIN ] EDF: Loaded 13052 existing records. [2025-10-16T18:36:29.872240] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:36:29.872699] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-16T18:36:29.872763] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-16T18:36:29.872948] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-16T18:36:29.873005] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-16T18:36:30.310426] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:36:30.313006] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-16T18:36:30.346326] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-16T18:36:30.369665] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T18:36:30.386997] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T18:36:31.142876] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-16T18:36:31.629965] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T18:36:31.942831] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-16T18:36:32.742864] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-16T18:36:32.910402] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T18:36:32.957350] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T18:36:33.542847] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-16T18:36:33.890576] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T18:36:34.342825] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-16T18:36:34.553541] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T18:36:35.142841] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-16T18:36:35.502665] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-16T18:36:35.655518] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-16T18:36:35.942782] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-16T18:36:36.742834] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-16T18:36:37.093007] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T18:36:37.349578] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-16T18:36:37.542819] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-16T18:36:38.342834] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-16T18:36:38.478947] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T18:36:39.142861] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-16T18:36:39.942804] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-16T18:36:40.096114] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T18:36:40.157068] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T18:36:40.742865] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-16T18:36:41.542883] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-16T18:36:41.599993] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T18:36:42.342839] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-16T18:36:42.373120] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T18:36:42.378875] [INFO ] [REMOTE ] ECVT: Full fetch complete (60246 records). [2025-10-16T18:36:42.378988] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-16T18:36:42.505930] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T18:36:42.781710] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-16T18:36:42.781795] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-16T18:36:42.782581] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-16T18:36:42.782622] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-16T18:36:42.783819] [DEBUG] [LOCAL ] ECVT: Trimmed 60246 records to 43630 (keeping 200 days of data) [2025-10-16T18:36:43.025691] [DEBUG] [LOCAL ] ECVT: Primary data saved (43630 records). [2025-10-16T18:36:43.025838] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-16T18:36:43.026375] [INFO ] [MAIN ] Update Progress: 693/2369 symbols completed. ECVT took 49.0s. Estimated remaining: 3h 53m 46s. Rate: 7.2 symbols/min [2025-10-16T18:36:43.147956] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-16T18:36:43.210465] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:36:43.233012] [DEBUG] [LOCAL ] EDN: Loaded 19013 existing records from primary storage. [2025-10-16T18:36:43.233270] [INFO ] [MAIN ] EDN: Loaded 19013 existing records. [2025-10-16T18:36:43.406967] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:36:43.407238] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-16T18:36:43.407309] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-16T18:36:43.412749] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-16T18:36:43.421087] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-16T18:36:43.461022] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T18:36:43.793024] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:36:43.942802] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-16T18:36:44.742814] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-16T18:36:45.010120] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-16T18:36:45.343619] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T18:36:45.542815] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-16T18:36:45.637521] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T18:36:46.021717] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-16T18:36:46.342829] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-16T18:36:46.990723] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T18:36:47.142846] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-16T18:36:47.942848] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-16T18:36:47.994079] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T18:36:47.995939] [INFO ] [REMOTE ] EDF: Full fetch complete (20440 records). [2025-10-16T18:36:47.996009] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-16T18:36:48.347853] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-16T18:36:48.347930] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-16T18:36:48.348357] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-16T18:36:48.348397] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-16T18:36:48.348999] [DEBUG] [LOCAL ] EDF: Trimmed 20440 records to 13171 (keeping 200 days of data) [2025-10-16T18:36:48.423792] [DEBUG] [LOCAL ] EDF: Primary data saved (13171 records). [2025-10-16T18:36:48.423926] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-16T18:36:48.424004] [INFO ] [MAIN ] Update Progress: 694/2369 symbols completed. EDF took 19.0s. Estimated remaining: 3h 53m 30s. Rate: 7.2 symbols/min [2025-10-16T18:36:48.593157] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:36:48.636193] [DEBUG] [LOCAL ] EDU: Loaded 44813 existing records from primary storage. [2025-10-16T18:36:48.636475] [INFO ] [MAIN ] EDU: Loaded 44813 existing records. [2025-10-16T18:36:48.742873] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-16T18:36:48.822492] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:36:48.822732] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-16T18:36:48.822790] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-16T18:36:48.822997] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-16T18:36:48.823056] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-16T18:36:49.208935] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:36:49.210483] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T18:36:49.542807] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-16T18:36:50.342824] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-16T18:36:50.560309] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T18:36:50.968714] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T18:36:51.142779] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-16T18:36:51.516964] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T18:36:51.942827] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-16T18:36:52.520142] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T18:36:52.742819] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-16T18:36:53.542793] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-16T18:36:53.684363] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T18:36:53.691449] [INFO ] [REMOTE ] ED: Full fetch complete (76437 records). [2025-10-16T18:36:53.691587] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-16T18:36:54.007483] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T18:36:54.109768] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-16T18:36:54.109849] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-16T18:36:54.110809] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-16T18:36:54.110871] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-16T18:36:54.112259] [DEBUG] [LOCAL ] ED: Trimmed 76437 records to 53052 (keeping 200 days of data) [2025-10-16T18:36:54.316632] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T18:36:54.347774] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-16T18:36:54.471546] [DEBUG] [LOCAL ] ED: Primary data saved (53052 records). [2025-10-16T18:36:54.471736] [INFO ] [MAIN ] ED: Full history saved. [2025-10-16T18:36:54.471825] [INFO ] [MAIN ] Update Progress: 695/2369 symbols completed. ED took 39.8s. Estimated remaining: 3h 53m 16s. Rate: 7.2 symbols/min [2025-10-16T18:36:54.637378] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:36:54.669809] [DEBUG] [LOCAL ] EE: Loaded 32990 existing records from primary storage. [2025-10-16T18:36:54.670096] [INFO ] [MAIN ] EE: Loaded 32990 existing records. [2025-10-16T18:36:54.846787] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:36:54.847068] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-16T18:36:54.847116] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-16T18:36:54.847290] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-16T18:36:54.847328] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-16T18:36:55.148013] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-16T18:36:55.200991] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:36:55.885576] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T18:36:55.942808] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-16T18:36:56.267949] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T18:36:56.742857] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-16T18:36:57.439494] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T18:36:57.542835] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-16T18:36:57.729965] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T18:36:58.342825] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-16T18:36:59.030467] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T18:36:59.142770] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-16T18:36:59.522176] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T18:36:59.942823] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-16T18:37:00.742823] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-16T18:37:00.775189] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T18:37:00.918573] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T18:37:01.542836] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-16T18:37:01.692889] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-16T18:37:01.696506] [INFO ] [REMOTE ] EDD: Full fetch complete (38631 records). [2025-10-16T18:37:01.696594] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-16T18:37:02.062014] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-16T18:37:02.062147] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-16T18:37:02.062811] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-16T18:37:02.062873] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-16T18:37:02.063767] [DEBUG] [LOCAL ] EDD: Trimmed 38631 records to 27000 (keeping 200 days of data) [2025-10-16T18:37:02.219088] [DEBUG] [LOCAL ] EDD: Primary data saved (27000 records). [2025-10-16T18:37:02.219231] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-16T18:37:02.219311] [INFO ] [MAIN ] Update Progress: 696/2369 symbols completed. EDD took 36.6s. Estimated remaining: 3h 53m 6s. Rate: 7.2 symbols/min [2025-10-16T18:37:02.344015] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-16T18:37:02.388594] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:37:02.388782] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-16T18:37:02.388825] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-16T18:37:02.388950] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-16T18:37:02.388992] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-16T18:37:02.389032] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-16T18:37:02.389064] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-16T18:37:02.700068] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T18:37:02.760274] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:37:03.132884] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T18:37:03.142765] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-16T18:37:03.942815] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-16T18:37:03.992389] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T18:37:04.742863] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-16T18:37:04.825534] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-16T18:37:05.542859] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-16T18:37:05.959162] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T18:37:06.101984] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T18:37:06.342848] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-16T18:37:07.142829] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-16T18:37:07.936366] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T18:37:07.942762] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-16T18:37:08.091013] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T18:37:08.742872] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-16T18:37:08.898026] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T18:37:09.542869] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-16T18:37:10.071129] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T18:37:10.342845] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-16T18:37:10.954892] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T18:37:10.958560] [INFO ] [REMOTE ] EDN: Full fetch complete (30015 records). [2025-10-16T18:37:10.958680] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-16T18:37:11.145461] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-16T18:37:11.329404] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-16T18:37:11.329565] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-16T18:37:11.330205] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-16T18:37:11.330278] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-16T18:37:11.346569] [DEBUG] [LOCAL ] EDN: Trimmed 30015 records to 19176 (keeping 200 days of data) [2025-10-16T18:37:11.359087] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T18:37:11.478828] [DEBUG] [LOCAL ] EDN: Primary data saved (19176 records). [2025-10-16T18:37:11.478986] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-16T18:37:11.479070] [INFO ] [MAIN ] Update Progress: 697/2369 symbols completed. EDN took 28.5s. Estimated remaining: 3h 53m 0s. Rate: 7.2 symbols/min [2025-10-16T18:37:11.696272] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T18:37:11.704730] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:37:11.721325] [DEBUG] [LOCAL ] EEX: Loaded 10208 existing records from primary storage. [2025-10-16T18:37:11.721616] [INFO ] [MAIN ] EEX: Loaded 10208 existing records. [2025-10-16T18:37:11.944222] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-16T18:37:11.979274] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:37:11.980044] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-16T18:37:11.980166] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-16T18:37:11.980383] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-16T18:37:11.980444] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-16T18:37:12.510632] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:37:12.742915] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-16T18:37:13.325601] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T18:37:13.542853] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-16T18:37:13.867984] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T18:37:14.116384] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-16T18:37:14.342885] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-16T18:37:15.097822] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-16T18:37:15.142834] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-16T18:37:15.942804] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-16T18:37:16.290103] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T18:37:16.450828] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-16T18:37:16.742813] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-16T18:37:17.542812] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-16T18:37:18.342789] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-16T18:37:18.371281] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T18:37:18.845796] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-16T18:37:18.868595] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T18:37:19.142836] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-16T18:37:19.692298] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T18:37:19.942819] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-16T18:37:20.742822] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-16T18:37:21.202434] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-16T18:37:21.382216] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T18:37:21.542812] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-16T18:37:21.920079] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-16T18:37:22.342861] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-16T18:37:23.142874] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-16T18:37:23.942807] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-16T18:37:24.311876] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-16T18:37:24.340992] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-16T18:37:24.742813] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-16T18:37:24.814576] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T18:37:25.542825] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-16T18:37:26.024286] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T18:37:26.028866] [INFO ] [REMOTE ] EE: Full fetch complete (43906 records). [2025-10-16T18:37:26.028979] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-16T18:37:26.029622] [FATAL] [VALIDATOR ] EE: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:37:26.029725] [FATAL] [MAIN ] EE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:37:26.029768] [WARN ] [MAIN ] EE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:37:26.029807] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-16T18:37:26.029865] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-10-16T18:37:26.029915] [INFO ] [LOCAL ] EE: Starting deletion of derivative data. [2025-10-16T18:37:26.030079] [DEBUG] [LOCAL ] EE: Deleted derivative data file. [2025-10-16T18:37:26.030166] [INFO ] [MAIN ] Update Progress: 698/2369 symbols completed. EE took 31.6s. Estimated remaining: 3h 53m 6s. Rate: 7.2 symbols/min [2025-10-16T18:37:26.203431] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:37:26.250141] [DEBUG] [LOCAL ] EFC: Loaded 46431 existing records from primary storage. [2025-10-16T18:37:26.250462] [INFO ] [MAIN ] EFC: Loaded 46431 existing records. [2025-10-16T18:37:26.350162] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-16T18:37:26.436358] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:37:26.436543] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-16T18:37:26.436590] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-16T18:37:26.436791] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-16T18:37:26.436856] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-16T18:37:26.791756] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:37:27.063280] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-16T18:37:27.102432] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T18:37:27.142765] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-16T18:37:27.942900] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-16T18:37:28.646061] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T18:37:28.742784] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-16T18:37:28.936633] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-16T18:37:29.315051] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T18:37:29.315830] [INFO ] [REMOTE ] EEA: Full fetch complete (3810 records). [2025-10-16T18:37:29.315899] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-16T18:37:29.491349] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T18:37:29.491547] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:37:29.491612] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:37:29.491713] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-16T18:37:29.491798] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-16T18:37:29.491835] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-16T18:37:29.491894] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-16T18:37:29.491950] [INFO ] [MAIN ] Update Progress: 699/2369 symbols completed. EEA took 27.3s. Estimated remaining: 3h 52m 46s. Rate: 7.2 symbols/min [2025-10-16T18:37:29.552347] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-16T18:37:29.660532] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:37:29.676330] [DEBUG] [LOCAL ] EFR: Loaded 15060 existing records from primary storage. [2025-10-16T18:37:29.676564] [INFO ] [MAIN ] EFR: Loaded 15060 existing records. [2025-10-16T18:37:29.846339] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:37:29.846528] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-16T18:37:29.846573] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-16T18:37:29.846765] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-16T18:37:29.846822] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-16T18:37:30.193161] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:37:30.342790] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-16T18:37:31.142787] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-16T18:37:31.214613] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T18:37:31.220844] [INFO ] [REMOTE ] EDU: Full fetch complete (66987 records). [2025-10-16T18:37:31.220964] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-16T18:37:31.600292] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T18:37:31.625764] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-16T18:37:31.625851] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-16T18:37:31.626790] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-16T18:37:31.626854] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-16T18:37:31.628119] [DEBUG] [LOCAL ] EDU: Trimmed 66987 records to 45172 (keeping 200 days of data) [2025-10-16T18:37:31.889416] [DEBUG] [LOCAL ] EDU: Primary data saved (45172 records). [2025-10-16T18:37:31.889546] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-16T18:37:31.889623] [INFO ] [MAIN ] Update Progress: 700/2369 symbols completed. EDU took 43.5s. Estimated remaining: 3h 52m 24s. Rate: 7.2 symbols/min [2025-10-16T18:37:31.951902] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-16T18:37:32.064289] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:37:32.079472] [DEBUG] [LOCAL ] EFT: Loaded 13087 existing records from primary storage. [2025-10-16T18:37:32.079717] [INFO ] [MAIN ] EFT: Loaded 13087 existing records. [2025-10-16T18:37:32.251067] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:37:32.251278] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-16T18:37:32.251334] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-16T18:37:32.251556] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-16T18:37:32.251621] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-16T18:37:32.597837] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:37:32.660165] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T18:37:32.742779] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-16T18:37:32.842487] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T18:37:33.542787] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-16T18:37:33.769752] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T18:37:34.118370] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T18:37:34.342831] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-16T18:37:35.142862] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-16T18:37:35.942829] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-16T18:37:35.984414] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T18:37:36.070179] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T18:37:36.742862] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-16T18:37:37.069206] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T18:37:37.526791] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T18:37:37.542816] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-16T18:37:38.342836] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-16T18:37:38.425943] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T18:37:38.934605] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-16T18:37:39.142828] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-16T18:37:39.722334] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-16T18:37:39.942872] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-16T18:37:40.742870] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-16T18:37:41.217503] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-16T18:37:41.525205] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T18:37:41.542769] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-16T18:37:42.342827] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-16T18:37:43.142841] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-16T18:37:43.166535] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T18:37:43.348488] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T18:37:43.619516] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-16T18:37:43.942800] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-16T18:37:44.742884] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-16T18:37:45.542873] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-16T18:37:45.703279] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-16T18:37:45.727502] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T18:37:45.729021] [INFO ] [REMOTE ] EEX: Full fetch complete (18627 records). [2025-10-16T18:37:45.729093] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-16T18:37:46.087315] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-16T18:37:46.087391] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-16T18:37:46.087805] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-16T18:37:46.087867] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-16T18:37:46.088361] [DEBUG] [LOCAL ] EEX: Trimmed 18627 records to 10294 (keeping 200 days of data) [2025-10-16T18:37:46.146756] [DEBUG] [LOCAL ] EEX: Primary data saved (10294 records). [2025-10-16T18:37:46.146888] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-16T18:37:46.146975] [INFO ] [MAIN ] Update Progress: 701/2369 symbols completed. EEX took 34.7s. Estimated remaining: 3h 52m 29s. Rate: 7.2 symbols/min [2025-10-16T18:37:46.316570] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:37:46.329067] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T18:37:46.342766] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-16T18:37:46.376624] [DEBUG] [LOCAL ] EFX: Loaded 44637 existing records from primary storage. [2025-10-16T18:37:46.377076] [INFO ] [MAIN ] EFX: Loaded 44637 existing records. [2025-10-16T18:37:46.547353] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:37:46.547543] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-16T18:37:46.547593] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-16T18:37:46.547944] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-16T18:37:46.548003] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-16T18:37:46.902181] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:37:47.113315] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T18:37:47.142776] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-16T18:37:47.942815] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-16T18:37:48.742884] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-16T18:37:48.868144] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T18:37:49.482635] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T18:37:49.517713] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T18:37:49.542775] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-16T18:37:50.342812] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-16T18:37:51.070263] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T18:37:51.142801] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-16T18:37:51.306742] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T18:37:51.883160] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T18:37:51.942865] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-16T18:37:52.681283] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T18:37:52.742831] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-16T18:37:53.542828] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-16T18:37:53.809342] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T18:37:54.342845] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-16T18:37:55.029372] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T18:37:55.048164] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-16T18:37:55.142787] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-16T18:37:55.942813] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-16T18:37:56.184276] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T18:37:56.187357] [INFO ] [REMOTE ] EFR: Full fetch complete (19448 records). [2025-10-16T18:37:56.187459] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-16T18:37:56.544435] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-16T18:37:56.544529] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-16T18:37:56.544980] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-16T18:37:56.545042] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-16T18:37:56.545601] [DEBUG] [LOCAL ] EFR: Trimmed 19448 records to 15165 (keeping 200 days of data) [2025-10-16T18:37:56.635120] [DEBUG] [LOCAL ] EFR: Primary data saved (15165 records). [2025-10-16T18:37:56.635256] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-16T18:37:56.635331] [INFO ] [MAIN ] Update Progress: 702/2369 symbols completed. EFR took 27.1s. Estimated remaining: 3h 52m 26s. Rate: 7.2 symbols/min [2025-10-16T18:37:56.747989] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-16T18:37:56.813143] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:37:56.843674] [DEBUG] [LOCAL ] EFXT: Loaded 29684 existing records from primary storage. [2025-10-16T18:37:56.843975] [INFO ] [MAIN ] EFXT: Loaded 29684 existing records. [2025-10-16T18:37:57.024916] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:37:57.025161] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-16T18:37:57.025209] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-16T18:37:57.025826] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-16T18:37:57.025885] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-16T18:37:57.428866] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:37:57.542851] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-16T18:37:57.597587] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T18:37:58.342819] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-16T18:37:58.437915] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T18:37:58.564277] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-16T18:37:59.142831] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-16T18:37:59.942808] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-16T18:38:00.022993] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T18:38:00.742861] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-16T18:38:00.987869] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T18:38:01.016093] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T18:38:01.542933] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-16T18:38:02.342799] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-16T18:38:02.500197] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T18:38:02.673454] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-16T18:38:03.142817] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-16T18:38:03.942850] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-16T18:38:04.260215] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-16T18:38:04.574432] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T18:38:04.743334] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-16T18:38:04.751864] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T18:38:05.542859] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-16T18:38:06.106762] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-16T18:38:06.342824] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-16T18:38:07.142827] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-16T18:38:07.197979] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-16T18:38:07.564458] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T18:38:07.942847] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-16T18:38:07.975673] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T18:38:08.742881] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-16T18:38:09.542906] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-16T18:38:09.758277] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T18:38:09.765216] [INFO ] [REMOTE ] EFC: Full fetch complete (66794 records). [2025-10-16T18:38:09.765412] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-16T18:38:09.872108] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-16T18:38:09.894883] [INFO ] [REMOTE ] EFT: Full fetch complete (17995 records). [2025-10-16T18:38:09.907787] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-16T18:38:10.353596] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-16T18:38:10.613858] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-16T18:38:10.614025] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-16T18:38:10.614101] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-16T18:38:10.615067] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-16T18:38:10.614178] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-16T18:38:10.615372] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-16T18:38:10.615446] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-16T18:38:10.615664] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-16T18:38:10.616819] [DEBUG] [LOCAL ] EFT: Trimmed 17995 records to 13160 (keeping 200 days of data) [2025-10-16T18:38:10.617953] [DEBUG] [LOCAL ] EFC: Trimmed 66794 records to 46757 (keeping 200 days of data) [2025-10-16T18:38:10.800857] [DEBUG] [LOCAL ] EFT: Primary data saved (13160 records). [2025-10-16T18:38:10.815371] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-16T18:38:10.817053] [INFO ] [MAIN ] Update Progress: 703/2369 symbols completed. EFT took 38.9s. Estimated remaining: 3h 52m 32s. Rate: 7.2 symbols/min [2025-10-16T18:38:11.136621] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:38:11.179336] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T18:38:11.220972] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-16T18:38:11.253350] [DEBUG] [LOCAL ] EFC: Primary data saved (46757 records). [2025-10-16T18:38:11.253852] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-16T18:38:11.254500] [INFO ] [MAIN ] Update Progress: 704/2369 symbols completed. EFC took 45.2s. Estimated remaining: 3h 52m 4s. Rate: 7.2 symbols/min [2025-10-16T18:38:11.255175] [DEBUG] [LOCAL ] EG: Loaded 27797 existing records from primary storage. [2025-10-16T18:38:11.318045] [INFO ] [MAIN ] EG: Loaded 27797 existing records. [2025-10-16T18:38:11.498809] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:38:11.623775] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:38:11.624280] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-16T18:38:11.624375] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-16T18:38:11.643235] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-16T18:38:11.644220] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T18:38:11.644351] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-16T18:38:11.899540] [DEBUG] [LOCAL ] EGO: Loaded 51726 existing records from primary storage. [2025-10-16T18:38:11.943298] [INFO ] [MAIN ] EGO: Loaded 51726 existing records. [2025-10-16T18:38:11.959152] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-16T18:38:12.160727] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:38:12.238604] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:38:12.238847] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-16T18:38:12.238895] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-16T18:38:12.239880] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-16T18:38:12.239938] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-16T18:38:12.600895] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:38:12.742786] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-16T18:38:12.848525] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T18:38:13.236444] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T18:38:13.542838] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-16T18:38:14.342851] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-16T18:38:14.370558] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T18:38:15.142791] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-16T18:38:15.527274] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T18:38:15.655283] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-16T18:38:15.942801] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-16T18:38:16.654600] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T18:38:16.742822] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-16T18:38:17.261904] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T18:38:17.542828] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-16T18:38:18.316375] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T18:38:18.342772] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-16T18:38:18.682671] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T18:38:19.142851] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-16T18:38:19.741998] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T18:38:19.948414] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-16T18:38:19.957305] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-16T18:38:20.742819] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-16T18:38:21.542890] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-16T18:38:21.851905] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-16T18:38:21.858242] [INFO ] [REMOTE ] EFX: Full fetch complete (64966 records). [2025-10-16T18:38:21.858358] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-16T18:38:22.290404] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-16T18:38:22.290522] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-16T18:38:22.291404] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-16T18:38:22.291477] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-16T18:38:22.292793] [DEBUG] [LOCAL ] EFX: Trimmed 64966 records to 45004 (keeping 200 days of data) [2025-10-16T18:38:22.353276] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-16T18:38:22.587199] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-16T18:38:22.649978] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-16T18:38:22.651688] [DEBUG] [LOCAL ] EFX: Primary data saved (45004 records). [2025-10-16T18:38:22.651896] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-16T18:38:22.652822] [INFO ] [MAIN ] Update Progress: 705/2369 symbols completed. EFX took 36.5s. Estimated remaining: 3h 52m 3s. Rate: 7.2 symbols/min [2025-10-16T18:38:22.827076] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:38:22.861477] [DEBUG] [LOCAL ] EGP: Loaded 30418 existing records from primary storage. [2025-10-16T18:38:22.861811] [INFO ] [MAIN ] EGP: Loaded 30418 existing records. [2025-10-16T18:38:23.039540] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:38:23.039779] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-16T18:38:23.039832] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-16T18:38:23.040500] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-16T18:38:23.040557] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-16T18:38:23.147915] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-16T18:38:23.402758] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:38:23.799815] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T18:38:23.942841] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-16T18:38:24.718836] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T18:38:24.742767] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-16T18:38:25.212028] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T18:38:25.542860] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-16T18:38:26.342849] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-16T18:38:26.560117] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T18:38:26.719780] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T18:38:27.142822] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-16T18:38:27.798071] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T18:38:27.942827] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-16T18:38:28.494021] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T18:38:28.742811] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-16T18:38:29.122515] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T18:38:29.127265] [INFO ] [REMOTE ] EFXT: Full fetch complete (44354 records). [2025-10-16T18:38:29.127409] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-16T18:38:29.522379] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-16T18:38:29.522461] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-16T18:38:29.523238] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-16T18:38:29.523308] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-16T18:38:29.524385] [DEBUG] [LOCAL ] EFXT: Trimmed 44354 records to 29940 (keeping 200 days of data) [2025-10-16T18:38:29.573221] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-16T18:38:29.699575] [DEBUG] [LOCAL ] EFXT: Primary data saved (29940 records). [2025-10-16T18:38:29.699900] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-16T18:38:29.700002] [INFO ] [MAIN ] Update Progress: 706/2369 symbols completed. EFXT took 33.1s. Estimated remaining: 3h 51m 52s. Rate: 7.2 symbols/min [2025-10-16T18:38:29.869309] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:38:29.904772] [DEBUG] [LOCAL ] EGY: Loaded 41558 existing records from primary storage. [2025-10-16T18:38:29.905055] [INFO ] [MAIN ] EGY: Loaded 41558 existing records. [2025-10-16T18:38:30.094968] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:38:30.095297] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-16T18:38:30.095374] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-16T18:38:30.102756] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-16T18:38:30.113108] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-16T18:38:30.119713] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T18:38:30.350262] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-16T18:38:30.475615] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:38:30.942401] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T18:38:31.142813] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-16T18:38:31.711758] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-16T18:38:31.942815] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-16T18:38:32.174411] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T18:38:32.742867] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-16T18:38:33.542795] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-16T18:38:33.706576] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T18:38:34.083593] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T18:38:34.342843] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-16T18:38:35.036531] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T18:38:35.142852] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-16T18:38:35.942887] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-16T18:38:35.974278] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T18:38:36.742860] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-16T18:38:36.892576] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T18:38:37.280543] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T18:38:37.542823] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-16T18:38:38.081695] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T18:38:38.342807] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-16T18:38:38.675239] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T18:38:39.142821] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-16T18:38:39.746524] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T18:38:39.942815] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-16T18:38:40.742788] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-16T18:38:40.779867] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T18:38:41.206319] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T18:38:41.542804] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-16T18:38:42.080481] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T18:38:42.342870] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-16T18:38:42.891031] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T18:38:43.142801] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-16T18:38:43.756090] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T18:38:43.942777] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-16T18:38:44.405151] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T18:38:44.742830] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-16T18:38:45.248811] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-16T18:38:45.542868] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-16T18:38:46.269040] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T18:38:46.342798] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-16T18:38:47.001500] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T18:38:47.142803] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-16T18:38:47.183237] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T18:38:47.942820] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-16T18:38:48.743144] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-16T18:38:48.745730] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T18:38:48.910770] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T18:38:49.542790] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-16T18:38:50.079920] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T18:38:50.083790] [INFO ] [REMOTE ] EGP: Full fetch complete (45621 records). [2025-10-16T18:38:50.083914] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-16T18:38:50.352148] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-16T18:38:50.468024] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-16T18:38:50.468109] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-16T18:38:50.468859] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-16T18:38:50.468925] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-16T18:38:50.469974] [DEBUG] [LOCAL ] EGP: Trimmed 45621 records to 30655 (keeping 200 days of data) [2025-10-16T18:38:50.663202] [DEBUG] [LOCAL ] EGP: Primary data saved (30655 records). [2025-10-16T18:38:50.663327] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-16T18:38:50.663405] [INFO ] [MAIN ] Update Progress: 707/2369 symbols completed. EGP took 28.0s. Estimated remaining: 3h 52m 13s. Rate: 7.2 symbols/min [2025-10-16T18:38:50.833160] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:38:50.861900] [DEBUG] [LOCAL ] EHAB: Loaded 29337 existing records from primary storage. [2025-10-16T18:38:50.862158] [INFO ] [MAIN ] EHAB: Loaded 29337 existing records. [2025-10-16T18:38:51.043237] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:38:51.043678] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-16T18:38:51.043754] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-16T18:38:51.043984] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-16T18:38:51.044057] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-16T18:38:51.150843] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-16T18:38:51.170153] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T18:38:51.436587] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:38:51.942867] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-16T18:38:52.598937] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-16T18:38:52.742785] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-16T18:38:52.946882] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T18:38:52.950293] [INFO ] [REMOTE ] EG: Full fetch complete (43191 records). [2025-10-16T18:38:52.950381] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-16T18:38:53.301343] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T18:38:53.359414] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-16T18:38:53.359524] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-16T18:38:53.360471] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-16T18:38:53.360542] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-16T18:38:53.361734] [DEBUG] [LOCAL ] EG: Trimmed 43191 records to 27993 (keeping 200 days of data) [2025-10-16T18:38:53.541212] [DEBUG] [LOCAL ] EG: Primary data saved (27993 records). [2025-10-16T18:38:53.541374] [INFO ] [MAIN ] EG: Full history saved. [2025-10-16T18:38:53.541474] [INFO ] [MAIN ] Update Progress: 708/2369 symbols completed. EG took 42.7s. Estimated remaining: 3h 51m 52s. Rate: 7.2 symbols/min [2025-10-16T18:38:53.552582] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-16T18:38:53.718790] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:38:53.718959] [DEBUG] [LOCAL ] EHC: No existing data file found in primary storage. [2025-10-16T18:38:53.718997] [WARN ] [MAIN ] EHC: No existing data found, performing full refresh instead. [2025-10-16T18:38:53.719133] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-16T18:38:53.719197] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-16T18:38:53.719246] [DEBUG] [LOCAL ] EHC: No primary data file found to delete. [2025-10-16T18:38:53.719278] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-16T18:38:54.077035] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:38:54.316810] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T18:38:54.323541] [INFO ] [REMOTE ] EGO: Full fetch complete (74383 records). [2025-10-16T18:38:54.323732] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-16T18:38:54.354548] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-16T18:38:54.710260] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-16T18:38:54.710367] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-16T18:38:54.711313] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-16T18:38:54.711375] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-16T18:38:54.712732] [DEBUG] [LOCAL ] EGO: Trimmed 74383 records to 52116 (keeping 200 days of data) [2025-10-16T18:38:54.846438] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T18:38:55.051103] [DEBUG] [LOCAL ] EGO: Primary data saved (52116 records). [2025-10-16T18:38:55.051251] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-16T18:38:55.051335] [INFO ] [MAIN ] Update Progress: 709/2369 symbols completed. EGO took 43.8s. Estimated remaining: 3h 51m 27s. Rate: 7.2 symbols/min [2025-10-16T18:38:55.148482] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-16T18:38:55.218137] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:38:55.230524] [DEBUG] [LOCAL ] EHI: Loaded 10605 existing records from primary storage. [2025-10-16T18:38:55.230786] [INFO ] [MAIN ] EHI: Loaded 10605 existing records. [2025-10-16T18:38:55.404372] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:38:55.404614] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-16T18:38:55.404692] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-16T18:38:55.404853] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-16T18:38:55.404891] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-16T18:38:55.698436] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T18:38:55.779450] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:38:55.942822] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-16T18:38:56.444604] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T18:38:56.742815] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-16T18:38:56.959994] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T18:38:57.542811] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-16T18:38:58.126446] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T18:38:58.342804] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-16T18:38:58.895408] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T18:38:59.142809] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-16T18:38:59.942789] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-16T18:38:59.978756] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-16T18:39:00.076571] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T18:39:00.742805] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-16T18:39:00.847774] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T18:39:01.542855] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-16T18:39:01.667948] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-16T18:39:02.342829] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-16T18:39:03.085107] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T18:39:03.142823] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-16T18:39:03.557863] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T18:39:03.583303] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-16T18:39:03.942818] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-16T18:39:04.742820] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-16T18:39:05.185820] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-16T18:39:05.542797] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-16T18:39:06.145941] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T18:39:06.171766] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T18:39:06.342868] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-16T18:39:07.123333] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T18:39:07.142769] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-16T18:39:07.859112] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-16T18:39:07.942772] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-16T18:39:08.719539] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T18:39:08.742790] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-16T18:39:09.542852] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-16T18:39:09.634935] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T18:39:10.342818] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-16T18:39:10.520979] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T18:39:11.142896] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-16T18:39:11.942845] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-16T18:39:11.990266] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T18:39:11.995993] [INFO ] [REMOTE ] EGY: Full fetch complete (61039 records). [2025-10-16T18:39:11.996172] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-16T18:39:12.555409] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-16T18:39:12.555617] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-16T18:39:12.556995] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-16T18:39:12.557110] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-16T18:39:12.558791] [DEBUG] [LOCAL ] EGY: Trimmed 61039 records to 41864 (keeping 200 days of data) [2025-10-16T18:39:12.694930] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T18:39:12.700484] [INFO ] [REMOTE ] EHI: Full fetch complete (16095 records). [2025-10-16T18:39:12.701103] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-16T18:39:12.743895] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-16T18:39:13.208989] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-16T18:39:13.265295] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-16T18:39:13.265738] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-16T18:39:13.266469] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-16T18:39:13.267632] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-16T18:39:13.270348] [DEBUG] [LOCAL ] EHI: Trimmed 16095 records to 10710 (keeping 200 days of data) [2025-10-16T18:39:13.366837] [DEBUG] [LOCAL ] EGY: Primary data saved (41864 records). [2025-10-16T18:39:13.366912] [DEBUG] [LOCAL ] EHI: Primary data saved (10710 records). [2025-10-16T18:39:13.367079] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-16T18:39:13.367190] [INFO ] [MAIN ] Update Progress: 710/2369 symbols completed. EGY took 43.7s. Estimated remaining: 3h 51m 42s. Rate: 7.2 symbols/min [2025-10-16T18:39:13.367275] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-16T18:39:13.378840] [INFO ] [MAIN ] Update Progress: 711/2369 symbols completed. EHI took 18.3s. Estimated remaining: 3h 51m 14s. Rate: 7.2 symbols/min [2025-10-16T18:39:13.545793] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-16T18:39:13.646031] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:39:13.723070] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:39:13.723562] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-16T18:39:13.723709] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-16T18:39:13.723901] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-16T18:39:13.723963] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-16T18:39:13.724016] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-16T18:39:13.724056] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-16T18:39:13.933790] [DEBUG] [LOCAL ] EIC: Loaded 22908 existing records from primary storage. [2025-10-16T18:39:13.983206] [INFO ] [MAIN ] EIC: Loaded 22908 existing records. [2025-10-16T18:39:14.073629] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T18:39:14.319223] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:39:14.314287] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:39:14.319680] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-16T18:39:14.319768] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-16T18:39:14.319953] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-16T18:39:14.319992] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-16T18:39:14.349824] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-16T18:39:14.675767] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:39:15.142797] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-16T18:39:15.211009] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T18:39:15.565252] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-16T18:39:15.567284] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T18:39:15.942817] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-16T18:39:16.742793] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-16T18:39:17.077848] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-16T18:39:17.166448] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T18:39:17.542791] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-16T18:39:18.342785] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-16T18:39:18.662101] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-16T18:39:19.142821] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-16T18:39:19.457216] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-16T18:39:19.474371] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T18:39:19.942838] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-16T18:39:20.742820] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-16T18:39:21.082913] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T18:39:21.542822] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-16T18:39:21.923400] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T18:39:22.335610] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T18:39:22.339353] [INFO ] [REMOTE ] EHAB: Full fetch complete (40939 records). [2025-10-16T18:39:22.339572] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-16T18:39:22.352688] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-16T18:39:22.753282] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-16T18:39:22.753402] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-16T18:39:22.754490] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-16T18:39:22.754561] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-16T18:39:22.756087] [DEBUG] [LOCAL ] EHAB: Trimmed 40939 records to 29476 (keeping 200 days of data) [2025-10-16T18:39:22.937348] [DEBUG] [LOCAL ] EHAB: Primary data saved (29476 records). [2025-10-16T18:39:22.937551] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-16T18:39:22.937680] [INFO ] [MAIN ] Update Progress: 712/2369 symbols completed. EHAB took 32.3s. Estimated remaining: 3h 51m 9s. Rate: 7.2 symbols/min [2025-10-16T18:39:23.115756] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:39:23.116026] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-16T18:39:23.116079] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-16T18:39:23.116204] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-16T18:39:23.116245] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-16T18:39:23.116287] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-16T18:39:23.116319] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-16T18:39:23.148066] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-16T18:39:23.492828] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:39:23.507794] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T18:39:23.942813] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-16T18:39:24.660002] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T18:39:24.742823] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-16T18:39:24.950070] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T18:39:25.542881] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-16T18:39:26.009793] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-16T18:39:26.342840] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-16T18:39:26.492251] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T18:39:27.142823] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-16T18:39:27.560563] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-16T18:39:27.770507] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T18:39:27.942817] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-16T18:39:28.742815] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-16T18:39:29.113740] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-16T18:39:29.230901] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T18:39:29.542812] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-16T18:39:30.342859] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-16T18:39:30.624922] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-16T18:39:30.669914] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-16T18:39:31.142821] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-16T18:39:31.476898] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-16T18:39:31.942930] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-16T18:39:32.742802] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-16T18:39:33.045980] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T18:39:33.148903] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-16T18:39:33.542849] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-16T18:39:33.890873] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-16T18:39:34.342817] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-16T18:39:34.661606] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-16T18:39:35.142825] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-16T18:39:35.942852] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-16T18:39:36.389946] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T18:39:36.742918] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-16T18:39:37.048121] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T18:39:37.155630] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-16T18:39:37.542830] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-16T18:39:38.342824] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-16T18:39:38.752477] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-16T18:39:38.755004] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T18:39:38.762698] [INFO ] [REMOTE ] EHC: Full fetch complete (58844 records). [2025-10-16T18:39:38.762879] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-16T18:39:39.132116] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-16T18:39:39.132193] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-16T18:39:39.132976] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-16T18:39:39.133041] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-16T18:39:39.134178] [DEBUG] [LOCAL ] EHC: Trimmed 58844 records to 41314 (keeping 200 days of data) [2025-10-16T18:39:39.188339] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-16T18:39:39.394171] [DEBUG] [LOCAL ] EHC: Primary data saved (41314 records). [2025-10-16T18:39:39.394329] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-16T18:39:39.394448] [INFO ] [MAIN ] Update Progress: 713/2369 symbols completed. EHC took 45.9s. Estimated remaining: 3h 51m 19s. Rate: 7.2 symbols/min [2025-10-16T18:39:39.564747] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:39:39.564932] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-16T18:39:39.564969] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-16T18:39:39.565081] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-16T18:39:39.565121] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-16T18:39:39.565161] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-16T18:39:39.565193] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-16T18:39:39.814381] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-16T18:39:39.833298] [INFO ] [REMOTE ] EICA: Full fetch complete (1284 records). [2025-10-16T18:39:39.835503] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-16T18:39:39.943729] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-16T18:39:40.020805] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:39:40.099891] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-16T18:39:40.100088] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:39:40.100157] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:39:40.100210] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-16T18:39:40.100284] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-16T18:39:40.100372] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-16T18:39:40.100441] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-16T18:39:40.100501] [INFO ] [MAIN ] Update Progress: 714/2369 symbols completed. EICA took 26.7s. Estimated remaining: 3h 50m 53s. Rate: 7.2 symbols/min [2025-10-16T18:39:40.268148] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:39:40.289031] [DEBUG] [LOCAL ] EIG: Loaded 20221 existing records from primary storage. [2025-10-16T18:39:40.289333] [INFO ] [MAIN ] EIG: Loaded 20221 existing records. [2025-10-16T18:39:40.463366] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:39:40.463621] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-16T18:39:40.463706] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-16T18:39:40.463934] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-16T18:39:40.463989] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-16T18:39:40.565309] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-16T18:39:40.748034] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-16T18:39:40.825064] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:39:41.542805] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-16T18:39:41.733294] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T18:39:42.172401] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-16T18:39:42.342810] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-16T18:39:43.142843] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-16T18:39:43.296357] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T18:39:43.752227] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T18:39:43.942798] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-16T18:39:44.742798] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-16T18:39:44.974049] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T18:39:45.011812] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-16T18:39:45.542821] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-16T18:39:45.950380] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T18:39:46.342849] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-16T18:39:46.847466] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-16T18:39:47.142835] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-16T18:39:47.942842] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-16T18:39:48.022856] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-16T18:39:48.742805] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-16T18:39:48.936140] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T18:39:48.938874] [INFO ] [REMOTE ] EIC: Full fetch complete (34411 records). [2025-10-16T18:39:48.938951] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-16T18:39:49.321130] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-16T18:39:49.321212] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-16T18:39:49.321934] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-16T18:39:49.321999] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-16T18:39:49.322851] [DEBUG] [LOCAL ] EIC: Trimmed 34411 records to 23019 (keeping 200 days of data) [2025-10-16T18:39:49.465232] [DEBUG] [LOCAL ] EIC: Primary data saved (23019 records). [2025-10-16T18:39:49.465370] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-16T18:39:49.465476] [INFO ] [MAIN ] Update Progress: 715/2369 symbols completed. EIC took 36.1s. Estimated remaining: 3h 50m 47s. Rate: 7.2 symbols/min [2025-10-16T18:39:49.550537] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-16T18:39:49.640104] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:39:49.654088] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T18:39:49.702702] [DEBUG] [LOCAL ] EIX: Loaded 53375 existing records from primary storage. [2025-10-16T18:39:49.703024] [INFO ] [MAIN ] EIX: Loaded 53375 existing records. [2025-10-16T18:39:49.878371] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:39:49.878571] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-16T18:39:49.878662] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-16T18:39:49.879577] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-16T18:39:49.879634] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-16T18:39:50.156047] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T18:39:50.231809] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:39:50.342774] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-16T18:39:51.142822] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-16T18:39:51.672808] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-16T18:39:51.942787] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-16T18:39:52.076116] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T18:39:52.401182] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-16T18:39:52.742805] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-16T18:39:53.281115] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-16T18:39:53.542826] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-16T18:39:53.990960] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T18:39:54.342814] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-16T18:39:54.947968] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T18:39:55.142827] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-16T18:39:55.815323] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-16T18:39:55.942807] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-16T18:39:56.742811] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-16T18:39:57.149270] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-16T18:39:57.542796] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-16T18:39:57.803212] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T18:39:58.342816] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-16T18:39:58.474772] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T18:39:59.142866] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-16T18:39:59.509079] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-16T18:39:59.509958] [INFO ] [REMOTE ] EICB: Full fetch complete (2728 records). [2025-10-16T18:39:59.510026] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-16T18:39:59.686145] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-16T18:39:59.686389] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:39:59.686468] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:39:59.686525] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-16T18:39:59.686601] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-16T18:39:59.686695] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-16T18:39:59.686768] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-16T18:39:59.686846] [INFO ] [MAIN ] Update Progress: 716/2369 symbols completed. EICB took 36.7s. Estimated remaining: 3h 50m 43s. Rate: 7.2 symbols/min [2025-10-16T18:39:59.878800] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:39:59.930212] [DEBUG] [LOCAL ] EL: Loaded 53376 existing records from primary storage. [2025-10-16T18:39:59.930504] [INFO ] [MAIN ] EL: Loaded 53376 existing records. [2025-10-16T18:39:59.950993] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-16T18:40:00.132218] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:40:00.140325] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-16T18:40:00.149395] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-16T18:40:00.149720] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-16T18:40:00.150118] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-16T18:40:00.151016] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T18:40:00.517044] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:40:00.742784] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-16T18:40:01.085771] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T18:40:01.542816] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-16T18:40:02.342876] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-16T18:40:03.087798] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T18:40:03.141090] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-16T18:40:03.151234] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-16T18:40:03.641753] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-16T18:40:03.942813] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-16T18:40:04.729927] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-16T18:40:04.742766] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-16T18:40:05.542888] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-16T18:40:05.883606] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-16T18:40:06.265950] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-16T18:40:06.342811] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-16T18:40:06.814841] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-16T18:40:07.142815] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-16T18:40:07.942801] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-16T18:40:08.121172] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T18:40:08.676372] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T18:40:08.742795] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-16T18:40:08.921043] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T18:40:09.542814] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-16T18:40:10.342847] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-16T18:40:10.671415] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-16T18:40:10.933359] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T18:40:11.142866] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-16T18:40:11.746026] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T18:40:11.942782] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-16T18:40:12.742793] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-16T18:40:12.992214] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-16T18:40:13.334571] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-16T18:40:13.542819] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-16T18:40:14.342792] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-16T18:40:14.751158] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T18:40:15.142821] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-16T18:40:15.543223] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T18:40:15.545629] [INFO ] [REMOTE ] EIG: Full fetch complete (27162 records). [2025-10-16T18:40:15.545769] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-16T18:40:15.917686] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-16T18:40:15.918045] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-16T18:40:15.918759] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-16T18:40:15.918820] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-16T18:40:15.919637] [DEBUG] [LOCAL ] EIG: Trimmed 27162 records to 20357 (keeping 200 days of data) [2025-10-16T18:40:15.974454] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-16T18:40:16.054381] [DEBUG] [LOCAL ] EIG: Primary data saved (20357 records). [2025-10-16T18:40:16.054516] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-16T18:40:16.054590] [INFO ] [MAIN ] Update Progress: 717/2369 symbols completed. EIG took 36.0s. Estimated remaining: 3h 50m 53s. Rate: 7.2 symbols/min [2025-10-16T18:40:16.589425] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-16T18:40:16.646430] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (3.10 seconds). [2025-10-16T18:40:16.742828] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-16T18:40:16.929375] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T18:40:17.542844] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-16T18:40:18.342813] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-16T18:40:18.516460] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T18:40:18.980347] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T18:40:18.981874] [INFO ] [REMOTE ] EICC: Full fetch complete (8472 records). [2025-10-16T18:40:18.981944] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-16T18:40:18.982334] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:40:18.982415] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:40:18.982476] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:40:18.982560] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-16T18:40:18.982637] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-16T18:40:18.982733] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-16T18:40:18.982796] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-16T18:40:18.982869] [INFO ] [MAIN ] Update Progress: 718/2369 symbols completed. EICC took 39.6s. Estimated remaining: 3h 50m 32s. Rate: 7.2 symbols/min [2025-10-16T18:40:19.143099] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-16T18:40:19.317745] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T18:40:19.942869] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-16T18:40:20.928012] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T18:40:20.937501] [INFO ] [REMOTE ] EIX: Full fetch complete (77423 records). [2025-10-16T18:40:20.937725] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-16T18:40:21.386792] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-16T18:40:21.441487] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-16T18:40:21.441591] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-16T18:40:21.442676] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-16T18:40:21.442820] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-16T18:40:21.443379] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-16T18:40:21.445383] [DEBUG] [LOCAL ] EIX: Trimmed 77423 records to 53763 (keeping 200 days of data) [2025-10-16T18:40:21.777363] [DEBUG] [LOCAL ] EIX: Primary data saved (53763 records). [2025-10-16T18:40:21.777507] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-16T18:40:21.777589] [INFO ] [MAIN ] Update Progress: 719/2369 symbols completed. EIX took 32.3s. Estimated remaining: 3h 50m 11s. Rate: 7.2 symbols/min [2025-10-16T18:40:23.500485] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-16T18:40:23.511676] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-16T18:40:25.276860] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T18:40:25.288012] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-16T18:40:25.776398] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T18:40:25.783176] [INFO ] [REMOTE ] EL: Full fetch complete (77435 records). [2025-10-16T18:40:25.783301] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-16T18:40:26.182013] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-16T18:40:26.182135] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-16T18:40:26.183571] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-16T18:40:26.183686] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-16T18:40:26.185861] [DEBUG] [LOCAL ] EL: Trimmed 77435 records to 53766 (keeping 200 days of data) [2025-10-16T18:40:26.511107] [DEBUG] [LOCAL ] EL: Primary data saved (53766 records). [2025-10-16T18:40:26.511250] [INFO ] [MAIN ] EL: Full history saved. [2025-10-16T18:40:26.511986] [INFO ] [MAIN ] Update Progress: 720/2369 symbols completed. EL took 26.8s. Estimated remaining: 3h 49m 54s. Rate: 7.2 symbols/min [2025-10-16T18:40:27.143243] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:40:27.200393] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:40:27.198869] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:40:27.256354] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:40:27.262536] [DEBUG] [LOCAL ] ELC: Loaded 3506 existing records from primary storage. [2025-10-16T18:40:27.262957] [INFO ] [MAIN ] ELC: Loaded 3506 existing records. [2025-10-16T18:40:27.486744] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:40:27.498394] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-16T18:40:27.498635] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-16T18:40:27.499488] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-16T18:40:27.499427] [DEBUG] [LOCAL ] ELME: Loaded 39404 existing records from primary storage. [2025-10-16T18:40:27.499709] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-16T18:40:27.534627] [INFO ] [MAIN ] ELME: Loaded 39404 existing records. [2025-10-16T18:40:27.602395] [DEBUG] [LOCAL ] ELF: Loaded 52028 existing records from primary storage. [2025-10-16T18:40:27.661506] [DEBUG] [LOCAL ] ELAN: Loaded 53301 existing records from primary storage. [2025-10-16T18:40:27.691722] [INFO ] [MAIN ] ELF: Loaded 52028 existing records. [2025-10-16T18:40:27.700287] [INFO ] [MAIN ] ELAN: Loaded 53301 existing records. [2025-10-16T18:40:28.216215] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:40:28.312966] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-16T18:40:28.325695] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-16T18:40:28.353041] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:40:28.358861] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:40:28.364762] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-16T18:40:28.370240] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-16T18:40:28.375496] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-16T18:40:28.380714] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-16T18:40:28.364850] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-16T18:40:28.418248] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-16T18:40:28.502706] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-16T18:40:28.488930] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:40:28.508156] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-16T18:40:28.508405] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-16T18:40:28.502786] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-16T18:40:28.513866] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-16T18:40:29.346159] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:40:29.388185] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-16T18:40:29.433218] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T18:40:29.455800] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-16T18:40:29.567443] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:40:29.546226] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:40:29.568276] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-16T18:40:29.568601] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-16T18:40:30.056851] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-16T18:40:30.058394] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-16T18:40:30.532292] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-16T18:40:30.533579] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-16T18:40:30.871924] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T18:40:30.880499] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-16T18:40:30.923842] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-16T18:40:30.925320] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-16T18:40:31.186871] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T18:40:31.197409] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-16T18:40:31.323225] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T18:40:31.336137] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-16T18:40:31.537635] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-16T18:40:31.933621] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T18:40:31.942773] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-16T18:40:32.644417] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T18:40:32.742771] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-16T18:40:33.051090] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T18:40:33.159246] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-16T18:40:33.542869] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-16T18:40:34.132095] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T18:40:34.342870] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-16T18:40:35.021105] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T18:40:35.142807] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-16T18:40:35.942816] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-16T18:40:36.179301] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-16T18:40:36.269907] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T18:40:36.742850] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-16T18:40:37.313881] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T18:40:37.542881] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-16T18:40:37.774471] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T18:40:38.342884] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-16T18:40:38.900727] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-16T18:40:39.142788] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-16T18:40:39.698463] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-16T18:40:39.942845] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-16T18:40:40.532344] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-16T18:40:40.656572] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-16T18:40:40.742798] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-16T18:40:41.287425] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-16T18:40:41.542807] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-16T18:40:42.342809] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-16T18:40:42.891983] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-16T18:40:43.142809] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-16T18:40:43.753029] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-16T18:40:43.942893] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-16T18:40:44.674469] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T18:40:44.742794] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-16T18:40:45.542839] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-16T18:40:45.681171] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T18:40:46.274041] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T18:40:46.342778] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-16T18:40:46.557733] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T18:40:47.142837] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-16T18:40:47.789021] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T18:40:47.942812] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-16T18:40:48.742844] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-16T18:40:49.127016] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-16T18:40:49.542848] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-16T18:40:49.652919] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T18:40:49.924131] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T18:40:50.107907] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T18:40:50.108864] [INFO ] [REMOTE ] ELC: Full fetch complete (5025 records). [2025-10-16T18:40:50.108936] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-16T18:40:50.348026] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-16T18:40:50.468588] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-16T18:40:50.468714] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-16T18:40:50.468870] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-16T18:40:50.468910] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-16T18:40:50.469256] [DEBUG] [LOCAL ] ELC: Trimmed 5025 records to 3525 (keeping 200 days of data) [2025-10-16T18:40:50.490102] [DEBUG] [LOCAL ] ELC: Primary data saved (3525 records). [2025-10-16T18:40:50.490174] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-16T18:40:50.490272] [INFO ] [MAIN ] Update Progress: 721/2369 symbols completed. ELC took 24.0s. Estimated remaining: 3h 50m 21s. Rate: 7.2 symbols/min [2025-10-16T18:40:50.656232] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:40:50.679792] [DEBUG] [LOCAL ] ELP: Loaded 25680 existing records from primary storage. [2025-10-16T18:40:50.680041] [INFO ] [MAIN ] ELP: Loaded 25680 existing records. [2025-10-16T18:40:50.854495] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:40:50.854691] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-16T18:40:50.854747] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-16T18:40:50.855199] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-16T18:40:50.855255] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-16T18:40:51.148042] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-16T18:40:51.208524] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:40:51.942830] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-16T18:40:52.156678] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T18:40:52.594885] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T18:40:52.742820] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-16T18:40:52.960604] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T18:40:53.542861] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-16T18:40:53.876027] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-16T18:40:53.880885] [INFO ] [REMOTE ] ELME: Full fetch complete (55839 records). [2025-10-16T18:40:53.880968] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-16T18:40:53.881547] [FATAL] [VALIDATOR ] ELME: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:40:53.881630] [FATAL] [MAIN ] ELME: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:40:53.881708] [WARN ] [MAIN ] ELME: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:40:53.881758] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-16T18:40:53.881812] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-16T18:40:53.881846] [INFO ] [LOCAL ] ELME: Starting deletion of derivative data. [2025-10-16T18:40:53.882008] [DEBUG] [LOCAL ] ELME: Deleted derivative data file. [2025-10-16T18:40:53.882091] [INFO ] [MAIN ] Update Progress: 722/2369 symbols completed. ELME took 27.4s. Estimated remaining: 3h 50m 1s. Rate: 7.2 symbols/min [2025-10-16T18:40:54.047069] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:40:54.047244] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-16T18:40:54.047280] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-16T18:40:54.047385] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-16T18:40:54.047425] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-16T18:40:54.047464] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-16T18:40:54.047496] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-16T18:40:54.347901] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-16T18:40:54.405510] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:40:55.142842] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-16T18:40:55.373557] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T18:40:55.942790] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-16T18:40:56.238435] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T18:40:56.742809] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-16T18:40:56.786341] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-16T18:40:57.542826] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-16T18:40:57.724135] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T18:40:57.904636] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T18:40:58.342880] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-16T18:40:58.789529] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-16T18:40:59.142885] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-16T18:40:59.440249] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T18:40:59.942868] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-16T18:41:00.742818] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-16T18:41:00.843776] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-16T18:41:00.850709] [INFO ] [REMOTE ] ELAN: Full fetch complete (77068 records). [2025-10-16T18:41:00.850846] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-16T18:41:01.242175] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-16T18:41:01.242291] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-16T18:41:01.243340] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-16T18:41:01.243406] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-16T18:41:01.245021] [DEBUG] [LOCAL ] ELAN: Trimmed 77068 records to 53690 (keeping 200 days of data) [2025-10-16T18:41:01.547133] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-16T18:41:01.565496] [DEBUG] [LOCAL ] ELAN: Primary data saved (53690 records). [2025-10-16T18:41:01.565614] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-16T18:41:01.565721] [INFO ] [MAIN ] Update Progress: 723/2369 symbols completed. ELAN took 35.1s. Estimated remaining: 3h 49m 52s. Rate: 7.2 symbols/min [2025-10-16T18:41:01.738019] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:41:01.784785] [DEBUG] [LOCAL ] ELS: Loaded 49862 existing records from primary storage. [2025-10-16T18:41:01.785319] [INFO ] [MAIN ] ELS: Loaded 49862 existing records. [2025-10-16T18:41:01.983499] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:41:01.983923] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-16T18:41:01.984105] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-16T18:41:01.984385] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-16T18:41:01.984567] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-16T18:41:02.096570] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T18:41:02.249904] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-16T18:41:02.251435] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T18:41:02.344040] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-16T18:41:02.453858] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:41:03.142856] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-16T18:41:03.483511] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-16T18:41:03.692676] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T18:41:03.942827] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-16T18:41:04.742861] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-16T18:41:05.542840] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-16T18:41:06.018419] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-16T18:41:06.024844] [INFO ] [REMOTE ] ELF: Full fetch complete (75507 records). [2025-10-16T18:41:06.024963] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-16T18:41:06.346907] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-16T18:41:06.440182] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-16T18:41:06.440335] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-16T18:41:06.441524] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-16T18:41:06.441692] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-16T18:41:06.469285] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T18:41:06.468003] [DEBUG] [LOCAL ] ELF: Trimmed 75507 records to 52376 (keeping 200 days of data) [2025-10-16T18:41:06.775614] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-16T18:41:06.800131] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T18:41:06.821359] [DEBUG] [LOCAL ] ELF: Primary data saved (52376 records). [2025-10-16T18:41:06.821466] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-16T18:41:06.821536] [INFO ] [MAIN ] Update Progress: 724/2369 symbols completed. ELF took 40.3s. Estimated remaining: 3h 49m 36s. Rate: 7.2 symbols/min [2025-10-16T18:41:06.989084] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:41:07.054627] [DEBUG] [LOCAL ] ELV: Loaded 50691 existing records from primary storage. [2025-10-16T18:41:07.054974] [INFO ] [MAIN ] ELV: Loaded 50691 existing records. [2025-10-16T18:41:07.150091] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-16T18:41:07.232203] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:41:07.232667] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-16T18:41:07.232815] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-16T18:41:07.233035] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-16T18:41:07.233090] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-16T18:41:07.509347] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-16T18:41:07.586188] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:41:07.942811] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-16T18:41:08.742804] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-16T18:41:09.542963] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-16T18:41:09.788230] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T18:41:09.883517] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T18:41:09.913141] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-16T18:41:10.342919] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-16T18:41:11.142914] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-16T18:41:11.411496] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-16T18:41:11.942819] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-16T18:41:12.153626] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T18:41:12.216406] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-16T18:41:12.742832] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-16T18:41:13.542820] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-16T18:41:13.817971] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-16T18:41:14.163046] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T18:41:14.342827] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-16T18:41:15.142826] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-16T18:41:15.942800] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-16T18:41:16.010220] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T18:41:16.234905] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-16T18:41:16.746852] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-16T18:41:16.763902] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T18:41:17.150846] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-16T18:41:17.152055] [INFO ] [REMOTE ] ELPC: Full fetch complete (1394 records). [2025-10-16T18:41:17.152430] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-16T18:41:17.328781] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-16T18:41:17.328999] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:41:17.329071] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:41:17.329144] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-16T18:41:17.329209] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-16T18:41:17.329246] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-16T18:41:17.329287] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-16T18:41:17.329346] [INFO ] [MAIN ] Update Progress: 725/2369 symbols completed. ELPC took 23.4s. Estimated remaining: 3h 49m 33s. Rate: 7.2 symbols/min [2025-10-16T18:41:17.498342] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:41:17.498555] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-16T18:41:17.498630] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-16T18:41:17.498766] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-16T18:41:17.498808] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-16T18:41:17.498848] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-16T18:41:17.498879] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-16T18:41:17.549754] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-16T18:41:17.845932] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:41:18.342820] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-16T18:41:18.542209] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:41:18.542508] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-16T18:41:18.542633] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:41:18.542729] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-16T18:41:18.542805] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:41:18.542875] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-16T18:41:18.542938] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-16T18:41:18.542974] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-16T18:41:18.543011] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-16T18:41:18.543056] [INFO ] [MAIN ] Update Progress: 726/2369 symbols completed. EMA took 1.2s. Estimated remaining: 3h 49m 8s. Rate: 7.2 symbols/min [2025-10-16T18:41:18.719253] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:41:18.740278] [DEBUG] [LOCAL ] EMD: Loaded 20863 existing records from primary storage. [2025-10-16T18:41:18.740520] [INFO ] [MAIN ] EMD: Loaded 20863 existing records. [2025-10-16T18:41:18.913550] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:41:18.913770] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-16T18:41:18.913819] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-16T18:41:18.913999] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-16T18:41:18.914038] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-16T18:41:19.147922] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-16T18:41:19.296100] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:41:19.364899] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T18:41:19.942846] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-16T18:41:20.597296] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T18:41:20.742799] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-16T18:41:21.542875] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-16T18:41:21.785333] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T18:41:22.112750] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T18:41:22.237244] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-16T18:41:22.342810] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-16T18:41:23.142786] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-16T18:41:23.487546] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T18:41:23.942812] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-16T18:41:24.742824] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-16T18:41:24.961611] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T18:41:25.006893] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T18:41:25.542793] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-16T18:41:25.887896] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T18:41:26.342814] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-16T18:41:27.143782] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-16T18:41:27.148599] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T18:41:27.681208] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T18:41:27.854826] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-16T18:41:27.942826] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-16T18:41:28.742815] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-16T18:41:29.038713] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T18:41:29.042268] [INFO ] [REMOTE ] ELP: Full fetch complete (36894 records). [2025-10-16T18:41:29.042379] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-16T18:41:29.437191] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-16T18:41:29.437270] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-16T18:41:29.437916] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-16T18:41:29.437977] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-16T18:41:29.438852] [DEBUG] [LOCAL ] ELP: Trimmed 36894 records to 25881 (keeping 200 days of data) [2025-10-16T18:41:29.544063] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-16T18:41:29.589780] [DEBUG] [LOCAL ] ELP: Primary data saved (25881 records). [2025-10-16T18:41:29.589945] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-16T18:41:29.590046] [INFO ] [MAIN ] Update Progress: 727/2369 symbols completed. ELP took 39.1s. Estimated remaining: 3h 49m 6s. Rate: 7.2 symbols/min [2025-10-16T18:41:29.764569] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T18:41:29.836081] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:41:29.870614] [DEBUG] [LOCAL ] EME: Loaded 30952 existing records from primary storage. [2025-10-16T18:41:29.870995] [INFO ] [MAIN ] EME: Loaded 30952 existing records. [2025-10-16T18:41:30.045921] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:41:30.046172] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-16T18:41:30.046219] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-16T18:41:30.046421] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-16T18:41:30.046477] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-16T18:41:30.354464] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-16T18:41:30.394696] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:41:31.142870] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-16T18:41:31.803757] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-16T18:41:31.942802] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-16T18:41:32.211280] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-16T18:41:32.262169] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T18:41:32.742830] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-16T18:41:33.542795] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-16T18:41:33.653277] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T18:41:34.263157] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T18:41:34.342826] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-16T18:41:34.520067] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T18:41:35.142837] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-16T18:41:35.942783] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-16T18:41:35.985421] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T18:41:36.326097] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-16T18:41:36.747903] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-16T18:41:36.754704] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T18:41:37.542841] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-16T18:41:38.342934] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-16T18:41:38.503682] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T18:41:38.575797] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T18:41:39.142802] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-16T18:41:39.735709] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T18:41:39.942818] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-16T18:41:40.742834] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-16T18:41:40.772905] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-16T18:41:41.150799] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-16T18:41:41.157290] [INFO ] [REMOTE ] ELV: Full fetch complete (73272 records). [2025-10-16T18:41:41.157403] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-16T18:41:41.541038] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-16T18:41:41.541114] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-16T18:41:41.542018] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-16T18:41:41.542080] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-16T18:41:41.542803] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-16T18:41:41.544376] [DEBUG] [LOCAL ] ELV: Trimmed 73272 records to 51042 (keeping 200 days of data) [2025-10-16T18:41:41.867142] [DEBUG] [LOCAL ] ELV: Primary data saved (51042 records). [2025-10-16T18:41:41.867251] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-16T18:41:41.867332] [INFO ] [MAIN ] Update Progress: 728/2369 symbols completed. ELV took 35.0s. Estimated remaining: 3h 49m 6s. Rate: 7.2 symbols/min [2025-10-16T18:41:42.035227] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:41:42.041320] [DEBUG] [LOCAL ] EMF: Loaded 3211 existing records from primary storage. [2025-10-16T18:41:42.041468] [INFO ] [MAIN ] EMF: Loaded 3211 existing records. [2025-10-16T18:41:42.215140] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:41:42.215368] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-16T18:41:42.215439] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-16T18:41:42.215673] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-16T18:41:42.215748] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-16T18:41:42.313688] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T18:41:42.347882] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-16T18:41:42.591417] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:41:43.073441] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T18:41:43.142775] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-16T18:41:43.762808] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T18:41:43.942829] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-16T18:41:44.742796] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-16T18:41:44.886729] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T18:41:44.910426] [INFO ] [REMOTE ] ELS: Full fetch complete (71209 records). [2025-10-16T18:41:44.910588] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-16T18:41:44.911799] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T18:41:45.294988] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-16T18:41:45.295062] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-16T18:41:45.295948] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-16T18:41:45.296009] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-16T18:41:45.297284] [DEBUG] [LOCAL ] ELS: Trimmed 71209 records to 50226 (keeping 200 days of data) [2025-10-16T18:41:45.564794] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-16T18:41:45.602774] [DEBUG] [LOCAL ] ELS: Primary data saved (50226 records). [2025-10-16T18:41:45.602916] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-16T18:41:45.603415] [INFO ] [MAIN ] Update Progress: 729/2369 symbols completed. ELS took 44.0s. Estimated remaining: 3h 48m 47s. Rate: 7.2 symbols/min [2025-10-16T18:41:45.766150] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:41:45.815234] [DEBUG] [LOCAL ] EMN: Loaded 50780 existing records from primary storage. [2025-10-16T18:41:45.815558] [INFO ] [MAIN ] EMN: Loaded 50780 existing records. [2025-10-16T18:41:45.985446] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:41:45.985725] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-16T18:41:45.985779] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-16T18:41:45.986008] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-16T18:41:45.986063] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-16T18:41:46.340666] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:41:46.350374] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-16T18:41:46.368148] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T18:41:46.678530] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T18:41:47.142823] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-16T18:41:47.885089] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T18:41:47.917386] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T18:41:47.942771] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-16T18:41:48.652306] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T18:41:48.742855] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-16T18:41:49.542868] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-16T18:41:50.267387] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-16T18:41:50.266852] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T18:41:50.342870] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-16T18:41:51.143005] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-16T18:41:51.934724] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T18:41:51.944706] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-16T18:41:51.949188] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-16T18:41:52.742859] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-16T18:41:53.542826] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-16T18:41:53.884780] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T18:41:54.342816] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-16T18:41:54.970916] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-16T18:41:55.150608] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-16T18:41:55.155839] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T18:41:55.565754] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-16T18:41:55.651570] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (3.71 seconds). [2025-10-16T18:41:55.654731] [INFO ] [REMOTE ] EMD: Full fetch complete (32118 records). [2025-10-16T18:41:55.654820] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-16T18:41:55.947919] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-16T18:41:56.064124] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-16T18:41:56.064200] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-16T18:41:56.064850] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-16T18:41:56.064910] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-16T18:41:56.065637] [DEBUG] [LOCAL ] EMD: Trimmed 32118 records to 21065 (keeping 200 days of data) [2025-10-16T18:41:56.191570] [DEBUG] [LOCAL ] EMD: Primary data saved (21065 records). [2025-10-16T18:41:56.191723] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-16T18:41:56.191808] [INFO ] [MAIN ] Update Progress: 730/2369 symbols completed. EMD took 37.6s. Estimated remaining: 3h 48m 44s. Rate: 7.2 symbols/min [2025-10-16T18:41:56.356117] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:41:56.370720] [DEBUG] [LOCAL ] EMO: Loaded 13265 existing records from primary storage. [2025-10-16T18:41:56.370945] [INFO ] [MAIN ] EMO: Loaded 13265 existing records. [2025-10-16T18:41:56.543622] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:41:56.543836] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-16T18:41:56.543886] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-16T18:41:56.544036] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-16T18:41:56.544074] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-16T18:41:56.747912] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-16T18:41:56.899873] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:41:57.252904] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-16T18:41:57.542843] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-16T18:41:58.229764] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T18:41:58.302989] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T18:41:58.342894] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-16T18:41:59.142832] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-16T18:41:59.944824] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-16T18:41:59.950204] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T18:41:59.978599] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T18:42:00.339619] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-16T18:42:00.742771] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-16T18:42:01.450343] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T18:42:01.542805] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-16T18:42:02.141592] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T18:42:02.342831] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-16T18:42:03.142865] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-16T18:42:03.478418] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-16T18:42:03.947459] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-16T18:42:03.951181] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-16T18:42:04.742866] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-16T18:42:05.401600] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T18:42:05.405722] [INFO ] [REMOTE ] EME: Full fetch complete (47125 records). [2025-10-16T18:42:05.405847] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-16T18:42:05.527160] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T18:42:05.545992] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-16T18:42:05.791393] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-16T18:42:05.791468] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-16T18:42:05.792164] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-16T18:42:05.792226] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-16T18:42:05.793169] [DEBUG] [LOCAL ] EME: Trimmed 47125 records to 31206 (keeping 200 days of data) [2025-10-16T18:42:05.985233] [DEBUG] [LOCAL ] EME: Primary data saved (31206 records). [2025-10-16T18:42:05.985367] [INFO ] [MAIN ] EME: Full history saved. [2025-10-16T18:42:05.985460] [INFO ] [MAIN ] Update Progress: 731/2369 symbols completed. EME took 36.4s. Estimated remaining: 3h 48m 39s. Rate: 7.2 symbols/min [2025-10-16T18:42:06.160681] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:42:06.165885] [DEBUG] [LOCAL ] EMP: Loaded 3037 existing records from primary storage. [2025-10-16T18:42:06.166178] [INFO ] [MAIN ] EMP: Loaded 3037 existing records. [2025-10-16T18:42:06.241305] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-16T18:42:06.350151] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-16T18:42:06.350073] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:42:06.351149] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-16T18:42:06.351203] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-16T18:42:06.351337] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-16T18:42:06.351374] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-16T18:42:06.706031] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:42:07.112475] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T18:42:07.142808] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-16T18:42:07.942826] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-16T18:42:08.044598] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T18:42:08.630920] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T18:42:08.631920] [INFO ] [REMOTE ] EMF: Full fetch complete (6447 records). [2025-10-16T18:42:08.631988] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-16T18:42:08.747969] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-16T18:42:08.991287] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-16T18:42:08.991363] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-16T18:42:08.991556] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-16T18:42:08.991626] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-16T18:42:08.992046] [DEBUG] [LOCAL ] EMF: Trimmed 6447 records to 3235 (keeping 200 days of data) [2025-10-16T18:42:09.012204] [DEBUG] [LOCAL ] EMF: Primary data saved (3235 records). [2025-10-16T18:42:09.012335] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-16T18:42:09.012418] [INFO ] [MAIN ] Update Progress: 732/2369 symbols completed. EMF took 27.1s. Estimated remaining: 3h 48m 18s. Rate: 7.2 symbols/min [2025-10-16T18:42:09.193087] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:42:09.245537] [DEBUG] [LOCAL ] EMR: Loaded 53206 existing records from primary storage. [2025-10-16T18:42:09.245908] [INFO ] [MAIN ] EMR: Loaded 53206 existing records. [2025-10-16T18:42:09.419842] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:42:09.420058] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-16T18:42:09.420120] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-16T18:42:09.420315] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-16T18:42:09.420352] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-16T18:42:09.557006] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-16T18:42:09.797919] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:42:10.342867] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-16T18:42:10.583628] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T18:42:10.584293] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T18:42:11.142815] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-16T18:42:11.582604] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-16T18:42:11.942790] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-16T18:42:12.136738] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T18:42:12.390099] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T18:42:12.742933] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-16T18:42:13.542806] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-16T18:42:13.611872] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T18:42:14.342826] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-16T18:42:15.142820] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-16T18:42:15.313685] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T18:42:15.692375] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T18:42:15.942783] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-16T18:42:16.103340] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T18:42:16.742813] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-16T18:42:17.542791] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-16T18:42:17.601242] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T18:42:18.002695] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-16T18:42:18.131584] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T18:42:18.342828] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-16T18:42:18.771909] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-16T18:42:19.142843] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-16T18:42:19.942860] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-16T18:42:20.742840] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-16T18:42:21.055298] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-16T18:42:21.365311] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T18:42:21.384454] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T18:42:21.542844] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-16T18:42:22.342861] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-16T18:42:22.593822] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-16T18:42:23.142882] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-16T18:42:23.942819] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-16T18:42:24.114884] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T18:42:24.330422] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T18:42:24.332915] [INFO ] [REMOTE ] EMO: Full fetch complete (17751 records). [2025-10-16T18:42:24.332986] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-16T18:42:24.622133] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-16T18:42:24.697382] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-16T18:42:24.697454] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-16T18:42:24.697864] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-16T18:42:24.697926] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-16T18:42:24.698437] [DEBUG] [LOCAL ] EMO: Trimmed 17751 records to 13368 (keeping 200 days of data) [2025-10-16T18:42:24.755548] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-16T18:42:24.783060] [DEBUG] [LOCAL ] EMO: Primary data saved (13368 records). [2025-10-16T18:42:24.783196] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-16T18:42:24.783280] [INFO ] [MAIN ] Update Progress: 733/2369 symbols completed. EMO took 28.6s. Estimated remaining: 3h 48m 26s. Rate: 7.2 symbols/min [2025-10-16T18:42:24.952507] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:42:25.007597] [DEBUG] [LOCAL ] ENB: Loaded 53513 existing records from primary storage. [2025-10-16T18:42:25.007963] [INFO ] [MAIN ] ENB: Loaded 53513 existing records. [2025-10-16T18:42:25.218756] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:42:25.219035] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-16T18:42:25.219089] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-16T18:42:25.219408] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-16T18:42:25.219478] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-16T18:42:25.544471] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-16T18:42:25.571621] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:42:25.954098] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T18:42:26.248853] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T18:42:26.342797] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-16T18:42:26.986638] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-16T18:42:27.142841] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-16T18:42:27.607055] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-16T18:42:27.942816] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-16T18:42:28.508597] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T18:42:28.742873] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-16T18:42:29.542848] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-16T18:42:30.230708] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T18:42:30.342807] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-16T18:42:30.934167] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T18:42:30.935012] [INFO ] [REMOTE ] EMP: Full fetch complete (4208 records). [2025-10-16T18:42:30.935082] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-16T18:42:31.144420] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-16T18:42:31.292311] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-16T18:42:31.292486] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-16T18:42:31.292637] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-16T18:42:31.292725] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-16T18:42:31.293074] [DEBUG] [LOCAL ] EMP: Trimmed 4208 records to 3045 (keeping 200 days of data) [2025-10-16T18:42:31.311632] [DEBUG] [LOCAL ] EMP: Primary data saved (3045 records). [2025-10-16T18:42:31.311741] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-16T18:42:31.311815] [INFO ] [MAIN ] Update Progress: 734/2369 symbols completed. EMP took 25.3s. Estimated remaining: 3h 48m 14s. Rate: 7.2 symbols/min [2025-10-16T18:42:31.487741] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:42:31.523728] [DEBUG] [LOCAL ] ENIC: Loaded 36700 existing records from primary storage. [2025-10-16T18:42:31.524175] [INFO ] [MAIN ] ENIC: Loaded 36700 existing records. [2025-10-16T18:42:31.732227] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:42:31.733035] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-16T18:42:31.734871] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-16T18:42:31.734990] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-16T18:42:31.746356] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-16T18:42:31.746451] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-16T18:42:31.949746] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-16T18:42:32.105281] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:42:32.732686] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T18:42:32.742947] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-16T18:42:33.542773] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-16T18:42:33.604691] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T18:42:34.342818] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-16T18:42:34.578191] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-16T18:42:35.142819] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-16T18:42:35.233271] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T18:42:35.378824] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T18:42:35.942816] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-16T18:42:36.527162] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T18:42:36.742811] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-16T18:42:37.376792] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T18:42:37.383464] [INFO ] [REMOTE ] EMN: Full fetch complete (72376 records). [2025-10-16T18:42:37.383712] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-16T18:42:37.556806] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-16T18:42:37.776563] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-16T18:42:37.776688] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-16T18:42:37.777680] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-16T18:42:37.777743] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-16T18:42:37.779304] [DEBUG] [LOCAL ] EMN: Trimmed 72376 records to 51134 (keeping 200 days of data) [2025-10-16T18:42:38.085305] [DEBUG] [LOCAL ] EMN: Primary data saved (51134 records). [2025-10-16T18:42:38.085440] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-16T18:42:38.085918] [INFO ] [MAIN ] Update Progress: 735/2369 symbols completed. EMN took 52.5s. Estimated remaining: 3h 48m 2s. Rate: 7.2 symbols/min [2025-10-16T18:42:38.254993] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:42:38.259570] [DEBUG] [LOCAL ] ENO: Loaded 1855 existing records from primary storage. [2025-10-16T18:42:38.259766] [INFO ] [MAIN ] ENO: Loaded 1855 existing records. [2025-10-16T18:42:38.358954] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-16T18:42:38.442030] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:42:38.442565] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-16T18:42:38.469714] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-16T18:42:38.473082] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-16T18:42:38.475040] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T18:42:38.473557] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-16T18:42:38.832864] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:42:39.142858] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-16T18:42:39.452038] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T18:42:39.573863] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T18:42:39.942839] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-16T18:42:40.742778] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-16T18:42:41.116477] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T18:42:41.197969] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-16T18:42:41.228208] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-16T18:42:41.542821] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-16T18:42:42.342791] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-16T18:42:42.996711] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T18:42:43.142810] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-16T18:42:43.942812] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-16T18:42:44.192827] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-16T18:42:44.276779] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T18:42:44.742869] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-16T18:42:45.542879] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-16T18:42:46.020363] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T18:42:46.021979] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-16T18:42:46.031052] [INFO ] [REMOTE ] EMR: Full fetch complete (77242 records). [2025-10-16T18:42:46.031227] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-16T18:42:46.347017] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-16T18:42:46.435702] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-16T18:42:46.435852] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-16T18:42:46.436971] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-16T18:42:46.437096] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-16T18:42:46.438904] [DEBUG] [LOCAL ] EMR: Trimmed 77242 records to 53592 (keeping 200 days of data) [2025-10-16T18:42:46.467559] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T18:42:46.769041] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-16T18:42:46.821083] [DEBUG] [LOCAL ] EMR: Primary data saved (53592 records). [2025-10-16T18:42:46.821251] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-16T18:42:46.821335] [INFO ] [MAIN ] Update Progress: 736/2369 symbols completed. EMR took 37.8s. Estimated remaining: 3h 47m 54s. Rate: 7.2 symbols/min [2025-10-16T18:42:46.986596] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:42:47.026424] [DEBUG] [LOCAL ] ENOV: Loaded 44851 existing records from primary storage. [2025-10-16T18:42:47.026761] [INFO ] [MAIN ] ENOV: Loaded 44851 existing records. [2025-10-16T18:42:47.148031] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-16T18:42:47.212132] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:42:47.212345] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-16T18:42:47.212394] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-16T18:42:47.212591] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-16T18:42:47.212671] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-16T18:42:47.563353] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:42:47.942822] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-16T18:42:48.742876] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-16T18:42:49.060354] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-16T18:42:49.244190] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-16T18:42:49.328980] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T18:42:49.542812] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-16T18:42:49.909617] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-16T18:42:50.342866] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-16T18:42:50.771629] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-16T18:42:51.142805] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-16T18:42:51.642620] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-16T18:42:51.942831] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-16T18:42:52.420896] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-16T18:42:52.742806] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-16T18:42:53.164665] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-16T18:42:53.542818] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-16T18:42:53.974571] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-16T18:42:54.342816] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-16T18:42:55.142803] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-16T18:42:55.590843] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-16T18:42:55.591576] [INFO ] [REMOTE ] ENO: Full fetch complete (3038 records). [2025-10-16T18:42:55.591682] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-16T18:42:55.944386] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-16T18:42:55.944816] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-16T18:42:55.945631] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-16T18:42:55.945819] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-16T18:42:55.946006] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-16T18:42:55.946772] [DEBUG] [LOCAL ] ENO: Trimmed 3038 records to 1865 (keeping 200 days of data) [2025-10-16T18:42:55.980332] [DEBUG] [LOCAL ] ENO: Primary data saved (1865 records). [2025-10-16T18:42:55.981759] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T18:42:55.981873] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-16T18:42:55.990623] [INFO ] [MAIN ] Update Progress: 737/2369 symbols completed. ENO took 17.9s. Estimated remaining: 3h 47m 48s. Rate: 7.2 symbols/min [2025-10-16T18:42:56.152607] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:42:56.193692] [DEBUG] [LOCAL ] ENR: Loaded 43703 existing records from primary storage. [2025-10-16T18:42:56.193983] [INFO ] [MAIN ] ENR: Loaded 43703 existing records. [2025-10-16T18:42:56.371932] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:42:56.372159] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-16T18:42:56.372212] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-16T18:42:56.372405] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-16T18:42:56.372463] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-16T18:42:56.716984] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:42:56.742774] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-16T18:42:57.542888] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-16T18:42:57.827167] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T18:42:58.156805] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T18:42:58.342812] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-16T18:42:59.038345] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T18:42:59.142851] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-16T18:42:59.942790] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-16T18:43:00.118196] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T18:43:00.180984] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T18:43:00.742855] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-16T18:43:01.254137] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T18:43:01.542828] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-16T18:43:02.266373] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T18:43:02.342778] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-16T18:43:03.078494] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T18:43:03.142774] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-16T18:43:03.627374] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T18:43:03.942804] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-16T18:43:04.735527] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T18:43:04.743932] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-16T18:43:05.091926] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T18:43:05.542824] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-16T18:43:06.342789] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-16T18:43:06.673824] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T18:43:06.799485] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-16T18:43:06.809042] [INFO ] [REMOTE ] ENB: Full fetch complete (77656 records). [2025-10-16T18:43:06.809242] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-16T18:43:07.148048] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-16T18:43:07.224720] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-16T18:43:07.224811] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-16T18:43:07.225797] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-16T18:43:07.225860] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-16T18:43:07.227441] [DEBUG] [LOCAL ] ENB: Trimmed 77656 records to 53902 (keeping 200 days of data) [2025-10-16T18:43:07.564513] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T18:43:07.592546] [DEBUG] [LOCAL ] ENB: Primary data saved (53902 records). [2025-10-16T18:43:07.592672] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-16T18:43:07.593273] [INFO ] [MAIN ] Update Progress: 738/2369 symbols completed. ENB took 42.8s. Estimated remaining: 3h 47m 47s. Rate: 7.2 symbols/min [2025-10-16T18:43:07.758165] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:43:07.789199] [DEBUG] [LOCAL ] ENS: Loaded 29689 existing records from primary storage. [2025-10-16T18:43:07.789475] [INFO ] [MAIN ] ENS: Loaded 29689 existing records. [2025-10-16T18:43:07.946914] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-16T18:43:07.968150] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:43:07.969314] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-16T18:43:07.969436] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-16T18:43:07.969802] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-16T18:43:07.969906] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-16T18:43:08.317294] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:43:08.747980] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-16T18:43:08.761163] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T18:43:09.367916] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T18:43:09.542830] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-16T18:43:09.751453] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-16T18:43:10.342874] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-16T18:43:10.909122] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T18:43:11.142861] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-16T18:43:11.591241] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T18:43:11.942813] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-16T18:43:12.748809] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-16T18:43:12.761743] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T18:43:13.168507] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T18:43:13.542859] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-16T18:43:14.342799] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-16T18:43:14.417748] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T18:43:14.886411] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T18:43:15.142823] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-16T18:43:15.515502] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-16T18:43:15.942886] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-16T18:43:16.540677] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T18:43:16.742900] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-16T18:43:17.541831] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T18:43:17.550371] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-16T18:43:17.655373] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T18:43:18.342809] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-16T18:43:18.736945] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T18:43:18.741461] [INFO ] [REMOTE ] ENIC: Full fetch complete (51519 records). [2025-10-16T18:43:18.741588] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-16T18:43:19.118868] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-16T18:43:19.118965] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-16T18:43:19.119761] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-16T18:43:19.119823] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-16T18:43:19.120954] [DEBUG] [LOCAL ] ENIC: Trimmed 51519 records to 36937 (keeping 200 days of data) [2025-10-16T18:43:19.170392] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-16T18:43:19.337099] [DEBUG] [LOCAL ] ENIC: Primary data saved (36937 records). [2025-10-16T18:43:19.337258] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-16T18:43:19.337339] [INFO ] [MAIN ] Update Progress: 739/2369 symbols completed. ENIC took 48.0s. Estimated remaining: 3h 47m 46s. Rate: 7.2 symbols/min [2025-10-16T18:43:19.508482] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:43:19.533764] [DEBUG] [LOCAL ] ENVA: Loaded 25474 existing records from primary storage. [2025-10-16T18:43:19.534160] [INFO ] [MAIN ] ENVA: Loaded 25474 existing records. [2025-10-16T18:43:19.714384] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:43:19.714740] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-16T18:43:19.714816] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-16T18:43:19.722554] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-16T18:43:19.722631] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-16T18:43:19.832448] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T18:43:19.947976] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-16T18:43:20.085794] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:43:20.742863] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-16T18:43:20.907845] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T18:43:21.270219] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-16T18:43:21.542840] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-16T18:43:21.707394] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T18:43:22.342832] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-16T18:43:22.864845] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T18:43:23.142894] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-16T18:43:23.703447] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T18:43:23.942851] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-16T18:43:24.209732] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T18:43:24.742849] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-16T18:43:25.342367] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T18:43:25.542886] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-16T18:43:25.736157] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T18:43:26.342820] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-16T18:43:26.710430] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T18:43:27.142817] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-16T18:43:27.637793] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T18:43:27.942802] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-16T18:43:28.714537] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T18:43:28.719631] [INFO ] [REMOTE ] ENOV: Full fetch complete (63468 records). [2025-10-16T18:43:28.719781] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-16T18:43:28.750557] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-16T18:43:29.110813] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-16T18:43:29.110910] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-16T18:43:29.125737] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-16T18:43:29.125943] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-16T18:43:29.127404] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T18:43:29.133862] [DEBUG] [LOCAL ] ENOV: Trimmed 63468 records to 45134 (keeping 200 days of data) [2025-10-16T18:43:29.393369] [DEBUG] [LOCAL ] ENOV: Primary data saved (45134 records). [2025-10-16T18:43:29.393560] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-16T18:43:29.393681] [INFO ] [MAIN ] Update Progress: 740/2369 symbols completed. ENOV took 42.6s. Estimated remaining: 3h 47m 41s. Rate: 7.2 symbols/min [2025-10-16T18:43:29.558994] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-16T18:43:29.561858] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:43:29.578922] [DEBUG] [LOCAL ] EOD: Loaded 15054 existing records from primary storage. [2025-10-16T18:43:29.579195] [INFO ] [MAIN ] EOD: Loaded 15054 existing records. [2025-10-16T18:43:29.751099] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:43:29.751310] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-16T18:43:29.751365] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-16T18:43:29.751533] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-16T18:43:29.751588] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-16T18:43:30.109751] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:43:30.227447] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T18:43:30.231953] [INFO ] [REMOTE ] ENS: Full fetch complete (42689 records). [2025-10-16T18:43:30.232034] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-16T18:43:30.347890] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-16T18:43:30.595583] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-16T18:43:30.595677] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-16T18:43:30.596276] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-16T18:43:30.596329] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-16T18:43:30.597224] [DEBUG] [LOCAL ] ENS: Trimmed 42689 records to 29991 (keeping 200 days of data) [2025-10-16T18:43:30.784257] [DEBUG] [LOCAL ] ENS: Primary data saved (29991 records). [2025-10-16T18:43:30.784384] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-16T18:43:30.784491] [INFO ] [MAIN ] Update Progress: 741/2369 symbols completed. ENS took 23.2s. Estimated remaining: 3h 47m 17s. Rate: 7.2 symbols/min [2025-10-16T18:43:30.957088] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:43:30.981045] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T18:43:31.043863] [DEBUG] [LOCAL ] EOG: Loaded 53373 existing records from primary storage. [2025-10-16T18:43:31.044186] [INFO ] [MAIN ] EOG: Loaded 53373 existing records. [2025-10-16T18:43:31.146245] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-16T18:43:31.223530] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:43:31.223739] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-16T18:43:31.223791] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-16T18:43:31.223987] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-16T18:43:31.224042] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-16T18:43:31.329710] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T18:43:31.596482] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:43:31.942829] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-16T18:43:32.145132] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-16T18:43:32.742876] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-16T18:43:33.253327] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-16T18:43:33.258788] [INFO ] [REMOTE ] ENR: Full fetch complete (59394 records). [2025-10-16T18:43:33.258922] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-16T18:43:33.549049] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-16T18:43:33.639788] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-16T18:43:33.639863] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-16T18:43:33.640666] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-16T18:43:33.640727] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-16T18:43:33.641856] [DEBUG] [LOCAL ] ENR: Trimmed 59394 records to 44023 (keeping 200 days of data) [2025-10-16T18:43:33.899926] [DEBUG] [LOCAL ] ENR: Primary data saved (44023 records). [2025-10-16T18:43:33.900038] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-16T18:43:33.900473] [INFO ] [MAIN ] Update Progress: 742/2369 symbols completed. ENR took 37.9s. Estimated remaining: 3h 46m 57s. Rate: 7.2 symbols/min [2025-10-16T18:43:34.065480] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:43:34.078382] [DEBUG] [LOCAL ] EOI: Loaded 10670 existing records from primary storage. [2025-10-16T18:43:34.078599] [INFO ] [MAIN ] EOI: Loaded 10670 existing records. [2025-10-16T18:43:34.254409] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:43:34.254724] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-16T18:43:34.254778] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-16T18:43:34.255028] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-16T18:43:34.255083] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-16T18:43:34.350697] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-16T18:43:34.551511] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T18:43:34.628873] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:43:34.728420] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-16T18:43:35.142825] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-16T18:43:35.755113] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T18:43:35.942871] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-16T18:43:36.640822] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-16T18:43:36.742831] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-16T18:43:37.020371] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-16T18:43:37.396245] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-16T18:43:37.542780] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-16T18:43:38.342787] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-16T18:43:38.634060] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T18:43:39.142795] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-16T18:43:39.174850] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T18:43:39.942787] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-16T18:43:40.543177] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T18:43:40.742836] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-16T18:43:40.836962] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T18:43:41.542788] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-16T18:43:41.646598] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T18:43:42.342832] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-16T18:43:42.605011] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T18:43:43.131186] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T18:43:43.142776] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-16T18:43:43.884042] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T18:43:43.942769] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-16T18:43:44.729023] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T18:43:44.742802] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-16T18:43:45.298913] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T18:43:45.542864] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-16T18:43:46.288364] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-16T18:43:46.342794] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-16T18:43:47.142808] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-16T18:43:47.368081] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T18:43:47.942805] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-16T18:43:48.283424] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T18:43:48.437153] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-16T18:43:48.742816] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-16T18:43:49.530471] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-16T18:43:49.542767] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-16T18:43:50.342843] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-16T18:43:50.420879] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T18:43:50.422866] [INFO ] [REMOTE ] EOI: Full fetch complete (16248 records). [2025-10-16T18:43:50.422941] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-16T18:43:50.793901] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-16T18:43:50.793985] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-16T18:43:50.794397] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-16T18:43:50.794464] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-16T18:43:50.795160] [DEBUG] [LOCAL ] EOI: Trimmed 16248 records to 10738 (keeping 200 days of data) [2025-10-16T18:43:50.867901] [DEBUG] [LOCAL ] EOI: Primary data saved (10738 records). [2025-10-16T18:43:50.868093] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-16T18:43:50.868231] [INFO ] [MAIN ] Update Progress: 743/2369 symbols completed. EOI took 17.0s. Estimated remaining: 3h 47m 8s. Rate: 7.2 symbols/min [2025-10-16T18:43:51.109794] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:43:51.130808] [DEBUG] [LOCAL ] EOS: Loaded 15153 existing records from primary storage. [2025-10-16T18:43:51.131101] [INFO ] [MAIN ] EOS: Loaded 15153 existing records. [2025-10-16T18:43:51.148181] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-16T18:43:51.380298] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:43:51.380747] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-16T18:43:51.380850] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-16T18:43:51.381199] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-16T18:43:51.381280] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-16T18:43:51.583735] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T18:43:51.847209] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:43:51.856369] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T18:43:51.942823] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-16T18:43:52.742845] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-16T18:43:52.862223] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T18:43:53.542799] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-16T18:43:53.892994] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T18:43:54.342804] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-16T18:43:54.779987] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T18:43:55.142804] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-16T18:43:55.278869] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T18:43:55.942812] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-16T18:43:56.742851] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-16T18:43:57.062042] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T18:43:57.216077] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-16T18:43:57.219241] [INFO ] [REMOTE ] ENVA: Full fetch complete (36698 records). [2025-10-16T18:43:57.219334] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-16T18:43:57.563471] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-16T18:43:57.604594] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-16T18:43:57.604760] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-16T18:43:57.605671] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-16T18:43:57.605758] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-16T18:43:57.607018] [DEBUG] [LOCAL ] ENVA: Trimmed 36698 records to 25627 (keeping 200 days of data) [2025-10-16T18:43:57.708225] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T18:43:57.779424] [DEBUG] [LOCAL ] ENVA: Primary data saved (25627 records). [2025-10-16T18:43:57.779572] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-16T18:43:57.779681] [INFO ] [MAIN ] Update Progress: 744/2369 symbols completed. ENVA took 38.4s. Estimated remaining: 3h 46m 56s. Rate: 7.2 symbols/min [2025-10-16T18:43:57.945540] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:43:57.955036] [DEBUG] [LOCAL ] EOT: Loaded 6957 existing records from primary storage. [2025-10-16T18:43:57.955255] [INFO ] [MAIN ] EOT: Loaded 6957 existing records. [2025-10-16T18:43:58.136663] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:43:58.136903] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-16T18:43:58.136958] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-16T18:43:58.137186] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-16T18:43:58.137243] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-16T18:43:58.348073] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-16T18:43:58.495771] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:43:58.550022] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T18:43:59.142861] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-16T18:43:59.942791] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-16T18:44:00.007893] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T18:44:00.381258] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-16T18:44:00.742867] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-16T18:44:01.102406] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T18:44:01.542824] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-16T18:44:01.637034] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T18:44:01.641238] [INFO ] [REMOTE ] EOD: Full fetch complete (20919 records). [2025-10-16T18:44:01.641471] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-16T18:44:01.642260] [FATAL] [VALIDATOR ] EOD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:44:01.642390] [FATAL] [MAIN ] EOD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:44:01.642452] [WARN ] [MAIN ] EOD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:44:01.642539] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-16T18:44:01.642630] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-16T18:44:01.642761] [INFO ] [LOCAL ] EOD: Starting deletion of derivative data. [2025-10-16T18:44:01.642975] [DEBUG] [LOCAL ] EOD: Deleted derivative data file. [2025-10-16T18:44:01.643096] [INFO ] [MAIN ] Update Progress: 745/2369 symbols completed. EOD took 32.2s. Estimated remaining: 3h 46m 38s. Rate: 7.2 symbols/min [2025-10-16T18:44:01.819344] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:44:01.845540] [DEBUG] [LOCAL ] EPAC: Loaded 26461 existing records from primary storage. [2025-10-16T18:44:01.845822] [INFO ] [MAIN ] EPAC: Loaded 26461 existing records. [2025-10-16T18:44:02.022802] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:44:02.023036] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-16T18:44:02.023084] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-16T18:44:02.023272] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-16T18:44:02.023329] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-16T18:44:02.359454] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T18:44:02.352989] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-16T18:44:02.403669] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:44:03.142819] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-16T18:44:03.942816] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-16T18:44:04.462749] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-16T18:44:04.545414] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T18:44:04.742821] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-16T18:44:05.049946] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T18:44:05.313584] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-16T18:44:05.542844] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-16T18:44:06.342806] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-16T18:44:06.726688] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-16T18:44:07.142811] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-16T18:44:07.858990] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-16T18:44:07.942825] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-16T18:44:08.182390] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-16T18:44:08.683741] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T18:44:08.742780] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-16T18:44:09.459027] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T18:44:09.542802] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-16T18:44:10.342809] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-16T18:44:10.604842] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T18:44:10.854828] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-16T18:44:11.142803] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-16T18:44:11.948317] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-16T18:44:11.950047] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T18:44:12.742832] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-16T18:44:12.882598] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T18:44:13.542805] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-16T18:44:14.342785] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-16T18:44:14.744342] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-16T18:44:15.032737] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T18:44:15.142803] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-16T18:44:15.165327] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-16T18:44:15.768889] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T18:44:15.942859] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-16T18:44:16.688469] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-16T18:44:16.742830] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-16T18:44:17.542932] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-16T18:44:17.644433] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-16T18:44:18.002613] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T18:44:18.342843] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-16T18:44:19.142783] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-16T18:44:19.580283] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-16T18:44:19.942866] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-16T18:44:20.742856] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-16T18:44:20.940954] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T18:44:20.979390] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-16T18:44:21.317442] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-16T18:44:21.542829] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-16T18:44:22.342798] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-16T18:44:22.441983] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T18:44:23.142849] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-16T18:44:23.942788] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-16T18:44:24.133788] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T18:44:24.186142] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T18:44:24.586025] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T18:44:24.588549] [INFO ] [REMOTE ] EOS: Full fetch complete (23061 records). [2025-10-16T18:44:24.588701] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-16T18:44:24.747109] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-16T18:44:24.957768] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-16T18:44:24.957840] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-16T18:44:24.958315] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-16T18:44:24.958377] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-16T18:44:24.959017] [DEBUG] [LOCAL ] EOS: Trimmed 23061 records to 15236 (keeping 200 days of data) [2025-10-16T18:44:25.050814] [DEBUG] [LOCAL ] EOS: Primary data saved (15236 records). [2025-10-16T18:44:25.050948] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-16T18:44:25.051024] [INFO ] [MAIN ] Update Progress: 746/2369 symbols completed. EOS took 34.2s. Estimated remaining: 3h 47m 2s. Rate: 7.1 symbols/min [2025-10-16T18:44:25.216205] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:44:25.256844] [DEBUG] [LOCAL ] EPAM: Loaded 39462 existing records from primary storage. [2025-10-16T18:44:25.257105] [INFO ] [MAIN ] EPAM: Loaded 39462 existing records. [2025-10-16T18:44:25.434686] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:44:25.435282] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-16T18:44:25.435342] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-16T18:44:25.435708] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-16T18:44:25.435777] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-16T18:44:25.547946] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-16T18:44:25.796296] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:44:26.261756] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T18:44:26.342796] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-16T18:44:26.569344] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T18:44:26.577427] [INFO ] [REMOTE ] EOG: Full fetch complete (77463 records). [2025-10-16T18:44:26.577588] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-16T18:44:27.063307] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-16T18:44:27.063394] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-16T18:44:27.064458] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-16T18:44:27.064527] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-16T18:44:27.066191] [DEBUG] [LOCAL ] EOG: Trimmed 77463 records to 53763 (keeping 200 days of data) [2025-10-16T18:44:27.161120] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-16T18:44:27.408090] [DEBUG] [LOCAL ] EOG: Primary data saved (53763 records). [2025-10-16T18:44:27.408213] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-16T18:44:27.409163] [INFO ] [MAIN ] Update Progress: 747/2369 symbols completed. EOG took 56.6s. Estimated remaining: 3h 46m 41s. Rate: 7.2 symbols/min [2025-10-16T18:44:27.624612] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:44:27.655077] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-16T18:44:27.658750] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T18:44:27.704183] [DEBUG] [LOCAL ] EPC: Loaded 39741 existing records from primary storage. [2025-10-16T18:44:27.704502] [INFO ] [MAIN ] EPC: Loaded 39741 existing records. [2025-10-16T18:44:27.878886] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:44:27.879190] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-16T18:44:27.879240] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-16T18:44:27.879569] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-16T18:44:27.879625] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-16T18:44:27.952974] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-16T18:44:28.288975] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:44:28.740476] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T18:44:28.742262] [INFO ] [REMOTE ] EOT: Full fetch complete (10842 records). [2025-10-16T18:44:28.742348] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-16T18:44:28.747880] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-16T18:44:29.160356] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-16T18:44:29.160451] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-16T18:44:29.160901] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-16T18:44:29.160964] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-16T18:44:29.161571] [DEBUG] [LOCAL ] EOT: Trimmed 10842 records to 7040 (keeping 200 days of data) [2025-10-16T18:44:29.206719] [DEBUG] [LOCAL ] EOT: Primary data saved (7040 records). [2025-10-16T18:44:29.206839] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-16T18:44:29.206918] [INFO ] [MAIN ] Update Progress: 748/2369 symbols completed. EOT took 31.4s. Estimated remaining: 3h 46m 18s. Rate: 7.2 symbols/min [2025-10-16T18:44:29.386259] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:44:29.437862] [DEBUG] [LOCAL ] EPD: Loaded 53611 existing records from primary storage. [2025-10-16T18:44:29.438204] [INFO ] [MAIN ] EPD: Loaded 53611 existing records. [2025-10-16T18:44:29.547975] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-16T18:44:29.612524] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:44:29.612756] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-16T18:44:29.612811] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-16T18:44:29.613228] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-16T18:44:29.613269] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-16T18:44:29.966699] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:44:30.062897] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T18:44:30.342842] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-16T18:44:30.804901] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T18:44:31.142850] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-16T18:44:31.942825] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-16T18:44:32.201699] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-16T18:44:32.257796] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T18:44:32.742850] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-16T18:44:33.308677] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T18:44:33.542868] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-16T18:44:34.024402] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T18:44:34.028140] [INFO ] [REMOTE ] EPAC: Full fetch complete (38784 records). [2025-10-16T18:44:34.028224] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-16T18:44:34.347879] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-16T18:44:34.419402] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-16T18:44:34.419819] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-16T18:44:34.420570] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-16T18:44:34.420631] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-16T18:44:34.421777] [DEBUG] [LOCAL ] EPAC: Trimmed 38784 records to 26765 (keeping 200 days of data) [2025-10-16T18:44:34.587615] [DEBUG] [LOCAL ] EPAC: Primary data saved (26765 records). [2025-10-16T18:44:34.587790] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-16T18:44:34.587876] [INFO ] [MAIN ] Update Progress: 749/2369 symbols completed. EPAC took 32.9s. Estimated remaining: 3h 46m 3s. Rate: 7.2 symbols/min [2025-10-16T18:44:34.759513] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:44:34.799694] [DEBUG] [LOCAL ] EPR: Loaded 43877 existing records from primary storage. [2025-10-16T18:44:34.800008] [INFO ] [MAIN ] EPR: Loaded 43877 existing records. [2025-10-16T18:44:34.992167] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:44:34.992602] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-16T18:44:34.992776] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-16T18:44:34.993255] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-16T18:44:35.006571] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-16T18:44:35.092943] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T18:44:35.147881] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-16T18:44:35.385151] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:44:35.855765] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T18:44:35.942852] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-16T18:44:36.742857] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-16T18:44:36.819302] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T18:44:36.975602] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T18:44:37.542845] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-16T18:44:38.342807] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-16T18:44:38.760795] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-16T18:44:38.826728] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-16T18:44:39.142817] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-16T18:44:39.374984] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T18:44:39.942821] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-16T18:44:40.305312] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T18:44:40.742865] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-16T18:44:41.542807] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-16T18:44:41.683198] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T18:44:42.078515] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-16T18:44:42.342812] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-16T18:44:43.142837] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-16T18:44:43.266894] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T18:44:43.942899] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-16T18:44:44.027758] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T18:44:44.432595] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T18:44:44.742829] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-16T18:44:45.542849] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-16T18:44:45.609859] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T18:44:46.013819] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T18:44:46.342837] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-16T18:44:47.147874] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-16T18:44:47.162747] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T18:44:47.789251] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T18:44:47.942789] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-16T18:44:48.433298] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T18:44:48.742803] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-16T18:44:49.003821] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T18:44:49.542847] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-16T18:44:49.889426] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T18:44:50.342815] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-16T18:44:51.142793] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-16T18:44:51.267518] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T18:44:51.942807] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-16T18:44:52.183298] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T18:44:52.227379] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T18:44:52.742857] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-16T18:44:53.542809] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-16T18:44:53.942863] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-16T18:44:54.163098] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T18:44:54.342779] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-16T18:44:55.142799] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-16T18:44:55.241423] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T18:44:55.463560] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-16T18:44:55.942782] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-16T18:44:56.680080] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T18:44:56.742785] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-16T18:44:57.207781] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T18:44:57.542807] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-16T18:44:58.342839] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-16T18:44:58.383492] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T18:44:58.904128] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T18:44:58.909701] [INFO ] [REMOTE ] EPC: Full fetch complete (57236 records). [2025-10-16T18:44:58.909836] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-16T18:44:59.150406] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-16T18:44:59.367803] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-16T18:44:59.367891] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-16T18:44:59.368936] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-16T18:44:59.369002] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-16T18:44:59.370314] [DEBUG] [LOCAL ] EPC: Trimmed 57236 records to 40042 (keeping 200 days of data) [2025-10-16T18:44:59.639027] [DEBUG] [LOCAL ] EPC: Primary data saved (40042 records). [2025-10-16T18:44:59.639153] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-16T18:44:59.639233] [INFO ] [MAIN ] Update Progress: 750/2369 symbols completed. EPC took 32.2s. Estimated remaining: 3h 46m 31s. Rate: 7.1 symbols/min [2025-10-16T18:44:59.844880] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:44:59.845150] [DEBUG] [LOCAL ] EPRT: No existing data file found in primary storage. [2025-10-16T18:44:59.845219] [WARN ] [MAIN ] EPRT: No existing data found, performing full refresh instead. [2025-10-16T18:44:59.845503] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-16T18:44:59.845576] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-16T18:44:59.845699] [DEBUG] [LOCAL ] EPRT: No primary data file found to delete. [2025-10-16T18:44:59.845826] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-16T18:44:59.949834] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-16T18:45:00.186083] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-16T18:45:00.273985] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:45:00.742867] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-16T18:45:00.895151] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T18:45:01.542794] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-16T18:45:01.557973] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T18:45:01.562791] [INFO ] [REMOTE ] EPAM: Full fetch complete (56315 records). [2025-10-16T18:45:01.562896] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-16T18:45:01.957053] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-16T18:45:01.957158] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-16T18:45:01.958098] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-16T18:45:01.958189] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-16T18:45:01.959603] [DEBUG] [LOCAL ] EPAM: Trimmed 56315 records to 39697 (keeping 200 days of data) [2025-10-16T18:45:02.229010] [DEBUG] [LOCAL ] EPAM: Primary data saved (39697 records). [2025-10-16T18:45:02.229159] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-16T18:45:02.229744] [INFO ] [MAIN ] Update Progress: 751/2369 symbols completed. EPAM took 37.2s. Estimated remaining: 3h 46m 10s. Rate: 7.2 symbols/min [2025-10-16T18:45:02.346858] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-16T18:45:02.421945] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:45:02.436999] [DEBUG] [LOCAL ] EQBK: Loaded 11247 existing records from primary storage. [2025-10-16T18:45:02.437307] [INFO ] [MAIN ] EQBK: Loaded 11247 existing records. [2025-10-16T18:45:02.613574] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:45:02.613830] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-16T18:45:02.613878] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-16T18:45:02.614031] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-16T18:45:02.614068] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-16T18:45:02.964794] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:45:03.103738] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T18:45:03.142771] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-16T18:45:03.216363] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-16T18:45:03.656216] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T18:45:03.942847] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-16T18:45:04.737996] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T18:45:04.746853] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-16T18:45:05.548687] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-16T18:45:05.550729] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T18:45:05.556619] [INFO ] [REMOTE ] EPR: Full fetch complete (63250 records). [2025-10-16T18:45:05.556760] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-16T18:45:05.935426] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-16T18:45:05.935523] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-16T18:45:05.936414] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-16T18:45:05.936477] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-16T18:45:05.937809] [DEBUG] [LOCAL ] EPR: Trimmed 63250 records to 44181 (keeping 200 days of data) [2025-10-16T18:45:06.205460] [DEBUG] [LOCAL ] EPR: Primary data saved (44181 records). [2025-10-16T18:45:06.205630] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-16T18:45:06.205752] [INFO ] [MAIN ] Update Progress: 752/2369 symbols completed. EPR took 31.6s. Estimated remaining: 3h 45m 52s. Rate: 7.2 symbols/min [2025-10-16T18:45:06.320384] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T18:45:06.356349] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-16T18:45:06.393870] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:45:06.448231] [DEBUG] [LOCAL ] EQH: Loaded 52699 existing records from primary storage. [2025-10-16T18:45:06.448559] [INFO ] [MAIN ] EQH: Loaded 52699 existing records. [2025-10-16T18:45:06.626797] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:45:06.627060] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-16T18:45:06.627117] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-16T18:45:06.627849] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-16T18:45:06.627922] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-16T18:45:06.988763] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:45:07.021817] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-16T18:45:07.142811] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-16T18:45:07.224444] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T18:45:07.942820] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-16T18:45:08.693239] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T18:45:08.742785] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-16T18:45:08.939796] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-16T18:45:09.542811] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-16T18:45:10.342825] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-16T18:45:10.795417] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-16T18:45:11.017962] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-16T18:45:11.142838] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-16T18:45:11.195331] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T18:45:11.942864] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-16T18:45:12.742812] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-16T18:45:13.100708] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T18:45:13.110812] [INFO ] [REMOTE ] EPD: Full fetch complete (77780 records). [2025-10-16T18:45:13.110978] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-16T18:45:13.501883] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-16T18:45:13.501965] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-16T18:45:13.502927] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-16T18:45:13.503013] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-16T18:45:13.504664] [DEBUG] [LOCAL ] EPD: Trimmed 77780 records to 54001 (keeping 200 days of data) [2025-10-16T18:45:13.560479] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-16T18:45:13.755408] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T18:45:13.883210] [DEBUG] [LOCAL ] EPD: Primary data saved (54001 records). [2025-10-16T18:45:13.883367] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-16T18:45:13.884268] [INFO ] [MAIN ] Update Progress: 753/2369 symbols completed. EPD took 44.7s. Estimated remaining: 3h 45m 42s. Rate: 7.2 symbols/min [2025-10-16T18:45:14.057368] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:45:14.121756] [DEBUG] [LOCAL ] EQNR: Loaded 53047 existing records from primary storage. [2025-10-16T18:45:14.122158] [INFO ] [MAIN ] EQNR: Loaded 53047 existing records. [2025-10-16T18:45:14.328914] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:45:14.337809] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-16T18:45:14.338974] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-16T18:45:14.342163] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-16T18:45:14.343125] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-16T18:45:14.344550] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-16T18:45:14.344737] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-16T18:45:14.713585] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-16T18:45:14.781729] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:45:15.031222] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T18:45:15.142912] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-16T18:45:15.942819] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-16T18:45:16.742843] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-16T18:45:17.321181] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-16T18:45:17.542800] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-16T18:45:17.661200] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T18:45:18.138480] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T18:45:18.342858] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-16T18:45:18.935704] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T18:45:19.142889] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-16T18:45:19.942830] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-16T18:45:20.234677] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T18:45:20.742828] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-16T18:45:20.996258] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-16T18:45:21.283999] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T18:45:21.480368] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T18:45:21.542828] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-16T18:45:22.342786] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-16T18:45:22.538192] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-16T18:45:23.142840] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-16T18:45:23.942861] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-16T18:45:24.004530] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T18:45:24.742812] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-16T18:45:24.878916] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T18:45:24.922388] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T18:45:25.542933] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-16T18:45:26.342860] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-16T18:45:26.455125] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-16T18:45:26.921341] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T18:45:27.142827] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-16T18:45:27.556740] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T18:45:27.942844] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-16T18:45:28.742839] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-16T18:45:28.835180] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T18:45:29.277178] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T18:45:29.542820] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-16T18:45:29.610695] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T18:45:29.612852] [INFO ] [REMOTE ] EQBK: Full fetch complete (15619 records). [2025-10-16T18:45:29.612942] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-16T18:45:29.977789] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-16T18:45:29.977904] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-16T18:45:29.978283] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-16T18:45:29.978325] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-16T18:45:29.979101] [DEBUG] [LOCAL ] EQBK: Trimmed 15619 records to 11396 (keeping 200 days of data) [2025-10-16T18:45:30.045784] [DEBUG] [LOCAL ] EQBK: Primary data saved (11396 records). [2025-10-16T18:45:30.045909] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-16T18:45:30.045984] [INFO ] [MAIN ] Update Progress: 754/2369 symbols completed. EQBK took 27.8s. Estimated remaining: 3h 45m 50s. Rate: 7.2 symbols/min [2025-10-16T18:45:30.209567] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:45:30.258199] [DEBUG] [LOCAL ] EQR: Loaded 51721 existing records from primary storage. [2025-10-16T18:45:30.258575] [INFO ] [MAIN ] EQR: Loaded 51721 existing records. [2025-10-16T18:45:30.352823] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-16T18:45:30.432081] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:45:30.432324] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-16T18:45:30.432372] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-16T18:45:30.432555] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-16T18:45:30.432593] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-16T18:45:30.803059] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:45:31.142791] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-16T18:45:31.552730] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T18:45:31.942872] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-16T18:45:32.128918] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T18:45:32.742810] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-16T18:45:32.832690] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T18:45:33.548815] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-16T18:45:33.564322] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T18:45:34.322189] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T18:45:34.342794] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-16T18:45:35.142899] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-16T18:45:35.324072] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T18:45:35.942817] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-16T18:45:36.266436] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T18:45:36.678595] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T18:45:36.742898] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-16T18:45:37.451545] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T18:45:37.542833] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-16T18:45:38.342822] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-16T18:45:38.402332] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T18:45:38.818109] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T18:45:38.824897] [INFO ] [REMOTE ] EPRT: Full fetch complete (69351 records). [2025-10-16T18:45:38.825020] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-16T18:45:39.157139] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-16T18:45:39.213268] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-16T18:45:39.213375] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-16T18:45:39.214480] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-16T18:45:39.214544] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-16T18:45:39.215984] [DEBUG] [LOCAL ] EPRT: Trimmed 69351 records to 48889 (keeping 200 days of data) [2025-10-16T18:45:39.534003] [DEBUG] [LOCAL ] EPRT: Primary data saved (48889 records). [2025-10-16T18:45:39.534288] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-16T18:45:39.534382] [INFO ] [MAIN ] Update Progress: 755/2369 symbols completed. EPRT took 39.9s. Estimated remaining: 3h 45m 44s. Rate: 7.1 symbols/min [2025-10-16T18:45:39.701942] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:45:39.702093] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-16T18:45:39.702299] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-16T18:45:39.702461] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-16T18:45:39.702535] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-16T18:45:39.702697] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-16T18:45:39.702802] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-16T18:45:39.944738] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-16T18:45:40.084240] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T18:45:40.108055] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:45:40.447388] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T18:45:40.742795] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-16T18:45:41.542921] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-16T18:45:41.906365] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-16T18:45:41.980349] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-16T18:45:42.342839] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-16T18:45:43.142783] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-16T18:45:43.456393] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-16T18:45:43.463307] [INFO ] [REMOTE ] EQH: Full fetch complete (76607 records). [2025-10-16T18:45:43.463464] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-16T18:45:43.567468] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-16T18:45:43.877875] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-16T18:45:43.877988] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-16T18:45:43.879115] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-16T18:45:43.879202] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-16T18:45:43.880990] [DEBUG] [LOCAL ] EQH: Trimmed 76607 records to 53088 (keeping 200 days of data) [2025-10-16T18:45:43.946888] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-16T18:45:44.008009] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T18:45:44.252898] [DEBUG] [LOCAL ] EQH: Primary data saved (53088 records). [2025-10-16T18:45:44.253032] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-16T18:45:44.253250] [INFO ] [MAIN ] Update Progress: 756/2369 symbols completed. EQH took 38.0s. Estimated remaining: 3h 45m 28s. Rate: 7.2 symbols/min [2025-10-16T18:45:44.341487] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-16T18:45:44.454354] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:45:44.515677] [DEBUG] [LOCAL ] EQT: Loaded 53685 existing records from primary storage. [2025-10-16T18:45:44.516111] [INFO ] [MAIN ] EQT: Loaded 53685 existing records. [2025-10-16T18:45:44.727692] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:45:44.727974] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-16T18:45:44.728024] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-16T18:45:44.728436] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-16T18:45:44.728496] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-16T18:45:44.751783] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-16T18:45:45.125826] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:45:45.542805] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-16T18:45:46.351909] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-16T18:45:46.357416] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T18:45:46.649493] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-16T18:45:47.142833] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-16T18:45:47.403832] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-16T18:45:47.942817] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-16T18:45:48.286665] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-16T18:45:48.662049] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T18:45:48.742783] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-16T18:45:49.542810] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-16T18:45:49.838970] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-16T18:45:50.342846] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-16T18:45:50.528724] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T18:45:51.142809] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-16T18:45:51.942974] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-16T18:45:52.309624] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-16T18:45:52.426851] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-16T18:45:52.433628] [INFO ] [REMOTE ] EQNR: Full fetch complete (77006 records). [2025-10-16T18:45:52.433807] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-16T18:45:52.747989] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-16T18:45:52.836925] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-16T18:45:52.837003] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-16T18:45:52.837990] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-16T18:45:52.838054] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-16T18:45:52.839490] [DEBUG] [LOCAL ] EQNR: Trimmed 77006 records to 53437 (keeping 200 days of data) [2025-10-16T18:45:53.158509] [DEBUG] [LOCAL ] EQNR: Primary data saved (53437 records). [2025-10-16T18:45:53.158813] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-16T18:45:53.159561] [INFO ] [MAIN ] Update Progress: 757/2369 symbols completed. EQNR took 39.3s. Estimated remaining: 3h 45m 21s. Rate: 7.2 symbols/min [2025-10-16T18:45:53.338693] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-16T18:45:53.542837] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-16T18:45:53.903099] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-16T18:45:54.342808] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-16T18:45:54.452214] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T18:45:54.717051] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-16T18:45:55.142842] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-16T18:45:55.942816] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-16T18:45:56.590478] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-16T18:45:56.742789] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-16T18:45:56.915601] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T18:45:57.084585] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-16T18:45:57.542811] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-16T18:45:58.030137] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T18:45:58.031080] [INFO ] [REMOTE ] EQS: Full fetch complete (2394 records). [2025-10-16T18:45:58.031160] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-16T18:45:58.238887] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-16T18:45:58.239131] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:45:58.239204] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:45:58.239278] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-16T18:45:58.239343] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-16T18:45:58.239396] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-16T18:45:58.239465] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-16T18:45:58.239526] [INFO ] [MAIN ] Update Progress: 758/2369 symbols completed. EQS took 18.7s. Estimated remaining: 3h 45m 6s. Rate: 7.2 symbols/min [2025-10-16T18:45:58.342904] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-16T18:45:59.142885] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-16T18:45:59.885457] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T18:45:59.942771] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-16T18:46:00.969046] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T18:46:00.980617] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-16T18:46:01.619543] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T18:46:01.631495] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-16T18:46:02.482064] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T18:46:02.489327] [INFO ] [REMOTE ] EQR: Full fetch complete (74439 records). [2025-10-16T18:46:02.489557] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-16T18:46:02.874522] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-16T18:46:02.874613] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-16T18:46:02.875630] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-16T18:46:02.875721] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-16T18:46:02.877215] [DEBUG] [LOCAL ] EQR: Trimmed 74439 records to 52109 (keeping 200 days of data) [2025-10-16T18:46:03.213431] [DEBUG] [LOCAL ] EQR: Primary data saved (52109 records). [2025-10-16T18:46:03.213594] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-16T18:46:03.214137] [INFO ] [MAIN ] Update Progress: 759/2369 symbols completed. EQR took 33.2s. Estimated remaining: 3h 44m 50s. Rate: 7.2 symbols/min [2025-10-16T18:46:03.663903] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-16T18:46:03.678745] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-16T18:46:05.363555] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T18:46:05.375125] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-16T18:46:07.345069] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-16T18:46:07.355855] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-16T18:46:09.437150] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-16T18:46:09.448883] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-16T18:46:11.153966] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T18:46:11.166250] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-16T18:46:13.274400] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-16T18:46:13.286018] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-16T18:46:15.263331] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-16T18:46:15.272275] [INFO ] [REMOTE ] EQT: Full fetch complete (77860 records). [2025-10-16T18:46:15.272441] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-16T18:46:15.690894] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-16T18:46:15.690987] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-16T18:46:15.692181] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-16T18:46:15.692287] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-16T18:46:15.694127] [DEBUG] [LOCAL ] EQT: Trimmed 77860 records to 54075 (keeping 200 days of data) [2025-10-16T18:46:16.027947] [DEBUG] [LOCAL ] EQT: Primary data saved (54075 records). [2025-10-16T18:46:16.028083] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-16T18:46:16.028166] [INFO ] [MAIN ] Update Progress: 760/2369 symbols completed. EQT took 31.8s. Estimated remaining: 3h 44m 51s. Rate: 7.2 symbols/min [2025-10-16T18:46:16.695307] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:46:16.697696] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:46:16.752171] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:46:16.784567] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:46:16.791243] [DEBUG] [LOCAL ] EQV: Loaded 2688 existing records from primary storage. [2025-10-16T18:46:16.792023] [INFO ] [MAIN ] EQV: Loaded 2688 existing records. [2025-10-16T18:46:17.066063] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:46:17.066445] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-16T18:46:17.066513] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-16T18:46:17.067529] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-16T18:46:17.067365] [DEBUG] [LOCAL ] ERO: Loaded 41875 existing records from primary storage. [2025-10-16T18:46:17.069121] [DEBUG] [LOCAL ] ERJ: Loaded 50317 existing records from primary storage. [2025-10-16T18:46:17.067747] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-16T18:46:17.075495] [INFO ] [MAIN ] ERJ: Loaded 50317 existing records. [2025-10-16T18:46:17.075690] [INFO ] [MAIN ] ERO: Loaded 41875 existing records. [2025-10-16T18:46:17.233957] [DEBUG] [LOCAL ] ES: Loaded 52695 existing records from primary storage. [2025-10-16T18:46:17.278481] [INFO ] [MAIN ] ES: Loaded 52695 existing records. [2025-10-16T18:46:17.736797] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:46:17.849300] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-16T18:46:17.879223] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:46:17.888799] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-16T18:46:17.923925] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:46:17.919999] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-16T18:46:17.939816] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-16T18:46:17.945051] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-16T18:46:17.966025] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-16T18:46:17.950371] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-16T18:46:17.979148] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-16T18:46:17.974694] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-16T18:46:17.985084] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-16T18:46:18.049681] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-16T18:46:18.065377] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-16T18:46:18.294760] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:46:18.371502] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-16T18:46:19.096425] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:46:19.150960] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-16T18:46:19.161964] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:46:19.199979] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-16T18:46:19.207603] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T18:46:19.218441] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-16T18:46:19.242600] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:46:19.243464] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-16T18:46:20.005403] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-16T18:46:20.008041] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-16T18:46:20.558421] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T18:46:20.560598] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-16T18:46:20.598313] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T18:46:20.610337] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-16T18:46:20.720760] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T18:46:20.731197] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-16T18:46:20.799946] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T18:46:20.809123] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-16T18:46:21.123345] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T18:46:21.124761] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-16T18:46:21.594953] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T18:46:21.602776] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-16T18:46:21.643392] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-16T18:46:21.645378] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-16T18:46:22.202499] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-16T18:46:22.203978] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-16T18:46:22.357456] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T18:46:22.376896] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-16T18:46:22.393376] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T18:46:22.403227] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-16T18:46:22.532310] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-16T18:46:22.533869] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-16T18:46:22.910138] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T18:46:22.918247] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-16T18:46:22.987864] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-16T18:46:22.989209] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-16T18:46:23.392781] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-16T18:46:23.395029] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-16T18:46:23.774039] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-16T18:46:23.775311] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-16T18:46:23.818698] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T18:46:23.947877] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-16T18:46:23.965069] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T18:46:24.045825] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T18:46:24.155431] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-16T18:46:24.156328] [INFO ] [REMOTE ] EQV: Full fetch complete (5322 records). [2025-10-16T18:46:24.156418] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-16T18:46:24.509937] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-16T18:46:24.510015] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-16T18:46:24.510159] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-16T18:46:24.510198] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-16T18:46:24.510563] [DEBUG] [LOCAL ] EQV: Trimmed 5322 records to 2745 (keeping 200 days of data) [2025-10-16T18:46:24.526329] [DEBUG] [LOCAL ] EQV: Primary data saved (2745 records). [2025-10-16T18:46:24.526445] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-16T18:46:24.526548] [INFO ] [MAIN ] Update Progress: 761/2369 symbols completed. EQV took 8.5s. Estimated remaining: 3h 44m 43s. Rate: 7.2 symbols/min [2025-10-16T18:46:24.694417] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:46:24.723937] [DEBUG] [LOCAL ] ESAB: Loaded 26058 existing records from primary storage. [2025-10-16T18:46:24.724227] [INFO ] [MAIN ] ESAB: Loaded 26058 existing records. [2025-10-16T18:46:24.754276] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-16T18:46:24.900105] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:46:24.900315] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-16T18:46:24.900365] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-16T18:46:24.900585] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-16T18:46:24.900682] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-16T18:46:25.270960] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:46:25.392891] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T18:46:25.542788] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-16T18:46:25.871956] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T18:46:26.342889] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-16T18:46:27.142801] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-16T18:46:27.347939] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T18:46:27.397260] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-16T18:46:27.942842] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-16T18:46:28.742868] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-16T18:46:28.892463] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T18:46:29.543104] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-16T18:46:29.543026] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T18:46:29.726015] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T18:46:30.342807] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-16T18:46:30.747458] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-16T18:46:31.142818] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-16T18:46:31.942787] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-16T18:46:32.052846] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T18:46:32.742806] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-16T18:46:32.935579] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T18:46:32.975667] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T18:46:33.542824] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-16T18:46:34.342859] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-16T18:46:34.482536] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T18:46:34.725322] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T18:46:35.142802] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-16T18:46:35.476064] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T18:46:35.942873] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-16T18:46:36.742819] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-16T18:46:36.879881] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T18:46:37.299026] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-16T18:46:37.542826] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-16T18:46:38.311823] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T18:46:38.342778] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-16T18:46:38.889511] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T18:46:39.142840] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-16T18:46:39.634389] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T18:46:39.942874] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-16T18:46:40.741526] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T18:46:40.750890] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-16T18:46:41.177709] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T18:46:41.542813] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-16T18:46:42.305994] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T18:46:42.342774] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-16T18:46:42.682845] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-16T18:46:43.142871] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-16T18:46:43.756491] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T18:46:43.762958] [INFO ] [REMOTE ] ERO: Full fetch complete (60389 records). [2025-10-16T18:46:43.763084] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-16T18:46:43.942818] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-16T18:46:44.245836] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-16T18:46:44.246130] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-16T18:46:44.247848] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-16T18:46:44.247957] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-16T18:46:44.273067] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T18:46:44.275566] [DEBUG] [LOCAL ] ERO: Trimmed 60389 records to 42256 (keeping 200 days of data) [2025-10-16T18:46:44.630105] [DEBUG] [LOCAL ] ERO: Primary data saved (42256 records). [2025-10-16T18:46:44.630387] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-16T18:46:44.630513] [INFO ] [MAIN ] Update Progress: 762/2369 symbols completed. ERO took 28.6s. Estimated remaining: 3h 44m 59s. Rate: 7.1 symbols/min [2025-10-16T18:46:44.743137] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-16T18:46:44.902209] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:46:44.924463] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T18:46:44.932518] [INFO ] [REMOTE ] ES: Full fetch complete (76477 records). [2025-10-16T18:46:44.932768] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-16T18:46:45.066153] [DEBUG] [LOCAL ] ESE: Loaded 16509 existing records from primary storage. [2025-10-16T18:46:45.071830] [INFO ] [MAIN ] ESE: Loaded 16509 existing records. [2025-10-16T18:46:45.544185] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-16T18:46:45.548526] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:46:45.566001] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-16T18:46:45.614123] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-16T18:46:45.654482] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-16T18:46:45.654538] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-16T18:46:45.654711] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-16T18:46:45.654856] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-16T18:46:45.655949] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-16T18:46:45.685735] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-16T18:46:45.794234] [DEBUG] [LOCAL ] ES: Trimmed 76477 records to 53077 (keeping 200 days of data) [2025-10-16T18:46:46.135120] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T18:46:46.202523] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:46:46.356354] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-16T18:46:46.402951] [DEBUG] [LOCAL ] ES: Primary data saved (53077 records). [2025-10-16T18:46:46.403060] [INFO ] [MAIN ] ES: Full history saved. [2025-10-16T18:46:46.403137] [INFO ] [MAIN ] Update Progress: 763/2369 symbols completed. ES took 30.4s. Estimated remaining: 3h 44m 37s. Rate: 7.2 symbols/min [2025-10-16T18:46:46.575489] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:46:46.625188] [DEBUG] [LOCAL ] ESI: Loaded 50648 existing records from primary storage. [2025-10-16T18:46:46.625502] [INFO ] [MAIN ] ESI: Loaded 50648 existing records. [2025-10-16T18:46:46.796750] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:46:46.796955] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-16T18:46:46.797002] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-16T18:46:46.797199] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-16T18:46:46.797254] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-16T18:46:47.146663] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-16T18:46:47.146582] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:46:47.224398] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T18:46:47.475440] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T18:46:47.942826] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-16T18:46:48.300845] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-16T18:46:48.415361] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T18:46:48.742816] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-16T18:46:49.542812] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-16T18:46:50.342793] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-16T18:46:50.433294] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T18:46:50.480476] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T18:46:51.142861] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-16T18:46:51.700892] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T18:46:51.942789] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-16T18:46:52.253625] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T18:46:52.742874] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-16T18:46:53.124695] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-16T18:46:53.542895] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-16T18:46:54.055506] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T18:46:54.342859] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-16T18:46:54.586048] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T18:46:55.142868] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-16T18:46:55.657843] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T18:46:55.942817] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-16T18:46:56.704087] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T18:46:56.742772] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-16T18:46:57.026907] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T18:46:57.542878] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-16T18:46:58.264503] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T18:46:58.307315] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T18:46:58.342795] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-16T18:46:59.142786] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-16T18:46:59.156582] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-16T18:46:59.942877] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-16T18:47:00.742877] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-16T18:47:00.984721] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-16T18:47:01.146901] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-16T18:47:01.153281] [INFO ] [REMOTE ] ERJ: Full fetch complete (72845 records). [2025-10-16T18:47:01.153419] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-16T18:47:01.545762] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-16T18:47:01.545300] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-16T18:47:01.546264] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-16T18:47:01.548262] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-16T18:47:01.548442] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-16T18:47:01.550210] [DEBUG] [LOCAL ] ERJ: Trimmed 72845 records to 50694 (keeping 200 days of data) [2025-10-16T18:47:01.856667] [DEBUG] [LOCAL ] ERJ: Primary data saved (50694 records). [2025-10-16T18:47:01.856822] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-16T18:47:01.856906] [INFO ] [MAIN ] Update Progress: 764/2369 symbols completed. ERJ took 45.8s. Estimated remaining: 3h 44m 43s. Rate: 7.1 symbols/min [2025-10-16T18:47:02.029826] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:47:02.065814] [DEBUG] [LOCAL ] ESNT: Loaded 38289 existing records from primary storage. [2025-10-16T18:47:02.066101] [INFO ] [MAIN ] ESNT: Loaded 38289 existing records. [2025-10-16T18:47:02.187627] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T18:47:02.229210] [INFO ] [REMOTE ] ESAB: Full fetch complete (36155 records). [2025-10-16T18:47:02.256058] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-16T18:47:02.263132] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:47:02.264241] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-16T18:47:02.264554] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-16T18:47:02.280273] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-16T18:47:02.290432] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-16T18:47:02.370371] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-16T18:47:02.947956] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T18:47:02.984053] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-16T18:47:02.989664] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-16T18:47:02.995436] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-16T18:47:03.000627] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-16T18:47:03.039342] [DEBUG] [LOCAL ] ESAB: Trimmed 36155 records to 26243 (keeping 200 days of data) [2025-10-16T18:47:03.058309] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:47:03.150823] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-16T18:47:03.228828] [DEBUG] [LOCAL ] ESAB: Primary data saved (26243 records). [2025-10-16T18:47:03.228952] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-16T18:47:03.229030] [INFO ] [MAIN ] Update Progress: 765/2369 symbols completed. ESAB took 38.7s. Estimated remaining: 3h 44m 20s. Rate: 7.2 symbols/min [2025-10-16T18:47:03.398104] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:47:03.441161] [DEBUG] [LOCAL ] ESRT: Loaded 46481 existing records from primary storage. [2025-10-16T18:47:03.441480] [INFO ] [MAIN ] ESRT: Loaded 46481 existing records. [2025-10-16T18:47:03.615772] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:47:03.615960] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-16T18:47:03.616032] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-16T18:47:03.616625] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-16T18:47:03.616745] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-16T18:47:03.947882] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-16T18:47:03.983937] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:47:04.235755] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-16T18:47:04.604297] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T18:47:04.667306] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T18:47:04.669758] [INFO ] [REMOTE ] ESE: Full fetch complete (22666 records). [2025-10-16T18:47:04.669853] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-16T18:47:04.747961] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-16T18:47:05.035688] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-16T18:47:05.035772] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-16T18:47:05.036241] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-16T18:47:05.036302] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-16T18:47:05.036930] [DEBUG] [LOCAL ] ESE: Trimmed 22666 records to 16630 (keeping 200 days of data) [2025-10-16T18:47:05.141326] [DEBUG] [LOCAL ] ESE: Primary data saved (16630 records). [2025-10-16T18:47:05.141480] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-16T18:47:05.141564] [INFO ] [MAIN ] Update Progress: 766/2369 symbols completed. ESE took 20.5s. Estimated remaining: 3h 43m 58s. Rate: 7.2 symbols/min [2025-10-16T18:47:05.307549] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:47:05.341795] [DEBUG] [LOCAL ] ESS: Loaded 30136 existing records from primary storage. [2025-10-16T18:47:05.342078] [INFO ] [MAIN ] ESS: Loaded 30136 existing records. [2025-10-16T18:47:05.515051] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:47:05.515303] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-16T18:47:05.515355] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-16T18:47:05.515576] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-16T18:47:05.515613] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-16T18:47:05.547984] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-16T18:47:05.869911] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:47:05.960322] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-16T18:47:06.342819] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-16T18:47:07.147911] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-16T18:47:07.162795] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T18:47:07.944360] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-16T18:47:07.947894] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T18:47:08.388907] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T18:47:08.742814] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-16T18:47:09.100520] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T18:47:09.542836] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-16T18:47:09.775434] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T18:47:10.342808] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-16T18:47:10.723053] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T18:47:11.142821] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-16T18:47:11.488191] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T18:47:11.942806] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-16T18:47:12.720296] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T18:47:12.742858] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-16T18:47:13.159307] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T18:47:13.542880] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-16T18:47:14.342805] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-16T18:47:14.398535] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T18:47:14.892429] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T18:47:15.142848] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-16T18:47:15.600139] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-16T18:47:15.942811] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-16T18:47:16.114240] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-16T18:47:16.742827] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-16T18:47:17.482844] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T18:47:17.542770] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-16T18:47:17.970149] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T18:47:18.342807] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-16T18:47:19.071671] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T18:47:19.142771] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-16T18:47:19.187895] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T18:47:19.942818] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-16T18:47:20.747941] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-16T18:47:20.766318] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T18:47:21.542786] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-16T18:47:21.651302] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T18:47:22.004753] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T18:47:22.342840] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-16T18:47:22.639158] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-16T18:47:23.142850] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-16T18:47:23.938408] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T18:47:23.945094] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-16T18:47:24.526442] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T18:47:24.742842] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-16T18:47:25.490883] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T18:47:25.542772] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-16T18:47:25.897672] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T18:47:26.342817] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-16T18:47:26.959355] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T18:47:27.142822] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-16T18:47:27.938155] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T18:47:27.946042] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-16T18:47:27.947828] [INFO ] [REMOTE ] ESRT: Full fetch complete (66583 records). [2025-10-16T18:47:27.947957] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-16T18:47:28.342091] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-16T18:47:28.342280] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-16T18:47:28.343242] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-16T18:47:28.343320] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-16T18:47:28.344857] [DEBUG] [LOCAL ] ESRT: Trimmed 66583 records to 46834 (keeping 200 days of data) [2025-10-16T18:47:28.459375] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T18:47:28.647738] [DEBUG] [LOCAL ] ESRT: Primary data saved (46834 records). [2025-10-16T18:47:28.647879] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-16T18:47:28.647960] [INFO ] [MAIN ] Update Progress: 767/2369 symbols completed. ESRT took 25.4s. Estimated remaining: 3h 44m 21s. Rate: 7.1 symbols/min [2025-10-16T18:47:28.748388] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-16T18:47:28.820610] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:47:28.868744] [DEBUG] [LOCAL ] ESTC: Loaded 50337 existing records from primary storage. [2025-10-16T18:47:28.869059] [INFO ] [MAIN ] ESTC: Loaded 50337 existing records. [2025-10-16T18:47:29.049128] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:47:29.049363] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-16T18:47:29.049413] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-16T18:47:29.049798] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-16T18:47:29.049872] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-16T18:47:29.406592] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:47:29.542821] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-16T18:47:29.624688] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T18:47:30.342799] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-16T18:47:30.537307] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T18:47:31.142792] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-16T18:47:31.195815] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T18:47:31.814550] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T18:47:31.821300] [INFO ] [REMOTE ] ESI: Full fetch complete (73174 records). [2025-10-16T18:47:31.821427] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-16T18:47:31.958230] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-16T18:47:32.214427] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-16T18:47:32.214538] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-16T18:47:32.215596] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-16T18:47:32.215733] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-16T18:47:32.217259] [DEBUG] [LOCAL ] ESI: Trimmed 73174 records to 51027 (keeping 200 days of data) [2025-10-16T18:47:32.334451] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T18:47:32.561617] [DEBUG] [LOCAL ] ESI: Primary data saved (51027 records). [2025-10-16T18:47:32.561785] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-16T18:47:32.561887] [INFO ] [MAIN ] Update Progress: 768/2369 symbols completed. ESI took 46.2s. Estimated remaining: 3h 44m 4s. Rate: 7.1 symbols/min [2025-10-16T18:47:32.725938] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:47:32.754625] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-16T18:47:32.777669] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-16T18:47:32.777972] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-16T18:47:32.949147] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:47:32.949342] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-16T18:47:32.949388] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-16T18:47:32.949596] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-16T18:47:32.949680] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-16T18:47:33.297748] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:47:33.542772] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-16T18:47:33.646235] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T18:47:34.183933] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-16T18:47:34.342817] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-16T18:47:35.142829] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-16T18:47:35.469419] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-16T18:47:35.477846] [INFO ] [REMOTE ] ESNT: Full fetch complete (57210 records). [2025-10-16T18:47:35.477970] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-16T18:47:35.829514] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-16T18:47:35.903224] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-16T18:47:35.903299] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-16T18:47:35.904100] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-16T18:47:35.904186] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-16T18:47:35.905314] [DEBUG] [LOCAL ] ESNT: Trimmed 57210 records to 38566 (keeping 200 days of data) [2025-10-16T18:47:35.961393] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-16T18:47:36.159368] [DEBUG] [LOCAL ] ESNT: Primary data saved (38566 records). [2025-10-16T18:47:36.159528] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-16T18:47:36.159613] [INFO ] [MAIN ] Update Progress: 769/2369 symbols completed. ESNT took 34.3s. Estimated remaining: 3h 43m 45s. Rate: 7.2 symbols/min [2025-10-16T18:47:36.331991] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:47:36.345717] [DEBUG] [LOCAL ] ETB: Loaded 11985 existing records from primary storage. [2025-10-16T18:47:36.345964] [INFO ] [MAIN ] ETB: Loaded 11985 existing records. [2025-10-16T18:47:36.536279] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:47:36.536719] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-16T18:47:36.536882] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-16T18:47:36.537053] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-16T18:47:36.537094] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-16T18:47:36.748810] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-16T18:47:37.012475] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:47:37.038065] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-16T18:47:37.542895] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-16T18:47:37.934344] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-16T18:47:37.987331] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T18:47:38.342867] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-16T18:47:38.851720] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T18:47:39.142802] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-16T18:47:39.942793] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-16T18:47:40.342314] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-16T18:47:40.708687] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T18:47:40.742781] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-16T18:47:40.778038] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T18:47:41.542806] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-16T18:47:42.342817] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-16T18:47:42.567610] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T18:47:42.620373] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T18:47:43.142850] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-16T18:47:43.942877] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-16T18:47:44.596599] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-16T18:47:44.618819] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T18:47:44.624112] [INFO ] [REMOTE ] ESS: Full fetch complete (43656 records). [2025-10-16T18:47:44.624252] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-16T18:47:44.747280] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-16T18:47:45.043090] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-16T18:47:45.043166] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-16T18:47:45.043888] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-16T18:47:45.043949] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-16T18:47:45.044819] [DEBUG] [LOCAL ] ESS: Trimmed 43656 records to 30383 (keeping 200 days of data) [2025-10-16T18:47:45.269709] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T18:47:45.284452] [DEBUG] [LOCAL ] ESS: Primary data saved (30383 records). [2025-10-16T18:47:45.285143] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-16T18:47:45.285391] [INFO ] [MAIN ] Update Progress: 770/2369 symbols completed. ESS took 40.1s. Estimated remaining: 3h 43m 38s. Rate: 7.1 symbols/min [2025-10-16T18:47:45.454996] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:47:45.485120] [DEBUG] [LOCAL ] ETD: Loaded 27336 existing records from primary storage. [2025-10-16T18:47:45.485413] [INFO ] [MAIN ] ETD: Loaded 27336 existing records. [2025-10-16T18:47:45.548035] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-16T18:47:45.596989] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T18:47:45.682673] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:47:45.683265] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-16T18:47:45.683348] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-16T18:47:45.683528] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-16T18:47:45.683568] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-16T18:47:46.028809] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:47:46.342845] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-16T18:47:47.115864] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T18:47:47.142767] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-16T18:47:47.795443] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-16T18:47:47.828628] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-16T18:47:47.942783] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-16T18:47:48.742810] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-16T18:47:49.451912] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T18:47:49.542770] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-16T18:47:50.342804] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-16T18:47:51.017832] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-16T18:47:51.041424] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-16T18:47:51.142793] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-16T18:47:51.274519] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T18:47:51.897709] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-16T18:47:51.942775] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-16T18:47:52.496497] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-16T18:47:52.742827] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-16T18:47:53.542851] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-16T18:47:54.342820] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-16T18:47:54.864496] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-16T18:47:54.965107] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T18:47:55.142769] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-16T18:47:55.234899] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-16T18:47:55.942896] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-16T18:47:56.742841] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-16T18:47:57.140332] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-16T18:47:57.147076] [INFO ] [REMOTE ] ESTC: Full fetch complete (72459 records). [2025-10-16T18:47:57.147206] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-16T18:47:57.551523] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-16T18:47:57.547318] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-16T18:47:57.547871] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T18:47:57.552612] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-16T18:47:57.556139] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-16T18:47:57.557135] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-16T18:47:57.558706] [DEBUG] [LOCAL ] ESTC: Trimmed 72459 records to 50722 (keeping 200 days of data) [2025-10-16T18:47:57.860424] [DEBUG] [LOCAL ] ESTC: Primary data saved (50722 records). [2025-10-16T18:47:57.860812] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-16T18:47:57.861499] [INFO ] [MAIN ] Update Progress: 771/2369 symbols completed. ESTC took 29.2s. Estimated remaining: 3h 43m 39s. Rate: 7.1 symbols/min [2025-10-16T18:47:58.034160] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:47:58.054273] [DEBUG] [LOCAL ] ETG: Loaded 16670 existing records from primary storage. [2025-10-16T18:47:58.054543] [INFO ] [MAIN ] ETG: Loaded 16670 existing records. [2025-10-16T18:47:58.244881] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-16T18:47:58.331477] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:47:58.332586] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-16T18:47:58.332839] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-16T18:47:58.333245] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-16T18:47:58.333442] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-16T18:47:58.348108] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-16T18:47:58.391169] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T18:47:58.705990] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:47:59.142854] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-16T18:47:59.222822] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T18:47:59.942885] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-16T18:48:00.742890] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-16T18:48:00.976891] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T18:48:01.542862] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-16T18:48:01.861707] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T18:48:01.942838] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-16T18:48:02.342847] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-16T18:48:02.624909] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T18:48:03.142813] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-16T18:48:03.942788] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-16T18:48:04.124908] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T18:48:04.601307] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-16T18:48:04.624428] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-16T18:48:04.742791] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-16T18:48:05.542854] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-16T18:48:06.342798] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-16T18:48:06.662030] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T18:48:06.816941] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-16T18:48:06.827218] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-16T18:48:06.827415] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-16T18:48:07.146849] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-16T18:48:07.141637] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T18:48:07.173712] [INFO ] [REMOTE ] ETB: Full fetch complete (18304 records). [2025-10-16T18:48:07.191822] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-16T18:48:07.311753] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-16T18:48:07.327678] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-16T18:48:07.329307] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-16T18:48:07.340798] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-16T18:48:07.401876] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 54179 (keeping 200 days of data) [2025-10-16T18:48:07.726745] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-16T18:48:07.729675] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-16T18:48:07.730295] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-16T18:48:07.736471] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-16T18:48:07.742714] [DEBUG] [LOCAL ] ETB: Trimmed 18304 records to 12026 (keeping 200 days of data) [2025-10-16T18:48:07.924604] [DEBUG] [LOCAL ] ETB: Primary data saved (12026 records). [2025-10-16T18:48:07.929325] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-16T18:48:07.929748] [INFO ] [MAIN ] Update Progress: 772/2369 symbols completed. ETB took 31.8s. Estimated remaining: 3h 43m 34s. Rate: 7.1 symbols/min [2025-10-16T18:48:07.952179] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-16T18:48:08.131197] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:48:08.249186] [DEBUG] [LOCAL ] ETJ: Loaded 16847 existing records from primary storage. [2025-10-16T18:48:08.258362] [INFO ] [MAIN ] ETJ: Loaded 16847 existing records. [2025-10-16T18:48:08.258527] [DEBUG] [LOCAL ] ET: Primary data saved (54179 records). [2025-10-16T18:48:08.279636] [INFO ] [MAIN ] ET: Full history saved. [2025-10-16T18:48:08.290234] [INFO ] [MAIN ] Update Progress: 773/2369 symbols completed. ET took 35.7s. Estimated remaining: 3h 43m 9s. Rate: 7.2 symbols/min [2025-10-16T18:48:08.485855] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T18:48:08.613533] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:48:08.627458] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-16T18:48:08.642022] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-16T18:48:08.644879] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-16T18:48:08.644973] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-16T18:48:08.644837] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:48:08.746766] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-16T18:48:09.022897] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:48:09.052637] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T18:48:09.059061] [DEBUG] [LOCAL ] ETN: Loaded 52641 existing records from primary storage. [2025-10-16T18:48:09.059625] [INFO ] [MAIN ] ETN: Loaded 52641 existing records. [2025-10-16T18:48:09.265399] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:48:09.265716] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-16T18:48:09.265776] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-16T18:48:09.266004] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-16T18:48:09.266059] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-16T18:48:09.543158] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-16T18:48:09.630423] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:48:09.875971] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-16T18:48:10.153403] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-16T18:48:10.342822] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-16T18:48:11.142887] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-16T18:48:11.315223] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T18:48:11.942876] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-16T18:48:12.742862] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T18:48:12.743040] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-16T18:48:13.016616] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-16T18:48:13.542800] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-16T18:48:13.781472] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T18:48:14.342864] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-16T18:48:14.634615] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T18:48:15.142848] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-16T18:48:15.366372] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T18:48:15.942866] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-16T18:48:16.307941] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T18:48:16.742807] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-16T18:48:17.542775] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-16T18:48:17.661923] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T18:48:17.782465] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T18:48:18.342912] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-16T18:48:18.837298] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T18:48:18.851672] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-16T18:48:19.142851] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-16T18:48:19.942853] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-16T18:48:20.163222] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T18:48:20.742823] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-16T18:48:21.018929] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T18:48:21.542834] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-16T18:48:22.277891] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T18:48:22.342829] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-16T18:48:22.771821] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-16T18:48:22.775430] [INFO ] [REMOTE ] ETD: Full fetch complete (38676 records). [2025-10-16T18:48:22.775522] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-16T18:48:23.144710] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-16T18:48:23.156624] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-16T18:48:23.156740] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-16T18:48:23.157440] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-16T18:48:23.157633] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-16T18:48:23.168425] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T18:48:23.172504] [DEBUG] [LOCAL ] ETD: Trimmed 38676 records to 27518 (keeping 200 days of data) [2025-10-16T18:48:23.346163] [DEBUG] [LOCAL ] ETD: Primary data saved (27518 records). [2025-10-16T18:48:23.346314] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-16T18:48:23.346436] [INFO ] [MAIN ] Update Progress: 774/2369 symbols completed. ETD took 38.1s. Estimated remaining: 3h 43m 14s. Rate: 7.1 symbols/min [2025-10-16T18:48:23.563465] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:48:23.573988] [DEBUG] [LOCAL ] ETO: Loaded 6976 existing records from primary storage. [2025-10-16T18:48:23.574228] [INFO ] [MAIN ] ETO: Loaded 6976 existing records. [2025-10-16T18:48:23.784336] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:48:23.784551] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-16T18:48:23.784600] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-16T18:48:23.784776] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-16T18:48:23.784841] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-16T18:48:23.953224] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-16T18:48:24.137369] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:48:24.742811] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-16T18:48:25.050015] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T18:48:25.215064] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-16T18:48:25.266661] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-16T18:48:25.542823] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-16T18:48:26.003849] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-16T18:48:26.342818] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-16T18:48:27.124498] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-16T18:48:27.142769] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-16T18:48:27.942786] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-16T18:48:28.097422] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T18:48:28.742837] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-16T18:48:29.336101] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T18:48:29.542896] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-16T18:48:29.683931] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T18:48:30.342833] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-16T18:48:30.570445] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T18:48:30.956987] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T18:48:31.142838] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-16T18:48:31.917056] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T18:48:31.942777] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-16T18:48:32.742799] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-16T18:48:32.916344] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T18:48:33.447047] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T18:48:33.542783] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-16T18:48:34.272459] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-16T18:48:34.342812] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-16T18:48:35.142814] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-16T18:48:35.166341] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T18:48:35.942804] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-16T18:48:36.742799] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-16T18:48:36.820520] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T18:48:36.823072] [INFO ] [REMOTE ] ETJ: Full fetch complete (25591 records). [2025-10-16T18:48:36.823144] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-16T18:48:37.191724] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-16T18:48:37.191892] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-16T18:48:37.192546] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-16T18:48:37.192622] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-16T18:48:37.193589] [DEBUG] [LOCAL ] ETJ: Trimmed 25591 records to 16898 (keeping 200 days of data) [2025-10-16T18:48:37.299509] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-16T18:48:37.334336] [DEBUG] [LOCAL ] ETJ: Primary data saved (16898 records). [2025-10-16T18:48:37.334455] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-16T18:48:37.334551] [INFO ] [MAIN ] Update Progress: 775/2369 symbols completed. ETJ took 29.4s. Estimated remaining: 3h 43m 17s. Rate: 7.1 symbols/min [2025-10-16T18:48:37.513431] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:48:37.519873] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-16T18:48:37.553795] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-16T18:48:37.575334] [DEBUG] [LOCAL ] ETR: Loaded 53210 existing records from primary storage. [2025-10-16T18:48:37.575697] [INFO ] [MAIN ] ETR: Loaded 53210 existing records. [2025-10-16T18:48:37.753973] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:48:37.754229] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-16T18:48:37.754286] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-16T18:48:37.754563] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-16T18:48:37.754621] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-16T18:48:38.114126] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:48:38.342839] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-16T18:48:38.375256] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T18:48:38.807741] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-16T18:48:39.142837] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-16T18:48:39.942826] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-16T18:48:40.742860] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-16T18:48:40.839054] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T18:48:40.874180] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T18:48:40.878076] [INFO ] [REMOTE ] ETG: Full fetch complete (24867 records). [2025-10-16T18:48:40.878206] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-16T18:48:41.262489] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-16T18:48:41.273331] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-16T18:48:41.273406] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-16T18:48:41.275568] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-16T18:48:41.275672] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-16T18:48:41.276490] [DEBUG] [LOCAL ] ETG: Trimmed 24867 records to 16789 (keeping 200 days of data) [2025-10-16T18:48:41.382925] [DEBUG] [LOCAL ] ETG: Primary data saved (16789 records). [2025-10-16T18:48:41.383071] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-16T18:48:41.383151] [INFO ] [MAIN ] Update Progress: 776/2369 symbols completed. ETG took 43.5s. Estimated remaining: 3h 42m 60s. Rate: 7.1 symbols/min [2025-10-16T18:48:41.543959] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-16T18:48:41.555466] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:48:41.608173] [DEBUG] [LOCAL ] ETSY: Loaded 53577 existing records from primary storage. [2025-10-16T18:48:41.608474] [INFO ] [MAIN ] ETSY: Loaded 53577 existing records. [2025-10-16T18:48:41.794626] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:48:41.794838] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-16T18:48:41.795077] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-16T18:48:41.795964] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-16T18:48:41.796024] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-16T18:48:42.152801] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:48:42.342810] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2024-12. [2025-10-16T18:48:43.043814] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T18:48:43.142778] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-16T18:48:43.805076] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T18:48:43.942781] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-16T18:48:44.742841] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-16T18:48:45.294277] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-16T18:48:45.471924] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T18:48:45.542804] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-16T18:48:46.342844] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-16T18:48:46.496436] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T18:48:46.962235] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:48:47.135370] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T18:48:47.137158] [INFO ] [REMOTE ] ETO: Full fetch complete (9757 records). [2025-10-16T18:48:47.137226] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-16T18:48:47.148492] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-16T18:48:47.494039] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-16T18:48:47.494111] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-16T18:48:47.494334] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-16T18:48:47.494372] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-16T18:48:47.494808] [DEBUG] [LOCAL ] ETO: Trimmed 9757 records to 7024 (keeping 200 days of data) [2025-10-16T18:48:47.536139] [DEBUG] [LOCAL ] ETO: Primary data saved (7024 records). [2025-10-16T18:48:47.536232] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-16T18:48:47.536307] [INFO ] [MAIN ] Update Progress: 777/2369 symbols completed. ETO took 24.2s. Estimated remaining: 3h 42m 47s. Rate: 7.1 symbols/min [2025-10-16T18:48:47.707961] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:48:47.730627] [DEBUG] [LOCAL ] ETV: Loaded 22258 existing records from primary storage. [2025-10-16T18:48:47.730900] [INFO ] [MAIN ] ETV: Loaded 22258 existing records. [2025-10-16T18:48:47.904071] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:48:47.904299] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-16T18:48:47.904351] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-16T18:48:47.904588] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-16T18:48:47.904675] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-16T18:48:47.947877] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-16T18:48:48.253205] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:48:48.742799] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-16T18:48:49.414681] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-16T18:48:49.489538] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T18:48:49.542774] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-16T18:48:49.993542] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T18:48:50.342846] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-16T18:48:51.087308] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T18:48:51.142786] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-16T18:48:51.240952] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T18:48:51.942801] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-16T18:48:52.708682] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T18:48:52.742812] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-16T18:48:53.542848] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-16T18:48:53.765286] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T18:48:54.068889] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T18:48:54.342908] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-16T18:48:55.142794] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-16T18:48:55.306637] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T18:48:55.855492] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T18:48:55.931530] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-16T18:48:55.942790] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-16T18:48:56.742841] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-16T18:48:57.542827] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-16T18:48:57.689917] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T18:48:58.342856] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-16T18:48:58.545571] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T18:48:58.567852] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T18:48:59.142812] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-16T18:48:59.811084] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T18:48:59.942773] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-16T18:49:00.210879] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-16T18:49:00.742784] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-16T18:49:01.542796] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-16T18:49:01.802708] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-16T18:49:01.812045] [INFO ] [REMOTE ] ETSY: Full fetch complete (77666 records). [2025-10-16T18:49:01.812350] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-16T18:49:02.085422] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T18:49:02.259811] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-16T18:49:02.259899] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-16T18:49:02.260929] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-16T18:49:02.260997] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-16T18:49:02.262532] [DEBUG] [LOCAL ] ETSY: Trimmed 77666 records to 53966 (keeping 200 days of data) [2025-10-16T18:49:02.346574] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-16T18:49:02.579336] [DEBUG] [LOCAL ] ETSY: Primary data saved (53966 records). [2025-10-16T18:49:02.579489] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-16T18:49:02.580421] [INFO ] [MAIN ] Update Progress: 778/2369 symbols completed. ETSY took 21.2s. Estimated remaining: 3h 42m 52s. Rate: 7.1 symbols/min [2025-10-16T18:49:02.744487] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:49:02.770294] [DEBUG] [LOCAL ] ETW: Loaded 25583 existing records from primary storage. [2025-10-16T18:49:02.770547] [INFO ] [MAIN ] ETW: Loaded 25583 existing records. [2025-10-16T18:49:02.972425] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:49:02.972827] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-16T18:49:02.972939] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-16T18:49:02.973279] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-16T18:49:02.973357] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-16T18:49:03.145965] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-16T18:49:03.335318] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T18:49:03.375949] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:49:03.942836] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-16T18:49:04.381440] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-16T18:49:04.416257] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-16T18:49:04.422752] [INFO ] [REMOTE ] ETN: Full fetch complete (76657 records). [2025-10-16T18:49:04.422865] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-16T18:49:04.745442] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-16T18:49:04.829470] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-16T18:49:04.830086] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-16T18:49:04.830514] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-16T18:49:04.831779] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-16T18:49:04.837217] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-16T18:49:04.838717] [DEBUG] [LOCAL ] ETN: Trimmed 76657 records to 53020 (keeping 200 days of data) [2025-10-16T18:49:05.166880] [DEBUG] [LOCAL ] ETN: Primary data saved (53020 records). [2025-10-16T18:49:05.167051] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-16T18:49:05.167151] [INFO ] [MAIN ] Update Progress: 779/2369 symbols completed. ETN took 56.9s. Estimated remaining: 3h 42m 32s. Rate: 7.1 symbols/min [2025-10-16T18:49:05.331725] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:49:05.341977] [DEBUG] [LOCAL ] ETX: Loaded 5256 existing records from primary storage. [2025-10-16T18:49:05.342162] [INFO ] [MAIN ] ETX: Loaded 5256 existing records. [2025-10-16T18:49:05.513588] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:49:05.513783] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-16T18:49:05.513831] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-16T18:49:05.513970] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-16T18:49:05.514007] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-16T18:49:05.548060] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-16T18:49:05.865298] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:49:06.342843] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-16T18:49:06.491036] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T18:49:06.626474] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T18:49:07.142823] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-16T18:49:07.415329] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T18:49:07.942817] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-16T18:49:08.725991] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T18:49:08.742779] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-16T18:49:09.542861] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-16T18:49:09.890624] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T18:49:10.342857] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-16T18:49:11.142877] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-16T18:49:11.465589] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T18:49:11.486288] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (4.34 seconds). [2025-10-16T18:49:11.657601] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-16T18:49:11.805053] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-16T18:49:11.942863] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-16T18:49:12.742820] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-16T18:49:13.119733] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T18:49:13.542866] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-16T18:49:13.652068] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T18:49:14.342776] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-16T18:49:14.586994] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T18:49:15.142781] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-16T18:49:15.390239] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-16T18:49:15.942785] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-16T18:49:16.314204] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T18:49:16.742823] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-16T18:49:17.288499] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T18:49:17.542836] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-16T18:49:17.765463] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T18:49:18.342869] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-16T18:49:18.798229] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T18:49:19.142880] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-16T18:49:19.900393] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T18:49:19.942776] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-16T18:49:20.451965] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-16T18:49:20.551240] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-16T18:49:20.742853] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-16T18:49:21.292439] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-16T18:49:21.542895] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-16T18:49:22.147443] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T18:49:22.342882] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-16T18:49:23.056003] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T18:49:23.142841] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-16T18:49:23.623348] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-16T18:49:23.942864] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-16T18:49:24.742835] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-16T18:49:25.542820] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-16T18:49:25.936400] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-16T18:49:25.943189] [INFO ] [REMOTE ] ETR: Full fetch complete (77284 records). [2025-10-16T18:49:25.943304] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-16T18:49:26.059432] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T18:49:26.081251] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-16T18:49:26.110951] [INFO ] [REMOTE ] ETV: Full fetch complete (32498 records). [2025-10-16T18:49:26.147205] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-16T18:49:26.355095] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-16T18:49:26.654427] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-16T18:49:26.664922] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-16T18:49:26.665992] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-16T18:49:26.666075] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-16T18:49:26.736095] [DEBUG] [LOCAL ] ETR: Trimmed 77284 records to 53597 (keeping 200 days of data) [2025-10-16T18:49:26.774880] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-16T18:49:26.775211] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-16T18:49:26.775583] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-16T18:49:26.775635] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-16T18:49:26.776467] [DEBUG] [LOCAL ] ETV: Trimmed 32498 records to 22403 (keeping 200 days of data) [2025-10-16T18:49:27.122418] [DEBUG] [LOCAL ] ETV: Primary data saved (22403 records). [2025-10-16T18:49:27.123396] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-16T18:49:27.123858] [INFO ] [MAIN ] Update Progress: 780/2369 symbols completed. ETV took 39.6s. Estimated remaining: 3h 42m 51s. Rate: 7.1 symbols/min [2025-10-16T18:49:27.155270] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-16T18:49:27.323841] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:49:27.359315] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-16T18:49:27.379036] [DEBUG] [LOCAL ] ETY: Loaded 22961 existing records from primary storage. [2025-10-16T18:49:27.380062] [INFO ] [MAIN ] ETY: Loaded 22961 existing records. [2025-10-16T18:49:27.624280] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:49:27.626184] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-16T18:49:27.627107] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-16T18:49:27.627985] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-16T18:49:27.628636] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-16T18:49:27.884739] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T18:49:27.944155] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-16T18:49:27.973678] [DEBUG] [LOCAL ] ETR: Primary data saved (53597 records). [2025-10-16T18:49:27.987361] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-16T18:49:27.995960] [INFO ] [MAIN ] Update Progress: 781/2369 symbols completed. ETR took 50.7s. Estimated remaining: 3h 42m 27s. Rate: 7.1 symbols/min [2025-10-16T18:49:28.028703] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:49:28.180015] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:49:28.199507] [DEBUG] [LOCAL ] EVC: Loaded 18093 existing records from primary storage. [2025-10-16T18:49:28.199781] [INFO ] [MAIN ] EVC: Loaded 18093 existing records. [2025-10-16T18:49:28.374875] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:49:28.375127] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-16T18:49:28.375184] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-16T18:49:28.375341] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-16T18:49:28.375378] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-16T18:49:28.639293] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T18:49:28.650675] [INFO ] [REMOTE ] ETX: Full fetch complete (6896 records). [2025-10-16T18:49:28.656278] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-16T18:49:28.765524] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-16T18:49:28.812575] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:49:29.086367] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-16T18:49:29.086444] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-16T18:49:29.086607] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-16T18:49:29.086666] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-16T18:49:29.087060] [DEBUG] [LOCAL ] ETX: Trimmed 6896 records to 5276 (keeping 200 days of data) [2025-10-16T18:49:29.118536] [DEBUG] [LOCAL ] ETX: Primary data saved (5276 records). [2025-10-16T18:49:29.118633] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-16T18:49:29.118745] [INFO ] [MAIN ] Update Progress: 782/2369 symbols completed. ETX took 24.0s. Estimated remaining: 3h 42m 4s. Rate: 7.1 symbols/min [2025-10-16T18:49:29.285312] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:49:29.315845] [DEBUG] [LOCAL ] EVEX: Loaded 32374 existing records from primary storage. [2025-10-16T18:49:29.316098] [INFO ] [MAIN ] EVEX: Loaded 32374 existing records. [2025-10-16T18:49:29.492031] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:49:29.492259] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-16T18:49:29.492312] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-16T18:49:29.492483] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-16T18:49:29.492520] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-16T18:49:29.552665] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-16T18:49:29.841849] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:49:29.941178] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T18:49:30.342796] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-16T18:49:30.654374] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T18:49:30.658366] [INFO ] [REMOTE ] ETW: Full fetch complete (36810 records). [2025-10-16T18:49:30.658483] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-16T18:49:31.033032] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-16T18:49:31.033112] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-16T18:49:31.033765] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-16T18:49:31.033828] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-16T18:49:31.034572] [DEBUG] [LOCAL ] ETW: Trimmed 36810 records to 25709 (keeping 200 days of data) [2025-10-16T18:49:31.142827] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-16T18:49:31.187603] [DEBUG] [LOCAL ] ETW: Primary data saved (25709 records). [2025-10-16T18:49:31.187760] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-16T18:49:31.187843] [INFO ] [MAIN ] Update Progress: 783/2369 symbols completed. ETW took 28.6s. Estimated remaining: 3h 41m 43s. Rate: 7.2 symbols/min [2025-10-16T18:49:31.356153] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:49:31.367699] [DEBUG] [LOCAL ] EVF: Loaded 9830 existing records from primary storage. [2025-10-16T18:49:31.367902] [INFO ] [MAIN ] EVF: Loaded 9830 existing records. [2025-10-16T18:49:31.547070] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:49:31.547316] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-16T18:49:31.547365] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-16T18:49:31.547521] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-16T18:49:31.547558] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-16T18:49:31.921376] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T18:49:31.925594] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:49:31.942771] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-16T18:49:32.288292] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T18:49:32.742787] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-16T18:49:33.082937] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T18:49:33.542809] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-16T18:49:33.736916] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T18:49:34.342816] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-16T18:49:34.536968] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T18:49:35.138873] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T18:49:35.144329] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-16T18:49:35.640760] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-16T18:49:35.942819] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-16T18:49:36.743981] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-16T18:49:36.746295] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T18:49:37.298562] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T18:49:37.542802] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-16T18:49:37.938419] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T18:49:38.342820] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-16T18:49:39.142784] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-16T18:49:39.354845] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T18:49:39.890168] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-16T18:49:39.942816] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-16T18:49:40.742802] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-16T18:49:40.984009] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T18:49:41.502346] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T18:49:41.542841] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-16T18:49:42.342869] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-16T18:49:42.447851] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-16T18:49:42.934689] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T18:49:43.142800] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-16T18:49:43.713591] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-16T18:49:43.942813] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-16T18:49:44.742805] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-16T18:49:44.931172] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T18:49:45.542804] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-16T18:49:45.666590] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-16T18:49:46.342806] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-16T18:49:46.371993] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T18:49:47.142802] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-16T18:49:47.196831] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T18:49:47.942803] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-16T18:49:48.146686] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T18:49:48.728236] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T18:49:48.742766] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-16T18:49:49.325063] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T18:49:49.542887] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-16T18:49:50.342806] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-16T18:49:50.566969] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T18:49:50.569550] [INFO ] [REMOTE ] EVF: Full fetch complete (12840 records). [2025-10-16T18:49:50.569738] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-16T18:49:50.961961] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-16T18:49:50.962061] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-16T18:49:50.962578] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-16T18:49:50.962706] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-16T18:49:50.963271] [DEBUG] [LOCAL ] EVF: Trimmed 12840 records to 9864 (keeping 200 days of data) [2025-10-16T18:49:51.026010] [DEBUG] [LOCAL ] EVF: Primary data saved (9864 records). [2025-10-16T18:49:51.026195] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-16T18:49:51.026290] [INFO ] [MAIN ] Update Progress: 784/2369 symbols completed. EVF took 19.8s. Estimated remaining: 3h 41m 58s. Rate: 7.1 symbols/min [2025-10-16T18:49:51.148004] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-16T18:49:51.204872] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:49:51.219103] [DEBUG] [LOCAL ] EVG: Loaded 5933 existing records from primary storage. [2025-10-16T18:49:51.219488] [INFO ] [MAIN ] EVG: Loaded 5933 existing records. [2025-10-16T18:49:51.404593] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:49:51.405138] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-16T18:49:51.405205] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-16T18:49:51.405383] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-16T18:49:51.405425] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-16T18:49:51.739171] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T18:49:51.825094] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:49:51.942849] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-16T18:49:52.278284] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T18:49:52.557704] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-16T18:49:52.742848] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-16T18:49:53.542740] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-16T18:49:53.581105] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T18:49:54.342824] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-16T18:49:54.933592] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-16T18:49:55.085531] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T18:49:55.142823] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-16T18:49:55.942821] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-16T18:49:56.404866] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-16T18:49:56.664169] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T18:49:56.742883] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-16T18:49:57.542826] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-16T18:49:57.890833] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T18:49:58.133721] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-16T18:49:58.342879] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-16T18:49:59.142879] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-16T18:49:59.908160] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T18:49:59.942780] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-16T18:49:59.966093] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-16T18:50:00.742858] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-16T18:50:01.542883] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-16T18:50:01.772587] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-16T18:50:01.778967] [INFO ] [REMOTE ] EVEX: Full fetch complete (43504 records). [2025-10-16T18:50:01.779065] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-16T18:50:02.017376] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T18:50:02.175586] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-16T18:50:02.175692] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-16T18:50:02.176410] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-16T18:50:02.176454] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-16T18:50:02.177454] [DEBUG] [LOCAL ] EVEX: Trimmed 43504 records to 32729 (keeping 200 days of data) [2025-10-16T18:50:02.343276] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-16T18:50:02.367152] [DEBUG] [LOCAL ] EVEX: Primary data saved (32729 records). [2025-10-16T18:50:02.367326] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-16T18:50:02.367416] [INFO ] [MAIN ] Update Progress: 785/2369 symbols completed. EVEX took 33.2s. Estimated remaining: 3h 41m 55s. Rate: 7.1 symbols/min [2025-10-16T18:50:02.543997] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:50:02.584950] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T18:50:02.603512] [DEBUG] [LOCAL ] EVH: Loaded 49624 existing records from primary storage. [2025-10-16T18:50:02.603837] [INFO ] [MAIN ] EVH: Loaded 49624 existing records. [2025-10-16T18:50:02.780154] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:50:02.780438] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-16T18:50:02.780500] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-16T18:50:02.780950] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-16T18:50:02.781018] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-16T18:50:03.145332] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-16T18:50:03.176193] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:50:03.593449] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T18:50:03.942883] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-16T18:50:04.213987] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T18:50:04.636234] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-16T18:50:04.742788] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-16T18:50:05.542893] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-16T18:50:05.964491] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-16T18:50:06.342808] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-16T18:50:07.142799] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-16T18:50:07.297767] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T18:50:07.398818] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T18:50:07.400975] [INFO ] [REMOTE ] EVC: Full fetch complete (28929 records). [2025-10-16T18:50:07.401045] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-16T18:50:07.618394] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-16T18:50:07.768828] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-16T18:50:07.768902] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-16T18:50:07.769442] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-16T18:50:07.769480] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-16T18:50:07.770145] [DEBUG] [LOCAL ] EVC: Trimmed 28929 records to 18191 (keeping 200 days of data) [2025-10-16T18:50:07.871398] [DEBUG] [LOCAL ] EVC: Primary data saved (18191 records). [2025-10-16T18:50:07.871533] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-16T18:50:07.871611] [INFO ] [MAIN ] Update Progress: 786/2369 symbols completed. EVC took 39.9s. Estimated remaining: 3h 41m 41s. Rate: 7.1 symbols/min [2025-10-16T18:50:07.947997] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-16T18:50:08.039066] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:50:08.051279] [DEBUG] [LOCAL ] EVN: Loaded 10787 existing records from primary storage. [2025-10-16T18:50:08.051476] [INFO ] [MAIN ] EVN: Loaded 10787 existing records. [2025-10-16T18:50:08.222341] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:50:08.222581] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-16T18:50:08.222627] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-16T18:50:08.222822] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-16T18:50:08.222877] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-16T18:50:08.568511] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:50:08.683803] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T18:50:08.742769] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-16T18:50:09.542786] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-16T18:50:09.688141] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T18:50:10.342829] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-16T18:50:10.530995] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T18:50:11.043803] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-16T18:50:11.142821] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-16T18:50:11.942839] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-16T18:50:12.133586] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T18:50:12.436809] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T18:50:12.742841] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-16T18:50:13.542846] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-16T18:50:14.072356] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-16T18:50:14.074262] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T18:50:14.342804] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-16T18:50:15.142861] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-16T18:50:15.771980] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T18:50:15.942852] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-16T18:50:15.979350] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T18:50:16.742839] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-16T18:50:16.851064] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T18:50:16.855276] [INFO ] [REMOTE ] ETY: Full fetch complete (34335 records). [2025-10-16T18:50:16.855468] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-16T18:50:17.238881] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-16T18:50:17.239196] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-16T18:50:17.239926] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-16T18:50:17.240015] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-16T18:50:17.255256] [DEBUG] [LOCAL ] ETY: Trimmed 34335 records to 23111 (keeping 200 days of data) [2025-10-16T18:50:17.255110] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-16T18:50:17.405066] [DEBUG] [LOCAL ] ETY: Primary data saved (23111 records). [2025-10-16T18:50:17.405213] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-16T18:50:17.405298] [INFO ] [MAIN ] Update Progress: 787/2369 symbols completed. ETY took 50.3s. Estimated remaining: 3h 41m 35s. Rate: 7.1 symbols/min [2025-10-16T18:50:17.549451] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-16T18:50:17.576066] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:50:17.608625] [DEBUG] [LOCAL ] EVR: Loaded 34420 existing records from primary storage. [2025-10-16T18:50:17.608983] [INFO ] [MAIN ] EVR: Loaded 34420 existing records. [2025-10-16T18:50:17.793768] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:50:17.794044] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-16T18:50:17.794100] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-16T18:50:17.794751] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-16T18:50:17.794809] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-16T18:50:18.143047] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:50:18.164868] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T18:50:18.342822] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-16T18:50:18.933689] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T18:50:18.935017] [INFO ] [REMOTE ] EVG: Full fetch complete (8200 records). [2025-10-16T18:50:18.935086] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-16T18:50:19.147998] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-16T18:50:19.311774] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-16T18:50:19.311853] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-16T18:50:19.312099] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-16T18:50:19.312147] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-16T18:50:19.312549] [DEBUG] [LOCAL ] EVG: Trimmed 8200 records to 5979 (keeping 200 days of data) [2025-10-16T18:50:19.348764] [DEBUG] [LOCAL ] EVG: Primary data saved (5979 records). [2025-10-16T18:50:19.348862] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-16T18:50:19.348936] [INFO ] [MAIN ] Update Progress: 788/2369 symbols completed. EVG took 28.3s. Estimated remaining: 3h 41m 13s. Rate: 7.1 symbols/min [2025-10-16T18:50:19.512029] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:50:19.529577] [DEBUG] [LOCAL ] EVT: Loaded 16833 existing records from primary storage. [2025-10-16T18:50:19.529852] [INFO ] [MAIN ] EVT: Loaded 16833 existing records. [2025-10-16T18:50:19.703351] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:50:19.703607] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-16T18:50:19.703682] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-16T18:50:19.703867] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-16T18:50:19.703906] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-16T18:50:19.954688] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-16T18:50:20.075761] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:50:20.562038] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T18:50:20.742836] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-16T18:50:20.800889] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-16T18:50:21.542816] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-16T18:50:22.286752] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T18:50:22.342785] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-16T18:50:22.589160] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-16T18:50:23.142842] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-16T18:50:23.720091] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T18:50:23.942801] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-16T18:50:24.526898] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T18:50:24.742817] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-16T18:50:24.816956] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T18:50:25.446949] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T18:50:25.542841] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-16T18:50:26.342846] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-16T18:50:26.482018] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T18:50:27.142817] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-16T18:50:27.654141] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-16T18:50:27.684109] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T18:50:27.942823] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-16T18:50:28.713659] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T18:50:28.742804] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-16T18:50:29.542829] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-16T18:50:29.629993] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T18:50:30.342931] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-16T18:50:30.552690] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T18:50:30.909289] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T18:50:31.142817] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-16T18:50:31.942833] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-16T18:50:32.071695] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T18:50:32.074719] [INFO ] [REMOTE ] EVN: Full fetch complete (17325 records). [2025-10-16T18:50:32.074863] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-16T18:50:32.474788] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-16T18:50:32.474875] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-16T18:50:32.475257] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-16T18:50:32.475299] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-16T18:50:32.475939] [DEBUG] [LOCAL ] EVN: Trimmed 17325 records to 10839 (keeping 200 days of data) [2025-10-16T18:50:32.543915] [DEBUG] [LOCAL ] EVN: Primary data saved (10839 records). [2025-10-16T18:50:32.544081] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-16T18:50:32.544168] [INFO ] [MAIN ] Update Progress: 789/2369 symbols completed. EVN took 24.7s. Estimated remaining: 3h 41m 15s. Rate: 7.1 symbols/min [2025-10-16T18:50:32.711874] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:50:32.735633] [DEBUG] [LOCAL ] EVTC: Loaded 26787 existing records from primary storage. [2025-10-16T18:50:32.735900] [INFO ] [MAIN ] EVTC: Loaded 26787 existing records. [2025-10-16T18:50:32.748326] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-16T18:50:32.910466] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:50:32.910684] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-16T18:50:32.910744] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-16T18:50:32.911249] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-16T18:50:32.911306] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-16T18:50:33.260631] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:50:33.542810] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-16T18:50:33.599802] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T18:50:34.347969] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-16T18:50:34.365300] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T18:50:34.674987] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T18:50:35.142813] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-16T18:50:35.349604] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T18:50:35.908052] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-16T18:50:35.942776] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-16T18:50:36.742791] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-16T18:50:36.882155] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T18:50:37.542838] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-16T18:50:37.923743] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T18:50:38.342816] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-16T18:50:38.866920] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T18:50:39.142803] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-16T18:50:39.767059] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T18:50:39.942837] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-16T18:50:40.742787] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-16T18:50:40.811365] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T18:50:40.977676] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T18:50:41.542784] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-16T18:50:41.737019] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T18:50:42.342817] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-16T18:50:43.142837] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-16T18:50:43.177757] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T18:50:43.234421] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T18:50:43.942783] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-16T18:50:44.095139] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-16T18:50:44.742793] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-16T18:50:44.883793] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T18:50:45.542857] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-16T18:50:46.342833] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-16T18:50:46.430818] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T18:50:46.561273] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T18:50:46.942771] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-16T18:50:47.142861] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-16T18:50:47.942852] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-16T18:50:48.521603] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T18:50:48.528166] [INFO ] [REMOTE ] EVH: Full fetch complete (71861 records). [2025-10-16T18:50:48.528345] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-16T18:50:48.751806] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-16T18:50:48.940446] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-16T18:50:48.940521] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-16T18:50:48.941451] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-16T18:50:48.941513] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-16T18:50:48.942857] [DEBUG] [LOCAL ] EVH: Trimmed 71861 records to 49986 (keeping 200 days of data) [2025-10-16T18:50:49.225220] [DEBUG] [LOCAL ] EVH: Primary data saved (49986 records). [2025-10-16T18:50:49.225435] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-16T18:50:49.225697] [INFO ] [MAIN ] Update Progress: 790/2369 symbols completed. EVH took 46.9s. Estimated remaining: 3h 41m 23s. Rate: 7.1 symbols/min [2025-10-16T18:50:49.420085] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T18:50:49.422448] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:50:49.465908] [DEBUG] [LOCAL ] EVTL: Loaded 40293 existing records from primary storage. [2025-10-16T18:50:49.466237] [INFO ] [MAIN ] EVTL: Loaded 40293 existing records. [2025-10-16T18:50:49.545608] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-16T18:50:49.648519] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:50:49.648893] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-16T18:50:49.648960] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-16T18:50:49.669123] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T18:50:49.669186] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-16T18:50:49.672086] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-16T18:50:50.033112] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:50:50.342798] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-16T18:50:50.609272] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T18:50:51.142852] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-16T18:50:51.630198] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T18:50:51.942839] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-16T18:50:52.543207] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T18:50:52.620449] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T18:50:52.622839] [INFO ] [REMOTE ] EVT: Full fetch complete (25299 records). [2025-10-16T18:50:52.622913] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-16T18:50:52.748002] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-16T18:50:52.999354] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-16T18:50:52.999436] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-16T18:50:53.000027] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-16T18:50:53.000089] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-16T18:50:53.000734] [DEBUG] [LOCAL ] EVT: Trimmed 25299 records to 16930 (keeping 200 days of data) [2025-10-16T18:50:53.106671] [DEBUG] [LOCAL ] EVT: Primary data saved (16930 records). [2025-10-16T18:50:53.106826] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-16T18:50:53.106906] [INFO ] [MAIN ] Update Progress: 791/2369 symbols completed. EVT took 33.8s. Estimated remaining: 3h 41m 5s. Rate: 7.1 symbols/min [2025-10-16T18:50:53.284246] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:50:53.284441] [DEBUG] [LOCAL ] EVTR: No existing data file found in primary storage. [2025-10-16T18:50:53.284482] [WARN ] [MAIN ] EVTR: No existing data found, performing full refresh instead. [2025-10-16T18:50:53.284594] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-16T18:50:53.284636] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-16T18:50:53.284723] [DEBUG] [LOCAL ] EVTR: No primary data file found to delete. [2025-10-16T18:50:53.284761] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-16T18:50:53.547962] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-16T18:50:53.650706] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:50:53.919769] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T18:50:54.342783] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-16T18:50:54.809152] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T18:50:55.052992] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-16T18:50:55.142807] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-16T18:50:55.942758] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-16T18:50:56.063859] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T18:50:56.742925] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-16T18:50:56.884147] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-16T18:50:57.542841] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-16T18:50:57.721323] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T18:50:58.342830] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-16T18:50:58.844258] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T18:50:58.930043] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-16T18:50:59.142819] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-16T18:50:59.942813] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-16T18:51:00.199779] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T18:51:00.203999] [INFO ] [REMOTE ] EVTC: Full fetch complete (38377 records). [2025-10-16T18:51:00.204087] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-16T18:51:00.579069] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-16T18:51:00.579145] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-16T18:51:00.579879] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-16T18:51:00.579942] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-16T18:51:00.580785] [DEBUG] [LOCAL ] EVTC: Trimmed 38377 records to 27014 (keeping 200 days of data) [2025-10-16T18:51:00.743006] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-16T18:51:00.744257] [DEBUG] [LOCAL ] EVTC: Primary data saved (27014 records). [2025-10-16T18:51:00.745180] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-16T18:51:00.745296] [INFO ] [MAIN ] Update Progress: 792/2369 symbols completed. EVTC took 28.2s. Estimated remaining: 3h 40m 55s. Rate: 7.1 symbols/min [2025-10-16T18:51:00.938049] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:51:00.986443] [DEBUG] [LOCAL ] EW: Loaded 53406 existing records from primary storage. [2025-10-16T18:51:00.986857] [INFO ] [MAIN ] EW: Loaded 53406 existing records. [2025-10-16T18:51:01.185776] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:51:01.180434] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T18:51:01.192009] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-16T18:51:01.192111] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-16T18:51:01.193925] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-16T18:51:01.193996] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-16T18:51:01.546385] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-16T18:51:01.586840] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:51:02.335714] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T18:51:02.345929] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-16T18:51:02.652537] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T18:51:03.142851] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-16T18:51:03.942785] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-16T18:51:04.179499] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T18:51:04.459319] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T18:51:04.464135] [INFO ] [REMOTE ] EVR: Full fetch complete (50850 records). [2025-10-16T18:51:04.464225] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-16T18:51:04.745248] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-16T18:51:04.858703] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-16T18:51:04.858087] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-16T18:51:04.863100] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-16T18:51:04.864297] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-16T18:51:04.864633] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-16T18:51:04.865622] [DEBUG] [LOCAL ] EVR: Trimmed 50850 records to 34630 (keeping 200 days of data) [2025-10-16T18:51:05.086305] [DEBUG] [LOCAL ] EVR: Primary data saved (34630 records). [2025-10-16T18:51:05.086447] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-16T18:51:05.086538] [INFO ] [MAIN ] Update Progress: 793/2369 symbols completed. EVR took 47.7s. Estimated remaining: 3h 40m 39s. Rate: 7.1 symbols/min [2025-10-16T18:51:05.250921] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:51:05.281381] [DEBUG] [LOCAL ] EXG: Loaded 34033 existing records from primary storage. [2025-10-16T18:51:05.281672] [INFO ] [MAIN ] EXG: Loaded 34033 existing records. [2025-10-16T18:51:05.458287] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:51:05.458532] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-16T18:51:05.458583] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-16T18:51:05.459337] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-16T18:51:05.459394] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-16T18:51:05.553026] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-16T18:51:05.804966] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:51:06.342810] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-16T18:51:06.789918] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-16T18:51:06.896685] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-16T18:51:07.142807] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-16T18:51:07.684755] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T18:51:07.942886] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-16T18:51:08.742874] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-16T18:51:08.800155] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T18:51:09.136302] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T18:51:09.542809] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-16T18:51:10.092915] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T18:51:10.342809] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-16T18:51:10.587437] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T18:51:11.142813] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-16T18:51:11.575745] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T18:51:11.942815] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-16T18:51:12.742827] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-16T18:51:12.930805] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T18:51:13.463121] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T18:51:13.542857] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-16T18:51:13.848701] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-16T18:51:14.342783] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-16T18:51:14.414534] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T18:51:15.142875] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-16T18:51:15.691591] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T18:51:15.942828] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-16T18:51:16.267784] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T18:51:16.742808] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-16T18:51:17.542842] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-16T18:51:17.627909] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T18:51:18.342804] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-16T18:51:18.397079] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T18:51:18.422448] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T18:51:19.142968] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-16T18:51:19.942843] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-16T18:51:20.377605] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-16T18:51:20.742803] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-16T18:51:20.797597] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T18:51:20.826452] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T18:51:21.542845] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-16T18:51:22.317051] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T18:51:22.342825] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-16T18:51:22.767984] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T18:51:23.142897] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-16T18:51:23.942844] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-16T18:51:24.309900] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T18:51:24.714008] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T18:51:24.742771] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-16T18:51:25.542947] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-16T18:51:25.784489] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T18:51:26.342856] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-16T18:51:26.387200] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-16T18:51:26.394076] [INFO ] [REMOTE ] EVTL: Full fetch complete (54383 records). [2025-10-16T18:51:26.394210] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-16T18:51:26.775767] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-16T18:51:26.775857] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-16T18:51:26.776640] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-16T18:51:26.776758] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-16T18:51:26.778091] [DEBUG] [LOCAL ] EVTL: Trimmed 54383 records to 40675 (keeping 200 days of data) [2025-10-16T18:51:26.988978] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T18:51:26.994779] [INFO ] [REMOTE ] EVTR: Full fetch complete (33539 records). [2025-10-16T18:51:26.997067] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-16T18:51:27.182670] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-16T18:51:27.311726] [DEBUG] [LOCAL ] EVTL: Primary data saved (40675 records). [2025-10-16T18:51:27.314086] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-16T18:51:27.314455] [INFO ] [MAIN ] Update Progress: 794/2369 symbols completed. EVTL took 38.1s. Estimated remaining: 3h 40m 58s. Rate: 7.1 symbols/min [2025-10-16T18:51:27.524168] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-16T18:51:27.536536] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-16T18:51:27.543214] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-16T18:51:27.566804] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-16T18:51:27.570215] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:51:27.571153] [DEBUG] [LOCAL ] EVTR: Trimmed 33539 records to 25015 (keeping 200 days of data) [2025-10-16T18:51:27.710871] [DEBUG] [LOCAL ] EXK: Loaded 53171 existing records from primary storage. [2025-10-16T18:51:27.712131] [INFO ] [MAIN ] EXK: Loaded 53171 existing records. [2025-10-16T18:51:27.900907] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:51:27.903242] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-16T18:51:27.903411] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-16T18:51:27.918789] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-16T18:51:27.921564] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-16T18:51:28.047160] [DEBUG] [LOCAL ] EVTR: Primary data saved (25015 records). [2025-10-16T18:51:28.068532] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-16T18:51:28.093837] [INFO ] [MAIN ] Update Progress: 795/2369 symbols completed. EVTR took 35.0s. Estimated remaining: 3h 40m 34s. Rate: 7.1 symbols/min [2025-10-16T18:51:28.423356] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:51:28.530025] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:51:28.530931] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-16T18:51:28.532847] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-16T18:51:28.573100] [DEBUG] [LOCAL ] EXP: Loaded 29600 existing records from primary storage. [2025-10-16T18:51:28.573378] [INFO ] [MAIN ] EXP: Loaded 29600 existing records. [2025-10-16T18:51:28.749764] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-16T18:51:28.761696] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T18:51:28.790398] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:51:28.791342] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-16T18:51:28.799249] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-16T18:51:28.800220] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-16T18:51:28.800277] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-16T18:51:29.144222] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:51:29.542812] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-16T18:51:30.177897] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T18:51:30.256691] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T18:51:30.342790] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-16T18:51:30.913320] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T18:51:31.018849] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T18:51:31.025843] [INFO ] [REMOTE ] EW: Full fetch complete (77520 records). [2025-10-16T18:51:31.026001] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-16T18:51:31.148016] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-16T18:51:31.463193] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-16T18:51:31.463282] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-16T18:51:31.464442] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-16T18:51:31.464516] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-16T18:51:31.466127] [DEBUG] [LOCAL ] EW: Trimmed 77520 records to 53793 (keeping 200 days of data) [2025-10-16T18:51:31.806367] [DEBUG] [LOCAL ] EW: Primary data saved (53793 records). [2025-10-16T18:51:31.806538] [INFO ] [MAIN ] EW: Full history saved. [2025-10-16T18:51:31.807278] [INFO ] [MAIN ] Update Progress: 796/2369 symbols completed. EW took 31.1s. Estimated remaining: 3h 40m 17s. Rate: 7.1 symbols/min [2025-10-16T18:51:31.943678] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-16T18:51:32.007234] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:51:32.058488] [DEBUG] [LOCAL ] EXPD: Loaded 47973 existing records from primary storage. [2025-10-16T18:51:32.058859] [INFO ] [MAIN ] EXPD: Loaded 47973 existing records. [2025-10-16T18:51:32.238879] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:51:32.239150] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-16T18:51:32.239251] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-16T18:51:32.239639] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-16T18:51:32.239726] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-16T18:51:32.516330] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T18:51:32.637994] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:51:32.742817] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-16T18:51:33.503924] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T18:51:33.542782] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-16T18:51:34.003219] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T18:51:34.342855] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-16T18:51:34.848610] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T18:51:35.142828] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-16T18:51:35.953150] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-16T18:51:35.960514] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T18:51:36.143913] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-16T18:51:36.742850] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-16T18:51:37.491255] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T18:51:37.542808] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-16T18:51:37.963501] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-16T18:51:37.972198] [INFO ] [REMOTE ] EXG: Full fetch complete (49898 records). [2025-10-16T18:51:37.972418] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-16T18:51:38.343164] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-16T18:51:38.343542] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-16T18:51:38.343848] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-16T18:51:38.345361] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-16T18:51:38.345545] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-16T18:51:38.346699] [DEBUG] [LOCAL ] EXG: Trimmed 49898 records to 34277 (keeping 200 days of data) [2025-10-16T18:51:38.549923] [DEBUG] [LOCAL ] EXG: Primary data saved (34277 records). [2025-10-16T18:51:38.550061] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-16T18:51:38.550151] [INFO ] [MAIN ] Update Progress: 797/2369 symbols completed. EXG took 33.5s. Estimated remaining: 3h 40m 5s. Rate: 7.1 symbols/min [2025-10-16T18:51:39.142822] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-16T18:51:39.362477] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T18:51:39.942820] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-16T18:51:39.988168] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T18:51:40.195596] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T18:51:40.742892] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-16T18:51:41.407196] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T18:51:41.542809] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-16T18:51:42.324507] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T18:51:42.342776] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-16T18:51:43.142853] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-16T18:51:43.296450] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T18:51:43.942796] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-16T18:51:44.037730] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T18:51:44.092825] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T18:51:44.742878] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-16T18:51:45.542926] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-16T18:51:46.140579] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-16T18:51:46.342862] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-16T18:51:46.527523] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T18:51:47.142902] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-16T18:51:47.336379] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T18:51:47.942863] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-16T18:51:48.103968] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T18:51:48.474018] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T18:51:48.742819] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-16T18:51:49.554788] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-16T18:51:49.560044] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T18:51:50.342814] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-16T18:51:50.674156] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-16T18:51:50.926895] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T18:51:51.142868] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-16T18:51:51.832229] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T18:51:51.942837] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-16T18:51:52.742855] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-16T18:51:52.989587] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T18:51:53.331253] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-16T18:51:53.338266] [INFO ] [REMOTE ] EXK: Full fetch complete (76794 records). [2025-10-16T18:51:53.338479] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-16T18:51:53.570977] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-16T18:51:53.740477] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-16T18:51:53.740567] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-16T18:51:53.741558] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-16T18:51:53.741628] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-16T18:51:53.743312] [DEBUG] [LOCAL ] EXK: Trimmed 76794 records to 53561 (keeping 200 days of data) [2025-10-16T18:51:54.049592] [DEBUG] [LOCAL ] EXK: Primary data saved (53561 records). [2025-10-16T18:51:54.049771] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-16T18:51:54.049857] [INFO ] [MAIN ] Update Progress: 798/2369 symbols completed. EXK took 26.7s. Estimated remaining: 3h 40m 11s. Rate: 7.1 symbols/min [2025-10-16T18:51:54.134187] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T18:51:54.342856] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-16T18:51:54.581087] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T18:51:55.142833] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-16T18:51:55.726253] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T18:51:55.942797] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-16T18:51:56.327810] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T18:51:56.742929] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-16T18:51:57.263173] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T18:51:57.542903] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-16T18:51:57.828383] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T18:51:58.342845] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-16T18:51:58.736087] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T18:51:58.744995] [INFO ] [REMOTE ] EXPD: Full fetch complete (69548 records). [2025-10-16T18:51:58.745160] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-16T18:51:59.133028] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-16T18:51:59.133132] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-16T18:51:59.134076] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-16T18:51:59.134140] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-16T18:51:59.135446] [DEBUG] [LOCAL ] EXPD: Trimmed 69548 records to 48303 (keeping 200 days of data) [2025-10-16T18:51:59.428279] [DEBUG] [LOCAL ] EXPD: Primary data saved (48303 records). [2025-10-16T18:51:59.428414] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-16T18:51:59.429270] [INFO ] [MAIN ] Update Progress: 799/2369 symbols completed. EXPD took 27.6s. Estimated remaining: 3h 39m 56s. Rate: 7.1 symbols/min [2025-10-16T18:51:59.555952] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T18:51:59.560701] [INFO ] [REMOTE ] EXP: Full fetch complete (42968 records). [2025-10-16T18:51:59.560826] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-16T18:51:59.933070] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-16T18:51:59.933145] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-16T18:51:59.933848] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-16T18:51:59.933911] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-16T18:51:59.934797] [DEBUG] [LOCAL ] EXP: Trimmed 42968 records to 29802 (keeping 200 days of data) [2025-10-16T18:52:00.121412] [DEBUG] [LOCAL ] EXP: Primary data saved (29802 records). [2025-10-16T18:52:00.121560] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-16T18:52:00.121678] [INFO ] [MAIN ] Update Progress: 800/2369 symbols completed. EXP took 32.0s. Estimated remaining: 3h 39m 33s. Rate: 7.1 symbols/min [2025-10-16T18:52:00.643439] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:00.764709] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:00.821162] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:00.824846] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:00.865402] [DEBUG] [LOCAL ] FAF: Loaded 41492 existing records from primary storage. [2025-10-16T18:52:00.865895] [INFO ] [MAIN ] FAF: Loaded 41492 existing records. [2025-10-16T18:52:01.053805] [DEBUG] [LOCAL ] FBIN: Loaded 50393 existing records from primary storage. [2025-10-16T18:52:01.053121] [DEBUG] [LOCAL ] EXR: Loaded 45550 existing records from primary storage. [2025-10-16T18:52:01.081485] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-16T18:52:01.094835] [INFO ] [MAIN ] FBIN: Loaded 50393 existing records. [2025-10-16T18:52:01.122493] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-16T18:52:01.122312] [INFO ] [MAIN ] EXR: Loaded 45550 existing records. [2025-10-16T18:52:01.168469] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:52:01.230529] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-16T18:52:01.298395] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-16T18:52:01.419674] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-16T18:52:01.464505] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-16T18:52:01.780193] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:52:01.801300] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-16T18:52:01.801407] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-16T18:52:01.830746] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-16T18:52:01.842424] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:52:01.851563] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-16T18:52:01.851434] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-16T18:52:01.847179] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:52:01.851906] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-16T18:52:01.878088] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-16T18:52:01.878371] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-16T18:52:01.883669] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-16T18:52:01.908389] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-16T18:52:01.945040] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-16T18:52:02.002269] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-16T18:52:02.842966] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:02.905191] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-16T18:52:03.121584] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:03.161714] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-16T18:52:03.263631] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:03.270176] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-16T18:52:03.269738] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:03.271471] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-16T18:52:04.356220] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T18:52:04.363592] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-16T18:52:04.608683] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T18:52:04.618340] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-16T18:52:04.926339] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T18:52:04.936639] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-16T18:52:05.328126] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-16T18:52:05.340080] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-16T18:52:05.796571] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T18:52:05.803901] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-16T18:52:06.107366] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T18:52:06.168280] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-16T18:52:06.342860] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-16T18:52:06.710151] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T18:52:07.142850] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-16T18:52:07.421383] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-16T18:52:07.458430] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T18:52:07.942864] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-16T18:52:08.553473] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T18:52:08.742848] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-16T18:52:09.542945] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-16T18:52:10.284988] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-16T18:52:10.330749] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T18:52:10.342767] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-16T18:52:10.808750] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-16T18:52:11.142778] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-16T18:52:11.848505] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T18:52:11.942777] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-16T18:52:12.697361] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T18:52:12.742783] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-16T18:52:13.517596] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T18:52:13.542769] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-16T18:52:14.342774] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-16T18:52:14.368789] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T18:52:15.080126] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T18:52:15.142877] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-16T18:52:15.884615] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T18:52:15.942823] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-16T18:52:16.742829] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-16T18:52:17.380752] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-16T18:52:17.439399] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T18:52:17.542832] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-16T18:52:18.177774] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T18:52:18.342852] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-16T18:52:18.977839] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T18:52:19.142790] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-16T18:52:19.829890] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T18:52:19.942821] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-16T18:52:20.742830] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-16T18:52:20.949796] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T18:52:21.515095] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T18:52:21.520619] [INFO ] [REMOTE ] FAF: Full fetch complete (58041 records). [2025-10-16T18:52:21.520811] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-16T18:52:21.547960] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-16T18:52:21.938065] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-16T18:52:21.938178] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-16T18:52:21.939143] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-16T18:52:21.939206] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-16T18:52:21.940685] [DEBUG] [LOCAL ] FAF: Trimmed 58041 records to 41803 (keeping 200 days of data) [2025-10-16T18:52:22.210717] [DEBUG] [LOCAL ] FAF: Primary data saved (41803 records). [2025-10-16T18:52:22.210845] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-16T18:52:22.210931] [INFO ] [MAIN ] Update Progress: 801/2369 symbols completed. FAF took 22.1s. Estimated remaining: 3h 39m 51s. Rate: 7.1 symbols/min [2025-10-16T18:52:22.346579] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-16T18:52:22.402912] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:22.434771] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T18:52:22.466237] [DEBUG] [LOCAL ] FBK: Loaded 27411 existing records from primary storage. [2025-10-16T18:52:22.466516] [INFO ] [MAIN ] FBK: Loaded 27411 existing records. [2025-10-16T18:52:22.652028] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:52:22.652274] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-16T18:52:22.652322] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-16T18:52:22.652517] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-16T18:52:22.652574] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-16T18:52:23.012858] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:23.142844] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-16T18:52:23.942810] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-16T18:52:24.102607] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-16T18:52:24.102085] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T18:52:24.163283] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-16T18:52:24.742836] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-16T18:52:25.438883] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T18:52:25.542806] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-16T18:52:26.342838] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-16T18:52:26.381854] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T18:52:26.851451] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T18:52:27.142849] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-16T18:52:27.835392] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T18:52:27.942809] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-16T18:52:28.600854] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-16T18:52:28.742787] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-16T18:52:28.868040] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T18:52:29.542794] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-16T18:52:30.342816] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-16T18:52:30.905384] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-16T18:52:30.932559] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T18:52:30.938483] [INFO ] [REMOTE ] EXR: Full fetch complete (66163 records). [2025-10-16T18:52:30.938684] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-16T18:52:31.147918] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-16T18:52:31.275692] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-16T18:52:31.357890] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-16T18:52:31.357988] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-16T18:52:31.359029] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-16T18:52:31.359100] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-16T18:52:31.360515] [DEBUG] [LOCAL ] EXR: Trimmed 66163 records to 45888 (keeping 200 days of data) [2025-10-16T18:52:31.654701] [DEBUG] [LOCAL ] EXR: Primary data saved (45888 records). [2025-10-16T18:52:31.654853] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-16T18:52:31.654955] [INFO ] [MAIN ] Update Progress: 802/2369 symbols completed. EXR took 31.5s. Estimated remaining: 3h 39m 45s. Rate: 7.1 symbols/min [2025-10-16T18:52:31.836681] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:31.884559] [DEBUG] [LOCAL ] FBP: Loaded 45728 existing records from primary storage. [2025-10-16T18:52:31.884969] [INFO ] [MAIN ] FBP: Loaded 45728 existing records. [2025-10-16T18:52:31.948289] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-16T18:52:32.099148] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:52:32.099379] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-16T18:52:32.099427] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-16T18:52:32.099689] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-16T18:52:32.099760] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-16T18:52:32.486688] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:32.742824] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-16T18:52:32.919471] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-16T18:52:32.950137] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T18:52:33.542835] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-16T18:52:34.253405] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T18:52:34.342812] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-16T18:52:34.986064] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T18:52:35.142818] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-16T18:52:35.885888] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T18:52:35.942776] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-16T18:52:36.742836] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-16T18:52:37.027226] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T18:52:37.240590] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-16T18:52:37.542828] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-16T18:52:37.806263] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T18:52:38.342814] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-16T18:52:39.142848] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-16T18:52:39.747531] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-16T18:52:39.942861] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-16T18:52:40.046599] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T18:52:40.228130] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T18:52:40.742844] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-16T18:52:41.543012] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-16T18:52:42.075394] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-16T18:52:42.342866] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-16T18:52:42.422078] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T18:52:42.919538] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T18:52:43.142842] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-16T18:52:43.177947] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T18:52:43.184784] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-16T18:52:43.184911] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-16T18:52:43.567820] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-16T18:52:43.567896] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-16T18:52:43.568897] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-16T18:52:43.568961] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-16T18:52:43.570405] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 54210 (keeping 200 days of data) [2025-10-16T18:52:43.911470] [DEBUG] [LOCAL ] F: Primary data saved (54210 records). [2025-10-16T18:52:43.911609] [INFO ] [MAIN ] F: Full history saved. [2025-10-16T18:52:43.912484] [INFO ] [MAIN ] Update Progress: 803/2369 symbols completed. F took 43.8s. Estimated remaining: 3h 39m 44s. Rate: 7.1 symbols/min [2025-10-16T18:52:43.947156] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-16T18:52:44.090919] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:44.127371] [DEBUG] [LOCAL ] FBRT: Loaded 35439 existing records from primary storage. [2025-10-16T18:52:44.127629] [INFO ] [MAIN ] FBRT: Loaded 35439 existing records. [2025-10-16T18:52:44.305223] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:52:44.305430] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-16T18:52:44.305476] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-16T18:52:44.305866] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-16T18:52:44.305933] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-16T18:52:44.577579] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T18:52:44.684892] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:44.742771] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-16T18:52:45.542887] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-16T18:52:45.612230] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T18:52:45.986256] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T18:52:46.342790] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-16T18:52:46.587798] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-16T18:52:47.142881] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-16T18:52:47.283819] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T18:52:47.942887] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-16T18:52:48.499863] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T18:52:48.742821] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-16T18:52:48.841248] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T18:52:49.542804] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-16T18:52:50.342783] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-16T18:52:50.415887] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T18:52:50.425825] [INFO ] [REMOTE ] FBIN: Full fetch complete (72956 records). [2025-10-16T18:52:50.426083] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-16T18:52:50.610176] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-16T18:52:50.844764] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-16T18:52:50.844849] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-16T18:52:50.845769] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-16T18:52:50.845832] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-16T18:52:50.847195] [DEBUG] [LOCAL ] FBIN: Trimmed 72956 records to 50718 (keeping 200 days of data) [2025-10-16T18:52:51.144945] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-16T18:52:51.150204] [DEBUG] [LOCAL ] FBIN: Primary data saved (50718 records). [2025-10-16T18:52:51.151097] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-16T18:52:51.152128] [INFO ] [MAIN ] Update Progress: 804/2369 symbols completed. FBIN took 51.0s. Estimated remaining: 3h 39m 33s. Rate: 7.1 symbols/min [2025-10-16T18:52:51.317321] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:51.334223] [DEBUG] [LOCAL ] FC: Loaded 14873 existing records from primary storage. [2025-10-16T18:52:51.334474] [INFO ] [MAIN ] FC: Loaded 14873 existing records. [2025-10-16T18:52:51.511812] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:52:51.512063] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-16T18:52:51.512223] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-16T18:52:51.512475] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-16T18:52:51.512551] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-16T18:52:51.815486] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T18:52:51.906783] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:51.942815] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-16T18:52:52.120837] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T18:52:52.126293] [INFO ] [REMOTE ] FBK: Full fetch complete (35127 records). [2025-10-16T18:52:52.126421] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-16T18:52:52.505823] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-16T18:52:52.505994] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-16T18:52:52.506766] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-16T18:52:52.506847] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-16T18:52:52.508062] [DEBUG] [LOCAL ] FBK: Trimmed 35127 records to 27707 (keeping 200 days of data) [2025-10-16T18:52:52.674227] [DEBUG] [LOCAL ] FBK: Primary data saved (27707 records). [2025-10-16T18:52:52.674377] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-16T18:52:52.674470] [INFO ] [MAIN ] Update Progress: 805/2369 symbols completed. FBK took 30.5s. Estimated remaining: 3h 39m 11s. Rate: 7.1 symbols/min [2025-10-16T18:52:52.748211] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-16T18:52:52.844685] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:52.844860] [DEBUG] [LOCAL ] FCF: No existing data file found in primary storage. [2025-10-16T18:52:52.844897] [WARN ] [MAIN ] FCF: No existing data found, performing full refresh instead. [2025-10-16T18:52:52.845013] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-16T18:52:52.845054] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-16T18:52:52.845094] [DEBUG] [LOCAL ] FCF: No primary data file found to delete. [2025-10-16T18:52:52.845126] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-16T18:52:53.194715] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:53.477408] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T18:52:53.542778] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-16T18:52:54.059222] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-16T18:52:54.342868] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-16T18:52:54.792971] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-16T18:52:55.130880] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-16T18:52:55.142800] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-16T18:52:55.942807] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-16T18:52:56.084767] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T18:52:56.742833] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-16T18:52:57.362241] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T18:52:57.542849] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-16T18:52:58.326212] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T18:52:58.342795] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-16T18:52:59.080503] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T18:52:59.142849] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-16T18:52:59.840425] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T18:52:59.942844] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-16T18:53:00.193237] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T18:53:00.742862] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-16T18:53:00.905101] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T18:53:01.542801] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-16T18:53:02.147096] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T18:53:02.342793] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-16T18:53:02.572405] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T18:53:03.142874] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-16T18:53:03.584470] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-16T18:53:03.942877] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-16T18:53:04.470496] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T18:53:04.742831] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-16T18:53:05.255695] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-16T18:53:05.264609] [INFO ] [REMOTE ] FBP: Full fetch complete (66717 records). [2025-10-16T18:53:05.264883] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-16T18:53:05.549572] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-16T18:53:05.659953] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-16T18:53:05.660127] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-16T18:53:05.661104] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-16T18:53:05.661168] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-16T18:53:05.662595] [DEBUG] [LOCAL ] FBP: Trimmed 66717 records to 46111 (keeping 200 days of data) [2025-10-16T18:53:05.895219] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T18:53:05.958350] [DEBUG] [LOCAL ] FBP: Primary data saved (46111 records). [2025-10-16T18:53:05.958469] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-16T18:53:05.959010] [INFO ] [MAIN ] Update Progress: 806/2369 symbols completed. FBP took 34.3s. Estimated remaining: 3h 39m 12s. Rate: 7.1 symbols/min [2025-10-16T18:53:06.123731] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:53:06.151311] [DEBUG] [LOCAL ] FCN: Loaded 26052 existing records from primary storage. [2025-10-16T18:53:06.151558] [INFO ] [MAIN ] FCN: Loaded 26052 existing records. [2025-10-16T18:53:06.326964] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:53:06.327201] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-16T18:53:06.327250] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-16T18:53:06.327496] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-16T18:53:06.327555] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-16T18:53:06.347988] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-16T18:53:06.689937] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:53:06.710147] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T18:53:07.142857] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-16T18:53:07.942827] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-16T18:53:07.998748] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T18:53:08.066159] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T18:53:08.707401] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T18:53:08.742778] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-16T18:53:09.373313] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T18:53:09.542826] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-16T18:53:10.342880] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-16T18:53:10.922285] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T18:53:11.142851] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-16T18:53:11.414587] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T18:53:11.942826] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-16T18:53:12.372870] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T18:53:12.706126] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-16T18:53:12.742863] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-16T18:53:13.542813] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-16T18:53:14.119345] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T18:53:14.127244] [INFO ] [REMOTE ] FBRT: Full fetch complete (49578 records). [2025-10-16T18:53:14.127449] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-16T18:53:14.347944] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-16T18:53:14.512839] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-16T18:53:14.512951] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-16T18:53:14.513782] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-16T18:53:14.513849] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-16T18:53:14.515096] [DEBUG] [LOCAL ] FBRT: Trimmed 49578 records to 35695 (keeping 200 days of data) [2025-10-16T18:53:14.736947] [DEBUG] [LOCAL ] FBRT: Primary data saved (35695 records). [2025-10-16T18:53:14.737096] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-16T18:53:14.737182] [INFO ] [MAIN ] Update Progress: 807/2369 symbols completed. FBRT took 30.8s. Estimated remaining: 3h 39m 5s. Rate: 7.1 symbols/min [2025-10-16T18:53:14.907948] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:53:14.943326] [DEBUG] [LOCAL ] FCPT: Loaded 37344 existing records from primary storage. [2025-10-16T18:53:14.943616] [INFO ] [MAIN ] FCPT: Loaded 37344 existing records. [2025-10-16T18:53:15.146240] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-16T18:53:15.152900] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:53:15.154443] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-16T18:53:15.154589] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-16T18:53:15.156527] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T18:53:15.156862] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-16T18:53:15.166699] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-16T18:53:15.282129] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T18:53:15.534485] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:53:15.942815] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-16T18:53:16.163301] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T18:53:16.742820] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-16T18:53:17.289114] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T18:53:17.542784] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-16T18:53:18.139873] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T18:53:18.266807] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-16T18:53:18.342775] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-16T18:53:19.142781] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-16T18:53:19.202177] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-16T18:53:19.942808] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-16T18:53:19.976667] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T18:53:19.978980] [INFO ] [REMOTE ] FC: Full fetch complete (21846 records). [2025-10-16T18:53:19.979070] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-16T18:53:20.338548] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-16T18:53:20.338692] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-16T18:53:20.339204] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-16T18:53:20.339245] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-16T18:53:20.339834] [DEBUG] [LOCAL ] FC: Trimmed 21846 records to 14966 (keeping 200 days of data) [2025-10-16T18:53:20.428773] [DEBUG] [LOCAL ] FC: Primary data saved (14966 records). [2025-10-16T18:53:20.428902] [INFO ] [MAIN ] FC: Full history saved. [2025-10-16T18:53:20.428980] [INFO ] [MAIN ] Update Progress: 808/2369 symbols completed. FC took 29.3s. Estimated remaining: 3h 38m 51s. Rate: 7.1 symbols/min [2025-10-16T18:53:20.592621] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:53:20.592826] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-16T18:53:20.592867] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-16T18:53:20.592976] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-16T18:53:20.593016] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-16T18:53:20.593057] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-16T18:53:20.593087] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-16T18:53:20.752832] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-16T18:53:20.945880] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:53:21.141042] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T18:53:21.542817] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-16T18:53:21.786498] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T18:53:21.786634] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.24 seconds). [2025-10-16T18:53:22.342806] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-16T18:53:23.142875] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-16T18:53:23.495280] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T18:53:23.942822] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-16T18:53:24.651406] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T18:53:24.742806] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-16T18:53:25.435838] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T18:53:25.542867] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-16T18:53:25.886060] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T18:53:26.342855] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-16T18:53:26.690580] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-16T18:53:26.990895] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T18:53:26.996588] [INFO ] [REMOTE ] FCF: Full fetch complete (58183 records). [2025-10-16T18:53:26.996741] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-16T18:53:27.146551] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-16T18:53:27.380702] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-16T18:53:27.380799] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-16T18:53:27.382357] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-16T18:53:27.382423] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-16T18:53:27.383841] [DEBUG] [LOCAL ] FCF: Trimmed 58183 records to 39657 (keeping 200 days of data) [2025-10-16T18:53:27.625661] [DEBUG] [LOCAL ] FCF: Primary data saved (39657 records). [2025-10-16T18:53:27.625842] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-16T18:53:27.625936] [INFO ] [MAIN ] Update Progress: 809/2369 symbols completed. FCF took 35.0s. Estimated remaining: 3h 38m 40s. Rate: 7.1 symbols/min [2025-10-16T18:53:27.823176] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:53:27.839099] [DEBUG] [LOCAL ] FCT: Loaded 14677 existing records from primary storage. [2025-10-16T18:53:27.839343] [INFO ] [MAIN ] FCT: Loaded 14677 existing records. [2025-10-16T18:53:27.943475] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-16T18:53:28.028887] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:53:28.029079] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-16T18:53:28.029145] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-16T18:53:28.029366] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-16T18:53:28.029426] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-16T18:53:28.312069] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-16T18:53:28.389123] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:53:28.709002] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T18:53:28.742770] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-16T18:53:29.542831] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-16T18:53:30.243328] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T18:53:30.342847] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-16T18:53:30.369018] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T18:53:31.142817] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-16T18:53:31.643731] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T18:53:31.942796] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-16T18:53:32.353507] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T18:53:32.742804] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-16T18:53:33.113688] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T18:53:33.302932] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T18:53:33.542812] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-16T18:53:34.342806] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-16T18:53:34.669727] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-16T18:53:34.878979] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T18:53:35.142813] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-16T18:53:35.942822] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-16T18:53:36.700274] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T18:53:36.719274] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T18:53:36.742783] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-16T18:53:37.542793] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-16T18:53:37.685613] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-16T18:53:38.342798] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-16T18:53:39.040194] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T18:53:39.045739] [INFO ] [REMOTE ] FCPT: Full fetch complete (53908 records). [2025-10-16T18:53:39.045868] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-16T18:53:39.147910] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-16T18:53:39.419934] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-16T18:53:39.476911] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-16T18:53:39.476988] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-16T18:53:39.477797] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-16T18:53:39.477857] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-16T18:53:39.478950] [DEBUG] [LOCAL ] FCPT: Trimmed 53908 records to 37627 (keeping 200 days of data) [2025-10-16T18:53:39.600686] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-16T18:53:39.713447] [DEBUG] [LOCAL ] FCPT: Primary data saved (37627 records). [2025-10-16T18:53:39.713580] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-16T18:53:39.713677] [INFO ] [MAIN ] Update Progress: 810/2369 symbols completed. FCPT took 25.0s. Estimated remaining: 3h 38m 39s. Rate: 7.1 symbols/min [2025-10-16T18:53:39.881482] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:53:39.932578] [DEBUG] [LOCAL ] FCX: Loaded 53701 existing records from primary storage. [2025-10-16T18:53:39.932958] [INFO ] [MAIN ] FCX: Loaded 53701 existing records. [2025-10-16T18:53:39.947900] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-16T18:53:40.114989] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:53:40.115219] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-16T18:53:40.115266] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-16T18:53:40.115631] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-16T18:53:40.115720] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-16T18:53:40.458002] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:53:40.742770] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-16T18:53:40.803913] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T18:53:41.542841] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-16T18:53:42.342804] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-16T18:53:42.719787] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-16T18:53:42.765990] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T18:53:43.142795] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-16T18:53:43.183429] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T18:53:43.942864] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-16T18:53:44.742793] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-16T18:53:45.108404] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-16T18:53:45.125546] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-16T18:53:45.144372] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T18:53:45.542854] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-16T18:53:45.947015] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-16T18:53:46.342813] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-16T18:53:47.142794] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-16T18:53:47.229631] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-16T18:53:47.942849] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-16T18:53:48.742792] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-16T18:53:49.011561] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-16T18:53:49.072597] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T18:53:49.072714] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-16T18:53:49.542832] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-16T18:53:50.342828] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-16T18:53:50.620927] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T18:53:51.142869] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-16T18:53:51.942809] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-16T18:53:51.958361] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T18:53:52.564309] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-16T18:53:52.742833] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-16T18:53:53.081633] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-16T18:53:53.244234] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T18:53:53.247835] [INFO ] [REMOTE ] FCN: Full fetch complete (35943 records). [2025-10-16T18:53:53.247945] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-16T18:53:53.542786] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-16T18:53:53.635261] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-16T18:53:53.635355] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-16T18:53:53.636260] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-16T18:53:53.636329] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-16T18:53:53.637396] [DEBUG] [LOCAL ] FCN: Trimmed 35943 records to 26219 (keeping 200 days of data) [2025-10-16T18:53:53.819572] [DEBUG] [LOCAL ] FCN: Primary data saved (26219 records). [2025-10-16T18:53:53.819749] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-16T18:53:53.819836] [INFO ] [MAIN ] Update Progress: 811/2369 symbols completed. FCN took 47.9s. Estimated remaining: 3h 38m 41s. Rate: 7.1 symbols/min [2025-10-16T18:53:53.990349] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:53:54.024953] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-16T18:53:54.025742] [DEBUG] [LOCAL ] FDP: Loaded 29807 existing records from primary storage. [2025-10-16T18:53:54.027713] [INFO ] [MAIN ] FDP: Loaded 29807 existing records. [2025-10-16T18:53:54.200640] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:53:54.201037] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-16T18:53:54.201088] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-16T18:53:54.201327] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-16T18:53:54.201366] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-16T18:53:54.351942] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-16T18:53:54.547101] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:53:54.839539] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T18:53:54.840300] [INFO ] [REMOTE ] FCRX: Full fetch complete (1665 records). [2025-10-16T18:53:54.840413] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-16T18:53:55.014012] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-16T18:53:55.014201] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:53:55.014270] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:53:55.014344] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-16T18:53:55.014407] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-16T18:53:55.014443] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-16T18:53:55.014482] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-16T18:53:55.014535] [INFO ] [MAIN ] Update Progress: 812/2369 symbols completed. FCRX took 34.6s. Estimated remaining: 3h 38m 19s. Rate: 7.1 symbols/min [2025-10-16T18:53:55.153173] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-16T18:53:55.186067] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:53:55.214280] [DEBUG] [LOCAL ] FDS: Loaded 27640 existing records from primary storage. [2025-10-16T18:53:55.214543] [INFO ] [MAIN ] FDS: Loaded 27640 existing records. [2025-10-16T18:53:55.385959] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:53:55.386170] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-16T18:53:55.386216] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-16T18:53:55.386465] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-16T18:53:55.386519] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-16T18:53:55.726891] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:53:55.942783] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-16T18:53:56.163681] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T18:53:56.742804] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-16T18:53:57.021730] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-16T18:53:57.542834] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-16T18:53:58.013768] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T18:53:58.342811] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-16T18:53:58.836151] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T18:53:59.142846] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-16T18:53:59.223496] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T18:53:59.942782] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-16T18:54:00.097048] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-16T18:54:00.099753] [INFO ] [REMOTE ] FCT: Full fetch complete (21061 records). [2025-10-16T18:54:00.099862] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-16T18:54:00.454533] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-16T18:54:00.454605] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-16T18:54:00.455067] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-16T18:54:00.455128] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-16T18:54:00.455690] [DEBUG] [LOCAL ] FCT: Trimmed 21061 records to 14752 (keeping 200 days of data) [2025-10-16T18:54:00.539915] [DEBUG] [LOCAL ] FCT: Primary data saved (14752 records). [2025-10-16T18:54:00.540053] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-16T18:54:00.540133] [INFO ] [MAIN ] Update Progress: 813/2369 symbols completed. FCT took 32.9s. Estimated remaining: 3h 38m 5s. Rate: 7.1 symbols/min [2025-10-16T18:54:00.708715] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:54:00.743318] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-16T18:54:00.759187] [DEBUG] [LOCAL ] FDX: Loaded 51368 existing records from primary storage. [2025-10-16T18:54:00.759518] [INFO ] [MAIN ] FDX: Loaded 51368 existing records. [2025-10-16T18:54:00.936001] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:54:00.936202] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-16T18:54:00.936313] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-16T18:54:00.937038] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-16T18:54:00.937096] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-16T18:54:01.316199] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:54:01.317602] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T18:54:01.542834] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-16T18:54:02.342814] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-16T18:54:03.068746] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-16T18:54:03.142773] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-16T18:54:03.501895] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T18:54:03.558698] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-16T18:54:03.942823] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-16T18:54:04.104425] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-16T18:54:04.742929] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-16T18:54:05.542787] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-16T18:54:05.986088] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-16T18:54:06.342798] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-16T18:54:06.573337] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T18:54:06.612190] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T18:54:07.142900] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-16T18:54:07.942851] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-16T18:54:08.108080] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T18:54:08.567865] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T18:54:08.742816] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-16T18:54:09.254513] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T18:54:09.542836] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-16T18:54:10.342825] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-16T18:54:11.002901] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-16T18:54:11.142795] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-16T18:54:11.287119] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T18:54:11.317395] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T18:54:11.942882] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-16T18:54:12.742858] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-16T18:54:13.119443] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-16T18:54:13.549492] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-16T18:54:13.570280] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T18:54:13.878452] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T18:54:14.342825] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-16T18:54:15.142807] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-16T18:54:15.684698] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-16T18:54:15.942793] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-16T18:54:16.126238] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T18:54:16.158095] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T18:54:16.742909] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-16T18:54:16.797967] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T18:54:16.805469] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-16T18:54:16.805701] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-16T18:54:17.368420] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-16T18:54:17.368514] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-16T18:54:17.370007] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-16T18:54:17.370081] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-16T18:54:17.372418] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 54091 (keeping 200 days of data) [2025-10-16T18:54:17.576725] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-16T18:54:17.756288] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T18:54:17.779337] [DEBUG] [LOCAL ] FCX: Primary data saved (54091 records). [2025-10-16T18:54:17.779541] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-16T18:54:17.779637] [INFO ] [MAIN ] Update Progress: 814/2369 symbols completed. FCX took 38.1s. Estimated remaining: 3h 38m 14s. Rate: 7.1 symbols/min [2025-10-16T18:54:17.951253] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:54:17.999239] [DEBUG] [LOCAL ] FE: Loaded 53432 existing records from primary storage. [2025-10-16T18:54:17.999551] [INFO ] [MAIN ] FE: Loaded 53432 existing records. [2025-10-16T18:54:18.190429] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:54:18.190685] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-16T18:54:18.190745] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-16T18:54:18.190944] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-16T18:54:18.190983] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-16T18:54:18.368429] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-16T18:54:18.561532] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:54:18.678568] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T18:54:19.142829] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-16T18:54:19.784962] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T18:54:19.942856] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-16T18:54:20.742801] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-16T18:54:20.846252] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T18:54:21.143471] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T18:54:21.542842] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-16T18:54:21.886976] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T18:54:22.342837] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-16T18:54:23.142914] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-16T18:54:23.440572] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T18:54:23.745156] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T18:54:23.942815] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-16T18:54:23.962499] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T18:54:24.742852] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-16T18:54:25.530169] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T18:54:25.542783] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-16T18:54:25.815010] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T18:54:26.342801] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-16T18:54:27.142894] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-16T18:54:27.273493] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T18:54:27.278106] [INFO ] [REMOTE ] FDP: Full fetch complete (42650 records). [2025-10-16T18:54:27.278242] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-16T18:54:27.423036] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T18:54:27.700138] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-16T18:54:27.700211] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-16T18:54:27.700799] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-16T18:54:27.700860] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-16T18:54:27.701730] [DEBUG] [LOCAL ] FDP: Trimmed 42650 records to 29961 (keeping 200 days of data) [2025-10-16T18:54:27.877369] [DEBUG] [LOCAL ] FDP: Primary data saved (29961 records). [2025-10-16T18:54:27.877506] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-16T18:54:27.877584] [INFO ] [MAIN ] Update Progress: 815/2369 symbols completed. FDP took 34.1s. Estimated remaining: 3h 38m 8s. Rate: 7.1 symbols/min [2025-10-16T18:54:27.951285] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-16T18:54:28.046685] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:54:28.046837] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-16T18:54:28.046874] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-16T18:54:28.046982] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-16T18:54:28.047022] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-16T18:54:28.047061] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-16T18:54:28.047092] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-16T18:54:28.402757] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:54:28.683447] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T18:54:28.742781] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-16T18:54:29.542845] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-16T18:54:29.893075] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-16T18:54:29.965067] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-16T18:54:30.342836] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-16T18:54:30.751541] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-16T18:54:30.781034] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-16T18:54:31.142786] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-16T18:54:31.567083] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-16T18:54:31.942824] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-16T18:54:32.742817] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-16T18:54:33.542808] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-16T18:54:33.779262] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T18:54:34.342810] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-16T18:54:34.633080] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-16T18:54:34.636261] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T18:54:35.011609] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T18:54:35.020260] [INFO ] [REMOTE ] FDS: Full fetch complete (38754 records). [2025-10-16T18:54:35.020432] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-16T18:54:35.147966] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-16T18:54:35.424503] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-16T18:54:35.424611] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-16T18:54:35.425696] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-16T18:54:35.425763] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-16T18:54:35.426993] [DEBUG] [LOCAL ] FDS: Trimmed 38754 records to 27887 (keeping 200 days of data) [2025-10-16T18:54:35.609527] [DEBUG] [LOCAL ] FDS: Primary data saved (27887 records). [2025-10-16T18:54:35.609774] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-16T18:54:35.609884] [INFO ] [MAIN ] Update Progress: 816/2369 symbols completed. FDS took 40.6s. Estimated remaining: 3h 37m 59s. Rate: 7.1 symbols/min [2025-10-16T18:54:35.786400] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:54:35.839998] [DEBUG] [LOCAL ] FERG: Loaded 48746 existing records from primary storage. [2025-10-16T18:54:35.840474] [INFO ] [MAIN ] FERG: Loaded 48746 existing records. [2025-10-16T18:54:35.947986] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-16T18:54:36.038916] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:54:36.039214] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-16T18:54:36.039266] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-16T18:54:36.039594] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-16T18:54:36.039699] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-16T18:54:36.452065] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:54:36.498567] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-16T18:54:36.742785] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-16T18:54:37.164491] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-16T18:54:37.231622] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-16T18:54:37.542780] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-16T18:54:38.342833] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-16T18:54:38.686792] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-16T18:54:39.142824] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-16T18:54:39.605949] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-16T18:54:39.612520] [INFO ] [REMOTE ] FDX: Full fetch complete (74404 records). [2025-10-16T18:54:39.612716] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-16T18:54:39.952459] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-16T18:54:39.999578] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-16T18:54:39.999683] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-16T18:54:40.000630] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-16T18:54:40.000716] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-16T18:54:40.002136] [DEBUG] [LOCAL ] FDX: Trimmed 74404 records to 51742 (keeping 200 days of data) [2025-10-16T18:54:40.256509] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-16T18:54:40.364461] [DEBUG] [LOCAL ] FDX: Primary data saved (51742 records). [2025-10-16T18:54:40.364590] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-16T18:54:40.365363] [INFO ] [MAIN ] Update Progress: 817/2369 symbols completed. FDX took 39.8s. Estimated remaining: 3h 37m 43s. Rate: 7.1 symbols/min [2025-10-16T18:54:40.536072] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:54:40.551683] [DEBUG] [LOCAL ] FET: Loaded 12838 existing records from primary storage. [2025-10-16T18:54:40.551912] [INFO ] [MAIN ] FET: Loaded 12838 existing records. [2025-10-16T18:54:40.730842] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:54:40.731077] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-16T18:54:40.731153] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-16T18:54:40.731399] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-16T18:54:40.731498] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-16T18:54:40.751341] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-16T18:54:41.066828] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T18:54:41.134089] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-16T18:54:41.137045] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:54:41.542791] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-16T18:54:42.342820] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-16T18:54:42.369525] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T18:54:43.142823] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-16T18:54:43.903865] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T18:54:43.942773] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-16T18:54:44.742810] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-16T18:54:44.877106] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T18:54:45.115117] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-16T18:54:45.406297] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:54:45.542838] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-16T18:54:46.342811] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-16T18:54:46.787963] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-16T18:54:46.788900] [INFO ] [REMOTE ] FENG: Full fetch complete (2281 records). [2025-10-16T18:54:46.788970] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-16T18:54:46.995821] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T18:54:46.996022] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:54:46.996106] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:54:46.996189] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-16T18:54:46.996255] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-16T18:54:46.996320] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-16T18:54:46.996391] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-16T18:54:46.996469] [INFO ] [MAIN ] Update Progress: 818/2369 symbols completed. FENG took 19.1s. Estimated remaining: 3h 37m 31s. Rate: 7.1 symbols/min [2025-10-16T18:54:47.143531] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-16T18:54:47.213875] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:54:47.246505] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T18:54:47.274594] [DEBUG] [LOCAL ] FF: Loaded 24337 existing records from primary storage. [2025-10-16T18:54:47.274977] [INFO ] [MAIN ] FF: Loaded 24337 existing records. [2025-10-16T18:54:47.464493] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:54:47.464823] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-16T18:54:47.464887] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-16T18:54:47.465153] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-16T18:54:47.465249] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-16T18:54:47.858139] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:54:47.942866] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-16T18:54:48.744187] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-16T18:54:48.747186] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-16T18:54:49.211379] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-16T18:54:49.542947] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-16T18:54:49.927637] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T18:54:50.342903] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-16T18:54:51.102474] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T18:54:51.142767] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T18:54:51.142849] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-16T18:54:51.709402] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T18:54:51.942866] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-16T18:54:52.742837] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-16T18:54:52.768819] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-16T18:54:53.542873] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-16T18:54:53.898219] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T18:54:54.071226] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-16T18:54:54.342870] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-16T18:54:55.071396] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T18:54:55.142792] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-16T18:54:55.922181] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T18:54:55.942791] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-16T18:54:56.742817] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-16T18:54:57.542809] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-16T18:54:57.776507] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T18:54:57.811909] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T18:54:58.165389] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T18:54:58.342814] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-16T18:54:59.142886] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-16T18:54:59.942834] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-16T18:55:00.017324] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T18:55:00.488966] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T18:55:00.585352] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T18:55:00.592461] [INFO ] [REMOTE ] FE: Full fetch complete (77468 records). [2025-10-16T18:55:00.592617] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-16T18:55:00.748627] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-16T18:55:00.999552] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-16T18:55:00.999628] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-16T18:55:01.000734] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-16T18:55:01.000799] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-16T18:55:01.002246] [DEBUG] [LOCAL ] FE: Trimmed 77468 records to 53822 (keeping 200 days of data) [2025-10-16T18:55:01.340965] [DEBUG] [LOCAL ] FE: Primary data saved (53822 records). [2025-10-16T18:55:01.341361] [INFO ] [MAIN ] FE: Full history saved. [2025-10-16T18:55:01.341467] [INFO ] [MAIN ] Update Progress: 819/2369 symbols completed. FE took 43.6s. Estimated remaining: 3h 37m 34s. Rate: 7.1 symbols/min [2025-10-16T18:55:01.529914] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:01.542214] [DEBUG] [LOCAL ] FFA: Loaded 5921 existing records from primary storage. [2025-10-16T18:55:01.542580] [INFO ] [MAIN ] FFA: Loaded 5921 existing records. [2025-10-16T18:55:01.547937] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-16T18:55:01.822600] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:55:01.822896] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-16T18:55:01.822945] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-16T18:55:01.823463] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-16T18:55:01.823532] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-16T18:55:02.242471] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:02.342834] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-16T18:55:02.549085] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T18:55:02.728679] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-16T18:55:03.142895] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-16T18:55:03.626996] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T18:55:03.942878] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-16T18:55:04.555742] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-16T18:55:04.742838] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-16T18:55:04.956110] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T18:55:05.542827] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-16T18:55:05.706194] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T18:55:06.342822] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-16T18:55:06.754607] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-16T18:55:07.142848] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-16T18:55:07.312018] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T18:55:07.314157] [INFO ] [REMOTE ] FET: Full fetch complete (18412 records). [2025-10-16T18:55:07.314225] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-16T18:55:07.669447] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-16T18:55:07.669522] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-16T18:55:07.670060] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-16T18:55:07.670124] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-16T18:55:07.670733] [DEBUG] [LOCAL ] FET: Trimmed 18412 records to 12940 (keeping 200 days of data) [2025-10-16T18:55:07.745231] [DEBUG] [LOCAL ] FET: Primary data saved (12940 records). [2025-10-16T18:55:07.745363] [INFO ] [MAIN ] FET: Full history saved. [2025-10-16T18:55:07.745444] [INFO ] [MAIN ] Update Progress: 820/2369 symbols completed. FET took 27.4s. Estimated remaining: 3h 37m 22s. Rate: 7.1 symbols/min [2025-10-16T18:55:07.912611] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:07.930900] [DEBUG] [LOCAL ] FFC: Loaded 16719 existing records from primary storage. [2025-10-16T18:55:07.931139] [INFO ] [MAIN ] FFC: Loaded 16719 existing records. [2025-10-16T18:55:07.951112] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-16T18:55:08.108220] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:55:08.108462] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-16T18:55:08.108509] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-16T18:55:08.108766] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-16T18:55:08.108822] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-16T18:55:08.427681] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T18:55:08.485298] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:08.742831] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-16T18:55:08.793688] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T18:55:09.542902] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-16T18:55:09.962622] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T18:55:10.342816] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-16T18:55:11.142781] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-16T18:55:11.405448] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-16T18:55:11.511700] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T18:55:11.544292] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T18:55:11.942789] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-16T18:55:12.742865] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-16T18:55:13.542849] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-16T18:55:13.746691] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T18:55:13.768258] [INFO ] [REMOTE ] FERG: Full fetch complete (71096 records). [2025-10-16T18:55:13.769708] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T18:55:13.769016] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-16T18:55:14.181176] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-16T18:55:14.181258] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-16T18:55:14.182250] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-16T18:55:14.182316] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-16T18:55:14.183638] [DEBUG] [LOCAL ] FERG: Trimmed 71096 records to 49121 (keeping 200 days of data) [2025-10-16T18:55:14.364921] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-16T18:55:14.496170] [DEBUG] [LOCAL ] FERG: Primary data saved (49121 records). [2025-10-16T18:55:14.496321] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-16T18:55:14.497126] [INFO ] [MAIN ] Update Progress: 821/2369 symbols completed. FERG took 38.9s. Estimated remaining: 3h 37m 10s. Rate: 7.1 symbols/min [2025-10-16T18:55:14.679465] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:14.681103] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T18:55:14.717977] [DEBUG] [LOCAL ] FFWM: Loaded 35915 existing records from primary storage. [2025-10-16T18:55:14.718279] [INFO ] [MAIN ] FFWM: Loaded 35915 existing records. [2025-10-16T18:55:14.899074] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-16T18:55:14.903477] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:55:14.905927] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-16T18:55:14.905993] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-16T18:55:14.906163] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-16T18:55:14.906203] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-16T18:55:15.147999] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-16T18:55:15.265359] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:15.922527] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T18:55:15.942758] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-16T18:55:16.548700] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-16T18:55:16.742867] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-16T18:55:17.542779] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-16T18:55:17.780573] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-16T18:55:18.186988] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-16T18:55:18.342836] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-16T18:55:19.142820] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-16T18:55:19.711185] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T18:55:19.868407] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T18:55:19.871587] [INFO ] [REMOTE ] FF: Full fetch complete (36598 records). [2025-10-16T18:55:19.871703] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-16T18:55:19.948001] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-16T18:55:20.235953] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-16T18:55:20.236031] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-16T18:55:20.236686] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-16T18:55:20.236747] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-16T18:55:20.237485] [DEBUG] [LOCAL ] FF: Trimmed 36598 records to 24506 (keeping 200 days of data) [2025-10-16T18:55:20.372231] [DEBUG] [LOCAL ] FF: Primary data saved (24506 records). [2025-10-16T18:55:20.372359] [INFO ] [MAIN ] FF: Full history saved. [2025-10-16T18:55:20.372442] [INFO ] [MAIN ] Update Progress: 822/2369 symbols completed. FF took 33.4s. Estimated remaining: 3h 36m 57s. Rate: 7.1 symbols/min [2025-10-16T18:55:20.541700] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:20.562796] [DEBUG] [LOCAL ] FG: Loaded 22183 existing records from primary storage. [2025-10-16T18:55:20.563032] [INFO ] [MAIN ] FG: Loaded 22183 existing records. [2025-10-16T18:55:20.735583] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:55:20.735784] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-16T18:55:20.735831] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-16T18:55:20.735996] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-16T18:55:20.736053] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-16T18:55:20.748744] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-16T18:55:21.088907] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:21.109540] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T18:55:21.380473] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-16T18:55:21.542792] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-16T18:55:22.342788] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-16T18:55:22.502362] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T18:55:23.143170] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-16T18:55:23.622062] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T18:55:23.942795] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-16T18:55:24.118774] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T18:55:24.742826] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-16T18:55:25.003470] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-16T18:55:25.400256] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-16T18:55:25.542835] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-16T18:55:26.178544] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-16T18:55:26.342778] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-16T18:55:27.143770] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-16T18:55:27.147363] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T18:55:27.942812] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-16T18:55:28.079228] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-16T18:55:28.742826] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-16T18:55:28.841019] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-16T18:55:29.318861] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-16T18:55:29.542831] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-16T18:55:30.342811] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-16T18:55:30.698223] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-16T18:55:31.142788] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-16T18:55:31.297938] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-16T18:55:31.942809] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-16T18:55:32.240739] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T18:55:32.711902] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T18:55:32.742776] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-16T18:55:33.542783] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-16T18:55:33.765736] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T18:55:34.050305] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-16T18:55:34.342811] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-16T18:55:35.142810] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-16T18:55:35.624716] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T18:55:35.945238] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-16T18:55:35.946070] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T18:55:35.948545] [INFO ] [REMOTE ] FFA: Full fetch complete (8808 records). [2025-10-16T18:55:35.948740] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-16T18:55:36.323579] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-16T18:55:36.323686] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-16T18:55:36.323928] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-16T18:55:36.323968] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-16T18:55:36.324399] [DEBUG] [LOCAL ] FFA: Trimmed 8808 records to 5963 (keeping 200 days of data) [2025-10-16T18:55:36.360808] [DEBUG] [LOCAL ] FFA: Primary data saved (5963 records). [2025-10-16T18:55:36.360895] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-16T18:55:36.361005] [INFO ] [MAIN ] Update Progress: 823/2369 symbols completed. FFA took 35.0s. Estimated remaining: 3h 37m 3s. Rate: 7.1 symbols/min [2025-10-16T18:55:36.525785] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:36.533196] [DEBUG] [LOCAL ] FGN: Loaded 3724 existing records from primary storage. [2025-10-16T18:55:36.533384] [INFO ] [MAIN ] FGN: Loaded 3724 existing records. [2025-10-16T18:55:36.716782] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:55:36.717000] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-16T18:55:36.717047] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-16T18:55:36.717191] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-16T18:55:36.717246] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-16T18:55:36.747859] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-16T18:55:37.079059] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:37.124391] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T18:55:37.542795] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-16T18:55:37.804676] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T18:55:38.342837] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-16T18:55:38.542956] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T18:55:39.142830] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-16T18:55:39.346939] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T18:55:39.942827] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-16T18:55:40.141799] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-16T18:55:40.742835] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-16T18:55:41.081108] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T18:55:41.359730] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-16T18:55:41.542816] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-16T18:55:42.155726] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-16T18:55:42.342838] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-16T18:55:43.142808] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-16T18:55:43.292834] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T18:55:43.476334] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-16T18:55:43.942828] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-16T18:55:44.742870] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-16T18:55:45.381509] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T18:55:45.542791] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-16T18:55:45.741837] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T18:55:46.342806] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-16T18:55:46.513076] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T18:55:46.515458] [INFO ] [REMOTE ] FFC: Full fetch complete (24559 records). [2025-10-16T18:55:46.515545] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-16T18:55:46.706398] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-16T18:55:46.922273] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-16T18:55:46.922366] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-16T18:55:46.922981] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-16T18:55:46.923044] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-16T18:55:46.923763] [DEBUG] [LOCAL ] FFC: Trimmed 24559 records to 16818 (keeping 200 days of data) [2025-10-16T18:55:47.026460] [DEBUG] [LOCAL ] FFC: Primary data saved (16818 records). [2025-10-16T18:55:47.026599] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-16T18:55:47.026702] [INFO ] [MAIN ] Update Progress: 824/2369 symbols completed. FFC took 39.3s. Estimated remaining: 3h 36m 59s. Rate: 7.1 symbols/min [2025-10-16T18:55:47.147943] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-16T18:55:47.202902] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:47.203075] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-16T18:55:47.203159] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-16T18:55:47.203272] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-16T18:55:47.203313] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-16T18:55:47.203353] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-16T18:55:47.203384] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-16T18:55:47.546957] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:47.942839] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-16T18:55:48.320111] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-16T18:55:48.543007] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T18:55:48.742785] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-16T18:55:48.930138] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:55:48.930442] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-16T18:55:48.930560] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:55:48.930636] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-16T18:55:48.930749] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:55:48.930841] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-16T18:55:48.930920] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-16T18:55:48.930958] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-16T18:55:48.930996] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-16T18:55:48.931041] [INFO ] [MAIN ] Update Progress: 825/2369 symbols completed. FGSN took 1.9s. Estimated remaining: 3h 36m 38s. Rate: 7.1 symbols/min [2025-10-16T18:55:49.119414] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:49.158727] [DEBUG] [LOCAL ] FHI: Loaded 39897 existing records from primary storage. [2025-10-16T18:55:49.159021] [INFO ] [MAIN ] FHI: Loaded 39897 existing records. [2025-10-16T18:55:49.337726] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:55:49.337960] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-16T18:55:49.338008] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-16T18:55:49.338198] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-16T18:55:49.338254] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-16T18:55:49.547932] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-16T18:55:49.695611] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:50.342825] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-16T18:55:50.697506] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-16T18:55:50.700783] [INFO ] [REMOTE ] FG: Full fetch complete (28671 records). [2025-10-16T18:55:50.700922] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-16T18:55:50.859307] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-16T18:55:51.087692] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-16T18:55:51.087776] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-16T18:55:51.088344] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-16T18:55:51.088423] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-16T18:55:51.089156] [DEBUG] [LOCAL ] FG: Trimmed 28671 records to 22335 (keeping 200 days of data) [2025-10-16T18:55:51.144004] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-16T18:55:51.228727] [DEBUG] [LOCAL ] FG: Primary data saved (22335 records). [2025-10-16T18:55:51.228867] [INFO ] [MAIN ] FG: Full history saved. [2025-10-16T18:55:51.228943] [INFO ] [MAIN ] Update Progress: 826/2369 symbols completed. FG took 30.9s. Estimated remaining: 3h 36m 18s. Rate: 7.1 symbols/min [2025-10-16T18:55:51.405256] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:51.459089] [DEBUG] [LOCAL ] FHN: Loaded 53392 existing records from primary storage. [2025-10-16T18:55:51.459493] [INFO ] [MAIN ] FHN: Loaded 53392 existing records. [2025-10-16T18:55:51.639054] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:55:51.639327] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-16T18:55:51.639387] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-16T18:55:51.639722] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-16T18:55:51.639778] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-16T18:55:51.955420] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-16T18:55:52.000393] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:52.241410] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T18:55:52.246088] [INFO ] [REMOTE ] FFWM: Full fetch complete (51927 records). [2025-10-16T18:55:52.246192] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-16T18:55:52.622188] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-16T18:55:52.622282] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-16T18:55:52.623087] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-16T18:55:52.623147] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-16T18:55:52.624162] [DEBUG] [LOCAL ] FFWM: Trimmed 51927 records to 36234 (keeping 200 days of data) [2025-10-16T18:55:52.767706] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-16T18:55:52.822834] [DEBUG] [LOCAL ] FFWM: Primary data saved (36234 records). [2025-10-16T18:55:52.822948] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-16T18:55:52.823021] [INFO ] [MAIN ] Update Progress: 827/2369 symbols completed. FFWM took 38.3s. Estimated remaining: 3h 35m 57s. Rate: 7.1 symbols/min [2025-10-16T18:55:52.992174] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:53.043722] [DEBUG] [LOCAL ] FI: Loaded 53580 existing records from primary storage. [2025-10-16T18:55:53.044080] [INFO ] [MAIN ] FI: Loaded 53580 existing records. [2025-10-16T18:55:53.223306] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:55:53.223552] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-16T18:55:53.223607] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-16T18:55:53.223811] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-16T18:55:53.223875] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-16T18:55:53.452113] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-16T18:55:53.548401] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-16T18:55:53.610146] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:53.632213] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T18:55:54.155627] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-16T18:55:54.342820] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-16T18:55:54.918287] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T18:55:55.142820] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-16T18:55:55.670862] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-16T18:55:55.942810] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-16T18:55:56.489424] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-16T18:55:56.742827] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-16T18:55:57.542834] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-16T18:55:57.896074] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-16T18:55:58.081579] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T18:55:58.342820] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-16T18:55:59.142824] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-16T18:55:59.868252] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T18:55:59.942837] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-16T18:56:00.696009] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T18:56:00.742785] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-16T18:56:01.542884] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-16T18:56:01.661114] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T18:56:02.342917] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-16T18:56:02.502746] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T18:56:02.504220] [INFO ] [REMOTE ] FGN: Full fetch complete (5618 records). [2025-10-16T18:56:02.504313] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-16T18:56:02.651828] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-16T18:56:02.934286] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-16T18:56:02.934389] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-16T18:56:02.934620] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-16T18:56:02.934696] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-16T18:56:02.935152] [DEBUG] [LOCAL ] FGN: Trimmed 5618 records to 3741 (keeping 200 days of data) [2025-10-16T18:56:02.960042] [DEBUG] [LOCAL ] FGN: Primary data saved (3741 records). [2025-10-16T18:56:02.960244] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-16T18:56:02.960352] [INFO ] [MAIN ] Update Progress: 828/2369 symbols completed. FGN took 26.6s. Estimated remaining: 3h 35m 52s. Rate: 7.1 symbols/min [2025-10-16T18:56:03.138494] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:56:03.142825] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-16T18:56:03.168357] [DEBUG] [LOCAL ] FICO: Loaded 21752 existing records from primary storage. [2025-10-16T18:56:03.168817] [INFO ] [MAIN ] FICO: Loaded 21752 existing records. [2025-10-16T18:56:03.357812] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:56:03.358030] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-16T18:56:03.358082] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-16T18:56:03.358325] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-16T18:56:03.358381] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-16T18:56:03.741134] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:56:03.912755] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T18:56:03.942798] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-16T18:56:04.050598] [DEBUG] [REMOTE ] FHN: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-16T18:56:04.051004] [WARN ] [REMOTE ] FHN: No data returned for month 2025-02 [2025-10-16T18:56:04.051107] [FATAL] [REMOTE ] FHN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:56:04.051209] [FATAL] [MAIN ] FHN: Failed to fetch primary data. [2025-10-16T18:56:04.051276] [WARN ] [MAIN ] FHN: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:56:04.051349] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-16T18:56:04.051418] [DEBUG] [LOCAL ] FHN: No primary data file found to delete. [2025-10-16T18:56:04.051456] [INFO ] [LOCAL ] FHN: Starting deletion of derivative data. [2025-10-16T18:56:04.051625] [DEBUG] [LOCAL ] FHN: Deleted derivative data file. [2025-10-16T18:56:04.052199] [INFO ] [MAIN ] Update Progress: 829/2369 symbols completed. FHN took 12.8s. Estimated remaining: 3h 35m 30s. Rate: 7.1 symbols/min [2025-10-16T18:56:04.224752] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:56:04.225046] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-16T18:56:04.225118] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-16T18:56:04.225234] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-16T18:56:04.225359] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-16T18:56:04.225442] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-16T18:56:04.225562] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-16T18:56:04.412370] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T18:56:04.636589] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:56:04.742777] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-16T18:56:04.976474] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.23 seconds). [2025-10-16T18:56:05.542872] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-16T18:56:06.342827] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-16T18:56:06.569366] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-16T18:56:07.142807] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-16T18:56:07.440961] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-16T18:56:07.465631] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T18:56:07.942879] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-16T18:56:08.206956] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-16T18:56:08.742814] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-16T18:56:09.542825] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-16T18:56:10.306287] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T18:56:10.346979] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-16T18:56:10.351702] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-16T18:56:11.142864] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-16T18:56:11.953414] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-16T18:56:11.958960] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T18:56:12.742800] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-16T18:56:13.085808] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-16T18:56:13.090494] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T18:56:13.121013] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T18:56:13.542856] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-16T18:56:14.342820] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-16T18:56:14.679606] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-16T18:56:15.142852] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-16T18:56:15.269023] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T18:56:15.942833] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-16T18:56:16.010812] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T18:56:16.138365] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:56:16.138768] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-16T18:56:16.138857] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:56:16.138930] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-16T18:56:16.138992] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:56:16.139067] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-16T18:56:16.139133] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-16T18:56:16.139169] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-16T18:56:16.139208] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-16T18:56:16.139255] [INFO ] [MAIN ] Update Progress: 830/2369 symbols completed. FIG took 12.1s. Estimated remaining: 3h 35m 28s. Rate: 7.1 symbols/min [2025-10-16T18:56:16.318992] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:56:16.363635] [DEBUG] [LOCAL ] FIGS: Loaded 48583 existing records from primary storage. [2025-10-16T18:56:16.364003] [INFO ] [MAIN ] FIGS: Loaded 48583 existing records. [2025-10-16T18:56:16.570153] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:56:16.570556] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-16T18:56:16.570614] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-16T18:56:16.570887] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-16T18:56:16.570943] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-16T18:56:16.744518] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-16T18:56:16.928231] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:56:17.542835] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-16T18:56:17.871057] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T18:56:18.342857] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-16T18:56:19.142806] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-16T18:56:19.601126] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-16T18:56:19.622630] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T18:56:19.942833] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-16T18:56:20.640402] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T18:56:20.742808] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-16T18:56:21.291317] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T18:56:21.542782] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-16T18:56:21.935881] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-16T18:56:22.342806] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-16T18:56:22.946409] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T18:56:23.142814] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-16T18:56:23.942815] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-16T18:56:24.494308] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-16T18:56:24.567347] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:56:24.742782] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-16T18:56:25.401991] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T18:56:25.542775] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-16T18:56:26.342808] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-16T18:56:26.379472] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T18:56:26.517787] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-16T18:56:27.142845] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-16T18:56:27.435335] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T18:56:27.942821] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-16T18:56:28.742865] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-16T18:56:28.777789] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T18:56:29.458857] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T18:56:29.542798] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-16T18:56:29.927900] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-16T18:56:30.342837] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-16T18:56:30.529851] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T18:56:31.142807] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-16T18:56:31.942810] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-16T18:56:32.279376] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-16T18:56:32.746878] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-16T18:56:32.752784] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T18:56:32.825560] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T18:56:33.542796] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-16T18:56:34.342791] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-16T18:56:34.675368] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-16T18:56:35.099128] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T18:56:35.142778] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-16T18:56:35.399548] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T18:56:35.942783] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-16T18:56:36.014512] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T18:56:36.021512] [INFO ] [REMOTE ] FI: Full fetch complete (77440 records). [2025-10-16T18:56:36.021634] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-16T18:56:36.422866] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-16T18:56:36.422962] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-16T18:56:36.423984] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-16T18:56:36.424051] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-16T18:56:36.425579] [DEBUG] [LOCAL ] FI: Trimmed 77440 records to 53970 (keeping 200 days of data) [2025-10-16T18:56:36.746631] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-16T18:56:36.746551] [DEBUG] [LOCAL ] FI: Primary data saved (53970 records). [2025-10-16T18:56:36.746857] [INFO ] [MAIN ] FI: Full history saved. [2025-10-16T18:56:36.748370] [INFO ] [MAIN ] Update Progress: 831/2369 symbols completed. FI took 43.9s. Estimated remaining: 3h 35m 43s. Rate: 7.1 symbols/min [2025-10-16T18:56:36.915459] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:56:36.953686] [DEBUG] [LOCAL ] FIHL: Loaded 39437 existing records from primary storage. [2025-10-16T18:56:36.953968] [INFO ] [MAIN ] FIHL: Loaded 39437 existing records. [2025-10-16T18:56:37.134635] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:56:37.134959] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-16T18:56:37.135052] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-16T18:56:37.135435] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-16T18:56:37.135480] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-16T18:56:37.429131] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T18:56:37.471355] [INFO ] [REMOTE ] FICO: Full fetch complete (29895 records). [2025-10-16T18:56:37.491123] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-16T18:56:37.566508] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:56:37.562782] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-16T18:56:37.885128] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-16T18:56:37.885205] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-16T18:56:37.885803] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-16T18:56:37.885864] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-16T18:56:37.886579] [DEBUG] [LOCAL ] FICO: Trimmed 29895 records to 21912 (keeping 200 days of data) [2025-10-16T18:56:38.025732] [DEBUG] [LOCAL ] FICO: Primary data saved (21912 records). [2025-10-16T18:56:38.025853] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-16T18:56:38.025929] [INFO ] [MAIN ] Update Progress: 832/2369 symbols completed. FICO took 35.1s. Estimated remaining: 3h 35m 21s. Rate: 7.1 symbols/min [2025-10-16T18:56:38.202163] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:56:38.212794] [DEBUG] [LOCAL ] FINS: Loaded 8292 existing records from primary storage. [2025-10-16T18:56:38.212994] [INFO ] [MAIN ] FINS: Loaded 8292 existing records. [2025-10-16T18:56:38.351148] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-16T18:56:38.391623] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:56:38.392825] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-16T18:56:38.393038] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-16T18:56:38.393245] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-16T18:56:38.393499] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-16T18:56:38.699582] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-16T18:56:38.791165] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:56:39.012572] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T18:56:39.017621] [INFO ] [REMOTE ] FHI: Full fetch complete (57761 records). [2025-10-16T18:56:39.017754] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-16T18:56:39.143572] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-16T18:56:39.440176] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-16T18:56:39.440263] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-16T18:56:39.441109] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-16T18:56:39.441178] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-16T18:56:39.442388] [DEBUG] [LOCAL ] FHI: Trimmed 57761 records to 40215 (keeping 200 days of data) [2025-10-16T18:56:39.685810] [DEBUG] [LOCAL ] FHI: Primary data saved (40215 records). [2025-10-16T18:56:39.685942] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-16T18:56:39.686022] [INFO ] [MAIN ] Update Progress: 833/2369 symbols completed. FHI took 50.8s. Estimated remaining: 3h 35m 0s. Rate: 7.1 symbols/min [2025-10-16T18:56:39.860591] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:56:39.881086] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T18:56:39.922762] [DEBUG] [LOCAL ] FINV: Loaded 45270 existing records from primary storage. [2025-10-16T18:56:39.923134] [INFO ] [MAIN ] FINV: Loaded 45270 existing records. [2025-10-16T18:56:39.953261] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-16T18:56:40.100720] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:56:40.100883] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-16T18:56:40.100938] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-16T18:56:40.101119] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-16T18:56:40.101156] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-16T18:56:40.453253] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:56:40.613725] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-16T18:56:40.742785] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-16T18:56:40.779198] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T18:56:41.450091] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T18:56:41.542834] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-16T18:56:42.342877] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-16T18:56:43.150311] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-16T18:56:43.155398] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T18:56:43.444687] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T18:56:43.822741] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T18:56:43.942854] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-16T18:56:44.742875] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-16T18:56:45.097987] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T18:56:45.542848] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-16T18:56:46.342814] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-16T18:56:46.398244] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T18:56:46.404776] [INFO ] [REMOTE ] FIGS: Full fetch complete (70882 records). [2025-10-16T18:56:46.404948] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-16T18:56:46.812816] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T18:56:46.843374] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-16T18:56:46.843455] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-16T18:56:46.844418] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-16T18:56:46.844484] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-16T18:56:46.845742] [DEBUG] [LOCAL ] FIGS: Trimmed 70882 records to 48947 (keeping 200 days of data) [2025-10-16T18:56:47.059933] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T18:56:47.142034] [DEBUG] [LOCAL ] FIGS: Primary data saved (48947 records). [2025-10-16T18:56:47.142183] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-16T18:56:47.142668] [INFO ] [MAIN ] Update Progress: 834/2369 symbols completed. FIGS took 31.0s. Estimated remaining: 3h 34m 50s. Rate: 7.1 symbols/min [2025-10-16T18:56:47.142991] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-16T18:56:47.316197] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:56:47.366672] [DEBUG] [LOCAL ] FIS: Loaded 53339 existing records from primary storage. [2025-10-16T18:56:47.367017] [INFO ] [MAIN ] FIS: Loaded 53339 existing records. [2025-10-16T18:56:47.545071] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:56:47.545321] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-16T18:56:47.545379] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-16T18:56:47.545568] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-16T18:56:47.545619] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-16T18:56:47.904800] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:56:47.942794] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-16T18:56:47.996787] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-16T18:56:48.742897] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-16T18:56:49.411740] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T18:56:49.542819] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-16T18:56:50.323563] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T18:56:50.342798] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-16T18:56:50.945328] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T18:56:51.142812] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-16T18:56:51.607163] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-16T18:56:51.915606] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T18:56:51.942771] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-16T18:56:52.665577] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T18:56:52.742875] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-16T18:56:53.542830] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-16T18:56:54.118552] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T18:56:54.342903] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-16T18:56:54.924947] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-16T18:56:55.065253] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T18:56:55.142853] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-16T18:56:55.942822] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-16T18:56:56.358464] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T18:56:56.742829] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-16T18:56:57.542797] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-16T18:56:57.635461] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T18:56:57.660209] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-16T18:56:58.342860] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-16T18:56:59.051599] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T18:56:59.142814] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-16T18:56:59.755727] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T18:56:59.942843] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-16T18:57:00.615799] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-16T18:57:00.663979] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T18:57:00.742808] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-16T18:57:01.536330] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T18:57:01.537678] [INFO ] [REMOTE ] FINS: Full fetch complete (11789 records). [2025-10-16T18:57:01.537748] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-16T18:57:01.548701] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-16T18:57:01.917173] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-16T18:57:01.917252] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-16T18:57:01.917606] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-16T18:57:01.917668] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-16T18:57:01.918183] [DEBUG] [LOCAL ] FINS: Trimmed 11789 records to 8363 (keeping 200 days of data) [2025-10-16T18:57:01.971124] [DEBUG] [LOCAL ] FINS: Primary data saved (8363 records). [2025-10-16T18:57:01.971271] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-16T18:57:01.971370] [INFO ] [MAIN ] Update Progress: 835/2369 symbols completed. FINS took 23.9s. Estimated remaining: 3h 34m 53s. Rate: 7.1 symbols/min [2025-10-16T18:57:02.146118] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:57:02.174582] [DEBUG] [LOCAL ] FIX: Loaded 28800 existing records from primary storage. [2025-10-16T18:57:02.174872] [INFO ] [MAIN ] FIX: Loaded 28800 existing records. [2025-10-16T18:57:02.348030] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-16T18:57:02.353250] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:57:02.354763] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-16T18:57:02.354846] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-16T18:57:02.355070] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-16T18:57:02.355131] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-16T18:57:02.726075] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:57:03.138818] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T18:57:03.147963] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-16T18:57:03.861956] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T18:57:03.942790] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-16T18:57:04.154441] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-16T18:57:04.742829] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-16T18:57:05.289074] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-16T18:57:05.294383] [INFO ] [REMOTE ] FIHL: Full fetch complete (56400 records). [2025-10-16T18:57:05.294508] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-16T18:57:05.554502] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-16T18:57:05.681890] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-16T18:57:05.681981] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-16T18:57:05.682821] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-16T18:57:05.682884] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-16T18:57:05.684093] [DEBUG] [LOCAL ] FIHL: Trimmed 56400 records to 39714 (keeping 200 days of data) [2025-10-16T18:57:05.932152] [DEBUG] [LOCAL ] FIHL: Primary data saved (39714 records). [2025-10-16T18:57:05.932301] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-16T18:57:05.932382] [INFO ] [MAIN ] Update Progress: 836/2369 symbols completed. FIHL took 29.2s. Estimated remaining: 3h 34m 37s. Rate: 7.1 symbols/min [2025-10-16T18:57:06.103625] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:57:06.103842] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-16T18:57:06.103884] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-16T18:57:06.103998] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-16T18:57:06.104040] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-16T18:57:06.104081] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-16T18:57:06.104115] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-16T18:57:06.351669] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-16T18:57:06.424326] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T18:57:06.523706] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:57:07.142872] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-16T18:57:07.249582] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T18:57:07.942828] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-16T18:57:08.041374] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T18:57:08.145985] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:57:08.146294] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-16T18:57:08.146402] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:57:08.146451] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-16T18:57:08.146511] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:57:08.146584] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-16T18:57:08.146674] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-16T18:57:08.146743] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-16T18:57:08.146810] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-16T18:57:08.146859] [INFO ] [MAIN ] Update Progress: 837/2369 symbols completed. FIXT took 2.2s. Estimated remaining: 3h 34m 17s. Rate: 7.1 symbols/min [2025-10-16T18:57:08.236827] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T18:57:08.742862] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-16T18:57:09.542912] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-16T18:57:10.342851] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-16T18:57:10.439969] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T18:57:10.590213] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T18:57:11.142838] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-16T18:57:11.909610] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T18:57:11.942795] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-16T18:57:12.439828] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T18:57:12.742887] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-16T18:57:13.542864] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-16T18:57:13.827968] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T18:57:14.266080] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T18:57:14.342809] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-16T18:57:14.572867] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T18:57:15.142826] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-16T18:57:15.944720] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-16T18:57:15.947136] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T18:57:16.437176] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T18:57:16.742784] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-16T18:57:17.147451] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T18:57:17.542834] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-16T18:57:18.342846] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-16T18:57:18.492898] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T18:57:19.142872] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-16T18:57:19.331034] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T18:57:19.381670] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T18:57:19.942854] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-16T18:57:20.742910] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-16T18:57:20.835633] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T18:57:21.198322] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T18:57:21.542850] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-16T18:57:22.342866] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-16T18:57:22.564077] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T18:57:23.105580] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T18:57:23.112247] [INFO ] [REMOTE ] FINV: Full fetch complete (64641 records). [2025-10-16T18:57:23.112382] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-16T18:57:23.149635] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-16T18:57:23.568318] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-16T18:57:23.568546] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-16T18:57:23.570030] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-16T18:57:23.570113] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-16T18:57:23.571967] [DEBUG] [LOCAL ] FINV: Trimmed 64641 records to 45609 (keeping 200 days of data) [2025-10-16T18:57:23.679890] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T18:57:23.880453] [DEBUG] [LOCAL ] FINV: Primary data saved (45609 records). [2025-10-16T18:57:23.880609] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-16T18:57:23.881563] [INFO ] [MAIN ] Update Progress: 838/2369 symbols completed. FINV took 44.2s. Estimated remaining: 3h 34m 22s. Rate: 7.1 symbols/min [2025-10-16T18:57:23.942889] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-16T18:57:25.085034] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-16T18:57:25.096571] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-16T18:57:25.178989] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-16T18:57:25.182549] [INFO ] [REMOTE ] FIX: Full fetch complete (45507 records). [2025-10-16T18:57:25.182666] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-16T18:57:25.550065] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-16T18:57:25.550143] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-16T18:57:25.550916] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-16T18:57:25.550980] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-16T18:57:25.551937] [DEBUG] [LOCAL ] FIX: Trimmed 45507 records to 29033 (keeping 200 days of data) [2025-10-16T18:57:25.732773] [DEBUG] [LOCAL ] FIX: Primary data saved (29033 records). [2025-10-16T18:57:25.732922] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-16T18:57:25.733032] [INFO ] [MAIN ] Update Progress: 839/2369 symbols completed. FIX took 23.8s. Estimated remaining: 3h 34m 2s. Rate: 7.1 symbols/min [2025-10-16T18:57:25.921274] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-16T18:57:25.928266] [INFO ] [REMOTE ] FIS: Full fetch complete (77392 records). [2025-10-16T18:57:25.928452] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-16T18:57:26.308251] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-16T18:57:26.308335] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-16T18:57:26.309326] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-16T18:57:26.309395] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-16T18:57:26.310891] [DEBUG] [LOCAL ] FIS: Trimmed 77392 records to 53727 (keeping 200 days of data) [2025-10-16T18:57:26.640376] [DEBUG] [LOCAL ] FIS: Primary data saved (53727 records). [2025-10-16T18:57:26.640514] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-16T18:57:26.640989] [INFO ] [MAIN ] Update Progress: 840/2369 symbols completed. FIS took 39.5s. Estimated remaining: 3h 33m 40s. Rate: 7.2 symbols/min [2025-10-16T18:57:27.242901] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:57:27.313911] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:57:27.361527] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:57:27.393621] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:57:27.400037] [DEBUG] [LOCAL ] FLC: Loaded 5420 existing records from primary storage. [2025-10-16T18:57:27.400330] [INFO ] [MAIN ] FLC: Loaded 5420 existing records. [2025-10-16T18:57:27.592435] [DEBUG] [LOCAL ] FLNG: Loaded 33712 existing records from primary storage. [2025-10-16T18:57:27.642390] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:57:27.643371] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-16T18:57:27.643433] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-16T18:57:27.643616] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-16T18:57:27.643703] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-16T18:57:27.642682] [INFO ] [MAIN ] FLNG: Loaded 33712 existing records. [2025-10-16T18:57:27.862799] [DEBUG] [LOCAL ] FLG: Loaded 53327 existing records from primary storage. [2025-10-16T18:57:27.853784] [DEBUG] [LOCAL ] FLO: Loaded 52082 existing records from primary storage. [2025-10-16T18:57:27.873479] [INFO ] [MAIN ] FLG: Loaded 53327 existing records. [2025-10-16T18:57:27.884041] [INFO ] [MAIN ] FLO: Loaded 52082 existing records. [2025-10-16T18:57:28.283819] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:57:28.342087] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-16T18:57:28.387666] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-16T18:57:28.495970] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-16T18:57:28.530679] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-16T18:57:28.549808] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:57:28.573676] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:57:28.614976] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-16T18:57:28.620302] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-16T18:57:28.625613] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-16T18:57:28.649367] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-16T18:57:28.666858] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-16T18:57:28.699553] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-16T18:57:28.715866] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-16T18:57:28.719623] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:57:28.716019] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-16T18:57:28.770756] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-16T18:57:29.629307] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:57:29.640830] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T18:57:29.646228] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-16T18:57:29.696311] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-16T18:57:29.773387] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:57:29.792331] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-16T18:57:29.795617] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:57:29.796741] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-16T18:57:30.366437] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T18:57:30.368236] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-16T18:57:30.945779] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T18:57:30.947277] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-16T18:57:31.204152] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T18:57:31.212022] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-16T18:57:31.280588] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T18:57:31.528121] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T18:57:31.526533] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T18:57:31.942878] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-16T18:57:32.626030] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T18:57:32.742811] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-16T18:57:33.396597] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T18:57:33.542897] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-16T18:57:34.342844] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-16T18:57:34.412576] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T18:57:34.908796] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T18:57:35.142868] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-16T18:57:35.293112] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-16T18:57:35.942812] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-16T18:57:36.747986] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-16T18:57:36.761982] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T18:57:37.119969] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-16T18:57:37.524396] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T18:57:37.542780] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-16T18:57:38.342908] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-16T18:57:39.086907] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T18:57:39.142824] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-16T18:57:39.950086] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-16T18:57:39.956058] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T18:57:40.534627] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T18:57:40.644175] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T18:57:40.742782] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-16T18:57:41.542815] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-16T18:57:42.204491] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T18:57:42.342782] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-16T18:57:43.142877] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-16T18:57:43.261812] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T18:57:43.714904] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T18:57:43.942819] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-16T18:57:44.487515] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-16T18:57:44.510788] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T18:57:44.742808] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-16T18:57:45.542820] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-16T18:57:45.860172] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T18:57:46.342870] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-16T18:57:47.142839] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-16T18:57:47.260238] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T18:57:47.908750] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T18:57:47.942769] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-16T18:57:48.222771] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T18:57:48.296828] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-16T18:57:48.742819] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-16T18:57:49.542842] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-16T18:57:49.953829] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T18:57:50.342838] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-16T18:57:50.854424] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T18:57:51.044034] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T18:57:51.045225] [INFO ] [REMOTE ] FLC: Full fetch complete (7820 records). [2025-10-16T18:57:51.045296] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-16T18:57:51.146061] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-16T18:57:51.406507] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-16T18:57:51.406592] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-16T18:57:51.406935] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-16T18:57:51.406998] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-16T18:57:51.407395] [DEBUG] [LOCAL ] FLC: Trimmed 7820 records to 5440 (keeping 200 days of data) [2025-10-16T18:57:51.440497] [DEBUG] [LOCAL ] FLC: Primary data saved (5440 records). [2025-10-16T18:57:51.440623] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-16T18:57:51.440743] [INFO ] [MAIN ] Update Progress: 841/2369 symbols completed. FLC took 24.8s. Estimated remaining: 3h 34m 1s. Rate: 7.1 symbols/min [2025-10-16T18:57:51.615997] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:57:51.616200] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-16T18:57:51.616240] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-16T18:57:51.616355] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-16T18:57:51.616397] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-16T18:57:51.616440] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-16T18:57:51.616474] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-16T18:57:51.947976] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-16T18:57:51.988055] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:57:52.742845] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-16T18:57:52.866440] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T18:57:53.391779] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T18:57:53.542832] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-16T18:57:53.735956] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:57:53.736293] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-16T18:57:53.736437] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:57:53.736528] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-16T18:57:53.736602] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:57:53.736699] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-16T18:57:53.736778] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-16T18:57:53.736825] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-16T18:57:53.736871] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-16T18:57:53.736932] [INFO ] [MAIN ] Update Progress: 842/2369 symbols completed. FLOC took 2.3s. Estimated remaining: 3h 33m 42s. Rate: 7.1 symbols/min [2025-10-16T18:57:53.933333] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:57:53.989006] [DEBUG] [LOCAL ] FLR: Loaded 53241 existing records from primary storage. [2025-10-16T18:57:53.989351] [INFO ] [MAIN ] FLR: Loaded 53241 existing records. [2025-10-16T18:57:54.197113] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:57:54.197471] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-16T18:57:54.197526] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-16T18:57:54.197866] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-16T18:57:54.197923] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-16T18:57:54.347108] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-16T18:57:54.628816] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:57:54.662949] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T18:57:55.142811] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-16T18:57:55.930485] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-16T18:57:55.942786] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-16T18:57:56.742880] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-16T18:57:56.791949] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T18:57:57.458977] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T18:57:57.542848] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-16T18:57:58.342803] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-16T18:57:58.450820] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T18:57:58.565362] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T18:57:59.142820] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-16T18:57:59.942798] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-16T18:58:00.054981] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T18:58:00.306387] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-16T18:58:00.310434] [INFO ] [REMOTE ] FLNG: Full fetch complete (50123 records). [2025-10-16T18:58:00.310522] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-16T18:58:00.676376] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-16T18:58:00.676452] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-16T18:58:00.677204] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-16T18:58:00.677266] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-16T18:58:00.678252] [DEBUG] [LOCAL ] FLNG: Trimmed 50123 records to 33918 (keeping 200 days of data) [2025-10-16T18:58:00.765853] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-16T18:58:00.886862] [DEBUG] [LOCAL ] FLNG: Primary data saved (33918 records). [2025-10-16T18:58:00.887008] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-16T18:58:00.887111] [INFO ] [MAIN ] Update Progress: 843/2369 symbols completed. FLNG took 34.2s. Estimated remaining: 3h 33m 31s. Rate: 7.1 symbols/min [2025-10-16T18:58:01.054310] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:58:01.099318] [DEBUG] [LOCAL ] FLS: Loaded 50373 existing records from primary storage. [2025-10-16T18:58:01.099613] [INFO ] [MAIN ] FLS: Loaded 50373 existing records. [2025-10-16T18:58:01.281487] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:58:01.281741] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-16T18:58:01.281796] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-16T18:58:01.281977] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-16T18:58:01.282016] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-16T18:58:01.552112] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-16T18:58:01.636995] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:58:01.737608] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T18:58:02.342882] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-16T18:58:02.561759] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-16T18:58:03.142855] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-16T18:58:03.456090] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-16T18:58:03.463636] [INFO ] [REMOTE ] FLG: Full fetch complete (77431 records). [2025-10-16T18:58:03.464017] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-16T18:58:03.885239] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-16T18:58:03.885376] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-16T18:58:03.886635] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-16T18:58:03.886791] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-16T18:58:03.888374] [DEBUG] [LOCAL ] FLG: Trimmed 77431 records to 53717 (keeping 200 days of data) [2025-10-16T18:58:03.951179] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-16T18:58:04.007563] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T18:58:04.018265] [INFO ] [REMOTE ] FLO: Full fetch complete (75289 records). [2025-10-16T18:58:04.019239] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-16T18:58:04.455204] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-16T18:58:04.456231] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-16T18:58:04.458610] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-16T18:58:04.459803] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-16T18:58:04.551906] [DEBUG] [LOCAL ] FLO: Trimmed 75289 records to 52459 (keeping 200 days of data) [2025-10-16T18:58:04.687467] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T18:58:04.742805] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-16T18:58:05.033080] [DEBUG] [LOCAL ] FLG: Primary data saved (53717 records). [2025-10-16T18:58:05.034390] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-16T18:58:05.034514] [INFO ] [MAIN ] Update Progress: 844/2369 symbols completed. FLG took 38.4s. Estimated remaining: 3h 33m 15s. Rate: 7.2 symbols/min [2025-10-16T18:58:05.257388] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:58:05.264804] [DEBUG] [LOCAL ] FLO: Primary data saved (52459 records). [2025-10-16T18:58:05.265150] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-16T18:58:05.265723] [INFO ] [MAIN ] Update Progress: 845/2369 symbols completed. FLO took 38.6s. Estimated remaining: 3h 32m 52s. Rate: 7.2 symbols/min [2025-10-16T18:58:05.527756] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:58:05.532158] [DEBUG] [LOCAL ] FLUT: Loaded 50758 existing records from primary storage. [2025-10-16T18:58:05.532878] [INFO ] [MAIN ] FLUT: Loaded 50758 existing records. [2025-10-16T18:58:05.552848] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T18:58:05.597234] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-16T18:58:05.746516] [DEBUG] [LOCAL ] FLXR: Loaded 21029 existing records from primary storage. [2025-10-16T18:58:05.748618] [INFO ] [MAIN ] FLXR: Loaded 21029 existing records. [2025-10-16T18:58:05.770897] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:58:05.862274] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-16T18:58:05.872943] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-16T18:58:05.879039] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-16T18:58:05.889358] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-16T18:58:06.025506] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:58:06.042171] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-16T18:58:06.049033] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-16T18:58:06.061423] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-16T18:58:06.072404] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-16T18:58:06.604190] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:58:06.629003] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-16T18:58:06.714488] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:58:06.752741] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T18:58:07.142865] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-16T18:58:07.298664] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T18:58:07.840279] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-16T18:58:07.942811] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-16T18:58:08.152580] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T18:58:08.742873] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-16T18:58:09.413892] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T18:58:09.413451] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T18:58:09.542847] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-16T18:58:10.342861] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-16T18:58:11.142812] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-16T18:58:11.327950] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T18:58:11.644031] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T18:58:11.942822] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-16T18:58:12.599687] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T18:58:12.716705] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T18:58:12.742771] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-16T18:58:13.542834] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-16T18:58:13.747270] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-16T18:58:14.342837] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-16T18:58:15.142847] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-16T18:58:15.279477] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T18:58:15.760582] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:58:15.942847] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-16T18:58:16.742846] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-16T18:58:16.971197] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T18:58:17.374933] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T18:58:17.542878] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-16T18:58:17.726676] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T18:58:18.343038] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-16T18:58:19.142845] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-16T18:58:19.303576] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T18:58:19.942836] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-16T18:58:20.035438] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T18:58:20.732880] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T18:58:20.743137] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-16T18:58:21.518848] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-16T18:58:21.542786] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-16T18:58:22.035238] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T18:58:22.342814] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-16T18:58:23.142800] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-16T18:58:23.431012] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-16T18:58:23.942801] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-16T18:58:23.992839] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T18:58:24.203729] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T18:58:24.742822] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-16T18:58:25.460603] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T18:58:25.542777] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-16T18:58:26.342802] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-16T18:58:26.407070] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T18:58:27.142813] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-16T18:58:27.299391] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T18:58:27.942816] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-16T18:58:27.987070] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T18:58:28.742785] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-16T18:58:28.984308] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T18:58:28.991001] [INFO ] [REMOTE ] FLS: Full fetch complete (72438 records). [2025-10-16T18:58:28.991157] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-16T18:58:29.372886] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-16T18:58:29.372996] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-16T18:58:29.374028] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-16T18:58:29.374110] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-16T18:58:29.375573] [DEBUG] [LOCAL ] FLS: Trimmed 72438 records to 50762 (keeping 200 days of data) [2025-10-16T18:58:29.552084] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-16T18:58:29.638737] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T18:58:29.730967] [DEBUG] [LOCAL ] FLS: Primary data saved (50762 records). [2025-10-16T18:58:29.731115] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-16T18:58:29.731201] [INFO ] [MAIN ] Update Progress: 846/2369 symbols completed. FLS took 28.8s. Estimated remaining: 3h 33m 13s. Rate: 7.1 symbols/min [2025-10-16T18:58:29.894508] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:58:29.941367] [DEBUG] [LOCAL ] FMC: Loaded 51849 existing records from primary storage. [2025-10-16T18:58:29.941709] [INFO ] [MAIN ] FMC: Loaded 51849 existing records. [2025-10-16T18:58:30.111504] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:58:30.111772] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-16T18:58:30.111822] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-16T18:58:30.112034] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-16T18:58:30.112090] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-16T18:58:30.348006] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-16T18:58:30.473002] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:58:30.495389] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T18:58:30.503088] [INFO ] [REMOTE ] FLR: Full fetch complete (76798 records). [2025-10-16T18:58:30.503233] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-16T18:58:30.638030] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T18:58:30.977952] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-16T18:58:30.978036] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-16T18:58:30.979136] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-16T18:58:30.979203] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-16T18:58:30.980815] [DEBUG] [LOCAL ] FLR: Trimmed 76798 records to 53630 (keeping 200 days of data) [2025-10-16T18:58:31.157942] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-16T18:58:31.311454] [DEBUG] [LOCAL ] FLR: Primary data saved (53630 records). [2025-10-16T18:58:31.311604] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-16T18:58:31.312347] [INFO ] [MAIN ] Update Progress: 847/2369 symbols completed. FLR took 37.6s. Estimated remaining: 3h 32m 52s. Rate: 7.2 symbols/min [2025-10-16T18:58:31.475670] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:58:31.484250] [DEBUG] [LOCAL ] FMN: Loaded 5431 existing records from primary storage. [2025-10-16T18:58:31.484469] [INFO ] [MAIN ] FMN: Loaded 5431 existing records. [2025-10-16T18:58:31.653891] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:58:31.654124] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-16T18:58:31.654172] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-16T18:58:31.654302] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-16T18:58:31.654339] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-16T18:58:31.944799] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-16T18:58:32.020981] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:58:32.062613] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T18:58:32.742789] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-16T18:58:32.933258] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T18:58:33.040860] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T18:58:33.164794] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-16T18:58:33.542841] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-16T18:58:34.342800] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-16T18:58:34.636366] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T18:58:35.142819] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-16T18:58:35.942852] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-16T18:58:36.029969] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T18:58:36.742791] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-16T18:58:37.014400] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T18:58:37.075739] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T18:58:37.219604] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T18:58:37.542864] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-16T18:58:38.342789] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-16T18:58:38.446819] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T18:58:38.450626] [INFO ] [REMOTE ] FLXR: Full fetch complete (26951 records). [2025-10-16T18:58:38.450742] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-16T18:58:38.872761] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-16T18:58:38.872836] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-16T18:58:38.873400] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-16T18:58:38.873439] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-16T18:58:38.874116] [DEBUG] [LOCAL ] FLXR: Trimmed 26951 records to 21214 (keeping 200 days of data) [2025-10-16T18:58:39.008537] [DEBUG] [LOCAL ] FLXR: Primary data saved (21214 records). [2025-10-16T18:58:39.008715] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-16T18:58:39.008831] [INFO ] [MAIN ] Update Progress: 848/2369 symbols completed. FLXR took 33.7s. Estimated remaining: 3h 32m 42s. Rate: 7.2 symbols/min [2025-10-16T18:58:39.150314] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-16T18:58:39.177860] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:58:39.206686] [DEBUG] [LOCAL ] FMS: Loaded 30232 existing records from primary storage. [2025-10-16T18:58:39.206972] [INFO ] [MAIN ] FMS: Loaded 30232 existing records. [2025-10-16T18:58:39.388193] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:58:39.388423] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-16T18:58:39.388501] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-16T18:58:39.389330] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-16T18:58:39.389391] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-16T18:58:39.742934] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:58:39.942793] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-16T18:58:40.136665] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T18:58:40.667951] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T18:58:40.742865] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-16T18:58:40.966762] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T18:58:41.236223] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-16T18:58:41.542772] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-16T18:58:42.268192] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T18:58:42.342830] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-16T18:58:42.894048] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-16T18:58:43.142830] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-16T18:58:43.610694] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-16T18:58:43.942866] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-16T18:58:44.742822] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-16T18:58:45.542806] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-16T18:58:45.666833] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T18:58:45.984022] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-16T18:58:46.342782] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-16T18:58:46.723074] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-16T18:58:46.743817] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-16T18:58:46.750486] [INFO ] [REMOTE ] FLUT: Full fetch complete (73282 records). [2025-10-16T18:58:46.750606] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-16T18:58:47.130025] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-16T18:58:47.130108] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-16T18:58:47.131035] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-16T18:58:47.131100] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-16T18:58:47.132473] [DEBUG] [LOCAL ] FLUT: Trimmed 73282 records to 51111 (keeping 200 days of data) [2025-10-16T18:58:47.182003] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-16T18:58:47.434950] [DEBUG] [LOCAL ] FLUT: Primary data saved (51111 records). [2025-10-16T18:58:47.435097] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-16T18:58:47.435697] [INFO ] [MAIN ] Update Progress: 849/2369 symbols completed. FLUT took 42.4s. Estimated remaining: 3h 32m 34s. Rate: 7.2 symbols/min [2025-10-16T18:58:47.600545] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:58:47.639534] [DEBUG] [LOCAL ] FMX: Loaded 40547 existing records from primary storage. [2025-10-16T18:58:47.639879] [INFO ] [MAIN ] FMX: Loaded 40547 existing records. [2025-10-16T18:58:47.810528] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:58:47.810756] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-16T18:58:47.810805] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-16T18:58:47.811734] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-16T18:58:47.811796] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-16T18:58:47.947962] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-16T18:58:48.161943] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:58:48.570034] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T18:58:48.742796] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-16T18:58:49.099467] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T18:58:49.248073] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-16T18:58:49.249675] [INFO ] [REMOTE ] FMN: Full fetch complete (10173 records). [2025-10-16T18:58:49.249749] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-16T18:58:49.547592] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-16T18:58:49.628995] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-16T18:58:49.629074] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-16T18:58:49.629347] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-16T18:58:49.629406] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-16T18:58:49.629852] [DEBUG] [LOCAL ] FMN: Trimmed 10173 records to 5497 (keeping 200 days of data) [2025-10-16T18:58:49.662248] [DEBUG] [LOCAL ] FMN: Primary data saved (5497 records). [2025-10-16T18:58:49.662350] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-16T18:58:49.662426] [INFO ] [MAIN ] Update Progress: 850/2369 symbols completed. FMN took 18.3s. Estimated remaining: 3h 32m 15s. Rate: 7.2 symbols/min [2025-10-16T18:58:49.829722] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:58:49.833474] [DEBUG] [LOCAL ] FMY: Loaded 1388 existing records from primary storage. [2025-10-16T18:58:49.833615] [INFO ] [MAIN ] FMY: Loaded 1388 existing records. [2025-10-16T18:58:50.004626] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:58:50.004866] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-16T18:58:50.004944] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-16T18:58:50.005090] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-16T18:58:50.005157] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-16T18:58:50.351824] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:58:50.347903] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-16T18:58:51.142786] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-16T18:58:51.343936] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T18:58:51.545434] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-16T18:58:51.944009] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T18:58:51.942782] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-16T18:58:52.742852] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-16T18:58:53.088142] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-16T18:58:53.552031] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-16T18:58:53.570053] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T18:58:54.342939] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-16T18:58:54.811904] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T18:58:55.142885] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-16T18:58:55.552943] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T18:58:55.566018] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-16T18:58:55.942826] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-16T18:58:56.742790] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-16T18:58:56.818959] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T18:58:57.542841] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-16T18:58:58.192963] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T18:58:58.342787] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-16T18:58:58.701926] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T18:58:59.142791] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-16T18:58:59.917710] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T18:58:59.942770] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-16T18:59:00.465918] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T18:59:00.742863] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-16T18:59:01.097534] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-16T18:59:01.420800] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T18:59:01.542885] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-16T18:59:02.342833] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-16T18:59:03.004247] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T18:59:03.142857] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-16T18:59:03.579500] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-16T18:59:03.837665] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T18:59:03.942895] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-16T18:59:04.742882] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-16T18:59:05.094304] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-16T18:59:05.426467] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T18:59:05.542891] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-16T18:59:06.342858] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-16T18:59:07.142902] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-16T18:59:07.347264] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T18:59:07.357632] [INFO ] [REMOTE ] FMC: Full fetch complete (75367 records). [2025-10-16T18:59:07.357969] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-16T18:59:07.868941] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-16T18:59:07.869089] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-16T18:59:07.870909] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-16T18:59:07.871075] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-16T18:59:07.873394] [DEBUG] [LOCAL ] FMC: Trimmed 75367 records to 52236 (keeping 200 days of data) [2025-10-16T18:59:07.900554] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T18:59:07.964174] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-16T18:59:08.275943] [DEBUG] [LOCAL ] FMC: Primary data saved (52236 records). [2025-10-16T18:59:08.276210] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-16T18:59:08.276372] [INFO ] [MAIN ] Update Progress: 851/2369 symbols completed. FMC took 38.5s. Estimated remaining: 3h 32m 24s. Rate: 7.1 symbols/min [2025-10-16T18:59:08.375762] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T18:59:08.472242] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:59:08.495781] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T18:59:08.534958] [DEBUG] [LOCAL ] FN: Loaded 37711 existing records from primary storage. [2025-10-16T18:59:08.535258] [INFO ] [MAIN ] FN: Loaded 37711 existing records. [2025-10-16T18:59:08.716895] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:59:08.717213] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-16T18:59:08.717272] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-16T18:59:08.718513] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-16T18:59:08.718604] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-16T18:59:08.748127] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-16T18:59:09.088035] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:59:09.542864] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-16T18:59:10.260874] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T18:59:10.342840] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-16T18:59:10.867026] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T18:59:11.142842] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-16T18:59:11.419098] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T18:59:11.597579] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-16T18:59:11.942843] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-16T18:59:12.742905] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-16T18:59:13.109618] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-16T18:59:13.544129] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-16T18:59:13.549471] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T18:59:14.342903] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-16T18:59:14.980677] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T18:59:15.142871] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-16T18:59:15.535753] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T18:59:15.942884] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-16T18:59:16.347427] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T18:59:16.379503] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T18:59:16.742795] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-16T18:59:17.145633] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-16T18:59:17.146353] [INFO ] [REMOTE ] FMY: Full fetch complete (1953 records). [2025-10-16T18:59:17.146419] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-16T18:59:17.512502] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-16T18:59:17.512583] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-16T18:59:17.512696] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-16T18:59:17.512755] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-16T18:59:17.513072] [DEBUG] [LOCAL ] FMY: Trimmed 1953 records to 1390 (keeping 200 days of data) [2025-10-16T18:59:17.521756] [DEBUG] [LOCAL ] FMY: Primary data saved (1390 records). [2025-10-16T18:59:17.521814] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-16T18:59:17.521877] [INFO ] [MAIN ] Update Progress: 852/2369 symbols completed. FMY took 27.9s. Estimated remaining: 3h 32m 18s. Rate: 7.1 symbols/min [2025-10-16T18:59:17.549898] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-16T18:59:17.692278] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:59:17.745976] [DEBUG] [LOCAL ] FNB: Loaded 52596 existing records from primary storage. [2025-10-16T18:59:17.746311] [INFO ] [MAIN ] FNB: Loaded 52596 existing records. [2025-10-16T18:59:17.918712] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:59:17.918934] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-16T18:59:17.918988] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-16T18:59:17.919962] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-16T18:59:17.920019] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-16T18:59:18.260424] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:59:18.342814] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-16T18:59:18.904454] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T18:59:19.142885] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-16T18:59:19.942796] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-16T18:59:20.000259] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T18:59:20.512537] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T18:59:20.742829] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-16T18:59:21.101431] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T18:59:21.542824] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-16T18:59:22.342798] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-16T18:59:22.462996] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T18:59:22.734469] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T18:59:23.142818] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-16T18:59:23.566256] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T18:59:23.942846] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-16T18:59:24.340867] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T18:59:24.345772] [INFO ] [REMOTE ] FMX: Full fetch complete (57909 records). [2025-10-16T18:59:24.345903] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-16T18:59:24.743723] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-16T18:59:24.744032] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-16T18:59:24.744940] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-16T18:59:24.745025] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-16T18:59:24.743842] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-16T18:59:24.747119] [DEBUG] [LOCAL ] FMX: Trimmed 57909 records to 40866 (keeping 200 days of data) [2025-10-16T18:59:25.000209] [DEBUG] [LOCAL ] FMX: Primary data saved (40866 records). [2025-10-16T18:59:25.000340] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-16T18:59:25.001316] [INFO ] [MAIN ] Update Progress: 853/2369 symbols completed. FMX took 37.6s. Estimated remaining: 3h 32m 7s. Rate: 7.1 symbols/min [2025-10-16T18:59:25.170162] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:59:25.220763] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T18:59:25.245521] [DEBUG] [LOCAL ] FND: Loaded 52150 existing records from primary storage. [2025-10-16T18:59:25.245858] [INFO ] [MAIN ] FND: Loaded 52150 existing records. [2025-10-16T18:59:25.419290] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:59:25.419536] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-16T18:59:25.419587] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-16T18:59:25.420500] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-16T18:59:25.420559] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-16T18:59:25.554114] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-16T18:59:25.768241] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:59:26.348515] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-16T18:59:26.361720] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T18:59:27.005341] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T18:59:27.009497] [INFO ] [REMOTE ] FMS: Full fetch complete (42664 records). [2025-10-16T18:59:27.009598] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-16T18:59:27.150859] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-16T18:59:27.386255] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-16T18:59:27.386328] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-16T18:59:27.387049] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-16T18:59:27.387110] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-16T18:59:27.388001] [DEBUG] [LOCAL ] FMS: Trimmed 42664 records to 30464 (keeping 200 days of data) [2025-10-16T18:59:27.579571] [DEBUG] [LOCAL ] FMS: Primary data saved (30464 records). [2025-10-16T18:59:27.579798] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-16T18:59:27.579922] [INFO ] [MAIN ] Update Progress: 854/2369 symbols completed. FMS took 48.6s. Estimated remaining: 3h 31m 49s. Rate: 7.2 symbols/min [2025-10-16T18:59:27.814670] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:59:27.865001] [DEBUG] [LOCAL ] FNF: Loaded 48942 existing records from primary storage. [2025-10-16T18:59:27.865452] [INFO ] [MAIN ] FNF: Loaded 48942 existing records. [2025-10-16T18:59:27.947861] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-16T18:59:28.064712] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:59:28.065247] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-16T18:59:28.065358] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-16T18:59:28.065887] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-16T18:59:28.065958] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-16T18:59:28.189727] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-16T18:59:28.503770] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:59:28.690719] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T18:59:28.742814] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-16T18:59:29.542886] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-16T18:59:29.611486] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T18:59:30.091777] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T18:59:30.342832] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-16T18:59:31.067164] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T18:59:31.142846] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-16T18:59:31.692329] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T18:59:31.942837] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-16T18:59:32.450109] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T18:59:32.742846] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-16T18:59:33.542888] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-16T18:59:33.690555] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T18:59:34.327345] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T18:59:34.342841] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-16T18:59:35.142852] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-16T18:59:35.180229] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T18:59:35.942364] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T18:59:35.951371] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-16T18:59:36.742839] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-16T18:59:36.930875] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T18:59:37.542900] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-16T18:59:37.729149] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T18:59:37.871901] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T18:59:38.342875] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-16T18:59:39.018214] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T18:59:39.142807] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-16T18:59:39.591770] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T18:59:39.596043] [INFO ] [REMOTE ] FN: Full fetch complete (56212 records). [2025-10-16T18:59:39.596149] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-16T18:59:39.950684] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-16T18:59:39.988439] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-16T18:59:39.988510] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-16T18:59:39.989518] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-16T18:59:39.989583] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-16T18:59:39.990781] [DEBUG] [LOCAL ] FN: Trimmed 56212 records to 38016 (keeping 200 days of data) [2025-10-16T18:59:40.225003] [DEBUG] [LOCAL ] FN: Primary data saved (38016 records). [2025-10-16T18:59:40.225171] [INFO ] [MAIN ] FN: Full history saved. [2025-10-16T18:59:40.225282] [INFO ] [MAIN ] Update Progress: 855/2369 symbols completed. FN took 31.9s. Estimated remaining: 3h 31m 48s. Rate: 7.1 symbols/min [2025-10-16T18:59:40.408063] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:59:40.408300] [DEBUG] [LOCAL ] FNV: No existing data file found in primary storage. [2025-10-16T18:59:40.408349] [WARN ] [MAIN ] FNV: No existing data found, performing full refresh instead. [2025-10-16T18:59:40.408458] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-16T18:59:40.408500] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-16T18:59:40.408542] [DEBUG] [LOCAL ] FNV: No primary data file found to delete. [2025-10-16T18:59:40.408602] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-16T18:59:40.751737] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-16T18:59:40.782118] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:59:40.813776] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T18:59:41.446079] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T18:59:41.542801] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-16T18:59:42.342796] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-16T18:59:42.504908] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T18:59:42.771268] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T18:59:43.142864] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-16T18:59:43.929617] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T18:59:43.942777] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-16T18:59:44.566624] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T18:59:44.742782] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-16T18:59:45.542869] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-16T18:59:45.597546] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T18:59:46.170885] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T18:59:46.342813] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-16T18:59:47.142921] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-16T18:59:47.271540] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T18:59:47.835331] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T18:59:47.942888] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-16T18:59:48.742882] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-16T18:59:49.542934] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-16T18:59:50.347739] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T18:59:50.358485] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-16T18:59:53.296057] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (6.15 seconds). [2025-10-16T18:59:53.308182] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-16T18:59:54.987266] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T18:59:54.998853] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-16T18:59:55.315930] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (7.37 seconds). [2025-10-16T18:59:55.326432] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-16T18:59:56.430584] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (6.89 seconds). [2025-10-16T18:59:56.442265] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-16T18:59:57.114808] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (6.76 seconds). [2025-10-16T18:59:57.126690] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-16T18:59:57.475741] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-16T18:59:57.483244] [INFO ] [REMOTE ] FNB: Full fetch complete (76156 records). [2025-10-16T18:59:57.483435] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-16T18:59:57.909111] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-16T18:59:57.909279] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-16T18:59:57.910789] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-16T18:59:57.910911] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-16T18:59:57.913470] [DEBUG] [LOCAL ] FNB: Trimmed 76156 records to 52986 (keeping 200 days of data) [2025-10-16T18:59:58.048742] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-16T18:59:58.063333] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-16T18:59:58.233438] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T18:59:58.248739] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-16T18:59:58.361675] [DEBUG] [LOCAL ] FNB: Primary data saved (52986 records). [2025-10-16T18:59:58.361889] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-16T18:59:58.362930] [INFO ] [MAIN ] Update Progress: 856/2369 symbols completed. FNB took 40.8s. Estimated remaining: 3h 31m 57s. Rate: 7.1 symbols/min [2025-10-16T18:59:58.547021] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:59:58.563620] [DEBUG] [LOCAL ] FOA: Loaded 13050 existing records from primary storage. [2025-10-16T18:59:58.563921] [INFO ] [MAIN ] FOA: Loaded 13050 existing records. [2025-10-16T18:59:58.761385] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:59:58.761844] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-16T18:59:58.761910] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-16T18:59:58.799176] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-16T18:59:58.799279] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-16T18:59:58.883123] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T18:59:58.936025] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-16T18:59:59.203506] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:59:59.203886] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-16T18:59:59.686691] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T18:59:59.698596] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-16T18:59:59.868910] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T18:59:59.881809] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-16T18:59:59.906588] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-16T18:59:59.942863] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-16T19:00:00.173425] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T19:00:00.742927] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-16T19:00:01.037620] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T19:00:01.373141] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:00:01.425533] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T19:00:01.542812] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-16T19:00:02.342923] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-16T19:00:02.567511] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T19:00:03.142858] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-16T19:00:03.935235] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-16T19:00:03.944303] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-16T19:00:04.166510] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T19:00:04.173423] [INFO ] [REMOTE ] FND: Full fetch complete (74997 records). [2025-10-16T19:00:04.173543] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-16T19:00:04.573311] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-16T19:00:04.573411] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-16T19:00:04.574464] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-16T19:00:04.574575] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-16T19:00:04.590983] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T19:00:04.596709] [DEBUG] [LOCAL ] FND: Trimmed 74997 records to 52517 (keeping 200 days of data) [2025-10-16T19:00:04.597555] [INFO ] [REMOTE ] FNF: Full fetch complete (69976 records). [2025-10-16T19:00:04.597852] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-16T19:00:04.767574] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-16T19:00:05.062023] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T19:00:05.148367] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-16T19:00:05.148778] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-16T19:00:05.150099] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-16T19:00:05.150181] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-16T19:00:05.158221] [DEBUG] [LOCAL ] FNF: Trimmed 69976 records to 49296 (keeping 200 days of data) [2025-10-16T19:00:05.549168] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-16T19:00:05.645796] [DEBUG] [LOCAL ] FNF: Primary data saved (49296 records). [2025-10-16T19:00:05.646473] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-16T19:00:05.647312] [INFO ] [MAIN ] Update Progress: 857/2369 symbols completed. FNF took 38.1s. Estimated remaining: 3h 31m 46s. Rate: 7.1 symbols/min [2025-10-16T19:00:05.780361] [DEBUG] [LOCAL ] FND: Primary data saved (52517 records). [2025-10-16T19:00:05.797844] [INFO ] [MAIN ] FND: Full history saved. [2025-10-16T19:00:05.804874] [INFO ] [MAIN ] Update Progress: 858/2369 symbols completed. FND took 40.8s. Estimated remaining: 3h 31m 23s. Rate: 7.1 symbols/min [2025-10-16T19:00:05.842393] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:00:05.987865] [DEBUG] [LOCAL ] FOF: Loaded 8595 existing records from primary storage. [2025-10-16T19:00:06.014283] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:00:06.011009] [INFO ] [MAIN ] FOF: Loaded 8595 existing records. [2025-10-16T19:00:06.205507] [DEBUG] [LOCAL ] FOR: Loaded 19813 existing records from primary storage. [2025-10-16T19:00:06.215103] [INFO ] [MAIN ] FOR: Loaded 19813 existing records. [2025-10-16T19:00:06.272483] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:00:06.307299] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-16T19:00:06.313261] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-16T19:00:06.330309] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-16T19:00:06.340967] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-16T19:00:06.524251] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:00:06.527886] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-16T19:00:06.533952] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-16T19:00:06.549781] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-16T19:00:06.591848] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-16T19:00:06.722533] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T19:00:06.813460] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-16T19:00:06.931035] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:00:07.151336] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-16T19:00:07.193039] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:00:07.237362] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-16T19:00:07.932506] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T19:00:07.937307] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-16T19:00:07.943515] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-16T19:00:08.742820] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-16T19:00:09.345964] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T19:00:09.399582] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-16T19:00:09.542821] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-16T19:00:10.342851] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-16T19:00:10.365477] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-16T19:00:11.105242] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T19:00:11.142770] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-16T19:00:11.844360] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-16T19:00:11.942817] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-16T19:00:12.742811] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-16T19:00:13.542959] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-16T19:00:13.546248] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T19:00:13.683532] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-16T19:00:14.339515] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T19:00:14.342838] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-16T19:00:15.139344] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T19:00:15.142757] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-16T19:00:15.942790] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-16T19:00:16.100603] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-16T19:00:16.742839] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-16T19:00:17.050630] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T19:00:17.336958] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T19:00:17.542812] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-16T19:00:18.342822] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-16T19:00:19.077353] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T19:00:19.083784] [INFO ] [REMOTE ] FNV: Full fetch complete (66726 records). [2025-10-16T19:00:19.083956] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-16T19:00:19.148011] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-16T19:00:19.497326] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-16T19:00:19.498003] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-16T19:00:19.498615] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T19:00:19.499969] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-16T19:00:19.504395] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-16T19:00:19.506469] [DEBUG] [LOCAL ] FNV: Trimmed 66726 records to 46507 (keeping 200 days of data) [2025-10-16T19:00:19.795600] [DEBUG] [LOCAL ] FNV: Primary data saved (46507 records). [2025-10-16T19:00:19.795760] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-16T19:00:19.795838] [INFO ] [MAIN ] Update Progress: 859/2369 symbols completed. FNV took 39.6s. Estimated remaining: 3h 31m 25s. Rate: 7.1 symbols/min [2025-10-16T19:00:19.923340] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T19:00:19.946582] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-16T19:00:19.982370] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:00:20.025960] [DEBUG] [LOCAL ] FOUR: Loaded 49718 existing records from primary storage. [2025-10-16T19:00:20.026278] [INFO ] [MAIN ] FOUR: Loaded 49718 existing records. [2025-10-16T19:00:20.204208] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:00:20.204447] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-16T19:00:20.204495] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-16T19:00:20.205269] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-16T19:00:20.205327] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-16T19:00:20.567607] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:00:20.742769] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-16T19:00:20.985054] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T19:00:21.542852] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-16T19:00:21.720037] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T19:00:22.342867] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-16T19:00:23.142785] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-16T19:00:23.272236] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T19:00:23.658469] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T19:00:23.918427] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-16T19:00:23.942766] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-16T19:00:24.489853] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-16T19:00:24.742806] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-16T19:00:25.542814] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-16T19:00:26.343176] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-16T19:00:26.350282] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T19:00:26.547794] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T19:00:26.550064] [INFO ] [REMOTE ] FOA: Full fetch complete (21684 records). [2025-10-16T19:00:26.550145] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-16T19:00:26.916498] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-16T19:00:26.916572] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-16T19:00:26.917042] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-16T19:00:26.917102] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-16T19:00:26.917630] [DEBUG] [LOCAL ] FOA: Trimmed 21684 records to 13156 (keeping 200 days of data) [2025-10-16T19:00:26.994039] [DEBUG] [LOCAL ] FOA: Primary data saved (13156 records). [2025-10-16T19:00:26.994176] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-16T19:00:26.994262] [INFO ] [MAIN ] Update Progress: 860/2369 symbols completed. FOA took 28.6s. Estimated remaining: 3h 31m 14s. Rate: 7.1 symbols/min [2025-10-16T19:00:27.143701] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-16T19:00:27.164346] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:00:27.183789] [DEBUG] [LOCAL ] FPF: Loaded 18844 existing records from primary storage. [2025-10-16T19:00:27.184028] [INFO ] [MAIN ] FPF: Loaded 18844 existing records. [2025-10-16T19:00:27.357135] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:00:27.357444] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-16T19:00:27.357564] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-16T19:00:27.358068] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-16T19:00:27.358126] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-16T19:00:27.506856] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-16T19:00:27.719639] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:00:27.942915] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-16T19:00:28.703983] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T19:00:28.742870] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-16T19:00:28.875863] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T19:00:29.290725] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-16T19:00:29.292299] [INFO ] [REMOTE ] FOF: Full fetch complete (11927 records). [2025-10-16T19:00:29.292372] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-16T19:00:29.548044] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-16T19:00:29.656099] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-16T19:00:29.656193] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-16T19:00:29.656552] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-16T19:00:29.656610] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-16T19:00:29.657097] [DEBUG] [LOCAL ] FOF: Trimmed 11927 records to 8657 (keeping 200 days of data) [2025-10-16T19:00:29.709119] [DEBUG] [LOCAL ] FOF: Primary data saved (8657 records). [2025-10-16T19:00:29.709247] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-16T19:00:29.709327] [INFO ] [MAIN ] Update Progress: 861/2369 symbols completed. FOF took 24.1s. Estimated remaining: 3h 30m 56s. Rate: 7.1 symbols/min [2025-10-16T19:00:29.876687] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:00:29.893924] [DEBUG] [LOCAL ] FPH: Loaded 19325 existing records from primary storage. [2025-10-16T19:00:29.894159] [INFO ] [MAIN ] FPH: Loaded 19325 existing records. [2025-10-16T19:00:30.067146] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:00:30.067343] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-16T19:00:30.067389] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-16T19:00:30.067773] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-16T19:00:30.067832] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-16T19:00:30.348002] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-16T19:00:30.422254] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:00:30.506662] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-16T19:00:31.142831] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-16T19:00:31.942812] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-16T19:00:32.101925] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T19:00:32.225221] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T19:00:32.742781] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-16T19:00:33.042076] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T19:00:33.542880] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-16T19:00:34.342797] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-16T19:00:34.408943] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T19:00:34.473080] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T19:00:35.142872] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-16T19:00:35.216278] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T19:00:35.942808] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-16T19:00:36.742855] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-16T19:00:36.819280] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T19:00:37.084984] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T19:00:37.337229] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T19:00:37.542845] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-16T19:00:38.342784] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-16T19:00:38.386739] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-16T19:00:39.142813] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-16T19:00:39.199708] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T19:00:39.868162] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T19:00:39.942955] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-16T19:00:40.742785] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-16T19:00:40.923384] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T19:00:41.542859] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-16T19:00:42.067772] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T19:00:42.196802] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T19:00:42.342831] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-16T19:00:43.142816] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-16T19:00:43.486135] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T19:00:43.942843] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-16T19:00:44.742827] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-16T19:00:44.819428] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T19:00:44.908031] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T19:00:44.910537] [INFO ] [REMOTE ] FOR: Full fetch complete (29791 records). [2025-10-16T19:00:44.910609] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-16T19:00:45.291162] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-16T19:00:45.291241] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-16T19:00:45.291940] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-16T19:00:45.292003] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-16T19:00:45.292719] [DEBUG] [LOCAL ] FOR: Trimmed 29791 records to 19877 (keeping 200 days of data) [2025-10-16T19:00:45.409447] [DEBUG] [LOCAL ] FOR: Primary data saved (19877 records). [2025-10-16T19:00:45.409594] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-16T19:00:45.409700] [INFO ] [MAIN ] Update Progress: 862/2369 symbols completed. FOR took 39.6s. Estimated remaining: 3h 31m 0s. Rate: 7.1 symbols/min [2025-10-16T19:00:45.549881] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-16T19:00:45.584405] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:00:45.615491] [DEBUG] [LOCAL ] FPI: Loaded 31359 existing records from primary storage. [2025-10-16T19:00:45.615837] [INFO ] [MAIN ] FPI: Loaded 31359 existing records. [2025-10-16T19:00:45.794998] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:00:45.795292] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-16T19:00:45.795443] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-16T19:00:45.796270] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-16T19:00:45.796328] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-16T19:00:45.990610] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-16T19:00:46.192605] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:00:46.342912] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-16T19:00:47.142868] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-16T19:00:47.265298] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T19:00:47.784104] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T19:00:47.942793] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-16T19:00:48.137282] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T19:00:48.742797] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-16T19:00:48.988142] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T19:00:49.542791] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-16T19:00:49.708533] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-16T19:00:50.342845] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-16T19:00:51.066562] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T19:00:51.142794] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-16T19:00:51.196766] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T19:00:51.942792] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-16T19:00:52.039750] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-16T19:00:52.742829] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-16T19:00:52.925026] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-16T19:00:53.542829] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-16T19:00:53.648483] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T19:00:54.307584] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-16T19:00:54.342822] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-16T19:00:55.142844] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-16T19:00:55.500692] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T19:00:55.942816] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-16T19:00:56.742876] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-16T19:00:57.007470] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T19:00:57.128049] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-16T19:00:57.134806] [INFO ] [REMOTE ] FOUR: Full fetch complete (72264 records). [2025-10-16T19:00:57.134954] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-16T19:00:57.521573] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-16T19:00:57.521693] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-16T19:00:57.522736] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-16T19:00:57.522893] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-16T19:00:57.524376] [DEBUG] [LOCAL ] FOUR: Trimmed 72264 records to 50101 (keeping 200 days of data) [2025-10-16T19:00:57.573104] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-16T19:00:57.750560] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T19:00:57.843431] [DEBUG] [LOCAL ] FOUR: Primary data saved (50101 records). [2025-10-16T19:00:57.843573] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-16T19:00:57.843672] [INFO ] [MAIN ] Update Progress: 863/2369 symbols completed. FOUR took 38.0s. Estimated remaining: 3h 30m 59s. Rate: 7.1 symbols/min [2025-10-16T19:00:58.017439] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:00:58.057804] [DEBUG] [LOCAL ] FR: Loaded 46546 existing records from primary storage. [2025-10-16T19:00:58.058145] [INFO ] [MAIN ] FR: Loaded 46546 existing records. [2025-10-16T19:00:58.244756] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:00:58.245001] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-16T19:00:58.245070] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-16T19:00:58.245892] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-16T19:00:58.245951] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-16T19:00:58.347952] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-16T19:00:58.413277] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T19:00:58.658076] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:00:59.142823] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-16T19:00:59.544805] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T19:00:59.548834] [INFO ] [REMOTE ] FPF: Full fetch complete (26738 records). [2025-10-16T19:00:59.548948] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-16T19:00:59.930589] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-16T19:00:59.930691] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-16T19:00:59.931278] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-16T19:00:59.931320] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-16T19:00:59.932015] [DEBUG] [LOCAL ] FPF: Trimmed 26738 records to 19054 (keeping 200 days of data) [2025-10-16T19:00:59.980254] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-16T19:01:00.049256] [DEBUG] [LOCAL ] FPF: Primary data saved (19054 records). [2025-10-16T19:01:00.049380] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-16T19:01:00.049458] [INFO ] [MAIN ] Update Progress: 864/2369 symbols completed. FPF took 33.1s. Estimated remaining: 3h 30m 40s. Rate: 7.1 symbols/min [2025-10-16T19:01:00.214848] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:01:00.229770] [DEBUG] [LOCAL ] FRA: Loaded 14294 existing records from primary storage. [2025-10-16T19:01:00.230052] [INFO ] [MAIN ] FRA: Loaded 14294 existing records. [2025-10-16T19:01:00.411932] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:01:00.412285] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-16T19:01:00.412407] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-16T19:01:00.412846] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-16T19:01:00.412917] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-16T19:01:00.785626] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-16T19:01:00.822919] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:01:00.826194] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T19:01:01.058856] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T19:01:01.542852] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-16T19:01:02.342838] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-16T19:01:02.747064] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T19:01:03.142881] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-16T19:01:03.386086] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T19:01:03.389927] [INFO ] [REMOTE ] FPH: Full fetch complete (31152 records). [2025-10-16T19:01:03.390069] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-16T19:01:03.522050] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-16T19:01:03.875796] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-16T19:01:03.875909] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-16T19:01:03.876873] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-16T19:01:03.877015] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-16T19:01:03.888983] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T19:01:03.893806] [DEBUG] [LOCAL ] FPH: Trimmed 31152 records to 19484 (keeping 200 days of data) [2025-10-16T19:01:03.949233] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-16T19:01:04.018570] [DEBUG] [LOCAL ] FPH: Primary data saved (19484 records). [2025-10-16T19:01:04.018767] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-16T19:01:04.018864] [INFO ] [MAIN ] Update Progress: 865/2369 symbols completed. FPH took 34.3s. Estimated remaining: 3h 30m 24s. Rate: 7.1 symbols/min [2025-10-16T19:01:04.219964] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:01:04.238710] [DEBUG] [LOCAL ] FRGE: Loaded 16119 existing records from primary storage. [2025-10-16T19:01:04.239018] [INFO ] [MAIN ] FRGE: Loaded 16119 existing records. [2025-10-16T19:01:04.449998] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:01:04.450280] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-16T19:01:04.450359] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-16T19:01:04.450559] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-16T19:01:04.450617] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-16T19:01:04.744243] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-16T19:01:04.877286] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:01:05.143142] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T19:01:05.542830] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-16T19:01:06.342797] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-16T19:01:06.395413] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T19:01:06.865221] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T19:01:07.142861] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-16T19:01:07.257527] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T19:01:07.942811] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-16T19:01:08.753732] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-16T19:01:08.788852] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:01:09.301552] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T19:01:09.542848] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-16T19:01:09.752499] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T19:01:10.212916] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T19:01:10.342796] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-16T19:01:11.142815] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-16T19:01:11.358285] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T19:01:11.942819] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-16T19:01:12.742794] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-16T19:01:12.777842] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T19:01:12.801804] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T19:01:13.542806] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-16T19:01:14.273003] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T19:01:14.287600] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T19:01:14.342781] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-16T19:01:15.006864] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-16T19:01:15.142794] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-16T19:01:15.942830] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-16T19:01:16.532186] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T19:01:16.742810] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-16T19:01:17.522772] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T19:01:17.542799] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-16T19:01:17.758007] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-16T19:01:18.342801] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-16T19:01:19.102586] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T19:01:19.142773] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-16T19:01:19.513402] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T19:01:19.942814] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-16T19:01:20.742807] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-16T19:01:20.869127] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T19:01:20.912434] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T19:01:21.542809] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-16T19:01:21.918140] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T19:01:22.342838] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-16T19:01:23.067767] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T19:01:23.096959] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T19:01:23.142774] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-16T19:01:23.942803] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-16T19:01:24.637809] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T19:01:24.679197] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T19:01:24.681579] [INFO ] [REMOTE ] FRA: Full fetch complete (23636 records). [2025-10-16T19:01:24.681694] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-16T19:01:24.747952] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-16T19:01:25.069712] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-16T19:01:25.069797] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-16T19:01:25.070284] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-16T19:01:25.070323] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-16T19:01:25.070931] [DEBUG] [LOCAL ] FRA: Trimmed 23636 records to 14371 (keeping 200 days of data) [2025-10-16T19:01:25.158479] [DEBUG] [LOCAL ] FRA: Primary data saved (14371 records). [2025-10-16T19:01:25.158635] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-16T19:01:25.158756] [INFO ] [MAIN ] Update Progress: 866/2369 symbols completed. FRA took 25.1s. Estimated remaining: 3h 30m 37s. Rate: 7.1 symbols/min [2025-10-16T19:01:25.328189] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:01:25.380283] [DEBUG] [LOCAL ] FRO: Loaded 51696 existing records from primary storage. [2025-10-16T19:01:25.380591] [INFO ] [MAIN ] FRO: Loaded 51696 existing records. [2025-10-16T19:01:25.544791] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-16T19:01:25.560297] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:01:25.560527] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-16T19:01:25.560574] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-16T19:01:25.561236] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-16T19:01:25.561307] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-16T19:01:25.917296] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:01:26.006421] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-16T19:01:26.342822] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-16T19:01:26.886438] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T19:01:26.971922] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-16T19:01:27.142840] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-16T19:01:27.942846] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-16T19:01:28.507571] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T19:01:28.511905] [INFO ] [REMOTE ] FPI: Full fetch complete (43917 records). [2025-10-16T19:01:28.512061] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-16T19:01:28.747972] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-16T19:01:28.916960] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-16T19:01:28.917050] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-16T19:01:28.917820] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-16T19:01:28.917886] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-16T19:01:28.919115] [DEBUG] [LOCAL ] FPI: Trimmed 43917 records to 31623 (keeping 200 days of data) [2025-10-16T19:01:29.113972] [DEBUG] [LOCAL ] FPI: Primary data saved (31623 records). [2025-10-16T19:01:29.114107] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-16T19:01:29.114182] [INFO ] [MAIN ] Update Progress: 867/2369 symbols completed. FPI took 43.7s. Estimated remaining: 3h 30m 21s. Rate: 7.1 symbols/min [2025-10-16T19:01:29.282272] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:01:29.335784] [DEBUG] [LOCAL ] FRT: Loaded 41709 existing records from primary storage. [2025-10-16T19:01:29.336899] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T19:01:29.337245] [INFO ] [MAIN ] FRT: Loaded 41709 existing records. [2025-10-16T19:01:29.385604] [INFO ] [REMOTE ] FR: Full fetch complete (67022 records). [2025-10-16T19:01:29.411609] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-16T19:01:29.547059] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-16T19:01:29.653535] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:01:29.663961] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-16T19:01:29.682985] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-16T19:01:29.713109] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-16T19:01:29.778328] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-16T19:01:30.093160] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-16T19:01:30.108735] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-16T19:01:30.113909] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-16T19:01:30.159156] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-16T19:01:30.223886] [DEBUG] [LOCAL ] FR: Trimmed 67022 records to 46923 (keeping 200 days of data) [2025-10-16T19:01:30.348485] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:01:30.385120] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-16T19:01:30.408546] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-16T19:01:30.594304] [DEBUG] [LOCAL ] FR: Primary data saved (46923 records). [2025-10-16T19:01:30.594438] [INFO ] [MAIN ] FR: Full history saved. [2025-10-16T19:01:30.594518] [INFO ] [MAIN ] Update Progress: 868/2369 symbols completed. FR took 32.8s. Estimated remaining: 3h 30m 1s. Rate: 7.1 symbols/min [2025-10-16T19:01:30.766813] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:01:30.801850] [DEBUG] [LOCAL ] FSCO: Loaded 38487 existing records from primary storage. [2025-10-16T19:01:30.802126] [INFO ] [MAIN ] FSCO: Loaded 38487 existing records. [2025-10-16T19:01:30.988180] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:01:30.998195] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-16T19:01:31.011846] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-16T19:01:31.014948] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-16T19:01:31.015396] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-16T19:01:31.016533] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-16T19:01:31.147891] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-16T19:01:31.395969] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:01:31.819478] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T19:01:31.836226] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-16T19:01:31.942818] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-16T19:01:32.742848] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-16T19:01:33.398150] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T19:01:33.542851] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-16T19:01:33.720169] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T19:01:34.342820] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-16T19:01:34.729268] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T19:01:35.142820] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-16T19:01:35.942798] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-16T19:01:36.068175] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T19:01:36.521674] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T19:01:36.742838] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-16T19:01:36.762002] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T19:01:37.542875] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-16T19:01:38.349542] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-16T19:01:38.367983] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T19:01:39.057926] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T19:01:39.142795] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-16T19:01:39.942886] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-16T19:01:40.228871] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-16T19:01:40.524447] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T19:01:40.742795] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-16T19:01:40.863829] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T19:01:40.865795] [INFO ] [REMOTE ] FRGE: Full fetch complete (30857 records). [2025-10-16T19:01:40.865866] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-16T19:01:41.233951] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-16T19:01:41.234034] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-16T19:01:41.234685] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-16T19:01:41.234748] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-16T19:01:41.235563] [DEBUG] [LOCAL ] FRGE: Trimmed 30857 records to 16223 (keeping 200 days of data) [2025-10-16T19:01:41.327795] [DEBUG] [LOCAL ] FRGE: Primary data saved (16223 records). [2025-10-16T19:01:41.327933] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-16T19:01:41.328027] [INFO ] [MAIN ] Update Progress: 869/2369 symbols completed. FRGE took 37.3s. Estimated remaining: 3h 29m 57s. Rate: 7.1 symbols/min [2025-10-16T19:01:41.493489] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:01:41.538150] [DEBUG] [LOCAL ] FSK: Loaded 49506 existing records from primary storage. [2025-10-16T19:01:41.538462] [INFO ] [MAIN ] FSK: Loaded 49506 existing records. [2025-10-16T19:01:41.549540] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-16T19:01:41.716091] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:01:41.716244] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-16T19:01:41.716291] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-16T19:01:41.716487] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-16T19:01:41.716543] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-16T19:01:42.069802] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:01:42.342788] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-16T19:01:42.464985] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T19:01:42.637197] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T19:01:43.142818] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-16T19:01:43.942851] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-16T19:01:44.013541] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T19:01:44.742794] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-16T19:01:44.873728] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T19:01:45.471426] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T19:01:45.542817] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-16T19:01:46.340829] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T19:01:46.350223] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-16T19:01:47.077380] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T19:01:47.142853] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-16T19:01:47.827048] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T19:01:47.942901] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-16T19:01:48.661959] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T19:01:48.742823] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-16T19:01:49.192485] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T19:01:49.542890] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-16T19:01:50.100564] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-16T19:01:50.342816] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-16T19:01:51.142874] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-16T19:01:51.310856] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T19:01:51.942848] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-16T19:01:52.204407] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T19:01:52.717394] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T19:01:52.742835] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-16T19:01:53.344752] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T19:01:53.542862] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-16T19:01:54.232746] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:01:54.342849] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-16T19:01:55.142818] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-16T19:01:55.186909] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T19:01:55.831954] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T19:01:55.837117] [INFO ] [REMOTE ] FRT: Full fetch complete (60531 records). [2025-10-16T19:01:55.837224] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-16T19:01:55.947991] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-16T19:01:56.219951] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-16T19:01:56.220052] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-16T19:01:56.221050] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-16T19:01:56.221117] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-16T19:01:56.222425] [DEBUG] [LOCAL ] FRT: Trimmed 60531 records to 42000 (keeping 200 days of data) [2025-10-16T19:01:56.483392] [DEBUG] [LOCAL ] FRT: Primary data saved (42000 records). [2025-10-16T19:01:56.483528] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-16T19:01:56.484135] [INFO ] [MAIN ] Update Progress: 870/2369 symbols completed. FRT took 27.4s. Estimated remaining: 3h 29m 60s. Rate: 7.1 symbols/min [2025-10-16T19:01:56.656551] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:01:56.735347] [DEBUG] [LOCAL ] FSLY: Loaded 51325 existing records from primary storage. [2025-10-16T19:01:56.734285] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T19:01:56.745675] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-16T19:01:56.747187] [INFO ] [MAIN ] FSLY: Loaded 51325 existing records. [2025-10-16T19:01:56.937456] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:01:56.937717] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-16T19:01:56.937775] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-16T19:01:56.938007] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-16T19:01:56.938063] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-16T19:01:57.290539] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:01:57.542824] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-16T19:01:57.691716] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T19:01:58.155018] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T19:01:58.342891] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-16T19:01:59.142804] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-16T19:01:59.585696] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-16T19:01:59.861845] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T19:01:59.942816] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-16T19:02:00.697748] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:02:00.742829] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-16T19:02:01.515362] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T19:02:01.542785] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-16T19:02:02.342845] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-16T19:02:02.631220] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T19:02:03.140890] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T19:02:03.149150] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-16T19:02:03.942807] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-16T19:02:04.237054] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-16T19:02:04.321436] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T19:02:04.742823] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-16T19:02:05.342155] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-16T19:02:05.348186] [INFO ] [REMOTE ] FSCO: Full fetch complete (55347 records). [2025-10-16T19:02:05.348293] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-16T19:02:05.553556] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-16T19:02:05.721585] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-16T19:02:05.721690] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-16T19:02:05.722507] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-16T19:02:05.722550] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-16T19:02:05.723738] [DEBUG] [LOCAL ] FSCO: Trimmed 55347 records to 38807 (keeping 200 days of data) [2025-10-16T19:02:05.949087] [DEBUG] [LOCAL ] FSCO: Primary data saved (38807 records). [2025-10-16T19:02:05.949226] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-16T19:02:05.949304] [INFO ] [MAIN ] Update Progress: 871/2369 symbols completed. FSCO took 35.4s. Estimated remaining: 3h 29m 53s. Rate: 7.1 symbols/min [2025-10-16T19:02:06.120970] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:02:06.178096] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T19:02:06.204943] [DEBUG] [LOCAL ] FSM: Loaded 53301 existing records from primary storage. [2025-10-16T19:02:06.205272] [INFO ] [MAIN ] FSM: Loaded 53301 existing records. [2025-10-16T19:02:06.348401] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-16T19:02:06.377972] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:02:06.378250] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-16T19:02:06.378298] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-16T19:02:06.378540] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-16T19:02:06.378617] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-16T19:02:06.719237] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:02:07.142810] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-16T19:02:07.340484] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T19:02:07.942824] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-16T19:02:08.308718] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-16T19:02:08.742818] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-16T19:02:08.828400] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T19:02:09.542772] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-16T19:02:09.735142] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T19:02:10.342816] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-16T19:02:10.752524] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-16T19:02:11.019307] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T19:02:11.142789] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-16T19:02:11.942795] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-16T19:02:12.405548] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-16T19:02:12.413025] [INFO ] [REMOTE ] FSK: Full fetch complete (72064 records). [2025-10-16T19:02:12.413291] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-16T19:02:12.755982] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-16T19:02:12.778150] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T19:02:12.876733] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-16T19:02:12.876833] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-16T19:02:12.877786] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-16T19:02:12.877850] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-16T19:02:12.879329] [DEBUG] [LOCAL ] FSK: Trimmed 72064 records to 49891 (keeping 200 days of data) [2025-10-16T19:02:13.199297] [DEBUG] [LOCAL ] FSK: Primary data saved (49891 records). [2025-10-16T19:02:13.199450] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-16T19:02:13.199964] [INFO ] [MAIN ] Update Progress: 872/2369 symbols completed. FSK took 31.9s. Estimated remaining: 3h 29m 43s. Rate: 7.1 symbols/min [2025-10-16T19:02:13.403301] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:02:13.433176] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T19:02:13.448934] [INFO ] [REMOTE ] FRO: Full fetch complete (75367 records). [2025-10-16T19:02:13.449139] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-16T19:02:13.547932] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-16T19:02:13.563076] [DEBUG] [LOCAL ] FSS: Loaded 33666 existing records from primary storage. [2025-10-16T19:02:13.563721] [INFO ] [MAIN ] FSS: Loaded 33666 existing records. [2025-10-16T19:02:13.981745] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:02:14.000964] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-16T19:02:14.006188] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-16T19:02:14.040611] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-16T19:02:14.069268] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-16T19:02:14.064768] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-16T19:02:14.111715] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-16T19:02:14.125372] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-16T19:02:14.140061] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-16T19:02:14.198914] [DEBUG] [LOCAL ] FRO: Trimmed 75367 records to 52078 (keeping 200 days of data) [2025-10-16T19:02:14.546188] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:02:14.548773] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-16T19:02:14.588896] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T19:02:14.816507] [DEBUG] [LOCAL ] FRO: Primary data saved (52078 records). [2025-10-16T19:02:14.816666] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-16T19:02:14.817312] [INFO ] [MAIN ] Update Progress: 873/2369 symbols completed. FRO took 49.7s. Estimated remaining: 3h 29m 23s. Rate: 7.1 symbols/min [2025-10-16T19:02:14.987055] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:02:15.018121] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T19:02:15.031785] [DEBUG] [LOCAL ] FT: Loaded 6804 existing records from primary storage. [2025-10-16T19:02:15.031997] [INFO ] [MAIN ] FT: Loaded 6804 existing records. [2025-10-16T19:02:15.147888] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-16T19:02:15.208200] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:02:15.208476] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-16T19:02:15.208527] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-16T19:02:15.208715] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-16T19:02:15.208771] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-16T19:02:15.561787] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:02:15.576569] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T19:02:15.942826] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-16T19:02:16.500245] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-16T19:02:16.725721] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-16T19:02:16.742779] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-16T19:02:17.542804] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-16T19:02:18.250897] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T19:02:18.342839] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-16T19:02:18.443631] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T19:02:18.914821] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T19:02:19.142799] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-16T19:02:19.942818] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-16T19:02:20.416099] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-16T19:02:20.443428] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T19:02:20.742820] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-16T19:02:21.460113] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T19:02:21.542862] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-16T19:02:22.342838] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-16T19:02:22.936037] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:02:23.142819] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-16T19:02:23.920468] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-16T19:02:23.942829] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-16T19:02:24.646171] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T19:02:24.742828] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-16T19:02:24.828493] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T19:02:25.542828] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-16T19:02:25.980555] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T19:02:26.342806] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-16T19:02:26.431565] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T19:02:26.442178] [INFO ] [REMOTE ] FSLY: Full fetch complete (74994 records). [2025-10-16T19:02:26.442402] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-16T19:02:26.844785] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-16T19:02:26.844880] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-16T19:02:26.845817] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-16T19:02:26.845881] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-16T19:02:26.847209] [DEBUG] [LOCAL ] FSLY: Trimmed 74994 records to 51707 (keeping 200 days of data) [2025-10-16T19:02:27.144739] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-16T19:02:27.155544] [DEBUG] [LOCAL ] FSLY: Primary data saved (51707 records). [2025-10-16T19:02:27.155672] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-16T19:02:27.156195] [INFO ] [MAIN ] Update Progress: 874/2369 symbols completed. FSLY took 30.7s. Estimated remaining: 3h 29m 21s. Rate: 7.1 symbols/min [2025-10-16T19:02:27.331918] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:02:27.348726] [DEBUG] [LOCAL ] FTHY: Loaded 12336 existing records from primary storage. [2025-10-16T19:02:27.348988] [INFO ] [MAIN ] FTHY: Loaded 12336 existing records. [2025-10-16T19:02:27.528878] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:02:27.529099] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-16T19:02:27.529147] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-16T19:02:27.529296] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-16T19:02:27.529334] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-16T19:02:27.897254] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:02:27.923350] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T19:02:27.942786] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-16T19:02:28.742816] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-16T19:02:28.885004] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T19:02:29.556176] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-16T19:02:29.559848] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T19:02:29.691274] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T19:02:30.105864] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T19:02:30.342845] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-16T19:02:31.142820] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-16T19:02:31.942836] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-16T19:02:32.319446] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-16T19:02:32.398298] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T19:02:32.457866] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-16T19:02:32.742847] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-16T19:02:33.542822] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-16T19:02:34.232069] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T19:02:34.342794] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-16T19:02:34.552262] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T19:02:34.921374] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T19:02:35.142797] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-16T19:02:35.876457] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T19:02:35.942855] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-16T19:02:36.742798] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-16T19:02:37.299165] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T19:02:37.475329] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T19:02:37.542905] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-16T19:02:38.342911] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-16T19:02:38.513863] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-16T19:02:39.142878] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-16T19:02:39.890370] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T19:02:39.934179] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-16T19:02:39.942828] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-16T19:02:40.742856] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-16T19:02:41.164689] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T19:02:41.542835] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-16T19:02:42.343796] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-16T19:02:42.351503] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T19:02:42.926510] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T19:02:42.929581] [INFO ] [REMOTE ] FT: Full fetch complete (9324 records). [2025-10-16T19:02:42.929485] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T19:02:42.932030] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-16T19:02:43.147963] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-16T19:02:43.322741] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-16T19:02:43.322821] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-16T19:02:43.323070] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-16T19:02:43.323111] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-16T19:02:43.323583] [DEBUG] [LOCAL ] FT: Trimmed 9324 records to 6851 (keeping 200 days of data) [2025-10-16T19:02:43.365400] [DEBUG] [LOCAL ] FT: Primary data saved (6851 records). [2025-10-16T19:02:43.365546] [INFO ] [MAIN ] FT: Full history saved. [2025-10-16T19:02:43.365731] [INFO ] [MAIN ] Update Progress: 875/2369 symbols completed. FT took 28.5s. Estimated remaining: 3h 29m 26s. Rate: 7.1 symbols/min [2025-10-16T19:02:43.546260] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:02:43.601160] [DEBUG] [LOCAL ] FTI: Loaded 53296 existing records from primary storage. [2025-10-16T19:02:43.601505] [INFO ] [MAIN ] FTI: Loaded 53296 existing records. [2025-10-16T19:02:43.789336] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:02:43.789606] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-16T19:02:43.789693] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-16T19:02:43.789921] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-16T19:02:43.789976] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-16T19:02:43.947130] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-16T19:02:44.053698] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-16T19:02:44.162904] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:02:44.742866] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-16T19:02:45.358118] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T19:02:45.363143] [INFO ] [REMOTE ] FSS: Full fetch complete (48605 records). [2025-10-16T19:02:45.363441] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-16T19:02:45.543277] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-16T19:02:45.767675] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-16T19:02:45.767762] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-16T19:02:45.768628] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-16T19:02:45.768713] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-16T19:02:45.769750] [DEBUG] [LOCAL ] FSS: Trimmed 48605 records to 33877 (keeping 200 days of data) [2025-10-16T19:02:45.990245] [DEBUG] [LOCAL ] FSS: Primary data saved (33877 records). [2025-10-16T19:02:45.990416] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-16T19:02:45.990509] [INFO ] [MAIN ] Update Progress: 876/2369 symbols completed. FSS took 32.8s. Estimated remaining: 3h 29m 8s. Rate: 7.1 symbols/min [2025-10-16T19:02:46.173021] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:02:46.211908] [DEBUG] [LOCAL ] FTK: Loaded 32908 existing records from primary storage. [2025-10-16T19:02:46.212250] [INFO ] [MAIN ] FTK: Loaded 32908 existing records. [2025-10-16T19:02:46.344489] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-16T19:02:46.436238] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:02:46.436626] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-16T19:02:46.436749] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-16T19:02:46.437302] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-16T19:02:46.437411] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-16T19:02:46.633544] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-16T19:02:46.856717] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:02:47.142794] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-16T19:02:47.216782] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-16T19:02:47.393032] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T19:02:47.942836] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-16T19:02:48.742988] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-16T19:02:48.871174] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T19:02:48.980725] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T19:02:49.542869] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-16T19:02:50.200189] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T19:02:50.342790] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-16T19:02:50.645408] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T19:02:51.142856] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-16T19:02:51.741929] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T19:02:51.942841] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-16T19:02:52.742868] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-16T19:02:52.773700] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-16T19:02:52.894516] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T19:02:53.542887] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-16T19:02:54.187004] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-16T19:02:54.342804] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-16T19:02:54.602286] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-16T19:02:55.142791] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-16T19:02:55.362426] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T19:02:55.942860] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-16T19:02:56.742794] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-16T19:02:56.912827] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T19:02:57.542817] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-16T19:02:57.808937] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T19:02:57.847919] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T19:02:58.342818] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-16T19:02:58.909446] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T19:02:59.143519] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T19:02:59.142842] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-16T19:02:59.942835] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-16T19:03:00.742777] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-16T19:03:00.821824] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T19:03:00.824029] [INFO ] [REMOTE ] FTHY: Full fetch complete (17348 records). [2025-10-16T19:03:00.824100] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-16T19:03:01.186869] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-16T19:03:01.187000] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-16T19:03:01.187419] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-16T19:03:01.187627] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-16T19:03:01.204543] [DEBUG] [LOCAL ] FTHY: Trimmed 17348 records to 12446 (keeping 200 days of data) [2025-10-16T19:03:01.205917] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-16T19:03:01.243894] [INFO ] [REMOTE ] FSM: Full fetch complete (77082 records). [2025-10-16T19:03:01.249941] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-16T19:03:01.442358] [DEBUG] [LOCAL ] FTHY: Primary data saved (12446 records). [2025-10-16T19:03:01.466006] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-16T19:03:01.471003] [INFO ] [MAIN ] Update Progress: 877/2369 symbols completed. FTHY took 34.3s. Estimated remaining: 3h 29m 11s. Rate: 7.1 symbols/min [2025-10-16T19:03:01.552438] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-16T19:03:01.699764] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-16T19:03:01.699857] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-16T19:03:01.701112] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-16T19:03:01.701177] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-16T19:03:01.702913] [DEBUG] [LOCAL ] FSM: Trimmed 77082 records to 53691 (keeping 200 days of data) [2025-10-16T19:03:02.020207] [DEBUG] [LOCAL ] FSM: Primary data saved (53691 records). [2025-10-16T19:03:02.020356] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-16T19:03:02.020496] [INFO ] [MAIN ] Update Progress: 878/2369 symbols completed. FSM took 56.1s. Estimated remaining: 3h 28m 50s. Rate: 7.1 symbols/min [2025-10-16T19:03:02.147367] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T19:03:02.342815] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-16T19:03:03.101682] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:03:03.142788] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-16T19:03:03.855592] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T19:03:03.942887] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-16T19:03:05.050788] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-16T19:03:05.062896] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-16T19:03:05.475770] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T19:03:05.542857] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-16T19:03:06.876962] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T19:03:06.888280] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-16T19:03:06.911276] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T19:03:07.142805] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-16T19:03:08.531536] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T19:03:08.540382] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-16T19:03:08.664726] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T19:03:08.742851] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-16T19:03:09.646628] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T19:03:09.651440] [INFO ] [REMOTE ] FTK: Full fetch complete (44002 records). [2025-10-16T19:03:09.651579] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-16T19:03:10.049417] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-16T19:03:10.049522] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-16T19:03:10.050376] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-16T19:03:10.050446] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-16T19:03:10.051565] [DEBUG] [LOCAL ] FTK: Trimmed 44002 records to 33095 (keeping 200 days of data) [2025-10-16T19:03:10.242877] [DEBUG] [LOCAL ] FTK: Primary data saved (33095 records). [2025-10-16T19:03:10.242998] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-16T19:03:10.243074] [INFO ] [MAIN ] Update Progress: 879/2369 symbols completed. FTK took 24.3s. Estimated remaining: 3h 28m 41s. Rate: 7.1 symbols/min [2025-10-16T19:03:10.319043] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T19:03:10.325757] [INFO ] [REMOTE ] FTI: Full fetch complete (77326 records). [2025-10-16T19:03:10.325868] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-16T19:03:10.715773] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-16T19:03:10.715849] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-16T19:03:10.716807] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-16T19:03:10.716870] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-16T19:03:10.718238] [DEBUG] [LOCAL ] FTI: Trimmed 77326 records to 53685 (keeping 200 days of data) [2025-10-16T19:03:11.035768] [DEBUG] [LOCAL ] FTI: Primary data saved (53685 records). [2025-10-16T19:03:11.035915] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-16T19:03:11.036578] [INFO ] [MAIN ] Update Progress: 880/2369 symbols completed. FTI took 27.7s. Estimated remaining: 3h 28m 20s. Rate: 7.1 symbols/min [2025-10-16T19:03:11.600766] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:03:11.693710] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:03:11.719082] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:03:11.738550] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:03:11.741819] [DEBUG] [LOCAL ] FTWO: Loaded 1915 existing records from primary storage. [2025-10-16T19:03:11.742246] [INFO ] [MAIN ] FTWO: Loaded 1915 existing records. [2025-10-16T19:03:11.958786] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:03:11.960004] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-16T19:03:11.960090] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-16T19:03:11.960392] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-16T19:03:11.960481] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-16T19:03:12.105103] [DEBUG] [LOCAL ] FUBO: Loaded 53718 existing records from primary storage. [2025-10-16T19:03:12.123134] [INFO ] [MAIN ] FUBO: Loaded 53718 existing records. [2025-10-16T19:03:12.123016] [DEBUG] [LOCAL ] FTS: Loaded 42538 existing records from primary storage. [2025-10-16T19:03:12.129415] [INFO ] [MAIN ] FTS: Loaded 42538 existing records. [2025-10-16T19:03:12.123861] [DEBUG] [LOCAL ] FTV: Loaded 53067 existing records from primary storage. [2025-10-16T19:03:12.228751] [INFO ] [MAIN ] FTV: Loaded 53067 existing records. [2025-10-16T19:03:12.660002] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:03:12.738345] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-16T19:03:12.792856] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-16T19:03:12.826515] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-16T19:03:12.932965] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:03:12.963058] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-16T19:03:12.962973] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-16T19:03:12.996899] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:03:12.997226] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-16T19:03:13.007597] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-16T19:03:13.022706] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-16T19:03:12.936635] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:03:13.033210] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-16T19:03:13.071455] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-16T19:03:13.087557] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-16T19:03:13.108263] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-16T19:03:13.111995] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-16T19:03:13.750369] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T19:03:13.859096] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:03:13.839841] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-16T19:03:13.869728] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-16T19:03:14.031164] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:03:14.046843] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-16T19:03:14.070092] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:03:14.070353] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-16T19:03:14.308356] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T19:03:14.310856] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-16T19:03:14.761424] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T19:03:14.762761] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-16T19:03:15.192084] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-16T19:03:15.193323] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-16T19:03:15.494006] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T19:03:15.528097] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T19:03:15.676308] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-16T19:03:15.942799] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-16T19:03:16.076036] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-16T19:03:16.273950] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-16T19:03:16.742817] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-16T19:03:17.542868] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-16T19:03:18.345982] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-16T19:03:18.352777] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T19:03:18.804049] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-16T19:03:18.835077] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T19:03:19.142796] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-16T19:03:19.942842] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-16T19:03:20.742851] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-16T19:03:20.929407] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T19:03:21.027475] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T19:03:21.542787] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-16T19:03:22.342862] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-16T19:03:22.773121] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-16T19:03:22.797991] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T19:03:23.055281] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T19:03:23.142873] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-16T19:03:23.942882] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-16T19:03:24.314901] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-16T19:03:24.701762] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T19:03:24.742837] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-16T19:03:25.542846] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-16T19:03:26.342814] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-16T19:03:26.511496] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T19:03:26.718480] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T19:03:27.142821] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-16T19:03:27.942848] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-16T19:03:28.410236] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T19:03:28.600592] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-16T19:03:28.742877] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-16T19:03:29.245729] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T19:03:29.542910] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-16T19:03:29.914676] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-16T19:03:29.974908] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-16T19:03:30.342871] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-16T19:03:31.142846] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-16T19:03:31.942882] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-16T19:03:32.452163] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-16T19:03:32.459430] [INFO ] [REMOTE ] FTWO: Full fetch complete (3332 records). [2025-10-16T19:03:32.459261] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-16T19:03:32.459632] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-16T19:03:32.744343] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-16T19:03:32.848563] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-16T19:03:32.848919] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-16T19:03:32.849330] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-16T19:03:32.849413] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-16T19:03:32.850346] [DEBUG] [LOCAL ] FTWO: Trimmed 3332 records to 1940 (keeping 200 days of data) [2025-10-16T19:03:32.862792] [DEBUG] [LOCAL ] FTWO: Primary data saved (1940 records). [2025-10-16T19:03:32.862917] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-16T19:03:32.863017] [INFO ] [MAIN ] Update Progress: 881/2369 symbols completed. FTWO took 21.8s. Estimated remaining: 3h 28m 34s. Rate: 7.1 symbols/min [2025-10-16T19:03:33.060553] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:03:33.117759] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T19:03:33.162382] [DEBUG] [LOCAL ] FUL: Loaded 32393 existing records from primary storage. [2025-10-16T19:03:33.162688] [INFO ] [MAIN ] FUL: Loaded 32393 existing records. [2025-10-16T19:03:33.370103] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:03:33.370374] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-16T19:03:33.370425] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-16T19:03:33.371058] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-16T19:03:33.371138] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-16T19:03:33.547994] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-16T19:03:33.894194] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:03:34.252504] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T19:03:34.342778] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-16T19:03:34.979417] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T19:03:35.142866] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-16T19:03:35.315424] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T19:03:35.942913] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-16T19:03:36.529745] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T19:03:36.742847] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-16T19:03:37.542775] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-16T19:03:37.782279] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T19:03:38.064800] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-16T19:03:38.342809] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-16T19:03:38.979167] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T19:03:39.142826] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-16T19:03:39.260051] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T19:03:39.942838] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-16T19:03:40.742874] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-16T19:03:41.033452] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T19:03:41.464552] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T19:03:41.470280] [INFO ] [REMOTE ] FTS: Full fetch complete (60557 records). [2025-10-16T19:03:41.470431] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-16T19:03:41.550710] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-16T19:03:41.881302] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-16T19:03:41.881398] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-16T19:03:41.882456] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-16T19:03:41.883244] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-16T19:03:41.884829] [DEBUG] [LOCAL ] FTS: Trimmed 60557 records to 42838 (keeping 200 days of data) [2025-10-16T19:03:42.151263] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T19:03:42.213584] [DEBUG] [LOCAL ] FTS: Primary data saved (42838 records). [2025-10-16T19:03:42.213804] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-16T19:03:42.214750] [INFO ] [MAIN ] Update Progress: 882/2369 symbols completed. FTS took 31.2s. Estimated remaining: 3h 28m 27s. Rate: 7.1 symbols/min [2025-10-16T19:03:42.358761] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-16T19:03:42.394745] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:03:42.457923] [DEBUG] [LOCAL ] FUN: Loaded 51916 existing records from primary storage. [2025-10-16T19:03:42.458379] [INFO ] [MAIN ] FUN: Loaded 51916 existing records. [2025-10-16T19:03:42.650035] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:03:42.650378] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-16T19:03:42.650432] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-16T19:03:42.651376] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-16T19:03:42.651440] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-16T19:03:43.033524] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:03:43.142845] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-16T19:03:43.688363] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-16T19:03:43.732257] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T19:03:43.942833] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-16T19:03:44.436718] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-16T19:03:44.742884] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-16T19:03:45.494474] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T19:03:45.542848] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-16T19:03:46.251333] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-16T19:03:46.258234] [INFO ] [REMOTE ] FTV: Full fetch complete (76635 records). [2025-10-16T19:03:46.258357] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-16T19:03:46.348750] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-16T19:03:46.687023] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-16T19:03:46.687182] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-16T19:03:46.688291] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-16T19:03:46.688425] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-16T19:03:46.689974] [DEBUG] [LOCAL ] FTV: Trimmed 76635 records to 53454 (keeping 200 days of data) [2025-10-16T19:03:46.810482] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T19:03:47.045277] [DEBUG] [LOCAL ] FTV: Primary data saved (53454 records). [2025-10-16T19:03:47.045443] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-16T19:03:47.045527] [INFO ] [MAIN ] Update Progress: 883/2369 symbols completed. FTV took 36.0s. Estimated remaining: 3h 28m 13s. Rate: 7.1 symbols/min [2025-10-16T19:03:47.145458] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-16T19:03:47.215065] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:03:47.235264] [DEBUG] [LOCAL ] FVR: Loaded 21190 existing records from primary storage. [2025-10-16T19:03:47.235501] [INFO ] [MAIN ] FVR: Loaded 21190 existing records. [2025-10-16T19:03:47.417808] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:03:47.418108] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-16T19:03:47.418163] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-16T19:03:47.418552] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-16T19:03:47.418634] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-16T19:03:47.793148] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:03:47.942834] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-16T19:03:48.628304] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-16T19:03:48.707016] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T19:03:48.742776] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-16T19:03:49.150826] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T19:03:49.542858] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-16T19:03:50.219308] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T19:03:50.342780] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-16T19:03:50.586799] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T19:03:51.142910] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-16T19:03:51.707636] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T19:03:51.942848] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-16T19:03:52.742877] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-16T19:03:52.959268] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T19:03:53.542834] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-16T19:03:53.763388] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-16T19:03:54.000614] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-16T19:03:54.342875] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-16T19:03:54.516808] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-16T19:03:55.142837] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-16T19:03:55.942831] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-16T19:03:56.176481] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T19:03:56.742860] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-16T19:03:57.078777] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T19:03:57.372155] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-16T19:03:57.542807] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-16T19:03:57.774798] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T19:03:58.342855] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-16T19:03:59.142863] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-16T19:03:59.642505] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-16T19:03:59.649403] [INFO ] [REMOTE ] FUBO: Full fetch complete (77869 records). [2025-10-16T19:03:59.649530] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-16T19:03:59.945243] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-16T19:04:00.056172] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-16T19:04:00.056521] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-16T19:04:00.058068] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-16T19:04:00.058152] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-16T19:04:00.087171] [DEBUG] [LOCAL ] FUBO: Trimmed 77869 records to 54108 (keeping 200 days of data) [2025-10-16T19:04:00.089177] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T19:04:00.199856] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T19:04:00.426506] [DEBUG] [LOCAL ] FUBO: Primary data saved (54108 records). [2025-10-16T19:04:00.426667] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-16T19:04:00.426767] [INFO ] [MAIN ] Update Progress: 884/2369 symbols completed. FUBO took 49.4s. Estimated remaining: 3h 28m 13s. Rate: 7.1 symbols/min [2025-10-16T19:04:00.592402] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:04:00.630188] [DEBUG] [LOCAL ] FVRR: Loaded 40631 existing records from primary storage. [2025-10-16T19:04:00.630477] [INFO ] [MAIN ] FVRR: Loaded 40631 existing records. [2025-10-16T19:04:00.747912] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-16T19:04:00.813554] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:04:00.813839] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-16T19:04:00.813890] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-16T19:04:00.814413] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-16T19:04:00.814487] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-16T19:04:01.162772] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:04:01.319135] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T19:04:01.542809] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-16T19:04:01.669182] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-16T19:04:02.342840] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-16T19:04:03.067586] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T19:04:03.142820] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-16T19:04:03.942835] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-16T19:04:04.099543] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T19:04:04.637033] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:04:04.742780] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-16T19:04:05.262304] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T19:04:05.542788] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-16T19:04:05.715794] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T19:04:05.720084] [INFO ] [REMOTE ] FUL: Full fetch complete (47835 records). [2025-10-16T19:04:05.720243] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-16T19:04:06.112399] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-16T19:04:06.112494] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-16T19:04:06.113252] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-16T19:04:06.113313] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-16T19:04:06.114343] [DEBUG] [LOCAL ] FUL: Trimmed 47835 records to 32565 (keeping 200 days of data) [2025-10-16T19:04:06.310766] [DEBUG] [LOCAL ] FUL: Primary data saved (32565 records). [2025-10-16T19:04:06.310934] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-16T19:04:06.311029] [INFO ] [MAIN ] Update Progress: 885/2369 symbols completed. FUL took 33.4s. Estimated remaining: 3h 28m 0s. Rate: 7.1 symbols/min [2025-10-16T19:04:06.348045] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-16T19:04:06.487691] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:04:06.491388] [DEBUG] [LOCAL ] FXED: Loaded 1246 existing records from primary storage. [2025-10-16T19:04:06.491545] [INFO ] [MAIN ] FXED: Loaded 1246 existing records. [2025-10-16T19:04:06.669127] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:04:06.669349] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-16T19:04:06.669396] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-16T19:04:06.669510] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-16T19:04:06.669547] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-16T19:04:07.054015] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:04:07.142833] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-16T19:04:07.356921] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T19:04:07.398546] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-10-16T19:04:07.496825] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T19:04:07.942829] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-16T19:04:08.369469] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-16T19:04:08.742808] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-16T19:04:09.071491] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-16T19:04:09.542809] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-16T19:04:09.955628] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-16T19:04:10.342808] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-16T19:04:11.142810] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-16T19:04:11.837540] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T19:04:11.942769] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-16T19:04:12.117980] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-16T19:04:12.742832] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-16T19:04:13.170902] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-16T19:04:13.542840] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-16T19:04:13.591167] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T19:04:14.342803] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-16T19:04:14.587212] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-16T19:04:14.898184] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T19:04:15.142803] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-16T19:04:15.579015] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T19:04:15.942792] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-16T19:04:16.742806] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-16T19:04:17.542852] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-16T19:04:17.774507] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T19:04:18.006230] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T19:04:18.035152] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T19:04:18.342814] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-16T19:04:19.142818] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-16T19:04:19.555691] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-16T19:04:19.684856] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T19:04:19.942856] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-16T19:04:20.243965] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-16T19:04:20.742877] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-16T19:04:21.542862] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-16T19:04:21.988533] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-16T19:04:21.989300] [INFO ] [REMOTE ] FXED: Full fetch complete (1788 records). [2025-10-16T19:04:21.989368] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-16T19:04:22.336274] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-16T19:04:22.336349] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-16T19:04:22.336432] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-16T19:04:22.336472] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-16T19:04:22.336848] [DEBUG] [LOCAL ] FXED: Trimmed 1788 records to 1251 (keeping 200 days of data) [2025-10-16T19:04:22.342980] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-16T19:04:22.345801] [DEBUG] [LOCAL ] FXED: Primary data saved (1251 records). [2025-10-16T19:04:22.345864] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-16T19:04:22.345927] [INFO ] [MAIN ] Update Progress: 886/2369 symbols completed. FXED took 16.0s. Estimated remaining: 3h 28m 4s. Rate: 7.1 symbols/min [2025-10-16T19:04:22.519522] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:04:22.566132] [DEBUG] [LOCAL ] G: Loaded 50051 existing records from primary storage. [2025-10-16T19:04:22.566473] [INFO ] [MAIN ] G: Loaded 50051 existing records. [2025-10-16T19:04:22.742103] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-16T19:04:22.779126] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:04:22.779611] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-16T19:04:22.779725] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-16T19:04:22.780222] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-16T19:04:22.780281] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-16T19:04:23.144195] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:04:23.142832] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-16T19:04:23.184722] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T19:04:23.942826] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-16T19:04:24.677334] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T19:04:24.684505] [INFO ] [REMOTE ] FUN: Full fetch complete (73380 records). [2025-10-16T19:04:24.684632] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-16T19:04:24.748399] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-16T19:04:24.935820] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T19:04:25.106457] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-16T19:04:25.106537] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-16T19:04:25.107472] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-16T19:04:25.107534] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-16T19:04:25.108984] [DEBUG] [LOCAL ] FUN: Trimmed 73380 records to 52299 (keeping 200 days of data) [2025-10-16T19:04:25.420002] [DEBUG] [LOCAL ] FUN: Primary data saved (52299 records). [2025-10-16T19:04:25.420170] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-16T19:04:25.420705] [INFO ] [MAIN ] Update Progress: 887/2369 symbols completed. FUN took 43.2s. Estimated remaining: 3h 27m 47s. Rate: 7.1 symbols/min [2025-10-16T19:04:25.547964] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-16T19:04:25.618917] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:04:25.653538] [DEBUG] [LOCAL ] GAB: Loaded 27709 existing records from primary storage. [2025-10-16T19:04:25.653849] [INFO ] [MAIN ] GAB: Loaded 27709 existing records. [2025-10-16T19:04:25.938242] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:04:25.938525] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-16T19:04:25.938629] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-16T19:04:25.938920] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-16T19:04:25.938980] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-16T19:04:26.347570] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-16T19:04:26.466529] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:04:26.523316] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T19:04:27.142814] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-16T19:04:27.230270] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T19:04:27.484909] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T19:04:27.487536] [INFO ] [REMOTE ] FVR: Full fetch complete (29541 records). [2025-10-16T19:04:27.487609] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-16T19:04:27.850959] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-16T19:04:27.851047] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-16T19:04:27.851677] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-16T19:04:27.851738] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-16T19:04:27.852438] [DEBUG] [LOCAL ] FVR: Trimmed 29541 records to 21309 (keeping 200 days of data) [2025-10-16T19:04:27.944698] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-16T19:04:27.987916] [DEBUG] [LOCAL ] FVR: Primary data saved (21309 records). [2025-10-16T19:04:27.988022] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-16T19:04:27.988104] [INFO ] [MAIN ] Update Progress: 888/2369 symbols completed. FVR took 40.9s. Estimated remaining: 3h 27m 29s. Rate: 7.1 symbols/min [2025-10-16T19:04:28.168039] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:04:28.175220] [DEBUG] [LOCAL ] GAM: Loaded 3926 existing records from primary storage. [2025-10-16T19:04:28.175401] [INFO ] [MAIN ] GAM: Loaded 3926 existing records. [2025-10-16T19:04:28.372121] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:04:28.372430] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-16T19:04:28.372513] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-16T19:04:28.372702] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-16T19:04:28.372758] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-16T19:04:28.726980] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:04:28.747798] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-16T19:04:28.753041] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T19:04:29.219495] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-16T19:04:29.542833] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-16T19:04:29.599144] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T19:04:30.342814] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-16T19:04:31.143428] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-16T19:04:31.143342] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T19:04:31.302010] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-16T19:04:31.812594] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T19:04:31.942835] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-16T19:04:32.672571] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T19:04:32.742826] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-16T19:04:33.542871] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-16T19:04:34.084457] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T19:04:34.284585] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T19:04:34.342810] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-16T19:04:35.142836] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-16T19:04:35.942802] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-16T19:04:36.068220] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T19:04:36.075052] [INFO ] [REMOTE ] FVRR: Full fetch complete (59292 records). [2025-10-16T19:04:36.075199] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-16T19:04:36.471758] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-16T19:04:36.471925] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-16T19:04:36.472981] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-16T19:04:36.473130] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-16T19:04:36.474805] [DEBUG] [LOCAL ] FVRR: Trimmed 59292 records to 40901 (keeping 200 days of data) [2025-10-16T19:04:36.608719] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T19:04:36.742828] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-16T19:04:36.753419] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-16T19:04:36.764715] [DEBUG] [LOCAL ] FVRR: Primary data saved (40901 records). [2025-10-16T19:04:36.764820] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-16T19:04:36.764892] [INFO ] [MAIN ] Update Progress: 889/2369 symbols completed. FVRR took 36.3s. Estimated remaining: 3h 27m 21s. Rate: 7.1 symbols/min [2025-10-16T19:04:36.941333] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:04:36.994279] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-16T19:04:36.994628] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-16T19:04:37.184587] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:04:37.184900] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-16T19:04:37.184954] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-16T19:04:37.185152] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-16T19:04:37.185206] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-16T19:04:37.535348] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:04:37.542783] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-16T19:04:37.811400] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T19:04:38.342817] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-16T19:04:38.865984] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T19:04:39.142813] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-16T19:04:39.942801] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-16T19:04:40.171601] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T19:04:40.221348] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T19:04:40.331874] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-16T19:04:40.742798] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-16T19:04:41.542830] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-16T19:04:42.191915] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-16T19:04:42.342781] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-16T19:04:42.395957] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T19:04:42.896288] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-16T19:04:43.142791] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-16T19:04:43.942820] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-16T19:04:44.742915] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-16T19:04:44.845839] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T19:04:45.062570] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T19:04:45.122195] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-16T19:04:45.542871] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-16T19:04:46.342834] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-16T19:04:46.908242] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-16T19:04:47.142808] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-16T19:04:47.240929] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T19:04:47.469308] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-16T19:04:47.942823] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-16T19:04:48.742876] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-16T19:04:49.542855] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-16T19:04:50.265931] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-16T19:04:50.342790] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-16T19:04:51.003380] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-16T19:04:51.142801] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-16T19:04:51.629789] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-16T19:04:51.889526] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T19:04:51.942822] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-16T19:04:52.423311] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T19:04:52.742824] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-16T19:04:53.416278] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T19:04:53.417396] [INFO ] [REMOTE ] GAM: Full fetch complete (6511 records). [2025-10-16T19:04:53.417466] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-16T19:04:53.544785] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-16T19:04:53.784984] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-16T19:04:53.785087] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-16T19:04:53.785266] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-16T19:04:53.785441] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-16T19:04:53.786225] [DEBUG] [LOCAL ] GAM: Trimmed 6511 records to 3940 (keeping 200 days of data) [2025-10-16T19:04:53.835987] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-16T19:04:53.851931] [DEBUG] [LOCAL ] GAM: Primary data saved (3940 records). [2025-10-16T19:04:53.852056] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-16T19:04:53.852138] [INFO ] [MAIN ] Update Progress: 890/2369 symbols completed. GAM took 25.9s. Estimated remaining: 3h 27m 27s. Rate: 7.1 symbols/min [2025-10-16T19:04:54.017336] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:04:54.036348] [DEBUG] [LOCAL ] GATX: Loaded 18079 existing records from primary storage. [2025-10-16T19:04:54.036620] [INFO ] [MAIN ] GATX: Loaded 18079 existing records. [2025-10-16T19:04:54.213974] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:04:54.214344] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-16T19:04:54.214404] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-16T19:04:54.214617] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-16T19:04:54.214741] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-16T19:04:54.351880] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-16T19:04:54.578932] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:04:55.142841] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-16T19:04:55.586638] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-16T19:04:55.614710] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-16T19:04:55.942805] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-16T19:04:56.174703] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T19:04:56.682088] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-16T19:04:56.742816] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-16T19:04:57.542860] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-16T19:04:58.342805] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-16T19:04:58.717001] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T19:04:58.933612] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T19:04:59.142814] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-16T19:04:59.302339] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T19:04:59.942855] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-16T19:05:00.742795] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-16T19:05:00.970286] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T19:05:01.018511] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T19:05:01.025250] [INFO ] [REMOTE ] G: Full fetch complete (72153 records). [2025-10-16T19:05:01.025369] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-16T19:05:01.431482] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-16T19:05:01.431573] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-16T19:05:01.432540] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-16T19:05:01.432605] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-16T19:05:01.434126] [DEBUG] [LOCAL ] G: Trimmed 72153 records to 50433 (keeping 200 days of data) [2025-10-16T19:05:01.544381] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-16T19:05:01.741333] [DEBUG] [LOCAL ] G: Primary data saved (50433 records). [2025-10-16T19:05:01.741714] [INFO ] [MAIN ] G: Full history saved. [2025-10-16T19:05:01.742260] [INFO ] [MAIN ] Update Progress: 891/2369 symbols completed. G took 39.4s. Estimated remaining: 3h 27m 18s. Rate: 7.1 symbols/min [2025-10-16T19:05:01.921743] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:05:01.936960] [DEBUG] [LOCAL ] GBAB: Loaded 12868 existing records from primary storage. [2025-10-16T19:05:01.937257] [INFO ] [MAIN ] GBAB: Loaded 12868 existing records. [2025-10-16T19:05:02.116265] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:05:02.116508] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-16T19:05:02.116557] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-16T19:05:02.116809] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-16T19:05:02.116867] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-16T19:05:02.343255] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-16T19:05:02.484969] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:05:02.706205] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-16T19:05:03.061272] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T19:05:03.065606] [INFO ] [REMOTE ] GAB: Full fetch complete (39356 records). [2025-10-16T19:05:03.065878] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-16T19:05:03.145961] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-16T19:05:03.160871] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T19:05:03.507882] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-16T19:05:03.507963] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-16T19:05:03.508631] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-16T19:05:03.508713] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-16T19:05:03.509718] [DEBUG] [LOCAL ] GAB: Trimmed 39356 records to 27933 (keeping 200 days of data) [2025-10-16T19:05:03.677581] [DEBUG] [LOCAL ] GAB: Primary data saved (27933 records). [2025-10-16T19:05:03.677765] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-16T19:05:03.677868] [INFO ] [MAIN ] Update Progress: 892/2369 symbols completed. GAB took 38.3s. Estimated remaining: 3h 26m 59s. Rate: 7.1 symbols/min [2025-10-16T19:05:03.849482] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:05:03.886300] [DEBUG] [LOCAL ] GBCI: Loaded 40856 existing records from primary storage. [2025-10-16T19:05:03.886611] [INFO ] [MAIN ] GBCI: Loaded 40856 existing records. [2025-10-16T19:05:03.951044] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-16T19:05:04.071465] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:05:04.071717] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-16T19:05:04.071782] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-16T19:05:04.071998] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-16T19:05:04.072069] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-16T19:05:04.460775] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:05:04.742885] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-16T19:05:04.844357] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T19:05:05.261635] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T19:05:05.377866] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T19:05:05.542827] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-16T19:05:06.342820] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-16T19:05:07.142818] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-16T19:05:07.889047] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T19:05:07.942794] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-16T19:05:08.742845] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-16T19:05:08.868360] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T19:05:08.991598] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T19:05:09.226017] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T19:05:09.542799] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-16T19:05:10.342793] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-16T19:05:10.395595] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (4.85 seconds). [2025-10-16T19:05:10.449503] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T19:05:11.142808] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-16T19:05:11.942791] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-16T19:05:12.175940] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T19:05:12.201355] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T19:05:12.742824] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-16T19:05:13.290235] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T19:05:13.542795] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-16T19:05:13.735848] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T19:05:14.342810] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-16T19:05:15.142861] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-16T19:05:15.237513] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T19:05:15.403837] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-16T19:05:15.411809] [INFO ] [REMOTE ] GAP: Full fetch complete (77812 records). [2025-10-16T19:05:15.411953] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-16T19:05:15.869536] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-16T19:05:15.869695] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-16T19:05:15.870978] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-16T19:05:15.871049] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-16T19:05:15.872691] [DEBUG] [LOCAL ] GAP: Trimmed 77812 records to 54043 (keeping 200 days of data) [2025-10-16T19:05:15.969815] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-16T19:05:16.115681] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-16T19:05:16.251396] [DEBUG] [LOCAL ] GAP: Primary data saved (54043 records). [2025-10-16T19:05:16.251562] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-16T19:05:16.252370] [INFO ] [MAIN ] Update Progress: 893/2369 symbols completed. GAP took 39.5s. Estimated remaining: 3h 26m 57s. Rate: 7.1 symbols/min [2025-10-16T19:05:16.452897] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:05:16.453055] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-16T19:05:16.453093] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-16T19:05:16.453219] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-16T19:05:16.453279] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-16T19:05:16.453344] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-16T19:05:16.453411] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-16T19:05:16.749362] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-16T19:05:16.871486] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:05:17.239124] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T19:05:17.542795] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-16T19:05:17.596748] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-16T19:05:17.967381] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-16T19:05:18.342808] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-16T19:05:19.020714] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-16T19:05:19.142787] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-16T19:05:19.942795] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-16T19:05:20.641131] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T19:05:20.748044] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-16T19:05:20.751747] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T19:05:21.542791] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-16T19:05:21.678806] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T19:05:22.342819] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-16T19:05:22.603534] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-16T19:05:23.051814] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T19:05:23.142792] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-16T19:05:23.942814] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-16T19:05:24.598399] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T19:05:24.742802] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-16T19:05:24.996227] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T19:05:24.998394] [INFO ] [REMOTE ] GATX: Full fetch complete (24902 records). [2025-10-16T19:05:24.998465] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-16T19:05:25.353879] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-16T19:05:25.353954] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-16T19:05:25.354449] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-16T19:05:25.354488] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-16T19:05:25.355136] [DEBUG] [LOCAL ] GATX: Trimmed 24902 records to 18184 (keeping 200 days of data) [2025-10-16T19:05:25.466826] [DEBUG] [LOCAL ] GATX: Primary data saved (18184 records). [2025-10-16T19:05:25.466935] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-16T19:05:25.467014] [INFO ] [MAIN ] Update Progress: 894/2369 symbols completed. GATX took 31.6s. Estimated remaining: 3h 26m 50s. Rate: 7.1 symbols/min [2025-10-16T19:05:25.548050] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-16T19:05:25.633526] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:05:25.670131] [DEBUG] [LOCAL ] GBTG: Loaded 40255 existing records from primary storage. [2025-10-16T19:05:25.670452] [INFO ] [MAIN ] GBTG: Loaded 40255 existing records. [2025-10-16T19:05:25.847472] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:05:25.847704] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-16T19:05:25.847772] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-16T19:05:25.847976] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-16T19:05:25.848064] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-16T19:05:26.203678] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:05:26.198619] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T19:05:26.227925] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T19:05:26.342769] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-16T19:05:27.142822] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-16T19:05:27.781232] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T19:05:27.942769] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-16T19:05:28.547796] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T19:05:28.742821] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-16T19:05:29.408093] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T19:05:29.482144] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-16T19:05:29.542808] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-16T19:05:30.330081] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T19:05:30.342777] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-16T19:05:30.981924] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-16T19:05:31.142902] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-16T19:05:31.741802] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-16T19:05:31.743614] [INFO ] [REMOTE ] GBAB: Full fetch complete (18919 records). [2025-10-16T19:05:31.743737] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-16T19:05:31.947985] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-16T19:05:32.122678] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-16T19:05:32.122787] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-16T19:05:32.123213] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-16T19:05:32.123273] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-16T19:05:32.123901] [DEBUG] [LOCAL ] GBAB: Trimmed 18919 records to 12918 (keeping 200 days of data) [2025-10-16T19:05:32.203156] [DEBUG] [LOCAL ] GBAB: Primary data saved (12918 records). [2025-10-16T19:05:32.203304] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-16T19:05:32.203384] [INFO ] [MAIN ] Update Progress: 895/2369 symbols completed. GBAB took 30.5s. Estimated remaining: 3h 26m 39s. Rate: 7.1 symbols/min [2025-10-16T19:05:32.371012] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:05:32.404225] [DEBUG] [LOCAL ] GBX: Loaded 28929 existing records from primary storage. [2025-10-16T19:05:32.404529] [INFO ] [MAIN ] GBX: Loaded 28929 existing records. [2025-10-16T19:05:32.587081] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:05:32.587371] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-16T19:05:32.587430] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-16T19:05:32.587602] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-16T19:05:32.587687] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-16T19:05:32.763535] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-16T19:05:32.953094] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:05:33.385749] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T19:05:33.542881] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-16T19:05:34.302902] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T19:05:34.342905] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-16T19:05:34.639789] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T19:05:35.142860] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-16T19:05:35.761874] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T19:05:35.768096] [INFO ] [REMOTE ] GBCI: Full fetch complete (59077 records). [2025-10-16T19:05:35.768227] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-16T19:05:35.952052] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-16T19:05:36.143847] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-16T19:05:36.143926] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-16T19:05:36.144793] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-16T19:05:36.144882] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-16T19:05:36.146069] [DEBUG] [LOCAL ] GBCI: Trimmed 59077 records to 41242 (keeping 200 days of data) [2025-10-16T19:05:36.403171] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T19:05:36.412238] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-16T19:05:36.428027] [DEBUG] [LOCAL ] GBCI: Primary data saved (41242 records). [2025-10-16T19:05:36.428135] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-16T19:05:36.428660] [INFO ] [MAIN ] Update Progress: 896/2369 symbols completed. GBCI took 32.8s. Estimated remaining: 3h 26m 24s. Rate: 7.1 symbols/min [2025-10-16T19:05:36.592544] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:05:36.635031] [DEBUG] [LOCAL ] GCI: Loaded 43878 existing records from primary storage. [2025-10-16T19:05:36.635358] [INFO ] [MAIN ] GCI: Loaded 43878 existing records. [2025-10-16T19:05:36.747931] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-16T19:05:36.811799] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:05:36.811997] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-16T19:05:36.812044] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-16T19:05:36.812244] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-16T19:05:36.812302] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-16T19:05:37.162797] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:05:37.542799] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-16T19:05:38.252708] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T19:05:38.342795] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-16T19:05:38.860003] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T19:05:39.142834] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-16T19:05:39.562372] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T19:05:39.942797] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-16T19:05:40.367371] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T19:05:40.742905] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-16T19:05:41.126377] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-16T19:05:41.158217] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T19:05:41.542875] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-16T19:05:42.342873] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-16T19:05:42.475383] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-16T19:05:42.600066] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-16T19:05:43.142875] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-16T19:05:43.942915] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-16T19:05:44.536037] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T19:05:44.742831] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-16T19:05:45.339619] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T19:05:45.542774] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-16T19:05:45.626429] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T19:05:46.342817] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-16T19:05:47.091213] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T19:05:47.142842] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-16T19:05:47.366093] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T19:05:47.942835] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-16T19:05:48.509090] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T19:05:48.742824] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-16T19:05:49.420081] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T19:05:49.542785] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-16T19:05:50.037481] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T19:05:50.342833] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-16T19:05:50.612775] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T19:05:51.142865] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-16T19:05:51.332530] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T19:05:51.408102] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-16T19:05:51.942802] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-16T19:05:52.256300] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-16T19:05:52.742894] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-16T19:05:53.542823] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-16T19:05:54.115349] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T19:05:54.342818] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-16T19:05:55.035537] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:05:55.142777] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-16T19:05:55.447437] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T19:05:55.942865] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-16T19:05:56.409944] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-16T19:05:56.415134] [INFO ] [REMOTE ] GBTG: Full fetch complete (56719 records). [2025-10-16T19:05:56.415237] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-16T19:05:56.747929] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-16T19:05:56.802056] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-16T19:05:56.802193] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-16T19:05:56.803216] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-16T19:05:56.803286] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-16T19:05:56.804626] [DEBUG] [LOCAL ] GBTG: Trimmed 56719 records to 40545 (keeping 200 days of data) [2025-10-16T19:05:57.040624] [DEBUG] [LOCAL ] GBTG: Primary data saved (40545 records). [2025-10-16T19:05:57.040780] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-16T19:05:57.040877] [INFO ] [MAIN ] Update Progress: 897/2369 symbols completed. GBTG took 31.6s. Estimated remaining: 3h 26m 35s. Rate: 7.1 symbols/min [2025-10-16T19:05:57.219018] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:05:57.247102] [DEBUG] [LOCAL ] GCO: Loaded 23651 existing records from primary storage. [2025-10-16T19:05:57.247459] [INFO ] [MAIN ] GCO: Loaded 23651 existing records. [2025-10-16T19:05:57.431057] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:05:57.431260] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-16T19:05:57.431308] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-16T19:05:57.431475] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-16T19:05:57.431515] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-16T19:05:57.548054] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-16T19:05:57.797853] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:05:57.999771] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T19:05:58.106899] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-16T19:05:58.342814] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-16T19:05:59.142797] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-16T19:05:59.232873] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T19:05:59.236715] [INFO ] [REMOTE ] GBX: Full fetch complete (42871 records). [2025-10-16T19:05:59.236811] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-16T19:05:59.611707] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-16T19:05:59.611794] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-16T19:05:59.612558] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-16T19:05:59.612620] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-16T19:05:59.613569] [DEBUG] [LOCAL ] GBX: Trimmed 42871 records to 29120 (keeping 200 days of data) [2025-10-16T19:05:59.785403] [DEBUG] [LOCAL ] GBX: Primary data saved (29120 records). [2025-10-16T19:05:59.785536] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-16T19:05:59.785614] [INFO ] [MAIN ] Update Progress: 898/2369 symbols completed. GBX took 27.6s. Estimated remaining: 3h 26m 18s. Rate: 7.1 symbols/min [2025-10-16T19:05:59.960000] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:05:59.956526] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-16T19:05:59.980462] [DEBUG] [LOCAL ] GCTS: Loaded 20465 existing records from primary storage. [2025-10-16T19:05:59.980736] [INFO ] [MAIN ] GCTS: Loaded 20465 existing records. [2025-10-16T19:06:00.157722] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:06:00.157933] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-16T19:06:00.157981] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-16T19:06:00.158220] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-16T19:06:00.158278] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-16T19:06:00.524987] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:06:00.742795] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-16T19:06:01.072182] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (5.13 seconds). [2025-10-16T19:06:01.542833] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-16T19:06:01.937971] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T19:06:02.342857] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-16T19:06:02.441491] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (3.30 seconds). [2025-10-16T19:06:02.459509] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-16T19:06:02.696347] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T19:06:03.142890] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-16T19:06:03.361046] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T19:06:03.942856] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-16T19:06:04.742796] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-16T19:06:04.880581] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T19:06:05.542824] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-16T19:06:05.655441] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T19:06:05.707748] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T19:06:06.342808] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-16T19:06:06.556409] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T19:06:06.776567] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-16T19:06:06.777390] [INFO ] [REMOTE ] GBLI: Full fetch complete (1282 records). [2025-10-16T19:06:06.777458] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-16T19:06:06.959127] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-10-16T19:06:06.959301] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:06:06.959345] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:06:06.959394] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-16T19:06:06.959448] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-16T19:06:06.959505] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-16T19:06:06.959572] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-16T19:06:06.959627] [INFO ] [MAIN ] Update Progress: 899/2369 symbols completed. GBLI took 50.7s. Estimated remaining: 3h 26m 7s. Rate: 7.1 symbols/min [2025-10-16T19:06:07.137083] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:06:07.144230] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-16T19:06:07.149609] [DEBUG] [LOCAL ] GCV: Loaded 7804 existing records from primary storage. [2025-10-16T19:06:07.149857] [INFO ] [MAIN ] GCV: Loaded 7804 existing records. [2025-10-16T19:06:07.345079] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:06:07.345359] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-16T19:06:07.345411] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-16T19:06:07.345563] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-16T19:06:07.345601] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-16T19:06:07.703410] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:06:07.942882] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-16T19:06:08.510343] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T19:06:08.742811] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-16T19:06:09.413488] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T19:06:09.542770] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-16T19:06:10.342887] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-16T19:06:10.972080] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-16T19:06:11.028941] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-16T19:06:11.142833] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-16T19:06:11.942787] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-16T19:06:12.016692] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T19:06:12.438006] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-10-16T19:06:12.742785] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-16T19:06:12.798188] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T19:06:13.364611] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-16T19:06:13.542820] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-16T19:06:14.208159] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T19:06:14.342827] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-16T19:06:15.142838] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-16T19:06:15.531923] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T19:06:15.942807] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-16T19:06:16.436200] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-16T19:06:16.753833] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-16T19:06:16.756705] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T19:06:17.542823] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-16T19:06:17.794741] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T19:06:18.342868] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-16T19:06:18.901102] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T19:06:18.906736] [INFO ] [REMOTE ] GCI: Full fetch complete (63438 records). [2025-10-16T19:06:18.906886] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-16T19:06:19.147920] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-16T19:06:19.161233] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-16T19:06:19.319105] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-16T19:06:19.319194] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-16T19:06:19.320125] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-16T19:06:19.320190] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-16T19:06:19.321674] [DEBUG] [LOCAL ] GCI: Trimmed 63438 records to 44182 (keeping 200 days of data) [2025-10-16T19:06:19.569502] [DEBUG] [LOCAL ] GCI: Primary data saved (44182 records). [2025-10-16T19:06:19.569917] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-16T19:06:19.570638] [INFO ] [MAIN ] Update Progress: 900/2369 symbols completed. GCI took 43.1s. Estimated remaining: 3h 26m 6s. Rate: 7.1 symbols/min [2025-10-16T19:06:19.738530] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:06:19.784173] [DEBUG] [LOCAL ] GD: Loaded 46735 existing records from primary storage. [2025-10-16T19:06:19.784475] [INFO ] [MAIN ] GD: Loaded 46735 existing records. [2025-10-16T19:06:19.956585] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-16T19:06:19.961105] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:06:19.961317] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-16T19:06:19.961537] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-16T19:06:19.962321] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-16T19:06:19.962374] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-16T19:06:20.319457] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:06:20.354733] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T19:06:20.742802] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-16T19:06:21.382412] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T19:06:21.542840] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-16T19:06:22.342810] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-16T19:06:23.142785] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-16T19:06:23.181946] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T19:06:23.476936] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-10-16T19:06:23.910815] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T19:06:23.943685] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-16T19:06:23.950868] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-16T19:06:24.559557] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-16T19:06:24.742800] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-16T19:06:25.542885] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-16T19:06:25.881287] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T19:06:25.884893] [INFO ] [REMOTE ] GCO: Full fetch complete (35064 records). [2025-10-16T19:06:25.885046] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-16T19:06:26.034444] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T19:06:26.305823] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-16T19:06:26.305914] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-16T19:06:26.306586] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-16T19:06:26.306633] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-16T19:06:26.307635] [DEBUG] [LOCAL ] GCO: Trimmed 35064 records to 23761 (keeping 200 days of data) [2025-10-16T19:06:26.359860] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-16T19:06:26.493011] [DEBUG] [LOCAL ] GCO: Primary data saved (23761 records). [2025-10-16T19:06:26.493205] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-16T19:06:26.493313] [INFO ] [MAIN ] Update Progress: 901/2369 symbols completed. GCO took 29.5s. Estimated remaining: 3h 25m 55s. Rate: 7.1 symbols/min [2025-10-16T19:06:26.752182] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:06:26.819362] [DEBUG] [LOCAL ] GDDY: Loaded 49776 existing records from primary storage. [2025-10-16T19:06:26.819925] [INFO ] [MAIN ] GDDY: Loaded 49776 existing records. [2025-10-16T19:06:27.101444] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:06:27.101830] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-16T19:06:27.101882] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-16T19:06:27.102078] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-16T19:06:27.102137] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-16T19:06:27.147926] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-16T19:06:27.218133] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-16T19:06:27.497846] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:06:27.942788] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-16T19:06:28.742787] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-16T19:06:28.753733] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T19:06:29.008956] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T19:06:29.542795] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-16T19:06:30.135575] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T19:06:30.205867] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T19:06:30.207849] [INFO ] [REMOTE ] GCV: Full fetch complete (9852 records). [2025-10-16T19:06:30.207930] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-16T19:06:30.354956] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-16T19:06:30.578044] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-16T19:06:30.578117] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-16T19:06:30.578357] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-16T19:06:30.578396] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-16T19:06:30.578874] [DEBUG] [LOCAL ] GCV: Trimmed 9852 records to 7864 (keeping 200 days of data) [2025-10-16T19:06:30.633002] [DEBUG] [LOCAL ] GCV: Primary data saved (7864 records). [2025-10-16T19:06:30.633166] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-16T19:06:30.633255] [INFO ] [MAIN ] Update Progress: 902/2369 symbols completed. GCV took 23.7s. Estimated remaining: 3h 25m 39s. Rate: 7.1 symbols/min [2025-10-16T19:06:30.797010] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:06:30.803215] [DEBUG] [LOCAL ] GDIV: Loaded 3598 existing records from primary storage. [2025-10-16T19:06:30.803404] [INFO ] [MAIN ] GDIV: Loaded 3598 existing records. [2025-10-16T19:06:30.976846] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:06:30.977107] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-16T19:06:30.977183] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-16T19:06:30.977341] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-16T19:06:30.977396] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-16T19:06:31.150097] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-16T19:06:31.337706] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:06:31.942779] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-16T19:06:32.021130] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T19:06:32.742791] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-16T19:06:33.011610] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T19:06:33.244830] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-16T19:06:33.542856] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-16T19:06:33.996242] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-16T19:06:34.342781] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-16T19:06:34.439902] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T19:06:35.142814] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-16T19:06:35.560542] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-16T19:06:35.942824] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-16T19:06:36.036022] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T19:06:36.742816] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-16T19:06:37.542846] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-16T19:06:37.862610] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T19:06:37.995028] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T19:06:38.342789] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-16T19:06:38.598378] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T19:06:39.142874] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-16T19:06:39.942838] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-16T19:06:40.566421] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-16T19:06:40.742864] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-16T19:06:40.844911] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T19:06:41.542793] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-16T19:06:41.651092] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-16T19:06:42.170581] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T19:06:42.342814] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-16T19:06:42.691492] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-16T19:06:42.694373] [INFO ] [REMOTE ] GCTS: Full fetch complete (26992 records). [2025-10-16T19:06:42.694448] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-16T19:06:43.088147] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-16T19:06:43.088344] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-16T19:06:43.089539] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-16T19:06:43.089625] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-16T19:06:43.091077] [DEBUG] [LOCAL ] GCTS: Trimmed 26992 records to 20570 (keeping 200 days of data) [2025-10-16T19:06:43.150317] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-16T19:06:43.239355] [DEBUG] [LOCAL ] GCTS: Primary data saved (20570 records). [2025-10-16T19:06:43.239559] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-16T19:06:43.239715] [INFO ] [MAIN ] Update Progress: 903/2369 symbols completed. GCTS took 43.5s. Estimated remaining: 3h 25m 38s. Rate: 7.1 symbols/min [2025-10-16T19:06:43.419668] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:06:43.425913] [DEBUG] [LOCAL ] GDL: Loaded 2523 existing records from primary storage. [2025-10-16T19:06:43.426237] [INFO ] [MAIN ] GDL: Loaded 2523 existing records. [2025-10-16T19:06:43.629944] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:06:43.630434] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-16T19:06:43.630531] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-16T19:06:43.630736] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-16T19:06:43.630797] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-16T19:06:43.990470] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-16T19:06:44.001034] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:06:44.038821] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T19:06:44.580332] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T19:06:44.742775] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-16T19:06:44.854199] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T19:06:45.085691] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-16T19:06:45.542826] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-16T19:06:46.001947] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-16T19:06:46.342843] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-16T19:06:46.793333] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-16T19:06:47.142826] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-16T19:06:47.732593] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-16T19:06:47.942806] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-16T19:06:48.528738] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T19:06:48.742817] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-16T19:06:49.308491] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-16T19:06:49.542824] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-16T19:06:49.980731] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T19:06:50.342821] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-16T19:06:50.770463] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-16T19:06:51.142824] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-16T19:06:51.701345] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-16T19:06:51.942819] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-16T19:06:52.409672] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-16T19:06:52.742812] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-16T19:06:53.542815] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-16T19:06:54.013993] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-16T19:06:54.342808] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-16T19:06:54.445043] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T19:06:54.679790] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-16T19:06:55.142884] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-16T19:06:55.942832] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-16T19:06:56.301862] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-16T19:06:56.742794] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-16T19:06:57.151886] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T19:06:57.155881] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T19:06:57.542820] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-16T19:06:58.342836] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-16T19:06:58.747796] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-16T19:06:58.793830] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T19:06:59.142797] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-16T19:06:59.597235] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T19:06:59.942876] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-16T19:07:00.742825] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-16T19:07:01.542811] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-16T19:07:01.737546] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T19:07:01.741424] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-16T19:07:01.741591] [INFO ] [REMOTE ] GDIV: Full fetch complete (5423 records). [2025-10-16T19:07:01.741832] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-16T19:07:02.046278] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-16T19:07:02.126781] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-16T19:07:02.126861] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-16T19:07:02.127026] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-16T19:07:02.127066] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-16T19:07:02.127488] [DEBUG] [LOCAL ] GDIV: Trimmed 5423 records to 3621 (keeping 200 days of data) [2025-10-16T19:07:02.149330] [DEBUG] [LOCAL ] GDIV: Primary data saved (3621 records). [2025-10-16T19:07:02.149414] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-16T19:07:02.149525] [INFO ] [MAIN ] Update Progress: 904/2369 symbols completed. GDIV took 31.5s. Estimated remaining: 3h 25m 46s. Rate: 7.1 symbols/min [2025-10-16T19:07:02.314933] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:07:02.325983] [DEBUG] [LOCAL ] GDO: Loaded 5849 existing records from primary storage. [2025-10-16T19:07:02.326272] [INFO ] [MAIN ] GDO: Loaded 5849 existing records. [2025-10-16T19:07:02.350146] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-16T19:07:02.513292] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:07:02.513541] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-16T19:07:02.513589] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-16T19:07:02.513759] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-16T19:07:02.513815] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-16T19:07:02.869271] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:07:03.142831] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-16T19:07:03.839400] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:07:03.942814] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-16T19:07:03.957976] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-16T19:07:04.742834] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-16T19:07:05.420980] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T19:07:05.426733] [INFO ] [REMOTE ] GD: Full fetch complete (69806 records). [2025-10-16T19:07:05.426875] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-16T19:07:05.548028] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-16T19:07:05.819582] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-16T19:07:05.819700] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-16T19:07:05.820630] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-16T19:07:05.820714] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-16T19:07:05.822103] [DEBUG] [LOCAL ] GD: Trimmed 69806 records to 47051 (keeping 200 days of data) [2025-10-16T19:07:05.986251] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T19:07:06.095240] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T19:07:06.177300] [DEBUG] [LOCAL ] GD: Primary data saved (47051 records). [2025-10-16T19:07:06.177495] [INFO ] [MAIN ] GD: Full history saved. [2025-10-16T19:07:06.178293] [INFO ] [MAIN ] Update Progress: 905/2369 symbols completed. GD took 46.6s. Estimated remaining: 3h 25m 31s. Rate: 7.1 symbols/min [2025-10-16T19:07:06.341241] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:07:06.342880] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-16T19:07:06.380471] [DEBUG] [LOCAL ] GDOT: Loaded 37755 existing records from primary storage. [2025-10-16T19:07:06.380813] [INFO ] [MAIN ] GDOT: Loaded 37755 existing records. [2025-10-16T19:07:06.550081] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:07:06.550263] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-16T19:07:06.550347] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-16T19:07:06.550541] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-16T19:07:06.550580] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-16T19:07:06.841088] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-16T19:07:06.903371] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:07:07.142769] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-16T19:07:07.942854] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-16T19:07:08.504119] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-16T19:07:08.505334] [INFO ] [REMOTE ] GDL: Full fetch complete (3495 records). [2025-10-16T19:07:08.505518] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-16T19:07:08.607812] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T19:07:08.750161] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-16T19:07:08.923253] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-16T19:07:08.923325] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-16T19:07:08.923466] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-16T19:07:08.923504] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-16T19:07:08.923868] [DEBUG] [LOCAL ] GDL: Trimmed 3495 records to 2541 (keeping 200 days of data) [2025-10-16T19:07:08.938520] [DEBUG] [LOCAL ] GDL: Primary data saved (2541 records). [2025-10-16T19:07:08.938608] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-16T19:07:08.938718] [INFO ] [MAIN ] Update Progress: 906/2369 symbols completed. GDL took 25.7s. Estimated remaining: 3h 25m 13s. Rate: 7.1 symbols/min [2025-10-16T19:07:09.100624] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:07:09.119426] [DEBUG] [LOCAL ] GDV: Loaded 19531 existing records from primary storage. [2025-10-16T19:07:09.119664] [INFO ] [MAIN ] GDV: Loaded 19531 existing records. [2025-10-16T19:07:09.291409] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:07:09.291620] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-16T19:07:09.291711] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-16T19:07:09.291895] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-16T19:07:09.291935] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-16T19:07:09.420819] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-16T19:07:09.547920] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-16T19:07:09.650881] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:07:10.342814] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-16T19:07:11.142844] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-16T19:07:11.186884] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T19:07:11.678429] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-16T19:07:11.854799] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-16T19:07:11.942775] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-16T19:07:12.521495] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T19:07:12.742854] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-16T19:07:13.542812] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-16T19:07:14.033777] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-16T19:07:14.114564] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T19:07:14.342839] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-16T19:07:15.142934] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-16T19:07:15.712079] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T19:07:15.942824] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-16T19:07:16.149890] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T19:07:16.742941] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-16T19:07:17.485918] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T19:07:17.542824] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-16T19:07:18.192284] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T19:07:18.199090] [INFO ] [REMOTE ] GDDY: Full fetch complete (72162 records). [2025-10-16T19:07:18.199260] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-16T19:07:18.352102] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-16T19:07:18.607908] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-16T19:07:18.608122] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-16T19:07:18.609490] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-16T19:07:18.609597] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-16T19:07:18.634140] [DEBUG] [LOCAL ] GDDY: Trimmed 72162 records to 50151 (keeping 200 days of data) [2025-10-16T19:07:18.635233] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T19:07:18.943742] [DEBUG] [LOCAL ] GDDY: Primary data saved (50151 records). [2025-10-16T19:07:18.943895] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-16T19:07:18.943982] [INFO ] [MAIN ] Update Progress: 907/2369 symbols completed. GDDY took 52.5s. Estimated remaining: 3h 25m 7s. Rate: 7.1 symbols/min [2025-10-16T19:07:19.116506] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:07:19.144351] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-16T19:07:19.168266] [DEBUG] [LOCAL ] GE: Loaded 53699 existing records from primary storage. [2025-10-16T19:07:19.168624] [INFO ] [MAIN ] GE: Loaded 53699 existing records. [2025-10-16T19:07:19.354931] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:07:19.355309] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-16T19:07:19.355447] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-16T19:07:19.355761] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-16T19:07:19.355826] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-16T19:07:19.579431] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T19:07:19.925177] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:07:19.942881] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-16T19:07:20.606030] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T19:07:20.742834] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-16T19:07:21.542889] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-16T19:07:22.065135] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T19:07:22.223122] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-16T19:07:22.342794] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-16T19:07:22.593088] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T19:07:23.142933] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-16T19:07:23.769397] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-16T19:07:23.942781] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-16T19:07:24.033086] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T19:07:24.742830] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-16T19:07:25.048663] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-16T19:07:25.542933] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-16T19:07:26.224392] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-16T19:07:26.342816] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-16T19:07:26.831600] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-16T19:07:27.142838] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-16T19:07:27.373143] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T19:07:27.586185] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T19:07:27.942838] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-16T19:07:28.742807] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-16T19:07:28.988530] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T19:07:29.542801] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-16T19:07:30.342839] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-16T19:07:30.644637] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-16T19:07:30.688773] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T19:07:30.775081] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-16T19:07:30.776216] [INFO ] [REMOTE ] GDO: Full fetch complete (8549 records). [2025-10-16T19:07:30.776290] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-16T19:07:31.132627] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-16T19:07:31.132731] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-16T19:07:31.132967] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-16T19:07:31.133027] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-16T19:07:31.133415] [DEBUG] [LOCAL ] GDO: Trimmed 8549 records to 5863 (keeping 200 days of data) [2025-10-16T19:07:31.148147] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-16T19:07:31.171496] [DEBUG] [LOCAL ] GDO: Primary data saved (5863 records). [2025-10-16T19:07:31.171704] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-16T19:07:31.171811] [INFO ] [MAIN ] Update Progress: 908/2369 symbols completed. GDO took 29.0s. Estimated remaining: 3h 25m 5s. Rate: 7.1 symbols/min [2025-10-16T19:07:31.346733] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:07:31.368522] [DEBUG] [LOCAL ] GEF: Loaded 20790 existing records from primary storage. [2025-10-16T19:07:31.368844] [INFO ] [MAIN ] GEF: Loaded 20790 existing records. [2025-10-16T19:07:31.549898] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:07:31.550103] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-16T19:07:31.550152] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-16T19:07:31.550385] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-16T19:07:31.550442] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-16T19:07:31.928189] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:07:31.942784] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-16T19:07:32.581567] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T19:07:32.661942] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-16T19:07:32.742767] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-16T19:07:33.542793] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-16T19:07:33.757325] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T19:07:34.342789] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-16T19:07:34.481198] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-16T19:07:35.142803] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-16T19:07:35.167241] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T19:07:35.942792] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-16T19:07:36.434234] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T19:07:36.489690] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-16T19:07:36.742828] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-16T19:07:37.542822] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-16T19:07:38.342838] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-16T19:07:38.588357] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T19:07:38.591273] [INFO ] [REMOTE ] GDV: Full fetch complete (28465 records). [2025-10-16T19:07:38.591359] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-16T19:07:38.965804] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-16T19:07:38.966002] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-16T19:07:38.966856] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-16T19:07:38.966957] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-16T19:07:38.967994] [DEBUG] [LOCAL ] GDV: Trimmed 28465 records to 19620 (keeping 200 days of data) [2025-10-16T19:07:39.090684] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-16T19:07:39.132552] [DEBUG] [LOCAL ] GDV: Primary data saved (19620 records). [2025-10-16T19:07:39.132740] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-16T19:07:39.132839] [INFO ] [MAIN ] Update Progress: 909/2369 symbols completed. GDV took 30.2s. Estimated remaining: 3h 24m 56s. Rate: 7.1 symbols/min [2025-10-16T19:07:39.147919] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-16T19:07:39.306101] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:07:39.341869] [DEBUG] [LOCAL ] GEL: Loaded 31836 existing records from primary storage. [2025-10-16T19:07:39.342328] [INFO ] [MAIN ] GEL: Loaded 31836 existing records. [2025-10-16T19:07:39.534389] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:07:39.535930] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T19:07:39.535087] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-16T19:07:39.537775] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-16T19:07:39.541854] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-16T19:07:39.541955] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-16T19:07:39.893149] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:07:39.942799] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-16T19:07:40.512840] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T19:07:40.517870] [INFO ] [REMOTE ] GDOT: Full fetch complete (53585 records). [2025-10-16T19:07:40.517987] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-16T19:07:40.750720] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-16T19:07:40.900007] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-16T19:07:40.900085] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-16T19:07:40.900886] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-16T19:07:40.900948] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-16T19:07:40.902072] [DEBUG] [LOCAL ] GDOT: Trimmed 53585 records to 38078 (keeping 200 days of data) [2025-10-16T19:07:41.116847] [DEBUG] [LOCAL ] GDOT: Primary data saved (38078 records). [2025-10-16T19:07:41.116988] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-16T19:07:41.117068] [INFO ] [MAIN ] Update Progress: 910/2369 symbols completed. GDOT took 34.9s. Estimated remaining: 3h 24m 37s. Rate: 7.1 symbols/min [2025-10-16T19:07:41.302338] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:07:41.353758] [DEBUG] [LOCAL ] GENI: Loaded 52942 existing records from primary storage. [2025-10-16T19:07:41.354096] [INFO ] [MAIN ] GENI: Loaded 52942 existing records. [2025-10-16T19:07:41.539319] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:07:41.539541] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-16T19:07:41.539589] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-16T19:07:41.539892] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-16T19:07:41.539974] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-16T19:07:41.553712] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-16T19:07:41.923212] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:07:41.935930] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T19:07:42.144710] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-16T19:07:42.342777] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-16T19:07:42.572798] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T19:07:43.142864] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-16T19:07:43.942918] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-16T19:07:44.464145] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T19:07:44.629406] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-16T19:07:44.650423] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T19:07:44.742772] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-16T19:07:45.542825] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-16T19:07:45.654620] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-16T19:07:46.342840] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-16T19:07:46.803327] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T19:07:47.142874] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-16T19:07:47.942891] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-16T19:07:47.959692] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-16T19:07:48.067842] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T19:07:48.742858] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-16T19:07:49.542796] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-16T19:07:49.643901] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-16T19:07:49.675376] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T19:07:50.342874] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-16T19:07:50.474562] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T19:07:51.142879] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-16T19:07:51.942853] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-16T19:07:52.052722] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-16T19:07:52.311097] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-16T19:07:52.742875] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-16T19:07:53.097718] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T19:07:53.442202] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T19:07:53.445167] [INFO ] [REMOTE ] GEF: Full fetch complete (29399 records). [2025-10-16T19:07:53.445246] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-16T19:07:53.543429] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-16T19:07:53.819326] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-16T19:07:53.819399] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-16T19:07:53.820031] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-16T19:07:53.820093] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-16T19:07:53.820764] [DEBUG] [LOCAL ] GEF: Trimmed 29399 records to 20966 (keeping 200 days of data) [2025-10-16T19:07:53.944420] [DEBUG] [LOCAL ] GEF: Primary data saved (20966 records). [2025-10-16T19:07:53.944546] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-16T19:07:53.944618] [INFO ] [MAIN ] Update Progress: 911/2369 symbols completed. GEF took 22.8s. Estimated remaining: 3h 24m 36s. Rate: 7.1 symbols/min [2025-10-16T19:07:54.126683] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:07:54.175759] [DEBUG] [LOCAL ] GEO: Loaded 51820 existing records from primary storage. [2025-10-16T19:07:54.176347] [INFO ] [MAIN ] GEO: Loaded 51820 existing records. [2025-10-16T19:07:54.346683] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-16T19:07:54.350234] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:07:54.351271] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-16T19:07:54.351360] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-16T19:07:54.352037] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-16T19:07:54.352097] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-16T19:07:54.704924] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:07:55.030231] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T19:07:55.142813] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-16T19:07:55.699074] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T19:07:55.942849] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-16T19:07:56.553842] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T19:07:56.742807] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-16T19:07:57.542887] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-16T19:07:58.142188] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-16T19:07:58.204966] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T19:07:58.342807] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-16T19:07:58.912959] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T19:07:59.142864] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-16T19:07:59.685418] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T19:07:59.942841] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-16T19:08:00.054493] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T19:08:00.742859] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-16T19:08:01.542845] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-16T19:08:02.150400] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-16T19:08:02.342790] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-16T19:08:02.867204] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-16T19:08:03.032415] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T19:08:03.142835] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-16T19:08:03.223866] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T19:08:03.230984] [INFO ] [REMOTE ] GE: Full fetch complete (77862 records). [2025-10-16T19:08:03.231129] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-16T19:08:03.610576] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-16T19:08:03.610680] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-16T19:08:03.611736] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-16T19:08:03.611799] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-16T19:08:03.613169] [DEBUG] [LOCAL ] GE: Trimmed 77862 records to 54088 (keeping 200 days of data) [2025-10-16T19:08:03.942919] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-16T19:08:03.950708] [DEBUG] [LOCAL ] GE: Primary data saved (54088 records). [2025-10-16T19:08:03.950928] [INFO ] [MAIN ] GE: Full history saved. [2025-10-16T19:08:03.951095] [INFO ] [MAIN ] Update Progress: 912/2369 symbols completed. GE took 45.0s. Estimated remaining: 3h 24m 30s. Rate: 7.1 symbols/min [2025-10-16T19:08:04.119517] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:08:04.155095] [DEBUG] [LOCAL ] GES: Loaded 38288 existing records from primary storage. [2025-10-16T19:08:04.155400] [INFO ] [MAIN ] GES: Loaded 38288 existing records. [2025-10-16T19:08:04.331856] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:08:04.332224] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-16T19:08:04.332334] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-16T19:08:04.332670] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-16T19:08:04.332733] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-16T19:08:04.704955] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:08:04.707783] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T19:08:04.742791] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-16T19:08:05.377888] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T19:08:05.542826] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-16T19:08:06.141235] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T19:08:06.342870] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-16T19:08:06.910397] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T19:08:07.142813] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-16T19:08:07.942840] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-16T19:08:08.303943] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-16T19:08:08.572090] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T19:08:08.742782] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-16T19:08:09.089102] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T19:08:09.542817] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-16T19:08:10.295139] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T19:08:10.342770] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-16T19:08:10.631039] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T19:08:10.634242] [INFO ] [REMOTE ] GEL: Full fetch complete (48191 records). [2025-10-16T19:08:10.634316] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-16T19:08:11.007271] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-16T19:08:11.007381] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-16T19:08:11.008261] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-16T19:08:11.008325] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-16T19:08:11.009453] [DEBUG] [LOCAL ] GEL: Trimmed 48191 records to 31983 (keeping 200 days of data) [2025-10-16T19:08:11.162406] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-16T19:08:11.205054] [DEBUG] [LOCAL ] GEL: Primary data saved (31983 records). [2025-10-16T19:08:11.205594] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-16T19:08:11.205722] [INFO ] [MAIN ] Update Progress: 913/2369 symbols completed. GEL took 32.1s. Estimated remaining: 3h 24m 20s. Rate: 7.1 symbols/min [2025-10-16T19:08:11.369147] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:08:11.401680] [DEBUG] [LOCAL ] GETY: Loaded 34990 existing records from primary storage. [2025-10-16T19:08:11.401955] [INFO ] [MAIN ] GETY: Loaded 34990 existing records. [2025-10-16T19:08:11.581678] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:08:11.581933] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-16T19:08:11.582022] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-16T19:08:11.582242] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-16T19:08:11.582317] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-16T19:08:11.893971] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T19:08:11.944740] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-16T19:08:11.985780] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:08:12.742892] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-16T19:08:12.813132] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:08:13.542906] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-16T19:08:13.660496] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T19:08:14.163463] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T19:08:14.342835] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-16T19:08:15.067891] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T19:08:15.142797] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-16T19:08:15.942837] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-16T19:08:16.268309] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-16T19:08:16.528979] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T19:08:16.742859] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-16T19:08:17.542821] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-16T19:08:17.732458] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T19:08:18.187730] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T19:08:18.342830] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-16T19:08:18.728625] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T19:08:19.142822] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-16T19:08:19.640267] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T19:08:19.942833] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-16T19:08:20.744058] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-16T19:08:20.749416] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T19:08:21.430773] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:08:21.542839] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-16T19:08:22.342803] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-16T19:08:22.499861] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T19:08:23.142836] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-16T19:08:23.611882] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-16T19:08:23.619701] [INFO ] [REMOTE ] GENI: Full fetch complete (76003 records). [2025-10-16T19:08:23.619857] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-16T19:08:23.943584] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-16T19:08:24.000822] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T19:08:24.103452] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-16T19:08:24.103546] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-16T19:08:24.104574] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-16T19:08:24.104664] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-16T19:08:24.106291] [DEBUG] [LOCAL ] GENI: Trimmed 76003 records to 53328 (keeping 200 days of data) [2025-10-16T19:08:24.432881] [DEBUG] [LOCAL ] GENI: Primary data saved (53328 records). [2025-10-16T19:08:24.433020] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-16T19:08:24.433858] [INFO ] [MAIN ] Update Progress: 914/2369 symbols completed. GENI took 43.3s. Estimated remaining: 3h 24m 19s. Rate: 7.1 symbols/min [2025-10-16T19:08:24.604325] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:08:24.660300] [DEBUG] [LOCAL ] GEV: Loaded 53000 existing records from primary storage. [2025-10-16T19:08:24.660690] [INFO ] [MAIN ] GEV: Loaded 53000 existing records. [2025-10-16T19:08:24.750047] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-16T19:08:24.839506] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:08:24.839817] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-16T19:08:24.840029] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-16T19:08:24.840240] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-16T19:08:24.840280] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-16T19:08:25.149853] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-16T19:08:25.236327] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:08:25.306371] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T19:08:25.542858] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-16T19:08:26.228442] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T19:08:26.342841] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-16T19:08:27.142895] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-16T19:08:27.254114] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T19:08:27.942871] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-16T19:08:28.314397] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-16T19:08:28.696234] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:08:28.742769] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-16T19:08:28.901630] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T19:08:29.542811] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-16T19:08:30.261453] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T19:08:30.342788] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-16T19:08:31.142862] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-16T19:08:31.721509] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-16T19:08:31.942747] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-16T19:08:32.260766] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-16T19:08:32.342614] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-16T19:08:32.742825] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-16T19:08:33.542800] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-16T19:08:34.196816] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-16T19:08:34.342850] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-16T19:08:34.439168] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T19:08:34.686093] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T19:08:34.690800] [INFO ] [REMOTE ] GES: Full fetch complete (58706 records). [2025-10-16T19:08:34.690907] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-16T19:08:35.066258] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-16T19:08:35.066341] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-16T19:08:35.067267] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-16T19:08:35.067333] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-16T19:08:35.068627] [DEBUG] [LOCAL ] GES: Trimmed 58706 records to 38584 (keeping 200 days of data) [2025-10-16T19:08:35.156702] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-16T19:08:35.306125] [DEBUG] [LOCAL ] GES: Primary data saved (38584 records). [2025-10-16T19:08:35.306277] [INFO ] [MAIN ] GES: Full history saved. [2025-10-16T19:08:35.306360] [INFO ] [MAIN ] Update Progress: 915/2369 symbols completed. GES took 31.4s. Estimated remaining: 3h 24m 14s. Rate: 7.1 symbols/min [2025-10-16T19:08:35.480185] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:08:35.485164] [DEBUG] [LOCAL ] GF: Loaded 2697 existing records from primary storage. [2025-10-16T19:08:35.485320] [INFO ] [MAIN ] GF: Loaded 2697 existing records. [2025-10-16T19:08:35.655471] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:08:35.655700] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-16T19:08:35.655757] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-16T19:08:35.655895] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-16T19:08:35.655950] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-16T19:08:35.947864] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-16T19:08:36.008508] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:08:36.464743] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-16T19:08:36.487958] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T19:08:36.742818] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-16T19:08:37.542894] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-16T19:08:37.817964] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-16T19:08:37.824596] [INFO ] [REMOTE ] GEO: Full fetch complete (75583 records). [2025-10-16T19:08:37.824764] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-16T19:08:37.941385] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T19:08:37.996704] [INFO ] [REMOTE ] GETY: Full fetch complete (55624 records). [2025-10-16T19:08:38.013411] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-16T19:08:38.222016] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-16T19:08:38.352731] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-16T19:08:38.455773] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-16T19:08:38.468595] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-16T19:08:38.482449] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-16T19:08:38.502816] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-16T19:08:38.565147] [DEBUG] [LOCAL ] GEO: Trimmed 75583 records to 52187 (keeping 200 days of data) [2025-10-16T19:08:38.753463] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-16T19:08:38.756954] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-16T19:08:38.758036] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-16T19:08:38.758119] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-16T19:08:38.770095] [DEBUG] [LOCAL ] GETY: Trimmed 55624 records to 35351 (keeping 200 days of data) [2025-10-16T19:08:39.069265] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-16T19:08:39.157473] [DEBUG] [LOCAL ] GEO: Primary data saved (52187 records). [2025-10-16T19:08:39.152567] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-16T19:08:39.158961] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-16T19:08:39.160184] [INFO ] [MAIN ] Update Progress: 916/2369 symbols completed. GEO took 45.2s. Estimated remaining: 3h 23m 59s. Rate: 7.1 symbols/min [2025-10-16T19:08:39.351446] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:08:39.368114] [DEBUG] [LOCAL ] GETY: Primary data saved (35351 records). [2025-10-16T19:08:39.368405] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-16T19:08:39.368524] [INFO ] [MAIN ] Update Progress: 917/2369 symbols completed. GETY took 28.2s. Estimated remaining: 3h 23m 37s. Rate: 7.1 symbols/min [2025-10-16T19:08:39.394695] [DEBUG] [LOCAL ] GFF: Loaded 30002 existing records from primary storage. [2025-10-16T19:08:39.395017] [INFO ] [MAIN ] GFF: Loaded 30002 existing records. [2025-10-16T19:08:39.575845] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:08:39.576091] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-16T19:08:39.576140] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-16T19:08:39.576323] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-16T19:08:39.576361] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-16T19:08:39.918910] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:08:39.942778] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-16T19:08:40.742852] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-16T19:08:41.224308] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T19:08:41.542786] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-16T19:08:41.734750] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-16T19:08:41.749921] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T19:08:42.342910] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-16T19:08:42.826059] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T19:08:42.903674] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T19:08:43.142815] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-16T19:08:43.697881] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-16T19:08:43.942817] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-16T19:08:44.742861] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-16T19:08:45.338939] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T19:08:45.542792] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-16T19:08:46.287918] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-16T19:08:46.347887] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-16T19:08:46.357528] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T19:08:46.887404] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-16T19:08:47.142911] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-16T19:08:47.577918] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-16T19:08:47.942894] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-16T19:08:48.742876] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-16T19:08:49.190879] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T19:08:49.542854] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-16T19:08:49.989762] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T19:08:50.344331] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-16T19:08:50.350251] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-16T19:08:51.142898] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-16T19:08:51.842243] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T19:08:51.942803] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-16T19:08:52.742909] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-16T19:08:53.208382] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-16T19:08:53.209366] [INFO ] [REMOTE ] GF: Full fetch complete (4878 records). [2025-10-16T19:08:53.209435] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-16T19:08:53.581935] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-16T19:08:53.582073] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-16T19:08:53.582431] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-16T19:08:53.582679] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-16T19:08:53.583451] [DEBUG] [LOCAL ] GF: Trimmed 4878 records to 2700 (keeping 200 days of data) [2025-10-16T19:08:53.622364] [DEBUG] [LOCAL ] GF: Primary data saved (2700 records). [2025-10-16T19:08:53.622595] [INFO ] [MAIN ] GF: Full history saved. [2025-10-16T19:08:53.624590] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T19:08:53.623378] [INFO ] [MAIN ] Update Progress: 918/2369 symbols completed. GF took 18.3s. Estimated remaining: 3h 23m 38s. Rate: 7.1 symbols/min [2025-10-16T19:08:53.633747] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-16T19:08:53.677601] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-16T19:08:54.342811] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-16T19:08:54.968268] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T19:08:55.142881] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-16T19:08:56.099796] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T19:08:56.106096] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-16T19:08:56.726795] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-16T19:08:56.742771] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-16T19:08:57.041290] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T19:08:57.542791] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-16T19:08:58.929029] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T19:08:58.936801] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-16T19:08:59.042493] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-16T19:08:59.142801] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-16T19:08:59.891188] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T19:08:59.942768] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-16T19:09:01.223759] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T19:09:01.228286] [INFO ] [REMOTE ] GFF: Full fetch complete (44020 records). [2025-10-16T19:09:01.228511] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-16T19:09:01.668763] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-16T19:09:01.669030] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-16T19:09:01.670081] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-16T19:09:01.670170] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-16T19:09:01.671782] [DEBUG] [LOCAL ] GFF: Trimmed 44020 records to 30148 (keeping 200 days of data) [2025-10-16T19:09:01.702743] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-16T19:09:01.781837] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-16T19:09:01.922929] [DEBUG] [LOCAL ] GFF: Primary data saved (30148 records). [2025-10-16T19:09:01.923095] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-16T19:09:01.923191] [INFO ] [MAIN ] Update Progress: 919/2369 symbols completed. GFF took 22.8s. Estimated remaining: 3h 23m 29s. Rate: 7.1 symbols/min [2025-10-16T19:09:04.397490] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-16T19:09:04.405258] [INFO ] [REMOTE ] GEV: Full fetch complete (77024 records). [2025-10-16T19:09:04.405494] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-16T19:09:04.818532] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-16T19:09:04.818692] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-16T19:09:04.820119] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-16T19:09:04.820193] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-16T19:09:04.822173] [DEBUG] [LOCAL ] GEV: Trimmed 77024 records to 53389 (keeping 200 days of data) [2025-10-16T19:09:05.192591] [DEBUG] [LOCAL ] GEV: Primary data saved (53389 records). [2025-10-16T19:09:05.192911] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-16T19:09:05.193794] [INFO ] [MAIN ] Update Progress: 920/2369 symbols completed. GEV took 40.8s. Estimated remaining: 3h 23m 13s. Rate: 7.1 symbols/min [2025-10-16T19:09:05.837183] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:09:05.911859] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:09:05.957486] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:09:05.951477] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:09:05.957958] [DEBUG] [LOCAL ] GFR: No existing data file found in primary storage. [2025-10-16T19:09:05.958163] [WARN ] [MAIN ] GFR: No existing data found, performing full refresh instead. [2025-10-16T19:09:05.958848] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-16T19:09:05.958912] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-16T19:09:05.959102] [DEBUG] [LOCAL ] GFR: No primary data file found to delete. [2025-10-16T19:09:05.959179] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-16T19:09:06.291909] [DEBUG] [LOCAL ] GFL: Loaded 47671 existing records from primary storage. [2025-10-16T19:09:06.309008] [INFO ] [MAIN ] GFL: Loaded 47671 existing records. [2025-10-16T19:09:06.340073] [DEBUG] [LOCAL ] GGB: Loaded 51471 existing records from primary storage. [2025-10-16T19:09:06.387098] [INFO ] [MAIN ] GGB: Loaded 51471 existing records. [2025-10-16T19:09:06.512371] [DEBUG] [LOCAL ] GFI: Loaded 53116 existing records from primary storage. [2025-10-16T19:09:06.588624] [INFO ] [MAIN ] GFI: Loaded 53116 existing records. [2025-10-16T19:09:06.896173] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:09:06.929238] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:09:06.968369] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-16T19:09:06.967682] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:09:06.967922] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-16T19:09:06.975575] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-16T19:09:06.981125] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-16T19:09:06.991772] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-16T19:09:07.002778] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-16T19:09:07.002637] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-16T19:09:07.103123] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:09:07.108819] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-16T19:09:07.108671] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-16T19:09:07.129615] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-16T19:09:07.129789] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-16T19:09:07.190598] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-16T19:09:07.213535] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-16T19:09:07.902785] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-16T19:09:07.943752] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-16T19:09:08.142336] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:09:08.147933] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-16T19:09:08.314255] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:09:08.320134] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:09:08.320450] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-16T19:09:08.320924] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-16T19:09:08.803205] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T19:09:08.805774] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-16T19:09:09.571067] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T19:09:09.574409] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-16T19:09:09.699405] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T19:09:09.708025] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-16T19:09:09.941977] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T19:09:09.952321] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-16T19:09:10.061590] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T19:09:10.071968] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-16T19:09:10.335547] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-16T19:09:10.339931] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-16T19:09:10.900495] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-16T19:09:10.903908] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-16T19:09:11.372136] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T19:09:11.389022] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-16T19:09:11.389295] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-16T19:09:11.543433] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T19:09:11.594215] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T19:09:11.942814] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-16T19:09:12.540308] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T19:09:12.742832] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-16T19:09:13.542801] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-16T19:09:13.596140] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T19:09:13.921461] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-16T19:09:14.342788] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-16T19:09:14.615206] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-16T19:09:14.721061] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-16T19:09:15.142810] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-16T19:09:15.942880] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-16T19:09:16.742825] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-16T19:09:17.301667] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-16T19:09:17.373483] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T19:09:17.542793] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-16T19:09:18.342791] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-16T19:09:18.500331] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T19:09:18.769606] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-16T19:09:19.142826] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-16T19:09:19.187761] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T19:09:19.831287] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-16T19:09:19.942839] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-16T19:09:20.742898] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-16T19:09:21.542848] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-16T19:09:21.676823] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T19:09:21.707879] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T19:09:21.709517] [INFO ] [REMOTE ] GFR: Full fetch complete (12109 records). [2025-10-16T19:09:21.709609] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-16T19:09:22.077981] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-16T19:09:22.078063] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-16T19:09:22.078367] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-16T19:09:22.078409] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-16T19:09:22.078908] [DEBUG] [LOCAL ] GFR: Trimmed 12109 records to 7789 (keeping 200 days of data) [2025-10-16T19:09:22.119688] [DEBUG] [LOCAL ] GFR: Primary data saved (7789 records). [2025-10-16T19:09:22.119789] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-16T19:09:22.119856] [INFO ] [MAIN ] Update Progress: 921/2369 symbols completed. GFR took 16.9s. Estimated remaining: 3h 23m 18s. Rate: 7.1 symbols/min [2025-10-16T19:09:22.288777] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:09:22.325801] [DEBUG] [LOCAL ] GGG: Loaded 40679 existing records from primary storage. [2025-10-16T19:09:22.326081] [INFO ] [MAIN ] GGG: Loaded 40679 existing records. [2025-10-16T19:09:22.348059] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-16T19:09:22.504382] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:09:22.504603] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-16T19:09:22.504810] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-16T19:09:22.505010] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-16T19:09:22.505066] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-16T19:09:22.847936] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:09:23.142829] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-16T19:09:23.558488] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-16T19:09:23.694176] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T19:09:23.942835] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-16T19:09:24.535453] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T19:09:24.742780] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-16T19:09:25.493877] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T19:09:25.542818] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-16T19:09:26.328782] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T19:09:26.342789] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-16T19:09:27.142798] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-16T19:09:27.250971] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-16T19:09:27.942839] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-16T19:09:28.179454] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T19:09:28.742679] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T19:09:28.742861] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-16T19:09:29.240401] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T19:09:29.542816] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-16T19:09:30.342882] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-16T19:09:30.713950] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-16T19:09:31.142786] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-16T19:09:31.192682] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T19:09:31.765864] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T19:09:31.942816] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-16T19:09:32.742795] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-16T19:09:33.204126] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T19:09:33.542815] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-16T19:09:33.678773] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T19:09:34.342805] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-16T19:09:34.623613] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T19:09:35.006579] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T19:09:35.142843] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-16T19:09:35.942801] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-16T19:09:35.995844] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T19:09:36.002506] [INFO ] [REMOTE ] GGB: Full fetch complete (74329 records). [2025-10-16T19:09:36.002619] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-16T19:09:36.388709] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-16T19:09:36.388794] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-16T19:09:36.389789] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-16T19:09:36.389850] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-16T19:09:36.391195] [DEBUG] [LOCAL ] GGB: Trimmed 74329 records to 51854 (keeping 200 days of data) [2025-10-16T19:09:36.686799] [DEBUG] [LOCAL ] GGB: Primary data saved (51854 records). [2025-10-16T19:09:36.686939] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-16T19:09:36.687463] [INFO ] [MAIN ] Update Progress: 922/2369 symbols completed. GGB took 31.5s. Estimated remaining: 3h 23m 19s. Rate: 7.1 symbols/min [2025-10-16T19:09:36.755777] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-16T19:09:36.861150] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:09:36.890702] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T19:09:36.909824] [DEBUG] [LOCAL ] GGT: Loaded 14408 existing records from primary storage. [2025-10-16T19:09:36.910060] [INFO ] [MAIN ] GGT: Loaded 14408 existing records. [2025-10-16T19:09:37.085933] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:09:37.086126] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-16T19:09:37.086173] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-16T19:09:37.086344] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-16T19:09:37.086398] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-16T19:09:37.450210] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:09:37.542805] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-16T19:09:37.607255] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T19:09:37.999932] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-16T19:09:38.342852] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-16T19:09:38.363520] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-16T19:09:39.142819] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-16T19:09:39.851739] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T19:09:39.855538] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T19:09:39.942812] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-16T19:09:40.742894] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-16T19:09:41.243553] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-16T19:09:41.542834] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-16T19:09:42.277097] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T19:09:42.342779] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-16T19:09:42.503931] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T19:09:43.134111] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T19:09:43.142757] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-16T19:09:43.942862] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-16T19:09:43.968161] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T19:09:44.742910] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-16T19:09:45.542840] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-16T19:09:46.112721] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-16T19:09:46.120143] [INFO ] [REMOTE ] GFI: Full fetch complete (76826 records). [2025-10-16T19:09:46.120331] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-16T19:09:46.362210] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-16T19:09:46.532203] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T19:09:46.564633] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-16T19:09:46.565594] [INFO ] [REMOTE ] GFL: Full fetch complete (69463 records). [2025-10-16T19:09:46.566464] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T19:09:46.566764] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-16T19:09:46.566637] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-16T19:09:46.572246] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-16T19:09:46.573027] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-16T19:09:46.673700] [DEBUG] [LOCAL ] GFI: Trimmed 76826 records to 53505 (keeping 200 days of data) [2025-10-16T19:09:47.169739] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-16T19:09:47.169323] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-16T19:09:47.172741] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-16T19:09:47.181826] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-16T19:09:47.190093] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-16T19:09:47.205019] [DEBUG] [LOCAL ] GFL: Trimmed 69463 records to 48000 (keeping 200 days of data) [2025-10-16T19:09:47.384750] [DEBUG] [LOCAL ] GFI: Primary data saved (53505 records). [2025-10-16T19:09:47.385753] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-16T19:09:47.386144] [INFO ] [MAIN ] Update Progress: 923/2369 symbols completed. GFI took 42.2s. Estimated remaining: 3h 23m 14s. Rate: 7.1 symbols/min [2025-10-16T19:09:47.584603] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:09:47.596270] [DEBUG] [LOCAL ] GGZ: Loaded 2401 existing records from primary storage. [2025-10-16T19:09:47.598200] [INFO ] [MAIN ] GGZ: Loaded 2401 existing records. [2025-10-16T19:09:47.808491] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:09:47.860577] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-16T19:09:47.869536] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-16T19:09:47.898465] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-16T19:09:47.899784] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-16T19:09:48.050354] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T19:09:48.082286] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T19:09:48.069844] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-16T19:09:48.355859] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:09:48.422541] [DEBUG] [LOCAL ] GFL: Primary data saved (48000 records). [2025-10-16T19:09:48.422739] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-16T19:09:48.422844] [INFO ] [MAIN ] Update Progress: 924/2369 symbols completed. GFL took 43.2s. Estimated remaining: 3h 22m 54s. Rate: 7.1 symbols/min [2025-10-16T19:09:48.592384] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:09:48.597486] [DEBUG] [LOCAL ] GHC: Loaded 2926 existing records from primary storage. [2025-10-16T19:09:48.597667] [INFO ] [MAIN ] GHC: Loaded 2926 existing records. [2025-10-16T19:09:48.750707] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-16T19:09:48.782850] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:09:48.783360] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-16T19:09:48.783429] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-16T19:09:48.783598] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-16T19:09:48.783688] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-16T19:09:49.134312] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:09:49.202076] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T19:09:49.340017] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-16T19:09:49.542850] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-16T19:09:49.976444] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-16T19:09:50.342844] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-16T19:09:51.142879] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-16T19:09:51.932595] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T19:09:51.933562] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T19:09:51.942910] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-16T19:09:52.505301] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T19:09:52.742846] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-16T19:09:53.542846] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-16T19:09:54.202890] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T19:09:54.342838] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-16T19:09:54.504958] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T19:09:54.863474] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-16T19:09:55.142821] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-16T19:09:55.634832] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-16T19:09:55.942869] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-16T19:09:56.530468] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-16T19:09:56.742828] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-16T19:09:57.542864] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-16T19:09:58.199699] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-16T19:09:58.229973] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:09:58.342813] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-16T19:09:59.142813] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-16T19:09:59.850020] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-16T19:09:59.852508] [INFO ] [REMOTE ] GGT: Full fetch complete (18930 records). [2025-10-16T19:09:59.852592] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-16T19:09:59.947024] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-16T19:09:59.973566] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T19:10:00.026158] [INFO ] [REMOTE ] GGG: Full fetch complete (59516 records). [2025-10-16T19:10:00.037998] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-16T19:10:00.486113] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-16T19:10:00.486025] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-16T19:10:00.492795] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-16T19:10:00.493377] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-16T19:10:00.527363] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-16T19:10:00.553593] [DEBUG] [LOCAL ] GGT: Trimmed 18930 records to 14507 (keeping 200 days of data) [2025-10-16T19:10:00.706783] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-16T19:10:00.707147] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-16T19:10:00.708379] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-16T19:10:00.708726] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-16T19:10:00.712889] [DEBUG] [LOCAL ] GGG: Trimmed 59516 records to 40973 (keeping 200 days of data) [2025-10-16T19:10:00.768911] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-16T19:10:00.840841] [DEBUG] [LOCAL ] GGT: Primary data saved (14507 records). [2025-10-16T19:10:00.842881] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-16T19:10:00.843238] [INFO ] [MAIN ] Update Progress: 925/2369 symbols completed. GGT took 24.2s. Estimated remaining: 3h 22m 52s. Rate: 7.1 symbols/min [2025-10-16T19:10:01.022287] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:10:01.029575] [DEBUG] [LOCAL ] GHG: Loaded 3296 existing records from primary storage. [2025-10-16T19:10:01.030013] [INFO ] [MAIN ] GHG: Loaded 3296 existing records. [2025-10-16T19:10:01.221557] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:10:01.279116] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-16T19:10:01.279464] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-16T19:10:01.309522] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-16T19:10:01.309681] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-16T19:10:01.309269] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-16T19:10:01.547937] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-16T19:10:01.703806] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:10:01.719759] [DEBUG] [LOCAL ] GGG: Primary data saved (40973 records). [2025-10-16T19:10:01.719885] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-16T19:10:01.719987] [INFO ] [MAIN ] Update Progress: 926/2369 symbols completed. GGG took 39.6s. Estimated remaining: 3h 22m 32s. Rate: 7.1 symbols/min [2025-10-16T19:10:01.893586] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:10:01.904493] [DEBUG] [LOCAL ] GHI: Loaded 7364 existing records from primary storage. [2025-10-16T19:10:01.904752] [INFO ] [MAIN ] GHI: Loaded 7364 existing records. [2025-10-16T19:10:02.083553] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:10:02.086307] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-16T19:10:02.086444] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-16T19:10:02.086503] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-16T19:10:02.087970] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-16T19:10:02.088029] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-16T19:10:02.347928] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-16T19:10:02.437589] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:10:02.870225] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-16T19:10:03.142811] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-16T19:10:03.532918] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-16T19:10:03.942836] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-16T19:10:04.742790] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-16T19:10:05.003952] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:10:05.262919] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-16T19:10:05.542812] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-16T19:10:05.852260] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-16T19:10:06.342832] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-16T19:10:07.142798] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-16T19:10:07.144784] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T19:10:07.518217] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-16T19:10:07.942847] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-16T19:10:08.293970] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-16T19:10:08.742815] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-16T19:10:09.174582] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T19:10:09.542856] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-16T19:10:10.257321] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-16T19:10:10.342836] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-16T19:10:10.833977] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-16T19:10:11.142822] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-16T19:10:11.570751] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T19:10:11.942831] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-16T19:10:12.515418] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-16T19:10:12.742811] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-16T19:10:13.108949] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-16T19:10:13.542879] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-16T19:10:14.096114] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T19:10:14.342816] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-16T19:10:14.840001] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-16T19:10:15.142835] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-16T19:10:15.661281] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-16T19:10:15.942814] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-16T19:10:16.560758] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T19:10:16.742898] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-16T19:10:17.234906] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-16T19:10:17.542803] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-16T19:10:17.865880] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-16T19:10:18.342829] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-16T19:10:18.790705] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-16T19:10:19.142794] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-16T19:10:19.696309] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-16T19:10:19.697251] [INFO ] [REMOTE ] GGZ: Full fetch complete (3975 records). [2025-10-16T19:10:19.697321] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-16T19:10:19.947944] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-16T19:10:20.060629] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-16T19:10:20.060731] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-16T19:10:20.060860] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-16T19:10:20.060898] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-16T19:10:20.061233] [DEBUG] [LOCAL ] GGZ: Trimmed 3975 records to 2437 (keeping 200 days of data) [2025-10-16T19:10:20.076270] [DEBUG] [LOCAL ] GGZ: Primary data saved (2437 records). [2025-10-16T19:10:20.076399] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-16T19:10:20.076478] [INFO ] [MAIN ] Update Progress: 927/2369 symbols completed. GGZ took 32.7s. Estimated remaining: 3h 22m 39s. Rate: 7.1 symbols/min [2025-10-16T19:10:20.245158] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:10:20.251702] [DEBUG] [LOCAL ] GHLD: Loaded 4222 existing records from primary storage. [2025-10-16T19:10:20.251877] [INFO ] [MAIN ] GHLD: Loaded 4222 existing records. [2025-10-16T19:10:20.428610] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:10:20.428850] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-16T19:10:20.428896] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-16T19:10:20.429025] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-16T19:10:20.429061] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-16T19:10:20.687088] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T19:10:20.747917] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-16T19:10:20.802972] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:10:21.316493] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T19:10:21.542813] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-16T19:10:22.003329] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-16T19:10:22.342819] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-16T19:10:23.015208] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T19:10:23.016452] [INFO ] [REMOTE ] GHC: Full fetch complete (3619 records). [2025-10-16T19:10:23.016542] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-16T19:10:23.155860] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-16T19:10:23.413858] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-16T19:10:23.413933] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-16T19:10:23.414048] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-16T19:10:23.414085] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-16T19:10:23.414417] [DEBUG] [LOCAL ] GHC: Trimmed 3619 records to 2948 (keeping 200 days of data) [2025-10-16T19:10:23.433190] [DEBUG] [LOCAL ] GHC: Primary data saved (2948 records). [2025-10-16T19:10:23.433251] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-16T19:10:23.433319] [INFO ] [MAIN ] Update Progress: 928/2369 symbols completed. GHC took 35.0s. Estimated remaining: 3h 22m 23s. Rate: 7.1 symbols/min [2025-10-16T19:10:23.623061] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:10:23.638405] [DEBUG] [LOCAL ] GHM: Loaded 14368 existing records from primary storage. [2025-10-16T19:10:23.638705] [INFO ] [MAIN ] GHM: Loaded 14368 existing records. [2025-10-16T19:10:23.842233] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:10:23.842473] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-16T19:10:23.842521] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-16T19:10:23.842987] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-16T19:10:23.843079] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-16T19:10:23.948005] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-16T19:10:23.992860] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T19:10:24.274490] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:10:24.465816] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-16T19:10:24.742829] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-16T19:10:25.542813] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-16T19:10:25.591564] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T19:10:26.277474] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T19:10:26.342789] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-16T19:10:27.142800] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-16T19:10:27.154175] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T19:10:27.156460] [INFO ] [REMOTE ] GHI: Full fetch complete (11295 records). [2025-10-16T19:10:27.156548] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-16T19:10:27.541231] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-16T19:10:27.541344] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-16T19:10:27.542027] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-16T19:10:27.542096] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-16T19:10:27.542974] [DEBUG] [LOCAL ] GHI: Trimmed 11295 records to 7465 (keeping 200 days of data) [2025-10-16T19:10:27.596411] [DEBUG] [LOCAL ] GHI: Primary data saved (7465 records). [2025-10-16T19:10:27.596576] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-16T19:10:27.596689] [INFO ] [MAIN ] Update Progress: 929/2369 symbols completed. GHI took 25.9s. Estimated remaining: 3h 22m 7s. Rate: 7.1 symbols/min [2025-10-16T19:10:27.769420] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:10:27.791796] [DEBUG] [LOCAL ] GHY: Loaded 20928 existing records from primary storage. [2025-10-16T19:10:27.792042] [INFO ] [MAIN ] GHY: Loaded 20928 existing records. [2025-10-16T19:10:27.944092] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-16T19:10:27.975439] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:10:27.975671] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-16T19:10:27.975739] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-16T19:10:27.975945] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-16T19:10:27.976001] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-16T19:10:28.167112] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T19:10:28.354017] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:10:28.418510] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-16T19:10:28.742891] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-16T19:10:29.157451] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-16T19:10:29.542808] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-16T19:10:30.342784] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-16T19:10:30.670422] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T19:10:30.795323] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-16T19:10:31.142810] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-16T19:10:31.942786] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-16T19:10:31.983491] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T19:10:32.433553] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-16T19:10:32.742928] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-16T19:10:33.542810] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-16T19:10:33.807813] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:10:34.333093] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T19:10:34.342767] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-16T19:10:35.124766] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T19:10:35.142772] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-16T19:10:35.942773] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-16T19:10:35.992010] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T19:10:36.518803] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T19:10:36.742831] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-16T19:10:37.462189] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-16T19:10:37.542779] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-16T19:10:38.342792] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-16T19:10:38.474934] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T19:10:39.004226] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T19:10:39.005320] [INFO ] [REMOTE ] GHG: Full fetch complete (4173 records). [2025-10-16T19:10:39.005390] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-16T19:10:39.151172] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-16T19:10:39.355218] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-16T19:10:39.355294] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-16T19:10:39.355433] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-16T19:10:39.355472] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-16T19:10:39.355861] [DEBUG] [LOCAL ] GHG: Trimmed 4173 records to 3303 (keeping 200 days of data) [2025-10-16T19:10:39.373779] [DEBUG] [LOCAL ] GHG: Primary data saved (3303 records). [2025-10-16T19:10:39.373848] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-16T19:10:39.373916] [INFO ] [MAIN ] Update Progress: 930/2369 symbols completed. GHG took 38.5s. Estimated remaining: 3h 22m 4s. Rate: 7.1 symbols/min [2025-10-16T19:10:39.537673] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:10:39.570139] [DEBUG] [LOCAL ] GIB: Loaded 31659 existing records from primary storage. [2025-10-16T19:10:39.570407] [INFO ] [MAIN ] GIB: Loaded 31659 existing records. [2025-10-16T19:10:39.643603] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-16T19:10:39.749197] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:10:39.749414] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-16T19:10:39.749460] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-16T19:10:39.749689] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-16T19:10:39.749746] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-16T19:10:39.952467] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-16T19:10:40.097857] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:10:40.742833] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-16T19:10:40.975037] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T19:10:41.542882] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-16T19:10:41.588089] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T19:10:42.342891] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-16T19:10:42.699508] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-16T19:10:42.702526] [INFO ] [REMOTE ] GHM: Full fetch complete (22139 records). [2025-10-16T19:10:42.702620] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-16T19:10:43.064575] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-16T19:10:43.064678] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-16T19:10:43.065222] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-16T19:10:43.065283] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-16T19:10:43.065972] [DEBUG] [LOCAL ] GHM: Trimmed 22139 records to 14491 (keeping 200 days of data) [2025-10-16T19:10:43.143057] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-16T19:10:43.151528] [DEBUG] [LOCAL ] GHM: Primary data saved (14491 records). [2025-10-16T19:10:43.151707] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-16T19:10:43.151803] [INFO ] [MAIN ] Update Progress: 931/2369 symbols completed. GHM took 19.7s. Estimated remaining: 3h 21m 49s. Rate: 7.1 symbols/min [2025-10-16T19:10:43.335088] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:10:43.354379] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T19:10:43.372298] [DEBUG] [LOCAL ] GIC: Loaded 13411 existing records from primary storage. [2025-10-16T19:10:43.372538] [INFO ] [MAIN ] GIC: Loaded 13411 existing records. [2025-10-16T19:10:43.477369] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-16T19:10:43.557111] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:10:43.557317] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-16T19:10:43.557363] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-16T19:10:43.557506] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-16T19:10:43.557544] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-16T19:10:43.912188] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:10:43.942773] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-16T19:10:44.696391] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T19:10:44.742781] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-16T19:10:45.542806] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-16T19:10:45.660396] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T19:10:45.845629] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-16T19:10:46.342805] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-16T19:10:46.833551] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-16T19:10:47.142898] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-16T19:10:47.942875] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-16T19:10:48.181620] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T19:10:48.742833] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-16T19:10:49.082204] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T19:10:49.549461] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-16T19:10:49.554984] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-16T19:10:50.342835] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-16T19:10:50.573379] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T19:10:50.917990] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T19:10:51.142869] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-16T19:10:51.942812] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-16T19:10:52.547483] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T19:10:52.571299] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T19:10:52.742885] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-16T19:10:53.420870] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-16T19:10:53.542863] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-16T19:10:54.121393] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T19:10:54.342828] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-16T19:10:55.142891] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-16T19:10:55.772507] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T19:10:55.942872] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-16T19:10:56.311684] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T19:10:56.549055] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-16T19:10:56.550266] [INFO ] [REMOTE ] GHLD: Full fetch complete (5072 records). [2025-10-16T19:10:56.550343] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-16T19:10:56.747995] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-16T19:10:56.910109] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-16T19:10:56.910185] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-16T19:10:56.910335] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-16T19:10:56.910373] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-16T19:10:56.910797] [DEBUG] [LOCAL ] GHLD: Trimmed 5072 records to 4312 (keeping 200 days of data) [2025-10-16T19:10:56.937166] [DEBUG] [LOCAL ] GHLD: Primary data saved (4312 records). [2025-10-16T19:10:56.937357] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-16T19:10:56.937466] [INFO ] [MAIN ] Update Progress: 932/2369 symbols completed. GHLD took 36.9s. Estimated remaining: 3h 21m 49s. Rate: 7.1 symbols/min [2025-10-16T19:10:57.106893] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:10:57.147947] [DEBUG] [LOCAL ] GIL: Loaded 43829 existing records from primary storage. [2025-10-16T19:10:57.148286] [INFO ] [MAIN ] GIL: Loaded 43829 existing records. [2025-10-16T19:10:57.329941] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:10:57.330249] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-16T19:10:57.330312] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-16T19:10:57.330516] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-16T19:10:57.330574] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-16T19:10:57.552537] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-16T19:10:57.690334] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:10:58.038873] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T19:10:58.143320] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T19:10:58.342862] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-16T19:10:59.142835] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-16T19:10:59.746005] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T19:10:59.904879] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-16T19:10:59.942763] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-16T19:11:00.742786] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-16T19:11:00.798928] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T19:11:01.542781] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-16T19:11:01.739985] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T19:11:02.342824] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-16T19:11:02.382223] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T19:11:03.005254] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-16T19:11:03.142819] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-16T19:11:03.942780] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-16T19:11:04.342582] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T19:11:04.742816] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-16T19:11:05.407602] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-16T19:11:05.452610] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T19:11:05.542868] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-16T19:11:06.342843] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-16T19:11:06.768349] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T19:11:07.142824] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-16T19:11:07.208295] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-16T19:11:07.942853] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-16T19:11:08.708132] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T19:11:08.742789] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-16T19:11:09.155972] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-16T19:11:09.542809] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-16T19:11:10.034794] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T19:11:10.335466] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T19:11:10.342790] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-16T19:11:11.142826] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-16T19:11:11.326413] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T19:11:11.942865] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-16T19:11:12.031983] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T19:11:12.696797] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T19:11:12.742828] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-16T19:11:13.542796] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-16T19:11:14.049879] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T19:11:14.342835] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-16T19:11:14.674087] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-16T19:11:14.677881] [INFO ] [REMOTE ] GHY: Full fetch complete (32502 records). [2025-10-16T19:11:14.678016] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-16T19:11:15.051063] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-16T19:11:15.051148] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-16T19:11:15.051834] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-16T19:11:15.051895] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-16T19:11:15.052593] [DEBUG] [LOCAL ] GHY: Trimmed 32502 records to 21076 (keeping 200 days of data) [2025-10-16T19:11:15.143181] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-16T19:11:15.186272] [DEBUG] [LOCAL ] GHY: Primary data saved (21076 records). [2025-10-16T19:11:15.186411] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-16T19:11:15.186488] [INFO ] [MAIN ] Update Progress: 933/2369 symbols completed. GHY took 47.6s. Estimated remaining: 3h 21m 55s. Rate: 7.1 symbols/min [2025-10-16T19:11:15.354370] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:11:15.404393] [DEBUG] [LOCAL ] GIS: Loaded 53673 existing records from primary storage. [2025-10-16T19:11:15.404829] [INFO ] [MAIN ] GIS: Loaded 53673 existing records. [2025-10-16T19:11:15.579226] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:11:15.579442] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-16T19:11:15.579490] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-16T19:11:15.579814] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-16T19:11:15.579873] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-16T19:11:15.943815] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:11:15.944086] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-16T19:11:15.971972] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T19:11:16.059733] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T19:11:16.742876] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-16T19:11:17.332110] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T19:11:17.542812] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-16T19:11:18.342800] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-16T19:11:18.485946] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T19:11:18.881506] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T19:11:18.885520] [INFO ] [REMOTE ] GIB: Full fetch complete (46159 records). [2025-10-16T19:11:18.885598] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-16T19:11:19.147883] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-16T19:11:19.262497] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-16T19:11:19.262586] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-16T19:11:19.263391] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-16T19:11:19.263481] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-16T19:11:19.264714] [DEBUG] [LOCAL ] GIB: Trimmed 46159 records to 31938 (keeping 200 days of data) [2025-10-16T19:11:19.484758] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T19:11:19.495465] [DEBUG] [LOCAL ] GIB: Primary data saved (31938 records). [2025-10-16T19:11:19.495957] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-16T19:11:19.496071] [INFO ] [MAIN ] Update Progress: 934/2369 symbols completed. GIB took 40.1s. Estimated remaining: 3h 21m 40s. Rate: 7.1 symbols/min [2025-10-16T19:11:19.662094] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:11:19.698995] [DEBUG] [LOCAL ] GKOS: Loaded 42541 existing records from primary storage. [2025-10-16T19:11:19.699301] [INFO ] [MAIN ] GKOS: Loaded 42541 existing records. [2025-10-16T19:11:19.872587] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:11:19.872828] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-16T19:11:19.872877] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-16T19:11:19.873499] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-16T19:11:19.873554] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-16T19:11:19.947949] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-16T19:11:20.229124] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:11:20.742841] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-16T19:11:20.845262] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T19:11:20.847404] [INFO ] [REMOTE ] GIC: Full fetch complete (19960 records). [2025-10-16T19:11:20.847485] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-16T19:11:21.221311] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-16T19:11:21.221416] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-16T19:11:21.221922] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-16T19:11:21.222066] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-16T19:11:21.249221] [DEBUG] [LOCAL ] GIC: Trimmed 19960 records to 13495 (keeping 200 days of data) [2025-10-16T19:11:21.250580] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-16T19:11:21.343099] [DEBUG] [LOCAL ] GIC: Primary data saved (13495 records). [2025-10-16T19:11:21.343252] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-16T19:11:21.343338] [INFO ] [MAIN ] Update Progress: 935/2369 symbols completed. GIC took 38.2s. Estimated remaining: 3h 21m 22s. Rate: 7.1 symbols/min [2025-10-16T19:11:21.510760] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:11:21.547999] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-16T19:11:21.550511] [DEBUG] [LOCAL ] GL: Loaded 37640 existing records from primary storage. [2025-10-16T19:11:21.550767] [INFO ] [MAIN ] GL: Loaded 37640 existing records. [2025-10-16T19:11:21.724033] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:11:21.724217] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-16T19:11:21.724263] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-16T19:11:21.724469] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-16T19:11:21.724525] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-16T19:11:22.084263] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:11:22.108378] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T19:11:22.342805] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-16T19:11:23.046351] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T19:11:23.142808] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-16T19:11:23.789921] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T19:11:23.942822] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-16T19:11:24.619765] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T19:11:24.742934] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-16T19:11:25.331004] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T19:11:25.542813] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-16T19:11:25.902014] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T19:11:26.342826] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-16T19:11:26.659566] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T19:11:27.142867] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-16T19:11:27.947679] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-16T19:11:27.953274] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T19:11:28.742849] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-16T19:11:29.101259] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T19:11:29.139220] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-16T19:11:29.542868] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-16T19:11:29.854820] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T19:11:30.342804] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-16T19:11:31.142818] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-16T19:11:31.242279] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T19:11:31.942790] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-16T19:11:32.023764] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T19:11:32.742801] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-16T19:11:32.868732] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T19:11:32.874852] [INFO ] [REMOTE ] GIL: Full fetch complete (62316 records). [2025-10-16T19:11:32.874997] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-16T19:11:33.255931] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-16T19:11:33.256044] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-16T19:11:33.257133] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-16T19:11:33.257220] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-16T19:11:33.258718] [DEBUG] [LOCAL ] GIL: Trimmed 62316 records to 44162 (keeping 200 days of data) [2025-10-16T19:11:33.523927] [DEBUG] [LOCAL ] GIL: Primary data saved (44162 records). [2025-10-16T19:11:33.524108] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-16T19:11:33.524593] [INFO ] [MAIN ] Update Progress: 936/2369 symbols completed. GIL took 36.6s. Estimated remaining: 3h 21m 19s. Rate: 7.1 symbols/min [2025-10-16T19:11:33.555990] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-16T19:11:33.720633] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:11:33.755628] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T19:11:33.808825] [DEBUG] [LOCAL ] GLOB: Loaded 47983 existing records from primary storage. [2025-10-16T19:11:33.809237] [INFO ] [MAIN ] GLOB: Loaded 47983 existing records. [2025-10-16T19:11:34.046743] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:11:34.047105] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-16T19:11:34.047215] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-16T19:11:34.055638] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-16T19:11:34.068255] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-16T19:11:34.141773] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T19:11:34.347959] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-16T19:11:34.504398] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:11:35.142868] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-16T19:11:35.238529] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T19:11:35.935985] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T19:11:35.946351] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-16T19:11:36.525006] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T19:11:36.742859] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-16T19:11:36.874775] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T19:11:37.542900] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-16T19:11:38.342831] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-16T19:11:38.589083] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T19:11:39.142856] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-16T19:11:39.225983] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T19:11:39.307025] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T19:11:39.942813] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-16T19:11:40.742797] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-16T19:11:41.094759] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-16T19:11:41.194954] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-16T19:11:41.542803] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-16T19:11:42.277714] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T19:11:42.342799] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-16T19:11:43.089598] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T19:11:43.142785] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-16T19:11:43.490541] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-16T19:11:43.942837] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-16T19:11:44.625260] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T19:11:44.742817] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-16T19:11:45.539590] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T19:11:45.547002] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-16T19:11:46.217305] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T19:11:46.342813] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-16T19:11:47.142787] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-16T19:11:47.609011] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-16T19:11:47.886376] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T19:11:47.942838] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-16T19:11:48.393576] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-16T19:11:48.742882] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-16T19:11:49.304587] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T19:11:49.542814] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-16T19:11:49.578088] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T19:11:49.585796] [INFO ] [REMOTE ] GIS: Full fetch complete (77836 records). [2025-10-16T19:11:49.585996] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-16T19:11:50.009928] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-16T19:11:50.010021] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-16T19:11:50.011165] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-16T19:11:50.011231] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-16T19:11:50.012986] [DEBUG] [LOCAL ] GIS: Trimmed 77836 records to 54063 (keeping 200 days of data) [2025-10-16T19:11:50.343056] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-16T19:11:50.352691] [DEBUG] [LOCAL ] GIS: Primary data saved (54063 records). [2025-10-16T19:11:50.352844] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-16T19:11:50.353454] [INFO ] [MAIN ] Update Progress: 937/2369 symbols completed. GIS took 35.2s. Estimated remaining: 3h 21m 24s. Rate: 7.1 symbols/min [2025-10-16T19:11:50.518785] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:11:50.529606] [DEBUG] [LOCAL ] GLP: Loaded 9278 existing records from primary storage. [2025-10-16T19:11:50.529856] [INFO ] [MAIN ] GLP: Loaded 9278 existing records. [2025-10-16T19:11:50.702985] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:11:50.703212] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-16T19:11:50.703460] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-16T19:11:50.703873] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-16T19:11:50.703936] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-16T19:11:51.120328] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:11:51.134065] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T19:11:51.139080] [INFO ] [REMOTE ] GL: Full fetch complete (55147 records). [2025-10-16T19:11:51.139218] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-16T19:11:51.151102] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-16T19:11:51.523900] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-16T19:11:51.523981] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-16T19:11:51.524809] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-16T19:11:51.524871] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-16T19:11:51.526011] [DEBUG] [LOCAL ] GL: Trimmed 55147 records to 37863 (keeping 200 days of data) [2025-10-16T19:11:51.766011] [DEBUG] [LOCAL ] GL: Primary data saved (37863 records). [2025-10-16T19:11:51.766177] [INFO ] [MAIN ] GL: Full history saved. [2025-10-16T19:11:51.766292] [INFO ] [MAIN ] Update Progress: 938/2369 symbols completed. GL took 30.4s. Estimated remaining: 3h 21m 4s. Rate: 7.1 symbols/min [2025-10-16T19:11:51.940493] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:11:51.942783] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-16T19:11:51.968534] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T19:11:52.005126] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T19:11:52.027561] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-16T19:11:52.027932] [INFO ] [MAIN ] GLW: Loaded 53636 existing records. [2025-10-16T19:11:52.201166] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:11:52.201401] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-16T19:11:52.201449] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-16T19:11:52.202461] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-16T19:11:52.202519] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-16T19:11:52.551400] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:11:52.742817] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-16T19:11:53.462704] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T19:11:53.542827] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-16T19:11:54.342819] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-16T19:11:54.525090] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T19:11:54.681759] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T19:11:54.687035] [INFO ] [REMOTE ] GKOS: Full fetch complete (60375 records). [2025-10-16T19:11:54.687176] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-16T19:11:55.064274] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-16T19:11:55.064364] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-16T19:11:55.065259] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-16T19:11:55.065327] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-16T19:11:55.066626] [DEBUG] [LOCAL ] GKOS: Trimmed 60375 records to 42824 (keeping 200 days of data) [2025-10-16T19:11:55.152974] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-16T19:11:55.331208] [DEBUG] [LOCAL ] GKOS: Primary data saved (42824 records). [2025-10-16T19:11:55.331347] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-16T19:11:55.331953] [INFO ] [MAIN ] Update Progress: 939/2369 symbols completed. GKOS took 35.8s. Estimated remaining: 3h 20m 49s. Rate: 7.1 symbols/min [2025-10-16T19:11:55.525817] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:11:55.577341] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-16T19:11:55.577667] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-16T19:11:55.755907] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:11:55.756149] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-16T19:11:55.756204] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-16T19:11:55.757202] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-16T19:11:55.757261] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-16T19:11:55.950901] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-16T19:11:56.129976] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:11:56.163456] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T19:11:56.742802] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-16T19:11:56.818091] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T19:11:57.073714] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-16T19:11:57.542897] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-16T19:11:58.342873] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-16T19:11:58.669534] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-16T19:11:59.142817] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-16T19:11:59.171536] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T19:11:59.217290] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T19:11:59.942823] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-16T19:12:00.663752] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T19:12:00.742807] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-16T19:12:01.554158] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-16T19:12:01.559811] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-16T19:12:02.002016] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T19:12:02.277744] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T19:12:02.342813] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-16T19:12:03.094862] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-16T19:12:03.142798] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-16T19:12:03.942842] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-16T19:12:03.951778] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T19:12:04.742859] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-16T19:12:05.542842] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-16T19:12:05.714187] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T19:12:06.245741] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-16T19:12:06.342882] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-16T19:12:06.470459] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T19:12:07.142850] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-16T19:12:07.907337] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-16T19:12:07.942782] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-16T19:12:08.387757] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-16T19:12:08.742813] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-16T19:12:09.542828] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-16T19:12:09.618335] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T19:12:09.722054] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T19:12:10.342859] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-16T19:12:11.142793] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-16T19:12:11.232381] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T19:12:11.942823] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-16T19:12:12.056031] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T19:12:12.742856] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-16T19:12:13.123452] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-16T19:12:13.446257] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T19:12:13.447926] [INFO ] [REMOTE ] GLP: Full fetch complete (14287 records). [2025-10-16T19:12:13.447997] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-16T19:12:13.543111] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-16T19:12:13.827575] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-16T19:12:13.827723] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-16T19:12:13.828122] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-16T19:12:13.828258] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-16T19:12:13.829129] [DEBUG] [LOCAL ] GLP: Trimmed 14287 records to 9346 (keeping 200 days of data) [2025-10-16T19:12:13.912970] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T19:12:13.926931] [DEBUG] [LOCAL ] GLP: Primary data saved (9346 records). [2025-10-16T19:12:13.927372] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-16T19:12:13.927467] [INFO ] [MAIN ] Update Progress: 940/2369 symbols completed. GLP took 23.6s. Estimated remaining: 3h 20m 56s. Rate: 7.1 symbols/min [2025-10-16T19:12:14.095377] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:12:14.148257] [DEBUG] [LOCAL ] GME: Loaded 53781 existing records from primary storage. [2025-10-16T19:12:14.148592] [INFO ] [MAIN ] GME: Loaded 53781 existing records. [2025-10-16T19:12:14.324004] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:12:14.324223] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-16T19:12:14.324271] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-16T19:12:14.324478] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-16T19:12:14.324548] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-16T19:12:14.349314] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-16T19:12:14.692892] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:12:15.142825] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-16T19:12:15.571402] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-16T19:12:15.942814] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-16T19:12:16.228614] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T19:12:16.235196] [INFO ] [REMOTE ] GLOB: Full fetch complete (65695 records). [2025-10-16T19:12:16.235352] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-16T19:12:16.618205] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-16T19:12:16.618284] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-16T19:12:16.619264] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-16T19:12:16.619327] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-16T19:12:16.620706] [DEBUG] [LOCAL ] GLOB: Trimmed 65695 records to 48330 (keeping 200 days of data) [2025-10-16T19:12:16.783735] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-16T19:12:16.899157] [DEBUG] [LOCAL ] GLOB: Primary data saved (48330 records). [2025-10-16T19:12:16.899297] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-16T19:12:16.899374] [INFO ] [MAIN ] Update Progress: 941/2369 symbols completed. GLOB took 43.4s. Estimated remaining: 3h 20m 39s. Rate: 7.1 symbols/min [2025-10-16T19:12:17.068659] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:12:17.111809] [DEBUG] [LOCAL ] GMED: Loaded 48294 existing records from primary storage. [2025-10-16T19:12:17.112119] [INFO ] [MAIN ] GMED: Loaded 48294 existing records. [2025-10-16T19:12:17.286503] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:12:17.286770] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-16T19:12:17.286821] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-16T19:12:17.287065] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-16T19:12:17.287121] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-16T19:12:17.706986] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:12:17.707545] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-16T19:12:17.771354] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-16T19:12:17.812547] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T19:12:18.287687] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T19:12:18.342775] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-16T19:12:19.142909] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-16T19:12:19.188323] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T19:12:19.942798] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-16T19:12:20.091054] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-16T19:12:20.742910] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-16T19:12:21.515127] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T19:12:21.542818] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-16T19:12:21.721297] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-16T19:12:22.342841] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-16T19:12:22.708617] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T19:12:22.748518] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T19:12:23.142874] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-16T19:12:23.942842] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-16T19:12:24.230069] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-16T19:12:24.481209] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T19:12:24.742833] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-16T19:12:25.542832] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-16T19:12:25.726471] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T19:12:26.342795] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-16T19:12:26.912440] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-16T19:12:27.142861] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-16T19:12:27.833138] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T19:12:27.840067] [INFO ] [REMOTE ] GLW: Full fetch complete (77790 records). [2025-10-16T19:12:27.840184] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-16T19:12:27.946485] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-16T19:12:28.210065] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-10-16T19:12:28.306148] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-16T19:12:28.306738] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-16T19:12:28.307923] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-16T19:12:28.308006] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-16T19:12:28.335764] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T19:12:28.334426] [DEBUG] [LOCAL ] GLW: Trimmed 77790 records to 54026 (keeping 200 days of data) [2025-10-16T19:12:28.670728] [DEBUG] [LOCAL ] GLW: Primary data saved (54026 records). [2025-10-16T19:12:28.670880] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-16T19:12:28.670963] [INFO ] [MAIN ] Update Progress: 942/2369 symbols completed. GLW took 36.9s. Estimated remaining: 3h 20m 36s. Rate: 7.1 symbols/min [2025-10-16T19:12:28.747916] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-16T19:12:28.839883] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:12:28.874410] [DEBUG] [LOCAL ] GMRE: Loaded 37100 existing records from primary storage. [2025-10-16T19:12:28.874714] [INFO ] [MAIN ] GMRE: Loaded 37100 existing records. [2025-10-16T19:12:29.048366] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:12:29.048593] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-16T19:12:29.048676] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-16T19:12:29.048968] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-16T19:12:29.049025] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-16T19:12:29.423385] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:12:29.542831] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-16T19:12:29.765058] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T19:12:30.342791] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-16T19:12:30.506911] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T19:12:30.883596] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T19:12:31.142842] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-16T19:12:31.942843] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-16T19:12:32.186858] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T19:12:32.490043] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T19:12:32.742896] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-16T19:12:33.542815] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-16T19:12:33.604119] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T19:12:33.611097] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-16T19:12:33.611240] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-16T19:12:33.996544] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-16T19:12:33.996622] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-16T19:12:33.997674] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-16T19:12:33.997740] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-16T19:12:33.999169] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 54119 (keeping 200 days of data) [2025-10-16T19:12:34.327299] [DEBUG] [LOCAL ] GM: Primary data saved (54119 records). [2025-10-16T19:12:34.327474] [INFO ] [MAIN ] GM: Full history saved. [2025-10-16T19:12:34.328105] [INFO ] [MAIN ] Update Progress: 943/2369 symbols completed. GM took 39.0s. Estimated remaining: 3h 20m 23s. Rate: 7.1 symbols/min [2025-10-16T19:12:34.350146] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-16T19:12:34.526439] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:12:34.538448] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-16T19:12:34.565780] [DEBUG] [LOCAL ] GNE: Loaded 18040 existing records from primary storage. [2025-10-16T19:12:34.566034] [INFO ] [MAIN ] GNE: Loaded 18040 existing records. [2025-10-16T19:12:34.747503] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:12:34.747692] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-16T19:12:34.747749] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-16T19:12:34.747919] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-16T19:12:34.747974] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-16T19:12:35.110328] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:12:35.136310] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T19:12:35.145276] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-16T19:12:35.660546] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T19:12:35.854785] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T19:12:35.942932] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-16T19:12:36.742864] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-16T19:12:37.542787] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-16T19:12:37.647560] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T19:12:38.342844] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-16T19:12:38.353706] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-16T19:12:38.889422] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-16T19:12:39.142838] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-16T19:12:39.889607] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T19:12:39.890507] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T19:12:39.942830] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-16T19:12:40.735226] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T19:12:40.742786] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-16T19:12:41.542880] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-16T19:12:42.115713] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T19:12:42.342868] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-16T19:12:43.142877] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-16T19:12:43.696130] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T19:12:43.780703] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-16T19:12:43.902846] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T19:12:43.942823] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-16T19:12:44.742891] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-16T19:12:45.542844] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-16T19:12:46.271547] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T19:12:46.278005] [INFO ] [REMOTE ] GMED: Full fetch complete (69986 records). [2025-10-16T19:12:46.278128] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-16T19:12:46.344404] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-16T19:12:46.566381] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T19:12:46.701508] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-10-16T19:12:46.755927] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-16T19:12:46.756164] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-16T19:12:46.757234] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-16T19:12:46.757327] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-16T19:12:46.759120] [DEBUG] [LOCAL ] GMED: Trimmed 69986 records to 48602 (keeping 200 days of data) [2025-10-16T19:12:47.040174] [DEBUG] [LOCAL ] GMED: Primary data saved (48602 records). [2025-10-16T19:12:47.040321] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-16T19:12:47.040963] [INFO ] [MAIN ] Update Progress: 944/2369 symbols completed. GMED took 30.1s. Estimated remaining: 3h 20m 21s. Rate: 7.1 symbols/min [2025-10-16T19:12:47.147958] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-16T19:12:47.214141] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:12:47.255469] [DEBUG] [LOCAL ] GNK: Loaded 40065 existing records from primary storage. [2025-10-16T19:12:47.255829] [INFO ] [MAIN ] GNK: Loaded 40065 existing records. [2025-10-16T19:12:47.433561] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:12:47.433824] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-16T19:12:47.433874] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-16T19:12:47.434058] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-16T19:12:47.434096] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-16T19:12:47.805147] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:12:47.945040] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-16T19:12:47.948293] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-16T19:12:48.339953] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T19:12:48.742865] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-16T19:12:49.420470] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T19:12:49.542780] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-16T19:12:49.811471] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T19:12:50.342859] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-16T19:12:51.142828] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-16T19:12:51.843285] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T19:12:51.942774] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-16T19:12:52.071447] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T19:12:52.328748] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-10-16T19:12:52.742808] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-16T19:12:53.038338] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T19:12:53.542842] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-16T19:12:54.124608] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T19:12:54.179114] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-16T19:12:54.342808] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-16T19:12:55.142838] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-16T19:12:55.319085] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T19:12:55.321275] [INFO ] [REMOTE ] GNE: Full fetch complete (22508 records). [2025-10-16T19:12:55.321344] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-16T19:12:55.681150] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-16T19:12:55.681225] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-16T19:12:55.681744] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-16T19:12:55.681805] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-16T19:12:55.682452] [DEBUG] [LOCAL ] GNE: Trimmed 22508 records to 18130 (keeping 200 days of data) [2025-10-16T19:12:55.789701] [DEBUG] [LOCAL ] GNE: Primary data saved (18130 records). [2025-10-16T19:12:55.789838] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-16T19:12:55.789915] [INFO ] [MAIN ] Update Progress: 945/2369 symbols completed. GNE took 21.5s. Estimated remaining: 3h 20m 13s. Rate: 7.1 symbols/min [2025-10-16T19:12:55.954854] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-16T19:12:55.957536] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:12:56.004631] [DEBUG] [LOCAL ] GNL: Loaded 46728 existing records from primary storage. [2025-10-16T19:12:56.004984] [INFO ] [MAIN ] GNL: Loaded 46728 existing records. [2025-10-16T19:12:56.180146] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:12:56.180356] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-16T19:12:56.180402] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-16T19:12:56.180672] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-16T19:12:56.180729] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-16T19:12:56.540977] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:12:56.564142] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T19:12:56.742799] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-16T19:12:57.542839] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-16T19:12:58.276884] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T19:12:58.342627] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-16T19:12:58.342807] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-16T19:12:58.995014] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T19:12:59.142770] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-16T19:12:59.891237] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T19:12:59.942800] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-16T19:13:00.493637] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T19:13:00.742859] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-16T19:13:01.423323] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T19:13:01.542828] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-16T19:13:01.987300] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T19:13:02.342825] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-16T19:13:03.142865] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-16T19:13:03.563374] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T19:13:03.942827] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-16T19:13:04.180971] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-16T19:13:04.677862] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T19:13:04.742778] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-16T19:13:05.133964] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T19:13:05.542817] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-16T19:13:06.127202] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T19:13:06.131000] [INFO ] [REMOTE ] GMRE: Full fetch complete (52567 records). [2025-10-16T19:13:06.131098] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-16T19:13:06.351505] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-16T19:13:06.509241] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-16T19:13:06.509328] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-16T19:13:06.510096] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-16T19:13:06.510162] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-16T19:13:06.511298] [DEBUG] [LOCAL ] GMRE: Trimmed 52567 records to 37278 (keeping 200 days of data) [2025-10-16T19:13:06.731155] [DEBUG] [LOCAL ] GMRE: Primary data saved (37278 records). [2025-10-16T19:13:06.731883] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-16T19:13:06.731977] [INFO ] [MAIN ] Update Progress: 946/2369 symbols completed. GMRE took 38.1s. Estimated remaining: 3h 20m 8s. Rate: 7.1 symbols/min [2025-10-16T19:13:06.896598] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:13:06.938638] [DEBUG] [LOCAL ] GNRC: Loaded 45508 existing records from primary storage. [2025-10-16T19:13:06.938959] [INFO ] [MAIN ] GNRC: Loaded 45508 existing records. [2025-10-16T19:13:07.136666] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:13:07.137117] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-16T19:13:07.137245] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-16T19:13:07.137528] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-16T19:13:07.137608] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-16T19:13:07.142976] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-16T19:13:07.438351] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-16T19:13:07.682171] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:13:07.876592] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T19:13:07.942888] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-16T19:13:08.742882] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-16T19:13:09.449297] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T19:13:09.542807] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-16T19:13:09.639042] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-16T19:13:09.646480] [INFO ] [REMOTE ] GME: Full fetch complete (77923 records). [2025-10-16T19:13:09.646639] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-16T19:13:09.986763] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T19:13:10.094889] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-16T19:13:10.094995] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-16T19:13:10.096163] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-16T19:13:10.096241] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-16T19:13:10.097900] [DEBUG] [LOCAL ] GME: Trimmed 77923 records to 54171 (keeping 200 days of data) [2025-10-16T19:13:10.382334] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-16T19:13:10.434544] [DEBUG] [LOCAL ] GME: Primary data saved (54171 records). [2025-10-16T19:13:10.434706] [INFO ] [MAIN ] GME: Full history saved. [2025-10-16T19:13:10.435545] [INFO ] [MAIN ] Update Progress: 947/2369 symbols completed. GME took 56.5s. Estimated remaining: 3h 19m 53s. Rate: 7.1 symbols/min [2025-10-16T19:13:10.603763] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:13:10.614795] [DEBUG] [LOCAL ] GNT: Loaded 8426 existing records from primary storage. [2025-10-16T19:13:10.615016] [INFO ] [MAIN ] GNT: Loaded 8426 existing records. [2025-10-16T19:13:10.787488] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:13:10.787730] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-16T19:13:10.787783] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-16T19:13:10.787945] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-16T19:13:10.787999] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-16T19:13:11.136420] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:13:11.142775] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-16T19:13:11.233369] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T19:13:11.586920] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T19:13:11.593474] [INFO ] [REMOTE ] GNK: Full fetch complete (57305 records). [2025-10-16T19:13:11.593598] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-16T19:13:11.732405] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-16T19:13:11.947947] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-16T19:13:11.998710] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-16T19:13:11.998794] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-16T19:13:11.999728] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-16T19:13:11.999790] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-16T19:13:12.000992] [DEBUG] [LOCAL ] GNK: Trimmed 57305 records to 40280 (keeping 200 days of data) [2025-10-16T19:13:12.238634] [DEBUG] [LOCAL ] GNK: Primary data saved (40280 records). [2025-10-16T19:13:12.238810] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-16T19:13:12.239459] [INFO ] [MAIN ] Update Progress: 948/2369 symbols completed. GNK took 25.2s. Estimated remaining: 3h 19m 34s. Rate: 7.1 symbols/min [2025-10-16T19:13:12.403193] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:13:12.455516] [DEBUG] [LOCAL ] GNW: Loaded 51403 existing records from primary storage. [2025-10-16T19:13:12.455909] [INFO ] [MAIN ] GNW: Loaded 51403 existing records. [2025-10-16T19:13:12.629315] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:13:12.629591] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-16T19:13:12.629681] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-16T19:13:12.629908] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-16T19:13:12.629964] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-16T19:13:12.734812] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-16T19:13:12.747894] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-16T19:13:12.999960] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:13:13.542847] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-16T19:13:14.342817] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-16T19:13:14.417232] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T19:13:15.142871] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-16T19:13:15.322125] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T19:13:15.942833] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-16T19:13:15.974977] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T19:13:16.742789] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-16T19:13:16.770741] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T19:13:17.137702] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-16T19:13:17.243118] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-16T19:13:17.542794] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-16T19:13:18.342829] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-16T19:13:18.803265] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T19:13:18.804056] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-16T19:13:19.142857] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-16T19:13:19.942838] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-16T19:13:20.706921] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T19:13:20.742769] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-16T19:13:21.551989] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-16T19:13:21.559316] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T19:13:22.012223] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-16T19:13:22.342812] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-16T19:13:23.044883] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T19:13:23.142803] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-16T19:13:23.573904] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T19:13:23.942835] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-16T19:13:24.508937] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T19:13:24.742865] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-16T19:13:25.259861] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T19:13:25.265744] [INFO ] [REMOTE ] GNL: Full fetch complete (68190 records). [2025-10-16T19:13:25.265844] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-16T19:13:25.547954] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-16T19:13:25.651311] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-16T19:13:25.651387] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-16T19:13:25.652383] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-16T19:13:25.652447] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-16T19:13:25.653737] [DEBUG] [LOCAL ] GNL: Trimmed 68190 records to 47059 (keeping 200 days of data) [2025-10-16T19:13:25.926005] [DEBUG] [LOCAL ] GNL: Primary data saved (47059 records). [2025-10-16T19:13:25.926142] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-16T19:13:25.926625] [INFO ] [MAIN ] Update Progress: 949/2369 symbols completed. GNL took 30.1s. Estimated remaining: 3h 19m 34s. Rate: 7.1 symbols/min [2025-10-16T19:13:26.105957] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:13:26.148946] [DEBUG] [LOCAL ] GOF: Loaded 42604 existing records from primary storage. [2025-10-16T19:13:26.149242] [INFO ] [MAIN ] GOF: Loaded 42604 existing records. [2025-10-16T19:13:26.332223] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:13:26.340706] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T19:13:26.341174] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-16T19:13:26.343449] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-16T19:13:26.343922] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-16T19:13:26.345684] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-16T19:13:26.345872] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-16T19:13:26.476558] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T19:13:26.739226] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:13:27.142859] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-16T19:13:27.942839] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-16T19:13:28.073728] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T19:13:28.742868] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-16T19:13:28.821949] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T19:13:29.322084] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T19:13:29.542802] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-16T19:13:30.272610] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T19:13:30.342801] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-16T19:13:31.119892] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T19:13:31.142777] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-16T19:13:31.504122] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-16T19:13:31.942902] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-16T19:13:32.692178] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T19:13:32.742874] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-16T19:13:33.465846] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T19:13:33.518171] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T19:13:33.542788] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-16T19:13:34.342841] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-16T19:13:34.352286] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T19:13:35.142839] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-16T19:13:35.942830] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-16T19:13:36.005629] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T19:13:36.742806] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-16T19:13:36.814809] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T19:13:37.325348] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T19:13:37.503280] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-16T19:13:37.542801] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-16T19:13:38.169352] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T19:13:38.342807] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-16T19:13:39.142845] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-16T19:13:39.924344] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-16T19:13:39.942775] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-16T19:13:40.043783] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T19:13:40.742887] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-16T19:13:40.761124] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-16T19:13:40.763144] [INFO ] [REMOTE ] GNT: Full fetch complete (11242 records). [2025-10-16T19:13:40.763253] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-16T19:13:41.144928] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-16T19:13:41.145009] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-16T19:13:41.145354] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-16T19:13:41.145417] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-16T19:13:41.145955] [DEBUG] [LOCAL ] GNT: Trimmed 11242 records to 8541 (keeping 200 days of data) [2025-10-16T19:13:41.196512] [DEBUG] [LOCAL ] GNT: Primary data saved (8541 records). [2025-10-16T19:13:41.196683] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-16T19:13:41.196806] [INFO ] [MAIN ] Update Progress: 950/2369 symbols completed. GNT took 30.8s. Estimated remaining: 3h 19m 36s. Rate: 7.1 symbols/min [2025-10-16T19:13:41.377788] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:13:41.409247] [DEBUG] [LOCAL ] GOLF: Loaded 30944 existing records from primary storage. [2025-10-16T19:13:41.409522] [INFO ] [MAIN ] GOLF: Loaded 30944 existing records. [2025-10-16T19:13:41.557572] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-16T19:13:41.605277] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:13:41.605576] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-16T19:13:41.605627] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-16T19:13:41.605891] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-16T19:13:41.605948] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-16T19:13:41.966073] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:13:42.342805] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-16T19:13:42.453316] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T19:13:43.028153] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T19:13:43.142809] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-16T19:13:43.415384] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T19:13:43.942822] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-16T19:13:44.291596] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T19:13:44.742821] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-16T19:13:45.542786] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-16T19:13:45.684609] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T19:13:45.770056] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T19:13:46.342842] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-16T19:13:47.146871] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-16T19:13:47.152110] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T19:13:47.376539] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T19:13:47.942820] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-16T19:13:48.742790] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-16T19:13:48.979312] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-16T19:13:48.985435] [INFO ] [REMOTE ] GNRC: Full fetch complete (65713 records). [2025-10-16T19:13:48.985619] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-16T19:13:49.429903] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-16T19:13:49.430002] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-16T19:13:49.431040] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-16T19:13:49.431166] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-16T19:13:49.432813] [DEBUG] [LOCAL ] GNRC: Trimmed 65713 records to 45849 (keeping 200 days of data) [2025-10-16T19:13:49.544775] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-16T19:13:49.552570] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T19:13:49.745033] [DEBUG] [LOCAL ] GNRC: Primary data saved (45849 records). [2025-10-16T19:13:49.745175] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-16T19:13:49.745257] [INFO ] [MAIN ] Update Progress: 951/2369 symbols completed. GNRC took 43.0s. Estimated remaining: 3h 19m 27s. Rate: 7.1 symbols/min [2025-10-16T19:13:49.922544] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:13:49.964914] [DEBUG] [LOCAL ] GOOS: Loaded 44661 existing records from primary storage. [2025-10-16T19:13:49.965201] [INFO ] [MAIN ] GOOS: Loaded 44661 existing records. [2025-10-16T19:13:50.149810] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:13:50.150091] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-16T19:13:50.150212] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-16T19:13:50.150560] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-16T19:13:50.150629] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-16T19:13:50.348463] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-16T19:13:50.517892] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T19:13:50.563010] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:13:50.676814] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T19:13:51.142812] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-16T19:13:51.942826] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-16T19:13:52.169936] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T19:13:52.517996] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T19:13:52.742830] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-16T19:13:53.368005] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T19:13:53.542808] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-16T19:13:53.942829] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-16T19:13:54.342810] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-16T19:13:55.142810] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-16T19:13:55.364708] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T19:13:55.703197] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-16T19:13:55.942813] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-16T19:13:56.284172] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T19:13:56.742812] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-16T19:13:57.470347] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T19:13:57.476845] [INFO ] [REMOTE ] GOF: Full fetch complete (62389 records). [2025-10-16T19:13:57.476995] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-16T19:13:57.555204] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-16T19:13:57.935054] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-16T19:13:57.935144] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-16T19:13:57.936182] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-16T19:13:57.936246] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-16T19:13:57.937513] [DEBUG] [LOCAL ] GOF: Trimmed 62389 records to 42964 (keeping 200 days of data) [2025-10-16T19:13:58.215421] [DEBUG] [LOCAL ] GOF: Primary data saved (42964 records). [2025-10-16T19:13:58.215567] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-16T19:13:58.216097] [INFO ] [MAIN ] Update Progress: 952/2369 symbols completed. GOF took 32.3s. Estimated remaining: 3h 19m 19s. Rate: 7.1 symbols/min [2025-10-16T19:13:58.359763] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-16T19:13:58.445488] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:13:58.447964] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T19:13:58.489508] [DEBUG] [LOCAL ] GOTU: Loaded 37301 existing records from primary storage. [2025-10-16T19:13:58.489842] [INFO ] [MAIN ] GOTU: Loaded 37301 existing records. [2025-10-16T19:13:58.662301] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:13:58.662526] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-16T19:13:58.662572] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-16T19:13:58.662782] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-16T19:13:58.662861] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-16T19:13:59.019544] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:13:59.048825] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:13:59.142792] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-16T19:13:59.669071] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T19:13:59.942872] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-16T19:14:00.640433] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T19:14:00.652243] [INFO ] [REMOTE ] GNW: Full fetch complete (73880 records). [2025-10-16T19:14:00.652549] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-16T19:14:00.756291] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-16T19:14:01.141241] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-16T19:14:01.141320] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-16T19:14:01.142304] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-16T19:14:01.142370] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-16T19:14:01.143786] [DEBUG] [LOCAL ] GNW: Trimmed 73880 records to 51779 (keeping 200 days of data) [2025-10-16T19:14:01.463269] [DEBUG] [LOCAL ] GNW: Primary data saved (51779 records). [2025-10-16T19:14:01.463572] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-16T19:14:01.464219] [INFO ] [MAIN ] Update Progress: 953/2369 symbols completed. GNW took 49.2s. Estimated remaining: 3h 19m 3s. Rate: 7.1 symbols/min [2025-10-16T19:14:01.559341] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-16T19:14:01.618060] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T19:14:01.696987] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:14:01.744089] [DEBUG] [LOCAL ] GPC: Loaded 46017 existing records from primary storage. [2025-10-16T19:14:01.744442] [INFO ] [MAIN ] GPC: Loaded 46017 existing records. [2025-10-16T19:14:01.923858] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:14:01.924118] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-16T19:14:01.924167] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-16T19:14:01.924401] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-16T19:14:01.924459] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-16T19:14:02.322101] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T19:14:02.325309] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:14:02.342766] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-16T19:14:03.142791] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-16T19:14:03.215918] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T19:14:03.942796] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-16T19:14:03.972537] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T19:14:04.106409] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-16T19:14:04.742861] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-16T19:14:05.283041] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T19:14:05.477892] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-16T19:14:05.542812] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-16T19:14:06.342832] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-16T19:14:06.846590] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T19:14:06.850934] [INFO ] [REMOTE ] GOLF: Full fetch complete (45367 records). [2025-10-16T19:14:06.851057] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-16T19:14:07.148807] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-16T19:14:07.235293] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-16T19:14:07.235363] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-16T19:14:07.236085] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-16T19:14:07.236148] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-16T19:14:07.237131] [DEBUG] [LOCAL ] GOLF: Trimmed 45367 records to 31115 (keeping 200 days of data) [2025-10-16T19:14:07.423121] [DEBUG] [LOCAL ] GOLF: Primary data saved (31115 records). [2025-10-16T19:14:07.423248] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-16T19:14:07.423340] [INFO ] [MAIN ] Update Progress: 954/2369 symbols completed. GOLF took 26.2s. Estimated remaining: 3h 18m 51s. Rate: 7.1 symbols/min [2025-10-16T19:14:07.589327] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:14:07.605040] [DEBUG] [LOCAL ] GPI: Loaded 14894 existing records from primary storage. [2025-10-16T19:14:07.605258] [INFO ] [MAIN ] GPI: Loaded 14894 existing records. [2025-10-16T19:14:07.782587] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:14:07.782865] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-16T19:14:07.782938] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-16T19:14:07.783181] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-16T19:14:07.783237] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-16T19:14:07.943279] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-16T19:14:08.140920] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:14:08.166910] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T19:14:08.742786] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-16T19:14:08.799289] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T19:14:09.317100] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T19:14:09.542797] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-16T19:14:09.601078] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-16T19:14:10.342807] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-16T19:14:10.877567] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T19:14:11.142796] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-16T19:14:11.279062] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T19:14:11.942825] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-16T19:14:12.588379] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T19:14:12.742811] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-16T19:14:12.863606] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T19:14:13.542811] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-16T19:14:14.241460] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T19:14:14.342816] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-16T19:14:14.855216] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T19:14:15.142788] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-16T19:14:15.942794] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-16T19:14:16.018160] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T19:14:16.672621] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T19:14:16.727208] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-16T19:14:16.742764] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-16T19:14:17.542791] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-16T19:14:17.889071] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T19:14:18.342809] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-16T19:14:19.055754] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T19:14:19.142775] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-16T19:14:19.200833] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T19:14:19.942816] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-16T19:14:20.614346] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T19:14:20.742817] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-16T19:14:21.376811] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T19:14:21.381953] [INFO ] [REMOTE ] GOOS: Full fetch complete (64904 records). [2025-10-16T19:14:21.382056] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-16T19:14:21.555976] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-16T19:14:21.776772] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-16T19:14:21.776853] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-16T19:14:21.777757] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-16T19:14:21.777818] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-16T19:14:21.779161] [DEBUG] [LOCAL ] GOOS: Trimmed 64904 records to 44895 (keeping 200 days of data) [2025-10-16T19:14:22.038858] [DEBUG] [LOCAL ] GOOS: Primary data saved (44895 records). [2025-10-16T19:14:22.038995] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-16T19:14:22.039077] [INFO ] [MAIN ] Update Progress: 955/2369 symbols completed. GOOS took 32.3s. Estimated remaining: 3h 18m 51s. Rate: 7.1 symbols/min [2025-10-16T19:14:22.217619] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:14:22.225818] [DEBUG] [LOCAL ] GPJA: Loaded 4202 existing records from primary storage. [2025-10-16T19:14:22.226015] [INFO ] [MAIN ] GPJA: Loaded 4202 existing records. [2025-10-16T19:14:22.355202] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-16T19:14:22.446021] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:14:22.446421] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-16T19:14:22.446579] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-16T19:14:22.449291] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-16T19:14:22.449221] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T19:14:22.449407] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-16T19:14:22.767899] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T19:14:22.839477] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:14:23.142873] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-16T19:14:23.925565] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T19:14:23.942777] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-16T19:14:24.742873] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-16T19:14:24.811898] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T19:14:25.542814] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-16T19:14:25.713051] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T19:14:26.247061] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-16T19:14:26.342851] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-16T19:14:26.794071] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T19:14:27.142838] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-16T19:14:27.681323] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T19:14:27.942819] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-16T19:14:28.467515] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T19:14:28.742870] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-16T19:14:29.353598] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T19:14:29.354317] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-16T19:14:29.542823] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-16T19:14:30.342822] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-16T19:14:30.495474] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T19:14:31.142818] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-16T19:14:31.548040] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-16T19:14:31.942869] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-16T19:14:32.434747] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T19:14:32.725289] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T19:14:32.742765] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-16T19:14:33.101145] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-16T19:14:33.542814] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-16T19:14:34.126940] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T19:14:34.342810] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-16T19:14:35.142877] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-16T19:14:35.895977] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-16T19:14:35.930729] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T19:14:35.942776] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-16T19:14:36.742832] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-16T19:14:37.542860] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-16T19:14:37.557912] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T19:14:37.583565] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-16T19:14:37.591994] [INFO ] [REMOTE ] GPC: Full fetch complete (68708 records). [2025-10-16T19:14:37.592179] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-16T19:14:37.994116] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-16T19:14:37.994211] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-16T19:14:37.995144] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-16T19:14:37.995206] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-16T19:14:37.996584] [DEBUG] [LOCAL ] GPC: Trimmed 68708 records to 46350 (keeping 200 days of data) [2025-10-16T19:14:38.330313] [DEBUG] [LOCAL ] GPC: Primary data saved (46350 records). [2025-10-16T19:14:38.330482] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-16T19:14:38.330585] [INFO ] [MAIN ] Update Progress: 956/2369 symbols completed. GPC took 36.9s. Estimated remaining: 3h 18m 55s. Rate: 7.1 symbols/min [2025-10-16T19:14:38.351541] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-16T19:14:38.508193] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:14:38.557571] [DEBUG] [LOCAL ] GPK: Loaded 52775 existing records from primary storage. [2025-10-16T19:14:38.557937] [INFO ] [MAIN ] GPK: Loaded 52775 existing records. [2025-10-16T19:14:38.747249] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:14:38.747614] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-16T19:14:38.747709] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-16T19:14:38.747921] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-16T19:14:38.747977] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-16T19:14:38.949458] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T19:14:39.144502] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-16T19:14:39.157185] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T19:14:39.160506] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:14:39.942788] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-16T19:14:40.254864] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T19:14:40.257476] [INFO ] [REMOTE ] GPI: Full fetch complete (21638 records). [2025-10-16T19:14:40.257558] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-16T19:14:40.637526] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-16T19:14:40.637610] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-16T19:14:40.638127] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-16T19:14:40.638188] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-16T19:14:40.638852] [DEBUG] [LOCAL ] GPI: Trimmed 21638 records to 15026 (keeping 200 days of data) [2025-10-16T19:14:40.730923] [DEBUG] [LOCAL ] GPI: Primary data saved (15026 records). [2025-10-16T19:14:40.731068] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-16T19:14:40.731150] [INFO ] [MAIN ] Update Progress: 957/2369 symbols completed. GPI took 33.3s. Estimated remaining: 3h 18m 37s. Rate: 7.1 symbols/min [2025-10-16T19:14:40.742777] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-16T19:14:41.315203] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T19:14:41.542832] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-16T19:14:42.171715] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T19:14:42.176321] [INFO ] [REMOTE ] GOTU: Full fetch complete (58581 records). [2025-10-16T19:14:42.176463] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-16T19:14:42.349685] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-16T19:14:42.577065] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-16T19:14:42.577150] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-16T19:14:42.578104] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-16T19:14:42.578169] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-16T19:14:42.579401] [DEBUG] [LOCAL ] GOTU: Trimmed 58581 records to 37487 (keeping 200 days of data) [2025-10-16T19:14:42.800780] [DEBUG] [LOCAL ] GOTU: Primary data saved (37487 records). [2025-10-16T19:14:42.800981] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-16T19:14:42.801083] [INFO ] [MAIN ] Update Progress: 958/2369 symbols completed. GOTU took 44.6s. Estimated remaining: 3h 18m 19s. Rate: 7.1 symbols/min [2025-10-16T19:14:42.989522] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-16T19:14:43.148046] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-16T19:14:43.168717] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T19:14:43.788721] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-16T19:14:43.942853] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-16T19:14:44.336442] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-16T19:14:44.742907] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-16T19:14:45.542817] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-16T19:14:46.122050] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T19:14:46.135745] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-16T19:14:46.342809] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-16T19:14:47.025967] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T19:14:47.026907] [INFO ] [REMOTE ] GPJA: Full fetch complete (6986 records). [2025-10-16T19:14:47.026974] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-16T19:14:47.147973] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-16T19:14:47.385255] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-16T19:14:47.385353] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-16T19:14:47.385566] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-16T19:14:47.385634] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-16T19:14:47.386073] [DEBUG] [LOCAL ] GPJA: Trimmed 6986 records to 4213 (keeping 200 days of data) [2025-10-16T19:14:47.411561] [DEBUG] [LOCAL ] GPJA: Primary data saved (4213 records). [2025-10-16T19:14:47.411660] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-16T19:14:47.411751] [INFO ] [MAIN ] Update Progress: 959/2369 symbols completed. GPJA took 25.4s. Estimated remaining: 3h 18m 5s. Rate: 7.1 symbols/min [2025-10-16T19:14:48.913214] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T19:14:48.923996] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-16T19:14:50.340835] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T19:14:50.351585] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-16T19:14:52.129723] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T19:14:52.142440] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-16T19:14:53.790914] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T19:14:53.801588] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-16T19:14:55.552846] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-16T19:14:55.564808] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-16T19:14:57.340224] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T19:14:57.351915] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-16T19:14:59.039908] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T19:14:59.051455] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-16T19:15:00.842239] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T19:15:00.849115] [INFO ] [REMOTE ] GPK: Full fetch complete (75965 records). [2025-10-16T19:15:00.849251] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-16T19:15:01.292699] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-16T19:15:01.292795] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-16T19:15:01.294025] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-16T19:15:01.294093] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-16T19:15:01.295707] [DEBUG] [LOCAL ] GPK: Trimmed 75965 records to 53165 (keeping 200 days of data) [2025-10-16T19:15:01.661680] [DEBUG] [LOCAL ] GPK: Primary data saved (53165 records). [2025-10-16T19:15:01.661866] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-16T19:15:01.662427] [INFO ] [MAIN ] Update Progress: 960/2369 symbols completed. GPK took 23.3s. Estimated remaining: 3h 18m 5s. Rate: 7.1 symbols/min [2025-10-16T19:15:02.424254] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:02.448717] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:02.417702] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:02.425189] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:02.499847] [DEBUG] [LOCAL ] GPOR: Loaded 23324 existing records from primary storage. [2025-10-16T19:15:02.500562] [DEBUG] [LOCAL ] GPMT: Loaded 25932 existing records from primary storage. [2025-10-16T19:15:02.501015] [INFO ] [MAIN ] GPMT: Loaded 25932 existing records. [2025-10-16T19:15:02.501129] [INFO ] [MAIN ] GPOR: Loaded 23324 existing records. [2025-10-16T19:15:02.734249] [DEBUG] [LOCAL ] GPN: Loaded 52001 existing records from primary storage. [2025-10-16T19:15:02.748200] [DEBUG] [LOCAL ] GPRK: Loaded 39736 existing records from primary storage. [2025-10-16T19:15:02.765038] [INFO ] [MAIN ] GPN: Loaded 52001 existing records. [2025-10-16T19:15:02.780912] [INFO ] [MAIN ] GPRK: Loaded 39736 existing records. [2025-10-16T19:15:03.118637] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:03.173978] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:03.174502] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-16T19:15:03.175008] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-16T19:15:03.174832] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-16T19:15:03.185897] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-16T19:15:03.201671] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-16T19:15:03.212133] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-16T19:15:03.217378] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-16T19:15:03.246030] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-16T19:15:03.518704] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:03.464369] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:03.548246] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-16T19:15:03.556994] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-16T19:15:03.562845] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-16T19:15:03.566383] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-16T19:15:03.611533] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-16T19:15:03.642896] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-16T19:15:03.632493] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-16T19:15:03.661694] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-16T19:15:04.526760] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:04.594561] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:04.643961] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-16T19:15:04.658278] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-16T19:15:04.915284] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:04.917188] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-16T19:15:04.938204] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:04.938614] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-16T19:15:05.684233] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T19:15:05.690067] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-16T19:15:05.883553] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-16T19:15:05.891771] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-16T19:15:05.992787] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T19:15:05.998393] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-16T19:15:06.597039] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T19:15:06.607221] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-16T19:15:06.646622] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T19:15:06.651796] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-16T19:15:07.329137] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T19:15:07.335407] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-16T19:15:07.431921] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T19:15:07.440857] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-16T19:15:07.543064] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T19:15:07.547935] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-16T19:15:07.819020] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T19:15:07.828969] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-16T19:15:08.423203] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-16T19:15:08.428621] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-16T19:15:08.639444] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T19:15:08.644331] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-16T19:15:08.790346] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:15:08.798197] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-16T19:15:09.061356] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T19:15:09.072604] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-16T19:15:09.515579] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T19:15:09.523771] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-16T19:15:09.855037] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T19:15:09.862189] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-16T19:15:09.890014] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T19:15:09.898938] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-16T19:15:10.506836] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T19:15:10.519410] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-16T19:15:10.547033] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T19:15:10.555111] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-16T19:15:10.671192] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-16T19:15:11.142883] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-16T19:15:11.242071] [DEBUG] [REMOTE ] GPOR: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-16T19:15:11.242712] [WARN ] [REMOTE ] GPOR: No data returned for month 2025-05 [2025-10-16T19:15:11.242848] [FATAL] [REMOTE ] GPOR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:15:11.242998] [FATAL] [MAIN ] GPOR: Failed to fetch primary data. [2025-10-16T19:15:11.243088] [WARN ] [MAIN ] GPOR: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:15:11.243181] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-16T19:15:11.243282] [DEBUG] [LOCAL ] GPOR: No primary data file found to delete. [2025-10-16T19:15:11.243346] [INFO ] [LOCAL ] GPOR: Starting deletion of derivative data. [2025-10-16T19:15:11.243591] [DEBUG] [LOCAL ] GPOR: Deleted derivative data file. [2025-10-16T19:15:11.243749] [INFO ] [MAIN ] Update Progress: 961/2369 symbols completed. GPOR took 9.6s. Estimated remaining: 3h 17m 59s. Rate: 7.1 symbols/min [2025-10-16T19:15:11.460614] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T19:15:11.490866] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:11.522164] [DEBUG] [LOCAL ] GRBK: Loaded 27164 existing records from primary storage. [2025-10-16T19:15:11.522562] [INFO ] [MAIN ] GRBK: Loaded 27164 existing records. [2025-10-16T19:15:11.705797] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:11.706168] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-16T19:15:11.706249] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-16T19:15:11.706542] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-16T19:15:11.706619] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-16T19:15:11.875601] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T19:15:11.947952] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-16T19:15:12.110739] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:12.393051] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-16T19:15:12.742849] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-16T19:15:13.232783] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T19:15:13.542854] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-16T19:15:14.342775] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-16T19:15:14.545700] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T19:15:14.956954] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T19:15:15.142803] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-16T19:15:15.618193] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T19:15:15.942839] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-16T19:15:16.683252] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T19:15:16.742783] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-16T19:15:17.246377] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T19:15:17.542847] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-16T19:15:17.846227] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T19:15:18.342804] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-16T19:15:19.074536] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T19:15:19.142806] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-16T19:15:19.382058] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-16T19:15:19.942811] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-16T19:15:20.742820] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-16T19:15:20.954374] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T19:15:21.012753] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T19:15:21.542877] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-16T19:15:22.157128] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T19:15:22.342836] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-16T19:15:22.540462] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T19:15:23.142865] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-16T19:15:23.811017] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-16T19:15:23.937592] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T19:15:23.942781] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-16T19:15:23.943180] [INFO ] [REMOTE ] GPRK: Full fetch complete (58153 records). [2025-10-16T19:15:23.944448] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-16T19:15:24.320993] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-16T19:15:24.321071] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-16T19:15:24.321953] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-16T19:15:24.322016] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-16T19:15:24.323238] [DEBUG] [LOCAL ] GPRK: Trimmed 58153 records to 40056 (keeping 200 days of data) [2025-10-16T19:15:24.548151] [DEBUG] [LOCAL ] GPRK: Primary data saved (40056 records). [2025-10-16T19:15:24.548333] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-16T19:15:24.548756] [INFO ] [MAIN ] Update Progress: 962/2369 symbols completed. GPRK took 22.9s. Estimated remaining: 3h 17m 57s. Rate: 7.1 symbols/min [2025-10-16T19:15:24.715535] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:24.727712] [DEBUG] [LOCAL ] GRC: Loaded 9292 existing records from primary storage. [2025-10-16T19:15:24.727933] [INFO ] [MAIN ] GRC: Loaded 9292 existing records. [2025-10-16T19:15:24.748042] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-16T19:15:24.906593] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:24.906802] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-16T19:15:24.906849] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-16T19:15:24.906988] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-16T19:15:24.907025] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-16T19:15:25.266673] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:25.283383] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T19:15:25.542880] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-16T19:15:26.342850] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-16T19:15:26.363212] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-16T19:15:26.619168] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T19:15:27.142805] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-16T19:15:27.342944] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T19:15:27.904439] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T19:15:27.942822] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-16T19:15:28.742844] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-16T19:15:29.542832] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-16T19:15:29.664220] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T19:15:29.667226] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T19:15:29.680137] [INFO ] [REMOTE ] GPMT: Full fetch complete (36701 records). [2025-10-16T19:15:29.680364] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-16T19:15:30.041254] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-16T19:15:30.041364] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-16T19:15:30.042080] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-16T19:15:30.042141] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-16T19:15:30.043130] [DEBUG] [LOCAL ] GPMT: Trimmed 36701 records to 26072 (keeping 200 days of data) [2025-10-16T19:15:30.190933] [DEBUG] [LOCAL ] GPMT: Primary data saved (26072 records). [2025-10-16T19:15:30.191063] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-16T19:15:30.191141] [INFO ] [MAIN ] Update Progress: 963/2369 symbols completed. GPMT took 28.5s. Estimated remaining: 3h 17m 45s. Rate: 7.1 symbols/min [2025-10-16T19:15:30.354032] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-16T19:15:30.356622] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:30.381274] [DEBUG] [LOCAL ] GRDN: Loaded 20984 existing records from primary storage. [2025-10-16T19:15:30.381505] [INFO ] [MAIN ] GRDN: Loaded 20984 existing records. [2025-10-16T19:15:30.560681] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:30.561093] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-16T19:15:30.561224] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-16T19:15:30.561448] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-16T19:15:30.561579] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-16T19:15:30.667531] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T19:15:30.938364] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:31.101134] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T19:15:31.142790] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-16T19:15:31.942828] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-16T19:15:32.222041] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-16T19:15:32.398776] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-16T19:15:32.742814] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-16T19:15:33.542867] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-16T19:15:34.342882] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-16T19:15:34.530872] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T19:15:34.541348] [INFO ] [REMOTE ] GPN: Full fetch complete (75111 records). [2025-10-16T19:15:34.541536] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-16T19:15:34.885294] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T19:15:34.965821] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-16T19:15:34.965910] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-16T19:15:34.966899] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-16T19:15:34.966962] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-16T19:15:34.968404] [DEBUG] [LOCAL ] GPN: Trimmed 75111 records to 52372 (keeping 200 days of data) [2025-10-16T19:15:35.148258] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-16T19:15:35.209006] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-16T19:15:35.303869] [DEBUG] [LOCAL ] GPN: Primary data saved (52372 records). [2025-10-16T19:15:35.304005] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-16T19:15:35.305095] [INFO ] [MAIN ] Update Progress: 964/2369 symbols completed. GPN took 33.6s. Estimated remaining: 3h 17m 32s. Rate: 7.1 symbols/min [2025-10-16T19:15:35.499902] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:35.542508] [DEBUG] [LOCAL ] GRMN: Loaded 40425 existing records from primary storage. [2025-10-16T19:15:35.542813] [INFO ] [MAIN ] GRMN: Loaded 40425 existing records. [2025-10-16T19:15:35.721455] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:35.721732] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-16T19:15:35.721787] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-16T19:15:35.721969] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-16T19:15:35.722007] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-16T19:15:35.946032] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-16T19:15:36.093637] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:36.095342] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T19:15:36.742876] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-16T19:15:36.763517] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T19:15:37.542918] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-16T19:15:37.556073] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T19:15:38.126167] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T19:15:38.343121] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-16T19:15:38.865472] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-16T19:15:39.142930] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-16T19:15:39.942853] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-16T19:15:40.201705] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T19:15:40.691341] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T19:15:40.742847] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-16T19:15:41.542851] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-16T19:15:41.972722] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T19:15:42.342812] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-16T19:15:42.449081] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-16T19:15:43.142847] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-16T19:15:43.436941] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T19:15:43.942838] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-16T19:15:44.542240] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T19:15:44.742890] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-16T19:15:44.908289] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T19:15:44.917081] [INFO ] [REMOTE ] GRBK: Full fetch complete (40406 records). [2025-10-16T19:15:44.917397] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-16T19:15:45.461391] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-16T19:15:45.461502] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-16T19:15:45.462949] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-16T19:15:45.463018] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-16T19:15:45.464371] [DEBUG] [LOCAL ] GRBK: Trimmed 40406 records to 27274 (keeping 200 days of data) [2025-10-16T19:15:45.554437] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-16T19:15:45.632123] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T19:15:45.649186] [DEBUG] [LOCAL ] GRBK: Primary data saved (27274 records). [2025-10-16T19:15:45.649352] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-16T19:15:45.649444] [INFO ] [MAIN ] Update Progress: 965/2369 symbols completed. GRBK took 34.4s. Estimated remaining: 3h 17m 26s. Rate: 7.1 symbols/min [2025-10-16T19:15:45.821012] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:45.866515] [DEBUG] [LOCAL ] GRND: Loaded 50119 existing records from primary storage. [2025-10-16T19:15:45.866888] [INFO ] [MAIN ] GRND: Loaded 50119 existing records. [2025-10-16T19:15:46.045153] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:46.045396] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-16T19:15:46.045445] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-16T19:15:46.045633] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-16T19:15:46.045735] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-16T19:15:46.347963] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-16T19:15:46.417545] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:46.515998] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-16T19:15:47.079467] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T19:15:47.081605] [INFO ] [REMOTE ] GRC: Full fetch complete (13359 records). [2025-10-16T19:15:47.081728] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-16T19:15:47.147963] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-16T19:15:47.453057] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-16T19:15:47.453133] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-16T19:15:47.453458] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-16T19:15:47.453497] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-16T19:15:47.454030] [DEBUG] [LOCAL ] GRC: Trimmed 13359 records to 9376 (keeping 200 days of data) [2025-10-16T19:15:47.511196] [DEBUG] [LOCAL ] GRC: Primary data saved (9376 records). [2025-10-16T19:15:47.511344] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-16T19:15:47.511428] [INFO ] [MAIN ] Update Progress: 966/2369 symbols completed. GRC took 23.0s. Estimated remaining: 3h 17m 8s. Rate: 7.1 symbols/min [2025-10-16T19:15:47.706960] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:47.741314] [DEBUG] [LOCAL ] GRNT: Loaded 33966 existing records from primary storage. [2025-10-16T19:15:47.741665] [INFO ] [MAIN ] GRNT: Loaded 33966 existing records. [2025-10-16T19:15:47.944894] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-16T19:15:47.944755] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:47.946262] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-16T19:15:47.946334] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-16T19:15:47.946512] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-16T19:15:47.946552] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-16T19:15:48.311573] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:48.742848] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-16T19:15:48.789044] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T19:15:49.144209] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T19:15:49.542879] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-16T19:15:49.664930] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-16T19:15:50.342815] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-16T19:15:51.114090] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T19:15:51.142814] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-16T19:15:51.375019] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T19:15:51.942828] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-16T19:15:52.566551] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T19:15:52.742845] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-16T19:15:53.503390] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T19:15:53.542821] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-16T19:15:53.752155] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T19:15:54.342824] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-16T19:15:54.830780] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T19:15:55.142818] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-16T19:15:55.650372] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T19:15:55.942833] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-16T19:15:56.742822] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-16T19:15:56.869117] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T19:15:57.363442] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T19:15:57.542854] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-16T19:15:58.028197] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T19:15:58.342828] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-16T19:15:58.771268] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T19:15:59.142840] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-16T19:15:59.571188] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T19:15:59.942856] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-16T19:16:00.742840] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-16T19:16:00.946254] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T19:16:01.016161] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T19:16:01.542846] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-16T19:16:02.101296] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-16T19:16:02.342824] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-16T19:16:02.789895] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T19:16:03.142818] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-16T19:16:03.329917] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T19:16:03.942880] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-16T19:16:04.742859] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-16T19:16:05.054338] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-16T19:16:05.086193] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-16T19:16:05.542874] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-16T19:16:05.738822] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T19:16:05.742161] [INFO ] [REMOTE ] GRDN: Full fetch complete (26350 records). [2025-10-16T19:16:05.742279] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-16T19:16:06.111151] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-16T19:16:06.111231] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-16T19:16:06.111817] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-16T19:16:06.111880] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-16T19:16:06.112600] [DEBUG] [LOCAL ] GRDN: Trimmed 26350 records to 21092 (keeping 200 days of data) [2025-10-16T19:16:06.235845] [DEBUG] [LOCAL ] GRDN: Primary data saved (21092 records). [2025-10-16T19:16:06.236013] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-16T19:16:06.236114] [INFO ] [MAIN ] Update Progress: 967/2369 symbols completed. GRDN took 36.0s. Estimated remaining: 3h 17m 14s. Rate: 7.1 symbols/min [2025-10-16T19:16:06.348050] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-16T19:16:06.421939] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:16:06.433598] [DEBUG] [LOCAL ] GROV: Loaded 8760 existing records from primary storage. [2025-10-16T19:16:06.433881] [INFO ] [MAIN ] GROV: Loaded 8760 existing records. [2025-10-16T19:16:06.614003] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:16:06.614283] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-16T19:16:06.614340] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-16T19:16:06.614507] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-16T19:16:06.614574] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-16T19:16:06.983000] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:16:07.002608] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T19:16:07.142809] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-16T19:16:07.942783] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-16T19:16:08.055380] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T19:16:08.342514] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T19:16:08.473056] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-16T19:16:08.742837] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-16T19:16:09.542825] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-16T19:16:10.090804] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T19:16:10.219923] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T19:16:10.342868] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-16T19:16:11.142812] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-16T19:16:11.939044] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T19:16:11.942778] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-16T19:16:12.531426] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T19:16:12.704839] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T19:16:12.742798] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-16T19:16:13.542844] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-16T19:16:14.335160] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T19:16:14.343994] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-16T19:16:14.380965] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T19:16:15.142846] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-16T19:16:15.548948] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T19:16:15.644219] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-16T19:16:15.942824] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-16T19:16:16.742864] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-16T19:16:17.306898] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T19:16:17.542834] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-16T19:16:18.299247] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T19:16:18.343925] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-16T19:16:18.345827] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T19:16:19.142815] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-16T19:16:19.408301] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T19:16:19.412811] [INFO ] [REMOTE ] GRNT: Full fetch complete (48329 records). [2025-10-16T19:16:19.412937] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-16T19:16:19.797320] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-16T19:16:19.797417] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-16T19:16:19.798324] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-16T19:16:19.798391] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-16T19:16:19.799773] [DEBUG] [LOCAL ] GRNT: Trimmed 48329 records to 34222 (keeping 200 days of data) [2025-10-16T19:16:19.894973] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-16T19:16:19.957070] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-16T19:16:20.008084] [DEBUG] [LOCAL ] GRNT: Primary data saved (34222 records). [2025-10-16T19:16:20.008240] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-16T19:16:20.008323] [INFO ] [MAIN ] Update Progress: 968/2369 symbols completed. GRNT took 32.5s. Estimated remaining: 3h 17m 14s. Rate: 7.1 symbols/min [2025-10-16T19:16:20.172392] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:16:20.179015] [DEBUG] [LOCAL ] GRX: Loaded 4797 existing records from primary storage. [2025-10-16T19:16:20.179195] [INFO ] [MAIN ] GRX: Loaded 4797 existing records. [2025-10-16T19:16:20.350395] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:16:20.350638] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-16T19:16:20.350723] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-16T19:16:20.350900] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-16T19:16:20.350957] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-16T19:16:20.707966] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:16:20.742821] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-16T19:16:20.950872] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T19:16:21.542822] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-16T19:16:22.138542] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T19:16:22.206513] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-16T19:16:22.342813] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-16T19:16:22.803612] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-16T19:16:23.142815] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-16T19:16:23.688067] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T19:16:23.942816] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-16T19:16:24.591306] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T19:16:24.742823] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-16T19:16:25.542842] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-16T19:16:26.342797] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-16T19:16:26.389584] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T19:16:26.969065] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-16T19:16:26.983638] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T19:16:26.988741] [INFO ] [REMOTE ] GRMN: Full fetch complete (59704 records). [2025-10-16T19:16:26.988907] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-16T19:16:27.149003] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-16T19:16:27.376123] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-16T19:16:27.376204] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-16T19:16:27.377077] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-16T19:16:27.377141] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-16T19:16:27.378380] [DEBUG] [LOCAL ] GRMN: Trimmed 59704 records to 40670 (keeping 200 days of data) [2025-10-16T19:16:27.654495] [DEBUG] [LOCAL ] GRMN: Primary data saved (40670 records). [2025-10-16T19:16:27.654708] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-16T19:16:27.655403] [INFO ] [MAIN ] Update Progress: 969/2369 symbols completed. GRMN took 52.4s. Estimated remaining: 3h 17m 4s. Rate: 7.1 symbols/min [2025-10-16T19:16:27.771605] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-16T19:16:27.842140] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:16:27.892403] [DEBUG] [LOCAL ] GS: Loaded 51783 existing records from primary storage. [2025-10-16T19:16:27.892760] [INFO ] [MAIN ] GS: Loaded 51783 existing records. [2025-10-16T19:16:27.948006] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-16T19:16:28.076289] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:16:28.076496] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-16T19:16:28.076543] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-16T19:16:28.076808] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-16T19:16:28.076866] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-16T19:16:28.437313] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:16:28.742815] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-16T19:16:29.386806] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T19:16:29.388315] [INFO ] [REMOTE ] GROV: Full fetch complete (13955 records). [2025-10-16T19:16:29.388392] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-16T19:16:29.545247] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-16T19:16:29.799449] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-16T19:16:29.799903] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-16T19:16:29.807692] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-16T19:16:29.808361] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-16T19:16:29.808425] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-16T19:16:29.809460] [DEBUG] [LOCAL ] GROV: Trimmed 13955 records to 8795 (keeping 200 days of data) [2025-10-16T19:16:29.808984] [INFO ] [REMOTE ] GRND: Full fetch complete (71590 records). [2025-10-16T19:16:29.810203] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-16T19:16:29.938861] [DEBUG] [LOCAL ] GROV: Primary data saved (8795 records). [2025-10-16T19:16:29.945081] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-16T19:16:29.951692] [INFO ] [MAIN ] Update Progress: 970/2369 symbols completed. GROV took 23.7s. Estimated remaining: 3h 16m 47s. Rate: 7.1 symbols/min [2025-10-16T19:16:30.283390] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:16:30.254209] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-16T19:16:30.348106] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-16T19:16:30.485948] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-16T19:16:30.486027] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-16T19:16:30.486965] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-16T19:16:30.487124] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-16T19:16:30.488687] [DEBUG] [LOCAL ] GRND: Trimmed 71590 records to 50505 (keeping 200 days of data) [2025-10-16T19:16:30.559367] [DEBUG] [LOCAL ] GSBD: Loaded 39619 existing records from primary storage. [2025-10-16T19:16:30.589790] [INFO ] [MAIN ] GSBD: Loaded 39619 existing records. [2025-10-16T19:16:30.861779] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:16:30.892396] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-16T19:16:30.892727] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-16T19:16:30.898207] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-16T19:16:30.899046] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-16T19:16:30.967227] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T19:16:31.143592] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-16T19:16:31.149696] [DEBUG] [LOCAL ] GRND: Primary data saved (50505 records). [2025-10-16T19:16:31.163826] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-16T19:16:31.165051] [INFO ] [MAIN ] Update Progress: 971/2369 symbols completed. GRND took 45.5s. Estimated remaining: 3h 16m 28s. Rate: 7.1 symbols/min [2025-10-16T19:16:31.534268] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:16:31.582905] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:16:31.628862] [DEBUG] [LOCAL ] GSK: Loaded 53505 existing records from primary storage. [2025-10-16T19:16:31.629231] [INFO ] [MAIN ] GSK: Loaded 53505 existing records. [2025-10-16T19:16:31.806914] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:16:31.807165] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-16T19:16:31.807218] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-16T19:16:31.807475] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-16T19:16:31.807531] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-16T19:16:31.948027] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-16T19:16:32.158711] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:16:32.742812] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-16T19:16:33.264810] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T19:16:33.307538] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-16T19:16:33.542856] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-16T19:16:34.077154] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T19:16:34.342795] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-16T19:16:34.516777] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T19:16:35.142819] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-16T19:16:35.494139] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T19:16:35.942813] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-16T19:16:36.576981] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-16T19:16:36.742796] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-16T19:16:37.266596] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-16T19:16:37.542860] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-16T19:16:38.111268] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T19:16:38.342835] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-16T19:16:39.142788] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-16T19:16:39.573758] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-16T19:16:39.613045] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-16T19:16:39.942896] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-16T19:16:40.742824] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-16T19:16:41.006977] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T19:16:41.311838] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T19:16:41.542810] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-16T19:16:42.130501] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-16T19:16:42.342810] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-16T19:16:42.467005] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T19:16:43.066586] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T19:16:43.142841] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-16T19:16:43.942814] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-16T19:16:44.742813] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-16T19:16:44.943033] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T19:16:45.542817] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-16T19:16:45.960555] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T19:16:46.044732] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-16T19:16:46.045966] [INFO ] [REMOTE ] GRX: Full fetch complete (6527 records). [2025-10-16T19:16:46.046035] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-16T19:16:46.332233] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-16T19:16:46.343414] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-16T19:16:46.458041] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-16T19:16:46.458121] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-16T19:16:46.458298] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-16T19:16:46.458337] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-16T19:16:46.458858] [DEBUG] [LOCAL ] GRX: Trimmed 6527 records to 4828 (keeping 200 days of data) [2025-10-16T19:16:46.488197] [DEBUG] [LOCAL ] GRX: Primary data saved (4828 records). [2025-10-16T19:16:46.488353] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-16T19:16:46.488444] [INFO ] [MAIN ] Update Progress: 972/2369 symbols completed. GRX took 26.5s. Estimated remaining: 3h 16m 29s. Rate: 7.1 symbols/min [2025-10-16T19:16:46.669470] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:16:46.705768] [DEBUG] [LOCAL ] GSL: Loaded 33284 existing records from primary storage. [2025-10-16T19:16:46.706101] [INFO ] [MAIN ] GSL: Loaded 33284 existing records. [2025-10-16T19:16:46.916300] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:16:46.916513] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-16T19:16:46.916562] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-16T19:16:46.916784] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-16T19:16:46.916842] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-16T19:16:47.153366] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-16T19:16:47.309846] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:16:47.942880] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-16T19:16:48.223064] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T19:16:48.742824] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-16T19:16:49.403399] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T19:16:49.476189] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-16T19:16:49.542811] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-16T19:16:50.236217] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T19:16:50.342811] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-16T19:16:51.034383] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T19:16:51.142773] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-16T19:16:51.942800] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-16T19:16:52.033037] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T19:16:52.742842] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-16T19:16:52.956233] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T19:16:53.385306] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T19:16:53.542785] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-16T19:16:54.127353] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T19:16:54.342826] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-16T19:16:55.141986] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T19:16:55.150944] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-16T19:16:55.942848] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-16T19:16:56.251626] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-16T19:16:56.742798] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-16T19:16:57.001315] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T19:16:57.417093] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T19:16:57.542851] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-16T19:16:58.340593] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T19:16:58.351312] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-16T19:16:59.142845] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-16T19:16:59.242492] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T19:16:59.271576] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T19:16:59.942859] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-16T19:17:00.158054] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T19:17:00.742811] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-16T19:17:01.542855] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-16T19:17:01.643764] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T19:17:01.651098] [INFO ] [REMOTE ] GS: Full fetch complete (75813 records). [2025-10-16T19:17:01.651277] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-16T19:17:02.127028] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-16T19:17:02.129884] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-16T19:17:02.129793] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-16T19:17:02.131046] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-16T19:17:02.142343] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-16T19:17:02.144483] [DEBUG] [LOCAL ] GS: Trimmed 75813 records to 52170 (keeping 200 days of data) [2025-10-16T19:17:02.363338] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-16T19:17:02.478988] [DEBUG] [LOCAL ] GS: Primary data saved (52170 records). [2025-10-16T19:17:02.479138] [INFO ] [MAIN ] GS: Full history saved. [2025-10-16T19:17:02.479219] [INFO ] [MAIN ] Update Progress: 973/2369 symbols completed. GS took 34.8s. Estimated remaining: 3h 16m 32s. Rate: 7.1 symbols/min [2025-10-16T19:17:02.657259] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:17:02.703454] [DEBUG] [LOCAL ] GTES: Loaded 50380 existing records from primary storage. [2025-10-16T19:17:02.703841] [INFO ] [MAIN ] GTES: Loaded 50380 existing records. [2025-10-16T19:17:02.884846] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:17:02.885107] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-16T19:17:02.885256] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-16T19:17:02.885523] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-16T19:17:02.885734] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-16T19:17:03.077422] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-16T19:17:03.148095] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-16T19:17:03.300723] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:17:03.942810] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-16T19:17:04.003328] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T19:17:04.742802] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-16T19:17:04.796350] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T19:17:04.802397] [INFO ] [REMOTE ] GSBD: Full fetch complete (58671 records). [2025-10-16T19:17:04.802508] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-16T19:17:05.182438] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-16T19:17:05.182576] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-16T19:17:05.183511] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-16T19:17:05.183621] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-16T19:17:05.185838] [DEBUG] [LOCAL ] GSBD: Trimmed 58671 records to 39923 (keeping 200 days of data) [2025-10-16T19:17:05.215115] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T19:17:05.461285] [DEBUG] [LOCAL ] GSBD: Primary data saved (39923 records). [2025-10-16T19:17:05.461438] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-16T19:17:05.461517] [INFO ] [MAIN ] Update Progress: 974/2369 symbols completed. GSBD took 35.5s. Estimated remaining: 3h 16m 16s. Rate: 7.1 symbols/min [2025-10-16T19:17:05.549964] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-16T19:17:05.634793] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:17:05.677266] [DEBUG] [LOCAL ] GTLS: Loaded 43272 existing records from primary storage. [2025-10-16T19:17:05.677592] [INFO ] [MAIN ] GTLS: Loaded 43272 existing records. [2025-10-16T19:17:05.852010] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:17:05.852229] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-16T19:17:05.852277] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-16T19:17:05.852529] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-16T19:17:05.852586] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-16T19:17:06.197208] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:17:06.342824] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-16T19:17:06.755297] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-16T19:17:06.762290] [INFO ] [REMOTE ] GSK: Full fetch complete (77636 records). [2025-10-16T19:17:06.762416] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-16T19:17:07.143544] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-16T19:17:07.167179] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-16T19:17:07.167485] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-16T19:17:07.168495] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-16T19:17:07.168723] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-16T19:17:07.170244] [DEBUG] [LOCAL ] GSK: Trimmed 77636 records to 53895 (keeping 200 days of data) [2025-10-16T19:17:07.302684] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T19:17:07.538634] [DEBUG] [LOCAL ] GSK: Primary data saved (53895 records). [2025-10-16T19:17:07.538885] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-16T19:17:07.539147] [INFO ] [MAIN ] Update Progress: 975/2369 symbols completed. GSK took 36.4s. Estimated remaining: 3h 15m 58s. Rate: 7.1 symbols/min [2025-10-16T19:17:07.665278] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T19:17:07.744486] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:17:07.783096] [DEBUG] [LOCAL ] GTN: Loaded 45215 existing records from primary storage. [2025-10-16T19:17:07.783377] [INFO ] [MAIN ] GTN: Loaded 45215 existing records. [2025-10-16T19:17:07.944262] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-16T19:17:07.958405] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:17:07.958737] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-16T19:17:07.958811] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-16T19:17:07.959005] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-16T19:17:07.959043] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-16T19:17:08.309146] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:17:08.374511] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T19:17:08.742892] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-16T19:17:09.332413] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:17:09.542849] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-16T19:17:10.303611] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T19:17:10.342810] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-16T19:17:10.941791] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T19:17:11.142898] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-16T19:17:11.415341] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T19:17:11.942900] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-16T19:17:12.742924] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-16T19:17:12.893157] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T19:17:13.468698] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T19:17:13.542839] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-16T19:17:13.852121] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-16T19:17:14.342843] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-16T19:17:15.142818] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-16T19:17:15.337729] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T19:17:15.633385] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T19:17:15.942812] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-16T19:17:16.131337] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T19:17:16.742897] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-16T19:17:17.367630] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T19:17:17.542845] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-16T19:17:18.147092] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T19:17:18.342861] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-16T19:17:19.114049] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T19:17:19.142789] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-16T19:17:19.772046] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T19:17:19.942869] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-16T19:17:20.365490] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T19:17:20.742872] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-16T19:17:21.542843] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-16T19:17:21.584115] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T19:17:22.036890] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T19:17:22.342845] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-16T19:17:22.877053] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T19:17:23.142846] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-16T19:17:23.627595] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T19:17:23.942806] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-16T19:17:24.422026] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T19:17:24.742869] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-16T19:17:25.542799] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-16T19:17:25.668349] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T19:17:25.675171] [INFO ] [REMOTE ] GTES: Full fetch complete (73938 records). [2025-10-16T19:17:25.675289] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-16T19:17:26.070987] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-16T19:17:26.071165] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-16T19:17:26.072266] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-16T19:17:26.072376] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-16T19:17:26.073978] [DEBUG] [LOCAL ] GTES: Trimmed 73938 records to 50766 (keeping 200 days of data) [2025-10-16T19:17:26.182124] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T19:17:26.363857] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-16T19:17:26.402146] [DEBUG] [LOCAL ] GTES: Primary data saved (50766 records). [2025-10-16T19:17:26.402257] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-16T19:17:26.402775] [INFO ] [MAIN ] Update Progress: 976/2369 symbols completed. GTES took 23.9s. Estimated remaining: 3h 16m 4s. Rate: 7.1 symbols/min [2025-10-16T19:17:26.575813] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:17:26.609532] [DEBUG] [LOCAL ] GTY: Loaded 30274 existing records from primary storage. [2025-10-16T19:17:26.609872] [INFO ] [MAIN ] GTY: Loaded 30274 existing records. [2025-10-16T19:17:26.793331] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:17:26.793825] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-16T19:17:26.793907] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-16T19:17:26.794226] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-16T19:17:26.794295] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-16T19:17:26.958190] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T19:17:27.148175] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-16T19:17:27.188276] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:17:27.484611] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T19:17:27.942799] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-16T19:17:28.644493] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T19:17:28.648933] [INFO ] [REMOTE ] GSL: Full fetch complete (48316 records). [2025-10-16T19:17:28.649010] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-16T19:17:28.749896] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-16T19:17:28.976397] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T19:17:29.064866] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-16T19:17:29.064945] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-16T19:17:29.065803] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-16T19:17:29.065877] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-16T19:17:29.066888] [DEBUG] [LOCAL ] GSL: Trimmed 48316 records to 33526 (keeping 200 days of data) [2025-10-16T19:17:29.262873] [DEBUG] [LOCAL ] GSL: Primary data saved (33526 records). [2025-10-16T19:17:29.263003] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-16T19:17:29.263082] [INFO ] [MAIN ] Update Progress: 977/2369 symbols completed. GSL took 42.8s. Estimated remaining: 3h 15m 48s. Rate: 7.1 symbols/min [2025-10-16T19:17:29.427591] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:17:29.440861] [DEBUG] [LOCAL ] GUG: Loaded 12167 existing records from primary storage. [2025-10-16T19:17:29.441067] [INFO ] [MAIN ] GUG: Loaded 12167 existing records. [2025-10-16T19:17:29.548003] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-16T19:17:29.619409] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:17:29.619825] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-16T19:17:29.619879] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-16T19:17:29.620063] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-16T19:17:29.620120] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-16T19:17:29.978253] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:17:30.342828] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-16T19:17:30.404507] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T19:17:30.924139] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T19:17:30.971519] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-16T19:17:31.142790] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-16T19:17:31.942912] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-16T19:17:32.700228] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T19:17:32.742778] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-16T19:17:33.491957] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:17:33.542785] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-16T19:17:34.352504] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-16T19:17:34.358264] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T19:17:35.142842] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-16T19:17:35.206991] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T19:17:35.261633] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T19:17:35.942853] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-16T19:17:36.480356] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T19:17:36.742838] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-16T19:17:37.381943] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-16T19:17:37.425841] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-16T19:17:37.542806] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-16T19:17:38.342813] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-16T19:17:39.136068] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T19:17:39.142261] [INFO ] [REMOTE ] GTLS: Full fetch complete (61626 records). [2025-10-16T19:17:39.142562] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-16T19:17:39.142960] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-16T19:17:39.289963] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T19:17:39.552707] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-16T19:17:39.552822] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-16T19:17:39.553706] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-16T19:17:39.553766] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-16T19:17:39.555929] [DEBUG] [LOCAL ] GTLS: Trimmed 61626 records to 43612 (keeping 200 days of data) [2025-10-16T19:17:39.813832] [DEBUG] [LOCAL ] GTLS: Primary data saved (43612 records). [2025-10-16T19:17:39.813960] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-16T19:17:39.814038] [INFO ] [MAIN ] Update Progress: 978/2369 symbols completed. GTLS took 34.4s. Estimated remaining: 3h 15m 43s. Rate: 7.1 symbols/min [2025-10-16T19:17:39.952190] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-16T19:17:39.989049] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:17:39.998385] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T19:17:40.014945] [DEBUG] [LOCAL ] GUT: Loaded 15593 existing records from primary storage. [2025-10-16T19:17:40.015211] [INFO ] [MAIN ] GUT: Loaded 15593 existing records. [2025-10-16T19:17:40.192765] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:17:40.192976] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-16T19:17:40.193023] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-16T19:17:40.193405] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-16T19:17:40.193463] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-16T19:17:40.541575] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:17:40.742784] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-16T19:17:41.018719] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-16T19:17:41.542837] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-16T19:17:41.805887] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:17:42.342818] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-16T19:17:43.004403] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T19:17:43.142827] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-16T19:17:43.302254] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T19:17:43.942809] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-16T19:17:44.753703] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-16T19:17:44.760395] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T19:17:44.805403] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T19:17:45.542854] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-16T19:17:45.963766] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T19:17:46.342856] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-16T19:17:46.727101] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T19:17:46.732989] [INFO ] [REMOTE ] GTN: Full fetch complete (66129 records). [2025-10-16T19:17:46.733154] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-16T19:17:47.115618] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-16T19:17:47.115730] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-16T19:17:47.116630] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-16T19:17:47.116726] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-16T19:17:47.118087] [DEBUG] [LOCAL ] GTN: Trimmed 66129 records to 45496 (keeping 200 days of data) [2025-10-16T19:17:47.164940] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-16T19:17:47.299755] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T19:17:47.389217] [DEBUG] [LOCAL ] GTN: Primary data saved (45496 records). [2025-10-16T19:17:47.389350] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-16T19:17:47.389428] [INFO ] [MAIN ] Update Progress: 979/2369 symbols completed. GTN took 39.9s. Estimated remaining: 3h 15m 33s. Rate: 7.1 symbols/min [2025-10-16T19:17:47.554560] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:17:47.584880] [DEBUG] [LOCAL ] GVA: Loaded 32702 existing records from primary storage. [2025-10-16T19:17:47.585205] [INFO ] [MAIN ] GVA: Loaded 32702 existing records. [2025-10-16T19:17:47.760160] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:17:47.760360] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-16T19:17:47.760407] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-16T19:17:47.761073] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-16T19:17:47.761130] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-16T19:17:47.958842] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-16T19:17:48.142948] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:17:48.441235] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T19:17:48.742835] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-16T19:17:49.000975] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T19:17:49.457851] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-16T19:17:49.542795] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-16T19:17:50.342801] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-16T19:17:50.490718] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T19:17:51.142808] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-16T19:17:51.342824] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T19:17:51.942816] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-16T19:17:52.198767] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T19:17:52.742827] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-16T19:17:53.112627] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-16T19:17:53.542878] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-16T19:17:54.151754] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T19:17:54.171707] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-16T19:17:54.342832] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-16T19:17:55.142813] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-16T19:17:55.795779] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T19:17:55.942833] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-16T19:17:56.014860] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T19:17:56.719619] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T19:17:56.742790] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-16T19:17:57.542813] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-16T19:17:58.041677] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-16T19:17:58.342787] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-16T19:17:58.409276] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T19:17:59.142779] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-16T19:17:59.323605] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T19:17:59.942850] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-16T19:18:00.237533] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-16T19:18:00.742857] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-16T19:18:01.260789] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T19:18:01.265302] [INFO ] [REMOTE ] GTY: Full fetch complete (43940 records). [2025-10-16T19:18:01.265440] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-16T19:18:01.551718] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-16T19:18:01.650929] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-16T19:18:01.651012] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-16T19:18:01.651792] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-16T19:18:01.651856] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-16T19:18:01.652872] [DEBUG] [LOCAL ] GTY: Trimmed 43940 records to 30529 (keeping 200 days of data) [2025-10-16T19:18:01.839077] [DEBUG] [LOCAL ] GTY: Primary data saved (30529 records). [2025-10-16T19:18:01.839225] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-16T19:18:01.839307] [INFO ] [MAIN ] Update Progress: 980/2369 symbols completed. GTY took 35.4s. Estimated remaining: 3h 15m 33s. Rate: 7.1 symbols/min [2025-10-16T19:18:02.012266] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:18:02.030049] [DEBUG] [LOCAL ] GWH: Loaded 18636 existing records from primary storage. [2025-10-16T19:18:02.030339] [INFO ] [MAIN ] GWH: Loaded 18636 existing records. [2025-10-16T19:18:02.219096] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:18:02.219372] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-16T19:18:02.219451] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-16T19:18:02.219897] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-16T19:18:02.219954] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-16T19:18:02.344054] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-16T19:18:02.446045] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T19:18:02.649200] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:18:02.655200] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-16T19:18:03.040113] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-16T19:18:03.142805] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-16T19:18:03.942787] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-16T19:18:04.108474] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T19:18:04.742949] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-16T19:18:04.850437] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T19:18:04.852375] [INFO ] [REMOTE ] GUG: Full fetch complete (19097 records). [2025-10-16T19:18:04.852444] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-16T19:18:05.207050] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-16T19:18:05.207127] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-16T19:18:05.207534] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-16T19:18:05.207615] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-16T19:18:05.208173] [DEBUG] [LOCAL ] GUG: Trimmed 19097 records to 12217 (keeping 200 days of data) [2025-10-16T19:18:05.279919] [DEBUG] [LOCAL ] GUG: Primary data saved (12217 records). [2025-10-16T19:18:05.280052] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-16T19:18:05.280130] [INFO ] [MAIN ] Update Progress: 981/2369 symbols completed. GUG took 36.0s. Estimated remaining: 3h 15m 17s. Rate: 7.1 symbols/min [2025-10-16T19:18:05.451809] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:18:05.487967] [DEBUG] [LOCAL ] GWRE: Loaded 39928 existing records from primary storage. [2025-10-16T19:18:05.488273] [INFO ] [MAIN ] GWRE: Loaded 39928 existing records. [2025-10-16T19:18:05.549201] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-16T19:18:05.669573] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:18:05.669838] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-16T19:18:05.669888] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-16T19:18:05.670544] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-16T19:18:05.670600] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-16T19:18:05.778353] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T19:18:05.841895] [INFO ] [REMOTE ] GUT: Full fetch complete (22610 records). [2025-10-16T19:18:05.858813] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-16T19:18:06.251525] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:18:06.347356] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-16T19:18:06.458722] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-16T19:18:06.458827] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-16T19:18:06.459404] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-16T19:18:06.467615] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-16T19:18:06.468944] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T19:18:06.473029] [DEBUG] [LOCAL ] GUT: Trimmed 22610 records to 15736 (keeping 200 days of data) [2025-10-16T19:18:06.561575] [DEBUG] [LOCAL ] GUT: Primary data saved (15736 records). [2025-10-16T19:18:06.561792] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-16T19:18:06.561896] [INFO ] [MAIN ] Update Progress: 982/2369 symbols completed. GUT took 26.7s. Estimated remaining: 3h 14m 59s. Rate: 7.1 symbols/min [2025-10-16T19:18:06.726096] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:18:06.745521] [DEBUG] [LOCAL ] GWW: Loaded 19562 existing records from primary storage. [2025-10-16T19:18:06.745796] [INFO ] [MAIN ] GWW: Loaded 19562 existing records. [2025-10-16T19:18:06.919366] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:18:06.919571] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-16T19:18:06.919618] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-16T19:18:06.920248] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-16T19:18:06.920319] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-16T19:18:07.149972] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-16T19:18:07.273486] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:18:07.535173] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T19:18:07.942798] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-16T19:18:08.057903] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T19:18:08.742819] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-16T19:18:08.788993] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T19:18:09.542811] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-16T19:18:10.211453] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T19:18:10.322094] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T19:18:10.342815] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-16T19:18:11.142785] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-16T19:18:11.211491] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T19:18:11.942793] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-16T19:18:12.198045] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T19:18:12.742843] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-16T19:18:13.542859] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-16T19:18:13.752538] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T19:18:14.342799] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-16T19:18:14.498406] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-16T19:18:14.681625] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-16T19:18:15.142811] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-16T19:18:15.719683] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T19:18:15.806145] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T19:18:15.942824] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-16T19:18:16.530568] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-16T19:18:16.742853] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-16T19:18:17.542836] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-16T19:18:17.971435] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T19:18:18.342872] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-16T19:18:19.056771] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T19:18:19.076392] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T19:18:19.142782] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-16T19:18:19.942829] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-16T19:18:20.671241] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-16T19:18:20.742775] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-16T19:18:20.912922] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T19:18:21.542833] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-16T19:18:22.153968] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T19:18:22.345388] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-16T19:18:22.348673] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T19:18:23.142799] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-16T19:18:23.403681] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T19:18:23.942878] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-16T19:18:24.225856] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T19:18:24.742926] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-16T19:18:24.780181] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-16T19:18:25.542866] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-16T19:18:25.910028] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T19:18:26.342869] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-16T19:18:27.073621] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T19:18:27.120458] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T19:18:27.142784] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-16T19:18:27.942797] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-16T19:18:28.233957] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T19:18:28.742782] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-16T19:18:29.089165] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T19:18:29.542867] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-16T19:18:30.066034] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T19:18:30.071370] [INFO ] [REMOTE ] GWH: Full fetch complete (23511 records). [2025-10-16T19:18:30.071498] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-16T19:18:30.347956] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-16T19:18:30.452271] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-16T19:18:30.452368] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-16T19:18:30.452900] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-16T19:18:30.453030] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-16T19:18:30.458984] [DEBUG] [LOCAL ] GWH: Trimmed 23511 records to 19024 (keeping 200 days of data) [2025-10-16T19:18:30.468788] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T19:18:30.576399] [DEBUG] [LOCAL ] GWH: Primary data saved (19024 records). [2025-10-16T19:18:30.576529] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-16T19:18:30.576605] [INFO ] [MAIN ] Update Progress: 983/2369 symbols completed. GWH took 28.7s. Estimated remaining: 3h 15m 12s. Rate: 7.1 symbols/min [2025-10-16T19:18:30.746066] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:18:30.786700] [DEBUG] [LOCAL ] GXO: Loaded 46756 existing records from primary storage. [2025-10-16T19:18:30.786997] [INFO ] [MAIN ] GXO: Loaded 46756 existing records. [2025-10-16T19:18:30.964216] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:18:30.964406] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-16T19:18:30.964453] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-16T19:18:30.965525] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-16T19:18:30.965585] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-16T19:18:31.147676] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-16T19:18:31.329585] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:18:31.678760] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T19:18:31.942808] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-16T19:18:32.571073] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T19:18:32.742813] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-16T19:18:32.859399] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T19:18:33.542892] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-16T19:18:34.228507] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-16T19:18:34.347266] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-16T19:18:34.351108] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T19:18:34.354903] [INFO ] [REMOTE ] GWW: Full fetch complete (29149 records). [2025-10-16T19:18:34.355003] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-16T19:18:34.722052] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-16T19:18:34.722160] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-16T19:18:34.722852] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-16T19:18:34.722914] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-16T19:18:34.723677] [DEBUG] [LOCAL ] GWW: Trimmed 29149 records to 19681 (keeping 200 days of data) [2025-10-16T19:18:34.846760] [DEBUG] [LOCAL ] GWW: Primary data saved (19681 records). [2025-10-16T19:18:34.846904] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-16T19:18:34.846982] [INFO ] [MAIN ] Update Progress: 984/2369 symbols completed. GWW took 28.3s. Estimated remaining: 3h 14m 58s. Rate: 7.1 symbols/min [2025-10-16T19:18:35.012731] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:18:35.015825] [DEBUG] [LOCAL ] GYLD: Loaded 1544 existing records from primary storage. [2025-10-16T19:18:35.015967] [INFO ] [MAIN ] GYLD: Loaded 1544 existing records. [2025-10-16T19:18:35.148007] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-16T19:18:35.208741] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:18:35.208917] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-16T19:18:35.208965] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-16T19:18:35.209134] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-16T19:18:35.209190] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-16T19:18:35.554570] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:18:35.832541] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T19:18:35.942849] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-16T19:18:36.368429] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T19:18:36.742822] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-16T19:18:37.075519] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T19:18:37.542883] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-16T19:18:38.040955] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-16T19:18:38.342855] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-16T19:18:38.417675] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T19:18:39.142885] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-16T19:18:39.354289] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T19:18:39.942822] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-16T19:18:40.634457] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T19:18:40.639354] [INFO ] [REMOTE ] GWRE: Full fetch complete (60449 records). [2025-10-16T19:18:40.639461] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-16T19:18:40.752499] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-16T19:18:41.045825] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-16T19:18:41.045912] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-16T19:18:41.046817] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-16T19:18:41.046880] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-16T19:18:41.048068] [DEBUG] [LOCAL ] GWRE: Trimmed 60449 records to 40226 (keeping 200 days of data) [2025-10-16T19:18:41.320415] [DEBUG] [LOCAL ] GWRE: Primary data saved (40226 records). [2025-10-16T19:18:41.320608] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-16T19:18:41.321286] [INFO ] [MAIN ] Update Progress: 985/2369 symbols completed. GWRE took 36.0s. Estimated remaining: 3h 14m 47s. Rate: 7.1 symbols/min [2025-10-16T19:18:41.490680] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:18:41.518825] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T19:18:41.548142] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-16T19:18:41.567960] [DEBUG] [LOCAL ] H: Loaded 44421 existing records from primary storage. [2025-10-16T19:18:41.568252] [INFO ] [MAIN ] H: Loaded 44421 existing records. [2025-10-16T19:18:41.744861] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:18:41.745066] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-16T19:18:41.745114] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-16T19:18:41.746056] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-16T19:18:41.746115] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-16T19:18:42.116775] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:18:42.130221] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T19:18:42.134843] [INFO ] [REMOTE ] GVA: Full fetch complete (48438 records). [2025-10-16T19:18:42.135007] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-16T19:18:42.351573] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-16T19:18:42.525575] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-16T19:18:42.525698] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-16T19:18:42.526508] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-16T19:18:42.526553] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-16T19:18:42.527823] [DEBUG] [LOCAL ] GVA: Trimmed 48438 records to 32925 (keeping 200 days of data) [2025-10-16T19:18:42.731557] [DEBUG] [LOCAL ] GVA: Primary data saved (32925 records). [2025-10-16T19:18:42.731709] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-16T19:18:42.731810] [INFO ] [MAIN ] Update Progress: 986/2369 symbols completed. GVA took 55.3s. Estimated remaining: 3h 14m 29s. Rate: 7.1 symbols/min [2025-10-16T19:18:42.797747] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-16T19:18:42.906342] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:18:42.942298] [DEBUG] [LOCAL ] HAE: Loaded 39371 existing records from primary storage. [2025-10-16T19:18:42.942739] [INFO ] [MAIN ] HAE: Loaded 39371 existing records. [2025-10-16T19:18:43.074035] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-16T19:18:43.165143] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-16T19:18:43.170004] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:18:43.171015] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-16T19:18:43.171069] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-16T19:18:43.171449] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-16T19:18:43.171507] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-16T19:18:43.528806] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:18:43.942813] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-16T19:18:44.352283] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-16T19:18:44.576966] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T19:18:44.742816] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-16T19:18:45.542816] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-16T19:18:46.036938] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-16T19:18:46.342808] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-16T19:18:47.142846] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-16T19:18:47.267093] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T19:18:47.472798] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-16T19:18:47.782062] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T19:18:47.942810] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-16T19:18:48.742811] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-16T19:18:49.388971] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T19:18:49.542805] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-16T19:18:50.077803] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T19:18:50.342806] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-16T19:18:50.709231] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-16T19:18:51.126516] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T19:18:51.142771] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-16T19:18:51.942824] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-16T19:18:52.742833] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-16T19:18:53.120815] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-16T19:18:53.406334] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-16T19:18:53.539996] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T19:18:53.547834] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-16T19:18:54.342839] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-16T19:18:54.786045] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T19:18:55.107610] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T19:18:55.142822] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-16T19:18:55.942793] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-16T19:18:56.628505] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T19:18:56.742770] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-16T19:18:57.488903] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T19:18:57.542786] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-16T19:18:58.047047] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T19:18:58.342829] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-16T19:18:58.985583] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T19:18:59.142778] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-16T19:18:59.829259] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T19:18:59.942782] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-16T19:19:00.742803] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-16T19:19:00.788973] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T19:19:01.542863] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-16T19:19:01.783847] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T19:19:01.959242] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T19:19:02.342850] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-16T19:19:02.741248] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-16T19:19:03.142829] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-16T19:19:03.569330] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-16T19:19:03.942863] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-16T19:19:04.383491] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T19:19:04.464470] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (2.92 seconds). [2025-10-16T19:19:04.742816] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-16T19:19:05.243237] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-16T19:19:05.244245] [INFO ] [REMOTE ] GYLD: Full fetch complete (2112 records). [2025-10-16T19:19:05.244316] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-16T19:19:05.547976] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-16T19:19:05.604323] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-16T19:19:05.604399] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-16T19:19:05.604491] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-16T19:19:05.604533] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-16T19:19:05.604888] [DEBUG] [LOCAL ] GYLD: Trimmed 2112 records to 1553 (keeping 200 days of data) [2025-10-16T19:19:05.614722] [DEBUG] [LOCAL ] GYLD: Primary data saved (1553 records). [2025-10-16T19:19:05.614814] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-16T19:19:05.615319] [INFO ] [MAIN ] Update Progress: 987/2369 symbols completed. GYLD took 30.8s. Estimated remaining: 3h 14m 40s. Rate: 7.1 symbols/min [2025-10-16T19:19:05.782269] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:19:05.821300] [DEBUG] [LOCAL ] HAFN: Loaded 42943 existing records from primary storage. [2025-10-16T19:19:05.821617] [INFO ] [MAIN ] HAFN: Loaded 42943 existing records. [2025-10-16T19:19:05.998331] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:19:05.998524] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-16T19:19:05.998608] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-16T19:19:05.999239] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-16T19:19:05.999296] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-16T19:19:06.344699] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-16T19:19:06.349210] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:19:06.947593] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T19:19:07.142814] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-16T19:19:07.835352] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T19:19:07.942830] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-16T19:19:08.742853] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-16T19:19:08.955187] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T19:19:09.542823] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-16T19:19:09.896383] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-16T19:19:10.342826] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-16T19:19:10.754073] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T19:19:11.142788] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-16T19:19:11.589759] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-16T19:19:11.927915] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T19:19:11.942768] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-16T19:19:12.294411] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T19:19:12.742809] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-16T19:19:13.430677] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T19:19:13.437051] [INFO ] [REMOTE ] GXO: Full fetch complete (69596 records). [2025-10-16T19:19:13.437206] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-16T19:19:13.543766] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-16T19:19:13.696000] [DEBUG] [REMOTE ] H: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-16T19:19:13.736339] [WARN ] [REMOTE ] H: No data returned for month 2025-10 [2025-10-16T19:19:13.758001] [FATAL] [REMOTE ] H: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:19:13.779839] [FATAL] [MAIN ] H: Failed to fetch primary data. [2025-10-16T19:19:13.812003] [WARN ] [MAIN ] H: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:19:13.822190] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-16T19:19:13.840513] [DEBUG] [LOCAL ] H: No primary data file found to delete. [2025-10-16T19:19:13.842830] [INFO ] [LOCAL ] H: Starting deletion of derivative data. [2025-10-16T19:19:13.860510] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-16T19:19:13.860668] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-16T19:19:13.861919] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-16T19:19:13.862015] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-16T19:19:13.862091] [DEBUG] [LOCAL ] H: Deleted derivative data file. [2025-10-16T19:19:13.862908] [INFO ] [MAIN ] Update Progress: 988/2369 symbols completed. H took 32.5s. Estimated remaining: 3h 14m 32s. Rate: 7.1 symbols/min [2025-10-16T19:19:13.966145] [DEBUG] [LOCAL ] GXO: Trimmed 69596 records to 47088 (keeping 200 days of data) [2025-10-16T19:19:14.142679] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:19:14.343741] [DEBUG] [LOCAL ] GXO: Primary data saved (47088 records). [2025-10-16T19:19:14.342892] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-16T19:19:14.358864] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-16T19:19:14.361080] [INFO ] [MAIN ] Update Progress: 989/2369 symbols completed. GXO took 43.8s. Estimated remaining: 3h 14m 12s. Rate: 7.1 symbols/min [2025-10-16T19:19:14.360522] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-16T19:19:14.382835] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-16T19:19:14.685630] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:19:14.729751] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:19:14.730737] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-16T19:19:14.730860] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-16T19:19:14.745344] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-16T19:19:14.746608] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-16T19:19:14.746467] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-16T19:19:14.792560] [INFO ] [REMOTE ] HAE: Full fetch complete (59000 records). [2025-10-16T19:19:14.798026] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-16T19:19:15.021888] [DEBUG] [LOCAL ] HASI: Loaded 47673 existing records from primary storage. [2025-10-16T19:19:15.102111] [INFO ] [MAIN ] HASI: Loaded 47673 existing records. [2025-10-16T19:19:15.647181] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:19:15.716532] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:19:15.722261] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-16T19:19:15.727829] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-16T19:19:15.722189] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-16T19:19:15.759585] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-16T19:19:15.762505] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-16T19:19:15.854610] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-16T19:19:15.876750] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-16T19:19:15.888677] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-16T19:19:15.894831] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-16T19:19:15.989523] [DEBUG] [LOCAL ] HAE: Trimmed 59000 records to 39700 (keeping 200 days of data) [2025-10-16T19:19:16.267371] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:19:16.276333] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-16T19:19:16.406263] [DEBUG] [LOCAL ] HAE: Primary data saved (39700 records). [2025-10-16T19:19:16.407168] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-16T19:19:16.407345] [INFO ] [MAIN ] Update Progress: 990/2369 symbols completed. HAE took 33.7s. Estimated remaining: 3h 13m 55s. Rate: 7.1 symbols/min [2025-10-16T19:19:16.587200] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:19:16.631264] [DEBUG] [LOCAL ] HAYW: Loaded 48908 existing records from primary storage. [2025-10-16T19:19:16.631586] [INFO ] [MAIN ] HAYW: Loaded 48908 existing records. [2025-10-16T19:19:16.810110] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:19:16.810436] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-16T19:19:16.810618] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-16T19:19:16.811426] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-16T19:19:16.811502] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-16T19:19:17.066137] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-16T19:19:17.134847] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-16T19:19:17.215950] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:19:17.552801] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-16T19:19:17.555322] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T19:19:17.763499] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-16T19:19:18.342844] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-16T19:19:18.744402] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T19:19:18.875731] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T19:19:19.142825] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-16T19:19:19.942816] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-16T19:19:20.515177] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-16T19:19:20.742867] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-16T19:19:21.221822] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T19:19:21.542837] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-16T19:19:21.585335] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-16T19:19:22.342841] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-16T19:19:22.956300] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-16T19:19:23.142807] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-16T19:19:23.295104] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T19:19:23.730420] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:19:23.942836] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-16T19:19:24.488610] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:19:24.742822] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-16T19:19:25.550425] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-16T19:19:25.570754] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T19:19:26.333326] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T19:19:26.342798] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-16T19:19:27.088403] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T19:19:27.142828] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-16T19:19:27.942850] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-16T19:19:28.160774] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T19:19:28.347229] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-16T19:19:28.742794] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-16T19:19:29.356288] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T19:19:29.542837] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-16T19:19:30.355456] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-16T19:19:30.386367] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T19:19:31.142849] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-16T19:19:31.310327] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T19:19:31.942873] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-16T19:19:32.211520] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T19:19:32.649184] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T19:19:32.742867] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-16T19:19:33.542868] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-16T19:19:34.161584] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-16T19:19:34.239840] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T19:19:34.342790] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-16T19:19:35.142863] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-16T19:19:35.194339] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T19:19:35.844818] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T19:19:35.942822] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-16T19:19:36.445744] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T19:19:36.742856] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-16T19:19:37.542782] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-16T19:19:37.997604] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-16T19:19:38.344676] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-16T19:19:38.347488] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T19:19:38.718440] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T19:19:38.725476] [INFO ] [REMOTE ] HAFN: Full fetch complete (64940 records). [2025-10-16T19:19:38.725661] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-16T19:19:39.126534] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-16T19:19:39.126626] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-16T19:19:39.127710] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-16T19:19:39.127794] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-16T19:19:39.129103] [DEBUG] [LOCAL ] HAFN: Trimmed 64940 records to 43242 (keeping 200 days of data) [2025-10-16T19:19:39.177688] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-16T19:19:39.378227] [DEBUG] [LOCAL ] HAFN: Primary data saved (43242 records). [2025-10-16T19:19:39.378359] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-16T19:19:39.378439] [INFO ] [MAIN ] Update Progress: 991/2369 symbols completed. HAFN took 33.8s. Estimated remaining: 3h 14m 7s. Rate: 7.1 symbols/min [2025-10-16T19:19:39.545240] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:19:39.554454] [DEBUG] [LOCAL ] HBB: Loaded 6475 existing records from primary storage. [2025-10-16T19:19:39.554712] [INFO ] [MAIN ] HBB: Loaded 6475 existing records. [2025-10-16T19:19:39.726553] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:19:39.726778] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-16T19:19:39.726828] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-16T19:19:39.726965] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-16T19:19:39.727002] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-16T19:19:39.949422] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-16T19:19:40.093261] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:19:40.301055] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-16T19:19:40.709233] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T19:19:40.742767] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-16T19:19:41.286502] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T19:19:41.542813] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-16T19:19:41.916511] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T19:19:42.342808] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-16T19:19:43.142863] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-16T19:19:43.440770] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T19:19:43.942790] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-16T19:19:43.983288] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T19:19:44.578021] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T19:19:44.742850] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-16T19:19:45.542812] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-16T19:19:45.921554] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T19:19:46.070298] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T19:19:46.315035] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T19:19:46.342842] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-16T19:19:47.142823] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-16T19:19:47.942839] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-16T19:19:48.067372] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T19:19:48.074257] [INFO ] [REMOTE ] HAYW: Full fetch complete (70937 records). [2025-10-16T19:19:48.074435] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-16T19:19:48.490576] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-16T19:19:48.490758] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-16T19:19:48.492102] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-16T19:19:48.492169] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-16T19:19:48.493606] [DEBUG] [LOCAL ] HAYW: Trimmed 70937 records to 49275 (keeping 200 days of data) [2025-10-16T19:19:48.762341] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-16T19:19:48.804446] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T19:19:48.837511] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-16T19:19:48.851360] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-16T19:19:48.851051] [DEBUG] [LOCAL ] HAYW: Primary data saved (49275 records). [2025-10-16T19:19:48.851534] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-16T19:19:48.851708] [INFO ] [MAIN ] Update Progress: 992/2369 symbols completed. HAYW took 32.4s. Estimated remaining: 3h 13m 59s. Rate: 7.1 symbols/min [2025-10-16T19:19:48.882011] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T19:19:49.230971] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:19:49.372083] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T19:19:49.493761] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-16T19:19:49.493887] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-16T19:19:49.495541] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-16T19:19:49.495628] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-16T19:19:49.513317] [DEBUG] [LOCAL ] HBI: Loaded 52974 existing records from primary storage. [2025-10-16T19:19:49.513942] [INFO ] [MAIN ] HBI: Loaded 52974 existing records. [2025-10-16T19:19:49.547139] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 54108 (keeping 200 days of data) [2025-10-16T19:19:49.546700] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-16T19:19:49.843916] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:19:49.851313] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-16T19:19:49.851375] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-16T19:19:49.851774] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-16T19:19:49.851833] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-16T19:19:50.347966] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-16T19:19:50.348233] [DEBUG] [LOCAL ] HAL: Primary data saved (54108 records). [2025-10-16T19:19:50.382479] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T19:19:50.382755] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-16T19:19:50.388447] [INFO ] [MAIN ] Update Progress: 993/2369 symbols completed. HAL took 36.5s. Estimated remaining: 3h 13m 41s. Rate: 7.1 symbols/min [2025-10-16T19:19:50.619821] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:19:50.670449] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:19:50.723398] [DEBUG] [LOCAL ] HBM: Loaded 52958 existing records from primary storage. [2025-10-16T19:19:50.723973] [INFO ] [MAIN ] HBM: Loaded 52958 existing records. [2025-10-16T19:19:50.909891] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:19:50.910131] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-16T19:19:50.910182] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-16T19:19:50.911259] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-16T19:19:50.911319] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-16T19:19:51.154953] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-16T19:19:51.269958] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:19:51.942844] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-16T19:19:51.953187] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-16T19:19:52.126512] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-16T19:19:52.132920] [INFO ] [REMOTE ] HASI: Full fetch complete (68406 records). [2025-10-16T19:19:52.133072] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-16T19:19:52.520544] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-16T19:19:52.520636] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-16T19:19:52.521627] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-16T19:19:52.521716] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-16T19:19:52.523163] [DEBUG] [LOCAL ] HASI: Trimmed 68406 records to 48039 (keeping 200 days of data) [2025-10-16T19:19:52.754834] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-16T19:19:52.820959] [DEBUG] [LOCAL ] HASI: Primary data saved (48039 records). [2025-10-16T19:19:52.821100] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-16T19:19:52.821211] [INFO ] [MAIN ] Update Progress: 994/2369 symbols completed. HASI took 38.5s. Estimated remaining: 3h 13m 25s. Rate: 7.1 symbols/min [2025-10-16T19:19:52.987903] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:19:53.029600] [DEBUG] [LOCAL ] HCA: Loaded 46992 existing records from primary storage. [2025-10-16T19:19:53.029929] [INFO ] [MAIN ] HCA: Loaded 46992 existing records. [2025-10-16T19:19:53.208367] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:19:53.208694] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-16T19:19:53.208752] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-16T19:19:53.208932] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-16T19:19:53.208968] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-16T19:19:53.546400] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-16T19:19:53.568172] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:19:53.605807] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T19:19:54.111442] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T19:19:54.131192] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-16T19:19:54.342875] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-16T19:19:55.055007] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T19:19:55.142817] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-16T19:19:55.687471] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-16T19:19:55.942789] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-16T19:19:56.742814] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-16T19:19:57.542815] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-16T19:19:57.621235] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T19:19:58.136001] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T19:19:58.166132] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T19:19:58.342807] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-16T19:19:59.128935] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T19:19:59.142783] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-16T19:19:59.709051] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T19:19:59.942822] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-16T19:20:00.742818] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-16T19:20:01.542817] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-16T19:20:01.630332] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T19:20:02.218105] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T19:20:02.219282] [INFO ] [REMOTE ] HBB: Full fetch complete (9371 records). [2025-10-16T19:20:02.219359] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-16T19:20:02.343398] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-16T19:20:02.645746] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-16T19:20:02.662667] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-16T19:20:02.663786] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-16T19:20:02.664115] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-16T19:20:02.664160] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-16T19:20:02.664631] [DEBUG] [LOCAL ] HBB: Trimmed 9371 records to 6511 (keeping 200 days of data) [2025-10-16T19:20:02.705291] [DEBUG] [LOCAL ] HBB: Primary data saved (6511 records). [2025-10-16T19:20:02.705444] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-16T19:20:02.705532] [INFO ] [MAIN ] Update Progress: 995/2369 symbols completed. HBB took 23.3s. Estimated remaining: 3h 13m 18s. Rate: 7.1 symbols/min [2025-10-16T19:20:02.882958] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:20:02.926293] [DEBUG] [LOCAL ] HCC: Loaded 45241 existing records from primary storage. [2025-10-16T19:20:02.926599] [INFO ] [MAIN ] HCC: Loaded 45241 existing records. [2025-10-16T19:20:03.124048] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:20:03.124266] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-16T19:20:03.124314] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-16T19:20:03.124719] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-16T19:20:03.124777] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-16T19:20:03.147907] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-16T19:20:03.479929] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:20:03.942813] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-16T19:20:04.103791] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T19:20:04.703623] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T19:20:04.742774] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-16T19:20:05.260993] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T19:20:05.542872] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-16T19:20:06.342806] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-16T19:20:06.588352] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T19:20:07.142837] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-16T19:20:07.282251] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T19:20:07.545414] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T19:20:07.942823] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-16T19:20:08.668097] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T19:20:08.742857] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-16T19:20:09.542812] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-16T19:20:09.602247] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T19:20:10.342806] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-16T19:20:10.396777] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T19:20:11.019576] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T19:20:11.142820] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-16T19:20:11.942816] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-16T19:20:12.086703] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T19:20:12.742786] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-16T19:20:12.955619] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T19:20:13.315059] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T19:20:13.542840] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-16T19:20:14.342784] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-16T19:20:14.440625] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T19:20:15.142715] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T19:20:15.142787] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-16T19:20:15.627371] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T19:20:15.942861] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-16T19:20:16.742819] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-16T19:20:16.792281] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T19:20:17.488701] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T19:20:17.542780] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-16T19:20:18.342856] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-16T19:20:18.535089] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T19:20:19.061865] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T19:20:19.142767] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-16T19:20:19.942768] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-16T19:20:20.199766] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-16T19:20:20.742839] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-16T19:20:20.788147] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T19:20:21.532073] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T19:20:21.542800] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-16T19:20:22.342849] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-16T19:20:22.466956] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T19:20:23.011873] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T19:20:23.142813] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-16T19:20:23.804550] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T19:20:23.942779] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-16T19:20:24.719788] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T19:20:24.742770] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-16T19:20:25.542775] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-16T19:20:25.708969] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-16T19:20:25.715595] [INFO ] [REMOTE ] HBI: Full fetch complete (77034 records). [2025-10-16T19:20:25.715733] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-16T19:20:26.110392] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-16T19:20:26.110495] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-16T19:20:26.111548] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-16T19:20:26.111743] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-16T19:20:26.113314] [DEBUG] [LOCAL ] HBI: Trimmed 77034 records to 53362 (keeping 200 days of data) [2025-10-16T19:20:26.239610] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T19:20:26.343125] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-16T19:20:26.439597] [DEBUG] [LOCAL ] HBI: Primary data saved (53362 records). [2025-10-16T19:20:26.439743] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-16T19:20:26.439847] [INFO ] [MAIN ] Update Progress: 996/2369 symbols completed. HBI took 37.6s. Estimated remaining: 3h 13m 31s. Rate: 7.1 symbols/min [2025-10-16T19:20:26.612228] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:20:26.628587] [DEBUG] [LOCAL ] HCI: Loaded 14115 existing records from primary storage. [2025-10-16T19:20:26.628903] [INFO ] [MAIN ] HCI: Loaded 14115 existing records. [2025-10-16T19:20:26.833349] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:20:26.835672] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T19:20:26.834159] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-16T19:20:26.844355] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-16T19:20:26.845268] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-16T19:20:26.845347] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-16T19:20:27.147980] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-16T19:20:27.208073] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:20:27.942842] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-16T19:20:28.126541] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-16T19:20:28.132482] [INFO ] [REMOTE ] HCA: Full fetch complete (68931 records). [2025-10-16T19:20:28.132596] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-16T19:20:28.513486] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-16T19:20:28.513619] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-16T19:20:28.514889] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-16T19:20:28.515065] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-16T19:20:28.526451] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-16T19:20:28.526752] [DEBUG] [LOCAL ] HCA: Trimmed 68931 records to 47337 (keeping 200 days of data) [2025-10-16T19:20:28.621610] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T19:20:28.746673] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-16T19:20:28.859981] [DEBUG] [LOCAL ] HCA: Primary data saved (47337 records). [2025-10-16T19:20:28.860120] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-16T19:20:28.860748] [INFO ] [MAIN ] Update Progress: 997/2369 symbols completed. HCA took 36.0s. Estimated remaining: 3h 13m 14s. Rate: 7.1 symbols/min [2025-10-16T19:20:29.542816] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-16T19:20:29.655877] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T19:20:30.342824] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-16T19:20:31.062238] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-16T19:20:31.142785] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-16T19:20:31.349566] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T19:20:31.942856] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-16T19:20:32.047042] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-16T19:20:32.742829] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-16T19:20:33.305567] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T19:20:33.311734] [INFO ] [REMOTE ] HCC: Full fetch complete (64876 records). [2025-10-16T19:20:33.311955] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-16T19:20:33.567303] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-16T19:20:33.703915] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-16T19:20:33.704023] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-16T19:20:33.704961] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-16T19:20:33.705026] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-16T19:20:33.706472] [DEBUG] [LOCAL ] HCC: Trimmed 64876 records to 45525 (keeping 200 days of data) [2025-10-16T19:20:33.975952] [DEBUG] [LOCAL ] HCC: Primary data saved (45525 records). [2025-10-16T19:20:33.976101] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-16T19:20:33.976183] [INFO ] [MAIN ] Update Progress: 998/2369 symbols completed. HCC took 31.3s. Estimated remaining: 3h 13m 1s. Rate: 7.1 symbols/min [2025-10-16T19:20:34.413479] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-16T19:20:34.417461] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-16T19:20:34.584077] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T19:20:35.037780] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T19:20:35.142862] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-16T19:20:35.942828] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-16T19:20:36.828259] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T19:20:36.840105] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-16T19:20:36.954496] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T19:20:37.542806] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-16T19:20:38.294112] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T19:20:38.317267] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T19:20:38.342781] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-16T19:20:39.142928] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-16T19:20:39.248376] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T19:20:39.942821] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-16T19:20:40.864770] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T19:20:40.868473] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-16T19:20:40.960052] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T19:20:40.966964] [INFO ] [REMOTE ] HBM: Full fetch complete (76686 records). [2025-10-16T19:20:40.967094] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-16T19:20:41.358285] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-16T19:20:41.358370] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-16T19:20:41.359474] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-16T19:20:41.359539] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-16T19:20:41.360991] [DEBUG] [LOCAL ] HBM: Trimmed 76686 records to 53348 (keeping 200 days of data) [2025-10-16T19:20:41.675573] [DEBUG] [LOCAL ] HBM: Primary data saved (53348 records). [2025-10-16T19:20:41.675807] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-16T19:20:41.675925] [INFO ] [MAIN ] Update Progress: 999/2369 symbols completed. HBM took 51.3s. Estimated remaining: 3h 12m 52s. Rate: 7.1 symbols/min [2025-10-16T19:20:41.825577] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T19:20:41.828205] [INFO ] [REMOTE ] HCI: Full fetch complete (19671 records). [2025-10-16T19:20:41.828282] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-16T19:20:42.197021] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-16T19:20:42.197096] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-16T19:20:42.197513] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-16T19:20:42.197551] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-16T19:20:42.198115] [DEBUG] [LOCAL ] HCI: Trimmed 19671 records to 14289 (keeping 200 days of data) [2025-10-16T19:20:42.283468] [DEBUG] [LOCAL ] HCI: Primary data saved (14289 records). [2025-10-16T19:20:42.283599] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-16T19:20:42.283699] [INFO ] [MAIN ] Update Progress: 1000/2369 symbols completed. HCI took 15.8s. Estimated remaining: 3h 12m 32s. Rate: 7.1 symbols/min [2025-10-16T19:20:42.984340] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:20:43.027879] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-16T19:20:43.046771] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:20:43.027774] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:20:43.058336] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-16T19:20:43.098043] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:20:43.098775] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-16T19:20:43.099436] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-16T19:20:43.099733] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-16T19:20:43.099868] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-16T19:20:43.440581] [DEBUG] [LOCAL ] HDB: Loaded 51932 existing records from primary storage. [2025-10-16T19:20:43.490790] [INFO ] [MAIN ] HDB: Loaded 51932 existing records. [2025-10-16T19:20:43.521019] [DEBUG] [LOCAL ] HE: Loaded 48936 existing records from primary storage. [2025-10-16T19:20:43.529041] [INFO ] [MAIN ] HE: Loaded 48936 existing records. [2025-10-16T19:20:43.578756] [DEBUG] [LOCAL ] HD: Loaded 53492 existing records from primary storage. [2025-10-16T19:20:43.759203] [INFO ] [MAIN ] HD: Loaded 53492 existing records. [2025-10-16T19:20:43.832588] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:20:43.859298] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-16T19:20:44.174401] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:20:44.201152] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:20:44.226942] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-16T19:20:44.245152] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-16T19:20:44.245003] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-16T19:20:44.241159] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-16T19:20:44.276089] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:20:44.276451] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-16T19:20:44.276500] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-16T19:20:44.276557] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-16T19:20:44.276752] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-16T19:20:44.278720] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-16T19:20:44.276969] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-16T19:20:44.276852] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-16T19:20:44.290389] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-16T19:20:44.290519] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-16T19:20:44.284585] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-16T19:20:44.621273] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-16T19:20:44.649024] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-16T19:20:45.165867] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-16T19:20:45.292758] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-16T19:20:45.517034] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:20:45.511074] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:20:45.527739] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-16T19:20:45.546711] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-16T19:20:45.616913] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:20:45.686965] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-16T19:20:46.342808] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-16T19:20:46.548727] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-10-16T19:20:47.142845] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-16T19:20:47.369969] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-16T19:20:47.448956] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-16T19:20:47.630568] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-16T19:20:47.942805] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-16T19:20:48.219602] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-16T19:20:48.742819] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-16T19:20:49.542817] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-16T19:20:50.342790] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-16T19:20:50.507588] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-16T19:20:50.656136] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-16T19:20:51.142835] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-16T19:20:51.279583] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T19:20:51.942876] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-16T19:20:52.742887] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-16T19:20:53.053930] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-16T19:20:53.542835] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-16T19:20:53.616880] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-16T19:20:53.663409] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T19:20:54.342831] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-16T19:20:54.574100] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-16T19:20:54.985681] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T19:20:55.142850] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-16T19:20:55.942861] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-16T19:20:56.742885] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-16T19:20:56.889441] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T19:20:57.542861] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-16T19:20:58.140756] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-16T19:20:58.190593] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T19:20:58.342847] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-16T19:20:58.652024] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-16T19:20:58.652674] [INFO ] [REMOTE ] HCXY: Full fetch complete (519 records). [2025-10-16T19:20:58.652742] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-16T19:20:58.837667] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 164 unique days, need 200 days [2025-10-16T19:20:58.837957] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:20:58.838037] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:20:58.838118] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-16T19:20:58.838214] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-16T19:20:58.838267] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-16T19:20:58.838478] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-16T19:20:58.838743] [INFO ] [MAIN ] Update Progress: 1001/2369 symbols completed. HCXY took 16.6s. Estimated remaining: 3h 12m 35s. Rate: 7.1 symbols/min [2025-10-16T19:20:59.024739] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:20:59.057018] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T19:20:59.096630] [DEBUG] [LOCAL ] HEI: Loaded 31248 existing records from primary storage. [2025-10-16T19:20:59.097081] [INFO ] [MAIN ] HEI: Loaded 31248 existing records. [2025-10-16T19:20:59.151879] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-16T19:20:59.283567] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:20:59.283784] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-16T19:20:59.283833] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-16T19:20:59.284451] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-16T19:20:59.284508] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-16T19:20:59.647408] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:20:59.942829] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-16T19:21:00.742866] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-16T19:21:00.814172] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T19:21:01.542830] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-16T19:21:01.771000] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T19:21:02.345921] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-16T19:21:02.351539] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T19:21:03.142834] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-16T19:21:03.826077] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-16T19:21:03.942794] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-16T19:21:04.035789] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T19:21:04.733630] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T19:21:04.744092] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-16T19:21:05.542861] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-16T19:21:05.666432] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T19:21:06.342790] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-16T19:21:06.403935] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T19:21:07.016803] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T19:21:07.142827] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-16T19:21:07.942833] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-16T19:21:08.039693] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T19:21:08.621373] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T19:21:08.742823] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-16T19:21:09.542788] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-16T19:21:09.707058] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T19:21:10.260688] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T19:21:10.342831] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-16T19:21:11.017275] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T19:21:11.142850] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-16T19:21:11.884853] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T19:21:11.942780] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-16T19:21:12.588793] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T19:21:12.742832] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-16T19:21:13.436136] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T19:21:13.542832] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-16T19:21:14.342880] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-16T19:21:15.010358] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-16T19:21:15.061422] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T19:21:15.142829] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-16T19:21:15.867426] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T19:21:15.942804] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-16T19:21:16.602184] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T19:21:16.742820] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-16T19:21:17.459493] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T19:21:17.465736] [INFO ] [REMOTE ] HE: Full fetch complete (72227 records). [2025-10-16T19:21:17.465854] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-16T19:21:17.549008] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-16T19:21:17.872211] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-16T19:21:17.872355] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-16T19:21:17.873506] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-16T19:21:17.873622] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-16T19:21:17.875336] [DEBUG] [LOCAL ] HE: Trimmed 72227 records to 49287 (keeping 200 days of data) [2025-10-16T19:21:18.103469] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T19:21:18.191301] [DEBUG] [LOCAL ] HE: Primary data saved (49287 records). [2025-10-16T19:21:18.191433] [INFO ] [MAIN ] HE: Full history saved. [2025-10-16T19:21:18.191511] [INFO ] [MAIN ] Update Progress: 1002/2369 symbols completed. HE took 35.9s. Estimated remaining: 3h 12m 42s. Rate: 7.1 symbols/min [2025-10-16T19:21:18.343830] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-16T19:21:18.361305] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:21:18.370322] [DEBUG] [LOCAL ] HEQ: Loaded 6769 existing records from primary storage. [2025-10-16T19:21:18.370554] [INFO ] [MAIN ] HEQ: Loaded 6769 existing records. [2025-10-16T19:21:18.550526] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:21:18.550864] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-16T19:21:18.550931] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-16T19:21:18.551147] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-16T19:21:18.551186] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-16T19:21:18.907932] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:21:19.142815] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-16T19:21:19.393188] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T19:21:19.513062] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-16T19:21:19.694105] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T19:21:19.942819] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-16T19:21:20.629832] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T19:21:20.742835] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-16T19:21:21.542845] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-16T19:21:21.809582] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T19:21:22.342813] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-16T19:21:22.912756] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T19:21:23.141975] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T19:21:23.144020] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-16T19:21:23.942854] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-16T19:21:24.742834] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-16T19:21:25.144103] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T19:21:25.302943] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-16T19:21:25.542831] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-16T19:21:25.662852] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T19:21:26.342816] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-16T19:21:26.454361] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T19:21:26.457871] [INFO ] [REMOTE ] HEI: Full fetch complete (47712 records). [2025-10-16T19:21:26.457996] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-16T19:21:26.859433] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-16T19:21:26.859540] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-16T19:21:26.860471] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-16T19:21:26.860535] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-16T19:21:26.861791] [DEBUG] [LOCAL ] HEI: Trimmed 47712 records to 31397 (keeping 200 days of data) [2025-10-16T19:21:27.077963] [DEBUG] [LOCAL ] HEI: Primary data saved (31397 records). [2025-10-16T19:21:27.078080] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-16T19:21:27.078159] [INFO ] [MAIN ] Update Progress: 1003/2369 symbols completed. HEI took 28.2s. Estimated remaining: 3h 12m 34s. Rate: 7.1 symbols/min [2025-10-16T19:21:27.150235] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-16T19:21:27.244294] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:21:27.286911] [DEBUG] [LOCAL ] HESM: Loaded 48517 existing records from primary storage. [2025-10-16T19:21:27.287209] [INFO ] [MAIN ] HESM: Loaded 48517 existing records. [2025-10-16T19:21:27.463205] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:21:27.463464] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-16T19:21:27.463531] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-16T19:21:27.463939] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-16T19:21:27.464000] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-16T19:21:27.822634] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:21:27.841839] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T19:21:27.849063] [INFO ] [REMOTE ] HD: Full fetch complete (77559 records). [2025-10-16T19:21:27.849275] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-16T19:21:27.945573] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-16T19:21:28.005047] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T19:21:28.100103] [INFO ] [REMOTE ] HDB: Full fetch complete (75611 records). [2025-10-16T19:21:28.131328] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-16T19:21:28.507050] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-16T19:21:28.538700] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-16T19:21:28.568583] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-16T19:21:28.576867] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T19:21:28.582041] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-16T19:21:28.644982] [DEBUG] [LOCAL ] HD: Trimmed 77559 records to 53874 (keeping 200 days of data) [2025-10-16T19:21:28.693174] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-16T19:21:28.693287] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-16T19:21:28.694336] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-16T19:21:28.748865] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-16T19:21:28.758173] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-16T19:21:28.809219] [DEBUG] [LOCAL ] HDB: Trimmed 75611 records to 52321 (keeping 200 days of data) [2025-10-16T19:21:29.387774] [DEBUG] [LOCAL ] HD: Primary data saved (53874 records). [2025-10-16T19:21:29.404304] [DEBUG] [LOCAL ] HDB: Primary data saved (52321 records). [2025-10-16T19:21:29.404800] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-16T19:21:29.405557] [INFO ] [MAIN ] Update Progress: 1004/2369 symbols completed. HDB took 47.1s. Estimated remaining: 3h 12m 17s. Rate: 7.1 symbols/min [2025-10-16T19:21:29.404478] [INFO ] [MAIN ] HD: Full history saved. [2025-10-16T19:21:29.449702] [INFO ] [MAIN ] Update Progress: 1005/2369 symbols completed. HD took 47.2s. Estimated remaining: 3h 11m 57s. Rate: 7.1 symbols/min [2025-10-16T19:21:29.549679] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-16T19:21:29.710169] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:21:29.739079] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-16T19:21:29.750769] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-16T19:21:29.751226] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-16T19:21:29.751918] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-16T19:21:29.769965] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:21:29.768414] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-16T19:21:29.770132] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-16T19:21:29.770224] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-16T19:21:29.775439] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-16T19:21:29.812373] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-16T19:21:29.838348] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-16T19:21:29.896810] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-16T19:21:29.896984] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-16T19:21:30.255449] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-16T19:21:30.358357] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-16T19:21:30.427938] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:21:30.590895] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:21:30.621101] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T19:21:31.055335] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T19:21:31.142900] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-16T19:21:31.725413] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T19:21:31.942875] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-16T19:21:32.742870] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-16T19:21:33.201398] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-16T19:21:33.415492] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T19:21:33.542828] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-16T19:21:34.342822] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-16T19:21:35.045327] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-16T19:21:35.075084] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T19:21:35.142817] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-16T19:21:35.942871] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-16T19:21:36.723309] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T19:21:36.743591] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-16T19:21:36.744966] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T19:21:37.154569] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-16T19:21:37.542858] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-16T19:21:38.203449] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-16T19:21:38.342787] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-16T19:21:38.755308] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-16T19:21:39.142784] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-16T19:21:39.870968] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T19:21:39.942819] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-16T19:21:40.742808] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-16T19:21:40.833269] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T19:21:40.835194] [INFO ] [REMOTE ] HEQ: Full fetch complete (9632 records). [2025-10-16T19:21:40.835262] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-16T19:21:41.003682] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-10-16T19:21:41.228775] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-16T19:21:41.228865] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-16T19:21:41.229143] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-16T19:21:41.229187] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-16T19:21:41.229616] [DEBUG] [LOCAL ] HEQ: Trimmed 9632 records to 6834 (keeping 200 days of data) [2025-10-16T19:21:41.269344] [DEBUG] [LOCAL ] HEQ: Primary data saved (6834 records). [2025-10-16T19:21:41.269463] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-16T19:21:41.269548] [INFO ] [MAIN ] Update Progress: 1006/2369 symbols completed. HEQ took 23.1s. Estimated remaining: 3h 11m 53s. Rate: 7.1 symbols/min [2025-10-16T19:21:41.436460] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:21:41.452562] [DEBUG] [LOCAL ] HFRO: Loaded 16923 existing records from primary storage. [2025-10-16T19:21:41.452837] [INFO ] [MAIN ] HFRO: Loaded 16923 existing records. [2025-10-16T19:21:41.549283] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-16T19:21:41.630925] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:21:41.631119] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-16T19:21:41.631169] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-16T19:21:41.631555] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-16T19:21:41.631613] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-16T19:21:41.911970] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-16T19:21:41.988714] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:21:42.342884] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-16T19:21:42.666254] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-16T19:21:43.142884] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-16T19:21:43.359443] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-16T19:21:43.942813] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-16T19:21:44.402668] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-16T19:21:44.742793] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-16T19:21:44.992211] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-16T19:21:45.542805] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-16T19:21:45.755557] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-10-16T19:21:46.342805] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-16T19:21:47.142795] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-16T19:21:47.176464] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T19:21:47.405096] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-16T19:21:47.942825] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-16T19:21:48.742871] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-16T19:21:49.060919] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-16T19:21:49.498518] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T19:21:49.542803] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-16T19:21:50.342865] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-16T19:21:51.098204] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T19:21:51.142778] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-16T19:21:51.546174] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T19:21:51.942811] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-16T19:21:52.748528] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-16T19:21:52.755068] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T19:21:52.942057] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T19:21:53.043834] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-16T19:21:53.542816] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-16T19:21:54.342799] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-16T19:21:54.569947] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-16T19:21:54.657017] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T19:21:55.142825] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-16T19:21:55.942832] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-16T19:21:56.202790] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T19:21:56.742864] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-16T19:21:57.163482] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-16T19:21:57.542819] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-16T19:21:57.678072] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T19:21:58.303207] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T19:21:58.342831] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-16T19:21:59.142872] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-16T19:21:59.322800] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-16T19:21:59.575110] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-16T19:21:59.942817] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-16T19:22:00.175067] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-16T19:22:00.742815] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-16T19:22:01.422757] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T19:22:01.423493] [INFO ] [REMOTE ] HFND: Full fetch complete (1759 records). [2025-10-16T19:22:01.423562] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-16T19:22:01.547963] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-16T19:22:01.617213] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-16T19:22:01.617427] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:22:01.617495] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:22:01.617566] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-16T19:22:01.617631] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-16T19:22:01.617705] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-16T19:22:01.617757] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-16T19:22:01.617816] [INFO ] [MAIN ] Update Progress: 1007/2369 symbols completed. HFND took 32.1s. Estimated remaining: 3h 12m 1s. Rate: 7.1 symbols/min [2025-10-16T19:22:01.782627] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:22:01.799375] [DEBUG] [LOCAL ] HGER: Loaded 14918 existing records from primary storage. [2025-10-16T19:22:01.799614] [INFO ] [MAIN ] HGER: Loaded 14918 existing records. [2025-10-16T19:22:01.886328] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-16T19:22:02.001847] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:22:02.002086] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-16T19:22:02.002134] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-16T19:22:02.002329] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-16T19:22:02.002386] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-16T19:22:02.346891] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-16T19:22:02.349274] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:22:03.142841] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-16T19:22:03.378883] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-16T19:22:03.942881] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-16T19:22:04.003845] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T19:22:04.296881] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-16T19:22:04.297518] [INFO ] [REMOTE ] HF: Full fetch complete (440 records). [2025-10-16T19:22:04.297585] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-16T19:22:04.476189] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-16T19:22:04.476382] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:22:04.476430] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:22:04.476468] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-16T19:22:04.476523] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-16T19:22:04.476558] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-16T19:22:04.476597] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-16T19:22:04.476673] [INFO ] [MAIN ] Update Progress: 1008/2369 symbols completed. HF took 35.1s. Estimated remaining: 3h 11m 45s. Rate: 7.1 symbols/min [2025-10-16T19:22:04.649330] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:22:04.660924] [DEBUG] [LOCAL ] HGLB: Loaded 9584 existing records from primary storage. [2025-10-16T19:22:04.661162] [INFO ] [MAIN ] HGLB: Loaded 9584 existing records. [2025-10-16T19:22:04.748059] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-16T19:22:04.844166] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:22:04.844387] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-16T19:22:04.844436] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-16T19:22:04.844582] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-16T19:22:04.844623] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-16T19:22:05.194231] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:22:05.435320] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-16T19:22:05.542817] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-16T19:22:06.306639] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-16T19:22:06.342795] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-16T19:22:07.142834] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-16T19:22:07.942781] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-16T19:22:08.033529] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T19:22:08.056167] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-16T19:22:08.703880] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-16T19:22:08.742845] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-16T19:22:09.544016] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-16T19:22:09.546684] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T19:22:10.237363] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T19:22:10.342858] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-16T19:22:11.104595] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T19:22:11.142823] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-16T19:22:11.942832] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-16T19:22:11.997180] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-16T19:22:12.742849] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-16T19:22:13.542857] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-16T19:22:13.815954] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-16T19:22:13.825188] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T19:22:13.830747] [INFO ] [REMOTE ] HESM: Full fetch complete (69685 records). [2025-10-16T19:22:13.831224] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-16T19:22:14.219451] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-16T19:22:14.219541] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-16T19:22:14.220621] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-16T19:22:14.220772] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-16T19:22:14.222257] [DEBUG] [LOCAL ] HESM: Trimmed 69685 records to 48904 (keeping 200 days of data) [2025-10-16T19:22:14.344921] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-16T19:22:14.456498] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T19:22:14.529470] [DEBUG] [LOCAL ] HESM: Primary data saved (48904 records). [2025-10-16T19:22:14.529619] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-16T19:22:14.530126] [INFO ] [MAIN ] Update Progress: 1009/2369 symbols completed. HESM took 47.5s. Estimated remaining: 3h 11m 38s. Rate: 7.1 symbols/min [2025-10-16T19:22:14.706347] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:22:14.725178] [DEBUG] [LOCAL ] HGTY: Loaded 13285 existing records from primary storage. [2025-10-16T19:22:14.725450] [INFO ] [MAIN ] HGTY: Loaded 13285 existing records. [2025-10-16T19:22:14.912756] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:22:14.912926] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-16T19:22:14.912973] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-16T19:22:14.913112] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-16T19:22:14.913150] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-16T19:22:15.150937] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-16T19:22:15.277916] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:22:15.274289] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T19:22:15.280446] [INFO ] [REMOTE ] HFRO: Full fetch complete (27794 records). [2025-10-16T19:22:15.280518] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-16T19:22:15.694882] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-16T19:22:15.694959] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-16T19:22:15.695613] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-16T19:22:15.695820] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-16T19:22:15.696519] [DEBUG] [LOCAL ] HFRO: Trimmed 27794 records to 16982 (keeping 200 days of data) [2025-10-16T19:22:15.791315] [DEBUG] [LOCAL ] HFRO: Primary data saved (16982 records). [2025-10-16T19:22:15.791437] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-16T19:22:15.791517] [INFO ] [MAIN ] Update Progress: 1010/2369 symbols completed. HFRO took 34.5s. Estimated remaining: 3h 11m 20s. Rate: 7.1 symbols/min [2025-10-16T19:22:15.912446] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T19:22:15.947880] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-16T19:22:16.005457] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:22:16.044968] [DEBUG] [LOCAL ] HGV: Loaded 46390 existing records from primary storage. [2025-10-16T19:22:16.045254] [INFO ] [MAIN ] HGV: Loaded 46390 existing records. [2025-10-16T19:22:16.217291] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:22:16.217497] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-16T19:22:16.217543] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-16T19:22:16.218414] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-16T19:22:16.218472] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-16T19:22:16.566596] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:22:16.742777] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-16T19:22:16.819697] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T19:22:17.372285] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T19:22:17.542816] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-16T19:22:18.331792] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T19:22:18.342763] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-16T19:22:19.102257] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T19:22:19.142812] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-16T19:22:19.662353] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-16T19:22:19.942810] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-16T19:22:20.697460] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T19:22:20.742779] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-16T19:22:21.291929] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T19:22:21.542846] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-16T19:22:22.090794] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-16T19:22:22.342848] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-16T19:22:23.142832] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-16T19:22:23.793343] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T19:22:23.910726] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T19:22:23.942794] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-16T19:22:24.742922] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-16T19:22:25.229881] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T19:22:25.310025] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T19:22:25.542820] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-16T19:22:26.286908] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T19:22:26.342860] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-16T19:22:27.142850] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-16T19:22:27.153484] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T19:22:27.942921] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-16T19:22:27.983164] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T19:22:28.552382] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T19:22:28.742853] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-16T19:22:29.475986] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T19:22:29.542776] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-16T19:22:30.192730] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T19:22:30.342815] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-16T19:22:30.948594] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T19:22:31.142844] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-16T19:22:31.942824] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-16T19:22:32.256716] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-16T19:22:32.742838] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-16T19:22:33.319945] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T19:22:33.385713] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-16T19:22:33.542803] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-16T19:22:34.342869] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-16T19:22:35.089566] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T19:22:35.142840] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-16T19:22:35.261916] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T19:22:35.264271] [INFO ] [REMOTE ] HGTY: Full fetch complete (17530 records). [2025-10-16T19:22:35.264344] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-16T19:22:35.646276] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-16T19:22:35.646363] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-16T19:22:35.646827] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-16T19:22:35.646888] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-16T19:22:35.647404] [DEBUG] [LOCAL ] HGTY: Trimmed 17530 records to 13424 (keeping 200 days of data) [2025-10-16T19:22:35.722325] [DEBUG] [LOCAL ] HGTY: Primary data saved (13424 records). [2025-10-16T19:22:35.722457] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-16T19:22:35.722581] [INFO ] [MAIN ] Update Progress: 1011/2369 symbols completed. HGTY took 21.2s. Estimated remaining: 3h 11m 27s. Rate: 7.1 symbols/min [2025-10-16T19:22:35.888327] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:22:35.921489] [DEBUG] [LOCAL ] HHH: Loaded 33258 existing records from primary storage. [2025-10-16T19:22:35.921802] [INFO ] [MAIN ] HHH: Loaded 33258 existing records. [2025-10-16T19:22:35.953342] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-16T19:22:36.103905] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:22:36.104101] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-16T19:22:36.104149] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-16T19:22:36.104320] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-16T19:22:36.104358] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-16T19:22:36.471740] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:22:36.650276] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T19:22:36.742790] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-16T19:22:36.938721] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T19:22:37.372932] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-16T19:22:37.375240] [INFO ] [REMOTE ] HGLB: Full fetch complete (14758 records). [2025-10-16T19:22:37.375319] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-16T19:22:37.542849] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-16T19:22:37.757697] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-16T19:22:37.757791] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-16T19:22:37.758127] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-16T19:22:37.758168] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-16T19:22:37.758676] [DEBUG] [LOCAL ] HGLB: Trimmed 14758 records to 9718 (keeping 200 days of data) [2025-10-16T19:22:37.815697] [DEBUG] [LOCAL ] HGLB: Primary data saved (9718 records). [2025-10-16T19:22:37.815835] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-16T19:22:37.815914] [INFO ] [MAIN ] Update Progress: 1012/2369 symbols completed. HGLB took 33.3s. Estimated remaining: 3h 11m 10s. Rate: 7.1 symbols/min [2025-10-16T19:22:37.982848] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:22:38.017758] [DEBUG] [LOCAL ] HI: Loaded 35761 existing records from primary storage. [2025-10-16T19:22:38.018104] [INFO ] [MAIN ] HI: Loaded 35761 existing records. [2025-10-16T19:22:38.199302] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:22:38.199561] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-16T19:22:38.199613] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-16T19:22:38.199901] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-16T19:22:38.199970] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-16T19:22:38.347890] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-16T19:22:38.567530] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:22:38.576506] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T19:22:39.142778] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-16T19:22:39.734244] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-16T19:22:39.942801] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-16T19:22:40.159043] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T19:22:40.742798] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-16T19:22:41.005948] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:22:41.542848] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-16T19:22:41.831945] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T19:22:41.835578] [INFO ] [REMOTE ] HGER: Full fetch complete (18303 records). [2025-10-16T19:22:41.835675] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-16T19:22:42.218407] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-16T19:22:42.218504] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-16T19:22:42.218960] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-16T19:22:42.219020] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-16T19:22:42.219545] [DEBUG] [LOCAL ] HGER: Trimmed 18303 records to 15086 (keeping 200 days of data) [2025-10-16T19:22:42.305522] [DEBUG] [LOCAL ] HGER: Primary data saved (15086 records). [2025-10-16T19:22:42.305700] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-16T19:22:42.305820] [INFO ] [MAIN ] Update Progress: 1013/2369 symbols completed. HGER took 40.7s. Estimated remaining: 3h 10m 57s. Rate: 7.1 symbols/min [2025-10-16T19:22:42.351126] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-16T19:22:42.499791] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:22:42.552936] [DEBUG] [LOCAL ] HIG: Loaded 51192 existing records from primary storage. [2025-10-16T19:22:42.553287] [INFO ] [MAIN ] HIG: Loaded 51192 existing records. [2025-10-16T19:22:42.744211] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:22:42.744578] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-16T19:22:42.744675] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-16T19:22:42.745366] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-16T19:22:42.745424] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-16T19:22:43.037423] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T19:22:43.157043] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-16T19:22:43.162744] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:22:43.692379] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T19:22:43.942815] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-16T19:22:44.404393] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T19:22:44.742818] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-16T19:22:45.542934] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-16T19:22:45.614253] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T19:22:46.034798] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T19:22:46.342844] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-16T19:22:47.095566] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T19:22:47.142847] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-16T19:22:47.505493] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T19:22:47.942812] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-16T19:22:48.530959] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T19:22:48.742799] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-16T19:22:49.260794] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T19:22:49.542834] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-16T19:22:50.006919] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T19:22:50.342890] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-16T19:22:50.404022] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T19:22:51.142864] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-16T19:22:51.636840] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T19:22:51.942871] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-16T19:22:52.742877] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-16T19:22:53.542860] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-16T19:23:05.895972] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (12.35 seconds). [2025-10-16T19:23:05.902428] [INFO ] [REMOTE ] HGV: Full fetch complete (65995 records). [2025-10-16T19:23:05.902597] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-16T19:23:06.299132] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (13.56 seconds). [2025-10-16T19:23:06.366958] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-16T19:23:06.404803] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-16T19:23:06.405042] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-16T19:23:06.406111] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-16T19:23:06.406282] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-16T19:23:06.407793] [DEBUG] [LOCAL ] HGV: Trimmed 65995 records to 46673 (keeping 200 days of data) [2025-10-16T19:23:06.688258] [DEBUG] [LOCAL ] HGV: Primary data saved (46673 records). [2025-10-16T19:23:06.688405] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-16T19:23:06.688491] [INFO ] [MAIN ] Update Progress: 1014/2369 symbols completed. HGV took 50.9s. Estimated remaining: 3h 11m 9s. Rate: 7.1 symbols/min [2025-10-16T19:23:06.868372] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:23:06.898277] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (14.96 seconds). [2025-10-16T19:23:06.908569] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-16T19:23:06.935472] [DEBUG] [LOCAL ] HII: Loaded 33852 existing records from primary storage. [2025-10-16T19:23:06.935839] [INFO ] [MAIN ] HII: Loaded 33852 existing records. [2025-10-16T19:23:07.131208] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:23:07.131456] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-16T19:23:07.131506] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-16T19:23:07.132412] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-16T19:23:07.132473] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-16T19:23:07.546872] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:23:07.548564] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (16.41 seconds). [2025-10-16T19:23:07.549115] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-16T19:23:07.557910] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-16T19:23:08.702761] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-16T19:23:08.715892] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-16T19:23:08.818528] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-16T19:23:08.835778] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-16T19:23:09.014090] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T19:23:09.022051] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-16T19:23:09.476107] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T19:23:09.485175] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-16T19:23:09.733796] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T19:23:09.742870] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-16T19:23:10.497364] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T19:23:10.505349] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-16T19:23:10.653682] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T19:23:10.668203] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T19:23:10.682501] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-16T19:23:10.685047] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-16T19:23:10.729585] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T19:23:10.738730] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-16T19:23:11.738985] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T19:23:11.746836] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-16T19:23:11.841779] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-16T19:23:11.851033] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-16T19:23:11.962716] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T19:23:11.974245] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-16T19:23:12.096492] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T19:23:12.107446] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-16T19:23:12.698047] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T19:23:12.705902] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-16T19:23:13.324668] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T19:23:13.334612] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-16T19:23:13.371160] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T19:23:13.377949] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-16T19:23:13.418336] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T19:23:13.428832] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-16T19:23:13.846720] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T19:23:13.854702] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-16T19:23:14.429697] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T19:23:14.433815] [INFO ] [REMOTE ] HHH: Full fetch complete (45989 records). [2025-10-16T19:23:14.433912] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-16T19:23:14.806443] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-16T19:23:14.806525] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-16T19:23:14.807457] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-16T19:23:14.807520] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-16T19:23:14.808527] [DEBUG] [LOCAL ] HHH: Trimmed 45989 records to 33409 (keeping 200 days of data) [2025-10-16T19:23:15.004008] [DEBUG] [LOCAL ] HHH: Primary data saved (33409 records). [2025-10-16T19:23:15.004147] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-16T19:23:15.004228] [INFO ] [MAIN ] Update Progress: 1015/2369 symbols completed. HHH took 39.3s. Estimated remaining: 3h 11m 1s. Rate: 7.1 symbols/min [2025-10-16T19:23:15.180030] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:23:15.235855] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T19:23:15.260875] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-16T19:23:15.263231] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-16T19:23:15.264490] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-16T19:23:15.397101] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T19:23:15.427434] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-16T19:23:15.486095] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:23:15.486933] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-16T19:23:15.487039] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-16T19:23:15.487261] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-16T19:23:15.487423] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-16T19:23:15.774722] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-16T19:23:15.812527] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-16T19:23:15.885731] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:23:15.885996] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-16T19:23:16.874740] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T19:23:16.882924] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-16T19:23:16.945697] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T19:23:16.954042] [INFO ] [REMOTE ] HI: Full fetch complete (50632 records). [2025-10-16T19:23:16.954285] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-16T19:23:17.532018] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-16T19:23:17.532144] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-16T19:23:17.533326] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-16T19:23:17.533398] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-16T19:23:17.534709] [DEBUG] [LOCAL ] HI: Trimmed 50632 records to 36147 (keeping 200 days of data) [2025-10-16T19:23:17.809565] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-16T19:23:17.852417] [DEBUG] [LOCAL ] HI: Primary data saved (36147 records). [2025-10-16T19:23:17.852790] [INFO ] [MAIN ] HI: Full history saved. [2025-10-16T19:23:17.849354] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-16T19:23:17.853526] [INFO ] [MAIN ] Update Progress: 1016/2369 symbols completed. HI took 40.0s. Estimated remaining: 3h 10m 45s. Rate: 7.1 symbols/min [2025-10-16T19:23:18.063547] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:23:18.109836] [DEBUG] [LOCAL ] HIO: Loaded 24351 existing records from primary storage. [2025-10-16T19:23:18.111794] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T19:23:18.120453] [INFO ] [MAIN ] HIO: Loaded 24351 existing records. [2025-10-16T19:23:18.152473] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-16T19:23:18.301355] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:23:18.301731] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-16T19:23:18.301858] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-16T19:23:18.302077] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-16T19:23:18.302221] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-16T19:23:18.525875] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-16T19:23:18.615135] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-16T19:23:18.738431] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:23:18.738893] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-16T19:23:19.559245] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T19:23:19.570720] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-16T19:23:19.591624] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T19:23:19.867531] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T19:23:19.942789] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-16T19:23:20.405230] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T19:23:20.413099] [INFO ] [REMOTE ] HIG: Full fetch complete (73527 records). [2025-10-16T19:23:20.413273] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-16T19:23:20.769221] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-16T19:23:20.807734] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-16T19:23:20.807870] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-16T19:23:20.809105] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-16T19:23:20.809472] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-16T19:23:20.811340] [DEBUG] [LOCAL ] HIG: Trimmed 73527 records to 51580 (keeping 200 days of data) [2025-10-16T19:23:20.953145] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-16T19:23:21.217618] [DEBUG] [LOCAL ] HIG: Primary data saved (51580 records). [2025-10-16T19:23:21.217888] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-16T19:23:21.218970] [INFO ] [MAIN ] Update Progress: 1017/2369 symbols completed. HIG took 38.9s. Estimated remaining: 3h 10m 30s. Rate: 7.1 symbols/min [2025-10-16T19:23:21.285104] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T19:23:21.399354] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:23:21.424616] [DEBUG] [LOCAL ] HIPO: Loaded 21869 existing records from primary storage. [2025-10-16T19:23:21.424949] [INFO ] [MAIN ] HIPO: Loaded 21869 existing records. [2025-10-16T19:23:21.547904] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-16T19:23:21.608409] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:23:21.608764] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-16T19:23:21.608820] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-16T19:23:21.609015] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-16T19:23:21.609061] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-16T19:23:21.919566] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T19:23:22.008251] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:23:22.342845] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-16T19:23:22.829233] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T19:23:23.083928] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T19:23:23.142818] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-16T19:23:23.943082] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-16T19:23:24.114203] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T19:23:24.742867] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-16T19:23:25.542811] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-16T19:23:25.565917] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T19:23:26.039744] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-16T19:23:26.343018] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-16T19:23:27.056245] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-16T19:23:27.062187] [INFO ] [REMOTE ] HII: Full fetch complete (52536 records). [2025-10-16T19:23:27.062424] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-16T19:23:27.148253] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-16T19:23:27.468390] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-16T19:23:27.468523] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-16T19:23:27.469863] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-16T19:23:27.469944] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-16T19:23:27.471668] [DEBUG] [LOCAL ] HII: Trimmed 52536 records to 34070 (keeping 200 days of data) [2025-10-16T19:23:27.717912] [DEBUG] [LOCAL ] HII: Primary data saved (34070 records). [2025-10-16T19:23:27.718061] [INFO ] [MAIN ] HII: Full history saved. [2025-10-16T19:23:27.718192] [INFO ] [MAIN ] Update Progress: 1018/2369 symbols completed. HII took 21.0s. Estimated remaining: 3h 10m 19s. Rate: 7.1 symbols/min [2025-10-16T19:23:27.891399] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:23:27.932063] [DEBUG] [LOCAL ] HIW: Loaded 44595 existing records from primary storage. [2025-10-16T19:23:27.932363] [INFO ] [MAIN ] HIW: Loaded 44595 existing records. [2025-10-16T19:23:27.964359] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-16T19:23:28.121393] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:23:28.121621] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-16T19:23:28.121734] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-16T19:23:28.121942] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-16T19:23:28.121997] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-16T19:23:28.454622] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T19:23:28.519982] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:23:28.742823] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-16T19:23:28.864671] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-16T19:23:28.890761] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-16T19:23:29.542869] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-16T19:23:30.069384] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T19:23:30.342824] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-16T19:23:30.805156] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T19:23:31.079569] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T19:23:31.142830] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-16T19:23:31.942857] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-16T19:23:32.215190] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-16T19:23:32.742860] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-16T19:23:32.835462] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T19:23:33.542831] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-16T19:23:33.822033] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T19:23:34.342841] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-16T19:23:35.142795] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-16T19:23:35.466325] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T19:23:35.942799] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-16T19:23:36.191602] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-16T19:23:36.632893] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T19:23:36.742788] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-16T19:23:36.810115] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T19:23:37.542812] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-16T19:23:37.853608] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T19:23:38.342817] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-16T19:23:39.142826] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-16T19:23:39.910405] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T19:23:39.942771] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-16T19:23:40.229011] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-16T19:23:40.252529] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T19:23:40.742855] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-16T19:23:41.542806] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-16T19:23:41.587436] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T19:23:41.967919] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T19:23:42.342866] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-16T19:23:42.630105] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-16T19:23:43.142822] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-16T19:23:43.698068] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T19:23:43.942822] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-16T19:23:44.129165] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T19:23:44.742857] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-16T19:23:45.492765] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T19:23:45.542828] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-16T19:23:45.813113] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T19:23:46.342813] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-16T19:23:47.142817] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-16T19:23:47.635819] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-16T19:23:47.640514] [INFO ] [REMOTE ] HIO: Full fetch complete (37932 records). [2025-10-16T19:23:47.640598] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-16T19:23:47.950541] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-16T19:23:48.017692] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-16T19:23:48.018210] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-16T19:23:48.019045] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-16T19:23:48.019182] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-16T19:23:48.020167] [DEBUG] [LOCAL ] HIO: Trimmed 37932 records to 24541 (keeping 200 days of data) [2025-10-16T19:23:48.147778] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-16T19:23:48.203748] [DEBUG] [LOCAL ] HIO: Primary data saved (24541 records). [2025-10-16T19:23:48.203954] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-16T19:23:48.204055] [INFO ] [MAIN ] Update Progress: 1019/2369 symbols completed. HIO took 30.3s. Estimated remaining: 3h 10m 26s. Rate: 7.1 symbols/min [2025-10-16T19:23:48.380749] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:23:48.401394] [DEBUG] [LOCAL ] HIX: Loaded 20507 existing records from primary storage. [2025-10-16T19:23:48.401676] [INFO ] [MAIN ] HIX: Loaded 20507 existing records. [2025-10-16T19:23:48.632791] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:23:48.633108] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-16T19:23:48.633219] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-16T19:23:48.633472] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-16T19:23:48.633554] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-16T19:23:48.746612] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T19:23:48.745090] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-16T19:23:48.907245] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T19:23:48.966968] [INFO ] [REMOTE ] HIPO: Full fetch complete (31174 records). [2025-10-16T19:23:48.969289] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-16T19:23:49.183456] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:23:49.445747] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-16T19:23:49.445845] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-16T19:23:49.446553] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-16T19:23:49.446608] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-16T19:23:49.447735] [DEBUG] [LOCAL ] HIPO: Trimmed 31174 records to 21976 (keeping 200 days of data) [2025-10-16T19:23:49.559910] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-16T19:23:49.580028] [DEBUG] [LOCAL ] HIPO: Primary data saved (21976 records). [2025-10-16T19:23:49.580197] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-16T19:23:49.580309] [INFO ] [MAIN ] Update Progress: 1020/2369 symbols completed. HIPO took 28.4s. Estimated remaining: 3h 10m 8s. Rate: 7.1 symbols/min [2025-10-16T19:23:49.759948] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:23:49.780366] [DEBUG] [LOCAL ] HKD: Loaded 18657 existing records from primary storage. [2025-10-16T19:23:49.780729] [INFO ] [MAIN ] HKD: Loaded 18657 existing records. [2025-10-16T19:23:49.953733] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:23:49.953893] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-16T19:23:49.953940] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-16T19:23:49.954139] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-16T19:23:49.954208] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-16T19:23:50.298844] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:23:50.342770] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-16T19:23:50.485577] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-16T19:23:51.132113] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-16T19:23:51.143335] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-16T19:23:51.779529] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T19:23:51.901381] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T19:23:51.942789] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-16T19:23:52.742823] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-16T19:23:52.951514] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T19:23:53.542834] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-16T19:23:54.342785] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-16T19:23:54.564888] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T19:23:55.142799] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-16T19:23:55.423931] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-10-16T19:23:55.466699] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T19:23:55.868126] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T19:23:55.942775] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-16T19:23:56.742854] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-16T19:23:57.122421] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-16T19:23:57.542842] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-16T19:23:58.259781] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T19:23:58.342845] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-16T19:23:58.630579] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T19:23:59.142867] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-16T19:23:59.587822] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T19:23:59.942818] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-16T19:24:00.742789] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-16T19:24:01.079985] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T19:24:01.542801] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-16T19:24:01.897740] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-16T19:24:01.971079] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T19:24:02.342839] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-16T19:24:02.374277] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T19:24:03.142836] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-16T19:24:03.942780] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-16T19:24:04.219233] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-16T19:24:04.742791] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-16T19:24:04.980535] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.64 seconds). [2025-10-16T19:24:04.987536] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-16T19:24:04.987685] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-16T19:24:05.379881] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-16T19:24:05.380025] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-16T19:24:05.381096] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-16T19:24:05.381170] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-16T19:24:05.382594] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 54207 (keeping 200 days of data) [2025-10-16T19:24:05.508798] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T19:24:05.518096] [INFO ] [REMOTE ] HIW: Full fetch complete (64892 records). [2025-10-16T19:24:05.520716] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-16T19:24:05.609987] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-16T19:24:05.815877] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T19:24:06.150419] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-16T19:24:06.151726] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-16T19:24:06.156824] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-16T19:24:06.157444] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-16T19:24:06.165432] [DEBUG] [LOCAL ] HIMS: Primary data saved (54207 records). [2025-10-16T19:24:06.165621] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-16T19:24:06.166180] [INFO ] [MAIN ] Update Progress: 1021/2369 symbols completed. HIMS took 51.2s. Estimated remaining: 3h 10m 10s. Rate: 7.1 symbols/min [2025-10-16T19:24:06.216836] [DEBUG] [LOCAL ] HIW: Trimmed 64892 records to 44926 (keeping 200 days of data) [2025-10-16T19:24:06.344934] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-16T19:24:06.551674] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:24:06.649869] [DEBUG] [LOCAL ] HIW: Primary data saved (44926 records). [2025-10-16T19:24:06.650222] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-16T19:24:06.650380] [INFO ] [MAIN ] Update Progress: 1022/2369 symbols completed. HIW took 38.9s. Estimated remaining: 3h 9m 51s. Rate: 7.1 symbols/min [2025-10-16T19:24:06.763354] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T19:24:06.872590] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:24:06.874077] [DEBUG] [LOCAL ] HL: Loaded 53675 existing records from primary storage. [2025-10-16T19:24:06.874322] [INFO ] [MAIN ] HL: Loaded 53675 existing records. [2025-10-16T19:24:07.067744] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:24:07.068221] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-16T19:24:07.068268] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-16T19:24:07.068444] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-16T19:24:07.068481] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-16T19:24:07.148439] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-16T19:24:07.197156] [DEBUG] [LOCAL ] HLF: Loaded 48547 existing records from primary storage. [2025-10-16T19:24:07.238355] [INFO ] [MAIN ] HLF: Loaded 48547 existing records. [2025-10-16T19:24:07.586683] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T19:24:07.693474] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:24:07.688634] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:24:07.698407] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-16T19:24:07.698486] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-16T19:24:07.698930] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-16T19:24:07.698988] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-16T19:24:07.948791] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-16T19:24:08.051794] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:24:08.357437] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T19:24:08.742833] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-16T19:24:09.069734] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T19:24:09.542793] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-16T19:24:09.856263] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T19:24:10.342805] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-16T19:24:11.142835] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-16T19:24:11.407037] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T19:24:11.409861] [INFO ] [REMOTE ] HIX: Full fetch complete (30014 records). [2025-10-16T19:24:11.409945] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-16T19:24:11.551393] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-16T19:24:11.834339] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-16T19:24:11.834426] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-16T19:24:11.835038] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-16T19:24:11.835099] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-16T19:24:11.835951] [DEBUG] [LOCAL ] HIX: Trimmed 30014 records to 20590 (keeping 200 days of data) [2025-10-16T19:24:11.942992] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-16T19:24:11.956915] [DEBUG] [LOCAL ] HIX: Primary data saved (20590 records). [2025-10-16T19:24:11.957121] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-16T19:24:11.957214] [INFO ] [MAIN ] Update Progress: 1023/2369 symbols completed. HIX took 23.8s. Estimated remaining: 3h 9m 39s. Rate: 7.1 symbols/min [2025-10-16T19:24:12.122357] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:24:12.151869] [DEBUG] [LOCAL ] HLI: Loaded 30847 existing records from primary storage. [2025-10-16T19:24:12.152131] [INFO ] [MAIN ] HLI: Loaded 30847 existing records. [2025-10-16T19:24:12.326274] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:24:12.326472] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-16T19:24:12.326519] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-16T19:24:12.327257] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-16T19:24:12.327314] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-16T19:24:12.681573] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:24:12.730027] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T19:24:12.742770] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-16T19:24:13.542785] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-16T19:24:13.600452] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T19:24:14.348977] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-16T19:24:14.351564] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T19:24:14.358691] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T19:24:15.142814] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-16T19:24:15.523191] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T19:24:15.942817] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-16T19:24:16.166439] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T19:24:16.742814] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-16T19:24:17.539037] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T19:24:17.548053] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-16T19:24:17.953111] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T19:24:17.956323] [INFO ] [REMOTE ] HKD: Full fetch complete (28251 records). [2025-10-16T19:24:17.956409] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-16T19:24:18.329909] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-16T19:24:18.329985] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-16T19:24:18.330547] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-16T19:24:18.330586] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-16T19:24:18.331254] [DEBUG] [LOCAL ] HKD: Trimmed 28251 records to 18776 (keeping 200 days of data) [2025-10-16T19:24:18.373382] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-16T19:24:18.437956] [DEBUG] [LOCAL ] HKD: Primary data saved (18776 records). [2025-10-16T19:24:18.438077] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-16T19:24:18.438151] [INFO ] [MAIN ] Update Progress: 1024/2369 symbols completed. HKD took 28.9s. Estimated remaining: 3h 9m 28s. Rate: 7.1 symbols/min [2025-10-16T19:24:18.608042] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:24:18.637230] [DEBUG] [LOCAL ] HLIO: Loaded 28238 existing records from primary storage. [2025-10-16T19:24:18.637511] [INFO ] [MAIN ] HLIO: Loaded 28238 existing records. [2025-10-16T19:24:18.815224] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:24:18.815712] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-16T19:24:18.815875] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-16T19:24:18.816159] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-16T19:24:18.816324] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-16T19:24:18.974395] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T19:24:19.147954] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-16T19:24:19.223083] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:24:19.707568] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T19:24:19.942807] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-16T19:24:20.080893] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T19:24:20.574948] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-16T19:24:20.742876] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-16T19:24:21.542825] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-16T19:24:22.342789] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-16T19:24:22.553557] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T19:24:22.757115] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-16T19:24:23.142913] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-16T19:24:23.942877] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-16T19:24:24.034862] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T19:24:24.742796] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-16T19:24:24.897336] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T19:24:25.087100] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-16T19:24:25.542884] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-16T19:24:25.866049] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T19:24:26.342909] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-16T19:24:27.113391] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T19:24:27.142822] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-16T19:24:27.706261] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T19:24:27.942845] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-16T19:24:28.683207] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T19:24:28.742833] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-16T19:24:29.542846] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-16T19:24:29.938125] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T19:24:30.342843] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-16T19:24:30.483467] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T19:24:30.538958] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-16T19:24:31.142834] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-16T19:24:31.942832] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-16T19:24:32.142280] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T19:24:32.399325] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-16T19:24:32.742883] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-16T19:24:33.542883] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-16T19:24:33.585199] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T19:24:33.753536] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T19:24:34.342836] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-16T19:24:35.142860] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-16T19:24:35.462635] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T19:24:35.662729] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T19:24:35.942823] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-16T19:24:36.414758] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T19:24:36.742815] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-16T19:24:37.542784] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-16T19:24:38.010259] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-16T19:24:38.061616] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T19:24:38.342809] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-16T19:24:38.590852] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T19:24:39.142844] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-16T19:24:39.743016] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T19:24:39.942816] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-16T19:24:40.474350] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T19:24:40.742810] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-16T19:24:41.093171] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-16T19:24:41.542869] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-16T19:24:42.342842] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-16T19:24:42.802610] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-16T19:24:42.854059] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T19:24:43.142851] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-16T19:24:43.596759] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T19:24:43.602769] [INFO ] [REMOTE ] HLF: Full fetch complete (70966 records). [2025-10-16T19:24:43.602883] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-16T19:24:43.951639] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-16T19:24:43.993691] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-16T19:24:43.993842] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-16T19:24:43.994910] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-16T19:24:43.994975] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-16T19:24:43.996360] [DEBUG] [LOCAL ] HLF: Trimmed 70966 records to 48878 (keeping 200 days of data) [2025-10-16T19:24:44.266017] [DEBUG] [LOCAL ] HLF: Primary data saved (48878 records). [2025-10-16T19:24:44.266147] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-16T19:24:44.266225] [INFO ] [MAIN ] Update Progress: 1025/2369 symbols completed. HLF took 37.6s. Estimated remaining: 3h 9m 42s. Rate: 7.1 symbols/min [2025-10-16T19:24:44.434271] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:24:44.464777] [DEBUG] [LOCAL ] HLLY: Loaded 33508 existing records from primary storage. [2025-10-16T19:24:44.465033] [INFO ] [MAIN ] HLLY: Loaded 33508 existing records. [2025-10-16T19:24:44.642149] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:24:44.642357] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-16T19:24:44.642414] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-16T19:24:44.643071] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-16T19:24:44.643137] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-16T19:24:44.743802] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-16T19:24:45.002344] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:24:45.116368] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T19:24:45.396118] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-16T19:24:45.542844] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-16T19:24:45.675511] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T19:24:46.342858] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-16T19:24:46.743910] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T19:24:46.749121] [INFO ] [REMOTE ] HLIO: Full fetch complete (36926 records). [2025-10-16T19:24:46.749243] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-16T19:24:47.153214] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-16T19:24:47.169391] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-16T19:24:47.169482] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-16T19:24:47.170375] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-16T19:24:47.170569] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-16T19:24:47.171592] [DEBUG] [LOCAL ] HLIO: Trimmed 36926 records to 28465 (keeping 200 days of data) [2025-10-16T19:24:47.354510] [DEBUG] [LOCAL ] HLIO: Primary data saved (28465 records). [2025-10-16T19:24:47.354773] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-16T19:24:47.354882] [INFO ] [MAIN ] Update Progress: 1026/2369 symbols completed. HLIO took 28.9s. Estimated remaining: 3h 9m 27s. Rate: 7.1 symbols/min [2025-10-16T19:24:47.530538] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T19:24:47.557592] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:24:47.558766] [INFO ] [REMOTE ] HLI: Full fetch complete (45264 records). [2025-10-16T19:24:47.559066] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-16T19:24:47.958424] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-16T19:24:47.977620] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-16T19:24:47.977520] [DEBUG] [LOCAL ] HLN: Loaded 53123 existing records from primary storage. [2025-10-16T19:24:47.977884] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-16T19:24:47.978023] [INFO ] [MAIN ] HLN: Loaded 53123 existing records. [2025-10-16T19:24:47.989998] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-16T19:24:48.015109] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-16T19:24:48.096294] [DEBUG] [LOCAL ] HLI: Trimmed 45264 records to 31106 (keeping 200 days of data) [2025-10-16T19:24:48.259497] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:24:48.266804] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-16T19:24:48.278698] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-16T19:24:48.284871] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-16T19:24:48.286401] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-16T19:24:48.662923] [DEBUG] [LOCAL ] HLI: Primary data saved (31106 records). [2025-10-16T19:24:48.686960] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-16T19:24:48.687168] [INFO ] [MAIN ] Update Progress: 1027/2369 symbols completed. HLI took 36.7s. Estimated remaining: 3h 9m 9s. Rate: 7.1 symbols/min [2025-10-16T19:24:48.914285] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:24:48.939938] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-16T19:24:48.959546] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:24:49.005399] [DEBUG] [LOCAL ] HLT: Loaded 50527 existing records from primary storage. [2025-10-16T19:24:49.005736] [INFO ] [MAIN ] HLT: Loaded 50527 existing records. [2025-10-16T19:24:49.182399] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:24:49.182874] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-16T19:24:49.183119] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-16T19:24:49.183436] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-16T19:24:49.183587] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-16T19:24:49.317988] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T19:24:49.545251] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-16T19:24:49.564938] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-16T19:24:49.605919] [INFO ] [REMOTE ] HL: Full fetch complete (77822 records). [2025-10-16T19:24:49.611052] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-16T19:24:49.716294] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:24:50.049229] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-16T19:24:50.049308] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-16T19:24:50.050441] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-16T19:24:50.050505] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-16T19:24:50.052170] [DEBUG] [LOCAL ] HL: Trimmed 77822 records to 54065 (keeping 200 days of data) [2025-10-16T19:24:50.350484] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-16T19:24:50.377736] [DEBUG] [LOCAL ] HL: Primary data saved (54065 records). [2025-10-16T19:24:50.378118] [INFO ] [MAIN ] HL: Full history saved. [2025-10-16T19:24:50.378245] [INFO ] [MAIN ] Update Progress: 1028/2369 symbols completed. HL took 44.2s. Estimated remaining: 3h 8m 52s. Rate: 7.1 symbols/min [2025-10-16T19:24:50.602265] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:24:50.607070] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T19:24:50.660999] [DEBUG] [LOCAL ] HLX: Loaded 47471 existing records from primary storage. [2025-10-16T19:24:50.661335] [INFO ] [MAIN ] HLX: Loaded 47471 existing records. [2025-10-16T19:24:50.864900] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T19:24:50.888874] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:24:50.896549] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-16T19:24:50.896627] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-16T19:24:50.897604] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-16T19:24:50.897704] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-16T19:24:51.148016] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-16T19:24:51.319133] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:24:51.942806] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-16T19:24:52.352759] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-16T19:24:52.742813] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-16T19:24:53.108688] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-16T19:24:53.139454] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T19:24:53.542839] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-16T19:24:54.342838] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-16T19:24:54.557220] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T19:24:54.875997] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T19:24:55.142836] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-16T19:24:55.942862] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-16T19:24:55.988878] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T19:24:56.528006] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T19:24:56.742894] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-16T19:24:57.109759] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T19:24:57.542901] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-16T19:24:58.342886] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-16T19:24:58.473002] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T19:24:58.730550] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T19:24:59.142827] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-16T19:24:59.297007] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-16T19:24:59.942813] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-16T19:25:00.742785] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-16T19:25:00.790233] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:25:01.265443] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T19:25:01.542899] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-16T19:25:02.342875] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-16T19:25:02.597718] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T19:25:02.785366] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T19:25:03.142829] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-16T19:25:03.942829] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-16T19:25:04.044476] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T19:25:04.623268] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T19:25:04.742795] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-16T19:25:05.430436] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T19:25:05.542797] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-16T19:25:05.849267] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T19:25:06.342947] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-16T19:25:07.142891] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-16T19:25:07.269319] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T19:25:07.823863] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T19:25:07.942803] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-16T19:25:08.695308] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T19:25:08.742830] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-16T19:25:09.295057] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T19:25:09.542837] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-16T19:25:10.342843] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-16T19:25:10.673772] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-16T19:25:10.985632] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T19:25:10.990367] [INFO ] [REMOTE ] HLLY: Full fetch complete (46085 records). [2025-10-16T19:25:10.990471] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-16T19:25:11.147374] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-16T19:25:11.386589] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-16T19:25:11.386698] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-16T19:25:11.387617] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-16T19:25:11.387698] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-16T19:25:11.388940] [DEBUG] [LOCAL ] HLLY: Trimmed 46085 records to 33658 (keeping 200 days of data) [2025-10-16T19:25:11.592548] [DEBUG] [LOCAL ] HLLY: Primary data saved (33658 records). [2025-10-16T19:25:11.592734] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-16T19:25:11.592844] [INFO ] [MAIN ] Update Progress: 1029/2369 symbols completed. HLLY took 27.3s. Estimated remaining: 3h 8m 60s. Rate: 7.1 symbols/min [2025-10-16T19:25:11.782401] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:25:11.824455] [DEBUG] [LOCAL ] HMC: Loaded 46489 existing records from primary storage. [2025-10-16T19:25:11.824784] [INFO ] [MAIN ] HMC: Loaded 46489 existing records. [2025-10-16T19:25:11.947953] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-16T19:25:12.009205] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:25:12.009405] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-16T19:25:12.009452] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-16T19:25:12.010338] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-16T19:25:12.010397] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-16T19:25:12.408486] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:25:12.413876] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-16T19:25:12.742819] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-16T19:25:12.850397] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T19:25:13.542780] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-16T19:25:13.650503] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T19:25:14.116794] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T19:25:14.342846] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-16T19:25:15.142909] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-16T19:25:15.341336] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-16T19:25:15.720247] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T19:25:15.942832] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-16T19:25:16.444505] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T19:25:16.742800] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-16T19:25:17.198901] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T19:25:17.542837] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-16T19:25:18.342881] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-16T19:25:18.423550] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T19:25:19.142837] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-16T19:25:19.265457] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T19:25:19.942836] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-16T19:25:20.061031] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T19:25:20.742811] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-16T19:25:20.833942] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T19:25:21.542846] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-16T19:25:21.766612] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T19:25:22.154856] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T19:25:22.279635] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T19:25:22.286781] [INFO ] [REMOTE ] HLT: Full fetch complete (73631 records). [2025-10-16T19:25:22.287020] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-16T19:25:22.353094] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-16T19:25:22.686218] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-16T19:25:22.686301] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-16T19:25:22.687342] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-16T19:25:22.687408] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-16T19:25:22.688911] [DEBUG] [LOCAL ] HLT: Trimmed 73631 records to 50910 (keeping 200 days of data) [2025-10-16T19:25:23.001179] [DEBUG] [LOCAL ] HLT: Primary data saved (50910 records). [2025-10-16T19:25:23.001327] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-16T19:25:23.001412] [INFO ] [MAIN ] Update Progress: 1030/2369 symbols completed. HLT took 34.3s. Estimated remaining: 3h 8m 55s. Rate: 7.1 symbols/min [2025-10-16T19:25:23.152265] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-16T19:25:23.168947] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:25:23.192162] [DEBUG] [LOCAL ] HMN: Loaded 23512 existing records from primary storage. [2025-10-16T19:25:23.192411] [INFO ] [MAIN ] HMN: Loaded 23512 existing records. [2025-10-16T19:25:23.364808] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:25:23.364991] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-16T19:25:23.365039] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-16T19:25:23.365251] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-16T19:25:23.365307] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-16T19:25:23.716605] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:25:23.942815] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-16T19:25:24.103093] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T19:25:24.721438] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T19:25:24.742789] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-16T19:25:24.833452] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-16T19:25:25.542816] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-16T19:25:26.204053] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T19:25:26.211125] [INFO ] [REMOTE ] HLX: Full fetch complete (69067 records). [2025-10-16T19:25:26.211289] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-16T19:25:26.343171] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-16T19:25:26.351488] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-16T19:25:26.643053] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-16T19:25:26.643195] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-16T19:25:26.644673] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-16T19:25:26.644773] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-16T19:25:26.647125] [DEBUG] [LOCAL ] HLX: Trimmed 69067 records to 47821 (keeping 200 days of data) [2025-10-16T19:25:26.931901] [DEBUG] [LOCAL ] HLX: Primary data saved (47821 records). [2025-10-16T19:25:26.932096] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-16T19:25:26.932696] [INFO ] [MAIN ] Update Progress: 1031/2369 symbols completed. HLX took 36.6s. Estimated remaining: 3h 8m 41s. Rate: 7.1 symbols/min [2025-10-16T19:25:27.110790] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:25:27.144926] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-16T19:25:27.170810] [DEBUG] [LOCAL ] HMY: Loaded 53166 existing records from primary storage. [2025-10-16T19:25:27.171230] [INFO ] [MAIN ] HMY: Loaded 53166 existing records. [2025-10-16T19:25:27.358638] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:25:27.358964] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-16T19:25:27.359017] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-16T19:25:27.360143] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-16T19:25:27.360204] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-16T19:25:27.722053] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:25:27.942823] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-16T19:25:28.120459] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T19:25:28.241734] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-16T19:25:28.251698] [INFO ] [REMOTE ] HLN: Full fetch complete (77006 records). [2025-10-16T19:25:28.251909] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-16T19:25:28.628391] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-16T19:25:28.628474] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-16T19:25:28.629471] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-16T19:25:28.629533] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-16T19:25:28.630957] [DEBUG] [LOCAL ] HLN: Trimmed 77006 records to 53512 (keeping 200 days of data) [2025-10-16T19:25:28.743953] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-16T19:25:28.939849] [DEBUG] [LOCAL ] HLN: Primary data saved (53512 records). [2025-10-16T19:25:28.939980] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-16T19:25:28.940608] [INFO ] [MAIN ] Update Progress: 1032/2369 symbols completed. HLN took 41.6s. Estimated remaining: 3h 8m 24s. Rate: 7.1 symbols/min [2025-10-16T19:25:29.108379] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:25:29.108586] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-16T19:25:29.108661] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-16T19:25:29.108794] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-16T19:25:29.108844] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-16T19:25:29.108887] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-16T19:25:29.108919] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-16T19:25:29.467140] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:25:29.542812] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-16T19:25:29.820107] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T19:25:30.342797] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-16T19:25:30.503553] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:25:30.504002] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-16T19:25:30.504260] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:25:30.504381] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-16T19:25:30.504487] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:25:30.504704] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-16T19:25:30.504884] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-16T19:25:30.505025] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-16T19:25:30.505165] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-16T19:25:30.505286] [INFO ] [MAIN ] Update Progress: 1033/2369 symbols completed. HNGE took 1.6s. Estimated remaining: 3h 8m 7s. Rate: 7.1 symbols/min [2025-10-16T19:25:30.609961] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T19:25:30.711878] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T19:25:30.750322] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:25:30.780903] [DEBUG] [LOCAL ] HNI: Loaded 29627 existing records from primary storage. [2025-10-16T19:25:30.781187] [INFO ] [MAIN ] HNI: Loaded 29627 existing records. [2025-10-16T19:25:30.962775] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:25:30.963022] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-16T19:25:30.963081] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-16T19:25:30.963637] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-16T19:25:30.963729] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-16T19:25:31.152704] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-16T19:25:31.327780] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:25:31.942812] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-16T19:25:32.742813] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-16T19:25:33.133567] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T19:25:33.204773] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-16T19:25:33.542814] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-16T19:25:34.342825] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-16T19:25:34.614290] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-16T19:25:35.132984] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T19:25:35.143143] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-16T19:25:35.372509] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T19:25:35.942820] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-16T19:25:35.969321] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-16T19:25:36.742829] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-16T19:25:37.234234] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T19:25:37.542940] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-16T19:25:38.211519] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T19:25:38.292118] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T19:25:38.342791] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-16T19:25:39.142839] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-16T19:25:39.942863] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-16T19:25:40.279756] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-16T19:25:40.366867] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T19:25:40.742835] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-16T19:25:41.154177] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T19:25:41.542875] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-16T19:25:42.342791] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-16T19:25:42.676144] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-16T19:25:43.089485] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:25:43.142818] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-16T19:25:43.408356] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T19:25:43.942804] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-16T19:25:44.742824] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-16T19:25:44.797668] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T19:25:45.411978] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T19:25:45.542783] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-16T19:25:45.801420] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T19:25:46.342872] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-16T19:25:46.826899] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-16T19:25:47.142853] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-16T19:25:47.904929] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T19:25:47.942785] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-16T19:25:48.367411] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T19:25:48.742845] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-16T19:25:48.916959] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T19:25:49.542810] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-16T19:25:50.342869] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-16T19:25:50.386075] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T19:25:50.752277] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T19:25:51.062680] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T19:25:51.142852] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-16T19:25:51.942832] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-16T19:25:52.742844] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-16T19:25:52.935934] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T19:25:52.939177] [INFO ] [REMOTE ] HMN: Full fetch complete (31581 records). [2025-10-16T19:25:52.939444] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-16T19:25:53.361724] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-16T19:25:53.361950] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-16T19:25:53.362840] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-16T19:25:53.362980] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-16T19:25:53.364417] [DEBUG] [LOCAL ] HMN: Trimmed 31581 records to 23613 (keeping 200 days of data) [2025-10-16T19:25:53.495360] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-16T19:25:53.550040] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-16T19:25:53.564545] [DEBUG] [LOCAL ] HMN: Primary data saved (23613 records). [2025-10-16T19:25:53.564736] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-16T19:25:53.564837] [INFO ] [MAIN ] Update Progress: 1034/2369 symbols completed. HMN took 30.6s. Estimated remaining: 3h 8m 17s. Rate: 7.1 symbols/min [2025-10-16T19:25:53.782891] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:25:53.834274] [DEBUG] [LOCAL ] HOG: Loaded 50849 existing records from primary storage. [2025-10-16T19:25:53.834710] [INFO ] [MAIN ] HOG: Loaded 50849 existing records. [2025-10-16T19:25:54.018323] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:25:54.018601] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-16T19:25:54.018686] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-16T19:25:54.018926] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-16T19:25:54.018983] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-16T19:25:54.344928] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-16T19:25:54.433481] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:25:54.464788] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T19:25:55.142823] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-16T19:25:55.212206] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-16T19:25:55.300906] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T19:25:55.307980] [INFO ] [REMOTE ] HMY: Full fetch complete (77027 records). [2025-10-16T19:25:55.308144] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-16T19:25:55.754185] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-16T19:25:55.754324] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-16T19:25:55.755427] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-16T19:25:55.755498] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-16T19:25:55.757021] [DEBUG] [LOCAL ] HMY: Trimmed 77027 records to 53556 (keeping 200 days of data) [2025-10-16T19:25:55.948603] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-16T19:25:56.097187] [DEBUG] [LOCAL ] HMY: Primary data saved (53556 records). [2025-10-16T19:25:56.097341] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-16T19:25:56.097849] [INFO ] [MAIN ] Update Progress: 1035/2369 symbols completed. HMY took 29.2s. Estimated remaining: 3h 8m 1s. Rate: 7.1 symbols/min [2025-10-16T19:25:56.271421] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:25:56.314830] [DEBUG] [LOCAL ] HOMB: Loaded 43633 existing records from primary storage. [2025-10-16T19:25:56.315132] [INFO ] [MAIN ] HOMB: Loaded 43633 existing records. [2025-10-16T19:25:56.493128] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:25:56.493550] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-16T19:25:56.493743] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-16T19:25:56.494189] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-16T19:25:56.494322] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-16T19:25:56.765689] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T19:25:56.771041] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-16T19:25:56.922904] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:25:57.493997] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T19:25:57.542841] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-16T19:25:58.342840] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-16T19:25:58.414902] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T19:25:59.068635] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T19:25:59.142829] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-16T19:25:59.270195] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T19:25:59.942825] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-16T19:26:00.275806] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T19:26:00.742863] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-16T19:26:01.542844] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-16T19:26:01.668281] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T19:26:01.674854] [INFO ] [REMOTE ] HMC: Full fetch complete (68923 records). [2025-10-16T19:26:01.675036] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-16T19:26:02.116408] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-16T19:26:02.116520] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-16T19:26:02.117635] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-16T19:26:02.117808] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-16T19:26:02.119348] [DEBUG] [LOCAL ] HMC: Trimmed 68923 records to 46822 (keeping 200 days of data) [2025-10-16T19:26:02.360174] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-16T19:26:02.406101] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T19:26:02.440387] [DEBUG] [LOCAL ] HMC: Primary data saved (46822 records). [2025-10-16T19:26:02.441178] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-16T19:26:02.441753] [INFO ] [MAIN ] Update Progress: 1036/2369 symbols completed. HMC took 50.8s. Estimated remaining: 3h 7m 50s. Rate: 7.1 symbols/min [2025-10-16T19:26:02.610255] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:26:02.649746] [DEBUG] [LOCAL ] HOUS: Loaded 45340 existing records from primary storage. [2025-10-16T19:26:02.650115] [INFO ] [MAIN ] HOUS: Loaded 45340 existing records. [2025-10-16T19:26:02.831580] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:26:02.831860] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-16T19:26:02.831977] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-16T19:26:02.832185] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-16T19:26:02.832243] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-16T19:26:02.983377] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T19:26:03.022348] [INFO ] [REMOTE ] HNI: Full fetch complete (42082 records). [2025-10-16T19:26:03.070463] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-16T19:26:03.145428] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-16T19:26:03.333459] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:26:03.589282] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-16T19:26:03.589361] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-16T19:26:03.590109] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-16T19:26:03.590172] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-16T19:26:03.591074] [DEBUG] [LOCAL ] HNI: Trimmed 42082 records to 29900 (keeping 200 days of data) [2025-10-16T19:26:03.768341] [DEBUG] [LOCAL ] HNI: Primary data saved (29900 records). [2025-10-16T19:26:03.768590] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-16T19:26:03.768721] [INFO ] [MAIN ] Update Progress: 1037/2369 symbols completed. HNI took 33.3s. Estimated remaining: 3h 7m 32s. Rate: 7.1 symbols/min [2025-10-16T19:26:03.821477] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T19:26:03.942796] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-16T19:26:04.742887] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-16T19:26:04.884879] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T19:26:05.293271] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T19:26:05.542815] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-16T19:26:05.844574] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T19:26:06.342853] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-16T19:26:06.994436] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-16T19:26:07.142833] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-16T19:26:07.949551] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-16T19:26:07.953096] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T19:26:08.508357] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T19:26:08.742866] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-16T19:26:09.423407] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T19:26:09.542836] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-16T19:26:10.342988] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-16T19:26:10.485461] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T19:26:10.733099] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T19:26:11.142822] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-16T19:26:11.388342] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-16T19:26:11.942877] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-16T19:26:12.742888] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-16T19:26:12.965817] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T19:26:13.160706] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T19:26:13.542895] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-16T19:26:13.863932] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T19:26:14.342810] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-16T19:26:14.978231] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T19:26:15.142842] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-16T19:26:15.668143] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T19:26:15.942830] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-16T19:26:16.742806] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-16T19:26:16.895430] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-16T19:26:17.542817] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-16T19:26:17.669970] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T19:26:18.055035] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-16T19:26:18.342815] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-16T19:26:19.005417] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T19:26:19.142816] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-16T19:26:19.836327] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:26:19.942802] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-16T19:26:20.173550] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T19:26:20.742869] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-16T19:26:21.445349] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T19:26:21.542774] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-16T19:26:22.291008] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T19:26:22.342778] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-16T19:26:23.142863] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-16T19:26:23.175069] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T19:26:23.181254] [INFO ] [REMOTE ] HOMB: Full fetch complete (64255 records). [2025-10-16T19:26:23.181398] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-16T19:26:23.595780] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-16T19:26:23.596013] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-16T19:26:23.596999] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-16T19:26:23.597080] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-16T19:26:23.598784] [DEBUG] [LOCAL ] HOMB: Trimmed 64255 records to 44016 (keeping 200 days of data) [2025-10-16T19:26:23.633407] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T19:26:23.904244] [DEBUG] [LOCAL ] HOMB: Primary data saved (44016 records). [2025-10-16T19:26:23.904372] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-16T19:26:23.904854] [INFO ] [MAIN ] Update Progress: 1038/2369 symbols completed. HOMB took 27.8s. Estimated remaining: 3h 7m 39s. Rate: 7.1 symbols/min [2025-10-16T19:26:23.942837] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-16T19:26:24.561117] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T19:26:24.567430] [INFO ] [REMOTE ] HOG: Full fetch complete (74332 records). [2025-10-16T19:26:24.567543] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-16T19:26:24.948580] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-16T19:26:24.948688] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-16T19:26:24.949695] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-16T19:26:24.949757] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-16T19:26:24.951079] [DEBUG] [LOCAL ] HOG: Trimmed 74332 records to 51193 (keeping 200 days of data) [2025-10-16T19:26:25.283022] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T19:26:25.285700] [DEBUG] [LOCAL ] HOG: Primary data saved (51193 records). [2025-10-16T19:26:25.295902] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-16T19:26:25.296579] [INFO ] [MAIN ] Update Progress: 1039/2369 symbols completed. HOG took 31.7s. Estimated remaining: 3h 7m 21s. Rate: 7.1 symbols/min [2025-10-16T19:26:25.297237] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-16T19:26:27.186094] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-16T19:26:27.192743] [INFO ] [REMOTE ] HOUS: Full fetch complete (64459 records). [2025-10-16T19:26:27.192869] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-16T19:26:27.570941] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-16T19:26:27.571021] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-16T19:26:27.572326] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-16T19:26:27.572388] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-16T19:26:27.573559] [DEBUG] [LOCAL ] HOUS: Trimmed 64459 records to 45728 (keeping 200 days of data) [2025-10-16T19:26:27.824266] [DEBUG] [LOCAL ] HOUS: Primary data saved (45728 records). [2025-10-16T19:26:27.824411] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-16T19:26:27.824511] [INFO ] [MAIN ] Update Progress: 1040/2369 symbols completed. HOUS took 25.4s. Estimated remaining: 3h 7m 5s. Rate: 7.1 symbols/min [2025-10-16T19:26:28.495230] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:26:28.477161] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:26:28.555923] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:26:28.551438] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:26:28.570884] [DEBUG] [LOCAL ] HOV: Loaded 14032 existing records from primary storage. [2025-10-16T19:26:28.571327] [INFO ] [MAIN ] HOV: Loaded 14032 existing records. [2025-10-16T19:26:28.609011] [DEBUG] [LOCAL ] HPF: Loaded 7499 existing records from primary storage. [2025-10-16T19:26:28.609245] [INFO ] [MAIN ] HPF: Loaded 7499 existing records. [2025-10-16T19:26:28.930340] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:26:28.960899] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-16T19:26:28.966301] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:26:28.967276] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-16T19:26:28.967684] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-16T19:26:28.967969] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-16T19:26:28.981446] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-16T19:26:28.981659] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-16T19:26:28.983133] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-16T19:26:29.012804] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-16T19:26:29.019518] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-16T19:26:29.052980] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-16T19:26:29.263948] [DEBUG] [LOCAL ] HP: Loaded 51543 existing records from primary storage. [2025-10-16T19:26:29.299264] [INFO ] [MAIN ] HP: Loaded 51543 existing records. [2025-10-16T19:26:29.701233] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:26:29.861603] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-16T19:26:29.943591] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-16T19:26:29.938209] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:26:29.965335] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-16T19:26:29.999040] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-16T19:26:30.028407] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-16T19:26:30.096782] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-16T19:26:30.112489] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:26:30.189944] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-16T19:26:30.211488] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:26:30.244568] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-16T19:26:30.234010] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-16T19:26:30.257054] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-16T19:26:30.826739] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:26:30.838776] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-16T19:26:30.948115] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:26:30.948814] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-16T19:26:31.034569] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T19:26:31.038140] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-16T19:26:31.108167] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-16T19:26:31.110865] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-16T19:26:31.610689] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-16T19:26:31.613572] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-16T19:26:31.825520] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T19:26:31.828058] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-16T19:26:32.104173] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-16T19:26:32.107050] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-16T19:26:32.204569] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T19:26:32.220352] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-16T19:26:32.749039] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-16T19:26:32.756401] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T19:26:32.999585] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-16T19:26:33.542805] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-16T19:26:34.168283] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T19:26:34.195278] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-16T19:26:34.342830] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-16T19:26:35.142795] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-16T19:26:35.218481] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T19:26:35.942870] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-16T19:26:36.747945] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-16T19:26:36.763252] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T19:26:36.810902] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T19:26:37.542837] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-16T19:26:38.186947] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-16T19:26:38.342824] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-16T19:26:38.513201] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T19:26:38.748560] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-16T19:26:39.142814] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-16T19:26:39.831204] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-16T19:26:39.942799] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-16T19:26:40.742851] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-16T19:26:40.928874] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T19:26:41.542835] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-16T19:26:42.169447] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-16T19:26:42.342829] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-16T19:26:42.447118] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T19:26:42.762280] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-16T19:26:43.142826] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-16T19:26:43.877613] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-16T19:26:43.942788] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-16T19:26:44.549361] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-16T19:26:44.742805] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-16T19:26:45.542857] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-16T19:26:45.716809] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T19:26:46.342813] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-16T19:26:47.098121] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T19:26:47.103040] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T19:26:47.142864] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-16T19:26:47.871933] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T19:26:47.873436] [INFO ] [REMOTE ] HPF: Full fetch complete (10656 records). [2025-10-16T19:26:47.873543] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-16T19:26:47.948063] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-16T19:26:48.231291] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-16T19:26:48.231364] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-16T19:26:48.231626] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-16T19:26:48.231707] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-16T19:26:48.232126] [DEBUG] [LOCAL ] HPF: Trimmed 10656 records to 7539 (keeping 200 days of data) [2025-10-16T19:26:48.276394] [DEBUG] [LOCAL ] HPF: Primary data saved (7539 records). [2025-10-16T19:26:48.276504] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-16T19:26:48.276580] [INFO ] [MAIN ] Update Progress: 1041/2369 symbols completed. HPF took 20.4s. Estimated remaining: 3h 7m 12s. Rate: 7.1 symbols/min [2025-10-16T19:26:48.441755] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:26:48.453580] [DEBUG] [LOCAL ] HPI: Loaded 10655 existing records from primary storage. [2025-10-16T19:26:48.453809] [INFO ] [MAIN ] HPI: Loaded 10655 existing records. [2025-10-16T19:26:48.635959] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:26:48.636532] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-16T19:26:48.636591] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-16T19:26:48.636920] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-16T19:26:48.636993] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-16T19:26:48.745341] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-16T19:26:48.773733] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T19:26:48.800924] [INFO ] [REMOTE ] HOV: Full fetch complete (19096 records). [2025-10-16T19:26:48.812720] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-16T19:26:49.293953] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:26:49.383292] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-16T19:26:49.383367] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-16T19:26:49.383796] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-16T19:26:49.383857] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-16T19:26:49.384377] [DEBUG] [LOCAL ] HOV: Trimmed 19096 records to 14093 (keeping 200 days of data) [2025-10-16T19:26:49.465353] [DEBUG] [LOCAL ] HOV: Primary data saved (14093 records). [2025-10-16T19:26:49.465493] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-16T19:26:49.465576] [INFO ] [MAIN ] Update Progress: 1042/2369 symbols completed. HOV took 21.6s. Estimated remaining: 3h 6m 54s. Rate: 7.1 symbols/min [2025-10-16T19:26:49.552585] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-16T19:26:49.656399] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:26:49.702007] [DEBUG] [LOCAL ] HPP: Loaded 51192 existing records from primary storage. [2025-10-16T19:26:49.702304] [INFO ] [MAIN ] HPP: Loaded 51192 existing records. [2025-10-16T19:26:49.873907] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:26:49.874118] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-16T19:26:49.874164] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-16T19:26:49.875096] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-16T19:26:49.875154] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-16T19:26:50.224926] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:26:50.285440] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T19:26:50.342773] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-16T19:26:51.142816] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-16T19:26:51.613628] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-16T19:26:51.854147] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T19:26:51.942823] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-16T19:26:52.742842] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-16T19:26:52.919736] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T19:26:53.394222] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-16T19:26:53.542785] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-16T19:26:53.622550] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T19:26:54.244116] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-16T19:26:54.342818] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-16T19:26:54.718786] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-16T19:26:55.142832] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-16T19:26:55.942823] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-16T19:26:56.742789] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-16T19:26:57.282115] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-16T19:26:57.319264] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T19:26:57.539398] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-16T19:26:57.542756] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-16T19:26:58.280699] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T19:26:58.342775] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-16T19:26:59.047827] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T19:26:59.142794] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-16T19:26:59.849677] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T19:26:59.942811] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-16T19:27:00.742793] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-16T19:27:00.805340] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T19:27:01.542868] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-16T19:27:02.342792] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-16T19:27:02.506376] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-16T19:27:02.711883] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T19:27:03.142897] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-16T19:27:03.952024] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-16T19:27:03.971822] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T19:27:04.212819] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T19:27:04.742858] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-16T19:27:05.371874] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T19:27:05.542794] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-16T19:27:05.939252] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T19:27:05.941231] [INFO ] [REMOTE ] HPI: Full fetch complete (13942 records). [2025-10-16T19:27:05.941308] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-16T19:27:06.313970] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-16T19:27:06.314296] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-16T19:27:06.314664] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-16T19:27:06.314726] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-16T19:27:06.315291] [DEBUG] [LOCAL ] HPI: Trimmed 13942 records to 10730 (keeping 200 days of data) [2025-10-16T19:27:06.347968] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-16T19:27:06.384014] [DEBUG] [LOCAL ] HPI: Primary data saved (10730 records). [2025-10-16T19:27:06.384150] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-16T19:27:06.384229] [INFO ] [MAIN ] Update Progress: 1043/2369 symbols completed. HPI took 18.1s. Estimated remaining: 3h 6m 57s. Rate: 7.1 symbols/min [2025-10-16T19:27:06.553629] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:27:06.601241] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-16T19:27:06.601661] [INFO ] [MAIN ] HPQ: Loaded 53669 existing records. [2025-10-16T19:27:06.781546] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:27:06.781806] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-16T19:27:06.781855] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-16T19:27:06.782948] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-16T19:27:06.783007] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-16T19:27:07.140827] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:27:07.142765] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-16T19:27:07.255457] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T19:27:07.942792] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-16T19:27:08.375558] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-16T19:27:08.742814] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-16T19:27:09.062312] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T19:27:09.316868] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T19:27:09.542816] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-16T19:27:10.342850] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-16T19:27:10.457974] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T19:27:11.142793] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-16T19:27:11.436560] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-16T19:27:11.942791] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-16T19:27:12.426176] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-16T19:27:12.494311] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T19:27:12.742857] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-16T19:27:13.542811] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-16T19:27:13.757239] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T19:27:14.344412] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-16T19:27:14.350125] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T19:27:15.057529] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-16T19:27:15.063855] [INFO ] [REMOTE ] HP: Full fetch complete (74088 records). [2025-10-16T19:27:15.063966] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-16T19:27:15.148068] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-16T19:27:15.489074] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-16T19:27:15.489171] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-16T19:27:15.490182] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-16T19:27:15.490247] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-16T19:27:15.491720] [DEBUG] [LOCAL ] HP: Trimmed 74088 records to 51892 (keeping 200 days of data) [2025-10-16T19:27:15.809112] [DEBUG] [LOCAL ] HP: Primary data saved (51892 records). [2025-10-16T19:27:15.809290] [INFO ] [MAIN ] HP: Full history saved. [2025-10-16T19:27:15.809390] [INFO ] [MAIN ] Update Progress: 1044/2369 symbols completed. HP took 48.0s. Estimated remaining: 3h 6m 49s. Rate: 7.1 symbols/min [2025-10-16T19:27:15.956911] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-16T19:27:15.987988] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:27:16.000938] [DEBUG] [LOCAL ] HPS: Loaded 10310 existing records from primary storage. [2025-10-16T19:27:16.001284] [INFO ] [MAIN ] HPS: Loaded 10310 existing records. [2025-10-16T19:27:16.191239] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:27:16.191574] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-16T19:27:16.191698] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-16T19:27:16.192185] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-16T19:27:16.192247] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-16T19:27:16.559949] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-16T19:27:16.597569] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:27:16.742810] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-16T19:27:17.186898] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-16T19:27:17.479831] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T19:27:17.542779] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-16T19:27:18.297035] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T19:27:18.342778] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-16T19:27:18.659636] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T19:27:19.142834] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-16T19:27:19.942791] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-16T19:27:20.324167] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-16T19:27:20.742789] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-16T19:27:20.989362] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-16T19:27:20.996235] [INFO ] [REMOTE ] HPE: Full fetch complete (77875 records). [2025-10-16T19:27:20.996380] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-16T19:27:21.328636] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-16T19:27:21.409674] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-16T19:27:21.409784] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-16T19:27:21.410915] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-16T19:27:21.411028] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-16T19:27:21.412795] [DEBUG] [LOCAL ] HPE: Trimmed 77875 records to 54087 (keeping 200 days of data) [2025-10-16T19:27:21.548833] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-16T19:27:21.569829] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T19:27:21.799135] [DEBUG] [LOCAL ] HPE: Primary data saved (54087 records). [2025-10-16T19:27:21.799526] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-16T19:27:21.800248] [INFO ] [MAIN ] Update Progress: 1045/2369 symbols completed. HPE took 54.0s. Estimated remaining: 3h 6m 38s. Rate: 7.1 symbols/min [2025-10-16T19:27:21.979622] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:27:22.004707] [DEBUG] [LOCAL ] HQH: Loaded 25800 existing records from primary storage. [2025-10-16T19:27:22.005037] [INFO ] [MAIN ] HQH: Loaded 25800 existing records. [2025-10-16T19:27:22.180400] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:27:22.180599] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-16T19:27:22.180665] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-16T19:27:22.181368] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-16T19:27:22.181425] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-16T19:27:22.345426] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-16T19:27:22.555960] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:27:23.142844] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-16T19:27:23.425132] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T19:27:23.704539] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T19:27:23.942888] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-16T19:27:24.579388] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T19:27:24.742826] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-16T19:27:25.542826] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-16T19:27:25.885852] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T19:27:26.342806] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-16T19:27:26.432574] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T19:27:26.460046] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T19:27:27.142842] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-16T19:27:27.942812] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-16T19:27:28.078332] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T19:27:28.256580] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T19:27:28.448009] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-16T19:27:28.742810] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-16T19:27:29.542858] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-16T19:27:30.221496] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T19:27:30.342789] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-16T19:27:30.572269] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T19:27:31.142793] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-16T19:27:31.204873] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T19:27:31.211893] [INFO ] [REMOTE ] HPQ: Full fetch complete (77841 records). [2025-10-16T19:27:31.212021] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-16T19:27:31.602716] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-16T19:27:31.602801] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-16T19:27:31.603922] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-16T19:27:31.603986] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-16T19:27:31.605446] [DEBUG] [LOCAL ] HPQ: Trimmed 77841 records to 54059 (keeping 200 days of data) [2025-10-16T19:27:31.940565] [DEBUG] [LOCAL ] HPQ: Primary data saved (54059 records). [2025-10-16T19:27:31.940763] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-16T19:27:31.940882] [INFO ] [MAIN ] Update Progress: 1046/2369 symbols completed. HPQ took 25.6s. Estimated remaining: 3h 6m 31s. Rate: 7.1 symbols/min [2025-10-16T19:27:31.952719] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-16T19:27:32.114322] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:27:32.133121] [DEBUG] [LOCAL ] HQL: Loaded 16872 existing records from primary storage. [2025-10-16T19:27:32.133356] [INFO ] [MAIN ] HQL: Loaded 16872 existing records. [2025-10-16T19:27:32.312960] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:27:32.313167] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-16T19:27:32.313213] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-16T19:27:32.313445] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-16T19:27:32.313501] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-16T19:27:32.673220] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:27:32.691721] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-16T19:27:32.698810] [INFO ] [REMOTE ] HPP: Full fetch complete (73414 records). [2025-10-16T19:27:32.698949] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-16T19:27:32.747923] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-16T19:27:33.103993] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-16T19:27:33.104133] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-16T19:27:33.105254] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-16T19:27:33.110676] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-16T19:27:33.120913] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T19:27:33.126850] [DEBUG] [LOCAL ] HPP: Trimmed 73414 records to 51562 (keeping 200 days of data) [2025-10-16T19:27:33.358385] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-16T19:27:33.430860] [DEBUG] [LOCAL ] HPP: Primary data saved (51562 records). [2025-10-16T19:27:33.431014] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-16T19:27:33.431625] [INFO ] [MAIN ] Update Progress: 1047/2369 symbols completed. HPP took 44.0s. Estimated remaining: 3h 6m 14s. Rate: 7.1 symbols/min [2025-10-16T19:27:33.547876] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-16T19:27:33.606754] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:27:33.658262] [DEBUG] [LOCAL ] HR: Loaded 52106 existing records from primary storage. [2025-10-16T19:27:33.658783] [INFO ] [MAIN ] HR: Loaded 52106 existing records. [2025-10-16T19:27:33.832714] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:27:33.832950] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-16T19:27:33.832998] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-16T19:27:33.834051] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-16T19:27:33.834109] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-16T19:27:34.181887] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:27:34.342777] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-16T19:27:34.612206] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:27:35.142822] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-16T19:27:35.831686] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T19:27:35.898693] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T19:27:35.942772] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-16T19:27:36.742793] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-16T19:27:36.922869] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T19:27:37.222471] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-16T19:27:37.542817] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-16T19:27:38.342871] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-16T19:27:39.153931] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-16T19:27:39.178263] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T19:27:39.218052] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T19:27:39.924139] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T19:27:39.942761] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-16T19:27:40.692401] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-16T19:27:40.742782] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-16T19:27:41.542794] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-16T19:27:41.554733] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T19:27:42.342798] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-16T19:27:42.489885] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T19:27:42.967481] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T19:27:43.142797] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-16T19:27:43.942821] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-16T19:27:44.530615] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:27:44.649465] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T19:27:44.742846] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-16T19:27:45.542824] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-16T19:27:46.169533] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T19:27:46.342792] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-16T19:27:46.564677] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T19:27:47.142819] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-16T19:27:47.942797] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-16T19:27:48.305231] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T19:27:48.306620] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T19:27:48.387892] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T19:27:48.742838] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-16T19:27:49.542842] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-16T19:27:50.342801] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-16T19:27:50.469992] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T19:27:50.498333] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-16T19:27:51.142843] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-16T19:27:51.286997] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T19:27:51.942877] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-16T19:27:52.742838] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-16T19:27:52.821913] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T19:27:52.822756] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T19:27:53.542838] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-16T19:27:53.664204] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T19:27:54.124902] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T19:27:54.126667] [INFO ] [REMOTE ] HPS: Full fetch complete (15190 records). [2025-10-16T19:27:54.126738] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-16T19:27:54.348161] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-16T19:27:54.486450] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-16T19:27:54.486530] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-16T19:27:54.486951] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-16T19:27:54.487010] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-16T19:27:54.487476] [DEBUG] [LOCAL ] HPS: Trimmed 15190 records to 10382 (keeping 200 days of data) [2025-10-16T19:27:54.552670] [DEBUG] [LOCAL ] HPS: Primary data saved (10382 records). [2025-10-16T19:27:54.552833] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-16T19:27:54.552923] [INFO ] [MAIN ] Update Progress: 1048/2369 symbols completed. HPS took 38.7s. Estimated remaining: 3h 6m 22s. Rate: 7.1 symbols/min [2025-10-16T19:27:54.743109] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:27:54.784493] [DEBUG] [LOCAL ] HRB: Loaded 48404 existing records from primary storage. [2025-10-16T19:27:54.784824] [INFO ] [MAIN ] HRB: Loaded 48404 existing records. [2025-10-16T19:27:54.960409] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:27:54.960683] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-16T19:27:54.960743] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-16T19:27:54.961721] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-16T19:27:54.961778] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-16T19:27:55.152179] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-16T19:27:55.314775] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:27:55.942852] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-16T19:27:56.190823] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T19:27:56.196975] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T19:27:56.742812] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-16T19:27:57.542792] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-16T19:27:57.572121] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T19:27:57.625341] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T19:27:58.342870] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-16T19:27:59.142788] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-16T19:27:59.227604] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T19:27:59.308312] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T19:27:59.942790] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-16T19:28:00.556445] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T19:28:00.563944] [INFO ] [REMOTE ] HQH: Full fetch complete (37298 records). [2025-10-16T19:28:00.564080] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-16T19:28:00.752761] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-16T19:28:00.943956] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-16T19:28:00.944031] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-16T19:28:00.944743] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-16T19:28:00.944805] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-16T19:28:00.945566] [DEBUG] [LOCAL ] HQH: Trimmed 37298 records to 26023 (keeping 200 days of data) [2025-10-16T19:28:01.098021] [DEBUG] [LOCAL ] HQH: Primary data saved (26023 records). [2025-10-16T19:28:01.098158] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-16T19:28:01.098237] [INFO ] [MAIN ] Update Progress: 1049/2369 symbols completed. HQH took 39.3s. Estimated remaining: 3h 6m 11s. Rate: 7.1 symbols/min [2025-10-16T19:28:01.277157] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:28:01.309455] [DEBUG] [LOCAL ] HRI: Loaded 32443 existing records from primary storage. [2025-10-16T19:28:01.309770] [INFO ] [MAIN ] HRI: Loaded 32443 existing records. [2025-10-16T19:28:01.495480] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:28:01.495730] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-16T19:28:01.495789] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-16T19:28:01.496430] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-16T19:28:01.496490] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-16T19:28:01.554961] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-16T19:28:01.935174] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:28:01.942504] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-16T19:28:01.944929] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-16T19:28:02.342844] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-16T19:28:03.141304] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T19:28:03.150273] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-16T19:28:03.581369] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T19:28:03.942850] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-16T19:28:04.063006] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T19:28:04.066803] [INFO ] [REMOTE ] HQL: Full fetch complete (25330 records). [2025-10-16T19:28:04.066961] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-16T19:28:04.449661] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-16T19:28:04.449751] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-16T19:28:04.450291] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-16T19:28:04.450331] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-16T19:28:04.451028] [DEBUG] [LOCAL ] HQL: Trimmed 25330 records to 17085 (keeping 200 days of data) [2025-10-16T19:28:04.550257] [DEBUG] [LOCAL ] HQL: Primary data saved (17085 records). [2025-10-16T19:28:04.550387] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-16T19:28:04.550462] [INFO ] [MAIN ] Update Progress: 1050/2369 symbols completed. HQL took 32.6s. Estimated remaining: 3h 5m 56s. Rate: 7.1 symbols/min [2025-10-16T19:28:04.723263] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:28:04.749288] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-16T19:28:04.771158] [DEBUG] [LOCAL ] HRL: Loaded 53128 existing records from primary storage. [2025-10-16T19:28:04.771505] [INFO ] [MAIN ] HRL: Loaded 53128 existing records. [2025-10-16T19:28:04.945749] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:28:04.945974] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-16T19:28:04.946022] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-16T19:28:04.946953] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-16T19:28:04.947010] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-16T19:28:05.303213] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:28:05.322305] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T19:28:05.329350] [INFO ] [REMOTE ] HR: Full fetch complete (75056 records). [2025-10-16T19:28:05.329511] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-16T19:28:05.550830] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-16T19:28:05.735163] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-16T19:28:05.735259] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-16T19:28:05.736436] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-16T19:28:05.736506] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-16T19:28:05.738205] [DEBUG] [LOCAL ] HR: Trimmed 75056 records to 52488 (keeping 200 days of data) [2025-10-16T19:28:06.058378] [DEBUG] [LOCAL ] HR: Primary data saved (52488 records). [2025-10-16T19:28:06.058516] [INFO ] [MAIN ] HR: Full history saved. [2025-10-16T19:28:06.059238] [INFO ] [MAIN ] Update Progress: 1051/2369 symbols completed. HR took 32.6s. Estimated remaining: 3h 5m 39s. Rate: 7.1 symbols/min [2025-10-16T19:28:06.226765] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:28:06.260249] [DEBUG] [LOCAL ] HRTG: Loaded 34367 existing records from primary storage. [2025-10-16T19:28:06.260525] [INFO ] [MAIN ] HRTG: Loaded 34367 existing records. [2025-10-16T19:28:06.349547] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-16T19:28:06.441244] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:28:06.441591] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-16T19:28:06.441731] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-16T19:28:06.442137] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-16T19:28:06.442271] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-16T19:28:06.571800] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-16T19:28:06.837287] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:28:06.853337] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T19:28:07.142828] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-16T19:28:07.842947] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T19:28:07.942774] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-16T19:28:08.084183] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-16T19:28:08.742796] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-16T19:28:09.542812] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-16T19:28:09.671487] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T19:28:10.271572] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-16T19:28:10.338715] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T19:28:10.347876] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-16T19:28:11.142881] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-16T19:28:11.752627] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T19:28:11.942879] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-16T19:28:12.219405] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T19:28:12.742851] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-16T19:28:13.542835] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-16T19:28:13.587533] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T19:28:13.797272] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T19:28:14.342817] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-16T19:28:14.986177] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T19:28:15.142812] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-16T19:28:15.682119] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T19:28:15.942866] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-16T19:28:16.742792] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-16T19:28:16.920018] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T19:28:16.970267] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T19:28:17.542855] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-16T19:28:18.005892] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T19:28:18.342820] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-16T19:28:18.905410] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T19:28:19.142837] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-16T19:28:19.761790] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T19:28:19.942826] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-16T19:28:20.294390] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T19:28:20.742800] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-16T19:28:21.487338] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T19:28:21.542828] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-16T19:28:22.342816] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-16T19:28:22.535989] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T19:28:23.142784] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-16T19:28:23.310388] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T19:28:23.811774] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T19:28:23.942999] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-16T19:28:24.441690] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T19:28:24.742802] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-16T19:28:25.542825] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-16T19:28:25.749972] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T19:28:25.921602] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T19:28:26.342825] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-16T19:28:27.142803] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-16T19:28:27.201233] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T19:28:27.942787] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-16T19:28:28.009704] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T19:28:28.015934] [INFO ] [REMOTE ] HRB: Full fetch complete (70133 records). [2025-10-16T19:28:28.016072] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-16T19:28:28.415022] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-16T19:28:28.443481] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-16T19:28:28.443763] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-16T19:28:28.444900] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-16T19:28:28.444982] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-16T19:28:28.446871] [DEBUG] [LOCAL ] HRB: Trimmed 70133 records to 48745 (keeping 200 days of data) [2025-10-16T19:28:28.751272] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-16T19:28:28.769859] [DEBUG] [LOCAL ] HRB: Primary data saved (48745 records). [2025-10-16T19:28:28.770027] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-16T19:28:28.770691] [INFO ] [MAIN ] Update Progress: 1052/2369 symbols completed. HRB took 34.2s. Estimated remaining: 3h 5m 48s. Rate: 7.1 symbols/min [2025-10-16T19:28:28.974997] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:28:29.028700] [DEBUG] [LOCAL ] HSBC: Loaded 51004 existing records from primary storage. [2025-10-16T19:28:29.029174] [INFO ] [MAIN ] HSBC: Loaded 51004 existing records. [2025-10-16T19:28:29.232214] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:28:29.233272] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-16T19:28:29.234893] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-16T19:28:29.234787] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T19:28:29.242586] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-16T19:28:29.243344] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-16T19:28:29.556264] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-16T19:28:29.599830] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:28:29.676639] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T19:28:30.342820] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-16T19:28:31.142833] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-16T19:28:31.312763] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T19:28:31.749985] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T19:28:31.942828] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-16T19:28:32.168288] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T19:28:32.742808] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-16T19:28:33.353774] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T19:28:33.358720] [INFO ] [REMOTE ] HRTG: Full fetch complete (44160 records). [2025-10-16T19:28:33.358861] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-16T19:28:33.548095] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-16T19:28:33.740687] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-16T19:28:33.740851] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-16T19:28:33.741689] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-16T19:28:33.741753] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-16T19:28:33.742920] [DEBUG] [LOCAL ] HRTG: Trimmed 44160 records to 34673 (keeping 200 days of data) [2025-10-16T19:28:33.987079] [DEBUG] [LOCAL ] HRTG: Primary data saved (34673 records). [2025-10-16T19:28:33.988624] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-16T19:28:33.988509] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T19:28:33.988787] [INFO ] [MAIN ] Update Progress: 1053/2369 symbols completed. HRTG took 27.9s. Estimated remaining: 3h 5m 36s. Rate: 7.1 symbols/min [2025-10-16T19:28:34.165365] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:28:34.179490] [DEBUG] [LOCAL ] HSHP: Loaded 14871 existing records from primary storage. [2025-10-16T19:28:34.179740] [INFO ] [MAIN ] HSHP: Loaded 14871 existing records. [2025-10-16T19:28:34.348379] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-16T19:28:34.353118] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:28:34.354338] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-16T19:28:34.354404] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-16T19:28:34.354832] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-16T19:28:34.354891] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-16T19:28:34.700791] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:28:35.142853] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-16T19:28:35.298814] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-16T19:28:35.794638] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T19:28:35.798862] [INFO ] [REMOTE ] HRI: Full fetch complete (46528 records). [2025-10-16T19:28:35.799002] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-16T19:28:35.950459] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-16T19:28:36.176469] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-16T19:28:36.176542] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-16T19:28:36.177333] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-16T19:28:36.177397] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-16T19:28:36.178337] [DEBUG] [LOCAL ] HRI: Trimmed 46528 records to 32632 (keeping 200 days of data) [2025-10-16T19:28:36.382931] [DEBUG] [LOCAL ] HRI: Primary data saved (32632 records). [2025-10-16T19:28:36.383278] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-16T19:28:36.383467] [INFO ] [MAIN ] Update Progress: 1054/2369 symbols completed. HRI took 35.3s. Estimated remaining: 3h 5m 20s. Rate: 7.1 symbols/min [2025-10-16T19:28:36.557448] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:28:36.595989] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T19:28:36.650014] [DEBUG] [LOCAL ] HSY: Loaded 50437 existing records from primary storage. [2025-10-16T19:28:36.650361] [INFO ] [MAIN ] HSY: Loaded 50437 existing records. [2025-10-16T19:28:36.746385] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-16T19:28:36.835303] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:28:36.835591] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-16T19:28:36.835673] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-16T19:28:36.836401] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-16T19:28:36.836462] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-16T19:28:37.154623] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T19:28:37.247194] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:28:37.542834] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-16T19:28:38.243141] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-16T19:28:38.342937] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-16T19:28:38.347391] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T19:28:39.142841] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-16T19:28:39.942824] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-16T19:28:40.044288] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T19:28:40.198334] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T19:28:40.742863] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-16T19:28:41.542807] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-16T19:28:41.784831] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T19:28:42.342874] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-16T19:28:42.660616] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-16T19:28:43.142823] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-16T19:28:43.342294] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T19:28:43.370949] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T19:28:43.942962] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-16T19:28:44.742873] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-16T19:28:44.898141] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T19:28:45.542890] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-16T19:28:45.659076] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T19:28:46.342890] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-16T19:28:46.636023] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-16T19:28:47.142816] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-16T19:28:47.463346] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-16T19:28:47.470478] [INFO ] [REMOTE ] HRL: Full fetch complete (76963 records). [2025-10-16T19:28:47.470626] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-16T19:28:47.860605] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-16T19:28:47.860706] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-16T19:28:47.861711] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-16T19:28:47.861773] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-16T19:28:47.863163] [DEBUG] [LOCAL ] HRL: Trimmed 76963 records to 53516 (keeping 200 days of data) [2025-10-16T19:28:47.951361] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-16T19:28:48.191561] [DEBUG] [LOCAL ] HRL: Primary data saved (53516 records). [2025-10-16T19:28:48.191981] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-16T19:28:48.192117] [INFO ] [MAIN ] Update Progress: 1055/2369 symbols completed. HRL took 43.6s. Estimated remaining: 3h 5m 15s. Rate: 7.1 symbols/min [2025-10-16T19:28:48.363005] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:28:48.363195] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-16T19:28:48.363281] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-16T19:28:48.363512] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-16T19:28:48.363557] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-16T19:28:48.363598] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-16T19:28:48.363668] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-16T19:28:48.572733] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-16T19:28:48.762443] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-16T19:28:48.767989] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:28:48.804265] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T19:28:49.085904] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T19:28:49.542816] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-16T19:28:49.770790] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:28:49.771053] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-16T19:28:49.771140] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:28:49.771186] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-16T19:28:49.771219] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:28:49.771255] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-16T19:28:49.771309] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-16T19:28:49.771363] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-16T19:28:49.771428] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-16T19:28:49.771476] [INFO ] [MAIN ] Update Progress: 1056/2369 symbols completed. HTB took 1.6s. Estimated remaining: 3h 4m 58s. Rate: 7.1 symbols/min [2025-10-16T19:28:49.940363] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:28:49.954152] [DEBUG] [LOCAL ] HTD: Loaded 14172 existing records from primary storage. [2025-10-16T19:28:49.954371] [INFO ] [MAIN ] HTD: Loaded 14172 existing records. [2025-10-16T19:28:50.129952] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:28:50.130346] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-16T19:28:50.130395] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-16T19:28:50.130875] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-16T19:28:50.130932] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-16T19:28:50.347168] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-16T19:28:50.487173] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:28:50.515492] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T19:28:51.082041] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T19:28:51.142826] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-16T19:28:51.942829] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-16T19:28:52.154172] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-16T19:28:52.742835] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-16T19:28:53.542802] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-16T19:28:53.563659] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T19:28:53.918174] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-16T19:28:54.342797] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-16T19:28:54.599837] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T19:28:55.142888] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-16T19:28:55.942877] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-16T19:28:56.096763] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T19:28:56.209795] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T19:28:56.742863] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-16T19:28:57.304448] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-16T19:28:57.542856] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-16T19:28:57.844853] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-16T19:28:58.342883] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-16T19:28:59.142843] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-16T19:28:59.246899] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T19:28:59.271940] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T19:28:59.874607] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T19:28:59.942806] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-16T19:29:00.742842] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-16T19:29:00.773442] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-16T19:29:01.542904] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-16T19:29:02.342820] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-16T19:29:02.600810] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T19:29:02.602976] [INFO ] [REMOTE ] HSHP: Full fetch complete (23288 records). [2025-10-16T19:29:02.603045] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-16T19:29:02.968399] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-16T19:29:03.027457] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-16T19:29:03.098052] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-16T19:29:03.098135] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-16T19:29:03.098887] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-16T19:29:03.098950] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-16T19:29:03.099563] [DEBUG] [LOCAL ] HSHP: Trimmed 23288 records to 14969 (keeping 200 days of data) [2025-10-16T19:29:03.160988] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-16T19:29:03.187895] [DEBUG] [LOCAL ] HSHP: Primary data saved (14969 records). [2025-10-16T19:29:03.188395] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-16T19:29:03.188685] [INFO ] [MAIN ] Update Progress: 1057/2369 symbols completed. HSHP took 29.2s. Estimated remaining: 3h 4m 56s. Rate: 7.1 symbols/min [2025-10-16T19:29:03.368801] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:29:03.368984] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-16T19:29:03.369022] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-16T19:29:03.369138] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-16T19:29:03.369181] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-16T19:29:03.369224] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-16T19:29:03.369258] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-16T19:29:03.848512] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:29:03.942905] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-16T19:29:04.054345] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-16T19:29:04.742822] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-16T19:29:05.128739] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-16T19:29:05.542835] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-16T19:29:05.715592] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T19:29:06.342861] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-16T19:29:06.669844] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-16T19:29:07.142817] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-16T19:29:07.469478] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-16T19:29:07.471304] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T19:29:07.942836] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-16T19:29:08.742837] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-16T19:29:09.542828] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-16T19:29:09.676853] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T19:29:09.780160] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-16T19:29:10.342824] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-16T19:29:10.595329] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T19:29:11.142824] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-16T19:29:11.942849] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-16T19:29:12.080924] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T19:29:12.433297] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-16T19:29:12.742848] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-16T19:29:13.107446] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-16T19:29:13.138429] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-16T19:29:13.145472] [INFO ] [REMOTE ] HSBC: Full fetch complete (74116 records). [2025-10-16T19:29:13.145606] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-16T19:29:13.535123] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-16T19:29:13.535197] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-16T19:29:13.536193] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-16T19:29:13.536255] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-16T19:29:13.537593] [DEBUG] [LOCAL ] HSBC: Trimmed 74116 records to 51390 (keeping 200 days of data) [2025-10-16T19:29:13.589826] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-16T19:29:13.842888] [DEBUG] [LOCAL ] HSBC: Primary data saved (51390 records). [2025-10-16T19:29:13.843054] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-16T19:29:13.843728] [INFO ] [MAIN ] Update Progress: 1058/2369 symbols completed. HSBC took 45.1s. Estimated remaining: 3h 4m 50s. Rate: 7.1 symbols/min [2025-10-16T19:29:14.010437] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:29:14.055707] [DEBUG] [LOCAL ] HTGC: Loaded 47734 existing records from primary storage. [2025-10-16T19:29:14.055997] [INFO ] [MAIN ] HTGC: Loaded 47734 existing records. [2025-10-16T19:29:14.231303] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:29:14.231477] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-16T19:29:14.231523] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-16T19:29:14.231885] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-16T19:29:14.231941] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-16T19:29:14.347965] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-16T19:29:14.588891] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:29:14.633599] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T19:29:14.712626] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-16T19:29:15.142878] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-16T19:29:15.942810] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-16T19:29:16.742821] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-16T19:29:16.772763] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T19:29:16.802194] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T19:29:16.809798] [INFO ] [REMOTE ] HSY: Full fetch complete (73667 records). [2025-10-16T19:29:16.810066] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-16T19:29:17.144254] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-16T19:29:17.212691] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-16T19:29:17.212787] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-16T19:29:17.213918] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-16T19:29:17.213984] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-16T19:29:17.215414] [DEBUG] [LOCAL ] HSY: Trimmed 73667 records to 50818 (keeping 200 days of data) [2025-10-16T19:29:17.531791] [DEBUG] [LOCAL ] HSY: Primary data saved (50818 records). [2025-10-16T19:29:17.531923] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-16T19:29:17.532001] [INFO ] [MAIN ] Update Progress: 1059/2369 symbols completed. HSY took 41.1s. Estimated remaining: 3h 4m 36s. Rate: 7.1 symbols/min [2025-10-16T19:29:17.548978] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-16T19:29:17.703201] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:29:17.734566] [DEBUG] [LOCAL ] HTH: Loaded 32576 existing records from primary storage. [2025-10-16T19:29:17.734859] [INFO ] [MAIN ] HTH: Loaded 32576 existing records. [2025-10-16T19:29:17.916813] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:29:17.917029] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-16T19:29:17.917087] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-16T19:29:17.917339] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-16T19:29:17.917377] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-16T19:29:18.276939] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:29:18.342780] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-16T19:29:18.572106] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-16T19:29:19.142846] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-16T19:29:19.232010] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T19:29:19.641770] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-16T19:29:19.942839] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-16T19:29:20.158504] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-16T19:29:20.742861] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-16T19:29:21.542782] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-16T19:29:21.837611] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T19:29:22.342806] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-16T19:29:22.822776] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T19:29:23.142820] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-16T19:29:23.163209] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T19:29:23.942823] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-16T19:29:24.742818] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-16T19:29:24.788723] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:29:25.374210] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T19:29:25.542769] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-16T19:29:25.702587] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T19:29:25.865310] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-16T19:29:26.342831] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-16T19:29:27.142799] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-16T19:29:27.493064] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-16T19:29:27.493793] [INFO ] [REMOTE ] HTFC: Full fetch complete (839 records). [2025-10-16T19:29:27.493863] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-16T19:29:27.684658] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-16T19:29:27.684843] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:29:27.684927] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:29:27.685021] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-16T19:29:27.685103] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-16T19:29:27.685143] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-16T19:29:27.685185] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-16T19:29:27.685239] [INFO ] [MAIN ] Update Progress: 1060/2369 symbols completed. HTFC took 24.5s. Estimated remaining: 3h 4m 30s. Rate: 7.1 symbols/min [2025-10-16T19:29:27.863249] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:29:27.898965] [DEBUG] [LOCAL ] HUBB: Loaded 36510 existing records from primary storage. [2025-10-16T19:29:27.899266] [INFO ] [MAIN ] HUBB: Loaded 36510 existing records. [2025-10-16T19:29:27.943718] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-16T19:29:28.083056] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T19:29:28.150884] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:29:28.151091] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-16T19:29:28.151165] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-16T19:29:28.152107] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-16T19:29:28.152167] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-16T19:29:28.497181] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:29:28.742776] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-16T19:29:29.013524] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T19:29:29.016472] [INFO ] [REMOTE ] HTD: Full fetch complete (19507 records). [2025-10-16T19:29:29.016545] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-16T19:29:29.374942] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-16T19:29:29.375030] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-16T19:29:29.375472] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-16T19:29:29.375515] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-16T19:29:29.376123] [DEBUG] [LOCAL ] HTD: Trimmed 19507 records to 14244 (keeping 200 days of data) [2025-10-16T19:29:29.460209] [DEBUG] [LOCAL ] HTD: Primary data saved (14244 records). [2025-10-16T19:29:29.460334] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-16T19:29:29.460410] [INFO ] [MAIN ] Update Progress: 1061/2369 symbols completed. HTD took 39.7s. Estimated remaining: 3h 4m 13s. Rate: 7.1 symbols/min [2025-10-16T19:29:29.550979] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-16T19:29:29.630806] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:29:29.666936] [DEBUG] [LOCAL ] HUBS: Loaded 40051 existing records from primary storage. [2025-10-16T19:29:29.667205] [INFO ] [MAIN ] HUBS: Loaded 40051 existing records. [2025-10-16T19:29:29.845532] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:29:29.845794] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-16T19:29:29.845865] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-16T19:29:29.846585] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-16T19:29:29.846687] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-16T19:29:30.041136] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T19:29:30.235006] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:29:30.342764] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-16T19:29:30.637472] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T19:29:31.142865] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-16T19:29:31.478487] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T19:29:31.942822] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-16T19:29:32.696315] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T19:29:32.742775] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-16T19:29:32.883627] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T19:29:33.542813] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-16T19:29:34.342799] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-16T19:29:34.395487] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T19:29:34.943141] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T19:29:35.142819] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-16T19:29:35.478122] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T19:29:35.942804] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-16T19:29:36.362449] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T19:29:36.742857] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-16T19:29:37.277011] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T19:29:37.542838] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-16T19:29:38.342802] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-16T19:29:38.398512] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T19:29:39.097513] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T19:29:39.142768] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-16T19:29:39.673230] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T19:29:39.942808] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-16T19:29:40.527335] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T19:29:40.742807] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-16T19:29:41.084071] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T19:29:41.542864] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-16T19:29:42.342794] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-16T19:29:42.547260] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T19:29:42.553967] [INFO ] [REMOTE ] HTGC: Full fetch complete (68841 records). [2025-10-16T19:29:42.554106] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-16T19:29:42.956830] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-16T19:29:42.956939] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-16T19:29:42.957936] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-16T19:29:42.957998] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-16T19:29:42.959342] [DEBUG] [LOCAL ] HTGC: Trimmed 68841 records to 48100 (keeping 200 days of data) [2025-10-16T19:29:43.143036] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-16T19:29:43.257976] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T19:29:43.298411] [DEBUG] [LOCAL ] HTGC: Primary data saved (48100 records). [2025-10-16T19:29:43.298559] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-16T19:29:43.299062] [INFO ] [MAIN ] Update Progress: 1062/2369 symbols completed. HTGC took 29.5s. Estimated remaining: 3h 4m 11s. Rate: 7.1 symbols/min [2025-10-16T19:29:43.472855] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:29:43.518998] [DEBUG] [LOCAL ] HUM: Loaded 49309 existing records from primary storage. [2025-10-16T19:29:43.519287] [INFO ] [MAIN ] HUM: Loaded 49309 existing records. [2025-10-16T19:29:43.716510] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:29:43.718042] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T19:29:43.724291] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-16T19:29:43.724667] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-16T19:29:43.725139] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-16T19:29:43.725200] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-16T19:29:43.948037] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-16T19:29:44.087138] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:29:44.753198] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-16T19:29:44.755632] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T19:29:45.182096] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T19:29:45.542863] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-16T19:29:46.342806] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-16T19:29:46.488074] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T19:29:46.567186] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-16T19:29:47.142857] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-16T19:29:47.678041] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T19:29:47.942792] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-16T19:29:48.557179] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T19:29:48.742789] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-16T19:29:49.542783] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-16T19:29:49.595471] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T19:29:50.004429] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T19:29:50.342903] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-16T19:29:51.106431] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T19:29:51.142848] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-16T19:29:51.742523] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-16T19:29:51.748550] [INFO ] [REMOTE ] HTH: Full fetch complete (46824 records). [2025-10-16T19:29:51.748804] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-16T19:29:51.950489] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-16T19:29:52.125090] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-16T19:29:52.125161] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-16T19:29:52.125946] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-16T19:29:52.126008] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-16T19:29:52.126926] [DEBUG] [LOCAL ] HTH: Trimmed 46824 records to 32799 (keeping 200 days of data) [2025-10-16T19:29:52.317070] [DEBUG] [LOCAL ] HTH: Primary data saved (32799 records). [2025-10-16T19:29:52.317214] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-16T19:29:52.317295] [INFO ] [MAIN ] Update Progress: 1063/2369 symbols completed. HTH took 34.8s. Estimated remaining: 3h 4m 3s. Rate: 7.1 symbols/min [2025-10-16T19:29:52.503273] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:29:52.554412] [DEBUG] [LOCAL ] HUN: Loaded 53214 existing records from primary storage. [2025-10-16T19:29:52.554889] [INFO ] [MAIN ] HUN: Loaded 53214 existing records. [2025-10-16T19:29:52.737342] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:29:52.737678] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-16T19:29:52.737763] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-16T19:29:52.747104] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-16T19:29:52.747183] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-16T19:29:52.762045] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-16T19:29:52.845781] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T19:29:53.127770] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:29:53.525545] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T19:29:53.542766] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-16T19:29:54.342807] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-16T19:29:54.405934] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T19:29:54.876505] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T19:29:55.142822] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-16T19:29:55.697774] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T19:29:55.942880] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-16T19:29:56.259694] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T19:29:56.742877] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-16T19:29:57.542784] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-16T19:29:57.695762] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T19:29:57.999976] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T19:29:58.342834] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-16T19:29:59.142854] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-16T19:29:59.321259] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T19:29:59.942854] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-16T19:29:59.982725] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-16T19:29:59.988515] [INFO ] [REMOTE ] HUBS: Full fetch complete (56696 records). [2025-10-16T19:29:59.988680] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-16T19:30:00.377290] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-16T19:30:00.377394] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-16T19:30:00.378361] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-16T19:30:00.378452] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-16T19:30:00.379926] [DEBUG] [LOCAL ] HUBS: Trimmed 56696 records to 40357 (keeping 200 days of data) [2025-10-16T19:30:00.527891] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:30:00.659026] [DEBUG] [LOCAL ] HUBS: Primary data saved (40357 records). [2025-10-16T19:30:00.659147] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-16T19:30:00.659220] [INFO ] [MAIN ] Update Progress: 1064/2369 symbols completed. HUBS took 31.2s. Estimated remaining: 3h 3m 55s. Rate: 7.1 symbols/min [2025-10-16T19:30:00.747970] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-16T19:30:00.828917] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:30:00.866092] [DEBUG] [LOCAL ] HUYA: Loaded 43809 existing records from primary storage. [2025-10-16T19:30:00.866371] [INFO ] [MAIN ] HUYA: Loaded 43809 existing records. [2025-10-16T19:30:01.043208] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:30:01.043492] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-16T19:30:01.043563] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-16T19:30:01.044343] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-16T19:30:01.044426] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-16T19:30:01.347877] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T19:30:01.434950] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:30:01.542825] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-16T19:30:02.342794] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-16T19:30:02.756089] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T19:30:02.955968] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T19:30:03.142838] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-16T19:30:03.866003] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T19:30:03.942784] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-16T19:30:04.725043] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T19:30:04.742770] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-16T19:30:05.248272] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-16T19:30:05.253029] [INFO ] [REMOTE ] HUBB: Full fetch complete (54300 records). [2025-10-16T19:30:05.253121] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-16T19:30:05.548832] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-16T19:30:05.684416] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-16T19:30:05.684495] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-16T19:30:05.685443] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-16T19:30:05.685508] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-16T19:30:05.686883] [DEBUG] [LOCAL ] HUBB: Trimmed 54300 records to 36713 (keeping 200 days of data) [2025-10-16T19:30:05.940785] [DEBUG] [LOCAL ] HUBB: Primary data saved (36713 records). [2025-10-16T19:30:05.940964] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-16T19:30:05.941056] [INFO ] [MAIN ] Update Progress: 1065/2369 symbols completed. HUBB took 38.3s. Estimated remaining: 3h 3m 42s. Rate: 7.1 symbols/min [2025-10-16T19:30:06.135481] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:30:06.151275] [DEBUG] [LOCAL ] HVT: Loaded 15120 existing records from primary storage. [2025-10-16T19:30:06.151712] [INFO ] [MAIN ] HVT: Loaded 15120 existing records. [2025-10-16T19:30:06.344078] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-16T19:30:06.338852] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:30:06.357534] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-16T19:30:06.357672] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-16T19:30:06.358259] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-16T19:30:06.359886] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T19:30:06.360182] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-16T19:30:06.786596] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:30:07.046869] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T19:30:07.142814] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-16T19:30:07.942820] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-16T19:30:08.024054] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T19:30:08.742828] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-16T19:30:09.156735] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-16T19:30:09.542786] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-16T19:30:09.624281] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T19:30:10.342820] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-16T19:30:11.142792] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-16T19:30:11.145225] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-16T19:30:11.343786] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T19:30:11.758767] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T19:30:11.942828] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-16T19:30:12.233868] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T19:30:12.742857] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-16T19:30:13.156610] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T19:30:13.542812] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-16T19:30:13.733920] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T19:30:14.342832] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-16T19:30:15.051686] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T19:30:15.142793] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-16T19:30:15.331695] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T19:30:15.942822] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-16T19:30:16.742858] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-16T19:30:17.208205] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-16T19:30:17.263512] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T19:30:17.542833] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-16T19:30:18.339224] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T19:30:18.348874] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-16T19:30:19.127871] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T19:30:19.142781] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-16T19:30:19.942827] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-16T19:30:19.996501] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T19:30:20.047579] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T19:30:20.742822] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-16T19:30:21.542791] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-16T19:30:21.722201] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T19:30:22.342787] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-16T19:30:22.622215] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-16T19:30:23.142787] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-16T19:30:23.358330] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T19:30:23.734179] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T19:30:23.942823] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-16T19:30:24.742788] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-16T19:30:25.146455] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-16T19:30:25.152856] [INFO ] [REMOTE ] HUM: Full fetch complete (71091 records). [2025-10-16T19:30:25.152981] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-16T19:30:25.540253] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-16T19:30:25.540329] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-16T19:30:25.541308] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-16T19:30:25.541370] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-16T19:30:25.542691] [DEBUG] [LOCAL ] HUM: Trimmed 71091 records to 49651 (keeping 200 days of data) [2025-10-16T19:30:25.543182] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-16T19:30:25.824906] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T19:30:25.887135] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-16T19:30:25.917077] [DEBUG] [LOCAL ] HUM: Primary data saved (49651 records). [2025-10-16T19:30:25.917381] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-16T19:30:25.918005] [INFO ] [MAIN ] Update Progress: 1066/2369 symbols completed. HUM took 42.6s. Estimated remaining: 3h 3m 48s. Rate: 7.1 symbols/min [2025-10-16T19:30:26.085540] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:30:26.141059] [DEBUG] [LOCAL ] HWM: Loaded 52813 existing records from primary storage. [2025-10-16T19:30:26.141379] [INFO ] [MAIN ] HWM: Loaded 52813 existing records. [2025-10-16T19:30:26.314841] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:30:26.315034] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-16T19:30:26.315081] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-16T19:30:26.315952] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-16T19:30:26.316009] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-16T19:30:26.347935] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-16T19:30:26.666107] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:30:26.945463] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T19:30:27.142822] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-16T19:30:27.909500] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T19:30:27.942780] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-16T19:30:28.742810] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-16T19:30:29.008048] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T19:30:29.416045] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T19:30:29.422906] [INFO ] [REMOTE ] HUN: Full fetch complete (76974 records). [2025-10-16T19:30:29.423026] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-16T19:30:29.547996] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-16T19:30:29.803339] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T19:30:29.830393] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-16T19:30:29.830465] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-16T19:30:29.831490] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-16T19:30:29.831553] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-16T19:30:29.832870] [DEBUG] [LOCAL ] HUN: Trimmed 76974 records to 53604 (keeping 200 days of data) [2025-10-16T19:30:30.154739] [DEBUG] [LOCAL ] HUN: Primary data saved (53604 records). [2025-10-16T19:30:30.154890] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-16T19:30:30.155326] [INFO ] [MAIN ] Update Progress: 1067/2369 symbols completed. HUN took 37.8s. Estimated remaining: 3h 3m 34s. Rate: 7.1 symbols/min [2025-10-16T19:30:30.322705] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:30:30.345794] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-16T19:30:30.365567] [DEBUG] [LOCAL ] HXL: Loaded 45841 existing records from primary storage. [2025-10-16T19:30:30.365935] [INFO ] [MAIN ] HXL: Loaded 45841 existing records. [2025-10-16T19:30:30.546556] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:30:30.546794] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-16T19:30:30.546843] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-16T19:30:30.547578] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-16T19:30:30.547636] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-16T19:30:30.889042] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:30:31.142787] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-16T19:30:31.562856] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T19:30:31.631901] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-16T19:30:31.638078] [INFO ] [REMOTE ] HUYA: Full fetch complete (64184 records). [2025-10-16T19:30:31.638209] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-16T19:30:31.947906] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-16T19:30:32.022683] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-16T19:30:32.022883] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-16T19:30:32.023993] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-16T19:30:32.024091] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-16T19:30:32.025369] [DEBUG] [LOCAL ] HUYA: Trimmed 64184 records to 44168 (keeping 200 days of data) [2025-10-16T19:30:32.205005] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T19:30:32.288272] [DEBUG] [LOCAL ] HUYA: Primary data saved (44168 records). [2025-10-16T19:30:32.288438] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-16T19:30:32.288603] [INFO ] [MAIN ] Update Progress: 1068/2369 symbols completed. HUYA took 31.6s. Estimated remaining: 3h 3m 18s. Rate: 7.1 symbols/min [2025-10-16T19:30:32.452516] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:30:32.462715] [DEBUG] [LOCAL ] HY: Loaded 10057 existing records from primary storage. [2025-10-16T19:30:32.462933] [INFO ] [MAIN ] HY: Loaded 10057 existing records. [2025-10-16T19:30:32.635004] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:30:32.635215] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-16T19:30:32.635265] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-16T19:30:32.635553] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-16T19:30:32.635666] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-16T19:30:32.747936] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-16T19:30:32.992880] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:30:33.497979] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T19:30:33.542776] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-16T19:30:33.763979] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-16T19:30:34.342787] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-16T19:30:34.417107] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T19:30:34.975261] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-16T19:30:35.142829] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-16T19:30:35.942820] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-16T19:30:36.748595] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-16T19:30:36.753811] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T19:30:36.854951] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T19:30:36.857245] [INFO ] [REMOTE ] HVT: Full fetch complete (23184 records). [2025-10-16T19:30:36.857321] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-16T19:30:37.226858] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-16T19:30:37.226983] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-16T19:30:37.227547] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-16T19:30:37.227594] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-16T19:30:37.228239] [DEBUG] [LOCAL ] HVT: Trimmed 23184 records to 15241 (keeping 200 days of data) [2025-10-16T19:30:37.321089] [DEBUG] [LOCAL ] HVT: Primary data saved (15241 records). [2025-10-16T19:30:37.321228] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-16T19:30:37.321307] [INFO ] [MAIN ] Update Progress: 1069/2369 symbols completed. HVT took 31.4s. Estimated remaining: 3h 3m 6s. Rate: 7.1 symbols/min [2025-10-16T19:30:37.484786] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:30:37.484975] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-16T19:30:37.485032] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-16T19:30:37.485162] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-16T19:30:37.485202] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-16T19:30:37.485242] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-16T19:30:37.485273] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-16T19:30:37.548074] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-16T19:30:37.830249] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:30:38.342795] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-16T19:30:38.424707] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T19:30:38.541710] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T19:30:39.142830] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-16T19:30:39.615717] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T19:30:39.942843] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-16T19:30:40.269279] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-16T19:30:40.742805] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-16T19:30:41.052633] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-16T19:30:41.082563] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-16T19:30:41.542831] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-16T19:30:42.342830] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-16T19:30:43.149627] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-16T19:30:43.151679] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T19:30:43.419123] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T19:30:43.942851] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-16T19:30:44.714102] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T19:30:44.742797] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-16T19:30:44.760137] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T19:30:45.542824] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-16T19:30:45.867940] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-16T19:30:46.342782] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-16T19:30:46.616215] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-16T19:30:46.667579] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-16T19:30:47.142812] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-16T19:30:47.942814] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-16T19:30:48.742774] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-16T19:30:48.936532] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T19:30:49.542843] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-16T19:30:49.589877] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T19:30:49.626815] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-16T19:30:49.774148] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-16T19:30:50.342831] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-16T19:30:51.142830] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-16T19:30:51.942887] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-16T19:30:51.977857] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T19:30:52.079055] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T19:30:52.742811] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-16T19:30:53.492194] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-16T19:30:53.542773] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-16T19:30:54.038711] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-16T19:30:54.335580] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T19:30:54.342762] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-16T19:30:54.832836] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-16T19:30:55.142825] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-16T19:30:55.942796] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-16T19:30:55.980195] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T19:30:56.742803] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-16T19:30:57.055699] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-16T19:30:57.538606] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T19:30:57.547814] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-16T19:30:58.342790] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-16T19:30:58.360882] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T19:30:58.362619] [INFO ] [REMOTE ] HY: Full fetch complete (15005 records). [2025-10-16T19:30:58.362728] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-16T19:30:58.719364] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-16T19:30:58.719436] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-16T19:30:58.719791] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-16T19:30:58.719852] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-16T19:30:58.720317] [DEBUG] [LOCAL ] HY: Trimmed 15005 records to 10116 (keeping 200 days of data) [2025-10-16T19:30:58.782174] [DEBUG] [LOCAL ] HY: Primary data saved (10116 records). [2025-10-16T19:30:58.782311] [INFO ] [MAIN ] HY: Full history saved. [2025-10-16T19:30:58.782391] [INFO ] [MAIN ] Update Progress: 1070/2369 symbols completed. HY took 26.5s. Estimated remaining: 3h 3m 13s. Rate: 7.1 symbols/min [2025-10-16T19:30:58.952084] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:30:58.952271] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-16T19:30:58.952308] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-16T19:30:58.952419] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-16T19:30:58.952459] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-16T19:30:58.952498] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-16T19:30:58.952530] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-16T19:30:59.151688] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-16T19:30:59.310204] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:30:59.535513] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-16T19:30:59.942827] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-16T19:31:00.200593] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-16T19:31:00.742798] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-16T19:31:01.542779] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-16T19:31:01.726673] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T19:31:01.821927] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-16T19:31:02.342877] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-16T19:31:02.636566] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-16T19:31:02.684831] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-16T19:31:03.142839] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-16T19:31:03.942844] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-16T19:31:04.188600] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-16T19:31:04.742792] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-16T19:31:04.895749] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T19:31:04.902369] [INFO ] [REMOTE ] HWM: Full fetch complete (76684 records). [2025-10-16T19:31:04.902508] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-16T19:31:05.006699] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-16T19:31:05.291100] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-16T19:31:05.291177] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-16T19:31:05.292199] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-16T19:31:05.292261] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-16T19:31:05.293628] [DEBUG] [LOCAL ] HWM: Trimmed 76684 records to 53180 (keeping 200 days of data) [2025-10-16T19:31:05.567990] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-16T19:31:05.615864] [DEBUG] [LOCAL ] HWM: Primary data saved (53180 records). [2025-10-16T19:31:05.615980] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-16T19:31:05.616596] [INFO ] [MAIN ] Update Progress: 1071/2369 symbols completed. HWM took 39.7s. Estimated remaining: 3h 3m 3s. Rate: 7.1 symbols/min [2025-10-16T19:31:05.788294] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:31:05.800054] [DEBUG] [LOCAL ] HYI: Loaded 9824 existing records from primary storage. [2025-10-16T19:31:05.800289] [INFO ] [MAIN ] HYI: Loaded 9824 existing records. [2025-10-16T19:31:05.939990] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-16T19:31:05.983058] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:31:05.983319] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-16T19:31:05.983375] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-16T19:31:05.983965] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-16T19:31:05.984028] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-16T19:31:06.348023] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-16T19:31:06.355680] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:31:06.778277] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-16T19:31:07.142809] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-16T19:31:07.874092] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-16T19:31:07.942825] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-16T19:31:08.251247] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-16T19:31:08.742811] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-16T19:31:08.956747] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-10-16T19:31:09.542806] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-16T19:31:09.885239] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-16T19:31:10.342820] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-16T19:31:11.142813] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-16T19:31:11.889205] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T19:31:11.923389] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T19:31:11.942771] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-16T19:31:12.742777] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-16T19:31:12.754369] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T19:31:13.065209] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-16T19:31:13.542858] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-16T19:31:13.793634] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-16T19:31:14.342808] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-16T19:31:14.580966] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-16T19:31:15.142815] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-16T19:31:15.499961] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-16T19:31:15.500616] [INFO ] [REMOTE ] HYBX: Full fetch complete (707 records). [2025-10-16T19:31:15.500727] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-16T19:31:15.679284] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-10-16T19:31:15.679489] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:31:15.679558] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:31:15.679609] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-16T19:31:15.679702] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-16T19:31:15.679768] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-16T19:31:15.679819] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-16T19:31:15.679875] [INFO ] [MAIN ] Update Progress: 1072/2369 symbols completed. HYBX took 16.9s. Estimated remaining: 3h 2m 56s. Rate: 7.1 symbols/min [2025-10-16T19:31:15.856039] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:31:15.887168] [DEBUG] [LOCAL ] HYT: Loaded 33599 existing records from primary storage. [2025-10-16T19:31:15.887464] [INFO ] [MAIN ] HYT: Loaded 33599 existing records. [2025-10-16T19:31:15.948017] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-16T19:31:16.065779] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:31:16.065990] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-16T19:31:16.066038] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-16T19:31:16.066235] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-16T19:31:16.066295] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-16T19:31:16.243004] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-16T19:31:16.428967] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:31:16.742816] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-16T19:31:17.542855] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-16T19:31:18.022704] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-16T19:31:18.028573] [INFO ] [REMOTE ] HYAC: Full fetch complete (923 records). [2025-10-16T19:31:18.030350] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-16T19:31:18.104791] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T19:31:18.219612] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-10-16T19:31:18.219807] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:31:18.219875] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:31:18.220123] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-16T19:31:18.220185] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-16T19:31:18.220223] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-16T19:31:18.220263] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-16T19:31:18.220318] [INFO ] [MAIN ] Update Progress: 1073/2369 symbols completed. HYAC took 40.9s. Estimated remaining: 3h 2m 40s. Rate: 7.1 symbols/min [2025-10-16T19:31:18.347910] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-16T19:31:18.391407] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:31:18.396520] [DEBUG] [LOCAL ] HYTR: Loaded 3132 existing records from primary storage. [2025-10-16T19:31:18.396696] [INFO ] [MAIN ] HYTR: Loaded 3132 existing records. [2025-10-16T19:31:18.581087] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:31:18.581368] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-16T19:31:18.581429] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-16T19:31:18.581567] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-16T19:31:18.581605] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-16T19:31:18.936116] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:31:19.142812] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-16T19:31:19.564629] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-16T19:31:19.729804] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T19:31:19.942813] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-16T19:31:20.742808] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-16T19:31:21.145184] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T19:31:21.487322] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T19:31:21.542773] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-16T19:31:22.336549] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T19:31:22.342765] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-16T19:31:23.015415] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-16T19:31:23.142811] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-16T19:31:23.615947] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T19:31:23.942819] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-16T19:31:24.333636] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-16T19:31:24.742807] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-16T19:31:25.318272] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T19:31:25.542803] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-16T19:31:26.076969] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-16T19:31:26.342810] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-16T19:31:27.028073] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T19:31:27.142839] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-16T19:31:27.942798] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-16T19:31:28.441751] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T19:31:28.742761] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-16T19:31:29.296478] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-16T19:31:29.542776] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-16T19:31:29.569537] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T19:31:30.342824] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-16T19:31:30.824833] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-16T19:31:31.045147] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T19:31:31.142769] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-16T19:31:31.942829] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-16T19:31:32.557974] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T19:31:32.742831] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-16T19:31:33.022535] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-16T19:31:33.028749] [INFO ] [REMOTE ] HXL: Full fetch complete (66467 records). [2025-10-16T19:31:33.028908] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-16T19:31:33.380719] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-16T19:31:33.465631] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-16T19:31:33.465745] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-16T19:31:33.466703] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-16T19:31:33.466769] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-16T19:31:33.468115] [DEBUG] [LOCAL ] HXL: Trimmed 66467 records to 46186 (keeping 200 days of data) [2025-10-16T19:31:33.558333] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-16T19:31:33.748448] [DEBUG] [LOCAL ] HXL: Primary data saved (46186 records). [2025-10-16T19:31:33.748631] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-16T19:31:33.749087] [INFO ] [MAIN ] Update Progress: 1074/2369 symbols completed. HXL took 1m 4s. Estimated remaining: 3h 2m 41s. Rate: 7.1 symbols/min [2025-10-16T19:31:33.915145] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:31:33.942538] [DEBUG] [LOCAL ] HZO: Loaded 29081 existing records from primary storage. [2025-10-16T19:31:33.942831] [INFO ] [MAIN ] HZO: Loaded 29081 existing records. [2025-10-16T19:31:34.100249] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-16T19:31:34.132177] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:31:34.132403] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-16T19:31:34.132474] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-16T19:31:34.132759] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-16T19:31:34.132815] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-16T19:31:34.348116] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-16T19:31:34.498001] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:31:34.712100] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-16T19:31:35.142819] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-16T19:31:35.942813] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-16T19:31:36.365292] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T19:31:36.450021] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-16T19:31:36.742855] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-16T19:31:37.469076] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T19:31:37.542808] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-16T19:31:38.342818] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-16T19:31:38.889016] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T19:31:39.033967] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T19:31:39.035036] [INFO ] [REMOTE ] HYTR: Full fetch complete (4673 records). [2025-10-16T19:31:39.035109] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-16T19:31:39.150891] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-16T19:31:39.462176] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-16T19:31:39.462276] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-16T19:31:39.462476] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-16T19:31:39.462522] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-16T19:31:39.462952] [DEBUG] [LOCAL ] HYTR: Trimmed 4673 records to 3165 (keeping 200 days of data) [2025-10-16T19:31:39.483784] [DEBUG] [LOCAL ] HYTR: Primary data saved (3165 records). [2025-10-16T19:31:39.483898] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-16T19:31:39.483978] [INFO ] [MAIN ] Update Progress: 1075/2369 symbols completed. HYTR took 21.3s. Estimated remaining: 3h 2m 29s. Rate: 7.1 symbols/min [2025-10-16T19:31:39.675748] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:31:39.684488] [DEBUG] [LOCAL ] IAE: Loaded 6256 existing records from primary storage. [2025-10-16T19:31:39.684743] [INFO ] [MAIN ] IAE: Loaded 6256 existing records. [2025-10-16T19:31:39.862979] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:31:39.863214] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-16T19:31:39.863271] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-16T19:31:39.863448] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-16T19:31:39.863504] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-16T19:31:39.952556] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-16T19:31:40.231148] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:31:40.562022] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T19:31:40.742764] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-16T19:31:40.998307] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-16T19:31:41.445064] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-16T19:31:41.542793] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-16T19:31:42.342787] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-16T19:31:42.501746] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T19:31:42.941530] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-16T19:31:43.142795] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-16T19:31:43.942777] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-16T19:31:44.335377] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T19:31:44.742823] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-16T19:31:45.080612] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-16T19:31:45.325114] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T19:31:45.329844] [INFO ] [REMOTE ] HYT: Full fetch complete (47958 records). [2025-10-16T19:31:45.329964] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-16T19:31:45.549112] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-16T19:31:45.710027] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-16T19:31:45.710115] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-16T19:31:45.710932] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-16T19:31:45.710993] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-16T19:31:45.712119] [DEBUG] [LOCAL ] HYT: Trimmed 47958 records to 33837 (keeping 200 days of data) [2025-10-16T19:31:45.915262] [DEBUG] [LOCAL ] HYT: Primary data saved (33837 records). [2025-10-16T19:31:45.915399] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-16T19:31:45.915477] [INFO ] [MAIN ] Update Progress: 1076/2369 symbols completed. HYT took 30.2s. Estimated remaining: 3h 2m 18s. Rate: 7.1 symbols/min [2025-10-16T19:31:46.083282] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:31:46.132232] [DEBUG] [LOCAL ] IAG: Loaded 53488 existing records from primary storage. [2025-10-16T19:31:46.132562] [INFO ] [MAIN ] IAG: Loaded 53488 existing records. [2025-10-16T19:31:46.314260] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:31:46.314511] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-16T19:31:46.314562] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-16T19:31:46.314756] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-16T19:31:46.314813] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-16T19:31:46.348062] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-16T19:31:46.676167] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:31:46.692253] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T19:31:47.142820] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-16T19:31:47.318339] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T19:31:47.320745] [INFO ] [REMOTE ] HYI: Full fetch complete (13984 records). [2025-10-16T19:31:47.320815] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-16T19:31:47.682198] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-16T19:31:47.682288] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-16T19:31:47.682683] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-16T19:31:47.682777] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-16T19:31:47.683275] [DEBUG] [LOCAL ] HYI: Trimmed 13984 records to 9891 (keeping 200 days of data) [2025-10-16T19:31:47.746847] [DEBUG] [LOCAL ] HYI: Primary data saved (9891 records). [2025-10-16T19:31:47.751589] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-16T19:31:47.752229] [INFO ] [MAIN ] Update Progress: 1077/2369 symbols completed. HYI took 42.1s. Estimated remaining: 3h 2m 1s. Rate: 7.1 symbols/min [2025-10-16T19:31:47.752444] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-16T19:31:47.942846] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-16T19:31:48.742830] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-16T19:31:49.362280] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-16T19:31:49.542844] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-16T19:31:49.731306] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T19:31:49.887282] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-16T19:31:50.342820] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-16T19:31:51.142873] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-16T19:31:51.818879] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-16T19:31:51.942786] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-16T19:31:52.143576] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-16T19:31:52.562314] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-16T19:31:52.742845] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-16T19:31:53.433813] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-16T19:31:53.542828] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-16T19:31:54.130368] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-16T19:31:54.342830] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-16T19:31:55.071142] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T19:31:55.142874] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-16T19:31:55.942829] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-16T19:31:56.669921] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T19:31:56.742775] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-16T19:31:56.792191] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-16T19:31:57.542856] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-16T19:31:58.342840] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-16T19:31:58.401669] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T19:31:59.075756] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T19:31:59.092639] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T19:31:59.094768] [INFO ] [REMOTE ] IAE: Full fetch complete (9053 records). [2025-10-16T19:31:59.094885] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-16T19:31:59.151262] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-16T19:31:59.467121] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-16T19:31:59.467195] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-16T19:31:59.467412] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-16T19:31:59.467451] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-16T19:31:59.467892] [DEBUG] [LOCAL ] IAE: Trimmed 9053 records to 6326 (keeping 200 days of data) [2025-10-16T19:31:59.504084] [DEBUG] [LOCAL ] IAE: Primary data saved (6326 records). [2025-10-16T19:31:59.504224] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-16T19:31:59.504306] [INFO ] [MAIN ] Update Progress: 1078/2369 symbols completed. IAE took 20.0s. Estimated remaining: 3h 1m 57s. Rate: 7.1 symbols/min [2025-10-16T19:31:59.942822] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-16T19:32:01.274408] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T19:32:01.281747] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-16T19:32:01.393540] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-16T19:32:01.542916] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-16T19:32:02.440529] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-16T19:32:02.447594] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-16T19:32:03.273901] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T19:32:03.285985] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-16T19:32:03.629767] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-16T19:32:03.942924] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-16T19:32:05.203304] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T19:32:05.216420] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-16T19:32:05.222960] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-16T19:32:05.542861] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-16T19:32:06.517571] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T19:32:06.525083] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-16T19:32:07.152249] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T19:32:07.164633] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-16T19:32:07.738836] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T19:32:07.742748] [INFO ] [REMOTE ] HZO: Full fetch complete (41409 records). [2025-10-16T19:32:07.742848] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-16T19:32:08.107329] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-16T19:32:08.107408] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-16T19:32:08.108159] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-16T19:32:08.108221] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-16T19:32:08.109138] [DEBUG] [LOCAL ] HZO: Trimmed 41409 records to 29275 (keeping 200 days of data) [2025-10-16T19:32:08.275456] [DEBUG] [LOCAL ] HZO: Primary data saved (29275 records). [2025-10-16T19:32:08.275605] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-16T19:32:08.275710] [INFO ] [MAIN ] Update Progress: 1079/2369 symbols completed. HZO took 34.5s. Estimated remaining: 3h 1m 49s. Rate: 7.1 symbols/min [2025-10-16T19:32:09.070505] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T19:32:09.083160] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-16T19:32:11.160934] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-16T19:32:11.172531] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-16T19:32:13.275628] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-16T19:32:13.282616] [INFO ] [REMOTE ] IAG: Full fetch complete (77488 records). [2025-10-16T19:32:13.282804] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-16T19:32:13.665963] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-16T19:32:13.666095] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-16T19:32:13.667182] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-16T19:32:13.667455] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-16T19:32:13.669512] [DEBUG] [LOCAL ] IAG: Trimmed 77488 records to 53878 (keeping 200 days of data) [2025-10-16T19:32:13.969364] [DEBUG] [LOCAL ] IAG: Primary data saved (53878 records). [2025-10-16T19:32:13.969505] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-16T19:32:13.969586] [INFO ] [MAIN ] Update Progress: 1080/2369 symbols completed. IAG took 28.1s. Estimated remaining: 3h 1m 37s. Rate: 7.1 symbols/min [2025-10-16T19:32:14.482383] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:32:14.626029] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:32:14.664066] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:32:14.684587] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:32:14.726536] [DEBUG] [LOCAL ] IBTA: Loaded 36655 existing records from primary storage. [2025-10-16T19:32:14.727006] [INFO ] [MAIN ] IBTA: Loaded 36655 existing records. [2025-10-16T19:32:14.842142] [DEBUG] [LOCAL ] IBP: Loaded 28891 existing records from primary storage. [2025-10-16T19:32:14.871717] [INFO ] [MAIN ] IBP: Loaded 28891 existing records. [2025-10-16T19:32:15.037028] [DEBUG] [LOCAL ] IBM: Loaded 53633 existing records from primary storage. [2025-10-16T19:32:15.076473] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:32:15.086631] [INFO ] [MAIN ] IBM: Loaded 53633 existing records. [2025-10-16T19:32:15.092692] [DEBUG] [LOCAL ] IBN: Loaded 52819 existing records from primary storage. [2025-10-16T19:32:15.086327] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-16T19:32:15.136240] [INFO ] [MAIN ] IBN: Loaded 52819 existing records. [2025-10-16T19:32:15.141441] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-16T19:32:15.259112] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-16T19:32:15.293048] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-16T19:32:15.405272] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:32:15.441471] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-16T19:32:15.446749] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-16T19:32:15.535144] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-16T19:32:15.550728] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-16T19:32:15.678610] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:32:15.766174] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-16T19:32:15.802907] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:32:15.800056] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-16T19:32:15.837425] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-16T19:32:15.827046] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-16T19:32:15.848034] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-16T19:32:15.861754] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-16T19:32:15.934696] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-16T19:32:15.939961] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-16T19:32:16.345696] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:32:16.381485] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-16T19:32:16.954929] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:32:17.013965] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-16T19:32:17.003159] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:32:17.043575] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-16T19:32:17.075401] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:32:17.075786] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-16T19:32:17.876106] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T19:32:17.885560] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-16T19:32:18.289037] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-16T19:32:18.294438] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-16T19:32:18.780276] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T19:32:18.800395] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T19:32:18.810605] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-16T19:32:18.811515] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-16T19:32:18.885418] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T19:32:18.896313] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-16T19:32:19.484899] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T19:32:19.490288] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-16T19:32:19.986571] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T19:32:19.991723] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-16T19:32:20.130598] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T19:32:20.141452] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-16T19:32:20.806420] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T19:32:20.812356] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-16T19:32:21.084270] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-16T19:32:21.097676] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-16T19:32:21.377235] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T19:32:21.387025] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-16T19:32:21.679860] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-16T19:32:21.686255] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-16T19:32:21.828988] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T19:32:22.342809] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-16T19:32:22.611130] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-16T19:32:22.773523] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T19:32:22.858156] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T19:32:23.142817] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-16T19:32:23.735360] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T19:32:23.942832] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-16T19:32:24.742816] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-16T19:32:25.261228] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-16T19:32:25.542821] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-16T19:32:25.842933] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T19:32:26.080021] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T19:32:26.342824] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-16T19:32:26.516701] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T19:32:27.142806] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-16T19:32:27.942800] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-16T19:32:28.106030] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T19:32:28.180006] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T19:32:28.742893] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-16T19:32:29.542815] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-16T19:32:29.980037] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T19:32:30.222684] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-16T19:32:30.342773] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-16T19:32:30.801100] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T19:32:31.142843] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-16T19:32:31.698103] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T19:32:31.942818] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-16T19:32:32.430962] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T19:32:32.742781] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-16T19:32:33.122462] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-16T19:32:33.542808] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-16T19:32:34.321744] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T19:32:34.342963] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-16T19:32:35.142829] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-16T19:32:35.224774] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T19:32:35.329580] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T19:32:35.942835] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-16T19:32:36.446058] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T19:32:36.449869] [INFO ] [REMOTE ] IBP: Full fetch complete (41129 records). [2025-10-16T19:32:36.449961] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-16T19:32:36.747944] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-16T19:32:36.829226] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-16T19:32:36.829310] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-16T19:32:36.830111] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-16T19:32:36.830175] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-16T19:32:36.831216] [DEBUG] [LOCAL ] IBP: Trimmed 41129 records to 29018 (keeping 200 days of data) [2025-10-16T19:32:37.007042] [DEBUG] [LOCAL ] IBP: Primary data saved (29018 records). [2025-10-16T19:32:37.007173] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-16T19:32:37.007249] [INFO ] [MAIN ] Update Progress: 1081/2369 symbols completed. IBP took 23.0s. Estimated remaining: 3h 1m 46s. Rate: 7.1 symbols/min [2025-10-16T19:32:37.174663] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:32:37.225237] [DEBUG] [LOCAL ] ICE: Loaded 53018 existing records from primary storage. [2025-10-16T19:32:37.225587] [INFO ] [MAIN ] ICE: Loaded 53018 existing records. [2025-10-16T19:32:37.403564] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:32:37.403772] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-16T19:32:37.403843] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-16T19:32:37.404179] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-16T19:32:37.404238] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-16T19:32:37.547978] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-16T19:32:37.775666] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:32:37.847272] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T19:32:37.892412] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T19:32:37.897073] [INFO ] [REMOTE ] IBTA: Full fetch complete (51182 records). [2025-10-16T19:32:37.897165] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-16T19:32:38.288200] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-16T19:32:38.288279] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-16T19:32:38.289175] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-16T19:32:38.289237] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-16T19:32:38.290307] [DEBUG] [LOCAL ] IBTA: Trimmed 51182 records to 36892 (keeping 200 days of data) [2025-10-16T19:32:38.345039] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-16T19:32:38.501055] [DEBUG] [LOCAL ] IBTA: Primary data saved (36892 records). [2025-10-16T19:32:38.501232] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-16T19:32:38.501352] [INFO ] [MAIN ] Update Progress: 1082/2369 symbols completed. IBTA took 24.5s. Estimated remaining: 3h 1m 29s. Rate: 7.1 symbols/min [2025-10-16T19:32:38.671782] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:32:38.708132] [DEBUG] [LOCAL ] ICL: Loaded 38552 existing records from primary storage. [2025-10-16T19:32:38.708411] [INFO ] [MAIN ] ICL: Loaded 38552 existing records. [2025-10-16T19:32:38.885188] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:32:38.885376] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-16T19:32:38.885422] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-16T19:32:38.885618] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-16T19:32:38.885706] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-16T19:32:39.149299] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-16T19:32:39.246343] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:32:39.342519] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T19:32:39.942816] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-16T19:32:40.145168] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-16T19:32:40.556608] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T19:32:40.742807] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-16T19:32:41.456450] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T19:32:41.542816] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-16T19:32:42.342827] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-16T19:32:42.422956] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T19:32:43.142791] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-16T19:32:43.232556] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T19:32:43.773330] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T19:32:43.942841] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-16T19:32:44.533232] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:32:44.742814] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-16T19:32:45.542851] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-16T19:32:45.634750] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T19:32:46.132217] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:32:46.342815] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-16T19:32:47.142869] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-16T19:32:47.426275] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T19:32:47.835365] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T19:32:47.942854] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-16T19:32:48.742849] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-16T19:32:49.554287] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-16T19:32:49.561515] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-16T19:32:49.621690] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T19:32:50.342814] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-16T19:32:50.562379] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T19:32:50.569295] [INFO ] [REMOTE ] IBN: Full fetch complete (76548 records). [2025-10-16T19:32:50.569448] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-16T19:32:50.970009] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-16T19:32:50.970383] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-16T19:32:50.971768] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-16T19:32:50.971878] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-16T19:32:50.973820] [DEBUG] [LOCAL ] IBN: Trimmed 76548 records to 53205 (keeping 200 days of data) [2025-10-16T19:32:51.094166] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T19:32:51.181383] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-16T19:32:51.331002] [DEBUG] [LOCAL ] IBN: Primary data saved (53205 records). [2025-10-16T19:32:51.331149] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-16T19:32:51.331997] [INFO ] [MAIN ] Update Progress: 1083/2369 symbols completed. IBN took 37.4s. Estimated remaining: 3h 1m 26s. Rate: 7.1 symbols/min [2025-10-16T19:32:51.501807] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:32:51.542670] [DEBUG] [LOCAL ] IDA: Loaded 32824 existing records from primary storage. [2025-10-16T19:32:51.542969] [INFO ] [MAIN ] IDA: Loaded 32824 existing records. [2025-10-16T19:32:51.742121] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:32:51.742377] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-16T19:32:51.742435] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-16T19:32:51.742629] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-16T19:32:51.742735] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-16T19:32:51.948556] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-16T19:32:52.108068] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:32:52.241832] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T19:32:52.637812] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T19:32:52.742836] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-16T19:32:53.542922] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-16T19:32:54.015501] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T19:32:54.342800] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-16T19:32:54.382210] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-16T19:32:55.142850] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-16T19:32:55.214287] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T19:32:55.770865] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T19:32:55.942825] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-16T19:32:56.742822] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-16T19:32:57.095460] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T19:32:57.472834] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-16T19:32:57.542860] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-16T19:32:58.082042] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T19:32:58.342833] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-16T19:32:58.362281] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-16T19:32:58.369239] [INFO ] [REMOTE ] IBM: Full fetch complete (77739 records). [2025-10-16T19:32:58.369371] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-16T19:32:58.752941] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-16T19:32:58.753043] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-16T19:32:58.754120] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-16T19:32:58.754182] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-16T19:32:58.755675] [DEBUG] [LOCAL ] IBM: Trimmed 77739 records to 54023 (keeping 200 days of data) [2025-10-16T19:32:59.084225] [DEBUG] [LOCAL ] IBM: Primary data saved (54023 records). [2025-10-16T19:32:59.084336] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-16T19:32:59.085095] [INFO ] [MAIN ] Update Progress: 1084/2369 symbols completed. IBM took 45.1s. Estimated remaining: 3h 1m 17s. Rate: 7.1 symbols/min [2025-10-16T19:32:59.148064] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-16T19:32:59.254293] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:32:59.267153] [DEBUG] [LOCAL ] IDE: Loaded 9108 existing records from primary storage. [2025-10-16T19:32:59.267385] [INFO ] [MAIN ] IDE: Loaded 9108 existing records. [2025-10-16T19:32:59.443887] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:32:59.444160] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-16T19:32:59.444216] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-16T19:32:59.444358] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-16T19:32:59.444396] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-16T19:32:59.825453] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T19:32:59.829151] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:32:59.942829] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-16T19:33:00.546549] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T19:33:00.742818] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-16T19:33:01.444517] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T19:33:01.453003] [INFO ] [REMOTE ] ICL: Full fetch complete (56207 records). [2025-10-16T19:33:01.453166] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-16T19:33:01.548748] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-16T19:33:01.852821] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-16T19:33:01.852899] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-16T19:33:01.853794] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-16T19:33:01.853880] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-16T19:33:01.855057] [DEBUG] [LOCAL ] ICL: Trimmed 56207 records to 38831 (keeping 200 days of data) [2025-10-16T19:33:02.077918] [DEBUG] [LOCAL ] ICL: Primary data saved (38831 records). [2025-10-16T19:33:02.078058] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-16T19:33:02.078138] [INFO ] [MAIN ] Update Progress: 1085/2369 symbols completed. ICL took 23.6s. Estimated remaining: 3h 1m 2s. Rate: 7.1 symbols/min [2025-10-16T19:33:02.219584] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-16T19:33:02.277304] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:33:02.295777] [DEBUG] [LOCAL ] IDT: Loaded 18488 existing records from primary storage. [2025-10-16T19:33:02.296037] [INFO ] [MAIN ] IDT: Loaded 18488 existing records. [2025-10-16T19:33:02.348467] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-16T19:33:02.480075] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:33:02.480424] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-16T19:33:02.480507] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-16T19:33:02.480790] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-16T19:33:02.480864] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-16T19:33:02.860022] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:33:02.891295] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-16T19:33:03.142897] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-16T19:33:03.626160] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T19:33:03.942848] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-16T19:33:04.613125] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T19:33:04.744060] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-16T19:33:04.746507] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T19:33:05.542793] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-16T19:33:05.882863] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T19:33:06.271047] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T19:33:06.342857] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-16T19:33:06.958400] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-16T19:33:07.142819] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-16T19:33:07.942819] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-16T19:33:08.742820] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-16T19:33:08.801362] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-16T19:33:08.989890] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T19:33:09.500285] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T19:33:09.542837] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-16T19:33:10.291379] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-16T19:33:10.342783] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-16T19:33:11.066693] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T19:33:11.142781] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-16T19:33:11.942788] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-16T19:33:11.978163] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T19:33:12.742814] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-16T19:33:13.399618] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T19:33:13.542810] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-16T19:33:14.342791] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-16T19:33:14.667757] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-16T19:33:14.675091] [INFO ] [REMOTE ] ICE: Full fetch complete (76977 records). [2025-10-16T19:33:14.675244] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-16T19:33:14.946238] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T19:33:15.115786] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-16T19:33:15.116037] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T19:33:15.116213] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-16T19:33:15.120219] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-16T19:33:15.120290] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-16T19:33:15.121604] [DEBUG] [LOCAL ] ICE: Trimmed 76977 records to 53408 (keeping 200 days of data) [2025-10-16T19:33:15.177373] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-16T19:33:15.466043] [DEBUG] [LOCAL ] ICE: Primary data saved (53408 records). [2025-10-16T19:33:15.466189] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-16T19:33:15.466713] [INFO ] [MAIN ] Update Progress: 1086/2369 symbols completed. ICE took 38.5s. Estimated remaining: 3h 0m 59s. Rate: 7.1 symbols/min [2025-10-16T19:33:15.632699] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:33:15.670614] [DEBUG] [LOCAL ] IEX: Loaded 38458 existing records from primary storage. [2025-10-16T19:33:15.670927] [INFO ] [MAIN ] IEX: Loaded 38458 existing records. [2025-10-16T19:33:15.846591] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:33:15.846912] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-16T19:33:15.847000] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-16T19:33:15.847284] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-16T19:33:15.847374] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-16T19:33:15.944933] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-16T19:33:16.152159] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T19:33:16.219049] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:33:16.709835] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T19:33:16.742781] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-16T19:33:17.542881] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-16T19:33:18.244823] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T19:33:18.342822] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-16T19:33:18.917117] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T19:33:19.119080] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-16T19:33:19.142777] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-16T19:33:19.913014] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-16T19:33:19.915128] [INFO ] [REMOTE ] IDE: Full fetch complete (12802 records). [2025-10-16T19:33:19.915202] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-16T19:33:19.947891] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-16T19:33:20.268225] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-16T19:33:20.268298] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-16T19:33:20.268605] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-16T19:33:20.268697] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-16T19:33:20.269159] [DEBUG] [LOCAL ] IDE: Trimmed 12802 records to 9225 (keeping 200 days of data) [2025-10-16T19:33:20.322906] [DEBUG] [LOCAL ] IDE: Primary data saved (9225 records). [2025-10-16T19:33:20.323012] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-16T19:33:20.323087] [INFO ] [MAIN ] Update Progress: 1087/2369 symbols completed. IDE took 21.2s. Estimated remaining: 3h 0m 46s. Rate: 7.1 symbols/min [2025-10-16T19:33:20.487003] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:33:20.535069] [DEBUG] [LOCAL ] IFF: Loaded 51147 existing records from primary storage. [2025-10-16T19:33:20.535387] [INFO ] [MAIN ] IFF: Loaded 51147 existing records. [2025-10-16T19:33:20.711080] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:33:20.711328] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-16T19:33:20.711381] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-16T19:33:20.711614] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-16T19:33:20.711726] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-16T19:33:20.747991] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-16T19:33:21.074949] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T19:33:21.078934] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:33:21.542830] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-16T19:33:22.233691] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T19:33:22.342809] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-16T19:33:22.654125] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T19:33:23.142812] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-16T19:33:23.696297] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:33:23.942812] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-16T19:33:23.965663] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T19:33:24.742820] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-16T19:33:25.457673] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T19:33:25.542811] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-16T19:33:25.689706] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T19:33:26.342799] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-16T19:33:27.069886] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T19:33:27.142776] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-16T19:33:27.681456] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T19:33:27.685672] [INFO ] [REMOTE ] IDA: Full fetch complete (45282 records). [2025-10-16T19:33:27.685775] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-16T19:33:27.948011] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-16T19:33:28.094517] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-16T19:33:28.094592] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-16T19:33:28.095391] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-16T19:33:28.095452] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-16T19:33:28.096372] [DEBUG] [LOCAL ] IDA: Trimmed 45282 records to 32985 (keeping 200 days of data) [2025-10-16T19:33:28.301281] [DEBUG] [LOCAL ] IDA: Primary data saved (32985 records). [2025-10-16T19:33:28.301417] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-16T19:33:28.301494] [INFO ] [MAIN ] Update Progress: 1088/2369 symbols completed. IDA took 37.0s. Estimated remaining: 3h 0m 37s. Rate: 7.1 symbols/min [2025-10-16T19:33:28.470588] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:33:28.490246] [DEBUG] [LOCAL ] IFN: Loaded 18517 existing records from primary storage. [2025-10-16T19:33:28.490485] [INFO ] [MAIN ] IFN: Loaded 18517 existing records. [2025-10-16T19:33:28.666100] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:33:28.666397] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-16T19:33:28.666451] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-16T19:33:28.666605] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-16T19:33:28.666671] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-16T19:33:28.744975] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-16T19:33:29.037444] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:33:29.067614] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T19:33:29.434842] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T19:33:29.478762] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T19:33:29.542776] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-16T19:33:30.342831] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-16T19:33:30.995204] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T19:33:31.142788] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-16T19:33:31.457774] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T19:33:31.942824] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-16T19:33:32.645955] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T19:33:32.725036] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T19:33:32.742772] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-16T19:33:33.542830] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-16T19:33:34.317778] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T19:33:34.342768] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-16T19:33:34.379664] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T19:33:35.142862] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-16T19:33:35.843312] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T19:33:35.942800] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-16T19:33:36.335337] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T19:33:36.742815] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-16T19:33:37.437827] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T19:33:37.442496] [INFO ] [REMOTE ] IEX: Full fetch complete (53745 records). [2025-10-16T19:33:37.442603] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-16T19:33:37.547884] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-16T19:33:37.830138] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-16T19:33:37.830252] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-16T19:33:37.831426] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-16T19:33:37.831532] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-16T19:33:37.833225] [DEBUG] [LOCAL ] IEX: Trimmed 53745 records to 38731 (keeping 200 days of data) [2025-10-16T19:33:37.973738] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T19:33:38.128157] [DEBUG] [LOCAL ] IEX: Primary data saved (38731 records). [2025-10-16T19:33:38.128296] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-16T19:33:38.128988] [INFO ] [MAIN ] Update Progress: 1089/2369 symbols completed. IEX took 22.7s. Estimated remaining: 3h 0m 31s. Rate: 7.1 symbols/min [2025-10-16T19:33:38.293159] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:33:38.316543] [DEBUG] [LOCAL ] IFS: Loaded 22636 existing records from primary storage. [2025-10-16T19:33:38.316816] [INFO ] [MAIN ] IFS: Loaded 22636 existing records. [2025-10-16T19:33:38.347896] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-16T19:33:38.505208] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:33:38.505428] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-16T19:33:38.505482] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-16T19:33:38.505789] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-16T19:33:38.505847] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-16T19:33:38.833220] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T19:33:38.875783] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:33:39.142799] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-16T19:33:39.499505] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T19:33:39.886613] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T19:33:39.942835] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-16T19:33:40.742829] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-16T19:33:40.962021] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-16T19:33:41.542792] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-16T19:33:41.664481] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T19:33:42.342849] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-16T19:33:42.523909] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T19:33:43.142827] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-16T19:33:43.380956] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-16T19:33:43.942796] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-16T19:33:44.393547] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T19:33:44.742794] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-16T19:33:45.542835] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-16T19:33:45.623888] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T19:33:45.937365] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T19:33:46.342872] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-16T19:33:47.131253] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T19:33:47.134671] [INFO ] [REMOTE ] IDT: Full fetch complete (23825 records). [2025-10-16T19:33:47.134745] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-16T19:33:47.148070] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-16T19:33:47.505403] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-16T19:33:47.505488] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-16T19:33:47.506120] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-16T19:33:47.506181] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-16T19:33:47.506986] [DEBUG] [LOCAL ] IDT: Trimmed 23825 records to 18660 (keeping 200 days of data) [2025-10-16T19:33:47.621129] [DEBUG] [LOCAL ] IDT: Primary data saved (18660 records). [2025-10-16T19:33:47.621287] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-16T19:33:47.621371] [INFO ] [MAIN ] Update Progress: 1090/2369 symbols completed. IDT took 45.5s. Estimated remaining: 3h 0m 23s. Rate: 7.1 symbols/min [2025-10-16T19:33:47.797202] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:33:47.809086] [DEBUG] [LOCAL ] IGA: Loaded 10170 existing records from primary storage. [2025-10-16T19:33:47.809315] [INFO ] [MAIN ] IGA: Loaded 10170 existing records. [2025-10-16T19:33:47.945715] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-16T19:33:47.987421] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:33:47.987947] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-16T19:33:47.988089] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-16T19:33:47.988394] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-16T19:33:47.988450] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-16T19:33:48.177871] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T19:33:48.320129] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-16T19:33:48.406013] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:33:48.683282] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-16T19:33:48.742771] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-16T19:33:49.542848] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-16T19:33:49.742120] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T19:33:50.342804] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-16T19:33:51.142771] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-16T19:33:51.257999] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T19:33:51.342884] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T19:33:51.942802] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-16T19:33:52.068373] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T19:33:52.742784] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-16T19:33:52.893863] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T19:33:53.502683] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T19:33:53.542805] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-16T19:33:54.342850] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-16T19:33:54.532318] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T19:33:54.536603] [INFO ] [REMOTE ] IFN: Full fetch complete (28561 records). [2025-10-16T19:33:54.536736] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-16T19:33:54.904204] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-16T19:33:54.904297] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-16T19:33:54.904944] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-16T19:33:54.905003] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-16T19:33:54.905638] [DEBUG] [LOCAL ] IFN: Trimmed 28561 records to 18627 (keeping 200 days of data) [2025-10-16T19:33:55.014737] [DEBUG] [LOCAL ] IFN: Primary data saved (18627 records). [2025-10-16T19:33:55.014917] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-16T19:33:55.015110] [INFO ] [MAIN ] Update Progress: 1091/2369 symbols completed. IFN took 26.7s. Estimated remaining: 3h 0m 14s. Rate: 7.1 symbols/min [2025-10-16T19:33:55.129556] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-16T19:33:55.147889] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-16T19:33:55.189793] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:33:55.208631] [DEBUG] [LOCAL ] IGD: Loaded 19405 existing records from primary storage. [2025-10-16T19:33:55.208894] [INFO ] [MAIN ] IGD: Loaded 19405 existing records. [2025-10-16T19:33:55.380949] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:33:55.381113] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-16T19:33:55.381159] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-16T19:33:55.381336] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-16T19:33:55.381391] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-16T19:33:55.724043] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:33:55.942797] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-16T19:33:56.396225] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-16T19:33:56.680759] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T19:33:56.742840] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-16T19:33:57.542854] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-16T19:33:58.342796] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-16T19:33:58.539676] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T19:33:58.735876] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T19:33:58.874736] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-16T19:33:59.142803] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-16T19:33:59.942855] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-16T19:34:00.284116] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-16T19:34:00.742877] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-16T19:34:01.542788] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-16T19:34:01.987036] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-16T19:34:02.011933] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T19:34:02.342857] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-16T19:34:02.406484] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T19:34:03.142820] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-16T19:34:03.942852] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-16T19:34:03.980096] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T19:34:04.394418] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T19:34:04.742828] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-16T19:34:05.082556] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T19:34:05.542790] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-16T19:34:06.342888] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-16T19:34:06.481168] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T19:34:06.590777] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-16T19:34:07.142871] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-16T19:34:07.350384] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T19:34:07.837768] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T19:34:07.942825] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-16T19:34:08.742811] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-16T19:34:09.542803] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-16T19:34:09.612567] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-16T19:34:09.695838] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T19:34:10.342796] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-16T19:34:10.536437] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T19:34:11.089974] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-16T19:34:11.142793] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-16T19:34:11.942878] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-16T19:34:12.674822] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T19:34:12.742798] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-16T19:34:12.822828] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T19:34:12.829751] [INFO ] [REMOTE ] IFF: Full fetch complete (73610 records). [2025-10-16T19:34:12.829877] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-16T19:34:13.231038] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-16T19:34:13.231131] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-16T19:34:13.232163] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-16T19:34:13.232224] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-16T19:34:13.233578] [DEBUG] [LOCAL ] IFF: Trimmed 73610 records to 51530 (keeping 200 days of data) [2025-10-16T19:34:13.542882] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-16T19:34:13.552440] [DEBUG] [LOCAL ] IFF: Primary data saved (51530 records). [2025-10-16T19:34:13.552740] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-16T19:34:13.553403] [INFO ] [MAIN ] Update Progress: 1092/2369 symbols completed. IFF took 53.2s. Estimated remaining: 3h 0m 17s. Rate: 7.1 symbols/min [2025-10-16T19:34:13.722770] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:34:13.730980] [DEBUG] [LOCAL ] IGI: Loaded 3999 existing records from primary storage. [2025-10-16T19:34:13.731202] [INFO ] [MAIN ] IGI: Loaded 3999 existing records. [2025-10-16T19:34:13.911948] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:34:13.912247] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-16T19:34:13.912305] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-16T19:34:13.912444] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-16T19:34:13.912499] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-16T19:34:14.166109] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T19:34:14.311575] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:34:14.342780] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-16T19:34:14.456851] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-16T19:34:15.142786] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-16T19:34:15.380298] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-16T19:34:15.942877] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-16T19:34:16.038288] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T19:34:16.742846] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-16T19:34:16.754148] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T19:34:16.757067] [INFO ] [REMOTE ] IFS: Full fetch complete (32075 records). [2025-10-16T19:34:16.757137] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-16T19:34:17.144861] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-16T19:34:17.144948] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-16T19:34:17.145731] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-16T19:34:17.145794] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-16T19:34:17.146711] [DEBUG] [LOCAL ] IFS: Trimmed 32075 records to 22745 (keeping 200 days of data) [2025-10-16T19:34:17.284159] [DEBUG] [LOCAL ] IFS: Primary data saved (22745 records). [2025-10-16T19:34:17.284289] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-16T19:34:17.284395] [INFO ] [MAIN ] Update Progress: 1093/2369 symbols completed. IFS took 39.2s. Estimated remaining: 3h 0m 3s. Rate: 7.1 symbols/min [2025-10-16T19:34:17.321151] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T19:34:17.462771] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:34:17.492205] [DEBUG] [LOCAL ] IGR: Loaded 30438 existing records from primary storage. [2025-10-16T19:34:17.492461] [INFO ] [MAIN ] IGR: Loaded 30438 existing records. [2025-10-16T19:34:17.548078] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-16T19:34:17.677309] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:34:17.677513] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-16T19:34:17.677561] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-16T19:34:17.677779] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-16T19:34:17.677836] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-16T19:34:18.038167] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:34:18.342817] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-16T19:34:18.442871] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T19:34:18.444933] [INFO ] [REMOTE ] IGA: Full fetch complete (14220 records). [2025-10-16T19:34:18.445001] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-16T19:34:18.805213] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-16T19:34:18.805311] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-16T19:34:18.805701] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-16T19:34:18.805764] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-16T19:34:18.806327] [DEBUG] [LOCAL ] IGA: Trimmed 14220 records to 10286 (keeping 200 days of data) [2025-10-16T19:34:18.866911] [DEBUG] [LOCAL ] IGA: Primary data saved (10286 records). [2025-10-16T19:34:18.867072] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-16T19:34:18.867163] [INFO ] [MAIN ] Update Progress: 1094/2369 symbols completed. IGA took 31.2s. Estimated remaining: 2h 59m 46s. Rate: 7.1 symbols/min [2025-10-16T19:34:19.036914] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:34:19.042066] [DEBUG] [LOCAL ] IH: Loaded 2799 existing records from primary storage. [2025-10-16T19:34:19.042238] [INFO ] [MAIN ] IH: Loaded 2799 existing records. [2025-10-16T19:34:19.143187] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-16T19:34:19.223685] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:34:19.223909] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-16T19:34:19.223958] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-16T19:34:19.224111] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-16T19:34:19.224168] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-16T19:34:19.593992] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:34:19.606391] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-16T19:34:19.945823] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-16T19:34:19.948437] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T19:34:20.513764] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-16T19:34:20.742858] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-16T19:34:21.199874] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-16T19:34:21.542832] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-16T19:34:22.075154] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-16T19:34:22.342844] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-16T19:34:23.142832] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-16T19:34:23.608852] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T19:34:23.709472] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T19:34:23.942833] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-16T19:34:24.509229] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T19:34:24.742815] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-16T19:34:25.542807] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-16T19:34:26.091448] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:34:26.342826] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-16T19:34:26.528229] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T19:34:27.142815] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-16T19:34:27.365550] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T19:34:27.580693] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-16T19:34:27.942821] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-16T19:34:28.388040] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-16T19:34:28.742823] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-16T19:34:29.542829] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-16T19:34:29.976259] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-16T19:34:30.087232] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T19:34:30.342817] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-16T19:34:31.142785] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-16T19:34:31.564736] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T19:34:31.777938] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-16T19:34:31.942802] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-16T19:34:32.538966] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T19:34:32.742801] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-16T19:34:33.542835] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-16T19:34:33.736146] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T19:34:34.148050] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-16T19:34:34.342844] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-16T19:34:35.142881] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-16T19:34:35.370283] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T19:34:35.575242] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-16T19:34:35.942835] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-16T19:34:36.497507] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-16T19:34:36.742841] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-16T19:34:37.184195] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T19:34:37.542862] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-16T19:34:38.342892] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-16T19:34:38.583637] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T19:34:39.043425] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-16T19:34:39.142793] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-16T19:34:39.942873] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-16T19:34:40.113050] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T19:34:40.742836] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-16T19:34:41.364131] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T19:34:41.384971] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-16T19:34:41.542815] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-16T19:34:42.342828] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-16T19:34:42.887863] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-16T19:34:42.955011] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T19:34:43.142812] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-16T19:34:43.942815] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-16T19:34:44.446771] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T19:34:44.675504] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T19:34:44.677046] [INFO ] [REMOTE ] IGI: Full fetch complete (5488 records). [2025-10-16T19:34:44.677116] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-16T19:34:44.747999] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-16T19:34:45.039154] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-16T19:34:45.039231] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-16T19:34:45.039406] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-16T19:34:45.039444] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-16T19:34:45.039838] [DEBUG] [LOCAL ] IGI: Trimmed 5488 records to 4035 (keeping 200 days of data) [2025-10-16T19:34:45.064396] [DEBUG] [LOCAL ] IGI: Primary data saved (4035 records). [2025-10-16T19:34:45.064511] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-16T19:34:45.064589] [INFO ] [MAIN ] Update Progress: 1095/2369 symbols completed. IGI took 31.5s. Estimated remaining: 2h 59m 59s. Rate: 7.1 symbols/min [2025-10-16T19:34:45.227733] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:34:45.236578] [DEBUG] [LOCAL ] IHD: Loaded 7329 existing records from primary storage. [2025-10-16T19:34:45.236786] [INFO ] [MAIN ] IHD: Loaded 7329 existing records. [2025-10-16T19:34:45.406767] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:34:45.406960] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-16T19:34:45.407007] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-16T19:34:45.407151] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-16T19:34:45.407188] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-16T19:34:45.551781] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-16T19:34:45.766537] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:34:46.029178] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T19:34:46.035359] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-16T19:34:46.037683] [INFO ] [REMOTE ] IGD: Full fetch complete (30079 records). [2025-10-16T19:34:46.037771] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-16T19:34:46.356400] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-16T19:34:46.403911] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-16T19:34:46.404005] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-16T19:34:46.404688] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-16T19:34:46.404749] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-16T19:34:46.405491] [DEBUG] [LOCAL ] IGD: Trimmed 30079 records to 19512 (keeping 200 days of data) [2025-10-16T19:34:46.514932] [DEBUG] [LOCAL ] IGD: Primary data saved (19512 records). [2025-10-16T19:34:46.515069] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-16T19:34:46.515146] [INFO ] [MAIN ] Update Progress: 1096/2369 symbols completed. IGD took 51.5s. Estimated remaining: 2h 59m 42s. Rate: 7.1 symbols/min [2025-10-16T19:34:46.692364] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:34:46.718294] [DEBUG] [LOCAL ] IHG: Loaded 24302 existing records from primary storage. [2025-10-16T19:34:46.718589] [INFO ] [MAIN ] IHG: Loaded 24302 existing records. [2025-10-16T19:34:46.894018] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:34:46.894255] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-16T19:34:46.894309] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-16T19:34:46.894591] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-16T19:34:46.894703] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-16T19:34:46.998044] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T19:34:47.015016] [INFO ] [REMOTE ] IH: Full fetch complete (5025 records). [2025-10-16T19:34:47.044916] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-16T19:34:47.146558] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-16T19:34:47.540172] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:34:47.628465] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-16T19:34:47.628568] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-16T19:34:47.628740] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-16T19:34:47.628801] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-16T19:34:47.629174] [DEBUG] [LOCAL ] IH: Trimmed 5025 records to 2814 (keeping 200 days of data) [2025-10-16T19:34:47.644722] [DEBUG] [LOCAL ] IH: Primary data saved (2814 records). [2025-10-16T19:34:47.644786] [INFO ] [MAIN ] IH: Full history saved. [2025-10-16T19:34:47.644856] [INFO ] [MAIN ] Update Progress: 1097/2369 symbols completed. IH took 28.8s. Estimated remaining: 2h 59m 25s. Rate: 7.1 symbols/min [2025-10-16T19:34:47.812589] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:34:47.848627] [DEBUG] [LOCAL ] IHS: Loaded 37622 existing records from primary storage. [2025-10-16T19:34:47.848970] [INFO ] [MAIN ] IHS: Loaded 37622 existing records. [2025-10-16T19:34:47.948395] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-16T19:34:48.032161] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:34:48.032362] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-16T19:34:48.032427] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-16T19:34:48.032618] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-16T19:34:48.032715] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-16T19:34:48.155005] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-16T19:34:48.407114] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:34:48.742830] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-16T19:34:49.198067] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-16T19:34:49.542860] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-16T19:34:49.900982] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T19:34:50.342785] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-16T19:34:50.414962] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T19:34:50.418919] [INFO ] [REMOTE ] IGR: Full fetch complete (44935 records). [2025-10-16T19:34:50.419013] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-16T19:34:50.800560] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-16T19:34:50.800674] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-16T19:34:50.801471] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-16T19:34:50.801514] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-16T19:34:50.802468] [DEBUG] [LOCAL ] IGR: Trimmed 44935 records to 30626 (keeping 200 days of data) [2025-10-16T19:34:50.974405] [DEBUG] [LOCAL ] IGR: Primary data saved (30626 records). [2025-10-16T19:34:50.974546] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-16T19:34:50.974625] [INFO ] [MAIN ] Update Progress: 1098/2369 symbols completed. IGR took 33.7s. Estimated remaining: 2h 59m 11s. Rate: 7.1 symbols/min [2025-10-16T19:34:51.138308] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:34:51.142859] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-16T19:34:51.147036] [DEBUG] [LOCAL ] IIF: Loaded 5591 existing records from primary storage. [2025-10-16T19:34:51.147317] [INFO ] [MAIN ] IIF: Loaded 5591 existing records. [2025-10-16T19:34:51.320832] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:34:51.321040] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-16T19:34:51.321087] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-16T19:34:51.321231] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-16T19:34:51.321269] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-16T19:34:51.603279] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T19:34:51.694452] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:34:51.942842] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-16T19:34:52.120399] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T19:34:52.742842] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-16T19:34:52.944632] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-16T19:34:53.526743] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T19:34:53.542819] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-16T19:34:54.323266] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T19:34:54.342787] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-16T19:34:55.142791] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-16T19:34:55.444090] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T19:34:55.603463] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-16T19:34:55.942856] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-16T19:34:56.742849] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-16T19:34:57.151481] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T19:34:57.542913] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-16T19:34:58.342839] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-16T19:34:58.388114] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:34:58.920956] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T19:34:59.142821] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-16T19:34:59.755397] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-16T19:34:59.836225] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T19:34:59.942790] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-16T19:35:00.742811] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-16T19:35:01.272884] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T19:35:01.544122] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T19:35:01.543337] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-16T19:35:02.338909] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T19:35:02.342757] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-16T19:35:02.886811] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-16T19:35:03.142808] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-16T19:35:03.608383] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T19:35:03.942804] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-16T19:35:04.342881] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-16T19:35:04.742816] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-16T19:35:05.542848] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-16T19:35:05.619161] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-16T19:35:06.342836] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-16T19:35:06.915230] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T19:35:07.001381] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-16T19:35:07.142848] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-16T19:35:07.942861] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-16T19:35:08.548356] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T19:35:08.719604] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T19:35:08.742772] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-16T19:35:09.542814] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-16T19:35:10.351180] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-16T19:35:10.369007] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T19:35:10.821167] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T19:35:10.834108] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-16T19:35:11.142836] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-16T19:35:11.842617] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-16T19:35:11.942794] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-16T19:35:12.742841] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-16T19:35:13.363555] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T19:35:13.476866] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T19:35:13.542778] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-16T19:35:14.342783] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-16T19:35:14.740938] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T19:35:15.086816] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T19:35:15.088632] [INFO ] [REMOTE ] IHD: Full fetch complete (11875 records). [2025-10-16T19:35:15.088726] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-16T19:35:15.149332] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-16T19:35:15.456058] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-16T19:35:15.456139] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-16T19:35:15.456448] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-16T19:35:15.456490] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-16T19:35:15.456988] [DEBUG] [LOCAL ] IHD: Trimmed 11875 records to 7367 (keeping 200 days of data) [2025-10-16T19:35:15.499324] [DEBUG] [LOCAL ] IHD: Primary data saved (7367 records). [2025-10-16T19:35:15.499467] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-16T19:35:15.499550] [INFO ] [MAIN ] Update Progress: 1099/2369 symbols completed. IHD took 30.4s. Estimated remaining: 2h 59m 21s. Rate: 7.1 symbols/min [2025-10-16T19:35:15.669211] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:35:15.685586] [DEBUG] [LOCAL ] IIIN: Loaded 15979 existing records from primary storage. [2025-10-16T19:35:15.685838] [INFO ] [MAIN ] IIIN: Loaded 15979 existing records. [2025-10-16T19:35:15.860589] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:35:15.860809] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-16T19:35:15.860858] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-16T19:35:15.861018] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-16T19:35:15.861058] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-16T19:35:15.949771] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-16T19:35:16.225311] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:35:16.438424] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T19:35:16.742813] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-16T19:35:17.296155] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T19:35:17.542869] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-16T19:35:17.826705] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-16T19:35:18.138422] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-16T19:35:18.342829] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-16T19:35:18.816070] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-16T19:35:19.142835] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-16T19:35:19.942858] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-16T19:35:20.273378] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T19:35:20.742810] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-16T19:35:21.118387] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T19:35:21.122473] [INFO ] [REMOTE ] IHS: Full fetch complete (51598 records). [2025-10-16T19:35:21.122601] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-16T19:35:21.236806] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T19:35:21.277366] [INFO ] [REMOTE ] IIF: Full fetch complete (9012 records). [2025-10-16T19:35:21.286397] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-16T19:35:21.552737] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-16T19:35:21.884493] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-16T19:35:21.894541] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-16T19:35:21.904353] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-16T19:35:21.920783] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-16T19:35:21.927471] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-16T19:35:21.927557] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-16T19:35:21.928010] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-16T19:35:21.928186] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-16T19:35:21.929244] [DEBUG] [LOCAL ] IIF: Trimmed 9012 records to 5612 (keeping 200 days of data) [2025-10-16T19:35:21.929417] [DEBUG] [LOCAL ] IHS: Trimmed 51598 records to 37894 (keeping 200 days of data) [2025-10-16T19:35:22.046491] [DEBUG] [LOCAL ] IIF: Primary data saved (5612 records). [2025-10-16T19:35:22.049945] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-16T19:35:22.050638] [INFO ] [MAIN ] Update Progress: 1100/2369 symbols completed. IIF took 31.1s. Estimated remaining: 2h 59m 10s. Rate: 7.1 symbols/min [2025-10-16T19:35:22.245909] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:35:22.346970] [DEBUG] [LOCAL ] IIM: Loaded 15661 existing records from primary storage. [2025-10-16T19:35:22.348056] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-16T19:35:22.348300] [INFO ] [MAIN ] IIM: Loaded 15661 existing records. [2025-10-16T19:35:22.530468] [DEBUG] [LOCAL ] IHS: Primary data saved (37894 records). [2025-10-16T19:35:22.550057] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-16T19:35:22.550219] [INFO ] [MAIN ] Update Progress: 1101/2369 symbols completed. IHS took 34.9s. Estimated remaining: 2h 58m 52s. Rate: 7.1 symbols/min [2025-10-16T19:35:22.549958] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:35:22.572585] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-16T19:35:22.582818] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-16T19:35:22.595064] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-16T19:35:22.616678] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-16T19:35:22.828689] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:35:23.040972] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T19:35:23.127911] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:35:23.143476] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-16T19:35:23.145228] [DEBUG] [LOCAL ] IIPR: Loaded 29450 existing records from primary storage. [2025-10-16T19:35:23.146082] [INFO ] [MAIN ] IIPR: Loaded 29450 existing records. [2025-10-16T19:35:23.338446] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:35:23.338876] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-16T19:35:23.339012] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-16T19:35:23.339330] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-16T19:35:23.339385] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-16T19:35:23.607830] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T19:35:23.722523] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:35:23.942838] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-16T19:35:24.490448] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T19:35:24.742816] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-16T19:35:25.362144] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T19:35:25.542812] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-16T19:35:25.964823] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-16T19:35:26.342797] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-16T19:35:27.022486] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T19:35:27.142789] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-16T19:35:27.244697] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T19:35:27.942851] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-16T19:35:28.749458] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-16T19:35:28.763189] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T19:35:29.075849] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T19:35:29.542828] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-16T19:35:29.786334] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T19:35:29.789461] [INFO ] [REMOTE ] IHG: Full fetch complete (34101 records). [2025-10-16T19:35:29.789534] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-16T19:35:30.150065] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-16T19:35:30.150148] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-16T19:35:30.150860] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-16T19:35:30.150937] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-16T19:35:30.151879] [DEBUG] [LOCAL ] IHG: Trimmed 34101 records to 24519 (keeping 200 days of data) [2025-10-16T19:35:30.304868] [DEBUG] [LOCAL ] IHG: Primary data saved (24519 records). [2025-10-16T19:35:30.305027] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-16T19:35:30.305161] [INFO ] [MAIN ] Update Progress: 1102/2369 symbols completed. IHG took 43.8s. Estimated remaining: 2h 58m 43s. Rate: 7.1 symbols/min [2025-10-16T19:35:30.348187] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-16T19:35:30.478209] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:35:30.478360] [DEBUG] [LOCAL ] IMAX: No existing data file found in primary storage. [2025-10-16T19:35:30.478397] [WARN ] [MAIN ] IMAX: No existing data found, performing full refresh instead. [2025-10-16T19:35:30.478501] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-16T19:35:30.478581] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-16T19:35:30.478678] [DEBUG] [LOCAL ] IMAX: No primary data file found to delete. [2025-10-16T19:35:30.478731] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-16T19:35:30.767183] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T19:35:30.846303] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:35:31.142795] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-16T19:35:31.630829] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T19:35:31.942822] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-16T19:35:32.225921] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-16T19:35:32.639145] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-16T19:35:32.742799] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-16T19:35:33.542791] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-16T19:35:33.679552] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T19:35:34.342878] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-16T19:35:35.008083] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T19:35:35.142873] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-16T19:35:35.319360] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T19:35:35.942842] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-16T19:35:36.572023] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T19:35:36.590327] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-16T19:35:36.742825] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-16T19:35:37.542856] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-16T19:35:38.102308] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-16T19:35:38.342831] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-16T19:35:39.109476] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T19:35:39.142819] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-16T19:35:39.239933] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-16T19:35:39.942789] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-16T19:35:40.015267] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T19:35:40.742814] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-16T19:35:41.474976] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-16T19:35:41.493274] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-16T19:35:41.542776] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-16T19:35:42.342811] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-16T19:35:42.508544] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T19:35:43.142815] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-16T19:35:43.772933] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T19:35:43.808297] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-16T19:35:43.942813] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-16T19:35:44.476281] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-16T19:35:44.742878] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-16T19:35:45.542788] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-16T19:35:45.608016] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T19:35:46.342879] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-16T19:35:46.432040] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T19:35:47.142809] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-16T19:35:47.334922] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T19:35:47.337286] [INFO ] [REMOTE ] IIIN: Full fetch complete (24709 records). [2025-10-16T19:35:47.337355] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-16T19:35:47.692976] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-16T19:35:47.693046] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-16T19:35:47.693806] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-16T19:35:47.693869] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-16T19:35:47.694848] [DEBUG] [LOCAL ] IIIN: Trimmed 24709 records to 16246 (keeping 200 days of data) [2025-10-16T19:35:47.795632] [DEBUG] [LOCAL ] IIIN: Primary data saved (16246 records). [2025-10-16T19:35:47.795862] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-16T19:35:47.795967] [INFO ] [MAIN ] Update Progress: 1103/2369 symbols completed. IIIN took 32.3s. Estimated remaining: 2h 58m 45s. Rate: 7.1 symbols/min [2025-10-16T19:35:47.942787] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-16T19:35:47.962738] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:35:48.008363] [DEBUG] [LOCAL ] INFA: Loaded 49000 existing records from primary storage. [2025-10-16T19:35:48.008737] [INFO ] [MAIN ] INFA: Loaded 49000 existing records. [2025-10-16T19:35:48.182157] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:35:48.188715] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-16T19:35:48.189275] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-16T19:35:48.189548] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T19:35:48.192044] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-16T19:35:48.192418] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-16T19:35:48.223164] [INFO ] [REMOTE ] IIM: Full fetch complete (25126 records). [2025-10-16T19:35:48.234825] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-16T19:35:48.753082] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-16T19:35:48.933593] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:35:48.940965] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-16T19:35:48.941185] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-16T19:35:48.941786] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-16T19:35:48.941865] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-16T19:35:48.942909] [DEBUG] [LOCAL ] IIM: Trimmed 25126 records to 15782 (keeping 200 days of data) [2025-10-16T19:35:49.036238] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T19:35:49.065716] [DEBUG] [LOCAL ] IIM: Primary data saved (15782 records). [2025-10-16T19:35:49.065865] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-16T19:35:49.065947] [INFO ] [MAIN ] Update Progress: 1104/2369 symbols completed. IIM took 27.0s. Estimated remaining: 2h 58m 28s. Rate: 7.1 symbols/min [2025-10-16T19:35:49.232073] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:35:49.281959] [DEBUG] [LOCAL ] INFY: Loaded 53597 existing records from primary storage. [2025-10-16T19:35:49.282255] [INFO ] [MAIN ] INFY: Loaded 53597 existing records. [2025-10-16T19:35:49.455091] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:35:49.455292] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-16T19:35:49.455339] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-16T19:35:49.455560] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-16T19:35:49.455621] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-16T19:35:49.551320] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-16T19:35:49.801637] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:35:50.342805] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-16T19:35:50.396825] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T19:35:51.142818] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-16T19:35:51.301610] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T19:35:51.850198] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T19:35:51.942823] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-16T19:35:52.707112] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T19:35:52.742821] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-16T19:35:53.094792] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T19:35:53.542896] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-16T19:35:53.923095] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T19:35:54.342824] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-16T19:35:55.142840] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-16T19:35:55.243857] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T19:35:55.402313] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T19:35:55.942837] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-16T19:35:56.742783] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-16T19:35:56.745050] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T19:35:57.542794] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-16T19:35:57.935916] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-16T19:35:58.143539] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T19:35:58.342816] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-16T19:35:59.119428] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T19:35:59.142768] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-16T19:35:59.790442] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T19:35:59.942773] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-16T19:36:00.742790] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-16T19:36:00.875033] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T19:36:01.295802] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-16T19:36:01.300001] [INFO ] [REMOTE ] IIPR: Full fetch complete (44204 records). [2025-10-16T19:36:01.300106] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-16T19:36:01.548042] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-16T19:36:01.670843] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-16T19:36:01.670917] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-16T19:36:01.671703] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-16T19:36:01.671764] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-16T19:36:01.672633] [DEBUG] [LOCAL ] IIPR: Trimmed 44204 records to 29694 (keeping 200 days of data) [2025-10-16T19:36:01.861141] [DEBUG] [LOCAL ] IIPR: Primary data saved (29694 records). [2025-10-16T19:36:01.861288] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-16T19:36:01.861379] [INFO ] [MAIN ] Update Progress: 1105/2369 symbols completed. IIPR took 39.3s. Estimated remaining: 2h 58m 25s. Rate: 7.1 symbols/min [2025-10-16T19:36:02.066107] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:36:02.068212] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T19:36:02.121791] [DEBUG] [LOCAL ] ING: Loaded 50732 existing records from primary storage. [2025-10-16T19:36:02.122097] [INFO ] [MAIN ] ING: Loaded 50732 existing records. [2025-10-16T19:36:02.301419] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:36:02.301671] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-16T19:36:02.301733] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-16T19:36:02.302005] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-16T19:36:02.302081] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-16T19:36:02.348072] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-16T19:36:02.686006] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:36:03.142834] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-16T19:36:03.379745] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T19:36:03.942805] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-16T19:36:04.200370] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T19:36:04.742790] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-16T19:36:05.269764] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-16T19:36:05.451258] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T19:36:05.542842] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-16T19:36:06.311974] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T19:36:06.342782] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-16T19:36:06.912360] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T19:36:06.918588] [INFO ] [REMOTE ] IMAX: Full fetch complete (60787 records). [2025-10-16T19:36:06.918742] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-16T19:36:07.153067] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-16T19:36:07.306451] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-16T19:36:07.306532] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-16T19:36:07.307478] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-16T19:36:07.307546] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-16T19:36:07.308768] [DEBUG] [LOCAL ] IMAX: Trimmed 60787 records to 43543 (keeping 200 days of data) [2025-10-16T19:36:07.551399] [DEBUG] [LOCAL ] IMAX: Primary data saved (43543 records). [2025-10-16T19:36:07.551539] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-16T19:36:07.551612] [INFO ] [MAIN ] Update Progress: 1106/2369 symbols completed. IMAX took 37.2s. Estimated remaining: 2h 58m 13s. Rate: 7.1 symbols/min [2025-10-16T19:36:07.719503] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:36:07.748438] [DEBUG] [LOCAL ] INGM: Loaded 28330 existing records from primary storage. [2025-10-16T19:36:07.748792] [INFO ] [MAIN ] INGM: Loaded 28330 existing records. [2025-10-16T19:36:07.929330] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:36:07.929694] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-16T19:36:07.929769] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-16T19:36:07.930081] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-16T19:36:07.930272] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-16T19:36:07.950780] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-16T19:36:08.028536] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T19:36:08.321937] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:36:08.742896] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-16T19:36:09.036499] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T19:36:09.542907] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-16T19:36:09.649343] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T19:36:10.342806] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-16T19:36:10.688361] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T19:36:10.907556] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T19:36:11.142868] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-16T19:36:11.947943] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-16T19:36:11.959685] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T19:36:12.742854] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-16T19:36:12.796230] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T19:36:13.542772] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-16T19:36:13.666880] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T19:36:13.874458] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T19:36:14.342824] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-16T19:36:15.142855] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-16T19:36:15.302663] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T19:36:15.356315] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T19:36:15.942809] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-16T19:36:16.742802] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-16T19:36:16.866370] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T19:36:17.308111] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T19:36:17.542809] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-16T19:36:18.342875] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-16T19:36:18.384151] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T19:36:18.534715] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T19:36:19.142872] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-16T19:36:19.942866] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-16T19:36:20.038665] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T19:36:20.542172] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T19:36:20.742855] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-16T19:36:21.197329] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-16T19:36:21.542796] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-16T19:36:22.184394] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T19:36:22.189958] [INFO ] [REMOTE ] INFA: Full fetch complete (70952 records). [2025-10-16T19:36:22.190102] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-16T19:36:22.369365] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-16T19:36:22.586008] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-16T19:36:22.586082] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-16T19:36:22.587072] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-16T19:36:22.587133] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-16T19:36:22.588411] [DEBUG] [LOCAL ] INFA: Trimmed 70952 records to 49327 (keeping 200 days of data) [2025-10-16T19:36:22.871783] [DEBUG] [LOCAL ] INFA: Primary data saved (49327 records). [2025-10-16T19:36:22.871913] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-16T19:36:22.872560] [INFO ] [MAIN ] Update Progress: 1107/2369 symbols completed. INFA took 35.1s. Estimated remaining: 2h 58m 12s. Rate: 7.1 symbols/min [2025-10-16T19:36:23.045188] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:36:23.078809] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T19:36:23.122237] [DEBUG] [LOCAL ] INGR: Loaded 33816 existing records from primary storage. [2025-10-16T19:36:23.122544] [INFO ] [MAIN ] INGR: Loaded 33816 existing records. [2025-10-16T19:36:23.154477] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-16T19:36:23.322694] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:36:23.322929] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-16T19:36:23.322975] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-16T19:36:23.323161] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-16T19:36:23.323217] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-16T19:36:23.676128] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:36:23.914223] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T19:36:23.943679] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-16T19:36:23.947725] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T19:36:24.742839] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-16T19:36:25.183159] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T19:36:25.542801] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-16T19:36:26.141203] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T19:36:26.342811] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-16T19:36:27.142791] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-16T19:36:27.227616] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T19:36:27.825617] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T19:36:27.942790] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-16T19:36:28.317602] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T19:36:28.742787] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-16T19:36:29.496335] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:36:29.542791] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-16T19:36:29.559798] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T19:36:30.342817] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-16T19:36:31.142844] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-16T19:36:31.185315] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T19:36:31.942905] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-16T19:36:32.028248] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T19:36:32.442686] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T19:36:32.446537] [INFO ] [REMOTE ] INGM: Full fetch complete (41919 records). [2025-10-16T19:36:32.446615] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-16T19:36:32.747986] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-16T19:36:32.818115] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-16T19:36:32.818192] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-16T19:36:32.818967] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-16T19:36:32.819033] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-16T19:36:32.819929] [DEBUG] [LOCAL ] INGM: Trimmed 41919 records to 28536 (keeping 200 days of data) [2025-10-16T19:36:32.991491] [DEBUG] [LOCAL ] INGM: Primary data saved (28536 records). [2025-10-16T19:36:32.991618] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-16T19:36:32.991744] [INFO ] [MAIN ] Update Progress: 1108/2369 symbols completed. INGM took 25.4s. Estimated remaining: 2h 58m 6s. Rate: 7.1 symbols/min [2025-10-16T19:36:33.168630] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:36:33.205986] [DEBUG] [LOCAL ] INN: Loaded 41819 existing records from primary storage. [2025-10-16T19:36:33.206257] [INFO ] [MAIN ] INN: Loaded 41819 existing records. [2025-10-16T19:36:33.384638] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:36:33.384888] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-16T19:36:33.384938] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-16T19:36:33.385224] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-16T19:36:33.385323] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-16T19:36:33.507125] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T19:36:33.552963] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-16T19:36:33.774997] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:36:34.342854] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-16T19:36:34.615616] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-16T19:36:34.623432] [INFO ] [REMOTE ] INFY: Full fetch complete (77734 records). [2025-10-16T19:36:34.623620] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-16T19:36:34.936692] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T19:36:35.046773] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-16T19:36:35.046847] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-16T19:36:35.047884] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-16T19:36:35.047947] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-16T19:36:35.049393] [DEBUG] [LOCAL ] INFY: Trimmed 77734 records to 53987 (keeping 200 days of data) [2025-10-16T19:36:35.142865] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-16T19:36:35.372532] [DEBUG] [LOCAL ] INFY: Primary data saved (53987 records). [2025-10-16T19:36:35.372760] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-16T19:36:35.373347] [INFO ] [MAIN ] Update Progress: 1109/2369 symbols completed. INFY took 46.3s. Estimated remaining: 2h 57m 50s. Rate: 7.1 symbols/min [2025-10-16T19:36:35.540370] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:36:35.540506] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-16T19:36:35.540542] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-16T19:36:35.540666] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-16T19:36:35.540725] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-16T19:36:35.540769] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-16T19:36:35.540802] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-16T19:36:35.886945] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:36:35.942765] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-16T19:36:35.977760] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T19:36:36.126924] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:36:36.127184] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-16T19:36:36.127281] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:36:36.127354] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-16T19:36:36.127418] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:36:36.127490] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-16T19:36:36.127551] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-16T19:36:36.127587] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-16T19:36:36.127627] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-16T19:36:36.127711] [INFO ] [MAIN ] Update Progress: 1110/2369 symbols completed. INR took 0.8s. Estimated remaining: 2h 57m 33s. Rate: 7.1 symbols/min [2025-10-16T19:36:36.295256] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:36:36.337973] [DEBUG] [LOCAL ] INSP: Loaded 38333 existing records from primary storage. [2025-10-16T19:36:36.338248] [INFO ] [MAIN ] INSP: Loaded 38333 existing records. [2025-10-16T19:36:36.515196] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:36:36.515553] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-16T19:36:36.515693] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-16T19:36:36.516005] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-16T19:36:36.516073] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-16T19:36:36.747979] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-16T19:36:36.884203] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T19:36:36.903705] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:36:37.542871] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-16T19:36:38.164210] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T19:36:38.342780] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-16T19:36:38.369762] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-16T19:36:39.142836] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-16T19:36:39.338172] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T19:36:39.942816] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-16T19:36:40.389019] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T19:36:40.742793] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-16T19:36:40.942333] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T19:36:41.542863] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-16T19:36:41.976484] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T19:36:42.342820] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-16T19:36:42.555584] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T19:36:43.142816] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-16T19:36:43.942829] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-16T19:36:44.250364] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-16T19:36:44.647213] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T19:36:44.742805] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-16T19:36:45.454833] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T19:36:45.542779] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-16T19:36:45.970698] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-16T19:36:46.342840] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-16T19:36:46.998163] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T19:36:47.142812] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-16T19:36:47.553628] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T19:36:47.942868] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-16T19:36:48.563443] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T19:36:48.742873] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-16T19:36:49.281527] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T19:36:49.288126] [INFO ] [REMOTE ] ING: Full fetch complete (73822 records). [2025-10-16T19:36:49.288294] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-16T19:36:49.553834] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-16T19:36:49.691209] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-16T19:36:49.691353] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-16T19:36:49.692782] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-16T19:36:49.692928] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-16T19:36:49.694715] [DEBUG] [LOCAL ] ING: Trimmed 73822 records to 51112 (keeping 200 days of data) [2025-10-16T19:36:49.800831] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T19:36:49.817535] [INFO ] [REMOTE ] INGR: Full fetch complete (50681 records). [2025-10-16T19:36:49.838541] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-16T19:36:50.251025] [DEBUG] [LOCAL ] ING: Primary data saved (51112 records). [2025-10-16T19:36:50.282414] [INFO ] [MAIN ] ING: Full history saved. [2025-10-16T19:36:50.282551] [INFO ] [MAIN ] Update Progress: 1111/2369 symbols completed. ING took 48.4s. Estimated remaining: 2h 57m 31s. Rate: 7.1 symbols/min [2025-10-16T19:36:50.358939] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-16T19:36:50.555245] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:36:50.588501] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-16T19:36:50.588607] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-16T19:36:50.589576] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-16T19:36:50.589679] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-16T19:36:50.590859] [DEBUG] [LOCAL ] INGR: Trimmed 50681 records to 34043 (keeping 200 days of data) [2025-10-16T19:36:50.733313] [DEBUG] [LOCAL ] INSW: Loaded 39595 existing records from primary storage. [2025-10-16T19:36:50.741454] [INFO ] [MAIN ] INSW: Loaded 39595 existing records. [2025-10-16T19:36:50.996227] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:36:50.997821] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-16T19:36:50.997954] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-16T19:36:51.005203] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-16T19:36:51.005693] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-16T19:36:51.061141] [DEBUG] [LOCAL ] INGR: Primary data saved (34043 records). [2025-10-16T19:36:51.107850] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-16T19:36:51.113725] [INFO ] [MAIN ] Update Progress: 1112/2369 symbols completed. INGR took 28.2s. Estimated remaining: 2h 57m 14s. Rate: 7.1 symbols/min [2025-10-16T19:36:51.182631] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T19:36:51.288999] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-16T19:36:51.487863] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:36:51.615290] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:36:51.660289] [DEBUG] [LOCAL ] INVH: Loaded 53197 existing records from primary storage. [2025-10-16T19:36:51.676959] [INFO ] [MAIN ] INVH: Loaded 53197 existing records. [2025-10-16T19:36:51.708535] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T19:36:51.923040] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:36:51.923254] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-16T19:36:51.923300] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-16T19:36:51.923612] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-16T19:36:51.923690] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-16T19:36:51.953758] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-16T19:36:52.275978] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:36:52.742841] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-16T19:36:52.871051] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T19:36:53.294276] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T19:36:53.542849] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-16T19:36:54.177712] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T19:36:54.342842] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-16T19:36:54.771447] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T19:36:55.142873] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-16T19:36:55.374202] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T19:36:55.942882] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-16T19:36:56.750932] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-16T19:36:56.756761] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T19:36:57.384104] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T19:36:57.542874] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-16T19:36:58.342798] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-16T19:36:58.416042] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T19:36:58.818899] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T19:36:59.142805] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-16T19:36:59.740004] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T19:36:59.942789] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-16T19:37:00.512777] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T19:37:00.742782] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-16T19:37:01.375126] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T19:37:01.542828] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-16T19:37:02.293209] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T19:37:02.342771] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-16T19:37:03.131312] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T19:37:03.142766] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-16T19:37:03.390436] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-16T19:37:03.942862] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-16T19:37:04.742790] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-16T19:37:04.985889] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-16T19:37:05.052170] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T19:37:05.057908] [INFO ] [REMOTE ] INN: Full fetch complete (57798 records). [2025-10-16T19:37:05.058030] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-16T19:37:05.429084] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-16T19:37:05.429168] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-16T19:37:05.430084] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-16T19:37:05.430147] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-16T19:37:05.431283] [DEBUG] [LOCAL ] INN: Trimmed 57798 records to 42104 (keeping 200 days of data) [2025-10-16T19:37:05.542857] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-16T19:37:05.671823] [DEBUG] [LOCAL ] INN: Primary data saved (42104 records). [2025-10-16T19:37:05.671958] [INFO ] [MAIN ] INN: Full history saved. [2025-10-16T19:37:05.672034] [INFO ] [MAIN ] Update Progress: 1113/2369 symbols completed. INN took 32.7s. Estimated remaining: 2h 57m 13s. Rate: 7.1 symbols/min [2025-10-16T19:37:05.852382] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:37:05.884588] [DEBUG] [LOCAL ] INVX: Loaded 29342 existing records from primary storage. [2025-10-16T19:37:05.884931] [INFO ] [MAIN ] INVX: Loaded 29342 existing records. [2025-10-16T19:37:06.081889] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:37:06.082281] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-16T19:37:06.082428] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-16T19:37:06.082774] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-16T19:37:06.082831] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-16T19:37:06.346423] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-16T19:37:06.503287] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:37:06.505308] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T19:37:07.142797] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-16T19:37:07.200906] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T19:37:07.942788] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-16T19:37:08.106831] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T19:37:08.467768] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T19:37:08.742855] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-16T19:37:09.405226] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T19:37:09.542822] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-16T19:37:10.324044] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T19:37:10.342768] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-16T19:37:11.142867] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-16T19:37:11.283396] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T19:37:11.646922] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T19:37:11.942844] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-16T19:37:12.742853] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-16T19:37:12.859343] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T19:37:13.542816] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-16T19:37:13.675262] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T19:37:14.050308] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T19:37:14.342826] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-16T19:37:15.144195] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-16T19:37:15.146274] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T19:37:15.152262] [INFO ] [REMOTE ] INSP: Full fetch complete (53698 records). [2025-10-16T19:37:15.152357] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-16T19:37:15.532154] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-16T19:37:15.532235] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-16T19:37:15.533159] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-16T19:37:15.533221] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-16T19:37:15.534314] [DEBUG] [LOCAL ] INSP: Trimmed 53698 records to 38596 (keeping 200 days of data) [2025-10-16T19:37:15.762149] [DEBUG] [LOCAL ] INSP: Primary data saved (38596 records). [2025-10-16T19:37:15.762285] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-16T19:37:15.762770] [INFO ] [MAIN ] Update Progress: 1114/2369 symbols completed. INSP took 39.6s. Estimated remaining: 2h 57m 6s. Rate: 7.1 symbols/min [2025-10-16T19:37:15.935085] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:37:15.949025] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-16T19:37:15.961246] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T19:37:16.020148] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-16T19:37:16.020553] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-16T19:37:16.199109] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:37:16.199327] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-16T19:37:16.199374] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-16T19:37:16.199714] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-16T19:37:16.199770] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-16T19:37:16.552271] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:37:16.742813] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-16T19:37:16.773060] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T19:37:16.780096] [INFO ] [REMOTE ] INVH: Full fetch complete (76964 records). [2025-10-16T19:37:16.780270] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-16T19:37:17.215271] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-16T19:37:17.221199] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-16T19:37:17.232046] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-16T19:37:17.233437] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T19:37:17.232681] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-16T19:37:17.241144] [DEBUG] [LOCAL ] INVH: Trimmed 76964 records to 53585 (keeping 200 days of data) [2025-10-16T19:37:17.555689] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-16T19:37:17.580865] [DEBUG] [LOCAL ] INVH: Primary data saved (53585 records). [2025-10-16T19:37:17.581006] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-16T19:37:17.581086] [INFO ] [MAIN ] Update Progress: 1115/2369 symbols completed. INVH took 26.5s. Estimated remaining: 2h 56m 50s. Rate: 7.1 symbols/min [2025-10-16T19:37:17.745283] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:37:17.793071] [DEBUG] [LOCAL ] IOT: Loaded 53480 existing records from primary storage. [2025-10-16T19:37:17.793415] [INFO ] [MAIN ] IOT: Loaded 53480 existing records. [2025-10-16T19:37:17.968716] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:37:17.968915] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-16T19:37:17.968972] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-16T19:37:17.969178] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-16T19:37:17.969218] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-16T19:37:18.316743] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:37:18.342776] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-16T19:37:18.469970] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-16T19:37:19.025055] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-16T19:37:19.142775] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-16T19:37:19.942789] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-16T19:37:20.286934] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T19:37:20.496379] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T19:37:20.742816] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-16T19:37:21.542809] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-16T19:37:22.076171] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T19:37:22.342801] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-16T19:37:22.575248] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-16T19:37:22.603994] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T19:37:23.142862] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-16T19:37:23.778781] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T19:37:23.942817] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-16T19:37:24.576073] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T19:37:24.742773] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-16T19:37:24.873171] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T19:37:25.542779] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-16T19:37:25.951106] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T19:37:26.342808] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-16T19:37:27.147962] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-16T19:37:27.166491] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T19:37:27.943051] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-16T19:37:28.461522] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-16T19:37:28.647374] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T19:37:28.742906] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-16T19:37:29.483066] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T19:37:29.542798] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-16T19:37:30.342870] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-16T19:37:30.935473] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T19:37:30.941806] [INFO ] [REMOTE ] INSW: Full fetch complete (59929 records). [2025-10-16T19:37:30.942134] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-16T19:37:31.148194] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-16T19:37:31.456489] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-16T19:37:31.456630] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-16T19:37:31.458770] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-16T19:37:31.458996] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-16T19:37:31.461128] [DEBUG] [LOCAL ] INSW: Trimmed 59929 records to 39916 (keeping 200 days of data) [2025-10-16T19:37:31.655622] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.91 seconds). [2025-10-16T19:37:31.890376] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T19:37:31.941482] [DEBUG] [LOCAL ] INSW: Primary data saved (39916 records). [2025-10-16T19:37:31.941631] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-16T19:37:31.941749] [INFO ] [MAIN ] Update Progress: 1116/2369 symbols completed. INSW took 41.7s. Estimated remaining: 2h 56m 48s. Rate: 7.1 symbols/min [2025-10-16T19:37:31.953048] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-16T19:37:32.131754] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:37:32.181542] [DEBUG] [LOCAL ] IP: Loaded 53307 existing records from primary storage. [2025-10-16T19:37:32.181920] [INFO ] [MAIN ] IP: Loaded 53307 existing records. [2025-10-16T19:37:32.366800] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:37:32.367158] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-16T19:37:32.367231] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-16T19:37:32.374027] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-16T19:37:32.384767] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-16T19:37:32.470007] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T19:37:32.748962] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-16T19:37:32.755221] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:37:33.542794] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-16T19:37:33.975123] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T19:37:34.342833] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-16T19:37:34.668725] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-16T19:37:35.142850] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-16T19:37:35.269606] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T19:37:35.410461] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T19:37:35.942824] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-16T19:37:36.732218] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T19:37:36.742805] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-16T19:37:37.542910] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-16T19:37:38.342958] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-16T19:37:38.520105] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T19:37:38.525257] [INFO ] [REMOTE ] INVX: Full fetch complete (43189 records). [2025-10-16T19:37:38.525425] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-16T19:37:38.718500] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-16T19:37:39.079224] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-16T19:37:39.079598] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-16T19:37:39.081172] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-16T19:37:39.084013] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-16T19:37:39.083921] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (3.14 seconds). [2025-10-16T19:37:39.099924] [DEBUG] [LOCAL ] INVX: Trimmed 43189 records to 29473 (keeping 200 days of data) [2025-10-16T19:37:39.146627] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-16T19:37:39.267338] [DEBUG] [LOCAL ] INVX: Primary data saved (29473 records). [2025-10-16T19:37:39.267468] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-16T19:37:39.267546] [INFO ] [MAIN ] Update Progress: 1117/2369 symbols completed. INVX took 33.6s. Estimated remaining: 2h 56m 38s. Rate: 7.1 symbols/min [2025-10-16T19:37:39.942812] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-16T19:37:40.022310] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T19:37:40.742798] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-16T19:37:40.953297] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T19:37:41.542812] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-16T19:37:42.405547] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-16T19:37:42.417848] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-16T19:37:42.497871] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T19:37:43.142844] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-16T19:37:43.394599] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T19:37:43.942867] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-16T19:37:44.865517] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-16T19:37:44.877768] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-16T19:37:45.177209] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-16T19:37:45.542783] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-16T19:37:45.659996] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T19:37:46.342842] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-16T19:37:47.096808] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-16T19:37:47.142800] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-16T19:37:47.573850] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-16T19:37:47.635314] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T19:37:47.942827] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-16T19:37:48.742825] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-16T19:37:49.189869] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-16T19:37:49.542815] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-16T19:37:49.609730] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T19:37:50.336084] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T19:37:50.343083] [INFO ] [REMOTE ] IOT: Full fetch complete (77552 records). [2025-10-16T19:37:50.342892] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-16T19:37:50.344157] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-16T19:37:50.725680] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-16T19:37:50.725771] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-16T19:37:50.726821] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-16T19:37:50.726885] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-16T19:37:50.728325] [DEBUG] [LOCAL ] IOT: Trimmed 77552 records to 53870 (keeping 200 days of data) [2025-10-16T19:37:51.037100] [DEBUG] [LOCAL ] IOT: Primary data saved (53870 records). [2025-10-16T19:37:51.037238] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-16T19:37:51.037792] [INFO ] [MAIN ] Update Progress: 1118/2369 symbols completed. IOT took 33.5s. Estimated remaining: 2h 56m 34s. Rate: 7.1 symbols/min [2025-10-16T19:37:51.818629] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-16T19:37:51.825850] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-16T19:37:51.825975] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-16T19:37:52.232777] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-16T19:37:52.232880] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-16T19:37:52.233980] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-16T19:37:52.234061] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-16T19:37:52.235578] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54178 (keeping 200 days of data) [2025-10-16T19:37:52.384315] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-16T19:37:52.480073] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-16T19:37:52.596523] [DEBUG] [LOCAL ] IONQ: Primary data saved (54178 records). [2025-10-16T19:37:52.596685] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-16T19:37:52.597218] [INFO ] [MAIN ] Update Progress: 1119/2369 symbols completed. IONQ took 36.8s. Estimated remaining: 2h 56m 17s. Rate: 7.1 symbols/min [2025-10-16T19:37:54.314695] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T19:37:54.326009] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-16T19:37:55.716183] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T19:37:55.733233] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-16T19:37:57.194380] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T19:37:57.201445] [INFO ] [REMOTE ] IP: Full fetch complete (77380 records). [2025-10-16T19:37:57.201609] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-16T19:37:57.624706] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-16T19:37:57.624832] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-16T19:37:57.625985] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-16T19:37:57.626055] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-16T19:37:57.627575] [DEBUG] [LOCAL ] IP: Trimmed 77380 records to 53697 (keeping 200 days of data) [2025-10-16T19:37:57.947720] [DEBUG] [LOCAL ] IP: Primary data saved (53697 records). [2025-10-16T19:37:57.947910] [INFO ] [MAIN ] IP: Full history saved. [2025-10-16T19:37:57.948004] [INFO ] [MAIN ] Update Progress: 1120/2369 symbols completed. IP took 26.0s. Estimated remaining: 2h 56m 5s. Rate: 7.1 symbols/min [2025-10-16T19:37:58.641473] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:37:58.680697] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:37:58.722078] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:37:58.724020] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:37:58.748790] [DEBUG] [LOCAL ] IQI: Loaded 17837 existing records from primary storage. [2025-10-16T19:37:58.749320] [INFO ] [MAIN ] IQI: Loaded 17837 existing records. [2025-10-16T19:37:58.837260] [DEBUG] [LOCAL ] IPI: Loaded 21357 existing records from primary storage. [2025-10-16T19:37:58.848265] [INFO ] [MAIN ] IPI: Loaded 21357 existing records. [2025-10-16T19:37:59.069495] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:37:59.081171] [DEBUG] [LOCAL ] IQV: Loaded 50051 existing records from primary storage. [2025-10-16T19:37:59.103581] [INFO ] [MAIN ] IQV: Loaded 50051 existing records. [2025-10-16T19:37:59.103461] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-16T19:37:59.138672] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-16T19:37:59.197969] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-16T19:37:59.192710] [DEBUG] [LOCAL ] IPG: Loaded 53331 existing records from primary storage. [2025-10-16T19:37:59.217119] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-16T19:37:59.227798] [INFO ] [MAIN ] IPG: Loaded 53331 existing records. [2025-10-16T19:37:59.302516] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:37:59.342162] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-16T19:37:59.431997] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-16T19:37:59.541628] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-16T19:37:59.541855] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-16T19:37:59.845537] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:37:59.893803] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:37:59.918059] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-16T19:37:59.938485] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-16T19:37:59.938407] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-16T19:37:59.974811] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-16T19:37:59.953345] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-16T19:38:00.007701] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-16T19:38:00.018137] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-16T19:38:00.079059] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-16T19:38:00.596100] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:00.637281] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-16T19:38:01.008041] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:01.040474] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-16T19:38:01.155827] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:01.188884] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-16T19:38:01.225256] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:01.225562] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-16T19:38:01.761475] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-16T19:38:01.766683] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-16T19:38:02.097792] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:38:02.102344] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-16T19:38:02.817331] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T19:38:02.821911] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-16T19:38:02.968915] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T19:38:02.981278] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-16T19:38:03.088600] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T19:38:03.092456] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-16T19:38:03.123626] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-16T19:38:03.133556] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-16T19:38:03.913524] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T19:38:03.918625] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-16T19:38:04.097350] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T19:38:04.101425] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-16T19:38:04.410917] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T19:38:04.422046] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-16T19:38:04.601989] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-16T19:38:04.605925] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-16T19:38:04.828209] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T19:38:04.837898] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-16T19:38:04.921066] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T19:38:05.517040] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T19:38:05.542819] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-16T19:38:05.816421] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:38:06.342815] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-16T19:38:06.432833] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T19:38:06.469570] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T19:38:07.142808] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-16T19:38:07.910696] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T19:38:07.942773] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-16T19:38:08.742798] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-16T19:38:08.811320] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T19:38:09.383140] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T19:38:09.542787] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-16T19:38:09.712454] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-16T19:38:10.342819] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-16T19:38:11.142803] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-16T19:38:11.568239] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-16T19:38:11.916612] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T19:38:11.942773] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-16T19:38:12.272685] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T19:38:12.742878] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-16T19:38:13.542882] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-16T19:38:13.831544] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T19:38:13.853836] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T19:38:14.342814] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-16T19:38:15.004224] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T19:38:15.142780] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-16T19:38:15.942854] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-16T19:38:16.014251] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T19:38:16.742786] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-16T19:38:16.927515] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T19:38:17.150220] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T19:38:17.542860] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-16T19:38:18.009482] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-16T19:38:18.119764] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T19:38:18.342852] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-16T19:38:19.143016] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-16T19:38:19.475521] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T19:38:19.941741] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T19:38:19.943850] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-16T19:38:19.945170] [INFO ] [REMOTE ] IQI: Full fetch complete (26606 records). [2025-10-16T19:38:19.945265] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-16T19:38:20.306408] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-16T19:38:20.306485] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-16T19:38:20.307062] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-16T19:38:20.307123] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-16T19:38:20.307808] [DEBUG] [LOCAL ] IQI: Trimmed 26606 records to 17994 (keeping 200 days of data) [2025-10-16T19:38:20.416681] [DEBUG] [LOCAL ] IQI: Primary data saved (17994 records). [2025-10-16T19:38:20.416841] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-16T19:38:20.416935] [INFO ] [MAIN ] Update Progress: 1121/2369 symbols completed. IQI took 22.5s. Estimated remaining: 2h 56m 13s. Rate: 7.1 symbols/min [2025-10-16T19:38:20.582491] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:38:20.631363] [DEBUG] [LOCAL ] IR: Loaded 52780 existing records from primary storage. [2025-10-16T19:38:20.631689] [INFO ] [MAIN ] IR: Loaded 52780 existing records. [2025-10-16T19:38:20.748039] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-16T19:38:20.810261] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:38:20.810604] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-16T19:38:20.810689] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-16T19:38:20.810999] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-16T19:38:20.811056] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-16T19:38:21.153934] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:21.542785] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-16T19:38:21.611684] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T19:38:22.342785] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-16T19:38:22.546990] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-16T19:38:22.581756] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T19:38:23.142831] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-16T19:38:23.953332] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-16T19:38:23.989253] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T19:38:24.030866] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T19:38:24.742802] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-16T19:38:25.542808] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-16T19:38:25.632625] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T19:38:25.684347] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-16T19:38:26.342837] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-16T19:38:27.045660] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T19:38:27.142779] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-16T19:38:27.942788] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-16T19:38:28.004124] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T19:38:28.646172] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T19:38:28.653095] [INFO ] [REMOTE ] IPG: Full fetch complete (77433 records). [2025-10-16T19:38:28.653241] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-16T19:38:28.748692] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-16T19:38:29.037050] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-16T19:38:29.037180] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-16T19:38:29.038279] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-16T19:38:29.038343] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-16T19:38:29.039875] [DEBUG] [LOCAL ] IPG: Trimmed 77433 records to 53721 (keeping 200 days of data) [2025-10-16T19:38:29.361866] [DEBUG] [LOCAL ] IPG: Primary data saved (53721 records). [2025-10-16T19:38:29.361998] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-16T19:38:29.362076] [INFO ] [MAIN ] Update Progress: 1122/2369 symbols completed. IPG took 31.4s. Estimated remaining: 2h 56m 5s. Rate: 7.1 symbols/min [2025-10-16T19:38:29.543369] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-16T19:38:29.546732] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:38:29.586131] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T19:38:29.616946] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T19:38:29.623896] [INFO ] [REMOTE ] IQV: Full fetch complete (72436 records). [2025-10-16T19:38:29.624095] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-16T19:38:29.821241] [DEBUG] [LOCAL ] IRM: Loaded 49144 existing records from primary storage. [2025-10-16T19:38:29.834392] [INFO ] [MAIN ] IRM: Loaded 49144 existing records. [2025-10-16T19:38:30.189339] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:38:30.208253] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-16T19:38:30.231722] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-16T19:38:30.232343] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-16T19:38:30.232488] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-16T19:38:30.234081] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-16T19:38:30.234152] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-16T19:38:30.234029] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-16T19:38:30.300430] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-16T19:38:30.345449] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-16T19:38:30.372109] [DEBUG] [LOCAL ] IQV: Trimmed 72436 records to 50425 (keeping 200 days of data) [2025-10-16T19:38:30.662034] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-16T19:38:30.701232] [INFO ] [REMOTE ] IPI: Full fetch complete (30021 records). [2025-10-16T19:38:30.745062] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:30.740937] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-16T19:38:31.163237] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-16T19:38:31.241009] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-16T19:38:31.241127] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-16T19:38:31.242407] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-16T19:38:31.242492] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-16T19:38:31.251600] [DEBUG] [LOCAL ] IPI: Trimmed 30021 records to 21575 (keeping 200 days of data) [2025-10-16T19:38:31.410003] [DEBUG] [LOCAL ] IPI: Primary data saved (21575 records). [2025-10-16T19:38:31.441479] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-16T19:38:31.455556] [INFO ] [MAIN ] Update Progress: 1123/2369 symbols completed. IPI took 33.5s. Estimated remaining: 2h 55m 49s. Rate: 7.1 symbols/min [2025-10-16T19:38:31.589293] [DEBUG] [LOCAL ] IQV: Primary data saved (50425 records). [2025-10-16T19:38:31.607281] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-16T19:38:31.627441] [INFO ] [MAIN ] Update Progress: 1124/2369 symbols completed. IQV took 33.7s. Estimated remaining: 2h 55m 31s. Rate: 7.1 symbols/min [2025-10-16T19:38:31.665208] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:38:31.841545] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:38:31.842678] [DEBUG] [LOCAL ] IRS: Loaded 23063 existing records from primary storage. [2025-10-16T19:38:31.842953] [INFO ] [MAIN ] IRS: Loaded 23063 existing records. [2025-10-16T19:38:32.037222] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:38:32.037711] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-16T19:38:32.037828] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-16T19:38:32.038035] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-16T19:38:32.038719] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-16T19:38:32.220604] [DEBUG] [LOCAL ] IRT: Loaded 50567 existing records from primary storage. [2025-10-16T19:38:32.245056] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-16T19:38:32.255731] [INFO ] [MAIN ] IRT: Loaded 50567 existing records. [2025-10-16T19:38:32.378930] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-16T19:38:32.592000] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:32.680591] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:38:32.681048] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-16T19:38:32.681175] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-16T19:38:32.681574] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-16T19:38:32.681678] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-16T19:38:32.755488] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-16T19:38:33.060879] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-16T19:38:33.138305] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:33.542817] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-16T19:38:33.842758] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T19:38:33.947979] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T19:38:34.342815] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-16T19:38:34.652348] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T19:38:35.142819] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-16T19:38:35.942798] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-16T19:38:36.047321] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T19:38:36.515357] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T19:38:36.742776] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-16T19:38:37.068070] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T19:38:37.542850] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-16T19:38:38.342805] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-16T19:38:38.436402] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T19:38:38.703392] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T19:38:38.974738] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-16T19:38:39.142875] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-16T19:38:39.908225] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T19:38:39.942824] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-16T19:38:40.742800] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-16T19:38:41.044958] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T19:38:41.542817] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-16T19:38:42.220133] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T19:38:42.342800] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-16T19:38:43.120581] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T19:38:43.142770] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-16T19:38:43.942788] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-16T19:38:44.141777] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-16T19:38:44.742834] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-16T19:38:44.842408] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T19:38:45.542835] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-16T19:38:46.342943] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-16T19:38:46.547299] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T19:38:46.825865] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (2.88 seconds). [2025-10-16T19:38:46.992223] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-16T19:38:47.142876] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-16T19:38:47.793023] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T19:38:47.942854] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-16T19:38:48.742813] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-16T19:38:48.811143] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T19:38:48.952446] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T19:38:49.542819] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-16T19:38:50.132181] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T19:38:50.342843] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-16T19:38:50.587189] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T19:38:51.142829] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-16T19:38:51.942810] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-16T19:38:52.124596] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T19:38:52.237516] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T19:38:52.742847] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-16T19:38:53.535759] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T19:38:53.546369] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-16T19:38:54.163040] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T19:38:54.342832] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-16T19:38:55.142838] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-16T19:38:55.223430] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T19:38:55.787667] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T19:38:55.942851] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-16T19:38:56.742811] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-16T19:38:56.874860] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T19:38:56.887180] [INFO ] [REMOTE ] IR: Full fetch complete (76477 records). [2025-10-16T19:38:56.887571] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-16T19:38:57.305063] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-16T19:38:57.305182] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-16T19:38:57.307224] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-16T19:38:57.307310] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-16T19:38:57.309512] [DEBUG] [LOCAL ] IR: Trimmed 76477 records to 53164 (keeping 200 days of data) [2025-10-16T19:38:57.544327] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-16T19:38:57.712108] [DEBUG] [LOCAL ] IR: Primary data saved (53164 records). [2025-10-16T19:38:57.712380] [INFO ] [MAIN ] IR: Full history saved. [2025-10-16T19:38:57.713228] [INFO ] [MAIN ] Update Progress: 1125/2369 symbols completed. IR took 37.3s. Estimated remaining: 2h 55m 43s. Rate: 7.1 symbols/min [2025-10-16T19:38:57.726945] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T19:38:57.914619] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:38:57.937067] [DEBUG] [LOCAL ] ISD: Loaded 15874 existing records from primary storage. [2025-10-16T19:38:57.937579] [INFO ] [MAIN ] ISD: Loaded 15874 existing records. [2025-10-16T19:38:58.101100] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T19:38:58.141133] [INFO ] [REMOTE ] IRS: Full fetch complete (32707 records). [2025-10-16T19:38:58.158338] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-16T19:38:58.163990] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:38:58.164573] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-16T19:38:58.213183] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-16T19:38:58.274705] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-16T19:38:58.275341] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-16T19:38:58.348639] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-16T19:38:58.931998] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-16T19:38:58.944803] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-16T19:38:58.946032] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-16T19:38:58.946509] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-16T19:38:59.015820] [DEBUG] [LOCAL ] IRS: Trimmed 32707 records to 23269 (keeping 200 days of data) [2025-10-16T19:38:59.042383] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:59.151765] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-16T19:38:59.200576] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T19:38:59.248734] [DEBUG] [LOCAL ] IRS: Primary data saved (23269 records). [2025-10-16T19:38:59.248904] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-16T19:38:59.249001] [INFO ] [MAIN ] Update Progress: 1126/2369 symbols completed. IRS took 27.8s. Estimated remaining: 2h 55m 26s. Rate: 7.1 symbols/min [2025-10-16T19:38:59.427578] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:38:59.473059] [DEBUG] [LOCAL ] IT: Loaded 42223 existing records from primary storage. [2025-10-16T19:38:59.473488] [INFO ] [MAIN ] IT: Loaded 42223 existing records. [2025-10-16T19:38:59.656018] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:38:59.656330] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-16T19:38:59.656392] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-16T19:38:59.656611] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-16T19:38:59.656872] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-16T19:38:59.954918] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-16T19:39:00.078384] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-16T19:39:00.082533] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:39:00.269628] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T19:39:00.742847] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-16T19:39:01.542925] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-16T19:39:01.933850] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T19:39:02.342850] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-16T19:39:02.525921] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T19:39:02.572379] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T19:39:03.142831] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-16T19:39:03.681977] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T19:39:03.942841] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-16T19:39:04.603503] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T19:39:04.610796] [INFO ] [REMOTE ] IRT: Full fetch complete (72969 records). [2025-10-16T19:39:04.610971] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-16T19:39:04.754845] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-16T19:39:05.030807] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-16T19:39:05.030941] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-16T19:39:05.032471] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-16T19:39:05.032540] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-16T19:39:05.034583] [DEBUG] [LOCAL ] IRT: Trimmed 72969 records to 50924 (keeping 200 days of data) [2025-10-16T19:39:05.376435] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T19:39:05.405139] [DEBUG] [LOCAL ] IRT: Primary data saved (50924 records). [2025-10-16T19:39:05.405342] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-16T19:39:05.405452] [INFO ] [MAIN ] Update Progress: 1127/2369 symbols completed. IRT took 33.8s. Estimated remaining: 2h 55m 15s. Rate: 7.1 symbols/min [2025-10-16T19:39:05.547938] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-16T19:39:05.597063] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:39:05.634330] [DEBUG] [LOCAL ] ITGR: Loaded 31316 existing records from primary storage. [2025-10-16T19:39:05.634706] [INFO ] [MAIN ] ITGR: Loaded 31316 existing records. [2025-10-16T19:39:05.823505] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:39:05.823816] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-16T19:39:05.823871] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-16T19:39:05.824121] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-16T19:39:05.824180] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-16T19:39:06.223876] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:39:06.351597] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-16T19:39:06.369970] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T19:39:06.498343] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T19:39:07.142849] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-16T19:39:07.198696] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T19:39:07.942876] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-16T19:39:08.742789] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-16T19:39:08.932192] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T19:39:09.333442] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:39:09.542861] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-16T19:39:09.840687] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T19:39:10.232251] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-16T19:39:10.342834] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-16T19:39:11.142859] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-16T19:39:11.487096] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T19:39:11.942816] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-16T19:39:12.704353] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T19:39:12.742806] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-16T19:39:12.955459] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T19:39:13.542819] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-16T19:39:14.258485] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T19:39:14.342846] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-16T19:39:15.149593] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-16T19:39:15.152438] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T19:39:15.942790] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-16T19:39:16.106509] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-16T19:39:16.113817] [INFO ] [REMOTE ] IRM: Full fetch complete (72301 records). [2025-10-16T19:39:16.120380] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-16T19:39:16.125600] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T19:39:16.525260] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-16T19:39:16.525335] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-16T19:39:16.526343] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-16T19:39:16.526406] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-16T19:39:16.527736] [DEBUG] [LOCAL ] IRM: Trimmed 72301 records to 49463 (keeping 200 days of data) [2025-10-16T19:39:16.742912] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-16T19:39:16.831106] [DEBUG] [LOCAL ] IRM: Primary data saved (49463 records). [2025-10-16T19:39:16.831231] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-16T19:39:16.832060] [INFO ] [MAIN ] Update Progress: 1128/2369 symbols completed. IRM took 47.5s. Estimated remaining: 2h 55m 10s. Rate: 7.1 symbols/min [2025-10-16T19:39:17.000791] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:39:17.021615] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T19:39:17.059250] [DEBUG] [LOCAL ] ITT: Loaded 32710 existing records from primary storage. [2025-10-16T19:39:17.059509] [INFO ] [MAIN ] ITT: Loaded 32710 existing records. [2025-10-16T19:39:17.234434] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:39:17.234632] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-16T19:39:17.234711] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-16T19:39:17.234989] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-16T19:39:17.235044] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-16T19:39:17.547969] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-16T19:39:17.587923] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:39:18.249834] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T19:39:18.342789] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-16T19:39:18.403013] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T19:39:19.142820] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-16T19:39:19.537453] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T19:39:19.942794] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-16T19:39:20.162091] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T19:39:20.742795] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-16T19:39:20.913200] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-16T19:39:21.542791] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-16T19:39:21.693311] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T19:39:22.342826] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-16T19:39:22.791448] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T19:39:23.142828] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-16T19:39:23.160103] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-16T19:39:23.942834] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-16T19:39:24.750931] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-16T19:39:24.758196] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T19:39:24.833762] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T19:39:25.542803] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-16T19:39:25.708756] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T19:39:26.342813] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-16T19:39:27.142864] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-16T19:39:27.242572] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T19:39:27.538958] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T19:39:27.942812] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-16T19:39:28.532864] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:39:28.742878] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-16T19:39:29.542854] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-16T19:39:29.704248] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-16T19:39:29.710247] [INFO ] [REMOTE ] IT: Full fetch complete (57446 records). [2025-10-16T19:39:29.710386] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-16T19:39:30.120935] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-16T19:39:30.122116] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-16T19:39:30.122013] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T19:39:30.123246] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-16T19:39:30.129074] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-16T19:39:30.140063] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T19:39:30.144286] [DEBUG] [LOCAL ] IT: Trimmed 57446 records to 42544 (keeping 200 days of data) [2025-10-16T19:39:30.348480] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-16T19:39:30.400925] [DEBUG] [LOCAL ] IT: Primary data saved (42544 records). [2025-10-16T19:39:30.401059] [INFO ] [MAIN ] IT: Full history saved. [2025-10-16T19:39:30.401151] [INFO ] [MAIN ] Update Progress: 1129/2369 symbols completed. IT took 31.2s. Estimated remaining: 2h 55m 7s. Rate: 7.1 symbols/min [2025-10-16T19:39:30.566761] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:39:30.614203] [DEBUG] [LOCAL ] ITUB: Loaded 53332 existing records from primary storage. [2025-10-16T19:39:30.614560] [INFO ] [MAIN ] ITUB: Loaded 53332 existing records. [2025-10-16T19:39:30.793112] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:39:30.793321] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-16T19:39:30.793369] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-16T19:39:30.793558] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-16T19:39:30.793597] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-16T19:39:31.143523] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-16T19:39:31.149723] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:39:31.225727] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T19:39:31.228521] [INFO ] [REMOTE ] ISD: Full fetch complete (24118 records). [2025-10-16T19:39:31.228600] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-16T19:39:31.600545] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-16T19:39:31.600664] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-16T19:39:31.601372] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-16T19:39:31.601441] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-16T19:39:31.602422] [DEBUG] [LOCAL ] ISD: Trimmed 24118 records to 15985 (keeping 200 days of data) [2025-10-16T19:39:31.728836] [DEBUG] [LOCAL ] ISD: Primary data saved (15985 records). [2025-10-16T19:39:31.728999] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-16T19:39:31.729088] [INFO ] [MAIN ] Update Progress: 1130/2369 symbols completed. ISD took 34.0s. Estimated remaining: 2h 54m 51s. Rate: 7.1 symbols/min [2025-10-16T19:39:31.945932] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-16T19:39:31.947938] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:39:32.005154] [DEBUG] [LOCAL ] ITW: Loaded 45789 existing records from primary storage. [2025-10-16T19:39:32.005559] [INFO ] [MAIN ] ITW: Loaded 45789 existing records. [2025-10-16T19:39:32.261041] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:39:32.261352] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-16T19:39:32.261440] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-16T19:39:32.261782] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-16T19:39:32.261842] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-16T19:39:32.729855] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:39:32.747962] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-16T19:39:32.765941] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T19:39:33.200939] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T19:39:33.542835] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-16T19:39:34.054841] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T19:39:34.342816] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-16T19:39:35.142833] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-16T19:39:35.268245] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T19:39:35.761244] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T19:39:35.942839] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-16T19:39:36.266046] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-16T19:39:36.270360] [INFO ] [REMOTE ] ITGR: Full fetch complete (42840 records). [2025-10-16T19:39:36.270446] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-16T19:39:36.655997] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-16T19:39:36.656074] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-16T19:39:36.656855] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-16T19:39:36.656917] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-16T19:39:36.657868] [DEBUG] [LOCAL ] ITGR: Trimmed 42840 records to 31563 (keeping 200 days of data) [2025-10-16T19:39:36.745274] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-16T19:39:36.851809] [DEBUG] [LOCAL ] ITGR: Primary data saved (31563 records). [2025-10-16T19:39:36.851972] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-16T19:39:36.852054] [INFO ] [MAIN ] Update Progress: 1131/2369 symbols completed. ITGR took 31.4s. Estimated remaining: 2h 54m 39s. Rate: 7.1 symbols/min [2025-10-16T19:39:37.041759] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:39:37.042092] [DEBUG] [LOCAL ] IVR: No existing data file found in primary storage. [2025-10-16T19:39:37.042144] [WARN ] [MAIN ] IVR: No existing data found, performing full refresh instead. [2025-10-16T19:39:37.042303] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-16T19:39:37.042355] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-16T19:39:37.042400] [DEBUG] [LOCAL ] IVR: No primary data file found to delete. [2025-10-16T19:39:37.042486] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-16T19:39:37.421891] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:39:37.444633] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T19:39:37.542808] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-16T19:39:38.342859] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-16T19:39:38.376840] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T19:39:38.530797] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T19:39:39.142826] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-16T19:39:39.942797] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-16T19:39:40.176861] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T19:39:40.290295] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T19:39:40.742854] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-16T19:39:41.542840] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-16T19:39:41.927895] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-16T19:39:41.984600] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T19:39:42.342841] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-16T19:39:42.915868] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T19:39:43.142786] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-16T19:39:43.181087] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T19:39:43.942795] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-16T19:39:44.742859] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-16T19:39:44.815874] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T19:39:45.262802] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T19:39:45.266959] [INFO ] [REMOTE ] ITT: Full fetch complete (47350 records). [2025-10-16T19:39:45.267048] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-16T19:39:45.546480] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-16T19:39:45.634067] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-16T19:39:45.634141] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-16T19:39:45.634942] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-16T19:39:45.635005] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-16T19:39:45.635934] [DEBUG] [LOCAL ] ITT: Trimmed 47350 records to 32949 (keeping 200 days of data) [2025-10-16T19:39:45.842145] [DEBUG] [LOCAL ] ITT: Primary data saved (32949 records). [2025-10-16T19:39:45.842345] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-16T19:39:45.842448] [INFO ] [MAIN ] Update Progress: 1132/2369 symbols completed. ITT took 29.0s. Estimated remaining: 2h 54m 31s. Rate: 7.1 symbols/min [2025-10-16T19:39:46.006439] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:39:46.037113] [DEBUG] [LOCAL ] IVT: Loaded 31347 existing records from primary storage. [2025-10-16T19:39:46.037368] [INFO ] [MAIN ] IVT: Loaded 31347 existing records. [2025-10-16T19:39:46.213087] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:39:46.213317] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-16T19:39:46.213364] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-16T19:39:46.213541] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-16T19:39:46.213595] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-16T19:39:46.350430] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-16T19:39:46.594907] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T19:39:46.598452] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:39:46.830903] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T19:39:47.142799] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-16T19:39:47.942863] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-16T19:39:48.157774] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T19:39:48.742838] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-16T19:39:48.849199] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T19:39:49.473690] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T19:39:49.542783] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-16T19:39:49.908090] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T19:39:50.342817] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-16T19:39:51.142798] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-16T19:39:51.217499] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T19:39:51.804283] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T19:39:51.942827] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-16T19:39:52.565629] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T19:39:52.742844] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-16T19:39:53.229306] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T19:39:53.542789] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-16T19:39:54.342807] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-16T19:39:54.639496] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T19:39:54.867890] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T19:39:55.142782] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-16T19:39:55.942789] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-16T19:39:56.041458] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T19:39:56.606950] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T19:39:56.742803] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-16T19:39:57.211243] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-16T19:39:57.542872] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-16T19:39:58.128602] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T19:39:58.342859] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-16T19:39:58.780834] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T19:39:59.142836] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-16T19:39:59.582343] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T19:39:59.942814] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-16T19:40:00.702761] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T19:40:00.742814] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-16T19:40:01.552270] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-16T19:40:01.577922] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T19:40:02.155506] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T19:40:02.163111] [INFO ] [REMOTE ] ITW: Full fetch complete (66754 records). [2025-10-16T19:40:02.163318] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-16T19:40:02.345102] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-16T19:40:02.561682] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-16T19:40:02.561778] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-16T19:40:02.562757] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-16T19:40:02.562822] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-16T19:40:02.564172] [DEBUG] [LOCAL ] ITW: Trimmed 66754 records to 46082 (keeping 200 days of data) [2025-10-16T19:40:02.875469] [DEBUG] [LOCAL ] ITW: Primary data saved (46082 records). [2025-10-16T19:40:02.875631] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-16T19:40:02.876234] [INFO ] [MAIN ] Update Progress: 1133/2369 symbols completed. ITW took 31.1s. Estimated remaining: 2h 54m 32s. Rate: 7.1 symbols/min [2025-10-16T19:40:03.044095] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:40:03.096910] [DEBUG] [LOCAL ] IVZ: Loaded 53117 existing records from primary storage. [2025-10-16T19:40:03.097468] [INFO ] [MAIN ] IVZ: Loaded 53117 existing records. [2025-10-16T19:40:03.162131] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-16T19:40:03.307281] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:40:03.307471] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-16T19:40:03.307520] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-16T19:40:03.307784] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-16T19:40:03.307843] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-16T19:40:03.705744] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:40:03.710508] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-16T19:40:03.841309] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T19:40:03.942817] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-16T19:40:04.742862] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-16T19:40:05.011516] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T19:40:05.362167] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T19:40:05.542902] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-16T19:40:05.617058] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T19:40:06.342845] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-16T19:40:07.142838] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-16T19:40:07.268947] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T19:40:07.583515] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T19:40:07.942825] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-16T19:40:08.742856] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-16T19:40:08.839272] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T19:40:09.542833] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-16T19:40:09.570269] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T19:40:10.134546] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T19:40:10.342845] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-16T19:40:10.673638] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T19:40:11.142782] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-16T19:40:11.942801] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-16T19:40:12.325230] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-16T19:40:12.331838] [INFO ] [REMOTE ] IVR: Full fetch complete (69227 records). [2025-10-16T19:40:12.331994] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-16T19:40:12.718266] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-16T19:40:12.718355] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-16T19:40:12.719390] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-16T19:40:12.719453] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-16T19:40:12.720869] [DEBUG] [LOCAL ] IVR: Trimmed 69227 records to 48437 (keeping 200 days of data) [2025-10-16T19:40:12.768055] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-16T19:40:12.930023] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T19:40:13.000709] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T19:40:13.075215] [DEBUG] [LOCAL ] IVR: Primary data saved (48437 records). [2025-10-16T19:40:13.075354] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-16T19:40:13.075428] [INFO ] [MAIN ] Update Progress: 1134/2369 symbols completed. IVR took 36.2s. Estimated remaining: 2h 54m 25s. Rate: 7.1 symbols/min [2025-10-16T19:40:13.255377] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:40:13.284215] [DEBUG] [LOCAL ] IX: Loaded 22281 existing records from primary storage. [2025-10-16T19:40:13.284544] [INFO ] [MAIN ] IX: Loaded 22281 existing records. [2025-10-16T19:40:13.460286] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:40:13.460515] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-16T19:40:13.460565] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-16T19:40:13.460767] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-16T19:40:13.460824] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-16T19:40:13.551781] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-16T19:40:13.813872] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:40:14.342792] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-16T19:40:14.671704] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-16T19:40:14.878462] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T19:40:15.142849] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-16T19:40:15.942922] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-16T19:40:16.115604] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T19:40:16.742820] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-16T19:40:16.977368] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T19:40:17.542778] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-16T19:40:17.602761] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T19:40:17.607625] [INFO ] [REMOTE ] IVT: Full fetch complete (45933 records). [2025-10-16T19:40:17.607745] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-16T19:40:18.001381] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-16T19:40:18.001524] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-16T19:40:18.002668] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-16T19:40:18.002734] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-16T19:40:18.003759] [DEBUG] [LOCAL ] IVT: Trimmed 45933 records to 31572 (keeping 200 days of data) [2025-10-16T19:40:18.193634] [DEBUG] [LOCAL ] IVT: Primary data saved (31572 records). [2025-10-16T19:40:18.193870] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-16T19:40:18.193964] [INFO ] [MAIN ] Update Progress: 1135/2369 symbols completed. IVT took 32.4s. Estimated remaining: 2h 54m 13s. Rate: 7.1 symbols/min [2025-10-16T19:40:18.343718] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-16T19:40:18.369166] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T19:40:18.404066] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:40:18.453907] [DEBUG] [LOCAL ] J: Loaded 40381 existing records from primary storage. [2025-10-16T19:40:18.454217] [INFO ] [MAIN ] J: Loaded 40381 existing records. [2025-10-16T19:40:18.635048] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:40:18.635222] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-16T19:40:18.635268] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-16T19:40:18.635679] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-16T19:40:18.635741] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-16T19:40:19.003180] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:40:19.142305] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-16T19:40:19.144169] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T19:40:19.144361] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-16T19:40:19.942866] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-16T19:40:20.604317] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T19:40:20.742806] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-16T19:40:21.542797] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-16T19:40:21.785864] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T19:40:21.792719] [INFO ] [REMOTE ] ITUB: Full fetch complete (77320 records). [2025-10-16T19:40:21.792862] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-16T19:40:22.197580] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-16T19:40:22.197829] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-16T19:40:22.199036] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-16T19:40:22.199122] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-16T19:40:22.200750] [DEBUG] [LOCAL ] ITUB: Trimmed 77320 records to 53720 (keeping 200 days of data) [2025-10-16T19:40:22.327894] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-16T19:40:22.329454] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T19:40:22.344067] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-16T19:40:22.561549] [DEBUG] [LOCAL ] ITUB: Primary data saved (53720 records). [2025-10-16T19:40:22.561680] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-16T19:40:22.562278] [INFO ] [MAIN ] Update Progress: 1136/2369 symbols completed. ITUB took 52.2s. Estimated remaining: 2h 54m 0s. Rate: 7.1 symbols/min [2025-10-16T19:40:22.732545] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:40:22.773372] [DEBUG] [LOCAL ] JBGS: Loaded 42194 existing records from primary storage. [2025-10-16T19:40:22.773688] [INFO ] [MAIN ] JBGS: Loaded 42194 existing records. [2025-10-16T19:40:22.945976] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:40:22.946171] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-16T19:40:22.946219] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-16T19:40:22.946409] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-16T19:40:22.946464] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-16T19:40:23.148135] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-16T19:40:23.299697] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:40:23.827926] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T19:40:23.942839] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-16T19:40:24.742785] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-16T19:40:25.031450] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T19:40:25.212145] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-16T19:40:25.542782] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-16T19:40:25.565587] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T19:40:26.342790] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-16T19:40:27.142844] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-16T19:40:27.266698] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T19:40:27.555763] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T19:40:27.942837] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-16T19:40:28.326373] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T19:40:28.742874] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-16T19:40:29.542784] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-16T19:40:29.779358] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T19:40:29.786878] [INFO ] [REMOTE ] IVZ: Full fetch complete (77015 records). [2025-10-16T19:40:29.787173] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-16T19:40:29.963242] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-16T19:40:30.222147] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-16T19:40:30.222232] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-16T19:40:30.223275] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-16T19:40:30.223338] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-16T19:40:30.224874] [DEBUG] [LOCAL ] IVZ: Trimmed 77015 records to 53506 (keeping 200 days of data) [2025-10-16T19:40:30.345956] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-16T19:40:30.542559] [DEBUG] [LOCAL ] IVZ: Primary data saved (53506 records). [2025-10-16T19:40:30.542730] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-16T19:40:30.543209] [INFO ] [MAIN ] Update Progress: 1137/2369 symbols completed. IVZ took 27.7s. Estimated remaining: 2h 53m 51s. Rate: 7.1 symbols/min [2025-10-16T19:40:30.716895] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:40:30.758825] [DEBUG] [LOCAL ] JBI: Loaded 42989 existing records from primary storage. [2025-10-16T19:40:30.759136] [INFO ] [MAIN ] JBI: Loaded 42989 existing records. [2025-10-16T19:40:30.934707] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:40:30.935022] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-16T19:40:30.935144] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-16T19:40:30.935374] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-16T19:40:30.935440] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-16T19:40:31.156968] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-16T19:40:31.194474] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:40:31.351122] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:40:31.371255] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T19:40:31.942818] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-16T19:40:32.458098] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T19:40:32.742838] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-16T19:40:33.112000] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T19:40:33.542805] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-16T19:40:33.965597] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T19:40:34.342804] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-16T19:40:35.039778] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T19:40:35.142812] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-16T19:40:35.445443] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T19:40:35.942832] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-16T19:40:36.543278] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T19:40:36.742837] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-16T19:40:37.549777] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-16T19:40:37.552746] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T19:40:37.940817] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T19:40:38.342803] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-16T19:40:38.652116] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T19:40:39.142842] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-16T19:40:39.755419] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T19:40:39.942846] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-16T19:40:40.230101] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T19:40:40.737368] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T19:40:40.742769] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-16T19:40:41.542820] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-16T19:40:41.726074] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T19:40:42.342814] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-16T19:40:43.021266] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T19:40:43.142808] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-16T19:40:43.944598] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-16T19:40:43.949861] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T19:40:44.261812] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T19:40:44.742809] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-16T19:40:45.436850] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T19:40:45.542816] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-16T19:40:46.149522] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T19:40:46.342786] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-16T19:40:47.025831] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T19:40:47.142883] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-16T19:40:47.782347] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T19:40:47.942814] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-16T19:40:48.742468] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T19:40:48.751416] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-16T19:40:49.354892] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T19:40:49.542809] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-16T19:40:49.934140] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T19:40:50.342830] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-16T19:40:50.601902] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T19:40:51.142823] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-16T19:40:51.413491] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T19:40:51.417934] [INFO ] [REMOTE ] IX: Full fetch complete (28263 records). [2025-10-16T19:40:51.418074] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-16T19:40:51.793593] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-16T19:40:51.793727] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-16T19:40:51.794325] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-16T19:40:51.794371] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-16T19:40:51.795346] [DEBUG] [LOCAL ] IX: Trimmed 28263 records to 22439 (keeping 200 days of data) [2025-10-16T19:40:51.925674] [DEBUG] [LOCAL ] IX: Primary data saved (22439 records). [2025-10-16T19:40:51.925810] [INFO ] [MAIN ] IX: Full history saved. [2025-10-16T19:40:51.925889] [INFO ] [MAIN ] Update Progress: 1138/2369 symbols completed. IX took 38.9s. Estimated remaining: 2h 53m 57s. Rate: 7.1 symbols/min [2025-10-16T19:40:51.947969] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-16T19:40:52.101054] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:40:52.146810] [DEBUG] [LOCAL ] JBL: Loaded 48349 existing records from primary storage. [2025-10-16T19:40:52.147246] [INFO ] [MAIN ] JBL: Loaded 48349 existing records. [2025-10-16T19:40:52.327295] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:40:52.327501] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-16T19:40:52.327548] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-16T19:40:52.328429] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-16T19:40:52.328504] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-16T19:40:52.693345] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:40:52.721794] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-16T19:40:52.742793] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-16T19:40:53.110534] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-16T19:40:53.542817] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-16T19:40:54.335592] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T19:40:54.344485] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-16T19:40:54.940348] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-16T19:40:54.946038] [INFO ] [REMOTE ] J: Full fetch complete (59590 records). [2025-10-16T19:40:54.946178] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-16T19:40:55.149173] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-16T19:40:55.330475] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-16T19:40:55.330551] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-16T19:40:55.331438] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-16T19:40:55.331500] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-16T19:40:55.334003] [DEBUG] [LOCAL ] J: Trimmed 59590 records to 40700 (keeping 200 days of data) [2025-10-16T19:40:55.588954] [DEBUG] [LOCAL ] J: Primary data saved (40700 records). [2025-10-16T19:40:55.589076] [INFO ] [MAIN ] J: Full history saved. [2025-10-16T19:40:55.589152] [INFO ] [MAIN ] Update Progress: 1139/2369 symbols completed. J took 37.4s. Estimated remaining: 2h 53m 43s. Rate: 7.1 symbols/min [2025-10-16T19:40:55.760703] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:40:55.789960] [DEBUG] [LOCAL ] JBND: Loaded 26907 existing records from primary storage. [2025-10-16T19:40:55.790238] [INFO ] [MAIN ] JBND: Loaded 26907 existing records. [2025-10-16T19:40:55.963909] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-16T19:40:55.969143] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T19:40:56.004906] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:40:56.005930] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-16T19:40:56.006152] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-16T19:40:56.006746] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-16T19:40:56.006839] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-16T19:40:56.359245] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:40:56.583884] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T19:40:56.742876] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-16T19:40:57.542859] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-16T19:40:57.572008] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T19:40:57.687105] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-16T19:40:58.342815] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-16T19:40:58.707939] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T19:40:58.712838] [INFO ] [REMOTE ] JBGS: Full fetch complete (59314 records). [2025-10-16T19:40:58.712940] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-16T19:40:59.111599] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-16T19:40:59.111695] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-16T19:40:59.112580] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-16T19:40:59.112621] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-16T19:40:59.113809] [DEBUG] [LOCAL ] JBGS: Trimmed 59314 records to 42407 (keeping 200 days of data) [2025-10-16T19:40:59.165734] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-16T19:40:59.364826] [DEBUG] [LOCAL ] JBGS: Primary data saved (42407 records). [2025-10-16T19:40:59.364976] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-16T19:40:59.365664] [INFO ] [MAIN ] Update Progress: 1140/2369 symbols completed. JBGS took 36.8s. Estimated remaining: 2h 53m 30s. Rate: 7.1 symbols/min [2025-10-16T19:40:59.535391] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:40:59.535698] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-16T19:40:59.535754] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-16T19:40:59.535863] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-16T19:40:59.535903] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-16T19:40:59.535944] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-16T19:40:59.535975] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-16T19:40:59.904304] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:40:59.908548] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T19:40:59.942763] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-16T19:41:00.222157] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-16T19:41:00.742814] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-16T19:41:01.203388] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T19:41:01.542856] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-16T19:41:01.676744] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T19:41:01.750049] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:41:01.750340] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-16T19:41:01.750435] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:41:01.750502] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-16T19:41:01.750567] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:41:01.750639] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-16T19:41:01.750764] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-16T19:41:01.750803] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-16T19:41:01.750843] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-16T19:41:01.750941] [INFO ] [MAIN ] Update Progress: 1141/2369 symbols completed. JBS took 2.4s. Estimated remaining: 2h 53m 14s. Rate: 7.1 symbols/min [2025-10-16T19:41:01.920311] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:41:01.920529] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-16T19:41:01.920571] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-16T19:41:01.920707] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-16T19:41:01.920758] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-16T19:41:01.920800] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-16T19:41:01.920832] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-16T19:41:02.266146] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:41:02.342803] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-16T19:41:02.542885] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:41:02.543118] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-16T19:41:02.543204] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:41:02.543251] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-16T19:41:02.543292] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:41:02.543354] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-16T19:41:02.543414] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-16T19:41:02.543449] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-16T19:41:02.543488] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-16T19:41:02.543533] [INFO ] [MAIN ] Update Progress: 1142/2369 symbols completed. JBTM took 0.8s. Estimated remaining: 2h 52m 58s. Rate: 7.1 symbols/min [2025-10-16T19:41:02.707603] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:41:02.718605] [DEBUG] [LOCAL ] JCE: Loaded 7439 existing records from primary storage. [2025-10-16T19:41:02.718862] [INFO ] [MAIN ] JCE: Loaded 7439 existing records. [2025-10-16T19:41:02.890557] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:41:02.890780] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-16T19:41:02.890829] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-16T19:41:02.891015] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-16T19:41:02.891070] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-16T19:41:03.148077] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-16T19:41:03.239442] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:41:03.942793] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-16T19:41:04.498742] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:41:04.742945] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-16T19:41:05.522821] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T19:41:05.528365] [INFO ] [REMOTE ] JBI: Full fetch complete (63990 records). [2025-10-16T19:41:05.528510] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-16T19:41:05.549748] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-16T19:41:05.909331] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-16T19:41:05.909423] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-16T19:41:05.910418] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-16T19:41:05.910485] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-16T19:41:05.911816] [DEBUG] [LOCAL ] JBI: Trimmed 63990 records to 43293 (keeping 200 days of data) [2025-10-16T19:41:06.151188] [DEBUG] [LOCAL ] JBI: Primary data saved (43293 records). [2025-10-16T19:41:06.151314] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-16T19:41:06.151875] [INFO ] [MAIN ] Update Progress: 1143/2369 symbols completed. JBI took 35.6s. Estimated remaining: 2h 52m 44s. Rate: 7.1 symbols/min [2025-10-16T19:41:06.331206] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:41:06.342806] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-16T19:41:06.388597] [DEBUG] [LOCAL ] JCI: Loaded 53527 existing records from primary storage. [2025-10-16T19:41:06.389032] [INFO ] [MAIN ] JCI: Loaded 53527 existing records. [2025-10-16T19:41:06.578922] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:41:06.579238] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-16T19:41:06.579322] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-16T19:41:06.579747] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-16T19:41:06.579830] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-16T19:41:06.767404] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T19:41:06.947133] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-16T19:41:07.020220] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:41:07.027966] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-16T19:41:07.142785] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-16T19:41:07.942789] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-16T19:41:08.132397] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T19:41:08.742818] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-16T19:41:09.364292] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-16T19:41:09.542783] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-16T19:41:09.688042] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T19:41:10.126326] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T19:41:10.342807] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-16T19:41:11.142846] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-16T19:41:11.331295] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T19:41:11.504508] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-16T19:41:11.942809] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-16T19:41:12.742878] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-16T19:41:13.542804] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-16T19:41:13.790987] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T19:41:14.342846] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-16T19:41:14.643404] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T19:41:14.690944] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T19:41:14.756852] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-16T19:41:15.142821] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-16T19:41:15.942832] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-16T19:41:16.434480] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T19:41:16.742837] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-16T19:41:17.276580] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T19:41:17.314357] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T19:41:17.542876] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-16T19:41:18.342835] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-16T19:41:18.744428] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T19:41:19.142884] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-16T19:41:19.915417] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T19:41:19.942823] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-16T19:41:20.742844] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-16T19:41:20.902352] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T19:41:21.431024] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T19:41:21.542820] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-16T19:41:21.650634] [DEBUG] [REMOTE ] JCE: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-16T19:41:21.651244] [WARN ] [REMOTE ] JCE: No data returned for month 2025-07 [2025-10-16T19:41:21.651359] [FATAL] [REMOTE ] JCE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:41:21.651466] [FATAL] [MAIN ] JCE: Failed to fetch primary data. [2025-10-16T19:41:21.651546] [WARN ] [MAIN ] JCE: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:41:21.651636] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-16T19:41:21.651767] [DEBUG] [LOCAL ] JCE: No primary data file found to delete. [2025-10-16T19:41:21.651823] [INFO ] [LOCAL ] JCE: Starting deletion of derivative data. [2025-10-16T19:41:21.652210] [DEBUG] [LOCAL ] JCE: Deleted derivative data file. [2025-10-16T19:41:21.652314] [INFO ] [MAIN ] Update Progress: 1144/2369 symbols completed. JCE took 19.1s. Estimated remaining: 2h 52m 43s. Rate: 7.1 symbols/min [2025-10-16T19:41:21.850153] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:41:21.881854] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T19:41:21.938228] [DEBUG] [LOCAL ] JEF: Loaded 50171 existing records from primary storage. [2025-10-16T19:41:21.938603] [INFO ] [MAIN ] JEF: Loaded 50171 existing records. [2025-10-16T19:41:22.112975] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:41:22.113198] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-16T19:41:22.113246] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-16T19:41:22.113808] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-16T19:41:22.113869] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-16T19:41:22.349380] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-16T19:41:22.467613] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:41:23.142812] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-16T19:41:23.942810] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-16T19:41:24.215795] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T19:41:24.481044] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T19:41:24.742817] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-16T19:41:25.394457] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T19:41:25.542811] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-16T19:41:26.348048] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-16T19:41:26.373600] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T19:41:27.142797] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-16T19:41:27.417914] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-16T19:41:27.801839] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T19:41:27.942795] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-16T19:41:28.654763] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T19:41:28.742837] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-16T19:41:29.259256] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T19:41:29.542814] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-16T19:41:30.342826] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-16T19:41:30.376700] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T19:41:30.564760] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T19:41:30.569471] [INFO ] [REMOTE ] JBND: Full fetch complete (35631 records). [2025-10-16T19:41:30.569597] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-16T19:41:30.937700] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-16T19:41:30.937793] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-16T19:41:30.938524] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-16T19:41:30.938587] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-16T19:41:30.939582] [DEBUG] [LOCAL ] JBND: Trimmed 35631 records to 27187 (keeping 200 days of data) [2025-10-16T19:41:31.101181] [DEBUG] [LOCAL ] JBND: Primary data saved (27187 records). [2025-10-16T19:41:31.101311] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-16T19:41:31.101390] [INFO ] [MAIN ] Update Progress: 1145/2369 symbols completed. JBND took 35.5s. Estimated remaining: 2h 52m 36s. Rate: 7.1 symbols/min [2025-10-16T19:41:31.147916] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-16T19:41:31.272635] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:41:31.314789] [DEBUG] [LOCAL ] JELD: Loaded 46134 existing records from primary storage. [2025-10-16T19:41:31.315090] [INFO ] [MAIN ] JELD: Loaded 46134 existing records. [2025-10-16T19:41:31.492385] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:41:31.492594] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-16T19:41:31.492660] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-16T19:41:31.493006] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-16T19:41:31.493077] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-16T19:41:31.858969] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:41:31.942774] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-16T19:41:32.249861] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-16T19:41:32.256480] [INFO ] [REMOTE ] JBL: Full fetch complete (70609 records). [2025-10-16T19:41:32.256602] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-16T19:41:32.649216] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-16T19:41:32.649384] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-16T19:41:32.650439] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-16T19:41:32.650502] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-16T19:41:32.651839] [DEBUG] [LOCAL ] JBL: Trimmed 70609 records to 48716 (keeping 200 days of data) [2025-10-16T19:41:32.743769] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-16T19:41:32.960455] [DEBUG] [LOCAL ] JBL: Primary data saved (48716 records). [2025-10-16T19:41:32.960792] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-16T19:41:32.960883] [INFO ] [MAIN ] Update Progress: 1146/2369 symbols completed. JBL took 41.0s. Estimated remaining: 2h 52m 20s. Rate: 7.1 symbols/min [2025-10-16T19:41:33.058863] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-16T19:41:33.177225] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:41:33.206755] [DEBUG] [LOCAL ] JFR: Loaded 30985 existing records from primary storage. [2025-10-16T19:41:33.207047] [INFO ] [MAIN ] JFR: Loaded 30985 existing records. [2025-10-16T19:41:33.419325] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T19:41:33.416883] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:41:33.427565] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-16T19:41:33.427668] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-16T19:41:33.428005] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-16T19:41:33.428045] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-16T19:41:33.547984] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-16T19:41:33.776913] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:41:34.309263] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T19:41:34.342771] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-16T19:41:34.586404] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-16T19:41:35.142887] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-16T19:41:35.692943] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T19:41:35.942845] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-16T19:41:36.742802] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-16T19:41:36.905621] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T19:41:36.961327] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T19:41:37.542816] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-16T19:41:38.342862] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-16T19:41:38.664247] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-16T19:41:39.021771] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T19:41:39.142853] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-16T19:41:39.424348] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T19:41:39.942821] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-16T19:41:40.742832] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-16T19:41:40.873314] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T19:41:40.982884] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T19:41:41.542820] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-16T19:41:42.203309] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T19:41:42.342794] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-16T19:41:42.372251] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T19:41:42.379261] [INFO ] [REMOTE ] JCI: Full fetch complete (77626 records). [2025-10-16T19:41:42.379405] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-16T19:41:42.775012] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-16T19:41:42.775090] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-16T19:41:42.776126] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-16T19:41:42.776189] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-16T19:41:42.777845] [DEBUG] [LOCAL ] JCI: Trimmed 77626 records to 53916 (keeping 200 days of data) [2025-10-16T19:41:43.112792] [DEBUG] [LOCAL ] JCI: Primary data saved (53916 records). [2025-10-16T19:41:43.112989] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-16T19:41:43.113508] [INFO ] [MAIN ] Update Progress: 1147/2369 symbols completed. JCI took 37.0s. Estimated remaining: 2h 52m 14s. Rate: 7.1 symbols/min [2025-10-16T19:41:43.148045] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-16T19:41:43.286200] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:41:43.301743] [DEBUG] [LOCAL ] JGH: Loaded 12453 existing records from primary storage. [2025-10-16T19:41:43.301983] [INFO ] [MAIN ] JGH: Loaded 12453 existing records. [2025-10-16T19:41:43.480194] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:41:43.480423] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-16T19:41:43.480469] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-16T19:41:43.480731] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-16T19:41:43.480801] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-16T19:41:43.863736] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:41:43.867734] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T19:41:43.942798] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-16T19:41:44.742815] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-16T19:41:44.824065] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T19:41:44.890182] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-16T19:41:45.542868] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-16T19:41:46.342817] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-16T19:41:46.503160] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T19:41:46.660246] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T19:41:47.142896] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-16T19:41:47.857248] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T19:41:47.942784] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-16T19:41:48.742820] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-16T19:41:48.790443] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T19:41:49.416884] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T19:41:49.542778] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-16T19:41:49.633434] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-16T19:41:50.342814] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-16T19:41:51.005839] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T19:41:51.142830] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-16T19:41:51.547916] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-16T19:41:51.942860] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-16T19:41:52.460749] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-16T19:41:52.680385] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T19:41:52.742807] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-16T19:41:53.455696] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T19:41:53.542787] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-16T19:41:54.123325] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T19:41:54.342823] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-16T19:41:55.142838] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-16T19:41:55.413385] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T19:41:55.942820] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-16T19:41:56.692019] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T19:41:56.742777] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-16T19:41:57.542852] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-16T19:41:57.617745] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T19:41:58.335278] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T19:41:58.344452] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-16T19:41:58.588753] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-16T19:41:59.060211] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T19:41:59.142788] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-16T19:41:59.942793] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-16T19:42:00.730967] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T19:42:00.742770] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-16T19:42:01.503678] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T19:42:01.508413] [INFO ] [REMOTE ] JFR: Full fetch complete (48442 records). [2025-10-16T19:42:01.508538] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-16T19:42:01.551306] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-16T19:42:01.910839] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-16T19:42:01.910914] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-16T19:42:01.911758] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-16T19:42:01.911840] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-16T19:42:01.912815] [DEBUG] [LOCAL ] JFR: Trimmed 48442 records to 31245 (keeping 200 days of data) [2025-10-16T19:42:02.096154] [DEBUG] [LOCAL ] JFR: Primary data saved (31245 records). [2025-10-16T19:42:02.096281] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-16T19:42:02.096371] [INFO ] [MAIN ] Update Progress: 1148/2369 symbols completed. JFR took 29.1s. Estimated remaining: 2h 52m 16s. Rate: 7.1 symbols/min [2025-10-16T19:42:02.270689] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:42:02.311127] [DEBUG] [LOCAL ] JHG: Loaded 47560 existing records from primary storage. [2025-10-16T19:42:02.311784] [INFO ] [MAIN ] JHG: Loaded 47560 existing records. [2025-10-16T19:42:02.345631] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-16T19:42:02.399477] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T19:42:02.452065] [INFO ] [REMOTE ] JELD: Full fetch complete (64464 records). [2025-10-16T19:42:02.462579] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-16T19:42:02.541601] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:42:02.563142] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-16T19:42:02.575143] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-16T19:42:02.619486] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-16T19:42:02.630463] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-16T19:42:02.637110] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T19:42:03.162507] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-16T19:42:03.302862] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-16T19:42:03.317276] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-16T19:42:03.324267] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-16T19:42:03.323221] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:42:03.324594] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-16T19:42:03.325753] [DEBUG] [LOCAL ] JELD: Trimmed 64464 records to 46434 (keeping 200 days of data) [2025-10-16T19:42:03.578865] [DEBUG] [LOCAL ] JELD: Primary data saved (46434 records). [2025-10-16T19:42:03.578996] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-16T19:42:03.579076] [INFO ] [MAIN ] Update Progress: 1149/2369 symbols completed. JELD took 32.5s. Estimated remaining: 2h 52m 1s. Rate: 7.1 symbols/min [2025-10-16T19:42:03.744249] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:42:03.751719] [DEBUG] [LOCAL ] JHI: Loaded 4041 existing records from primary storage. [2025-10-16T19:42:03.751900] [INFO ] [MAIN ] JHI: Loaded 4041 existing records. [2025-10-16T19:42:03.931258] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:42:03.931570] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-16T19:42:03.931665] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-16T19:42:03.939381] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T19:42:03.939120] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-16T19:42:03.941959] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-16T19:42:03.953970] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-16T19:42:04.304235] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:42:04.323166] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-16T19:42:04.330069] [INFO ] [REMOTE ] JEF: Full fetch complete (73313 records). [2025-10-16T19:42:04.330193] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-16T19:42:04.719818] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-16T19:42:04.719898] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-16T19:42:04.720985] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-16T19:42:04.721047] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-16T19:42:04.722386] [DEBUG] [LOCAL ] JEF: Trimmed 73313 records to 50561 (keeping 200 days of data) [2025-10-16T19:42:04.775496] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-16T19:42:05.028270] [DEBUG] [LOCAL ] JEF: Primary data saved (50561 records). [2025-10-16T19:42:05.028423] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-16T19:42:05.029194] [INFO ] [MAIN ] Update Progress: 1150/2369 symbols completed. JEF took 43.4s. Estimated remaining: 2h 51m 45s. Rate: 7.1 symbols/min [2025-10-16T19:42:05.197527] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:42:05.203285] [DEBUG] [LOCAL ] JHS: Loaded 2933 existing records from primary storage. [2025-10-16T19:42:05.203475] [INFO ] [MAIN ] JHS: Loaded 2933 existing records. [2025-10-16T19:42:05.380601] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:42:05.380921] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-16T19:42:05.380980] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-16T19:42:05.381312] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-16T19:42:05.381408] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-16T19:42:05.486221] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T19:42:05.544389] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-16T19:42:05.699954] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T19:42:05.785732] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:42:06.037685] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-16T19:42:06.342828] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-16T19:42:07.142815] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-16T19:42:07.886604] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T19:42:07.911915] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T19:42:07.942773] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-16T19:42:08.742805] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-16T19:42:09.194842] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-16T19:42:09.465561] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T19:42:09.542893] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-16T19:42:10.026120] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T19:42:10.342823] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-16T19:42:11.142825] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-16T19:42:11.707053] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-16T19:42:11.942845] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-16T19:42:11.987123] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T19:42:12.573055] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T19:42:12.742811] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-16T19:42:13.383924] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-16T19:42:13.542824] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-16T19:42:14.089942] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-16T19:42:14.342826] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-16T19:42:14.782081] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-16T19:42:15.142820] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-16T19:42:15.942863] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-16T19:42:16.742850] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-16T19:42:16.771050] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T19:42:16.831212] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T19:42:17.211321] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-16T19:42:17.542815] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-16T19:42:18.342877] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-16T19:42:18.806819] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-16T19:42:19.141679] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T19:42:19.151389] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-16T19:42:19.620609] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-16T19:42:19.942818] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-16T19:42:20.742812] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-16T19:42:21.216179] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T19:42:21.526301] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T19:42:21.542769] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-16T19:42:22.342815] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-16T19:42:23.121435] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-16T19:42:23.142763] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-16T19:42:23.232757] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T19:42:23.622956] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-16T19:42:23.942908] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-16T19:42:24.305315] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-16T19:42:24.742833] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-16T19:42:25.304607] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-16T19:42:25.542826] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-16T19:42:26.342795] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-16T19:42:26.411227] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T19:42:27.142802] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-16T19:42:27.947194] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-16T19:42:27.952707] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T19:42:28.166127] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T19:42:28.169846] [INFO ] [REMOTE ] JGH: Full fetch complete (16292 records). [2025-10-16T19:42:28.169944] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-16T19:42:28.539931] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-16T19:42:28.540034] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-16T19:42:28.545156] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T19:42:28.544999] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-16T19:42:28.547194] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-16T19:42:28.547809] [DEBUG] [LOCAL ] JGH: Trimmed 16292 records to 12686 (keeping 200 days of data) [2025-10-16T19:42:28.624824] [DEBUG] [LOCAL ] JGH: Primary data saved (12686 records). [2025-10-16T19:42:28.624965] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-16T19:42:28.625044] [INFO ] [MAIN ] Update Progress: 1151/2369 symbols completed. JGH took 45.5s. Estimated remaining: 2h 51m 52s. Rate: 7.1 symbols/min [2025-10-16T19:42:28.747984] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-16T19:42:28.795186] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:42:28.851876] [DEBUG] [LOCAL ] JHX: Loaded 53161 existing records from primary storage. [2025-10-16T19:42:28.852276] [INFO ] [MAIN ] JHX: Loaded 53161 existing records. [2025-10-16T19:42:29.061980] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:42:29.062201] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-16T19:42:29.062250] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-16T19:42:29.062862] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-16T19:42:29.062921] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-16T19:42:29.397427] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-16T19:42:29.399621] [INFO ] [REMOTE ] JHI: Full fetch complete (5750 records). [2025-10-16T19:42:29.399733] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-16T19:42:29.576195] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:42:29.570406] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-16T19:42:29.856968] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-16T19:42:29.857043] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-16T19:42:29.857217] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-16T19:42:29.857255] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-16T19:42:29.857610] [DEBUG] [LOCAL ] JHI: Trimmed 5750 records to 4106 (keeping 200 days of data) [2025-10-16T19:42:29.881414] [DEBUG] [LOCAL ] JHI: Primary data saved (4106 records). [2025-10-16T19:42:29.881500] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-16T19:42:29.881572] [INFO ] [MAIN ] Update Progress: 1152/2369 symbols completed. JHI took 26.3s. Estimated remaining: 2h 51m 36s. Rate: 7.1 symbols/min [2025-10-16T19:42:30.043742] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:42:30.060735] [DEBUG] [LOCAL ] JILL: Loaded 15931 existing records from primary storage. [2025-10-16T19:42:30.060985] [INFO ] [MAIN ] JILL: Loaded 15931 existing records. [2025-10-16T19:42:30.231353] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:42:30.231548] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-16T19:42:30.231595] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-16T19:42:30.231790] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-16T19:42:30.231861] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-16T19:42:30.347988] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-16T19:42:30.579064] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:42:31.142794] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-16T19:42:31.317554] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T19:42:31.474205] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T19:42:31.542461] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-16T19:42:31.942853] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-16T19:42:32.742820] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-16T19:42:32.862038] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T19:42:33.028807] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-16T19:42:33.542823] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-16T19:42:34.342839] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-16T19:42:34.600154] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-16T19:42:34.724704] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-16T19:42:35.142864] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-16T19:42:35.700683] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-16T19:42:35.701578] [INFO ] [REMOTE ] JHS: Full fetch complete (4494 records). [2025-10-16T19:42:35.701675] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-16T19:42:35.947941] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-16T19:42:36.062151] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-16T19:42:36.062227] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-16T19:42:36.062384] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-16T19:42:36.062422] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-16T19:42:36.062805] [DEBUG] [LOCAL ] JHS: Trimmed 4494 records to 2944 (keeping 200 days of data) [2025-10-16T19:42:36.081147] [DEBUG] [LOCAL ] JHS: Primary data saved (2944 records). [2025-10-16T19:42:36.081226] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-16T19:42:36.081302] [INFO ] [MAIN ] Update Progress: 1153/2369 symbols completed. JHS took 31.1s. Estimated remaining: 2h 51m 25s. Rate: 7.1 symbols/min [2025-10-16T19:42:36.246205] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:42:36.284243] [DEBUG] [LOCAL ] JKS: Loaded 39674 existing records from primary storage. [2025-10-16T19:42:36.284551] [INFO ] [MAIN ] JKS: Loaded 39674 existing records. [2025-10-16T19:42:36.456902] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:42:36.457120] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-16T19:42:36.457166] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-16T19:42:36.457813] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-16T19:42:36.457871] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-16T19:42:36.747912] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-16T19:42:36.820716] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:42:36.829538] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T19:42:37.542858] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-16T19:42:37.595973] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-16T19:42:38.342878] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-16T19:42:39.142796] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-16T19:42:39.177814] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T19:42:39.207883] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T19:42:39.942849] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-16T19:42:40.262025] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T19:42:40.742875] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-16T19:42:41.492537] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T19:42:41.542774] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-16T19:42:42.342906] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-16T19:42:42.428175] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T19:42:42.972602] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T19:42:43.038385] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-16T19:42:43.142795] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-16T19:42:43.942812] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-16T19:42:44.742783] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-16T19:42:44.776345] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T19:42:45.200857] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-16T19:42:45.206881] [INFO ] [REMOTE ] JHG: Full fetch complete (68517 records). [2025-10-16T19:42:45.206999] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-16T19:42:45.552389] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-16T19:42:45.591347] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-16T19:42:45.591439] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-16T19:42:45.592461] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-16T19:42:45.592525] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-16T19:42:45.593943] [DEBUG] [LOCAL ] JHG: Trimmed 68517 records to 47922 (keeping 200 days of data) [2025-10-16T19:42:45.837523] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T19:42:45.914451] [DEBUG] [LOCAL ] JHG: Primary data saved (47922 records). [2025-10-16T19:42:45.914607] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-16T19:42:45.914737] [INFO ] [MAIN ] Update Progress: 1154/2369 symbols completed. JHG took 43.8s. Estimated remaining: 2h 51m 18s. Rate: 7.1 symbols/min [2025-10-16T19:42:46.117481] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:42:46.146579] [DEBUG] [LOCAL ] JLL: Loaded 31768 existing records from primary storage. [2025-10-16T19:42:46.146871] [INFO ] [MAIN ] JLL: Loaded 31768 existing records. [2025-10-16T19:42:46.318985] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:42:46.319200] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-16T19:42:46.319249] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-16T19:42:46.319836] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-16T19:42:46.319893] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-16T19:42:46.350329] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-16T19:42:46.669024] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:42:47.142842] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-16T19:42:47.202355] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T19:42:47.942771] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-16T19:42:48.004784] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T19:42:48.339453] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T19:42:48.742875] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-16T19:42:49.542845] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-16T19:42:49.623845] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T19:42:50.088394] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T19:42:50.342805] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-16T19:42:50.401102] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T19:42:51.029547] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T19:42:51.142821] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-16T19:42:51.942881] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-16T19:42:52.573235] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T19:42:52.742827] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-16T19:42:53.050980] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T19:42:53.542872] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-16T19:42:54.142838] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T19:42:54.342792] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-16T19:42:54.951035] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T19:42:54.974090] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T19:42:55.142799] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-16T19:42:55.942805] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-16T19:42:56.638948] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-16T19:42:56.742785] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-16T19:42:56.821025] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T19:42:57.542844] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-16T19:42:57.713189] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T19:42:58.342849] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-16T19:42:59.028495] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T19:42:59.142787] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-16T19:42:59.465343] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T19:42:59.942856] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-16T19:43:00.684806] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T19:43:00.742779] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-16T19:43:01.271543] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T19:43:01.542907] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-16T19:43:02.289491] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T19:43:02.342826] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-16T19:43:03.065052] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T19:43:03.142805] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-16T19:43:03.264826] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T19:43:03.267080] [INFO ] [REMOTE ] JILL: Full fetch complete (22549 records). [2025-10-16T19:43:03.267170] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-16T19:43:03.624569] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-16T19:43:03.624683] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-16T19:43:03.625164] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-16T19:43:03.625205] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-16T19:43:03.625824] [DEBUG] [LOCAL ] JILL: Trimmed 22549 records to 15989 (keeping 200 days of data) [2025-10-16T19:43:03.721318] [DEBUG] [LOCAL ] JILL: Primary data saved (15989 records). [2025-10-16T19:43:03.721474] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-16T19:43:03.721559] [INFO ] [MAIN ] Update Progress: 1155/2369 symbols completed. JILL took 33.8s. Estimated remaining: 2h 51m 20s. Rate: 7.1 symbols/min [2025-10-16T19:43:03.889519] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:43:03.895410] [DEBUG] [LOCAL ] JLS: Loaded 4209 existing records from primary storage. [2025-10-16T19:43:03.895611] [INFO ] [MAIN ] JLS: Loaded 4209 existing records. [2025-10-16T19:43:03.948264] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-16T19:43:04.098054] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:43:04.098275] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-16T19:43:04.098321] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-16T19:43:04.098579] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-16T19:43:04.098636] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-16T19:43:04.455991] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:43:04.742865] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-16T19:43:05.008208] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-16T19:43:05.015263] [INFO ] [REMOTE ] JHX: Full fetch complete (61431 records). [2025-10-16T19:43:05.015481] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-16T19:43:05.297315] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T19:43:05.434142] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-16T19:43:05.434231] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-16T19:43:05.435174] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-16T19:43:05.435256] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-16T19:43:05.436551] [DEBUG] [LOCAL ] JHX: Trimmed 61431 records to 53550 (keeping 200 days of data) [2025-10-16T19:43:05.544931] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-16T19:43:05.745189] [DEBUG] [LOCAL ] JHX: Primary data saved (53550 records). [2025-10-16T19:43:05.745336] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-16T19:43:05.745868] [INFO ] [MAIN ] Update Progress: 1156/2369 symbols completed. JHX took 37.1s. Estimated remaining: 2h 51m 4s. Rate: 7.1 symbols/min [2025-10-16T19:43:05.911782] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:43:05.959760] [DEBUG] [LOCAL ] JMIA: Loaded 51055 existing records from primary storage. [2025-10-16T19:43:05.960088] [INFO ] [MAIN ] JMIA: Loaded 51055 existing records. [2025-10-16T19:43:06.131836] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:43:06.132373] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-16T19:43:06.132475] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-16T19:43:06.133351] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-16T19:43:06.133411] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-16T19:43:06.348046] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-16T19:43:06.520181] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T19:43:06.551473] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:43:06.694111] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T19:43:06.706110] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-16T19:43:07.142823] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-16T19:43:07.942820] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-16T19:43:08.579197] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T19:43:08.742809] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-16T19:43:09.480520] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T19:43:09.542782] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-16T19:43:10.034535] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T19:43:10.342812] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-16T19:43:11.142800] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-16T19:43:11.365857] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T19:43:11.942786] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-16T19:43:12.294890] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-16T19:43:12.301197] [INFO ] [REMOTE ] JKS: Full fetch complete (58855 records). [2025-10-16T19:43:12.301320] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-16T19:43:12.634852] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T19:43:12.699166] [INFO ] [REMOTE ] JLL: Full fetch complete (45034 records). [2025-10-16T19:43:12.719293] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-16T19:43:12.719621] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-16T19:43:12.719782] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-16T19:43:12.752566] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-16T19:43:12.720874] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-16T19:43:12.765005] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-16T19:43:12.847954] [DEBUG] [LOCAL ] JKS: Trimmed 58855 records to 39945 (keeping 200 days of data) [2025-10-16T19:43:13.290697] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-16T19:43:13.316508] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-16T19:43:13.317512] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-16T19:43:13.317590] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-16T19:43:13.323570] [DEBUG] [LOCAL ] JLL: Trimmed 45034 records to 31952 (keeping 200 days of data) [2025-10-16T19:43:13.425815] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T19:43:13.475432] [DEBUG] [LOCAL ] JKS: Primary data saved (39945 records). [2025-10-16T19:43:13.480026] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-16T19:43:13.480251] [INFO ] [MAIN ] Update Progress: 1157/2369 symbols completed. JKS took 37.4s. Estimated remaining: 2h 50m 55s. Rate: 7.1 symbols/min [2025-10-16T19:43:13.546130] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-16T19:43:13.553095] [DEBUG] [LOCAL ] JLL: Primary data saved (31952 records). [2025-10-16T19:43:13.553188] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-16T19:43:13.553293] [INFO ] [MAIN ] Update Progress: 1158/2369 symbols completed. JLL took 27.6s. Estimated remaining: 2h 50m 38s. Rate: 7.1 symbols/min [2025-10-16T19:43:13.577890] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T19:43:13.953358] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-16T19:43:14.342818] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-16T19:43:14.884340] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-16T19:43:15.142794] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-16T19:43:15.691079] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-16T19:43:15.942868] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-16T19:43:16.515384] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T19:43:16.742812] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-16T19:43:17.309183] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-16T19:43:17.542886] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-16T19:43:18.342841] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-16T19:43:18.916932] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T19:43:19.142819] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-16T19:43:19.194510] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:43:19.697639] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-16T19:43:19.942806] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-16T19:43:20.347433] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-16T19:43:20.742828] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-16T19:43:21.542802] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-16T19:43:22.432879] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T19:43:22.434183] [INFO ] [REMOTE ] JLS: Full fetch complete (5850 records). [2025-10-16T19:43:22.434398] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-16T19:43:22.647892] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-16T19:43:22.758456] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-16T19:43:22.849947] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-16T19:43:22.850024] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-16T19:43:22.850184] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-16T19:43:22.850222] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-16T19:43:22.850584] [DEBUG] [LOCAL ] JLS: Trimmed 5850 records to 4239 (keeping 200 days of data) [2025-10-16T19:43:22.875874] [DEBUG] [LOCAL ] JLS: Primary data saved (4239 records). [2025-10-16T19:43:22.876032] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-16T19:43:22.876131] [INFO ] [MAIN ] Update Progress: 1159/2369 symbols completed. JLS took 19.2s. Estimated remaining: 2h 50m 30s. Rate: 7.1 symbols/min [2025-10-16T19:43:24.735394] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-16T19:43:24.745960] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-16T19:43:26.181107] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T19:43:26.191251] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-16T19:43:28.117795] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T19:43:28.128768] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-16T19:43:30.095540] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T19:43:30.106598] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-16T19:43:31.917638] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T19:43:31.928856] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-16T19:43:33.773563] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T19:43:33.780364] [INFO ] [REMOTE ] JMIA: Full fetch complete (73449 records). [2025-10-16T19:43:33.780500] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-16T19:43:34.163937] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-16T19:43:34.164023] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-16T19:43:34.165144] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-16T19:43:34.165208] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-16T19:43:34.166686] [DEBUG] [LOCAL ] JMIA: Trimmed 73449 records to 51442 (keeping 200 days of data) [2025-10-16T19:43:34.465474] [DEBUG] [LOCAL ] JMIA: Primary data saved (51442 records). [2025-10-16T19:43:34.465658] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-16T19:43:34.466238] [INFO ] [MAIN ] Update Progress: 1160/2369 symbols completed. JMIA took 28.7s. Estimated remaining: 2h 50m 25s. Rate: 7.1 symbols/min [2025-10-16T19:43:35.026320] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:43:35.133799] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:43:35.132989] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:43:35.155606] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-16T19:43:35.158191] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-16T19:43:35.159971] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-16T19:43:35.160045] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-16T19:43:35.160092] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-16T19:43:35.160126] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-16T19:43:35.159493] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:43:35.389562] [DEBUG] [LOCAL ] JOE: Loaded 23893 existing records from primary storage. [2025-10-16T19:43:35.409496] [INFO ] [MAIN ] JOE: Loaded 23893 existing records. [2025-10-16T19:43:35.565280] [DEBUG] [LOCAL ] JOBY: Loaded 53808 existing records from primary storage. [2025-10-16T19:43:35.637857] [INFO ] [MAIN ] JOBY: Loaded 53808 existing records. [2025-10-16T19:43:35.653126] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-16T19:43:35.714465] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-16T19:43:35.877063] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:43:35.920527] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-16T19:43:35.920422] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:43:35.926015] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-16T19:43:35.959205] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-16T19:43:35.964470] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-16T19:43:36.018422] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-16T19:43:36.128080] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:43:36.147143] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-16T19:43:36.177378] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-16T19:43:36.212432] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-16T19:43:36.252253] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-16T19:43:36.381596] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:43:36.387556] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-16T19:43:36.401415] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-16T19:43:36.466175] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-16T19:43:36.466467] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-16T19:43:36.519720] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-16T19:43:36.545542] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-16T19:43:37.078724] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-16T19:43:37.150694] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-16T19:43:37.271032] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:43:37.343470] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-16T19:43:37.369131] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:43:37.374537] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-16T19:43:37.433129] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:43:37.433389] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-16T19:43:37.669295] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-16T19:43:37.670345] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-16T19:43:38.003288] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-16T19:43:38.004559] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-16T19:43:38.365195] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-16T19:43:38.366401] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-16T19:43:38.657232] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T19:43:38.663202] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-16T19:43:38.831725] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-16T19:43:38.833062] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-16T19:43:39.164688] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-16T19:43:39.166627] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-16T19:43:39.571404] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T19:43:39.577812] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-16T19:43:39.626957] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T19:43:39.628223] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-16T19:43:39.658923] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-16T19:43:39.670178] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-16T19:43:40.000625] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-16T19:43:40.012746] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-16T19:43:40.083072] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T19:43:40.084933] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-16T19:43:40.603982] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-16T19:43:40.618806] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T19:43:40.742812] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-16T19:43:41.542839] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-16T19:43:41.726602] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-16T19:43:41.753364] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T19:43:41.902233] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-16T19:43:41.902970] [INFO ] [REMOTE ] JMM: Full fetch complete (2297 records). [2025-10-16T19:43:41.903039] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-16T19:43:42.083694] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-16T19:43:42.083949] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:43:42.084186] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:43:42.084265] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-16T19:43:42.084461] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-16T19:43:42.084587] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-16T19:43:42.084751] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-16T19:43:42.084876] [INFO ] [MAIN ] Update Progress: 1161/2369 symbols completed. JMM took 7.6s. Estimated remaining: 2h 50m 16s. Rate: 7.1 symbols/min [2025-10-16T19:43:42.258348] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:43:42.290980] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-16T19:43:42.305170] [DEBUG] [LOCAL ] JOF: Loaded 6891 existing records from primary storage. [2025-10-16T19:43:42.305360] [INFO ] [MAIN ] JOF: Loaded 6891 existing records. [2025-10-16T19:43:42.347881] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-16T19:43:42.480589] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:43:42.480816] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-16T19:43:42.480864] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-16T19:43:42.481007] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-16T19:43:42.481043] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-16T19:43:42.833003] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:43:43.142812] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-16T19:43:43.772896] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T19:43:43.942784] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-16T19:43:44.742796] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-16T19:43:44.885419] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T19:43:45.217400] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-16T19:43:45.542822] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-16T19:43:46.342822] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-16T19:43:46.902989] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-16T19:43:47.142784] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-16T19:43:47.422583] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T19:43:47.667505] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-16T19:43:47.942845] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-16T19:43:48.742858] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-16T19:43:49.351562] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-16T19:43:49.506110] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-16T19:43:49.542853] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-16T19:43:50.174468] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-16T19:43:50.342865] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-16T19:43:51.142866] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-16T19:43:51.890586] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-16T19:43:51.919975] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-16T19:43:51.942773] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-16T19:43:52.749219] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-16T19:43:52.755280] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T19:43:53.132681] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-16T19:43:53.152745] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-16T19:43:53.542826] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-16T19:43:54.342871] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-16T19:43:54.621128] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T19:43:55.142946] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-16T19:43:55.942793] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-16T19:43:56.278282] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-16T19:43:56.742840] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-16T19:43:57.051495] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T19:43:57.054627] [INFO ] [REMOTE ] JOE: Full fetch complete (35675 records). [2025-10-16T19:43:57.054728] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-16T19:43:57.385854] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T19:43:57.474555] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-16T19:43:57.474795] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-16T19:43:57.475818] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-16T19:43:57.475920] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-16T19:43:57.477322] [DEBUG] [LOCAL ] JOE: Trimmed 35675 records to 24021 (keeping 200 days of data) [2025-10-16T19:43:57.545294] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-16T19:43:57.600056] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-16T19:43:57.668487] [DEBUG] [LOCAL ] JOE: Primary data saved (24021 records). [2025-10-16T19:43:57.668677] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-16T19:43:57.668784] [INFO ] [MAIN ] Update Progress: 1162/2369 symbols completed. JOE took 23.2s. Estimated remaining: 2h 50m 15s. Rate: 7.1 symbols/min [2025-10-16T19:43:57.841513] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:43:57.876851] [DEBUG] [LOCAL ] JPC: Loaded 37227 existing records from primary storage. [2025-10-16T19:43:57.877158] [INFO ] [MAIN ] JPC: Loaded 37227 existing records. [2025-10-16T19:43:58.051063] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:43:58.051269] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-16T19:43:58.051316] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-16T19:43:58.052043] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-16T19:43:58.052112] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-16T19:43:58.347910] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-16T19:43:58.399577] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:43:58.871327] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-16T19:43:59.142813] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-16T19:43:59.666489] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-16T19:43:59.929120] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-16T19:43:59.942781] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-16T19:44:00.742825] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-16T19:44:01.542850] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-16T19:44:02.187730] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T19:44:02.342801] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-16T19:44:02.522189] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-16T19:44:03.142811] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-16T19:44:03.450816] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T19:44:03.918782] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T19:44:03.942823] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-16T19:44:04.449754] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-16T19:44:04.742895] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-16T19:44:05.532480] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-16T19:44:05.543487] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-16T19:44:06.148185] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T19:44:06.342860] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-16T19:44:06.745948] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-16T19:44:07.142859] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-16T19:44:07.547029] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-16T19:44:07.805416] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-16T19:44:07.942831] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-16T19:44:08.742827] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-16T19:44:09.542794] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-16T19:44:10.213879] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T19:44:10.342841] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-16T19:44:10.748732] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-10-16T19:44:11.129786] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T19:44:11.142804] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-16T19:44:11.622199] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-16T19:44:11.629209] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-16T19:44:11.629358] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-16T19:44:11.739508] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T19:44:11.948018] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-16T19:44:12.073898] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-16T19:44:12.073971] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-16T19:44:12.075032] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-16T19:44:12.075095] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-16T19:44:12.076430] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 54143 (keeping 200 days of data) [2025-10-16T19:44:12.410587] [DEBUG] [LOCAL ] JNJ: Primary data saved (54143 records). [2025-10-16T19:44:12.410762] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-16T19:44:12.410864] [INFO ] [MAIN ] Update Progress: 1163/2369 symbols completed. JNJ took 37.9s. Estimated remaining: 2h 50m 13s. Rate: 7.1 symbols/min [2025-10-16T19:44:12.576151] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:44:12.623729] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-16T19:44:12.624038] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-16T19:44:12.748049] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-16T19:44:12.823709] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:44:12.823932] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-16T19:44:12.823985] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-16T19:44:12.825051] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-16T19:44:12.825107] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-16T19:44:13.169481] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:44:13.536054] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T19:44:13.537480] [INFO ] [REMOTE ] JOF: Full fetch complete (9464 records). [2025-10-16T19:44:13.537548] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-16T19:44:13.548887] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-16T19:44:13.892295] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-16T19:44:13.892376] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-16T19:44:13.892632] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-16T19:44:13.892707] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-16T19:44:13.893183] [DEBUG] [LOCAL ] JOF: Trimmed 9464 records to 6944 (keeping 200 days of data) [2025-10-16T19:44:13.936143] [DEBUG] [LOCAL ] JOF: Primary data saved (6944 records). [2025-10-16T19:44:13.936288] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-16T19:44:13.936369] [INFO ] [MAIN ] Update Progress: 1164/2369 symbols completed. JOF took 31.9s. Estimated remaining: 2h 49m 57s. Rate: 7.1 symbols/min [2025-10-16T19:44:14.103604] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:44:14.135303] [DEBUG] [LOCAL ] JQC: Loaded 33645 existing records from primary storage. [2025-10-16T19:44:14.135632] [INFO ] [MAIN ] JQC: Loaded 33645 existing records. [2025-10-16T19:44:14.314096] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:44:14.314590] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-16T19:44:14.314638] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-16T19:44:14.315749] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-16T19:44:14.315809] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-16T19:44:14.348087] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-16T19:44:14.679281] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:44:14.777236] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-16T19:44:15.142818] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-16T19:44:15.942806] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-16T19:44:15.990864] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-16T19:44:16.063284] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T19:44:16.742831] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-16T19:44:16.963350] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T19:44:17.542812] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-16T19:44:18.078399] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.94 seconds). [2025-10-16T19:44:18.085711] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-16T19:44:18.085871] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-16T19:44:18.355402] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-16T19:44:18.486446] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-16T19:44:18.486561] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-16T19:44:18.487607] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-16T19:44:18.487698] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-16T19:44:18.489148] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 54198 (keeping 200 days of data) [2025-10-16T19:44:18.802323] [DEBUG] [LOCAL ] JOBY: Primary data saved (54198 records). [2025-10-16T19:44:18.802448] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-16T19:44:18.802525] [INFO ] [MAIN ] Update Progress: 1165/2369 symbols completed. JOBY took 44.3s. Estimated remaining: 2h 49m 45s. Rate: 7.1 symbols/min [2025-10-16T19:44:18.996707] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:44:18.998552] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T19:44:19.021182] [DEBUG] [LOCAL ] JRI: Loaded 15410 existing records from primary storage. [2025-10-16T19:44:19.021414] [INFO ] [MAIN ] JRI: Loaded 15410 existing records. [2025-10-16T19:44:19.145411] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-16T19:44:19.231429] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:44:19.231742] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-16T19:44:19.231806] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-16T19:44:19.232263] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-16T19:44:19.232321] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-16T19:44:19.544027] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.80 seconds). [2025-10-16T19:44:19.633217] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:44:19.872115] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T19:44:19.942818] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-16T19:44:20.109088] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T19:44:20.586996] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-16T19:44:20.742807] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-16T19:44:21.542801] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-16T19:44:21.596104] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T19:44:22.342815] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-16T19:44:23.142823] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-16T19:44:23.638555] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T19:44:23.747283] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-16T19:44:23.942804] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-16T19:44:23.974435] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-16T19:44:24.742802] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-16T19:44:24.930994] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T19:44:25.542817] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-16T19:44:25.822797] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T19:44:26.260821] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T19:44:26.342860] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-16T19:44:27.142795] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-16T19:44:27.345528] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T19:44:27.942827] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-16T19:44:28.742862] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-16T19:44:29.406572] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T19:44:29.547907] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-16T19:44:29.565185] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-16T19:44:29.840486] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-16T19:44:30.342864] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-16T19:44:30.490420] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T19:44:31.142826] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-16T19:44:31.700788] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T19:44:31.942842] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-16T19:44:32.742848] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-16T19:44:32.965690] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T19:44:33.145880] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T19:44:33.542824] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-16T19:44:34.288631] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-16T19:44:34.293756] [INFO ] [REMOTE ] JPC: Full fetch complete (55289 records). [2025-10-16T19:44:34.293892] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-16T19:44:34.350555] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-16T19:44:34.694389] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-16T19:44:34.694484] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-16T19:44:34.695346] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-16T19:44:34.695408] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-16T19:44:34.696432] [DEBUG] [LOCAL ] JPC: Trimmed 55289 records to 37494 (keeping 200 days of data) [2025-10-16T19:44:34.913164] [DEBUG] [LOCAL ] JPC: Primary data saved (37494 records). [2025-10-16T19:44:34.913287] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-16T19:44:34.913915] [INFO ] [MAIN ] Update Progress: 1166/2369 symbols completed. JPC took 37.2s. Estimated remaining: 2h 49m 44s. Rate: 7.1 symbols/min [2025-10-16T19:44:35.084838] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T19:44:35.118138] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:44:35.130547] [DEBUG] [LOCAL ] JRS: Loaded 11669 existing records from primary storage. [2025-10-16T19:44:35.130792] [INFO ] [MAIN ] JRS: Loaded 11669 existing records. [2025-10-16T19:44:35.150934] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-16T19:44:35.335624] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:44:35.335953] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-16T19:44:35.336010] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-16T19:44:35.336282] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-16T19:44:35.336339] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-16T19:44:35.687114] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:44:35.942781] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-16T19:44:36.147051] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T19:44:36.734891] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-16T19:44:36.746602] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-16T19:44:36.945020] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T19:44:37.542880] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-16T19:44:37.598121] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T19:44:38.342898] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-16T19:44:39.014177] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T19:44:39.142829] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-16T19:44:39.284506] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T19:44:39.945971] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-16T19:44:39.946844] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T19:44:40.742872] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-16T19:44:41.220219] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T19:44:41.503328] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T19:44:41.542786] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-16T19:44:42.342841] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-16T19:44:42.509553] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T19:44:42.904842] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T19:44:43.142807] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-16T19:44:43.886941] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T19:44:43.942770] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-16T19:44:44.714276] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T19:44:44.742820] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-16T19:44:45.427350] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-16T19:44:45.542812] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-16T19:44:46.342898] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-16T19:44:46.915577] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-16T19:44:47.058276] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T19:44:47.063365] [INFO ] [REMOTE ] JQC: Full fetch complete (49729 records). [2025-10-16T19:44:47.063500] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-16T19:44:47.148052] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-16T19:44:47.448856] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-16T19:44:47.448932] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-16T19:44:47.449840] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-16T19:44:47.449903] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-16T19:44:47.450906] [DEBUG] [LOCAL ] JQC: Trimmed 49729 records to 33945 (keeping 200 days of data) [2025-10-16T19:44:47.644149] [DEBUG] [LOCAL ] JQC: Primary data saved (33945 records). [2025-10-16T19:44:47.644281] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-16T19:44:47.644361] [INFO ] [MAIN ] Update Progress: 1167/2369 symbols completed. JQC took 33.7s. Estimated remaining: 2h 49m 40s. Rate: 7.1 symbols/min [2025-10-16T19:44:47.816801] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:44:47.858125] [DEBUG] [LOCAL ] JXN: Loaded 44730 existing records from primary storage. [2025-10-16T19:44:47.858424] [INFO ] [MAIN ] JXN: Loaded 44730 existing records. [2025-10-16T19:44:47.947929] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-16T19:44:48.039863] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:44:48.040251] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-16T19:44:48.045618] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-16T19:44:48.052549] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-16T19:44:48.052629] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-16T19:44:48.053580] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-16T19:44:48.405956] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:44:48.742800] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-16T19:44:49.542836] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-16T19:44:49.626376] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T19:44:50.258198] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-16T19:44:50.259199] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-16T19:44:50.342781] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-16T19:44:50.800639] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-16T19:44:51.142826] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-16T19:44:51.942801] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-16T19:44:52.044310] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T19:44:52.047041] [INFO ] [REMOTE ] JRI: Full fetch complete (23214 records). [2025-10-16T19:44:52.047135] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-16T19:44:52.432726] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-16T19:44:52.432809] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-16T19:44:52.433282] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-16T19:44:52.433320] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-16T19:44:52.433931] [DEBUG] [LOCAL ] JRI: Trimmed 23214 records to 15503 (keeping 200 days of data) [2025-10-16T19:44:52.526547] [DEBUG] [LOCAL ] JRI: Primary data saved (15503 records). [2025-10-16T19:44:52.526714] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-16T19:44:52.526809] [INFO ] [MAIN ] Update Progress: 1168/2369 symbols completed. JRI took 33.7s. Estimated remaining: 2h 49m 28s. Rate: 7.1 symbols/min [2025-10-16T19:44:52.706571] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T19:44:52.709848] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:44:52.712682] [INFO ] [REMOTE ] JRS: Full fetch complete (16339 records). [2025-10-16T19:44:52.712839] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-16T19:44:52.744390] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-16T19:44:53.057266] [DEBUG] [LOCAL ] K: Loaded 50422 existing records from primary storage. [2025-10-16T19:44:53.080574] [INFO ] [MAIN ] K: Loaded 50422 existing records. [2025-10-16T19:44:53.230252] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-16T19:44:53.232636] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-16T19:44:53.233065] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-16T19:44:53.233372] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-16T19:44:53.277244] [DEBUG] [LOCAL ] JRS: Trimmed 16339 records to 11746 (keeping 200 days of data) [2025-10-16T19:44:53.313609] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:44:53.314029] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-16T19:44:53.314091] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-16T19:44:53.340496] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-16T19:44:53.340612] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-16T19:44:53.486560] [DEBUG] [LOCAL ] JRS: Primary data saved (11746 records). [2025-10-16T19:44:53.487006] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-16T19:44:53.492455] [INFO ] [MAIN ] Update Progress: 1169/2369 symbols completed. JRS took 18.6s. Estimated remaining: 2h 49m 12s. Rate: 7.1 symbols/min [2025-10-16T19:44:53.547904] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-16T19:44:53.924618] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:44:53.947564] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:44:53.966306] [DEBUG] [LOCAL ] KAI: Loaded 13579 existing records from primary storage. [2025-10-16T19:44:53.966623] [INFO ] [MAIN ] KAI: Loaded 13579 existing records. [2025-10-16T19:44:54.136081] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T19:44:54.187182] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:44:54.187482] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-16T19:44:54.187541] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-16T19:44:54.187730] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-16T19:44:54.187786] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-16T19:44:54.361604] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-16T19:44:54.543375] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:44:55.142809] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-16T19:44:55.474026] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-16T19:44:55.929345] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-16T19:44:55.942757] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-16T19:44:56.023150] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T19:44:56.742841] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-16T19:44:57.542824] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-16T19:44:57.911563] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T19:44:58.342843] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-16T19:44:58.411450] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T19:44:58.646728] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T19:44:58.797481] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-16T19:44:59.142850] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-16T19:44:59.942826] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-16T19:45:00.742853] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-16T19:45:01.542891] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-16T19:45:01.682893] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.54 seconds). [2025-10-16T19:45:01.690198] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-16T19:45:01.690376] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-16T19:45:02.092381] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:45:02.144189] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-16T19:45:02.208638] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-16T19:45:02.208865] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-16T19:45:02.210511] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-16T19:45:02.210592] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-16T19:45:02.212257] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 54184 (keeping 200 days of data) [2025-10-16T19:45:02.389724] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-16T19:45:02.554988] [DEBUG] [LOCAL ] JPM: Primary data saved (54184 records). [2025-10-16T19:45:02.555162] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-16T19:45:02.555260] [INFO ] [MAIN ] Update Progress: 1170/2369 symbols completed. JPM took 50.1s. Estimated remaining: 2h 49m 4s. Rate: 7.1 symbols/min [2025-10-16T19:45:02.754798] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:45:02.813218] [DEBUG] [LOCAL ] KAR: Loaded 40054 existing records from primary storage. [2025-10-16T19:45:02.813690] [INFO ] [MAIN ] KAR: Loaded 40054 existing records. [2025-10-16T19:45:03.110856] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:45:03.111169] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-16T19:45:03.111228] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-16T19:45:03.111621] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-16T19:45:03.111742] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-16T19:45:03.156884] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-16T19:45:03.531692] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-16T19:45:03.739040] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:45:03.942786] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-16T19:45:03.995849] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T19:45:04.037548] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T19:45:04.742813] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-16T19:45:05.456312] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T19:45:05.542816] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-16T19:45:06.163933] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T19:45:06.342849] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-16T19:45:07.121102] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T19:45:07.142774] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-16T19:45:07.715119] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T19:45:07.942803] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-16T19:45:08.601138] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T19:45:08.734695] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T19:45:08.742767] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-16T19:45:09.472396] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T19:45:09.542833] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-16T19:45:10.342866] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-16T19:45:10.666360] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T19:45:11.006219] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-16T19:45:11.142810] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-16T19:45:11.942798] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-16T19:45:12.742784] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-16T19:45:12.848816] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T19:45:13.405019] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T19:45:13.542797] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-16T19:45:13.922492] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-16T19:45:14.342824] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-16T19:45:14.621286] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-16T19:45:15.142815] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-16T19:45:15.942780] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-16T19:45:16.199299] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T19:45:16.425703] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T19:45:16.742862] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-16T19:45:17.106989] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T19:45:17.542816] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-16T19:45:18.108077] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T19:45:18.128192] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-16T19:45:18.342811] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-16T19:45:19.142815] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-16T19:45:19.428982] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T19:45:19.593913] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T19:45:19.942814] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-16T19:45:20.742821] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-16T19:45:21.542821] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-16T19:45:21.589601] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T19:45:22.352288] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-16T19:45:22.358679] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T19:45:22.515814] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T19:45:23.142884] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-16T19:45:23.876138] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T19:45:23.878831] [INFO ] [REMOTE ] KAI: Full fetch complete (19174 records). [2025-10-16T19:45:23.878915] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-16T19:45:23.944834] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-16T19:45:24.177984] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T19:45:24.299899] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-16T19:45:24.299982] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-16T19:45:24.300393] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-16T19:45:24.300433] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-16T19:45:24.301131] [DEBUG] [LOCAL ] KAI: Trimmed 19174 records to 13688 (keeping 200 days of data) [2025-10-16T19:45:24.387316] [DEBUG] [LOCAL ] KAI: Primary data saved (13688 records). [2025-10-16T19:45:24.387446] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-16T19:45:24.387524] [INFO ] [MAIN ] Update Progress: 1171/2369 symbols completed. KAI took 30.9s. Estimated remaining: 2h 49m 9s. Rate: 7.1 symbols/min [2025-10-16T19:45:24.560235] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:45:24.582402] [DEBUG] [LOCAL ] KB: Loaded 23340 existing records from primary storage. [2025-10-16T19:45:24.582689] [INFO ] [MAIN ] KB: Loaded 23340 existing records. [2025-10-16T19:45:24.748781] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-16T19:45:24.780011] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:45:24.780266] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-16T19:45:24.780320] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-16T19:45:24.780498] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-16T19:45:24.780557] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-16T19:45:25.136108] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:45:25.535680] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T19:45:25.545400] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-16T19:45:25.908413] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T19:45:26.342879] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-16T19:45:26.673368] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T19:45:27.142886] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-16T19:45:27.875247] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T19:45:27.880506] [INFO ] [REMOTE ] JXN: Full fetch complete (65598 records). [2025-10-16T19:45:27.880619] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-16T19:45:27.948068] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-16T19:45:28.275275] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-16T19:45:28.275400] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-16T19:45:28.276367] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-16T19:45:28.276455] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-16T19:45:28.277849] [DEBUG] [LOCAL ] JXN: Trimmed 65598 records to 45020 (keeping 200 days of data) [2025-10-16T19:45:28.553291] [DEBUG] [LOCAL ] JXN: Primary data saved (45020 records). [2025-10-16T19:45:28.553411] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-16T19:45:28.554023] [INFO ] [MAIN ] Update Progress: 1172/2369 symbols completed. JXN took 40.9s. Estimated remaining: 2h 48m 57s. Rate: 7.1 symbols/min [2025-10-16T19:45:28.721307] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T19:45:28.738198] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:45:28.742910] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-16T19:45:28.744727] [INFO ] [REMOTE ] KAR: Full fetch complete (57018 records). [2025-10-16T19:45:28.744902] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-16T19:45:28.958023] [DEBUG] [LOCAL ] KBDC: Loaded 22209 existing records from primary storage. [2025-10-16T19:45:28.985848] [INFO ] [MAIN ] KBDC: Loaded 22209 existing records. [2025-10-16T19:45:29.297263] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-16T19:45:29.297040] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T19:45:29.297378] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-16T19:45:29.326812] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-16T19:45:29.339613] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-16T19:45:29.367292] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:45:29.367672] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-16T19:45:29.367828] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-16T19:45:29.368147] [DEBUG] [LOCAL ] KAR: Trimmed 57018 records to 40339 (keeping 200 days of data) [2025-10-16T19:45:29.368433] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-16T19:45:29.368526] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-16T19:45:29.549373] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-16T19:45:29.946671] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:45:29.971216] [DEBUG] [LOCAL ] KAR: Primary data saved (40339 records). [2025-10-16T19:45:29.971332] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-16T19:45:29.971407] [INFO ] [MAIN ] Update Progress: 1173/2369 symbols completed. KAR took 27.4s. Estimated remaining: 2h 48m 41s. Rate: 7.1 symbols/min [2025-10-16T19:45:30.142885] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:45:30.186816] [DEBUG] [LOCAL ] KBH: Loaded 48840 existing records from primary storage. [2025-10-16T19:45:30.187113] [INFO ] [MAIN ] KBH: Loaded 48840 existing records. [2025-10-16T19:45:30.347796] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-16T19:45:30.367140] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:45:30.368244] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-16T19:45:30.368332] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-16T19:45:30.369104] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-16T19:45:30.369180] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-16T19:45:30.748564] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:45:30.795391] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T19:45:30.803722] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T19:45:31.035794] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-16T19:45:31.142792] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-16T19:45:31.942799] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-16T19:45:31.980357] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T19:45:32.742818] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-16T19:45:33.551906] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-16T19:45:33.571053] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T19:45:34.342810] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-16T19:45:34.396601] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T19:45:34.428200] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-16T19:45:35.142843] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-16T19:45:35.942807] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-16T19:45:36.157451] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T19:45:36.742813] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-16T19:45:36.884224] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T19:45:36.943399] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T19:45:37.542862] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-16T19:45:38.312052] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T19:45:38.318962] [INFO ] [REMOTE ] K: Full fetch complete (72346 records). [2025-10-16T19:45:38.319128] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-16T19:45:38.354168] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-16T19:45:38.791310] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-16T19:45:38.791446] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-16T19:45:38.792581] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-16T19:45:38.792664] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-16T19:45:38.794093] [DEBUG] [LOCAL ] K: Trimmed 72346 records to 50804 (keeping 200 days of data) [2025-10-16T19:45:39.102909] [DEBUG] [LOCAL ] K: Primary data saved (50804 records). [2025-10-16T19:45:39.103044] [INFO ] [MAIN ] K: Full history saved. [2025-10-16T19:45:39.103811] [INFO ] [MAIN ] Update Progress: 1174/2369 symbols completed. K took 46.6s. Estimated remaining: 2h 48m 33s. Rate: 7.1 symbols/min [2025-10-16T19:45:39.160821] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-16T19:45:39.285597] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:45:39.313327] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T19:45:39.366229] [DEBUG] [LOCAL ] KBR: Loaded 48081 existing records from primary storage. [2025-10-16T19:45:39.366548] [INFO ] [MAIN ] KBR: Loaded 48081 existing records. [2025-10-16T19:45:39.568503] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T19:45:39.567140] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:45:39.574356] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-16T19:45:39.574612] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-16T19:45:39.576322] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-16T19:45:39.576469] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-16T19:45:39.961847] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:45:39.955834] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-16T19:45:39.956365] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T19:45:40.742840] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-16T19:45:41.542798] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-16T19:45:41.711464] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T19:45:42.342846] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-16T19:45:42.383733] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T19:45:42.441098] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-16T19:45:43.142786] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-16T19:45:43.301891] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T19:45:43.942837] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-16T19:45:44.487163] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T19:45:44.669765] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T19:45:44.742806] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-16T19:45:45.470966] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T19:45:45.542790] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-16T19:45:46.342810] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-16T19:45:46.557803] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T19:45:47.142825] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-16T19:45:47.323152] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-16T19:45:47.942820] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-16T19:45:48.728317] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T19:45:48.742787] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-16T19:45:49.542780] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-16T19:45:49.688501] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T19:45:49.889864] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-16T19:45:50.162389] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T19:45:50.342840] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-16T19:45:51.142818] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-16T19:45:51.842163] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T19:45:51.942796] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-16T19:45:52.217745] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T19:45:52.725549] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T19:45:52.742776] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-16T19:45:53.542819] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-16T19:45:54.342919] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-16T19:45:54.414213] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T19:45:54.439510] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T19:45:54.442413] [INFO ] [REMOTE ] KB: Full fetch complete (33722 records). [2025-10-16T19:45:54.442506] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-16T19:45:54.819569] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-16T19:45:54.819677] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-16T19:45:54.820361] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-16T19:45:54.820406] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-16T19:45:54.821295] [DEBUG] [LOCAL ] KB: Trimmed 33722 records to 23518 (keeping 200 days of data) [2025-10-16T19:45:54.960614] [DEBUG] [LOCAL ] KB: Primary data saved (23518 records). [2025-10-16T19:45:54.960772] [INFO ] [MAIN ] KB: Full history saved. [2025-10-16T19:45:54.960858] [INFO ] [MAIN ] Update Progress: 1175/2369 symbols completed. KB took 30.6s. Estimated remaining: 2h 48m 32s. Rate: 7.1 symbols/min [2025-10-16T19:45:55.132536] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:45:55.142859] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-16T19:45:55.185632] [DEBUG] [LOCAL ] KD: Loaded 52354 existing records from primary storage. [2025-10-16T19:45:55.185997] [INFO ] [MAIN ] KD: Loaded 52354 existing records. [2025-10-16T19:45:55.381692] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:45:55.381942] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-16T19:45:55.382004] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-16T19:45:55.382221] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-16T19:45:55.382286] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-16T19:45:55.856069] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T19:45:55.943609] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-16T19:45:55.975457] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:45:56.232570] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T19:45:56.742839] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-16T19:45:57.542845] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-16T19:45:57.722243] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T19:45:58.114634] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T19:45:58.120168] [INFO ] [REMOTE ] KBDC: Full fetch complete (30312 records). [2025-10-16T19:45:58.120308] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-16T19:45:58.350636] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-16T19:45:58.497810] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-16T19:45:58.497900] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-16T19:45:58.498661] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-16T19:45:58.498727] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-16T19:45:58.499757] [DEBUG] [LOCAL ] KBDC: Trimmed 30312 records to 22431 (keeping 200 days of data) [2025-10-16T19:45:58.656360] [DEBUG] [LOCAL ] KBDC: Primary data saved (22431 records). [2025-10-16T19:45:58.656703] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-16T19:45:58.656807] [INFO ] [MAIN ] Update Progress: 1176/2369 symbols completed. KBDC took 30.1s. Estimated remaining: 2h 48m 19s. Rate: 7.1 symbols/min [2025-10-16T19:45:58.861005] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:45:58.895172] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T19:45:58.895429] [DEBUG] [LOCAL ] KEN: Loaded 4705 existing records from primary storage. [2025-10-16T19:45:58.905121] [INFO ] [MAIN ] KEN: Loaded 4705 existing records. [2025-10-16T19:45:59.082838] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:45:59.083054] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-16T19:45:59.083102] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-16T19:45:59.083236] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-16T19:45:59.083274] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-16T19:45:59.148078] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-16T19:45:59.431494] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:45:59.942787] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-16T19:45:59.974452] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T19:46:00.742833] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-16T19:46:00.980746] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T19:46:01.549256] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-16T19:46:01.555916] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T19:46:02.108756] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-16T19:46:02.112221] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T19:46:02.342826] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-16T19:46:03.142833] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-16T19:46:03.942791] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-16T19:46:04.005107] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T19:46:04.383114] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T19:46:04.742811] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-16T19:46:05.542797] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-16T19:46:05.700733] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T19:46:06.303508] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T19:46:06.342770] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-16T19:46:07.142794] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-16T19:46:07.196262] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:46:07.697524] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T19:46:07.942548] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T19:46:07.948424] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-16T19:46:07.950215] [INFO ] [REMOTE ] KBH: Full fetch complete (71131 records). [2025-10-16T19:46:07.950302] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-16T19:46:08.336846] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-16T19:46:08.336944] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-16T19:46:08.340766] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-16T19:46:08.340890] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-16T19:46:08.341033] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-16T19:46:08.343668] [DEBUG] [LOCAL ] KBH: Trimmed 71131 records to 49212 (keeping 200 days of data) [2025-10-16T19:46:08.638056] [DEBUG] [LOCAL ] KBH: Primary data saved (49212 records). [2025-10-16T19:46:08.638192] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-16T19:46:08.638321] [INFO ] [MAIN ] Update Progress: 1177/2369 symbols completed. KBH took 38.7s. Estimated remaining: 2h 48m 12s. Rate: 7.1 symbols/min [2025-10-16T19:46:08.747911] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-16T19:46:08.812061] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:46:08.843225] [DEBUG] [LOCAL ] KEP: Loaded 31996 existing records from primary storage. [2025-10-16T19:46:08.843487] [INFO ] [MAIN ] KEP: Loaded 31996 existing records. [2025-10-16T19:46:09.018262] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:46:09.018489] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-16T19:46:09.018547] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-16T19:46:09.018758] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-16T19:46:09.018832] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-16T19:46:09.370887] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:46:09.542815] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-16T19:46:10.342771] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-16T19:46:10.548731] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T19:46:10.598556] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:46:11.007660] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-16T19:46:11.142807] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-16T19:46:11.942780] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-16T19:46:12.003883] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T19:46:12.696790] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-16T19:46:12.742876] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-16T19:46:13.324425] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T19:46:13.542812] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-16T19:46:14.342810] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-16T19:46:15.008927] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T19:46:15.142824] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-16T19:46:15.423481] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T19:46:15.942822] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-16T19:46:16.747017] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-16T19:46:16.748483] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T19:46:16.781627] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T19:46:17.542880] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-16T19:46:18.115152] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T19:46:18.256308] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-16T19:46:18.342771] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-16T19:46:19.142824] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-16T19:46:19.651203] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T19:46:19.942806] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-16T19:46:20.742789] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-16T19:46:21.062141] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T19:46:21.505886] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T19:46:21.542825] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-16T19:46:21.638165] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T19:46:22.342871] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-16T19:46:22.874431] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T19:46:22.881251] [INFO ] [REMOTE ] KBR: Full fetch complete (69985 records). [2025-10-16T19:46:22.881393] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-16T19:46:23.144732] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-16T19:46:23.182442] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-16T19:46:23.275128] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-16T19:46:23.275204] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-16T19:46:23.276174] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-16T19:46:23.276238] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-16T19:46:23.277520] [DEBUG] [LOCAL ] KBR: Trimmed 69985 records to 48409 (keeping 200 days of data) [2025-10-16T19:46:23.561034] [DEBUG] [LOCAL ] KBR: Primary data saved (48409 records). [2025-10-16T19:46:23.561162] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-16T19:46:23.561979] [INFO ] [MAIN ] Update Progress: 1178/2369 symbols completed. KBR took 44.5s. Estimated remaining: 2h 48m 10s. Rate: 7.1 symbols/min [2025-10-16T19:46:23.725945] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:46:23.764333] [DEBUG] [LOCAL ] KEX: Loaded 38604 existing records from primary storage. [2025-10-16T19:46:23.764611] [INFO ] [MAIN ] KEX: Loaded 38604 existing records. [2025-10-16T19:46:23.939471] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:46:23.939707] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-16T19:46:23.939766] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-16T19:46:23.940064] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-16T19:46:23.940120] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-16T19:46:23.951328] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-16T19:46:24.320831] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:46:24.663174] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T19:46:24.742792] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-16T19:46:25.117275] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T19:46:25.542839] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-16T19:46:26.228753] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T19:46:26.342808] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-16T19:46:27.060417] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T19:46:27.142777] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-16T19:46:27.414616] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T19:46:27.942853] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-16T19:46:28.730554] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T19:46:28.737434] [INFO ] [REMOTE ] KD: Full fetch complete (76051 records). [2025-10-16T19:46:28.737585] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-16T19:46:28.749454] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-16T19:46:29.168014] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-16T19:46:29.168150] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-16T19:46:29.169242] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-16T19:46:29.169304] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-16T19:46:29.170725] [DEBUG] [LOCAL ] KD: Trimmed 76051 records to 52742 (keeping 200 days of data) [2025-10-16T19:46:29.398245] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T19:46:29.397207] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T19:46:29.505630] [DEBUG] [LOCAL ] KD: Primary data saved (52742 records). [2025-10-16T19:46:29.505806] [INFO ] [MAIN ] KD: Full history saved. [2025-10-16T19:46:29.506450] [INFO ] [MAIN ] Update Progress: 1179/2369 symbols completed. KD took 34.5s. Estimated remaining: 2h 47m 59s. Rate: 7.1 symbols/min [2025-10-16T19:46:29.547950] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-16T19:46:29.677121] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:46:29.677290] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-16T19:46:29.677327] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-16T19:46:29.677493] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-16T19:46:29.677534] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-16T19:46:29.677578] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-16T19:46:29.677612] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-16T19:46:30.031563] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:46:30.065258] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-16T19:46:30.066424] [INFO ] [REMOTE ] KEN: Full fetch complete (5972 records). [2025-10-16T19:46:30.066510] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-16T19:46:30.347952] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-16T19:46:30.452668] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-16T19:46:30.452815] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-16T19:46:30.453020] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-16T19:46:30.453907] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-16T19:46:30.454372] [DEBUG] [LOCAL ] KEN: Trimmed 5972 records to 4721 (keeping 200 days of data) [2025-10-16T19:46:30.482455] [DEBUG] [LOCAL ] KEN: Primary data saved (4721 records). [2025-10-16T19:46:30.482590] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-16T19:46:30.482697] [INFO ] [MAIN ] Update Progress: 1180/2369 symbols completed. KEN took 31.8s. Estimated remaining: 2h 47m 43s. Rate: 7.1 symbols/min [2025-10-16T19:46:30.649199] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:46:30.690762] [DEBUG] [LOCAL ] KEYS: Loaded 43274 existing records from primary storage. [2025-10-16T19:46:30.691103] [INFO ] [MAIN ] KEYS: Loaded 43274 existing records. [2025-10-16T19:46:30.866538] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:46:30.866804] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-16T19:46:30.866855] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-16T19:46:30.867171] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-16T19:46:30.867228] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-16T19:46:31.148186] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-16T19:46:31.227335] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:46:31.942793] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-16T19:46:32.126165] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T19:46:32.605827] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T19:46:32.742854] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-16T19:46:33.487587] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T19:46:33.542834] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-16T19:46:34.342846] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-16T19:46:34.461822] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T19:46:34.810447] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-16T19:46:35.142839] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-16T19:46:35.912395] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T19:46:35.942805] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-16T19:46:36.270160] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T19:46:36.742854] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-16T19:46:37.520608] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T19:46:37.542776] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-16T19:46:37.585638] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T19:46:38.342835] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-16T19:46:39.142801] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-16T19:46:39.244933] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T19:46:39.713985] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T19:46:39.942801] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-16T19:46:40.462626] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T19:46:40.466882] [INFO ] [REMOTE ] KEP: Full fetch complete (42077 records). [2025-10-16T19:46:40.466962] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-16T19:46:40.748012] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-16T19:46:40.842064] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-16T19:46:40.842162] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-16T19:46:40.843026] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-16T19:46:40.843088] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-16T19:46:40.844108] [DEBUG] [LOCAL ] KEP: Trimmed 42077 records to 32230 (keeping 200 days of data) [2025-10-16T19:46:41.031560] [DEBUG] [LOCAL ] KEP: Primary data saved (32230 records). [2025-10-16T19:46:41.031728] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-16T19:46:41.031818] [INFO ] [MAIN ] Update Progress: 1181/2369 symbols completed. KEP took 32.4s. Estimated remaining: 2h 47m 37s. Rate: 7.1 symbols/min [2025-10-16T19:46:41.210838] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:46:41.210997] [DEBUG] [LOCAL ] KF: No existing data file found in primary storage. [2025-10-16T19:46:41.211034] [WARN ] [MAIN ] KF: No existing data found, performing full refresh instead. [2025-10-16T19:46:41.211149] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-16T19:46:41.211189] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-16T19:46:41.211230] [DEBUG] [LOCAL ] KF: No primary data file found to delete. [2025-10-16T19:46:41.211262] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-16T19:46:41.549344] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-16T19:46:41.579755] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:46:41.619291] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T19:46:41.779203] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T19:46:42.342888] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-16T19:46:42.921992] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-16T19:46:43.142787] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-16T19:46:43.298999] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-16T19:46:43.616046] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T19:46:43.942781] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-16T19:46:44.452361] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-16T19:46:44.742872] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-16T19:46:45.542859] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-16T19:46:46.342805] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-16T19:46:46.548269] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T19:46:46.647034] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-16T19:46:46.911608] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T19:46:47.142810] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-16T19:46:47.611399] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-16T19:46:47.942808] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-16T19:46:48.385294] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-16T19:46:48.742845] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-16T19:46:49.542869] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-16T19:46:50.105122] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-16T19:46:50.224702] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T19:46:50.342798] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-16T19:46:51.142809] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-16T19:46:51.615049] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T19:46:51.634280] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T19:46:51.942808] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-16T19:46:52.387948] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T19:46:52.742807] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-16T19:46:53.542824] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-16T19:46:54.342805] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-16T19:46:54.672191] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-16T19:46:54.815693] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-16T19:46:55.008188] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T19:46:55.142802] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-16T19:46:55.942860] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-16T19:46:56.563495] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T19:46:56.742870] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-16T19:46:57.362242] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-16T19:46:57.363175] [INFO ] [REMOTE ] KF: Full fetch complete (3555 records). [2025-10-16T19:46:57.363245] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-16T19:46:57.547285] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-16T19:46:57.654028] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T19:46:57.788868] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-16T19:46:57.788957] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-16T19:46:57.789088] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-16T19:46:57.789126] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-16T19:46:57.789515] [DEBUG] [LOCAL ] KF: Trimmed 3555 records to 2377 (keeping 200 days of data) [2025-10-16T19:46:57.803491] [DEBUG] [LOCAL ] KF: Primary data saved (2377 records). [2025-10-16T19:46:57.803606] [INFO ] [MAIN ] KF: Full history saved. [2025-10-16T19:46:57.803701] [INFO ] [MAIN ] Update Progress: 1182/2369 symbols completed. KF took 16.8s. Estimated remaining: 2h 47m 36s. Rate: 7.1 symbols/min [2025-10-16T19:46:57.967200] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:46:57.986767] [DEBUG] [LOCAL ] KFRC: Loaded 20493 existing records from primary storage. [2025-10-16T19:46:57.986997] [INFO ] [MAIN ] KFRC: Loaded 20493 existing records. [2025-10-16T19:46:58.163530] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:46:58.163769] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-16T19:46:58.163820] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-16T19:46:58.164014] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-16T19:46:58.164070] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-16T19:46:58.347959] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-16T19:46:58.540228] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:46:59.142837] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-16T19:46:59.330365] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T19:46:59.942802] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-16T19:46:59.989267] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T19:47:00.376199] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T19:47:00.742797] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-16T19:47:01.019610] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-16T19:47:01.542869] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-16T19:47:02.284636] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T19:47:02.342770] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-16T19:47:02.509381] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T19:47:03.142830] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-16T19:47:03.642174] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T19:47:03.942882] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-16T19:47:03.978304] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T19:47:04.742837] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-16T19:47:05.324413] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T19:47:05.329913] [INFO ] [REMOTE ] KEX: Full fetch complete (56053 records). [2025-10-16T19:47:05.330002] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-16T19:47:05.547993] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-16T19:47:05.719977] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T19:47:05.720111] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-16T19:47:05.723848] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-16T19:47:05.724747] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-16T19:47:05.724809] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-16T19:47:05.725802] [DEBUG] [LOCAL ] KEX: Trimmed 56053 records to 38962 (keeping 200 days of data) [2025-10-16T19:47:05.954170] [DEBUG] [LOCAL ] KEX: Primary data saved (38962 records). [2025-10-16T19:47:05.954315] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-16T19:47:05.954401] [INFO ] [MAIN ] Update Progress: 1183/2369 symbols completed. KEX took 42.4s. Estimated remaining: 2h 47m 28s. Rate: 7.1 symbols/min [2025-10-16T19:47:06.122173] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:47:06.132543] [DEBUG] [LOCAL ] KFS: Loaded 8664 existing records from primary storage. [2025-10-16T19:47:06.132762] [INFO ] [MAIN ] KFS: Loaded 8664 existing records. [2025-10-16T19:47:06.304143] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:47:06.304320] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-16T19:47:06.304366] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-16T19:47:06.304529] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-16T19:47:06.304584] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-16T19:47:06.348126] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-16T19:47:06.659379] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:47:07.142864] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-16T19:47:07.252513] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T19:47:07.715112] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T19:47:07.942799] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-16T19:47:08.063840] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T19:47:08.071147] [INFO ] [REMOTE ] KEYS: Full fetch complete (63011 records). [2025-10-16T19:47:08.071335] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-16T19:47:08.494588] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-16T19:47:08.494711] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-16T19:47:08.495768] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-16T19:47:08.495830] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-16T19:47:08.497155] [DEBUG] [LOCAL ] KEYS: Trimmed 63011 records to 43613 (keeping 200 days of data) [2025-10-16T19:47:08.745368] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-16T19:47:08.757892] [DEBUG] [LOCAL ] KEYS: Primary data saved (43613 records). [2025-10-16T19:47:08.758164] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-16T19:47:08.758821] [INFO ] [MAIN ] Update Progress: 1184/2369 symbols completed. KEYS took 38.3s. Estimated remaining: 2h 47m 14s. Rate: 7.1 symbols/min [2025-10-16T19:47:08.927414] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:47:08.959768] [DEBUG] [LOCAL ] KFY: Loaded 29991 existing records from primary storage. [2025-10-16T19:47:08.960031] [INFO ] [MAIN ] KFY: Loaded 29991 existing records. [2025-10-16T19:47:09.140468] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:47:09.140784] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-16T19:47:09.140842] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-16T19:47:09.141107] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-16T19:47:09.141162] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-16T19:47:09.433977] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T19:47:09.513459] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:47:09.542769] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-16T19:47:09.771912] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T19:47:10.342839] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-16T19:47:10.768755] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T19:47:10.907347] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T19:47:11.142781] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-16T19:47:11.942815] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-16T19:47:12.585152] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-16T19:47:12.742797] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-16T19:47:13.067606] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-16T19:47:13.467130] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T19:47:13.542778] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-16T19:47:14.342807] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-16T19:47:14.624603] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T19:47:15.142811] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-16T19:47:15.913009] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T19:47:15.948999] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-16T19:47:15.968138] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T19:47:16.742780] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-16T19:47:16.815149] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T19:47:17.517834] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-16T19:47:17.542828] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-16T19:47:18.342829] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-16T19:47:19.070125] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-16T19:47:19.142779] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-16T19:47:19.462639] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-16T19:47:19.470097] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-16T19:47:19.470269] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-16T19:47:19.679397] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T19:47:19.680285] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:47:19.680362] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:47:19.680437] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-16T19:47:19.680506] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-16T19:47:19.680543] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-16T19:47:19.680583] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-16T19:47:19.680670] [INFO ] [MAIN ] Update Progress: 1185/2369 symbols completed. KEY took 50.2s. Estimated remaining: 2h 47m 8s. Rate: 7.1 symbols/min [2025-10-16T19:47:19.853198] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:47:19.914002] [DEBUG] [LOCAL ] KGC: Loaded 53700 existing records from primary storage. [2025-10-16T19:47:19.914433] [INFO ] [MAIN ] KGC: Loaded 53700 existing records. [2025-10-16T19:47:19.947992] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-16T19:47:20.101698] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-16T19:47:20.114476] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:47:20.119233] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-16T19:47:20.119290] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-16T19:47:20.119776] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-16T19:47:20.119832] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-16T19:47:20.473958] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:47:20.742805] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-16T19:47:21.166375] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T19:47:21.542843] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-16T19:47:22.271339] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T19:47:22.342875] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-16T19:47:22.522368] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T19:47:23.145426] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-16T19:47:23.146398] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T19:47:23.899395] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-16T19:47:23.942809] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-16T19:47:24.742829] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-16T19:47:24.953878] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T19:47:25.542864] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-16T19:47:26.342818] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-16T19:47:26.434753] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T19:47:26.600349] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T19:47:26.903967] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-16T19:47:26.905864] [INFO ] [REMOTE ] KFS: Full fetch complete (11031 records). [2025-10-16T19:47:26.905953] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-16T19:47:27.147881] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-16T19:47:27.275059] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-16T19:47:27.275159] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-16T19:47:27.275500] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-16T19:47:27.275562] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-16T19:47:27.276083] [DEBUG] [LOCAL ] KFS: Trimmed 11031 records to 8736 (keeping 200 days of data) [2025-10-16T19:47:27.329555] [DEBUG] [LOCAL ] KFS: Primary data saved (8736 records). [2025-10-16T19:47:27.329761] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-16T19:47:27.329860] [INFO ] [MAIN ] Update Progress: 1186/2369 symbols completed. KFS took 21.4s. Estimated remaining: 2h 46m 58s. Rate: 7.1 symbols/min [2025-10-16T19:47:27.497289] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:47:27.538819] [DEBUG] [LOCAL ] KGS: Loaded 46135 existing records from primary storage. [2025-10-16T19:47:27.539103] [INFO ] [MAIN ] KGS: Loaded 46135 existing records. [2025-10-16T19:47:27.714089] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:47:27.714276] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-16T19:47:27.714322] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-16T19:47:27.714696] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-16T19:47:27.714751] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-16T19:47:27.950934] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-16T19:47:28.095720] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:47:28.616819] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T19:47:28.742775] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-16T19:47:28.788106] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T19:47:29.542816] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-16T19:47:30.342813] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-16T19:47:30.644932] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-16T19:47:30.983512] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T19:47:31.142849] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-16T19:47:31.904860] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T19:47:31.942802] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-16T19:47:32.376406] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T19:47:32.742829] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-16T19:47:33.187954] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T19:47:33.191395] [INFO ] [REMOTE ] KFRC: Full fetch complete (26649 records). [2025-10-16T19:47:33.191467] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-16T19:47:33.548092] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-16T19:47:33.558418] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-16T19:47:33.558520] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-16T19:47:33.559920] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-16T19:47:33.560004] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-16T19:47:33.560868] [DEBUG] [LOCAL ] KFRC: Trimmed 26649 records to 20719 (keeping 200 days of data) [2025-10-16T19:47:33.691321] [DEBUG] [LOCAL ] KFRC: Primary data saved (20719 records). [2025-10-16T19:47:33.691454] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-16T19:47:33.691535] [INFO ] [MAIN ] Update Progress: 1187/2369 symbols completed. KFRC took 35.9s. Estimated remaining: 2h 46m 48s. Rate: 7.1 symbols/min [2025-10-16T19:47:33.859058] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:47:33.879102] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T19:47:33.932108] [DEBUG] [LOCAL ] KIM: Loaded 53004 existing records from primary storage. [2025-10-16T19:47:33.932507] [INFO ] [MAIN ] KIM: Loaded 53004 existing records. [2025-10-16T19:47:34.106057] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:47:34.106277] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-16T19:47:34.106324] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-16T19:47:34.106551] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-16T19:47:34.106607] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-16T19:47:34.352377] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-16T19:47:34.466890] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:47:35.142788] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-16T19:47:35.535345] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-16T19:47:35.651241] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-16T19:47:35.942825] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-16T19:47:36.721017] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T19:47:36.742761] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-16T19:47:36.845554] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-16T19:47:37.542810] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-16T19:47:38.091681] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T19:47:38.342800] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-16T19:47:38.886745] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T19:47:39.142830] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-16T19:47:39.491068] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T19:47:39.942829] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-16T19:47:40.492071] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:47:40.742900] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-16T19:47:41.424735] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T19:47:41.542823] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-16T19:47:41.875969] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-16T19:47:41.880118] [INFO ] [REMOTE ] KFY: Full fetch complete (43405 records). [2025-10-16T19:47:41.880220] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-16T19:47:42.251836] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-16T19:47:42.251915] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-16T19:47:42.252687] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-16T19:47:42.252748] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-16T19:47:42.253711] [DEBUG] [LOCAL ] KFY: Trimmed 43405 records to 30189 (keeping 200 days of data) [2025-10-16T19:47:42.343323] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-16T19:47:42.444958] [DEBUG] [LOCAL ] KFY: Primary data saved (30189 records). [2025-10-16T19:47:42.445100] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-16T19:47:42.445182] [INFO ] [MAIN ] Update Progress: 1188/2369 symbols completed. KFY took 33.7s. Estimated remaining: 2h 46m 39s. Rate: 7.1 symbols/min [2025-10-16T19:47:42.613544] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:47:42.635587] [DEBUG] [LOCAL ] KIO: Loaded 21606 existing records from primary storage. [2025-10-16T19:47:42.635920] [INFO ] [MAIN ] KIO: Loaded 21606 existing records. [2025-10-16T19:47:42.817626] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:47:42.817970] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-16T19:47:42.818238] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-16T19:47:42.818634] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-16T19:47:42.818756] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-16T19:47:43.030470] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T19:47:43.147950] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-16T19:47:43.214960] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:47:43.942796] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-16T19:47:44.186057] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T19:47:44.742853] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-16T19:47:44.822868] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-16T19:47:45.345668] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-16T19:47:45.542826] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-16T19:47:46.091570] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T19:47:46.342801] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-16T19:47:47.142812] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-16T19:47:47.261861] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T19:47:47.351109] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T19:47:47.942843] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-16T19:47:48.659776] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T19:47:48.742890] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-16T19:47:49.548013] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-16T19:47:49.567500] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T19:47:50.284914] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T19:47:50.342871] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-16T19:47:50.593705] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T19:47:51.142851] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-16T19:47:51.942803] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-16T19:47:52.447396] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-16T19:47:52.545797] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T19:47:52.742859] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-16T19:47:53.106711] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-16T19:47:53.542842] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-16T19:47:54.342794] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-16T19:47:54.518909] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T19:47:55.142801] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-16T19:47:55.251204] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T19:47:55.892678] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:47:55.942797] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-16T19:47:56.742893] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-16T19:47:57.080775] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-16T19:47:57.526240] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-16T19:47:57.542766] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-16T19:47:57.786065] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T19:47:58.342803] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-16T19:47:58.543264] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T19:47:59.142815] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-16T19:47:59.942825] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-16T19:48:00.534036] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-16T19:48:00.541329] [INFO ] [REMOTE ] KGC: Full fetch complete (77871 records). [2025-10-16T19:48:00.541499] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-16T19:48:00.747892] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-16T19:48:00.974138] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-16T19:48:00.974280] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-16T19:48:00.975386] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-16T19:48:00.975458] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-16T19:48:00.977001] [DEBUG] [LOCAL ] KGC: Trimmed 77871 records to 54090 (keeping 200 days of data) [2025-10-16T19:48:01.076926] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T19:48:01.246433] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-16T19:48:01.383412] [DEBUG] [LOCAL ] KGC: Primary data saved (54090 records). [2025-10-16T19:48:01.383557] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-16T19:48:01.384145] [INFO ] [MAIN ] Update Progress: 1189/2369 symbols completed. KGC took 41.7s. Estimated remaining: 2h 46m 41s. Rate: 7.1 symbols/min [2025-10-16T19:48:01.551803] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-16T19:48:01.583831] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:48:01.640661] [DEBUG] [LOCAL ] KKR: Loaded 53503 existing records from primary storage. [2025-10-16T19:48:01.640981] [INFO ] [MAIN ] KKR: Loaded 53503 existing records. [2025-10-16T19:48:01.830974] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:48:01.831183] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-16T19:48:01.831229] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-16T19:48:01.831533] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-16T19:48:01.831589] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-16T19:48:02.198706] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:48:02.230957] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T19:48:02.342828] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-16T19:48:03.142785] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-16T19:48:03.452271] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T19:48:03.942798] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-16T19:48:04.310562] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-16T19:48:04.337201] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-16T19:48:04.742859] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-16T19:48:05.265193] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T19:48:05.542786] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-16T19:48:06.315677] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T19:48:06.342761] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-16T19:48:07.142848] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-16T19:48:07.524118] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-16T19:48:07.530816] [INFO ] [REMOTE ] KIM: Full fetch complete (76967 records). [2025-10-16T19:48:07.530938] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-16T19:48:07.935163] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-16T19:48:07.935301] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-16T19:48:07.936504] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-16T19:48:07.936752] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-16T19:48:07.938265] [DEBUG] [LOCAL ] KIM: Trimmed 76967 records to 53394 (keeping 200 days of data) [2025-10-16T19:48:07.990056] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-16T19:48:08.056867] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-16T19:48:08.064977] [INFO ] [REMOTE ] KGS: Full fetch complete (66515 records). [2025-10-16T19:48:08.065561] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-16T19:48:08.524477] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T19:48:08.642692] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-16T19:48:08.643039] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-16T19:48:08.644253] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-16T19:48:08.644629] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-16T19:48:08.659735] [DEBUG] [LOCAL ] KGS: Trimmed 66515 records to 46426 (keeping 200 days of data) [2025-10-16T19:48:08.761020] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-16T19:48:08.858006] [DEBUG] [LOCAL ] KIM: Primary data saved (53394 records). [2025-10-16T19:48:08.859472] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-16T19:48:08.861192] [INFO ] [MAIN ] Update Progress: 1190/2369 symbols completed. KIM took 35.2s. Estimated remaining: 2h 46m 32s. Rate: 7.1 symbols/min [2025-10-16T19:48:09.109906] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:48:09.165747] [DEBUG] [LOCAL ] KKRS: Loaded 5638 existing records from primary storage. [2025-10-16T19:48:09.166945] [INFO ] [MAIN ] KKRS: Loaded 5638 existing records. [2025-10-16T19:48:09.400290] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:48:09.407965] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-16T19:48:09.413208] [DEBUG] [LOCAL ] KGS: Primary data saved (46426 records). [2025-10-16T19:48:09.413317] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-16T19:48:09.413543] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-16T19:48:09.413724] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-16T19:48:09.413968] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-16T19:48:09.426174] [INFO ] [MAIN ] Update Progress: 1191/2369 symbols completed. KGS took 42.1s. Estimated remaining: 2h 46m 16s. Rate: 7.1 symbols/min [2025-10-16T19:48:09.734478] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:48:09.775837] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-16T19:48:09.836221] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-16T19:48:09.894251] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-16T19:48:09.905416] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-16T19:48:09.905836] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-16T19:48:09.905987] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-16T19:48:10.082591] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T19:48:10.116516] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-16T19:48:10.138400] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:48:10.147285] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-16T19:48:10.347929] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-16T19:48:10.411284] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:48:11.112991] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T19:48:11.116691] [INFO ] [REMOTE ] KIO: Full fetch complete (32024 records). [2025-10-16T19:48:11.116768] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-16T19:48:11.151268] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-16T19:48:11.409463] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:48:11.428026] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-16T19:48:11.437176] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:48:11.440681] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-16T19:48:11.440762] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:48:11.451676] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-16T19:48:11.462162] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-16T19:48:11.481561] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-16T19:48:11.501839] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-16T19:48:11.501947] [INFO ] [MAIN ] Update Progress: 1192/2369 symbols completed. KKRT took 2.1s. Estimated remaining: 2h 46m 1s. Rate: 7.1 symbols/min [2025-10-16T19:48:11.562497] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-16T19:48:11.594471] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-16T19:48:11.600565] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-16T19:48:11.600667] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-16T19:48:11.643491] [DEBUG] [LOCAL ] KIO: Trimmed 32024 records to 21866 (keeping 200 days of data) [2025-10-16T19:48:11.761215] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:48:11.762181] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-16T19:48:11.762337] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-16T19:48:11.792487] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-16T19:48:11.798566] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-16T19:48:11.804700] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-16T19:48:11.809878] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-16T19:48:11.948242] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-16T19:48:11.967177] [DEBUG] [LOCAL ] KIO: Primary data saved (21866 records). [2025-10-16T19:48:11.980358] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-16T19:48:11.985858] [INFO ] [MAIN ] Update Progress: 1193/2369 symbols completed. KIO took 29.5s. Estimated remaining: 2h 45m 45s. Rate: 7.1 symbols/min [2025-10-16T19:48:12.344550] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:48:12.414031] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:48:12.420869] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-16T19:48:12.451303] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-16T19:48:12.485338] [DEBUG] [LOCAL ] KLC: Loaded 36505 existing records from primary storage. [2025-10-16T19:48:12.485624] [INFO ] [MAIN ] KLC: Loaded 36505 existing records. [2025-10-16T19:48:12.657438] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:48:12.657720] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-16T19:48:12.657776] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-16T19:48:12.658033] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-16T19:48:12.658089] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-16T19:48:12.748034] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-16T19:48:13.006151] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:48:13.036103] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:48:13.036393] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-16T19:48:13.036491] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:48:13.036548] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-16T19:48:13.036631] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:48:13.036726] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-16T19:48:13.036788] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-16T19:48:13.036822] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-16T19:48:13.036861] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-16T19:48:13.036906] [INFO ] [MAIN ] Update Progress: 1194/2369 symbols completed. KLAR took 1.5s. Estimated remaining: 2h 45m 29s. Rate: 7.1 symbols/min [2025-10-16T19:48:13.213335] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:48:13.265109] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-16T19:48:13.265489] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-16T19:48:13.438399] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:48:13.438619] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-16T19:48:13.438695] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-16T19:48:13.439051] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-16T19:48:13.439106] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-16T19:48:13.547989] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-16T19:48:13.788533] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:48:14.342841] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-16T19:48:15.142831] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-16T19:48:15.278405] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T19:48:15.942810] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-16T19:48:16.408936] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T19:48:16.440185] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-16T19:48:16.615121] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T19:48:16.742812] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-16T19:48:17.542809] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-16T19:48:17.948677] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T19:48:18.342827] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-16T19:48:19.142811] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-16T19:48:19.581667] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-16T19:48:19.742793] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T19:48:19.942809] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-16T19:48:20.197482] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T19:48:20.742820] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-16T19:48:21.267882] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T19:48:21.319274] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T19:48:21.542843] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-16T19:48:22.328717] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T19:48:22.342772] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-16T19:48:22.966619] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T19:48:23.142816] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-16T19:48:23.559453] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-16T19:48:23.942814] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-16T19:48:24.742854] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-16T19:48:25.542822] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-16T19:48:25.911775] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-16T19:48:25.926133] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-16T19:48:26.342786] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-16T19:48:26.740392] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-16T19:48:26.839327] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-16T19:48:27.142821] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-16T19:48:27.542435] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-16T19:48:27.942857] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-16T19:48:28.742875] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-16T19:48:29.542798] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-16T19:48:29.965105] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-16T19:48:30.131436] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T19:48:30.132414] [INFO ] [REMOTE ] KKRS: Full fetch complete (7647 records). [2025-10-16T19:48:30.132483] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-16T19:48:30.345279] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-16T19:48:30.500907] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-16T19:48:30.501096] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-16T19:48:30.501379] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-16T19:48:30.501514] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-16T19:48:30.502336] [DEBUG] [LOCAL ] KKRS: Trimmed 7647 records to 5648 (keeping 200 days of data) [2025-10-16T19:48:30.536319] [DEBUG] [LOCAL ] KKRS: Primary data saved (5648 records). [2025-10-16T19:48:30.536450] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-16T19:48:30.536530] [INFO ] [MAIN ] Update Progress: 1195/2369 symbols completed. KKRS took 21.7s. Estimated remaining: 2h 45m 29s. Rate: 7.1 symbols/min [2025-10-16T19:48:30.719754] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:48:30.739810] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-16T19:48:30.754365] [DEBUG] [LOCAL ] KMPB: Loaded 3652 existing records from primary storage. [2025-10-16T19:48:30.754580] [INFO ] [MAIN ] KMPB: Loaded 3652 existing records. [2025-10-16T19:48:30.930212] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:48:30.930451] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-16T19:48:30.930500] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-16T19:48:30.930668] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-16T19:48:30.930749] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-16T19:48:31.148032] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-16T19:48:31.299802] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:48:31.942862] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-16T19:48:32.330591] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T19:48:32.742859] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-16T19:48:32.979360] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T19:48:33.075600] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T19:48:33.542868] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-16T19:48:34.342780] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-16T19:48:34.414395] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T19:48:35.142808] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-16T19:48:35.348593] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T19:48:35.942810] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-16T19:48:35.966745] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T19:48:36.742823] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-16T19:48:37.004521] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-16T19:48:37.542858] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-16T19:48:37.718459] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T19:48:38.162752] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T19:48:38.342788] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-16T19:48:39.142815] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-16T19:48:39.241965] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T19:48:39.942778] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-16T19:48:40.149019] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-16T19:48:40.155856] [INFO ] [REMOTE ] KKR: Full fetch complete (77631 records). [2025-10-16T19:48:40.155996] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-16T19:48:40.567943] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T19:48:40.568234] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-16T19:48:40.574837] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-16T19:48:40.576331] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-16T19:48:40.576523] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-16T19:48:40.578302] [DEBUG] [LOCAL ] KKR: Trimmed 77631 records to 53893 (keeping 200 days of data) [2025-10-16T19:48:40.760793] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-16T19:48:40.914317] [DEBUG] [LOCAL ] KKR: Primary data saved (53893 records). [2025-10-16T19:48:40.914500] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-16T19:48:40.915131] [INFO ] [MAIN ] Update Progress: 1196/2369 symbols completed. KKR took 39.5s. Estimated remaining: 2h 45m 23s. Rate: 7.1 symbols/min [2025-10-16T19:48:41.078350] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:48:41.116171] [DEBUG] [LOCAL ] KMPR: Loaded 39987 existing records from primary storage. [2025-10-16T19:48:41.116456] [INFO ] [MAIN ] KMPR: Loaded 39987 existing records. [2025-10-16T19:48:41.288866] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:48:41.289058] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-16T19:48:41.289104] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-16T19:48:41.289336] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-16T19:48:41.289391] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-16T19:48:41.554399] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-16T19:48:41.672747] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:48:41.704991] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T19:48:42.081276] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T19:48:42.203151] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-16T19:48:42.342794] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-16T19:48:43.142810] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-16T19:48:43.478439] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T19:48:43.942813] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-16T19:48:44.742786] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-16T19:48:44.829680] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T19:48:44.886147] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-16T19:48:45.157664] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-16T19:48:45.542814] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-16T19:48:46.342785] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-16T19:48:46.421818] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T19:48:47.142791] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-16T19:48:47.215959] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T19:48:47.575688] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T19:48:47.942807] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-16T19:48:48.739108] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T19:48:48.748874] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-16T19:48:48.751125] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-16T19:48:48.752773] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-16T19:48:49.285999] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-16T19:48:49.286118] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-16T19:48:49.287349] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-16T19:48:49.287416] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-16T19:48:49.289056] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 54083 (keeping 200 days of data) [2025-10-16T19:48:49.543295] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-16T19:48:49.645760] [DEBUG] [LOCAL ] KMI: Primary data saved (54083 records). [2025-10-16T19:48:49.645922] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-16T19:48:49.646808] [INFO ] [MAIN ] Update Progress: 1197/2369 symbols completed. KMI took 36.6s. Estimated remaining: 2h 45m 14s. Rate: 7.1 symbols/min [2025-10-16T19:48:50.095771] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:48:50.149671] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T19:48:50.342823] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-16T19:48:51.142814] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-16T19:48:51.766935] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-16T19:48:51.942833] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-16T19:48:52.388824] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-16T19:48:52.453940] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-16T19:48:52.459594] [INFO ] [REMOTE ] KLC: Full fetch complete (50532 records). [2025-10-16T19:48:52.459761] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-16T19:48:52.748034] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-16T19:48:52.850316] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-16T19:48:52.850418] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-16T19:48:52.851393] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-16T19:48:52.851458] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-16T19:48:52.852783] [DEBUG] [LOCAL ] KLC: Trimmed 50532 records to 36757 (keeping 200 days of data) [2025-10-16T19:48:53.060962] [DEBUG] [LOCAL ] KLC: Primary data saved (36757 records). [2025-10-16T19:48:53.061116] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-16T19:48:53.061196] [INFO ] [MAIN ] Update Progress: 1198/2369 symbols completed. KLC took 41.1s. Estimated remaining: 2h 45m 1s. Rate: 7.1 symbols/min [2025-10-16T19:48:53.382557] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T19:48:53.542828] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-16T19:48:53.860715] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-16T19:48:54.342814] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-16T19:48:55.142860] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-16T19:48:55.323162] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T19:48:55.713124] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-16T19:48:55.942807] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-16T19:48:56.471865] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-16T19:48:56.742846] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-16T19:48:57.269002] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-16T19:48:57.270048] [INFO ] [REMOTE ] KMPB: Full fetch complete (5008 records). [2025-10-16T19:48:57.270121] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-16T19:48:57.548055] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-16T19:48:57.649905] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-16T19:48:57.649980] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-16T19:48:57.650155] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-16T19:48:57.650194] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-16T19:48:57.650544] [DEBUG] [LOCAL ] KMPB: Trimmed 5008 records to 3667 (keeping 200 days of data) [2025-10-16T19:48:57.672587] [DEBUG] [LOCAL ] KMPB: Primary data saved (3667 records). [2025-10-16T19:48:57.672676] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-16T19:48:57.672761] [INFO ] [MAIN ] Update Progress: 1199/2369 symbols completed. KMPB took 27.1s. Estimated remaining: 2h 44m 49s. Rate: 7.1 symbols/min [2025-10-16T19:48:59.055905] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T19:48:59.063755] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-16T19:49:00.403031] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T19:49:00.410166] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-16T19:49:02.010790] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T19:49:02.018868] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-16T19:49:03.581762] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T19:49:03.590752] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-16T19:49:05.321198] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T19:49:05.331018] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-16T19:49:06.988760] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T19:49:06.998544] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-16T19:49:08.796069] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T19:49:08.802226] [INFO ] [REMOTE ] KMPR: Full fetch complete (53054 records). [2025-10-16T19:49:08.802384] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-16T19:49:09.178341] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-16T19:49:09.178430] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-16T19:49:09.179296] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-16T19:49:09.179357] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-16T19:49:09.180414] [DEBUG] [LOCAL ] KMPR: Trimmed 53054 records to 40369 (keeping 200 days of data) [2025-10-16T19:49:09.427166] [DEBUG] [LOCAL ] KMPR: Primary data saved (40369 records). [2025-10-16T19:49:09.427305] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-16T19:49:09.427836] [INFO ] [MAIN ] Update Progress: 1200/2369 symbols completed. KMPR took 28.5s. Estimated remaining: 2h 44m 44s. Rate: 7.1 symbols/min [2025-10-16T19:49:10.059931] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:10.135875] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:10.130806] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:10.157118] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:10.243406] [DEBUG] [LOCAL ] KNF: Loaded 36599 existing records from primary storage. [2025-10-16T19:49:10.271231] [INFO ] [MAIN ] KNF: Loaded 36599 existing records. [2025-10-16T19:49:10.272227] [DEBUG] [LOCAL ] KMT: Loaded 42946 existing records from primary storage. [2025-10-16T19:49:10.273569] [DEBUG] [LOCAL ] KN: Loaded 38621 existing records from primary storage. [2025-10-16T19:49:10.292629] [INFO ] [MAIN ] KMT: Loaded 42946 existing records. [2025-10-16T19:49:10.287160] [INFO ] [MAIN ] KN: Loaded 38621 existing records. [2025-10-16T19:49:10.274376] [DEBUG] [LOCAL ] KMX: Loaded 53277 existing records from primary storage. [2025-10-16T19:49:10.344192] [INFO ] [MAIN ] KMX: Loaded 53277 existing records. [2025-10-16T19:49:10.940249] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:49:10.961009] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:49:11.009191] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:49:11.005631] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-16T19:49:11.009378] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-16T19:49:11.000342] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-16T19:49:11.041934] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-16T19:49:11.042044] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-16T19:49:11.042183] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-16T19:49:11.041896] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-16T19:49:11.047695] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-16T19:49:11.047602] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:49:11.047940] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-16T19:49:11.058706] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-16T19:49:11.077227] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-16T19:49:11.077308] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-16T19:49:11.082483] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-16T19:49:11.120242] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-16T19:49:11.167774] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-16T19:49:11.206519] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-16T19:49:12.403945] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:49:12.511320] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:49:12.507552] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:49:12.516506] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-16T19:49:12.515886] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-16T19:49:12.518148] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-16T19:49:12.610572] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:49:12.611004] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-16T19:49:13.944427] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T19:49:13.952154] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-16T19:49:13.998712] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T19:49:14.006566] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-16T19:49:14.033561] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T19:49:14.041954] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-16T19:49:14.111721] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T19:49:14.123525] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-16T19:49:15.082467] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T19:49:15.089459] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-16T19:49:15.115384] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T19:49:15.123797] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-16T19:49:15.147532] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T19:49:15.156206] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-16T19:49:15.713110] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T19:49:15.725859] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-16T19:49:16.122417] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T19:49:16.128940] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-16T19:49:16.583106] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T19:49:16.591913] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-16T19:49:16.677888] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T19:49:16.686678] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-16T19:49:16.920872] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T19:49:16.930576] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-16T19:49:17.492391] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-16T19:49:17.500182] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-16T19:49:17.920752] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-16T19:49:17.930406] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-16T19:49:18.039051] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T19:49:18.052436] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-16T19:49:18.309849] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T19:49:18.342779] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-16T19:49:19.001002] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T19:49:19.142808] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-16T19:49:19.331782] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T19:49:19.785921] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T19:49:19.927120] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T19:49:19.942779] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-16T19:49:20.017980] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T19:49:20.742803] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-16T19:49:21.104905] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-16T19:49:21.542827] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-16T19:49:22.342788] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-16T19:49:22.629609] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T19:49:22.711424] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-16T19:49:23.142872] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-16T19:49:23.694109] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T19:49:23.942838] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-16T19:49:24.232395] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T19:49:24.742839] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-16T19:49:25.481724] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T19:49:25.542783] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-16T19:49:25.732974] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T19:49:26.342903] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-16T19:49:26.824127] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-16T19:49:27.142778] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-16T19:49:27.241956] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-16T19:49:27.942819] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-16T19:49:28.742782] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-16T19:49:28.856445] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T19:49:29.371091] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T19:49:29.542832] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-16T19:49:30.142179] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T19:49:30.342845] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-16T19:49:30.800010] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T19:49:31.142825] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-16T19:49:31.813203] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T19:49:31.942801] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-16T19:49:32.250971] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T19:49:32.742820] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-16T19:49:33.438509] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T19:49:33.443863] [INFO ] [REMOTE ] KNF: Full fetch complete (51300 records). [2025-10-16T19:49:33.443982] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-16T19:49:33.547136] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-16T19:49:33.835776] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-16T19:49:33.835901] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-16T19:49:33.836784] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-16T19:49:33.836848] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-16T19:49:33.838054] [DEBUG] [LOCAL ] KNF: Trimmed 51300 records to 36840 (keeping 200 days of data) [2025-10-16T19:49:34.053630] [DEBUG] [LOCAL ] KNF: Primary data saved (36840 records). [2025-10-16T19:49:34.053802] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-16T19:49:34.053884] [INFO ] [MAIN ] Update Progress: 1201/2369 symbols completed. KNF took 24.6s. Estimated remaining: 2h 44m 51s. Rate: 7.1 symbols/min [2025-10-16T19:49:34.222967] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:34.234082] [DEBUG] [LOCAL ] KNOP: Loaded 10486 existing records from primary storage. [2025-10-16T19:49:34.234325] [INFO ] [MAIN ] KNOP: Loaded 10486 existing records. [2025-10-16T19:49:34.351533] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-16T19:49:34.439218] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:49:34.439550] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-16T19:49:34.439622] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-16T19:49:34.440017] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-16T19:49:34.440085] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-16T19:49:34.814509] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:49:34.846589] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-16T19:49:35.093607] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T19:49:35.142779] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-16T19:49:35.555967] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T19:49:35.561110] [INFO ] [REMOTE ] KN: Full fetch complete (56562 records). [2025-10-16T19:49:35.561229] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-16T19:49:35.946231] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-16T19:49:35.963782] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-16T19:49:35.970728] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-16T19:49:35.970788] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-16T19:49:35.971688] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-16T19:49:35.971760] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-16T19:49:35.972831] [DEBUG] [LOCAL ] KN: Trimmed 56562 records to 38866 (keeping 200 days of data) [2025-10-16T19:49:36.190364] [DEBUG] [LOCAL ] KN: Primary data saved (38866 records). [2025-10-16T19:49:36.190480] [INFO ] [MAIN ] KN: Full history saved. [2025-10-16T19:49:36.191013] [INFO ] [MAIN ] Update Progress: 1202/2369 symbols completed. KN took 26.8s. Estimated remaining: 2h 44m 36s. Rate: 7.1 symbols/min [2025-10-16T19:49:36.360023] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:36.379835] [DEBUG] [LOCAL ] KNSL: Loaded 18426 existing records from primary storage. [2025-10-16T19:49:36.380069] [INFO ] [MAIN ] KNSL: Loaded 18426 existing records. [2025-10-16T19:49:36.552633] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:49:36.553036] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-16T19:49:36.553084] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-16T19:49:36.553247] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-16T19:49:36.553285] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-16T19:49:36.748063] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-16T19:49:36.900447] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:49:37.542842] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-16T19:49:37.971665] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-16T19:49:38.201817] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T19:49:38.207252] [INFO ] [REMOTE ] KMT: Full fetch complete (61924 records). [2025-10-16T19:49:38.207392] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-16T19:49:38.318635] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T19:49:38.347507] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-16T19:49:38.618102] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-16T19:49:38.618177] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-16T19:49:38.619224] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-16T19:49:38.619300] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-16T19:49:38.620921] [DEBUG] [LOCAL ] KMT: Trimmed 61924 records to 43226 (keeping 200 days of data) [2025-10-16T19:49:38.882321] [DEBUG] [LOCAL ] KMT: Primary data saved (43226 records). [2025-10-16T19:49:38.882445] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-16T19:49:38.882529] [INFO ] [MAIN ] Update Progress: 1203/2369 symbols completed. KMT took 29.5s. Estimated remaining: 2h 44m 22s. Rate: 7.1 symbols/min [2025-10-16T19:49:39.056701] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:39.101339] [DEBUG] [LOCAL ] KNTK: Loaded 47085 existing records from primary storage. [2025-10-16T19:49:39.101758] [INFO ] [MAIN ] KNTK: Loaded 47085 existing records. [2025-10-16T19:49:39.148054] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-16T19:49:39.287928] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:49:39.288128] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-16T19:49:39.288177] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-16T19:49:39.288978] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-16T19:49:39.289036] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-16T19:49:39.580944] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T19:49:39.663608] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:49:39.893320] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T19:49:39.942782] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-16T19:49:40.742887] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-16T19:49:41.464731] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T19:49:41.531923] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T19:49:41.542793] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-16T19:49:42.342839] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-16T19:49:42.447434] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T19:49:43.142871] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-16T19:49:43.902589] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T19:49:43.942771] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-16T19:49:44.186499] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T19:49:44.678858] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T19:49:44.742787] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-16T19:49:45.526185] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T19:49:45.533028] [INFO ] [REMOTE ] KMX: Full fetch complete (76343 records). [2025-10-16T19:49:45.533153] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-16T19:49:45.547875] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-16T19:49:45.926876] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-16T19:49:45.927011] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-16T19:49:45.928055] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-16T19:49:45.928118] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-16T19:49:45.929560] [DEBUG] [LOCAL ] KMX: Trimmed 76343 records to 53667 (keeping 200 days of data) [2025-10-16T19:49:46.235160] [DEBUG] [LOCAL ] KMX: Primary data saved (53667 records). [2025-10-16T19:49:46.235298] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-16T19:49:46.235998] [INFO ] [MAIN ] Update Progress: 1204/2369 symbols completed. KMX took 36.8s. Estimated remaining: 2h 44m 13s. Rate: 7.1 symbols/min [2025-10-16T19:49:46.348017] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-16T19:49:46.405133] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:46.454508] [DEBUG] [LOCAL ] KNX: Loaded 52615 existing records from primary storage. [2025-10-16T19:49:46.454848] [INFO ] [MAIN ] KNX: Loaded 52615 existing records. [2025-10-16T19:49:46.626916] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:49:46.627142] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-16T19:49:46.627189] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-16T19:49:46.627368] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-16T19:49:46.627405] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-16T19:49:46.980896] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:49:47.076038] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T19:49:47.142836] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-16T19:49:47.507428] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T19:49:47.942837] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-16T19:49:48.601883] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T19:49:48.742794] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-16T19:49:48.781263] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T19:49:49.542884] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-16T19:49:50.220602] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T19:49:50.342802] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-16T19:49:50.683042] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T19:49:51.142842] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-16T19:49:51.942815] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-16T19:49:52.032800] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T19:49:52.199605] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T19:49:52.736606] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T19:49:52.742759] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-16T19:49:53.458998] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-16T19:49:53.542866] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-16T19:49:54.342846] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-16T19:49:54.359494] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T19:49:55.142812] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-16T19:49:55.331631] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T19:49:55.942837] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-16T19:49:56.710090] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T19:49:56.742784] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-16T19:49:57.186481] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T19:49:57.542850] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-16T19:49:58.349432] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-16T19:49:58.355185] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T19:49:58.419771] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T19:49:59.142778] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-16T19:49:59.368157] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T19:49:59.370284] [INFO ] [REMOTE ] KNOP: Full fetch complete (14704 records). [2025-10-16T19:49:59.370357] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-16T19:49:59.728970] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-16T19:49:59.729059] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-16T19:49:59.729426] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-16T19:49:59.729468] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-16T19:49:59.730158] [DEBUG] [LOCAL ] KNOP: Trimmed 14704 records to 10555 (keeping 200 days of data) [2025-10-16T19:49:59.789994] [DEBUG] [LOCAL ] KNOP: Primary data saved (10555 records). [2025-10-16T19:49:59.790120] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-16T19:49:59.790196] [INFO ] [MAIN ] Update Progress: 1205/2369 symbols completed. KNOP took 25.7s. Estimated remaining: 2h 44m 9s. Rate: 7.1 symbols/min [2025-10-16T19:49:59.945363] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-16T19:49:59.965718] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:59.965972] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-16T19:49:59.966048] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-16T19:49:59.966166] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-16T19:49:59.966209] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-16T19:49:59.966251] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-16T19:49:59.966284] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-16T19:50:00.321835] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:50:00.742831] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-16T19:50:00.788825] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T19:50:01.542832] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-16T19:50:01.961841] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T19:50:02.342863] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-16T19:50:02.974017] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T19:50:03.142806] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-16T19:50:03.283430] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-10-16T19:50:03.920186] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T19:50:03.942776] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-16T19:50:04.000873] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-16T19:50:04.742879] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-16T19:50:05.390322] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T19:50:05.542841] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-16T19:50:06.342863] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-16T19:50:06.377462] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T19:50:07.095144] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T19:50:07.142842] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-16T19:50:07.942849] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-16T19:50:08.107245] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-16T19:50:08.163847] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T19:50:08.167248] [INFO ] [REMOTE ] KNSL: Full fetch complete (27134 records). [2025-10-16T19:50:08.167336] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-16T19:50:08.578013] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-16T19:50:08.578091] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-16T19:50:08.578747] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-16T19:50:08.578848] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-16T19:50:08.579512] [DEBUG] [LOCAL ] KNSL: Trimmed 27134 records to 18656 (keeping 200 days of data) [2025-10-16T19:50:08.691422] [DEBUG] [LOCAL ] KNSL: Primary data saved (18656 records). [2025-10-16T19:50:08.691556] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-16T19:50:08.691632] [INFO ] [MAIN ] Update Progress: 1206/2369 symbols completed. KNSL took 32.5s. Estimated remaining: 2h 44m 1s. Rate: 7.1 symbols/min [2025-10-16T19:50:08.755599] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-16T19:50:08.863086] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:50:08.901326] [DEBUG] [LOCAL ] KODK: Loaded 43766 existing records from primary storage. [2025-10-16T19:50:08.901611] [INFO ] [MAIN ] KODK: Loaded 43766 existing records. [2025-10-16T19:50:09.079598] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:50:09.079852] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-16T19:50:09.079900] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-16T19:50:09.080100] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-16T19:50:09.080154] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-16T19:50:09.436148] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:50:09.511772] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T19:50:09.542836] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-16T19:50:10.342857] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-16T19:50:11.037107] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T19:50:11.142790] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-16T19:50:11.247631] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-16T19:50:11.942812] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-16T19:50:12.300299] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T19:50:12.308086] [INFO ] [REMOTE ] KNTK: Full fetch complete (65586 records). [2025-10-16T19:50:12.308236] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-16T19:50:12.705409] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-16T19:50:12.705502] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-16T19:50:12.706706] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-16T19:50:12.706964] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-16T19:50:12.708496] [DEBUG] [LOCAL ] KNTK: Trimmed 65586 records to 47433 (keeping 200 days of data) [2025-10-16T19:50:12.762763] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-16T19:50:13.036755] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-16T19:50:13.038918] [DEBUG] [LOCAL ] KNTK: Primary data saved (47433 records). [2025-10-16T19:50:13.050338] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-16T19:50:13.050457] [INFO ] [MAIN ] Update Progress: 1207/2369 symbols completed. KNTK took 34.2s. Estimated remaining: 2h 43m 49s. Rate: 7.1 symbols/min [2025-10-16T19:50:13.222199] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:50:13.249102] [DEBUG] [LOCAL ] KOF: Loaded 26616 existing records from primary storage. [2025-10-16T19:50:13.249404] [INFO ] [MAIN ] KOF: Loaded 26616 existing records. [2025-10-16T19:50:13.430082] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:50:13.430475] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-16T19:50:13.430608] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-16T19:50:13.430900] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-16T19:50:13.430964] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-16T19:50:13.545124] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-16T19:50:13.748716] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T19:50:13.847141] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:50:14.342873] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-16T19:50:15.142820] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-16T19:50:15.438664] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-16T19:50:15.538914] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-16T19:50:15.883251] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T19:50:15.942764] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-16T19:50:15.972397] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T19:50:16.742926] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-16T19:50:16.885585] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T19:50:17.542835] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-16T19:50:18.342788] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-16T19:50:18.371731] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T19:50:18.869599] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T19:50:19.142867] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-16T19:50:19.942853] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-16T19:50:20.002620] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T19:50:20.730819] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T19:50:20.742768] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-16T19:50:20.785221] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T19:50:21.542794] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-16T19:50:22.342794] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-16T19:50:22.532024] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T19:50:22.812044] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T19:50:23.142809] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-16T19:50:23.942824] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-16T19:50:24.398347] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T19:50:24.742843] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-16T19:50:24.978169] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-16T19:50:25.347830] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T19:50:25.542848] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-16T19:50:26.044272] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T19:50:26.342838] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-16T19:50:27.142786] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-16T19:50:27.280984] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T19:50:27.942794] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-16T19:50:28.042514] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T19:50:28.742824] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-16T19:50:29.411202] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T19:50:29.542785] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-16T19:50:29.643851] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-16T19:50:30.004610] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-16T19:50:30.011622] [INFO ] [REMOTE ] KNX: Full fetch complete (76226 records). [2025-10-16T19:50:30.011788] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-16T19:50:30.352486] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-16T19:50:30.436846] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-16T19:50:30.436957] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-16T19:50:30.438104] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-16T19:50:30.438218] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-16T19:50:30.454877] [DEBUG] [LOCAL ] KNX: Trimmed 76226 records to 53005 (keeping 200 days of data) [2025-10-16T19:50:30.480777] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T19:50:30.814569] [DEBUG] [LOCAL ] KNX: Primary data saved (53005 records). [2025-10-16T19:50:30.814754] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-16T19:50:30.815328] [INFO ] [MAIN ] Update Progress: 1208/2369 symbols completed. KNX took 44.6s. Estimated remaining: 2h 43m 49s. Rate: 7.1 symbols/min [2025-10-16T19:50:30.982140] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:50:31.001065] [DEBUG] [LOCAL ] KOP: Loaded 17433 existing records from primary storage. [2025-10-16T19:50:31.001330] [INFO ] [MAIN ] KOP: Loaded 17433 existing records. [2025-10-16T19:50:31.149990] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-16T19:50:31.182685] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:50:31.182885] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-16T19:50:31.182932] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-16T19:50:31.183110] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-16T19:50:31.183179] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-16T19:50:31.536370] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:50:31.645738] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T19:50:31.942820] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-16T19:50:32.742811] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-16T19:50:33.137191] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-16T19:50:33.542799] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-16T19:50:33.719144] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-16T19:50:33.974242] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T19:50:34.342829] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-16T19:50:34.450619] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-16T19:50:35.142890] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-16T19:50:35.942832] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-16T19:50:36.133576] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T19:50:36.139500] [INFO ] [REMOTE ] KODK: Full fetch complete (63481 records). [2025-10-16T19:50:36.139612] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-16T19:50:36.552498] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-16T19:50:36.552382] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T19:50:36.552732] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-16T19:50:36.559544] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-16T19:50:36.559715] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-16T19:50:36.561510] [DEBUG] [LOCAL ] KODK: Trimmed 63481 records to 44120 (keeping 200 days of data) [2025-10-16T19:50:36.665400] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-16T19:50:36.765087] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-16T19:50:36.821032] [DEBUG] [LOCAL ] KODK: Primary data saved (44120 records). [2025-10-16T19:50:36.821166] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-16T19:50:36.821241] [INFO ] [MAIN ] Update Progress: 1209/2369 symbols completed. KODK took 28.1s. Estimated remaining: 2h 43m 38s. Rate: 7.1 symbols/min [2025-10-16T19:50:36.987613] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:50:36.992121] [DEBUG] [LOCAL ] KORE: Loaded 2164 existing records from primary storage. [2025-10-16T19:50:36.992269] [INFO ] [MAIN ] KORE: Loaded 2164 existing records. [2025-10-16T19:50:37.172492] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:50:37.173758] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-16T19:50:37.173819] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-16T19:50:37.174464] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-16T19:50:37.174520] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-16T19:50:37.529138] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:50:37.542768] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-16T19:50:37.684850] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T19:50:38.342828] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-16T19:50:38.605578] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:50:39.142852] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-16T19:50:39.942899] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-16T19:50:39.959590] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T19:50:40.742825] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-16T19:50:41.118080] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-10-16T19:50:41.146069] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T19:50:41.224434] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T19:50:41.542829] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-16T19:50:41.901700] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-16T19:50:42.342816] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-16T19:50:42.792386] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-16T19:50:43.142818] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-16T19:50:43.942824] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-16T19:50:44.255221] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T19:50:44.378888] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-16T19:50:44.742812] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-16T19:50:45.542805] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-16T19:50:45.811285] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-16T19:50:46.342828] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-16T19:50:46.657245] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T19:50:46.661712] [INFO ] [REMOTE ] KOF: Full fetch complete (38042 records). [2025-10-16T19:50:46.661820] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-16T19:50:47.072672] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-16T19:50:47.072758] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-16T19:50:47.073467] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-16T19:50:47.073507] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-16T19:50:47.074394] [DEBUG] [LOCAL ] KOF: Trimmed 38042 records to 26812 (keeping 200 days of data) [2025-10-16T19:50:47.162174] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-16T19:50:47.239808] [DEBUG] [LOCAL ] KOF: Primary data saved (26812 records). [2025-10-16T19:50:47.239945] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-16T19:50:47.240026] [INFO ] [MAIN ] Update Progress: 1210/2369 symbols completed. KOF took 34.2s. Estimated remaining: 2h 43m 32s. Rate: 7.1 symbols/min [2025-10-16T19:50:47.405913] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:50:47.455837] [DEBUG] [LOCAL ] KOS: Loaded 53097 existing records from primary storage. [2025-10-16T19:50:47.456181] [INFO ] [MAIN ] KOS: Loaded 53097 existing records. [2025-10-16T19:50:47.633333] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:50:47.633549] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-16T19:50:47.633601] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-16T19:50:47.633948] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-16T19:50:47.634006] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-16T19:50:47.947903] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-16T19:50:47.984556] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:50:48.160198] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T19:50:48.346927] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-16T19:50:48.742783] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-16T19:50:48.815492] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-16T19:50:49.233409] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T19:50:49.542817] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-16T19:50:50.342927] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-16T19:50:50.452589] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-16T19:50:50.697044] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-16T19:50:51.142813] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-16T19:50:51.647606] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-16T19:50:51.942821] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-16T19:50:52.699704] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T19:50:52.701009] [INFO ] [REMOTE ] KORE: Full fetch complete (5114 records). [2025-10-16T19:50:52.701103] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-16T19:50:52.747994] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-16T19:50:53.088356] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-16T19:50:53.088478] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-16T19:50:53.088661] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-16T19:50:53.088722] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-16T19:50:53.089113] [DEBUG] [LOCAL ] KORE: Trimmed 5114 records to 2182 (keeping 200 days of data) [2025-10-16T19:50:53.102042] [DEBUG] [LOCAL ] KORE: Primary data saved (2182 records). [2025-10-16T19:50:53.102190] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-16T19:50:53.102275] [INFO ] [MAIN ] Update Progress: 1211/2369 symbols completed. KORE took 16.3s. Estimated remaining: 2h 43m 21s. Rate: 7.1 symbols/min [2025-10-16T19:50:53.274733] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:50:53.322706] [DEBUG] [LOCAL ] KR: Loaded 53680 existing records from primary storage. [2025-10-16T19:50:53.323023] [INFO ] [MAIN ] KR: Loaded 53680 existing records. [2025-10-16T19:50:53.501938] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:50:53.502210] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-16T19:50:53.502266] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-16T19:50:53.502455] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-16T19:50:53.502492] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-16T19:50:53.544971] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-16T19:50:53.841399] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-16T19:50:53.905907] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:50:54.342829] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-16T19:50:55.142843] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-16T19:50:55.322001] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T19:50:55.942803] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-16T19:50:56.031447] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-16T19:50:56.742786] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-16T19:50:56.994788] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T19:50:57.542780] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-16T19:50:57.597445] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T19:50:57.604499] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-16T19:50:57.604689] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-16T19:50:57.825250] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-16T19:50:57.826186] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:50:57.826405] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:50:57.826570] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-16T19:50:57.826735] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-16T19:50:57.826932] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-16T19:50:57.827066] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-16T19:50:57.827183] [INFO ] [MAIN ] Update Progress: 1212/2369 symbols completed. KO took 58.0s. Estimated remaining: 2h 43m 9s. Rate: 7.1 symbols/min [2025-10-16T19:50:58.016508] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-16T19:50:58.037664] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:50:58.048913] [DEBUG] [LOCAL ] KRC: No existing data file found in primary storage. [2025-10-16T19:50:58.048991] [WARN ] [MAIN ] KRC: No existing data found, performing full refresh instead. [2025-10-16T19:50:58.049117] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-16T19:50:58.049160] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-16T19:50:58.049202] [DEBUG] [LOCAL ] KRC: No primary data file found to delete. [2025-10-16T19:50:58.049236] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-16T19:50:58.347934] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-16T19:50:58.405759] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:50:59.142796] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-16T19:50:59.393126] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T19:50:59.942842] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-16T19:51:00.161044] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T19:51:00.742800] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-16T19:51:00.854793] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T19:51:01.012998] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T19:51:01.542844] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-16T19:51:02.342839] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-16T19:51:02.546843] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T19:51:03.119800] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T19:51:03.142779] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-16T19:51:03.942801] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-16T19:51:03.999046] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T19:51:04.742791] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-16T19:51:04.826526] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T19:51:04.929132] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T19:51:04.931903] [INFO ] [REMOTE ] KOP: Full fetch complete (25399 records). [2025-10-16T19:51:04.931993] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-16T19:51:05.304549] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-16T19:51:05.304678] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-16T19:51:05.305307] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-16T19:51:05.305370] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-16T19:51:05.306158] [DEBUG] [LOCAL ] KOP: Trimmed 25399 records to 17544 (keeping 200 days of data) [2025-10-16T19:51:05.429835] [DEBUG] [LOCAL ] KOP: Primary data saved (17544 records). [2025-10-16T19:51:05.430052] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-16T19:51:05.430187] [INFO ] [MAIN ] Update Progress: 1213/2369 symbols completed. KOP took 34.6s. Estimated remaining: 2h 42m 60s. Rate: 7.1 symbols/min [2025-10-16T19:51:05.547885] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-16T19:51:05.610842] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:51:05.647460] [DEBUG] [LOCAL ] KREF: Loaded 37941 existing records from primary storage. [2025-10-16T19:51:05.647858] [INFO ] [MAIN ] KREF: Loaded 37941 existing records. [2025-10-16T19:51:05.822784] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:51:05.823010] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-16T19:51:05.823064] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-16T19:51:05.823248] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-16T19:51:05.823302] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-16T19:51:06.173844] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:51:06.342791] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-16T19:51:06.608071] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T19:51:07.142809] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-16T19:51:07.454821] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-16T19:51:07.729624] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T19:51:07.942815] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-16T19:51:08.516626] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T19:51:08.742804] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-16T19:51:09.542820] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-16T19:51:09.726219] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T19:51:10.342820] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-16T19:51:10.694815] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T19:51:11.142778] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-16T19:51:11.200827] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T19:51:11.624204] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T19:51:11.942811] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-16T19:51:12.742860] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-16T19:51:12.892792] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T19:51:13.162034] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T19:51:13.542863] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-16T19:51:14.342805] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-16T19:51:14.473496] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T19:51:15.083363] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T19:51:15.142811] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-16T19:51:15.903402] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T19:51:15.942813] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-16T19:51:16.742793] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-16T19:51:16.821354] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T19:51:17.383935] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T19:51:17.542814] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-16T19:51:18.342798] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-16T19:51:18.635570] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-16T19:51:19.142896] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-16T19:51:19.188987] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T19:51:19.942826] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-16T19:51:20.205359] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-16T19:51:20.742802] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-16T19:51:21.081033] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T19:51:21.507747] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T19:51:21.542786] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-16T19:51:22.296039] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T19:51:22.342791] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-16T19:51:23.133400] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T19:51:23.142906] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-16T19:51:23.942808] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-16T19:51:24.465062] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-16T19:51:24.742843] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-16T19:51:24.922776] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T19:51:25.542874] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-16T19:51:25.572702] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T19:51:25.588784] [INFO ] [REMOTE ] KR: Full fetch complete (77843 records). [2025-10-16T19:51:25.594873] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-16T19:51:25.596010] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T19:51:25.677494] [INFO ] [REMOTE ] KRC: Full fetch complete (70061 records). [2025-10-16T19:51:25.701130] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-16T19:51:26.364227] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-16T19:51:26.367530] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-16T19:51:26.390405] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-16T19:51:26.411410] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-16T19:51:26.415090] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-16T19:51:26.415200] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-16T19:51:26.415445] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-16T19:51:26.416190] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-16T19:51:26.416514] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-16T19:51:26.418320] [DEBUG] [LOCAL ] KRC: Trimmed 70061 records to 48625 (keeping 200 days of data) [2025-10-16T19:51:26.418207] [DEBUG] [LOCAL ] KR: Trimmed 77843 records to 54070 (keeping 200 days of data) [2025-10-16T19:51:26.995207] [DEBUG] [LOCAL ] KR: Primary data saved (54070 records). [2025-10-16T19:51:26.998962] [INFO ] [MAIN ] KR: Full history saved. [2025-10-16T19:51:26.999106] [INFO ] [MAIN ] Update Progress: 1214/2369 symbols completed. KR took 33.9s. Estimated remaining: 2h 43m 4s. Rate: 7.1 symbols/min [2025-10-16T19:51:27.199542] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:51:27.279527] [DEBUG] [LOCAL ] KRC: Primary data saved (48625 records). [2025-10-16T19:51:27.279788] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-16T19:51:27.279900] [INFO ] [MAIN ] Update Progress: 1215/2369 symbols completed. KRC took 29.5s. Estimated remaining: 2h 42m 47s. Rate: 7.1 symbols/min [2025-10-16T19:51:27.430156] [DEBUG] [LOCAL ] KRG: Loaded 49285 existing records from primary storage. [2025-10-16T19:51:27.430950] [INFO ] [MAIN ] KRG: Loaded 49285 existing records. [2025-10-16T19:51:27.454351] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-16T19:51:27.581707] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:51:27.603692] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-16T19:51:27.620927] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-16T19:51:27.641192] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-16T19:51:27.641301] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-16T19:51:27.635019] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-16T19:51:27.643166] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-16T19:51:27.643666] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-16T19:51:27.784157] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:51:27.818667] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-16T19:51:27.834284] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-16T19:51:27.845004] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-16T19:51:27.855564] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-16T19:51:28.439800] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:51:28.440855] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-16T19:51:28.485036] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-16T19:51:28.538225] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:51:28.658616] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:51:28.658955] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-16T19:51:28.659064] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:51:28.659112] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-16T19:51:28.659149] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:51:28.659189] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-16T19:51:28.659269] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-16T19:51:28.659328] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-16T19:51:28.659372] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-16T19:51:28.659420] [INFO ] [MAIN ] Update Progress: 1216/2369 symbols completed. KRMN took 1.4s. Estimated remaining: 2h 42m 32s. Rate: 7.1 symbols/min [2025-10-16T19:51:28.751342] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-16T19:51:28.837431] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:51:28.862240] [DEBUG] [LOCAL ] KRO: Loaded 26413 existing records from primary storage. [2025-10-16T19:51:28.862532] [INFO ] [MAIN ] KRO: Loaded 26413 existing records. [2025-10-16T19:51:29.063912] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:51:29.064147] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-16T19:51:29.064205] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-16T19:51:29.064699] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-16T19:51:29.064756] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-16T19:51:29.442677] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:51:29.542790] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-16T19:51:29.660423] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-16T19:51:29.671751] [INFO ] [REMOTE ] KOS: Full fetch complete (77039 records). [2025-10-16T19:51:29.671939] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-16T19:51:30.069242] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-16T19:51:30.069351] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-16T19:51:30.070658] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-16T19:51:30.070725] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-16T19:51:30.072203] [DEBUG] [LOCAL ] KOS: Trimmed 77039 records to 53487 (keeping 200 days of data) [2025-10-16T19:51:30.350023] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-16T19:51:30.400348] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T19:51:30.431591] [DEBUG] [LOCAL ] KOS: Primary data saved (53487 records). [2025-10-16T19:51:30.431779] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-16T19:51:30.432431] [INFO ] [MAIN ] Update Progress: 1217/2369 symbols completed. KOS took 43.2s. Estimated remaining: 2h 42m 17s. Rate: 7.1 symbols/min [2025-10-16T19:51:30.619461] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:51:30.656748] [DEBUG] [LOCAL ] KRP: Loaded 36348 existing records from primary storage. [2025-10-16T19:51:30.657027] [INFO ] [MAIN ] KRP: Loaded 36348 existing records. [2025-10-16T19:51:30.862360] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T19:51:30.865850] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:51:30.874372] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-16T19:51:30.874424] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-16T19:51:30.875079] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-16T19:51:30.875137] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-16T19:51:31.145910] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-16T19:51:31.225828] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:51:31.836764] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T19:51:31.942861] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-16T19:51:32.698994] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T19:51:32.742727] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-16T19:51:32.775343] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T19:51:33.542791] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-16T19:51:34.194567] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T19:51:34.342818] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-16T19:51:34.603100] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-16T19:51:35.142879] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-16T19:51:35.851473] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T19:51:35.942839] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-16T19:51:36.496737] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:51:36.742788] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-16T19:51:36.948849] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T19:51:37.542890] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-16T19:51:38.265674] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T19:51:38.342775] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-16T19:51:38.804500] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T19:51:39.142851] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-16T19:51:39.945085] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-16T19:51:39.950469] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T19:51:40.470587] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T19:51:40.742832] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-16T19:51:40.879177] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T19:51:41.542816] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-16T19:51:42.305546] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T19:51:42.342862] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-16T19:51:42.668741] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T19:51:43.142828] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-16T19:51:43.827010] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T19:51:43.942785] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-16T19:51:44.742860] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-16T19:51:44.854372] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T19:51:45.416416] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T19:51:45.542799] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-16T19:51:46.305723] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T19:51:46.311099] [INFO ] [REMOTE ] KREF: Full fetch complete (52815 records). [2025-10-16T19:51:46.311219] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-16T19:51:46.347991] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-16T19:51:46.693471] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-16T19:51:46.693551] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-16T19:51:46.694463] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-16T19:51:46.694525] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-16T19:51:46.695626] [DEBUG] [LOCAL ] KREF: Trimmed 52815 records to 38221 (keeping 200 days of data) [2025-10-16T19:51:46.925968] [DEBUG] [LOCAL ] KREF: Primary data saved (38221 records). [2025-10-16T19:51:46.926147] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-16T19:51:46.926233] [INFO ] [MAIN ] Update Progress: 1218/2369 symbols completed. KREF took 41.5s. Estimated remaining: 2h 42m 16s. Rate: 7.1 symbols/min [2025-10-16T19:51:47.125025] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:51:47.152308] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-16T19:51:47.174694] [DEBUG] [LOCAL ] KSS: Loaded 53593 existing records from primary storage. [2025-10-16T19:51:47.175020] [INFO ] [MAIN ] KSS: Loaded 53593 existing records. [2025-10-16T19:51:47.351197] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T19:51:47.396613] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:51:47.396838] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-16T19:51:47.396904] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-16T19:51:47.397078] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-16T19:51:47.397115] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-16T19:51:47.754994] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:51:47.798841] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T19:51:47.942787] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-16T19:51:48.081769] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-16T19:51:48.742851] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-16T19:51:49.076806] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T19:51:49.542839] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-16T19:51:49.935185] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T19:51:50.342808] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-16T19:51:51.142853] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-16T19:51:51.659888] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-16T19:51:51.806116] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T19:51:51.950854] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-16T19:51:51.952957] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T19:51:52.742820] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-16T19:51:53.160763] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T19:51:53.542868] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-16T19:51:53.854740] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T19:51:54.342907] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-16T19:51:54.613222] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T19:51:54.617584] [INFO ] [REMOTE ] KRP: Full fetch complete (55073 records). [2025-10-16T19:51:54.617701] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-16T19:51:54.987123] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-16T19:51:54.987198] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-16T19:51:54.988057] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-16T19:51:54.988120] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-16T19:51:54.989222] [DEBUG] [LOCAL ] KRP: Trimmed 55073 records to 36597 (keeping 200 days of data) [2025-10-16T19:51:55.157815] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-16T19:51:55.217545] [DEBUG] [LOCAL ] KRP: Primary data saved (36597 records). [2025-10-16T19:51:55.217718] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-16T19:51:55.217827] [INFO ] [MAIN ] Update Progress: 1219/2369 symbols completed. KRP took 24.8s. Estimated remaining: 2h 42m 8s. Rate: 7.1 symbols/min [2025-10-16T19:51:55.389143] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:51:55.431900] [DEBUG] [LOCAL ] KT: Loaded 45480 existing records from primary storage. [2025-10-16T19:51:55.432204] [INFO ] [MAIN ] KT: Loaded 45480 existing records. [2025-10-16T19:51:55.616455] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:51:55.616865] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-16T19:51:55.616925] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-16T19:51:55.617202] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-16T19:51:55.617254] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-16T19:51:55.943180] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-16T19:51:55.979884] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:51:56.008504] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T19:51:56.742792] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-16T19:51:57.066639] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-16T19:51:57.105814] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T19:51:57.542863] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-16T19:51:58.342783] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-16T19:51:58.474560] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T19:51:59.034050] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T19:51:59.142820] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-16T19:51:59.942827] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-16T19:52:00.148301] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T19:52:00.742822] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-16T19:52:00.885929] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T19:52:01.542851] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-16T19:52:01.664271] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T19:52:02.342788] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-16T19:52:02.576481] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T19:52:02.872556] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T19:52:03.142812] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-16T19:52:03.942789] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-16T19:52:04.050584] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-16T19:52:04.059993] [INFO ] [REMOTE ] KRG: Full fetch complete (71326 records). [2025-10-16T19:52:04.060123] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-16T19:52:04.460419] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-16T19:52:04.460507] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-16T19:52:04.461634] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-16T19:52:04.461723] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-16T19:52:04.463141] [DEBUG] [LOCAL ] KRG: Trimmed 71326 records to 49661 (keeping 200 days of data) [2025-10-16T19:52:04.752753] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-16T19:52:04.764212] [DEBUG] [LOCAL ] KRG: Primary data saved (49661 records). [2025-10-16T19:52:04.764373] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-16T19:52:04.764461] [INFO ] [MAIN ] Update Progress: 1220/2369 symbols completed. KRG took 37.8s. Estimated remaining: 2h 42m 0s. Rate: 7.1 symbols/min [2025-10-16T19:52:04.960603] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:52:04.996319] [DEBUG] [LOCAL ] KTB: Loaded 40516 existing records from primary storage. [2025-10-16T19:52:04.996610] [INFO ] [MAIN ] KTB: Loaded 40516 existing records. [2025-10-16T19:52:05.189460] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T19:52:05.192751] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:52:05.199698] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-16T19:52:05.200175] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-16T19:52:05.200395] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-16T19:52:05.200451] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-16T19:52:05.522560] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-16T19:52:05.548755] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-16T19:52:05.607714] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:52:06.349800] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-16T19:52:06.366782] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T19:52:06.484835] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T19:52:06.488453] [INFO ] [REMOTE ] KRO: Full fetch complete (35270 records). [2025-10-16T19:52:06.488532] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-16T19:52:06.856578] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-16T19:52:06.856674] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-16T19:52:06.857396] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-16T19:52:06.857437] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-16T19:52:06.858240] [DEBUG] [LOCAL ] KRO: Trimmed 35270 records to 26679 (keeping 200 days of data) [2025-10-16T19:52:07.006562] [DEBUG] [LOCAL ] KRO: Primary data saved (26679 records). [2025-10-16T19:52:07.006725] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-16T19:52:07.006816] [INFO ] [MAIN ] Update Progress: 1221/2369 symbols completed. KRO took 38.3s. Estimated remaining: 2h 41m 46s. Rate: 7.1 symbols/min [2025-10-16T19:52:07.145606] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-16T19:52:07.176384] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:52:07.189282] [DEBUG] [LOCAL ] KTF: Loaded 11799 existing records from primary storage. [2025-10-16T19:52:07.189489] [INFO ] [MAIN ] KTF: Loaded 11799 existing records. [2025-10-16T19:52:07.364148] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:52:07.364372] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-16T19:52:07.364426] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-16T19:52:07.364581] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-16T19:52:07.364635] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-16T19:52:07.713939] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:52:07.767380] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T19:52:07.942829] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-16T19:52:08.499011] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T19:52:08.742818] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-16T19:52:09.542786] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-16T19:52:10.034800] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-16T19:52:10.342786] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-16T19:52:10.459469] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T19:52:10.664474] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T19:52:11.142859] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-16T19:52:11.942833] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-16T19:52:12.378884] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-16T19:52:12.658737] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T19:52:12.742810] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-16T19:52:13.543326] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-16T19:52:13.543257] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T19:52:13.871099] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T19:52:14.129828] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-16T19:52:14.342860] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-16T19:52:15.142807] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-16T19:52:15.760681] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T19:52:15.942809] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-16T19:52:16.682799] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T19:52:16.742798] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-16T19:52:17.282511] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-16T19:52:17.542792] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-16T19:52:17.556027] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T19:52:18.342829] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-16T19:52:18.921328] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T19:52:18.940863] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T19:52:19.142806] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-16T19:52:19.942808] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-16T19:52:20.164297] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-16T19:52:20.742832] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-16T19:52:21.302793] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T19:52:21.542853] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-16T19:52:22.342794] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-16T19:52:22.856609] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-16T19:52:23.091477] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:52:23.142825] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-16T19:52:23.152090] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T19:52:23.942819] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-16T19:52:24.393045] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T19:52:24.742871] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-16T19:52:25.542838] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-16T19:52:25.924111] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T19:52:26.305170] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T19:52:26.342790] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-16T19:52:26.438934] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-16T19:52:27.142804] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-16T19:52:27.947825] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-16T19:52:27.959971] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T19:52:28.696226] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T19:52:28.742771] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-16T19:52:29.534952] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T19:52:29.541831] [INFO ] [REMOTE ] KSS: Full fetch complete (77755 records). [2025-10-16T19:52:29.541963] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-16T19:52:29.553890] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-16T19:52:29.933755] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-16T19:52:29.933849] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-16T19:52:29.934913] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-16T19:52:29.934975] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-16T19:52:29.936413] [DEBUG] [LOCAL ] KSS: Trimmed 77755 records to 53983 (keeping 200 days of data) [2025-10-16T19:52:30.258683] [DEBUG] [LOCAL ] KSS: Primary data saved (53983 records). [2025-10-16T19:52:30.258909] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-16T19:52:30.259492] [INFO ] [MAIN ] Update Progress: 1222/2369 symbols completed. KSS took 43.3s. Estimated remaining: 2h 41m 52s. Rate: 7.1 symbols/min [2025-10-16T19:52:30.350746] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-16T19:52:30.432813] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:52:30.433146] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-16T19:52:30.433199] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-16T19:52:30.455197] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-16T19:52:30.457934] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-16T19:52:30.458013] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-16T19:52:30.458057] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-16T19:52:30.524388] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T19:52:30.839135] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:52:31.018923] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-16T19:52:31.122136] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T19:52:31.129925] [INFO ] [REMOTE ] KT: Full fetch complete (66805 records). [2025-10-16T19:52:31.130048] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-16T19:52:31.150857] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-16T19:52:31.522331] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-16T19:52:31.522415] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-16T19:52:31.523423] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-16T19:52:31.523496] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-16T19:52:31.524834] [DEBUG] [LOCAL ] KT: Trimmed 66805 records to 45863 (keeping 200 days of data) [2025-10-16T19:52:31.796277] [DEBUG] [LOCAL ] KT: Primary data saved (45863 records). [2025-10-16T19:52:31.796419] [INFO ] [MAIN ] KT: Full history saved. [2025-10-16T19:52:31.796532] [INFO ] [MAIN ] Update Progress: 1223/2369 symbols completed. KT took 36.6s. Estimated remaining: 2h 41m 37s. Rate: 7.1 symbols/min [2025-10-16T19:52:31.945898] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-16T19:52:31.967293] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:52:32.017448] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-16T19:52:32.017779] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-16T19:52:32.189950] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:52:32.190203] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-16T19:52:32.190255] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-16T19:52:32.190959] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-16T19:52:32.191015] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-16T19:52:32.541138] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:52:32.748891] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-16T19:52:32.754061] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T19:52:32.782069] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T19:52:33.390666] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-16T19:52:33.542836] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-16T19:52:34.052683] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-16T19:52:34.342859] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-16T19:52:35.142827] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-16T19:52:35.882532] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T19:52:35.884039] [INFO ] [REMOTE ] KTF: Full fetch complete (17390 records). [2025-10-16T19:52:35.884107] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-16T19:52:35.951522] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-16T19:52:36.255878] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-16T19:52:36.291945] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-16T19:52:36.292034] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-16T19:52:36.292581] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-16T19:52:36.292697] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-16T19:52:36.293383] [DEBUG] [LOCAL ] KTF: Trimmed 17390 records to 11841 (keeping 200 days of data) [2025-10-16T19:52:36.383412] [DEBUG] [LOCAL ] KTF: Primary data saved (11841 records). [2025-10-16T19:52:36.383553] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-16T19:52:36.383629] [INFO ] [MAIN ] Update Progress: 1224/2369 symbols completed. KTF took 29.4s. Estimated remaining: 2h 41m 25s. Rate: 7.1 symbols/min [2025-10-16T19:52:36.547206] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:52:36.592202] [DEBUG] [LOCAL ] KVYO: Loaded 50785 existing records from primary storage. [2025-10-16T19:52:36.592502] [INFO ] [MAIN ] KVYO: Loaded 50785 existing records. [2025-10-16T19:52:36.745855] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-16T19:52:36.765125] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:52:36.765976] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-16T19:52:36.766025] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-16T19:52:36.766772] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-16T19:52:36.766829] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-16T19:52:37.117091] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:52:37.410677] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T19:52:37.415281] [INFO ] [REMOTE ] KTB: Full fetch complete (58245 records). [2025-10-16T19:52:37.415372] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-16T19:52:37.552705] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-16T19:52:37.796819] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-16T19:52:37.796890] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-16T19:52:37.797889] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-16T19:52:37.797952] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-16T19:52:37.799047] [DEBUG] [LOCAL ] KTB: Trimmed 58245 records to 40757 (keeping 200 days of data) [2025-10-16T19:52:38.041462] [DEBUG] [LOCAL ] KTB: Primary data saved (40757 records). [2025-10-16T19:52:38.041588] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-16T19:52:38.041701] [INFO ] [MAIN ] Update Progress: 1225/2369 symbols completed. KTB took 33.3s. Estimated remaining: 2h 41m 10s. Rate: 7.1 symbols/min [2025-10-16T19:52:38.210980] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:52:38.244809] [DEBUG] [LOCAL ] KW: Loaded 40511 existing records from primary storage. [2025-10-16T19:52:38.245079] [INFO ] [MAIN ] KW: Loaded 40511 existing records. [2025-10-16T19:52:38.345132] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-16T19:52:38.429724] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:52:38.430243] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-16T19:52:38.430365] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-16T19:52:38.431314] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-16T19:52:38.431387] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-16T19:52:38.746957] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-16T19:52:38.834418] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:52:39.142768] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-16T19:52:39.297414] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T19:52:39.381044] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-16T19:52:39.942794] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-16T19:52:40.742843] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-16T19:52:40.885087] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T19:52:40.920774] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T19:52:41.542836] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-16T19:52:42.356261] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-16T19:52:42.359442] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T19:52:43.142815] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-16T19:52:43.381470] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T19:52:43.678783] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T19:52:43.942815] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-16T19:52:44.080077] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-16T19:52:44.742828] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-16T19:52:45.358434] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T19:52:45.542824] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-16T19:52:46.342838] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-16T19:52:46.710100] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T19:52:47.142817] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-16T19:52:47.190435] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:52:47.468292] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T19:52:47.942814] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-16T19:52:48.742799] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-16T19:52:49.013598] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T19:52:49.201952] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-16T19:52:49.542690] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-16T19:52:49.542796] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-16T19:52:50.342848] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-16T19:52:51.142817] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-16T19:52:51.360952] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T19:52:51.942869] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-16T19:52:52.236775] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T19:52:52.448796] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T19:52:52.742853] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-16T19:52:53.189475] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-16T19:52:53.542856] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-16T19:52:53.607058] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T19:52:54.342827] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-16T19:52:54.725612] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T19:52:55.142798] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-16T19:52:55.942779] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-16T19:52:56.129838] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T19:52:56.195380] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T19:52:56.742875] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-16T19:52:57.156826] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T19:52:57.548135] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-16T19:52:57.553966] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T19:52:57.928160] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-16T19:52:58.342816] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-16T19:52:58.978589] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T19:52:59.142861] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-16T19:52:59.942829] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-16T19:52:59.953581] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T19:53:00.742829] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-16T19:53:01.547936] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-16T19:53:01.561993] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T19:53:02.342822] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-16T19:53:02.700261] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-16T19:53:03.142798] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-16T19:53:03.312788] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T19:53:03.364003] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T19:53:03.365971] [INFO ] [REMOTE ] KUKE: Full fetch complete (8938 records). [2025-10-16T19:53:03.366053] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-16T19:53:03.546335] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T19:53:03.546616] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:53:03.546701] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:53:03.546776] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-16T19:53:03.546849] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-16T19:53:03.546904] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-16T19:53:03.546946] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-16T19:53:03.547002] [INFO ] [MAIN ] Update Progress: 1226/2369 symbols completed. KUKE took 33.3s. Estimated remaining: 2h 41m 17s. Rate: 7.1 symbols/min [2025-10-16T19:53:03.726547] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:53:03.744547] [DEBUG] [LOCAL ] KWR: Loaded 16108 existing records from primary storage. [2025-10-16T19:53:03.744838] [INFO ] [MAIN ] KWR: Loaded 16108 existing records. [2025-10-16T19:53:03.934853] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:53:03.935064] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-16T19:53:03.935112] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-16T19:53:03.935827] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-16T19:53:03.935888] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-16T19:53:03.947938] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-16T19:53:04.293756] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:53:04.502561] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T19:53:04.742860] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-16T19:53:05.542838] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-16T19:53:05.724219] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T19:53:06.261967] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T19:53:06.342814] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-16T19:53:06.371607] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T19:53:07.142815] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-16T19:53:07.696018] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T19:53:07.756313] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T19:53:07.942824] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-16T19:53:08.742836] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-16T19:53:09.334397] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T19:53:09.542865] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-16T19:53:09.729531] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T19:53:09.736592] [INFO ] [REMOTE ] KVUE: Full fetch complete (77842 records). [2025-10-16T19:53:09.736752] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-16T19:53:10.131525] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-16T19:53:10.131596] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-16T19:53:10.132758] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-16T19:53:10.132823] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-16T19:53:10.134400] [DEBUG] [LOCAL ] KVUE: Trimmed 77842 records to 54057 (keeping 200 days of data) [2025-10-16T19:53:10.337676] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-16T19:53:10.364242] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-16T19:53:10.492329] [DEBUG] [LOCAL ] KVUE: Primary data saved (54057 records). [2025-10-16T19:53:10.492476] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-16T19:53:10.493464] [INFO ] [MAIN ] Update Progress: 1227/2369 symbols completed. KVUE took 38.7s. Estimated remaining: 2h 41m 7s. Rate: 7.1 symbols/min [2025-10-16T19:53:10.665610] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:53:10.699912] [DEBUG] [LOCAL ] KYN: Loaded 30275 existing records from primary storage. [2025-10-16T19:53:10.700159] [INFO ] [MAIN ] KYN: Loaded 30275 existing records. [2025-10-16T19:53:10.895944] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:53:10.896173] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-16T19:53:10.896219] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-16T19:53:10.896523] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-16T19:53:10.896578] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-16T19:53:11.147899] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-16T19:53:11.249203] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:53:11.942787] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-16T19:53:12.185955] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T19:53:12.248836] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T19:53:12.742813] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-16T19:53:13.435274] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T19:53:13.440908] [INFO ] [REMOTE ] KW: Full fetch complete (57270 records). [2025-10-16T19:53:13.441081] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-16T19:53:13.547900] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-16T19:53:13.830583] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-16T19:53:13.830706] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-16T19:53:13.831740] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-16T19:53:13.831806] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-16T19:53:13.833136] [DEBUG] [LOCAL ] KW: Trimmed 57270 records to 40783 (keeping 200 days of data) [2025-10-16T19:53:14.065606] [DEBUG] [LOCAL ] KW: Primary data saved (40783 records). [2025-10-16T19:53:14.065761] [INFO ] [MAIN ] KW: Full history saved. [2025-10-16T19:53:14.065843] [INFO ] [MAIN ] Update Progress: 1228/2369 symbols completed. KW took 36.0s. Estimated remaining: 2h 40m 54s. Rate: 7.1 symbols/min [2025-10-16T19:53:14.231523] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:53:14.268693] [DEBUG] [LOCAL ] L: Loaded 41169 existing records from primary storage. [2025-10-16T19:53:14.268987] [INFO ] [MAIN ] L: Loaded 41169 existing records. [2025-10-16T19:53:14.358409] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-16T19:53:14.453088] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:53:14.453388] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-16T19:53:14.453444] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-16T19:53:14.453632] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-16T19:53:14.453714] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-16T19:53:14.813943] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:53:14.838928] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-16T19:53:14.839992] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T19:53:14.851396] [INFO ] [REMOTE ] KVYO: Full fetch complete (72072 records). [2025-10-16T19:53:14.851501] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-16T19:53:15.146181] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-16T19:53:15.240895] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-16T19:53:15.240970] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-16T19:53:15.242062] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-16T19:53:15.242124] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-16T19:53:15.243515] [DEBUG] [LOCAL ] KVYO: Trimmed 72072 records to 51171 (keeping 200 days of data) [2025-10-16T19:53:15.541460] [DEBUG] [LOCAL ] KVYO: Primary data saved (51171 records). [2025-10-16T19:53:15.541612] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-16T19:53:15.542240] [INFO ] [MAIN ] Update Progress: 1229/2369 symbols completed. KVYO took 39.2s. Estimated remaining: 2h 40m 39s. Rate: 7.1 symbols/min [2025-10-16T19:53:15.714039] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:53:15.761021] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T19:53:15.785005] [DEBUG] [LOCAL ] LAC: Loaded 52510 existing records from primary storage. [2025-10-16T19:53:15.785313] [INFO ] [MAIN ] LAC: Loaded 52510 existing records. [2025-10-16T19:53:15.956176] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-16T19:53:15.986992] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:53:15.988041] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-16T19:53:15.988092] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-16T19:53:15.988933] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-16T19:53:15.988990] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-16T19:53:16.362758] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T19:53:16.361729] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:53:16.742778] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-16T19:53:17.520207] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T19:53:17.542773] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-16T19:53:17.575612] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T19:53:18.342856] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-16T19:53:19.142782] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-16T19:53:19.498291] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-16T19:53:19.611884] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T19:53:19.942767] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-16T19:53:20.087328] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T19:53:20.742824] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-16T19:53:21.542785] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-16T19:53:21.885447] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-16T19:53:22.257302] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T19:53:22.342792] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-16T19:53:22.587012] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-16T19:53:23.142874] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-16T19:53:23.947990] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-16T19:53:23.965058] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T19:53:24.444849] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T19:53:24.742855] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-16T19:53:25.500318] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T19:53:25.542872] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-16T19:53:25.632357] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T19:53:26.342816] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-16T19:53:26.803784] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-16T19:53:27.142872] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-16T19:53:27.345857] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T19:53:27.347980] [INFO ] [REMOTE ] KWR: Full fetch complete (23487 records). [2025-10-16T19:53:27.348111] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-16T19:53:27.777673] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-16T19:53:27.777766] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-16T19:53:27.778322] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-16T19:53:27.778364] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-16T19:53:27.779174] [DEBUG] [LOCAL ] KWR: Trimmed 23487 records to 16172 (keeping 200 days of data) [2025-10-16T19:53:27.881112] [DEBUG] [LOCAL ] KWR: Primary data saved (16172 records). [2025-10-16T19:53:27.881263] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-16T19:53:27.881348] [INFO ] [MAIN ] Update Progress: 1230/2369 symbols completed. KWR took 24.3s. Estimated remaining: 2h 40m 34s. Rate: 7.1 symbols/min [2025-10-16T19:53:27.947964] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-16T19:53:28.053314] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:53:28.076410] [DEBUG] [LOCAL ] LAD: Loaded 23378 existing records from primary storage. [2025-10-16T19:53:28.076680] [INFO ] [MAIN ] LAD: Loaded 23378 existing records. [2025-10-16T19:53:28.247911] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:53:28.248146] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-16T19:53:28.248244] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-16T19:53:28.248475] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-16T19:53:28.248529] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-16T19:53:28.608596] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:53:28.742783] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-16T19:53:28.937157] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T19:53:29.349566] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T19:53:29.542874] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-16T19:53:30.342840] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-16T19:53:30.392331] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:53:30.444965] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T19:53:31.142801] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-16T19:53:31.446522] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T19:53:31.942796] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-16T19:53:32.400291] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T19:53:32.742921] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-16T19:53:33.501531] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T19:53:33.542852] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-16T19:53:34.088092] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T19:53:34.342815] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-16T19:53:34.718511] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T19:53:35.142806] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-16T19:53:35.375463] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T19:53:35.942826] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-16T19:53:36.689505] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:53:36.742787] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-16T19:53:37.176614] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-16T19:53:37.542827] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-16T19:53:38.159016] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T19:53:38.343395] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T19:53:38.342830] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-16T19:53:39.142814] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-16T19:53:39.942828] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-16T19:53:40.348293] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-16T19:53:40.556295] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T19:53:40.742786] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-16T19:53:41.059351] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T19:53:41.542868] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-16T19:53:41.721448] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T19:53:41.725824] [INFO ] [REMOTE ] KYN: Full fetch complete (44560 records). [2025-10-16T19:53:41.725949] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-16T19:53:42.132031] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-16T19:53:42.132144] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-16T19:53:42.133023] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-16T19:53:42.133088] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-16T19:53:42.134164] [DEBUG] [LOCAL ] KYN: Trimmed 44560 records to 30494 (keeping 200 days of data) [2025-10-16T19:53:42.317658] [DEBUG] [LOCAL ] KYN: Primary data saved (30494 records). [2025-10-16T19:53:42.317802] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-16T19:53:42.317882] [INFO ] [MAIN ] Update Progress: 1231/2369 symbols completed. KYN took 31.8s. Estimated remaining: 2h 40m 32s. Rate: 7.1 symbols/min [2025-10-16T19:53:42.347961] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-16T19:53:42.487045] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:53:42.523863] [DEBUG] [LOCAL ] LADR: Loaded 39396 existing records from primary storage. [2025-10-16T19:53:42.524138] [INFO ] [MAIN ] LADR: Loaded 39396 existing records. [2025-10-16T19:53:42.700165] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:53:42.700425] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-16T19:53:42.700478] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-16T19:53:42.700765] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-16T19:53:42.700821] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-16T19:53:43.074706] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-16T19:53:43.080055] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:53:43.142809] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-16T19:53:43.870810] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T19:53:43.942792] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-16T19:53:44.583222] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T19:53:44.742826] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-16T19:53:45.297591] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T19:53:45.542852] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-16T19:53:46.018612] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T19:53:46.024173] [INFO ] [REMOTE ] L: Full fetch complete (59496 records). [2025-10-16T19:53:46.024351] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-16T19:53:46.354515] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-16T19:53:46.413612] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-16T19:53:46.413718] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-16T19:53:46.414637] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-16T19:53:46.414719] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-16T19:53:46.416106] [DEBUG] [LOCAL ] L: Trimmed 59496 records to 41525 (keeping 200 days of data) [2025-10-16T19:53:46.665466] [DEBUG] [LOCAL ] L: Primary data saved (41525 records). [2025-10-16T19:53:46.665585] [INFO ] [MAIN ] L: Full history saved. [2025-10-16T19:53:46.665683] [INFO ] [MAIN ] Update Progress: 1232/2369 symbols completed. L took 32.6s. Estimated remaining: 2h 40m 19s. Rate: 7.1 symbols/min [2025-10-16T19:53:46.837880] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:53:46.842287] [DEBUG] [LOCAL ] LANV: Loaded 2784 existing records from primary storage. [2025-10-16T19:53:46.842477] [INFO ] [MAIN ] LANV: Loaded 2784 existing records. [2025-10-16T19:53:47.024594] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T19:53:47.045212] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:53:47.053683] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-16T19:53:47.053956] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-16T19:53:47.054164] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-16T19:53:47.054217] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-16T19:53:47.144724] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-16T19:53:47.431436] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T19:53:47.442335] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:53:47.942847] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-16T19:53:48.407921] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T19:53:48.742830] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-16T19:53:49.297531] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-16T19:53:49.542810] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-16T19:53:49.632785] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T19:53:50.342815] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-16T19:53:50.519787] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-16T19:53:50.667447] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-16T19:53:51.142825] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-16T19:53:51.578017] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T19:53:51.942825] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-16T19:53:52.742879] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-16T19:53:53.542808] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-16T19:53:53.803841] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-16T19:53:53.917569] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T19:53:54.344848] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-16T19:53:54.346824] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T19:53:55.142844] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-16T19:53:55.799974] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T19:53:55.942811] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-16T19:53:56.742819] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-16T19:53:57.245789] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-16T19:53:57.250380] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-16T19:53:57.277681] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T19:53:57.542827] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-16T19:53:57.965567] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-16T19:53:58.342832] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-16T19:53:58.763409] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-16T19:53:59.142814] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-16T19:53:59.942827] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-16T19:54:00.525728] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T19:54:00.742829] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-16T19:54:01.145303] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-16T19:54:01.542806] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-16T19:54:02.342878] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-16T19:54:02.970478] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T19:54:02.973725] [INFO ] [REMOTE ] LAD: Full fetch complete (35383 records). [2025-10-16T19:54:02.973813] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-16T19:54:03.129557] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-16T19:54:03.163130] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-16T19:54:03.400793] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-16T19:54:03.400879] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-16T19:54:03.401691] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-16T19:54:03.401755] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-16T19:54:03.402636] [DEBUG] [LOCAL ] LAD: Trimmed 35383 records to 23491 (keeping 200 days of data) [2025-10-16T19:54:03.548268] [DEBUG] [LOCAL ] LAD: Primary data saved (23491 records). [2025-10-16T19:54:03.548414] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-16T19:54:03.548508] [INFO ] [MAIN ] Update Progress: 1233/2369 symbols completed. LAD took 35.7s. Estimated remaining: 2h 40m 19s. Rate: 7.1 symbols/min [2025-10-16T19:54:03.715808] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:54:03.715963] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-16T19:54:03.716002] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-16T19:54:03.716112] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-16T19:54:03.716154] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-16T19:54:03.716197] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-16T19:54:03.716232] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-16T19:54:03.926546] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T19:54:03.948043] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-16T19:54:04.089295] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:54:04.110049] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T19:54:04.742813] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-16T19:54:05.542822] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-16T19:54:05.999278] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T19:54:06.244826] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-16T19:54:06.343958] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-16T19:54:06.343814] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T19:54:06.902233] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-16T19:54:07.142809] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-16T19:54:07.324840] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:54:07.325177] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-16T19:54:07.325269] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:54:07.325316] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-16T19:54:07.325375] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:54:07.325447] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-16T19:54:07.325510] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-16T19:54:07.325546] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-16T19:54:07.325584] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-16T19:54:07.325628] [INFO ] [MAIN ] Update Progress: 1234/2369 symbols completed. LAR took 3.8s. Estimated remaining: 2h 40m 6s. Rate: 7.1 symbols/min [2025-10-16T19:54:07.499275] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:54:07.515479] [DEBUG] [LOCAL ] LAW: Loaded 14653 existing records from primary storage. [2025-10-16T19:54:07.515808] [INFO ] [MAIN ] LAW: Loaded 14653 existing records. [2025-10-16T19:54:07.698539] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:54:07.698846] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-16T19:54:07.698895] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-16T19:54:07.699089] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-16T19:54:07.699148] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-16T19:54:07.947991] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-16T19:54:08.057725] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:54:08.742859] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-16T19:54:09.373702] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-16T19:54:09.408419] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T19:54:09.542798] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-16T19:54:10.185199] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T19:54:10.186180] [INFO ] [REMOTE ] LANV: Full fetch complete (4286 records). [2025-10-16T19:54:10.186252] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-16T19:54:10.355839] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-16T19:54:10.542496] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-16T19:54:10.542583] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-16T19:54:10.542747] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-16T19:54:10.542809] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-16T19:54:10.543221] [DEBUG] [LOCAL ] LANV: Trimmed 4286 records to 2789 (keeping 200 days of data) [2025-10-16T19:54:10.559237] [DEBUG] [LOCAL ] LANV: Primary data saved (2789 records). [2025-10-16T19:54:10.559377] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-16T19:54:10.559468] [INFO ] [MAIN ] Update Progress: 1235/2369 symbols completed. LANV took 23.9s. Estimated remaining: 2h 39m 53s. Rate: 7.1 symbols/min [2025-10-16T19:54:10.729371] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:54:10.769733] [DEBUG] [LOCAL ] LAZ: Loaded 44741 existing records from primary storage. [2025-10-16T19:54:10.770102] [INFO ] [MAIN ] LAZ: Loaded 44741 existing records. [2025-10-16T19:54:10.944298] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:54:10.944516] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-16T19:54:10.944564] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-16T19:54:10.944898] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-16T19:54:10.944957] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-16T19:54:11.151523] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-16T19:54:11.297950] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:54:11.942818] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-16T19:54:12.695345] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T19:54:12.742836] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-16T19:54:12.877513] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-16T19:54:12.991788] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.64 seconds). [2025-10-16T19:54:12.999057] [INFO ] [REMOTE ] LAC: Full fetch complete (76129 records). [2025-10-16T19:54:12.999192] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-16T19:54:13.444239] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-16T19:54:13.444333] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-16T19:54:13.445454] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-16T19:54:13.445517] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-16T19:54:13.447076] [DEBUG] [LOCAL ] LAC: Trimmed 76129 records to 52900 (keeping 200 days of data) [2025-10-16T19:54:13.554888] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-16T19:54:13.744283] [DEBUG] [LOCAL ] LAC: Primary data saved (52900 records). [2025-10-16T19:54:13.744425] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-16T19:54:13.744979] [INFO ] [MAIN ] Update Progress: 1236/2369 symbols completed. LAC took 58.2s. Estimated remaining: 2h 39m 39s. Rate: 7.1 symbols/min [2025-10-16T19:54:13.918788] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:54:13.948766] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-16T19:54:13.984288] [DEBUG] [LOCAL ] LB: Loaded 37383 existing records from primary storage. [2025-10-16T19:54:13.984573] [INFO ] [MAIN ] LB: Loaded 37383 existing records. [2025-10-16T19:54:14.158087] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:54:14.158299] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-16T19:54:14.158347] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-16T19:54:14.158585] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-16T19:54:14.158675] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-16T19:54:14.332334] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T19:54:14.344301] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-16T19:54:14.557402] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:54:15.142800] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-16T19:54:15.782112] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T19:54:15.787452] [INFO ] [REMOTE ] LADR: Full fetch complete (55722 records). [2025-10-16T19:54:15.787559] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-16T19:54:15.947945] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-16T19:54:16.224257] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-16T19:54:16.224514] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-16T19:54:16.225717] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-16T19:54:16.225899] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-16T19:54:16.227384] [DEBUG] [LOCAL ] LADR: Trimmed 55722 records to 39688 (keeping 200 days of data) [2025-10-16T19:54:16.497182] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T19:54:16.541292] [DEBUG] [LOCAL ] LADR: Primary data saved (39688 records). [2025-10-16T19:54:16.541449] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-16T19:54:16.541550] [INFO ] [MAIN ] Update Progress: 1237/2369 symbols completed. LADR took 34.2s. Estimated remaining: 2h 39m 26s. Rate: 7.1 symbols/min [2025-10-16T19:54:16.742809] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-16T19:54:17.363351] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T19:54:17.542803] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-16T19:54:18.126896] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T19:54:18.342781] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-16T19:54:18.499807] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T19:54:19.142884] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-16T19:54:19.860582] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T19:54:19.942806] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-16T19:54:19.982223] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T19:54:20.742812] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-16T19:54:21.542851] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-16T19:54:21.615174] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T19:54:22.313577] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T19:54:22.312422] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T19:54:22.342764] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-16T19:54:23.142862] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-16T19:54:23.839351] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T19:54:23.942770] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-16T19:54:24.668842] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T19:54:24.742801] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-16T19:54:25.491022] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T19:54:25.542771] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-16T19:54:26.222560] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T19:54:26.342843] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-16T19:54:26.646099] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T19:54:26.929400] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T19:54:27.142841] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-16T19:54:27.942813] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-16T19:54:28.559433] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T19:54:28.742823] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-16T19:54:28.848248] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-16T19:54:29.542854] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-16T19:54:30.190374] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T19:54:30.342829] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-16T19:54:30.434611] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-16T19:54:31.142831] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-16T19:54:31.935911] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T19:54:31.949562] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-16T19:54:32.742819] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-16T19:54:32.793477] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T19:54:32.960452] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T19:54:33.542859] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-16T19:54:33.947551] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T19:54:34.342888] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-16T19:54:34.472987] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T19:54:35.142845] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-16T19:54:35.517708] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-16T19:54:35.942815] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-16T19:54:36.668863] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T19:54:36.742789] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-16T19:54:36.914115] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T19:54:36.916911] [INFO ] [REMOTE ] LAW: Full fetch complete (20872 records). [2025-10-16T19:54:36.916990] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-16T19:54:37.286043] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-16T19:54:37.286124] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-16T19:54:37.286595] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-16T19:54:37.286636] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-16T19:54:37.287247] [DEBUG] [LOCAL ] LAW: Trimmed 20872 records to 14781 (keeping 200 days of data) [2025-10-16T19:54:37.368047] [DEBUG] [LOCAL ] LAW: Primary data saved (14781 records). [2025-10-16T19:54:37.368189] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-16T19:54:37.368274] [INFO ] [MAIN ] Update Progress: 1238/2369 symbols completed. LAW took 30.0s. Estimated remaining: 2h 39m 28s. Rate: 7.1 symbols/min [2025-10-16T19:54:37.542827] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-16T19:54:38.126572] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T19:54:38.342797] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-16T19:54:38.712069] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T19:54:38.717034] [INFO ] [REMOTE ] LB: Full fetch complete (56009 records). [2025-10-16T19:54:38.717129] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-16T19:54:39.144182] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-16T19:54:39.144271] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-16T19:54:39.145534] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-16T19:54:39.145669] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-16T19:54:39.147014] [DEBUG] [LOCAL ] LB: Trimmed 56009 records to 37609 (keeping 200 days of data) [2025-10-16T19:54:39.396009] [DEBUG] [LOCAL ] LB: Primary data saved (37609 records). [2025-10-16T19:54:39.396152] [INFO ] [MAIN ] LB: Full history saved. [2025-10-16T19:54:39.396763] [INFO ] [MAIN ] Update Progress: 1239/2369 symbols completed. LB took 25.7s. Estimated remaining: 2h 39m 14s. Rate: 7.1 symbols/min [2025-10-16T19:54:39.809222] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T19:54:39.814501] [INFO ] [REMOTE ] LAZ: Full fetch complete (65611 records). [2025-10-16T19:54:39.814614] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-16T19:54:40.199484] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-16T19:54:40.199577] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-16T19:54:40.200569] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-16T19:54:40.200636] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-16T19:54:40.202013] [DEBUG] [LOCAL ] LAZ: Trimmed 65611 records to 44986 (keeping 200 days of data) [2025-10-16T19:54:40.473784] [DEBUG] [LOCAL ] LAZ: Primary data saved (44986 records). [2025-10-16T19:54:40.473926] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-16T19:54:40.474005] [INFO ] [MAIN ] Update Progress: 1240/2369 symbols completed. LAZ took 29.9s. Estimated remaining: 2h 38m 59s. Rate: 7.1 symbols/min [2025-10-16T19:54:41.114146] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:54:41.177419] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:54:41.198142] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:54:41.199731] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:54:41.250148] [DEBUG] [LOCAL ] LCII: Loaded 27437 existing records from primary storage. [2025-10-16T19:54:41.264598] [INFO ] [MAIN ] LCII: Loaded 27437 existing records. [2025-10-16T19:54:41.416489] [DEBUG] [LOCAL ] LDI: Loaded 44806 existing records from primary storage. [2025-10-16T19:54:41.415886] [DEBUG] [LOCAL ] LBRT: Loaded 52959 existing records from primary storage. [2025-10-16T19:54:41.438244] [INFO ] [MAIN ] LDI: Loaded 44806 existing records. [2025-10-16T19:54:41.427591] [DEBUG] [LOCAL ] LC: Loaded 48164 existing records from primary storage. [2025-10-16T19:54:41.443947] [INFO ] [MAIN ] LC: Loaded 48164 existing records. [2025-10-16T19:54:41.464337] [INFO ] [MAIN ] LBRT: Loaded 52959 existing records. [2025-10-16T19:54:41.699013] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:54:41.803250] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-16T19:54:41.808631] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-16T19:54:41.921121] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-16T19:54:41.955364] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-16T19:54:41.973458] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:54:42.092402] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-16T19:54:42.133527] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:54:42.183973] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-16T19:54:42.197734] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-16T19:54:42.192533] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:54:42.225504] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-16T19:54:42.197839] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-16T19:54:42.225610] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-16T19:54:42.225855] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-16T19:54:42.225992] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-16T19:54:42.237404] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-16T19:54:42.246795] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-16T19:54:42.247221] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-16T19:54:42.237604] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-16T19:54:43.338476] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:54:43.427816] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-16T19:54:43.555823] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:54:43.567294] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-16T19:54:43.615846] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:54:43.636435] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-16T19:54:43.679412] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:54:43.679971] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-16T19:54:44.583472] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T19:54:44.588145] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-16T19:54:45.058758] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T19:54:45.067403] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-16T19:54:45.156791] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T19:54:45.167203] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-16T19:54:45.384853] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T19:54:45.395305] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-16T19:54:45.410098] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T19:54:45.542777] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-16T19:54:46.185088] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T19:54:46.342779] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-16T19:54:46.667638] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T19:54:46.836941] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T19:54:46.993494] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T19:54:47.142818] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-16T19:54:47.262254] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T19:54:47.942858] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-16T19:54:48.441696] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T19:54:48.742833] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-16T19:54:49.043960] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T19:54:49.542815] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-16T19:54:50.351397] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-16T19:54:50.356725] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T19:54:51.142827] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-16T19:54:51.198303] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T19:54:51.856692] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T19:54:51.942785] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-16T19:54:52.742816] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-16T19:54:53.542939] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-16T19:54:54.329531] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T19:54:54.342763] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-16T19:54:54.982879] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T19:54:55.142780] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-16T19:54:55.613211] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-16T19:54:55.942823] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-16T19:54:56.086577] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (4.94 seconds). [2025-10-16T19:54:56.742845] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-16T19:54:56.881799] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T19:54:56.914033] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (4.97 seconds). [2025-10-16T19:54:56.936288] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T19:54:57.542851] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-16T19:54:58.342838] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-16T19:54:58.482531] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T19:54:59.147916] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-16T19:54:59.165413] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T19:54:59.249574] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-16T19:54:59.942819] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-16T19:55:00.592246] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T19:55:00.742777] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-16T19:55:01.207040] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T19:55:01.542884] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-16T19:55:02.260145] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T19:55:02.342811] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-16T19:55:02.709485] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-16T19:55:03.142848] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-16T19:55:03.942820] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-16T19:55:04.413303] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-16T19:55:04.742815] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-16T19:55:05.042893] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-16T19:55:05.174923] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-16T19:55:05.542777] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-16T19:55:05.775130] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T19:55:06.342813] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-16T19:55:07.119631] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T19:55:07.142785] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-16T19:55:07.942801] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-16T19:55:08.742830] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-16T19:55:08.919750] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-16T19:55:09.219575] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T19:55:09.224672] [INFO ] [REMOTE ] LCII: Full fetch complete (39158 records). [2025-10-16T19:55:09.224871] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-16T19:55:09.552437] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-16T19:55:09.602800] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-16T19:55:09.603004] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-16T19:55:09.603987] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-16T19:55:09.604068] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-16T19:55:09.605458] [DEBUG] [LOCAL ] LCII: Trimmed 39158 records to 27611 (keeping 200 days of data) [2025-10-16T19:55:09.728886] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-16T19:55:09.820804] [DEBUG] [LOCAL ] LCII: Primary data saved (27611 records). [2025-10-16T19:55:09.820962] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-16T19:55:09.821050] [INFO ] [MAIN ] Update Progress: 1241/2369 symbols completed. LCII took 29.3s. Estimated remaining: 2h 39m 9s. Rate: 7.1 symbols/min [2025-10-16T19:55:09.992297] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:55:10.033609] [DEBUG] [LOCAL ] LDOS: Loaded 44998 existing records from primary storage. [2025-10-16T19:55:10.033916] [INFO ] [MAIN ] LDOS: Loaded 44998 existing records. [2025-10-16T19:55:10.208738] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:55:10.208995] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-16T19:55:10.209143] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-16T19:55:10.209397] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-16T19:55:10.209453] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-16T19:55:10.345814] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-16T19:55:10.602561] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-16T19:55:10.614884] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:55:11.142828] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-16T19:55:11.563683] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T19:55:11.942922] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-16T19:55:12.275285] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-16T19:55:12.282128] [INFO ] [REMOTE ] LDI: Full fetch complete (61828 records). [2025-10-16T19:55:12.282279] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-16T19:55:12.682602] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-16T19:55:12.682818] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-16T19:55:12.683802] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-16T19:55:12.683866] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-16T19:55:12.685163] [DEBUG] [LOCAL ] LDI: Trimmed 61828 records to 45194 (keeping 200 days of data) [2025-10-16T19:55:12.768426] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-16T19:55:12.953110] [DEBUG] [LOCAL ] LDI: Primary data saved (45194 records). [2025-10-16T19:55:12.962882] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-16T19:55:12.963556] [INFO ] [MAIN ] Update Progress: 1242/2369 symbols completed. LDI took 32.5s. Estimated remaining: 2h 38m 56s. Rate: 7.1 symbols/min [2025-10-16T19:55:13.040134] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-16T19:55:13.143342] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:55:13.158496] [DEBUG] [LOCAL ] LDP: Loaded 12815 existing records from primary storage. [2025-10-16T19:55:13.158752] [INFO ] [MAIN ] LDP: Loaded 12815 existing records. [2025-10-16T19:55:13.338351] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:55:13.338586] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-16T19:55:13.338637] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-16T19:55:13.338856] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-16T19:55:13.338911] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-16T19:55:13.548054] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-16T19:55:13.716854] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T19:55:13.729737] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:55:14.342828] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-16T19:55:14.504696] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T19:55:15.142837] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-16T19:55:15.443943] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-16T19:55:15.942847] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-16T19:55:16.306526] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T19:55:16.313004] [INFO ] [REMOTE ] LC: Full fetch complete (70679 records). [2025-10-16T19:55:16.313147] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-16T19:55:16.697773] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-16T19:55:16.697845] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-16T19:55:16.698844] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-16T19:55:16.698906] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-16T19:55:16.700164] [DEBUG] [LOCAL ] LC: Trimmed 70679 records to 48551 (keeping 200 days of data) [2025-10-16T19:55:16.747539] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-16T19:55:17.001896] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-16T19:55:17.002583] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:55:17.016256] [INFO ] [REMOTE ] LBRT: Full fetch complete (76898 records). [2025-10-16T19:55:17.017017] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-16T19:55:17.096025] [DEBUG] [LOCAL ] LC: Primary data saved (48551 records). [2025-10-16T19:55:17.106990] [INFO ] [MAIN ] LC: Full history saved. [2025-10-16T19:55:17.126157] [INFO ] [MAIN ] Update Progress: 1243/2369 symbols completed. LC took 36.7s. Estimated remaining: 2h 38m 44s. Rate: 7.1 symbols/min [2025-10-16T19:55:17.477289] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:55:17.549113] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-16T19:55:17.598142] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-16T19:55:17.598319] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-16T19:55:17.599388] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-16T19:55:17.600859] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-16T19:55:17.602678] [DEBUG] [LOCAL ] LBRT: Trimmed 76898 records to 53348 (keeping 200 days of data) [2025-10-16T19:55:17.740339] [DEBUG] [LOCAL ] LEA: Loaded 41359 existing records from primary storage. [2025-10-16T19:55:17.746260] [INFO ] [MAIN ] LEA: Loaded 41359 existing records. [2025-10-16T19:55:18.042259] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:55:18.048532] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-16T19:55:18.049022] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-16T19:55:18.053248] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-16T19:55:18.053321] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-16T19:55:18.285013] [DEBUG] [LOCAL ] LBRT: Primary data saved (53348 records). [2025-10-16T19:55:18.310513] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-16T19:55:18.320125] [INFO ] [MAIN ] Update Progress: 1244/2369 symbols completed. LBRT took 37.8s. Estimated remaining: 2h 38m 29s. Rate: 7.1 symbols/min [2025-10-16T19:55:18.618902] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T19:55:18.643296] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:55:18.634823] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-16T19:55:18.694135] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:55:18.722315] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-16T19:55:18.771453] [DEBUG] [LOCAL ] LEG: Loaded 50170 existing records from primary storage. [2025-10-16T19:55:18.771825] [INFO ] [MAIN ] LEG: Loaded 50170 existing records. [2025-10-16T19:55:18.948849] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:55:18.949095] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-16T19:55:18.949180] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-16T19:55:18.949538] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-16T19:55:18.949597] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-16T19:55:19.151940] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-16T19:55:19.299163] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:55:19.480688] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-16T19:55:19.942807] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-16T19:55:20.742892] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-16T19:55:20.906275] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T19:55:21.542870] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-16T19:55:21.599820] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T19:55:21.631087] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-16T19:55:22.342868] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-16T19:55:23.142820] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-16T19:55:23.320010] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T19:55:23.952706] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-16T19:55:23.957676] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T19:55:24.017022] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-16T19:55:24.742816] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-16T19:55:25.151421] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T19:55:25.319221] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T19:55:25.542886] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-16T19:55:26.342837] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-16T19:55:27.144070] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-16T19:55:27.160201] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T19:55:27.942823] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-16T19:55:28.015033] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T19:55:28.650514] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T19:55:28.742780] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-16T19:55:29.372006] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T19:55:29.542791] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-16T19:55:30.279300] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T19:55:30.342808] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-16T19:55:31.142799] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-16T19:55:31.182530] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T19:55:31.935547] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T19:55:31.944545] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-16T19:55:32.542566] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T19:55:32.742794] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-16T19:55:33.542795] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-16T19:55:33.621533] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T19:55:33.661353] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T19:55:34.342809] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-16T19:55:35.093607] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T19:55:35.142793] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-16T19:55:35.251426] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-16T19:55:35.942858] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-16T19:55:36.742850] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-16T19:55:36.812043] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T19:55:37.388144] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T19:55:37.532404] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T19:55:37.542757] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-16T19:55:38.342829] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-16T19:55:38.395993] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-16T19:55:39.142811] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-16T19:55:39.909816] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-16T19:55:39.912671] [INFO ] [REMOTE ] LDP: Full fetch complete (18973 records). [2025-10-16T19:55:39.912762] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-16T19:55:39.951865] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-16T19:55:40.322048] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-16T19:55:40.363766] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-16T19:55:40.363967] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-16T19:55:40.364408] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-16T19:55:40.364889] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-16T19:55:40.365488] [DEBUG] [LOCAL ] LDP: Trimmed 18973 records to 12892 (keeping 200 days of data) [2025-10-16T19:55:40.446931] [DEBUG] [LOCAL ] LDP: Primary data saved (12892 records). [2025-10-16T19:55:40.447085] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-16T19:55:40.447179] [INFO ] [MAIN ] Update Progress: 1245/2369 symbols completed. LDP took 27.5s. Estimated remaining: 2h 38m 33s. Rate: 7.1 symbols/min [2025-10-16T19:55:40.614283] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:55:40.664867] [DEBUG] [LOCAL ] LEN: Loaded 53195 existing records from primary storage. [2025-10-16T19:55:40.665181] [INFO ] [MAIN ] LEN: Loaded 53195 existing records. [2025-10-16T19:55:40.747897] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-16T19:55:40.841305] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:55:40.841523] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-16T19:55:40.841571] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-16T19:55:40.841807] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-16T19:55:40.841864] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-16T19:55:41.198028] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:55:41.542794] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-16T19:55:41.658976] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T19:55:42.246150] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T19:55:42.342796] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-16T19:55:43.142787] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-16T19:55:43.437348] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-16T19:55:43.825603] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T19:55:43.942847] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-16T19:55:44.708324] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T19:55:44.713765] [INFO ] [REMOTE ] LDOS: Full fetch complete (67084 records). [2025-10-16T19:55:44.713878] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-16T19:55:44.748115] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-16T19:55:45.105278] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-16T19:55:45.105385] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-16T19:55:45.106518] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-16T19:55:45.106581] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-16T19:55:45.107909] [DEBUG] [LOCAL ] LDOS: Trimmed 67084 records to 45271 (keeping 200 days of data) [2025-10-16T19:55:45.381956] [DEBUG] [LOCAL ] LDOS: Primary data saved (45271 records). [2025-10-16T19:55:45.382090] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-16T19:55:45.382526] [INFO ] [MAIN ] Update Progress: 1246/2369 symbols completed. LDOS took 35.6s. Estimated remaining: 2h 38m 21s. Rate: 7.1 symbols/min [2025-10-16T19:55:45.548749] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-16T19:55:45.553211] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:55:45.570539] [DEBUG] [LOCAL ] LEO: Loaded 16652 existing records from primary storage. [2025-10-16T19:55:45.570810] [INFO ] [MAIN ] LEO: Loaded 16652 existing records. [2025-10-16T19:55:45.760982] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:55:45.761350] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-16T19:55:45.761592] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-16T19:55:45.761901] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-16T19:55:45.762068] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-16T19:55:45.949183] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T19:55:46.164810] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:55:46.342817] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-16T19:55:46.494002] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T19:55:46.991101] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-16T19:55:47.033919] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T19:55:47.142805] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-16T19:55:47.942788] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-16T19:55:48.124256] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T19:55:48.742816] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-16T19:55:49.542858] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-16T19:55:49.704252] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T19:55:50.342859] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-16T19:55:50.345377] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T19:55:51.147965] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-16T19:55:51.161632] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T19:55:51.365701] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T19:55:51.942856] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-16T19:55:52.742923] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-16T19:55:52.853162] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T19:55:53.421375] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T19:55:53.426735] [INFO ] [REMOTE ] LEA: Full fetch complete (60661 records). [2025-10-16T19:55:53.426864] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-16T19:55:53.547988] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-16T19:55:53.872051] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T19:55:53.872305] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-16T19:55:53.877818] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-16T19:55:53.880544] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-16T19:55:53.881155] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-16T19:55:53.883108] [DEBUG] [LOCAL ] LEA: Trimmed 60661 records to 41612 (keeping 200 days of data) [2025-10-16T19:55:54.167068] [DEBUG] [LOCAL ] LEA: Primary data saved (41612 records). [2025-10-16T19:55:54.167252] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-16T19:55:54.167378] [INFO ] [MAIN ] Update Progress: 1247/2369 symbols completed. LEA took 37.0s. Estimated remaining: 2h 38m 13s. Rate: 7.1 symbols/min [2025-10-16T19:55:54.347993] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-16T19:55:54.349973] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:55:54.410734] [DEBUG] [LOCAL ] LEVI: Loaded 51780 existing records from primary storage. [2025-10-16T19:55:54.411238] [INFO ] [MAIN ] LEVI: Loaded 51780 existing records. [2025-10-16T19:55:54.599881] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:55:54.600227] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-16T19:55:54.600301] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-16T19:55:54.600831] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-16T19:55:54.600902] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-16T19:55:54.982812] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:55:55.142833] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-16T19:55:55.409355] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T19:55:55.587029] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T19:55:55.942791] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-16T19:55:56.303492] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-16T19:55:56.742826] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-16T19:55:57.542779] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-16T19:55:57.710883] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T19:55:57.991702] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T19:55:58.056842] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-16T19:55:58.342825] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-16T19:55:59.142874] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-16T19:55:59.942812] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-16T19:56:00.247081] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-16T19:56:00.671402] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-16T19:56:00.742782] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-16T19:56:00.878597] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T19:56:01.542862] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-16T19:56:02.342804] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-16T19:56:02.848533] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-16T19:56:03.142796] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-16T19:56:03.323742] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-16T19:56:03.330087] [INFO ] [REMOTE ] LEG: Full fetch complete (73027 records). [2025-10-16T19:56:03.330206] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-16T19:56:03.721101] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-16T19:56:03.721194] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-16T19:56:03.722242] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-16T19:56:03.722305] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-16T19:56:03.723612] [DEBUG] [LOCAL ] LEG: Trimmed 73027 records to 50533 (keeping 200 days of data) [2025-10-16T19:56:03.942783] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-16T19:56:04.028319] [DEBUG] [LOCAL ] LEG: Primary data saved (50533 records). [2025-10-16T19:56:04.028742] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-16T19:56:04.028971] [INFO ] [MAIN ] Update Progress: 1248/2369 symbols completed. LEG took 45.7s. Estimated remaining: 2h 38m 6s. Rate: 7.1 symbols/min [2025-10-16T19:56:04.167330] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T19:56:04.234442] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:56:04.253910] [DEBUG] [LOCAL ] LFT: Loaded 18357 existing records from primary storage. [2025-10-16T19:56:04.254157] [INFO ] [MAIN ] LFT: Loaded 18357 existing records. [2025-10-16T19:56:04.426077] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:56:04.426281] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-16T19:56:04.426328] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-16T19:56:04.426546] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-16T19:56:04.426603] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-16T19:56:04.756228] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-16T19:56:04.788854] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:56:04.899449] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T19:56:04.901956] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T19:56:05.542857] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-16T19:56:06.234565] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-16T19:56:06.266292] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T19:56:06.342775] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-16T19:56:07.142865] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-16T19:56:07.947941] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-16T19:56:07.964801] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T19:56:08.132370] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T19:56:08.742788] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-16T19:56:08.886042] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-16T19:56:09.450215] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T19:56:09.542815] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-16T19:56:10.313459] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T19:56:10.342771] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-16T19:56:11.142787] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-16T19:56:11.224856] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-16T19:56:11.942807] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-16T19:56:12.128553] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T19:56:12.131016] [INFO ] [REMOTE ] LEO: Full fetch complete (26573 records). [2025-10-16T19:56:12.131108] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-16T19:56:12.508924] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-16T19:56:12.508999] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-16T19:56:12.509547] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-16T19:56:12.509629] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-16T19:56:12.510294] [DEBUG] [LOCAL ] LEO: Trimmed 26573 records to 16748 (keeping 200 days of data) [2025-10-16T19:56:12.604857] [DEBUG] [LOCAL ] LEO: Primary data saved (16748 records). [2025-10-16T19:56:12.605030] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-16T19:56:12.605127] [INFO ] [MAIN ] Update Progress: 1249/2369 symbols completed. LEO took 27.2s. Estimated remaining: 2h 37m 57s. Rate: 7.1 symbols/min [2025-10-16T19:56:12.749216] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-16T19:56:12.774784] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:56:12.787348] [DEBUG] [LOCAL ] LGI: Loaded 10092 existing records from primary storage. [2025-10-16T19:56:12.787560] [INFO ] [MAIN ] LGI: Loaded 10092 existing records. [2025-10-16T19:56:12.961244] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:56:12.961452] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-16T19:56:12.961499] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-16T19:56:12.961688] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-16T19:56:12.961745] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-16T19:56:13.317835] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:56:13.542781] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-16T19:56:13.793059] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T19:56:14.254947] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T19:56:14.342826] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-16T19:56:14.661515] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-16T19:56:15.142797] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-16T19:56:15.920089] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T19:56:15.942787] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-16T19:56:16.065803] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-16T19:56:16.745036] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-16T19:56:16.746107] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T19:56:17.542840] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-16T19:56:18.342836] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-16T19:56:19.112884] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-16T19:56:19.123848] [INFO ] [REMOTE ] LEN: Full fetch complete (77213 records). [2025-10-16T19:56:19.124031] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-16T19:56:19.159064] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-16T19:56:19.292616] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-16T19:56:19.550793] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-16T19:56:19.807523] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-16T19:56:19.807693] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-16T19:56:19.809823] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-16T19:56:19.810003] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-16T19:56:19.812030] [DEBUG] [LOCAL ] LEN: Trimmed 77213 records to 53584 (keeping 200 days of data) [2025-10-16T19:56:19.948906] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-16T19:56:19.965365] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T19:56:20.263059] [DEBUG] [LOCAL ] LEN: Primary data saved (53584 records). [2025-10-16T19:56:20.263208] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-16T19:56:20.263316] [INFO ] [MAIN ] Update Progress: 1250/2369 symbols completed. LEN took 39.8s. Estimated remaining: 2h 37m 48s. Rate: 7.1 symbols/min [2025-10-16T19:56:20.430778] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:56:20.466013] [DEBUG] [LOCAL ] LH: Loaded 37607 existing records from primary storage. [2025-10-16T19:56:20.466320] [INFO ] [MAIN ] LH: Loaded 37607 existing records. [2025-10-16T19:56:20.637785] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:56:20.637997] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-16T19:56:20.638048] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-16T19:56:20.638434] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-16T19:56:20.638492] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-16T19:56:20.747954] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-16T19:56:20.986048] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:56:21.542840] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-16T19:56:21.802979] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T19:56:22.082426] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-16T19:56:22.126338] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T19:56:22.342846] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-16T19:56:23.142821] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-16T19:56:23.400318] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T19:56:23.916246] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T19:56:23.942794] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-16T19:56:24.491319] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-16T19:56:24.742882] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-16T19:56:25.546172] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-16T19:56:25.548668] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T19:56:26.342827] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-16T19:56:27.029025] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T19:56:27.107282] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-16T19:56:27.142787] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-16T19:56:27.942785] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-16T19:56:28.091496] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T19:56:28.742813] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-16T19:56:29.426784] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T19:56:29.542793] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-16T19:56:30.002695] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T19:56:30.342831] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-16T19:56:30.613137] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T19:56:31.142846] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-16T19:56:31.884385] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T19:56:31.924482] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-16T19:56:31.942772] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-16T19:56:32.667143] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T19:56:32.669527] [INFO ] [REMOTE ] LFT: Full fetch complete (24022 records). [2025-10-16T19:56:32.669605] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-16T19:56:32.747973] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-16T19:56:33.029513] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-16T19:56:33.029586] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-16T19:56:33.030084] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-16T19:56:33.030167] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-16T19:56:33.030816] [DEBUG] [LOCAL ] LFT: Trimmed 24022 records to 18440 (keeping 200 days of data) [2025-10-16T19:56:33.135904] [DEBUG] [LOCAL ] LFT: Primary data saved (18440 records). [2025-10-16T19:56:33.136018] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-16T19:56:33.136093] [INFO ] [MAIN ] Update Progress: 1251/2369 symbols completed. LFT took 29.1s. Estimated remaining: 2h 37m 44s. Rate: 7.1 symbols/min [2025-10-16T19:56:33.303159] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:56:33.347474] [DEBUG] [LOCAL ] LHX: Loaded 48604 existing records from primary storage. [2025-10-16T19:56:33.347791] [INFO ] [MAIN ] LHX: Loaded 48604 existing records. [2025-10-16T19:56:33.452113] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-16T19:56:33.532253] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:56:33.532461] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-16T19:56:33.532508] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-16T19:56:33.532983] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-16T19:56:33.533041] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-16T19:56:33.552922] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-16T19:56:33.884050] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:56:34.342831] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-16T19:56:35.124489] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T19:56:35.142778] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-16T19:56:35.942855] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-16T19:56:36.296966] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-16T19:56:36.303851] [INFO ] [REMOTE ] LEVI: Full fetch complete (74928 records). [2025-10-16T19:56:36.304015] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-16T19:56:36.708414] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-16T19:56:36.708577] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-16T19:56:36.709755] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-16T19:56:36.709896] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-16T19:56:36.711608] [DEBUG] [LOCAL ] LEVI: Trimmed 74928 records to 52170 (keeping 200 days of data) [2025-10-16T19:56:36.734683] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T19:56:36.743220] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-16T19:56:37.051521] [DEBUG] [LOCAL ] LEVI: Primary data saved (52170 records). [2025-10-16T19:56:37.051689] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-16T19:56:37.051785] [INFO ] [MAIN ] Update Progress: 1252/2369 symbols completed. LEVI took 42.9s. Estimated remaining: 2h 37m 31s. Rate: 7.1 symbols/min [2025-10-16T19:56:37.224443] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:56:37.257750] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T19:56:37.288899] [DEBUG] [LOCAL ] LII: Loaded 27767 existing records from primary storage. [2025-10-16T19:56:37.289201] [INFO ] [MAIN ] LII: Loaded 27767 existing records. [2025-10-16T19:56:37.406972] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T19:56:37.425220] [INFO ] [REMOTE ] LGI: Full fetch complete (14534 records). [2025-10-16T19:56:37.448139] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-16T19:56:37.509541] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:56:37.557114] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-16T19:56:37.546632] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-16T19:56:37.576616] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-16T19:56:37.580142] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-16T19:56:37.580218] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-16T19:56:38.171422] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-16T19:56:38.177551] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-16T19:56:38.193433] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-16T19:56:38.198207] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-16T19:56:38.198147] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:56:38.198957] [DEBUG] [LOCAL ] LGI: Trimmed 14534 records to 10147 (keeping 200 days of data) [2025-10-16T19:56:38.259780] [DEBUG] [LOCAL ] LGI: Primary data saved (10147 records). [2025-10-16T19:56:38.259907] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-16T19:56:38.259984] [INFO ] [MAIN ] Update Progress: 1253/2369 symbols completed. LGI took 25.7s. Estimated remaining: 2h 37m 16s. Rate: 7.1 symbols/min [2025-10-16T19:56:38.348883] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-16T19:56:38.430523] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:56:38.472362] [DEBUG] [LOCAL ] LION: Loaded 46349 existing records from primary storage. [2025-10-16T19:56:38.472735] [INFO ] [MAIN ] LION: Loaded 46349 existing records. [2025-10-16T19:56:38.650013] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:56:38.650250] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-16T19:56:38.650297] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-16T19:56:38.650692] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-16T19:56:38.650751] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-16T19:56:39.009469] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:56:39.142799] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-16T19:56:39.347445] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T19:56:39.942804] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-16T19:56:40.036106] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T19:56:40.062857] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T19:56:40.742821] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-16T19:56:41.522192] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T19:56:41.542784] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-16T19:56:41.931189] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T19:56:42.342821] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-16T19:56:42.557186] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-16T19:56:43.142869] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-16T19:56:43.520996] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T19:56:43.942835] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-16T19:56:44.742809] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-16T19:56:44.771021] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T19:56:44.994988] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T19:56:45.542827] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-16T19:56:46.326890] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T19:56:46.342771] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-16T19:56:46.564257] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T19:56:47.142865] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-16T19:56:47.942819] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-16T19:56:47.969882] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T19:56:48.664390] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T19:56:48.742787] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-16T19:56:48.985832] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T19:56:49.542819] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-16T19:56:50.217330] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T19:56:50.342784] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-16T19:56:50.811535] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-16T19:56:51.142798] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-16T19:56:51.918996] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T19:56:51.942802] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-16T19:56:52.024542] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T19:56:52.742831] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-16T19:56:53.542791] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-16T19:56:53.624904] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T19:56:53.812522] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-16T19:56:54.342820] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-16T19:56:54.846251] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-16T19:56:55.142842] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-16T19:56:55.563065] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T19:56:55.942812] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-16T19:56:56.712804] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T19:56:56.742839] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-16T19:56:57.547986] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-16T19:56:57.564843] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T19:56:57.946857] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T19:56:58.342866] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-16T19:56:58.925788] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T19:56:59.142812] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-16T19:56:59.910056] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T19:56:59.942775] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-16T19:57:00.470291] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T19:57:00.742823] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-16T19:57:01.542820] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-16T19:57:01.632355] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T19:57:02.042290] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T19:57:02.046780] [INFO ] [REMOTE ] LII: Full fetch complete (41445 records). [2025-10-16T19:57:02.046898] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-16T19:57:02.347954] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-16T19:57:02.417162] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-16T19:57:02.417237] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-16T19:57:02.418001] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-16T19:57:02.418063] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-16T19:57:02.419020] [DEBUG] [LOCAL ] LII: Trimmed 41445 records to 28004 (keeping 200 days of data) [2025-10-16T19:57:02.591958] [DEBUG] [LOCAL ] LII: Primary data saved (28004 records). [2025-10-16T19:57:02.592098] [INFO ] [MAIN ] LII: Full history saved. [2025-10-16T19:57:02.592178] [INFO ] [MAIN ] Update Progress: 1254/2369 symbols completed. LII took 25.5s. Estimated remaining: 2h 37m 22s. Rate: 7.1 symbols/min [2025-10-16T19:57:02.757472] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:02.764375] [DEBUG] [LOCAL ] LITB: Loaded 4146 existing records from primary storage. [2025-10-16T19:57:02.764566] [INFO ] [MAIN ] LITB: Loaded 4146 existing records. [2025-10-16T19:57:02.937890] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:02.938246] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-16T19:57:02.938302] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-16T19:57:02.938623] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-16T19:57:02.938710] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-16T19:57:03.152710] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-16T19:57:03.296500] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:03.433138] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T19:57:03.674628] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T19:57:03.942828] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-16T19:57:04.742846] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-16T19:57:05.069196] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-16T19:57:05.070953] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-16T19:57:05.543511] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-16T19:57:05.548881] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T19:57:06.127273] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T19:57:06.342791] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-16T19:57:06.782624] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T19:57:07.142811] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-16T19:57:07.820527] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-16T19:57:07.942856] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-16T19:57:08.700370] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T19:57:08.742834] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-16T19:57:09.542843] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-16T19:57:10.085294] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-16T19:57:10.104930] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T19:57:10.109495] [INFO ] [REMOTE ] LH: Full fetch complete (54931 records). [2025-10-16T19:57:10.109600] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-16T19:57:10.349070] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-16T19:57:10.499045] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-16T19:57:10.499132] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-16T19:57:10.500181] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-16T19:57:10.500248] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-16T19:57:10.501672] [DEBUG] [LOCAL ] LH: Trimmed 54931 records to 37792 (keeping 200 days of data) [2025-10-16T19:57:10.762787] [DEBUG] [LOCAL ] LH: Primary data saved (37792 records). [2025-10-16T19:57:10.762932] [INFO ] [MAIN ] LH: Full history saved. [2025-10-16T19:57:10.763015] [INFO ] [MAIN ] Update Progress: 1255/2369 symbols completed. LH took 50.5s. Estimated remaining: 2h 37m 13s. Rate: 7.1 symbols/min [2025-10-16T19:57:10.926481] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:10.979291] [DEBUG] [LOCAL ] LLY: Loaded 53261 existing records from primary storage. [2025-10-16T19:57:10.979663] [INFO ] [MAIN ] LLY: Loaded 53261 existing records. [2025-10-16T19:57:11.150395] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-16T19:57:11.150303] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:11.151366] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-16T19:57:11.151417] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-16T19:57:11.151859] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-16T19:57:11.151917] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-16T19:57:11.579006] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:11.942800] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-16T19:57:12.141801] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T19:57:12.742817] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-16T19:57:12.869475] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T19:57:13.048237] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-16T19:57:13.542812] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-16T19:57:13.995684] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-16T19:57:14.342791] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-16T19:57:14.503800] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-16T19:57:14.692111] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-16T19:57:15.142817] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-16T19:57:15.942827] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-16T19:57:16.742779] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-16T19:57:17.198140] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-16T19:57:17.204123] [INFO ] [REMOTE ] LHX: Full fetch complete (70779 records). [2025-10-16T19:57:17.204232] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-16T19:57:17.550765] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-16T19:57:17.612604] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-16T19:57:17.612717] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-16T19:57:17.613764] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-16T19:57:17.613830] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-16T19:57:17.615398] [DEBUG] [LOCAL ] LHX: Trimmed 70779 records to 48970 (keeping 200 days of data) [2025-10-16T19:57:17.931320] [DEBUG] [LOCAL ] LHX: Primary data saved (48970 records). [2025-10-16T19:57:17.931453] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-16T19:57:17.932116] [INFO ] [MAIN ] Update Progress: 1256/2369 symbols completed. LHX took 44.8s. Estimated remaining: 2h 37m 4s. Rate: 7.1 symbols/min [2025-10-16T19:57:18.103112] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:18.153840] [DEBUG] [LOCAL ] LMND: Loaded 52062 existing records from primary storage. [2025-10-16T19:57:18.154135] [INFO ] [MAIN ] LMND: Loaded 52062 existing records. [2025-10-16T19:57:18.344314] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:18.350457] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-16T19:57:18.351185] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-16T19:57:18.351582] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T19:57:18.353582] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-16T19:57:18.354455] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-16T19:57:18.354149] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-16T19:57:18.488457] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-10-16T19:57:18.659061] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-16T19:57:18.700133] [INFO ] [REMOTE ] LION: Full fetch complete (57303 records). [2025-10-16T19:57:18.702461] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-16T19:57:18.882380] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:19.047973] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T19:57:19.075895] [INFO ] [REMOTE ] LITB: Full fetch complete (5716 records). [2025-10-16T19:57:19.076004] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-16T19:57:19.144860] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-16T19:57:19.270277] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-16T19:57:19.270673] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-16T19:57:19.271574] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-16T19:57:19.277050] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-16T19:57:19.331148] [DEBUG] [LOCAL ] LION: Trimmed 57303 records to 46694 (keeping 200 days of data) [2025-10-16T19:57:19.689836] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-16T19:57:19.699013] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-16T19:57:19.699290] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-16T19:57:19.725124] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-16T19:57:19.727384] [DEBUG] [LOCAL ] LITB: Trimmed 5716 records to 4203 (keeping 200 days of data) [2025-10-16T19:57:19.766123] [DEBUG] [LOCAL ] LITB: Primary data saved (4203 records). [2025-10-16T19:57:19.768299] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-16T19:57:19.771581] [INFO ] [MAIN ] Update Progress: 1257/2369 symbols completed. LITB took 17.2s. Estimated remaining: 2h 36m 49s. Rate: 7.1 symbols/min [2025-10-16T19:57:19.951798] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-16T19:57:19.971205] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:19.999704] [DEBUG] [LOCAL ] LION: Primary data saved (46694 records). [2025-10-16T19:57:19.999939] [INFO ] [MAIN ] LION: Full history saved. [2025-10-16T19:57:20.000503] [INFO ] [MAIN ] Update Progress: 1258/2369 symbols completed. LION took 41.7s. Estimated remaining: 2h 36m 33s. Rate: 7.1 symbols/min [2025-10-16T19:57:20.192274] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:20.208030] [DEBUG] [LOCAL ] LMT: Loaded 49623 existing records from primary storage. [2025-10-16T19:57:20.208496] [INFO ] [MAIN ] LMT: Loaded 49623 existing records. [2025-10-16T19:57:20.397181] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:20.410719] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-16T19:57:20.410818] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-16T19:57:20.411254] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-16T19:57:20.411302] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-16T19:57:20.548191] [DEBUG] [LOCAL ] LNC: Loaded 51556 existing records from primary storage. [2025-10-16T19:57:20.571263] [INFO ] [MAIN ] LNC: Loaded 51556 existing records. [2025-10-16T19:57:20.971975] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:20.991771] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-16T19:57:20.991692] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:20.992108] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-16T19:57:20.991892] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-16T19:57:20.992910] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-16T19:57:20.992972] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-16T19:57:21.347148] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:21.542798] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-16T19:57:21.719551] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-10-16T19:57:22.015953] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-16T19:57:22.342899] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-16T19:57:22.860056] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T19:57:23.142871] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-16T19:57:23.236931] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T19:57:23.942808] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-16T19:57:24.109190] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T19:57:24.742859] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-16T19:57:25.252874] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-16T19:57:25.503812] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T19:57:25.542769] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-16T19:57:26.342898] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-16T19:57:26.807448] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-16T19:57:27.142924] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-16T19:57:27.211345] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T19:57:27.942826] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-16T19:57:28.213597] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-16T19:57:28.742793] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-16T19:57:29.163666] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-16T19:57:29.313004] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T19:57:29.542833] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-16T19:57:30.182360] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T19:57:30.342826] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-16T19:57:31.142813] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-16T19:57:31.739961] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-16T19:57:31.942866] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-16T19:57:32.192580] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T19:57:32.742840] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-16T19:57:33.415390] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-16T19:57:33.542794] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-16T19:57:34.186719] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-16T19:57:34.342813] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-16T19:57:34.561455] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T19:57:35.142831] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-16T19:57:35.942786] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-16T19:57:36.011006] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T19:57:36.076490] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-16T19:57:36.742860] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-16T19:57:37.162946] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-16T19:57:37.543544] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-16T19:57:37.543475] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T19:57:38.342818] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-16T19:57:38.486457] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T19:57:39.142807] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-16T19:57:39.942273] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-16T19:57:39.951888] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-16T19:57:40.742782] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-16T19:57:40.809921] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T19:57:40.859286] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-16T19:57:41.542850] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-16T19:57:42.068933] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-16T19:57:42.342821] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-16T19:57:43.075161] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-16T19:57:43.142807] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-16T19:57:43.942795] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-16T19:57:44.105561] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-16T19:57:44.461303] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-16T19:57:44.742893] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-16T19:57:45.434530] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-16T19:57:45.542814] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-16T19:57:45.718511] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T19:57:46.342835] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-16T19:57:47.017806] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-16T19:57:47.142821] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-16T19:57:47.785506] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-16T19:57:47.942787] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-16T19:57:48.742838] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-16T19:57:49.267320] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.92 seconds). [2025-10-16T19:57:49.542822] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-16T19:57:49.766739] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-16T19:57:49.774050] [INFO ] [REMOTE ] LMND: Full fetch complete (75461 records). [2025-10-16T19:57:49.774200] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-16T19:57:50.189592] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-16T19:57:50.189812] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-16T19:57:50.191100] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-16T19:57:50.191187] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-16T19:57:50.193459] [DEBUG] [LOCAL ] LMND: Trimmed 75461 records to 52452 (keeping 200 days of data) [2025-10-16T19:57:50.411432] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-16T19:57:50.453427] [INFO ] [REMOTE ] LMT: Full fetch complete (72452 records). [2025-10-16T19:57:50.488706] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-16T19:57:50.540975] [DEBUG] [LOCAL ] LMND: Primary data saved (52452 records). [2025-10-16T19:57:50.550666] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-16T19:57:50.566771] [INFO ] [MAIN ] Update Progress: 1259/2369 symbols completed. LMND took 32.6s. Estimated remaining: 2h 36m 44s. Rate: 7.1 symbols/min [2025-10-16T19:57:50.963068] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:51.125350] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-16T19:57:51.105034] [DEBUG] [LOCAL ] LND: Loaded 4972 existing records from primary storage. [2025-10-16T19:57:51.180903] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-16T19:57:51.176161] [INFO ] [MAIN ] LND: Loaded 4972 existing records. [2025-10-16T19:57:51.181179] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-16T19:57:51.212666] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-16T19:57:51.213223] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-16T19:57:51.213119] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-16T19:57:51.288960] [DEBUG] [LOCAL ] LMT: Trimmed 72452 records to 49981 (keeping 200 days of data) [2025-10-16T19:57:51.432537] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:51.460055] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-16T19:57:51.460180] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-16T19:57:51.465133] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-16T19:57:51.465508] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-16T19:57:52.067036] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:52.083703] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-16T19:57:52.082934] [DEBUG] [LOCAL ] LMT: Primary data saved (49981 records). [2025-10-16T19:57:52.085366] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-16T19:57:52.086186] [INFO ] [MAIN ] Update Progress: 1260/2369 symbols completed. LMT took 32.3s. Estimated remaining: 2h 36m 30s. Rate: 7.1 symbols/min [2025-10-16T19:57:52.260365] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:52.296132] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-16T19:57:52.308135] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-16T19:57:52.352124] [DEBUG] [LOCAL ] LNG: Loaded 51216 existing records from primary storage. [2025-10-16T19:57:52.352421] [INFO ] [MAIN ] LNG: Loaded 51216 existing records. [2025-10-16T19:57:52.534807] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:52.535202] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-16T19:57:52.535320] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-16T19:57:52.535928] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-16T19:57:52.536038] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-16T19:57:52.892586] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T19:57:52.975062] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-16T19:57:52.975873] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-16T19:57:52.996764] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:53.215088] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T19:57:53.222031] [INFO ] [REMOTE ] LLY: Full fetch complete (77251 records). [2025-10-16T19:57:53.222183] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-16T19:57:53.547968] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-16T19:57:53.622073] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-16T19:57:53.622187] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-16T19:57:53.623336] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-16T19:57:53.623399] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-16T19:57:53.624842] [DEBUG] [LOCAL ] LLY: Trimmed 77251 records to 53635 (keeping 200 days of data) [2025-10-16T19:57:53.955942] [DEBUG] [LOCAL ] LLY: Primary data saved (53635 records). [2025-10-16T19:57:53.956113] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-16T19:57:53.956213] [INFO ] [MAIN ] Update Progress: 1261/2369 symbols completed. LLY took 43.2s. Estimated remaining: 2h 36m 16s. Rate: 7.1 symbols/min [2025-10-16T19:57:54.122176] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:54.135202] [DEBUG] [LOCAL ] LNN: Loaded 11430 existing records from primary storage. [2025-10-16T19:57:54.135414] [INFO ] [MAIN ] LNN: Loaded 11430 existing records. [2025-10-16T19:57:54.295833] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T19:57:54.318789] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:54.318997] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-16T19:57:54.319046] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-16T19:57:54.319204] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-16T19:57:54.319242] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-16T19:57:54.362113] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-16T19:57:54.675418] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:54.822849] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-16T19:57:54.829432] [INFO ] [REMOTE ] LNC: Full fetch complete (74553 records). [2025-10-16T19:57:54.829559] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-16T19:57:55.154555] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-16T19:57:55.210224] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-16T19:57:55.210310] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-16T19:57:55.211475] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-16T19:57:55.211538] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-16T19:57:55.212975] [DEBUG] [LOCAL ] LNC: Trimmed 74553 records to 51933 (keeping 200 days of data) [2025-10-16T19:57:55.515422] [DEBUG] [LOCAL ] LNC: Primary data saved (51933 records). [2025-10-16T19:57:55.515548] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-16T19:57:55.516081] [INFO ] [MAIN ] Update Progress: 1262/2369 symbols completed. LNC took 35.5s. Estimated remaining: 2h 36m 1s. Rate: 7.1 symbols/min [2025-10-16T19:57:55.681780] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:55.721853] [DEBUG] [LOCAL ] LOAR: Loaded 42140 existing records from primary storage. [2025-10-16T19:57:55.722129] [INFO ] [MAIN ] LOAR: Loaded 42140 existing records. [2025-10-16T19:57:55.898077] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:55.898331] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-16T19:57:55.898507] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-16T19:57:55.898788] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-16T19:57:55.898845] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-16T19:57:55.956459] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-16T19:57:55.994357] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T19:57:56.266954] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:56.295144] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-16T19:57:56.742835] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-16T19:57:56.794789] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T19:57:57.542821] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-16T19:57:58.280928] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T19:57:58.279458] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T19:57:58.342798] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-16T19:57:59.142815] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-16T19:57:59.849723] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-16T19:57:59.942805] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-16T19:58:00.415415] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-16T19:58:00.524033] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T19:58:00.742788] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-16T19:58:01.354693] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T19:58:01.542825] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-16T19:58:02.073022] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-16T19:58:02.342849] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-16T19:58:03.142791] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-16T19:58:03.657469] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T19:58:03.942860] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-16T19:58:04.657831] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T19:58:04.742768] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-16T19:58:04.814192] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T19:58:05.542851] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-16T19:58:06.245853] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-16T19:58:06.342873] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-16T19:58:06.634775] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T19:58:06.906260] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-16T19:58:07.142820] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-16T19:58:07.942879] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-16T19:58:08.386422] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T19:58:08.611540] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T19:58:08.613213] [INFO ] [REMOTE ] LND: Full fetch complete (7916 records). [2025-10-16T19:58:08.613300] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-16T19:58:08.757895] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-16T19:58:08.976540] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-16T19:58:08.976613] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-16T19:58:08.976839] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-16T19:58:08.976896] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-16T19:58:08.977294] [DEBUG] [LOCAL ] LND: Trimmed 7916 records to 4994 (keeping 200 days of data) [2025-10-16T19:58:09.003741] [DEBUG] [LOCAL ] LND: Primary data saved (4994 records). [2025-10-16T19:58:09.003807] [INFO ] [MAIN ] LND: Full history saved. [2025-10-16T19:58:09.003876] [INFO ] [MAIN ] Update Progress: 1263/2369 symbols completed. LND took 18.4s. Estimated remaining: 2h 35m 57s. Rate: 7.1 symbols/min [2025-10-16T19:58:09.170885] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:58:09.200989] [DEBUG] [LOCAL ] LOB: Loaded 26728 existing records from primary storage. [2025-10-16T19:58:09.201263] [INFO ] [MAIN ] LOB: Loaded 26728 existing records. [2025-10-16T19:58:09.376801] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:58:09.377003] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-16T19:58:09.377054] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-16T19:58:09.377313] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-16T19:58:09.377352] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-16T19:58:09.551216] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-16T19:58:09.670613] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T19:58:09.741445] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:58:10.342805] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-16T19:58:10.979683] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T19:58:11.122541] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-16T19:58:11.142780] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-16T19:58:11.942823] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-16T19:58:12.753422] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-16T19:58:12.755219] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T19:58:12.905434] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-16T19:58:13.542865] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-16T19:58:14.342845] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-16T19:58:14.669240] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T19:58:15.142858] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-16T19:58:15.283369] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T19:58:15.313620] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-16T19:58:15.942801] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-16T19:58:16.742779] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-16T19:58:16.757904] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T19:58:16.975054] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T19:58:17.542805] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-16T19:58:17.831520] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T19:58:18.342846] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-16T19:58:19.046988] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-16T19:58:19.143077] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-16T19:58:19.422949] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T19:58:19.942898] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-16T19:58:20.071983] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T19:58:20.742830] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-16T19:58:21.081352] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T19:58:21.267780] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-16T19:58:21.542836] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-16T19:58:22.342828] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-16T19:58:22.856734] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T19:58:23.142824] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-16T19:58:23.806278] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T19:58:23.936630] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-16T19:58:23.942756] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-16T19:58:24.699056] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T19:58:24.701050] [INFO ] [REMOTE ] LNN: Full fetch complete (15757 records). [2025-10-16T19:58:24.701138] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-16T19:58:24.747946] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-16T19:58:25.063350] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-16T19:58:25.063424] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-16T19:58:25.063732] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-16T19:58:25.063797] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-16T19:58:25.064275] [DEBUG] [LOCAL ] LNN: Trimmed 15757 records to 11521 (keeping 200 days of data) [2025-10-16T19:58:25.136592] [DEBUG] [LOCAL ] LNN: Primary data saved (11521 records). [2025-10-16T19:58:25.136747] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-16T19:58:25.136831] [INFO ] [MAIN ] Update Progress: 1264/2369 symbols completed. LNN took 31.2s. Estimated remaining: 2h 35m 55s. Rate: 7.1 symbols/min [2025-10-16T19:58:25.305199] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:58:25.311015] [DEBUG] [LOCAL ] LOCL: Loaded 3781 existing records from primary storage. [2025-10-16T19:58:25.311179] [INFO ] [MAIN ] LOCL: Loaded 3781 existing records. [2025-10-16T19:58:25.483094] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:58:25.483308] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-16T19:58:25.483356] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-16T19:58:25.483499] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-16T19:58:25.483556] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-16T19:58:25.548021] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-16T19:58:25.835309] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:58:26.198340] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-16T19:58:26.342773] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-16T19:58:27.144426] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-16T19:58:27.147719] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T19:58:27.211827] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T19:58:27.942812] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-16T19:58:28.742824] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-16T19:58:28.993972] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T19:58:29.163487] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T19:58:29.542853] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-16T19:58:30.348490] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-16T19:58:30.363318] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T19:58:30.968842] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-16T19:58:31.142808] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-16T19:58:31.430324] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-16T19:58:31.942841] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-16T19:58:32.329906] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-16T19:58:32.742826] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-16T19:58:33.160744] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-16T19:58:33.507259] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T19:58:33.542777] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-16T19:58:34.342832] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-16T19:58:35.142832] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-16T19:58:35.363139] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T19:58:35.760326] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T19:58:35.765357] [INFO ] [REMOTE ] LOAR: Full fetch complete (55993 records). [2025-10-16T19:58:35.765498] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-16T19:58:35.943974] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-16T19:58:36.209009] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-16T19:58:36.209616] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-16T19:58:36.210254] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T19:58:36.211226] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-16T19:58:36.216453] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-16T19:58:36.217970] [DEBUG] [LOCAL ] LOAR: Trimmed 55993 records to 42364 (keeping 200 days of data) [2025-10-16T19:58:36.311529] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-16T19:58:36.467868] [DEBUG] [LOCAL ] LOAR: Primary data saved (42364 records). [2025-10-16T19:58:36.467994] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-16T19:58:36.468444] [INFO ] [MAIN ] Update Progress: 1265/2369 symbols completed. LOAR took 41.0s. Estimated remaining: 2h 35m 49s. Rate: 7.1 symbols/min [2025-10-16T19:58:36.637434] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:58:36.672001] [DEBUG] [LOCAL ] LOMA: Loaded 32694 existing records from primary storage. [2025-10-16T19:58:36.672266] [INFO ] [MAIN ] LOMA: Loaded 32694 existing records. [2025-10-16T19:58:36.747975] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-16T19:58:36.847870] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:58:36.848069] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-16T19:58:36.848116] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-16T19:58:36.848422] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-16T19:58:36.848486] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-16T19:58:37.211010] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:58:37.542806] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-16T19:58:37.878629] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-16T19:58:37.986007] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T19:58:38.342814] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-16T19:58:39.142864] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-16T19:58:39.644108] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T19:58:39.942818] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-16T19:58:40.333742] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T19:58:40.337896] [INFO ] [REMOTE ] LOB: Full fetch complete (38255 records). [2025-10-16T19:58:40.338107] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-16T19:58:40.733604] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-16T19:58:40.733712] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-16T19:58:40.734540] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-16T19:58:40.734582] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-16T19:58:40.735498] [DEBUG] [LOCAL ] LOB: Trimmed 38255 records to 26949 (keeping 200 days of data) [2025-10-16T19:58:40.790335] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-16T19:58:40.903918] [DEBUG] [LOCAL ] LOB: Primary data saved (26949 records). [2025-10-16T19:58:40.904057] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-16T19:58:40.904141] [INFO ] [MAIN ] Update Progress: 1266/2369 symbols completed. LOB took 31.9s. Estimated remaining: 2h 35m 37s. Rate: 7.1 symbols/min [2025-10-16T19:58:41.073310] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:58:41.122361] [DEBUG] [LOCAL ] LOW: Loaded 52993 existing records from primary storage. [2025-10-16T19:58:41.122720] [INFO ] [MAIN ] LOW: Loaded 52993 existing records. [2025-10-16T19:58:41.275934] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T19:58:41.351275] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:58:41.351555] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-16T19:58:41.351621] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-16T19:58:41.351886] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-16T19:58:41.351943] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-16T19:58:41.548036] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-16T19:58:41.730754] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:58:41.748494] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T19:58:41.755020] [INFO ] [REMOTE ] LNG: Full fetch complete (74810 records). [2025-10-16T19:58:41.755175] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-16T19:58:42.179456] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-16T19:58:42.179543] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-16T19:58:42.180911] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-16T19:58:42.180979] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-16T19:58:42.182407] [DEBUG] [LOCAL ] LNG: Trimmed 74810 records to 51601 (keeping 200 days of data) [2025-10-16T19:58:42.359972] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-16T19:58:42.407900] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T19:58:42.515012] [DEBUG] [LOCAL ] LNG: Primary data saved (51601 records). [2025-10-16T19:58:42.515149] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-16T19:58:42.515679] [INFO ] [MAIN ] Update Progress: 1267/2369 symbols completed. LNG took 50.4s. Estimated remaining: 2h 35m 23s. Rate: 7.1 symbols/min [2025-10-16T19:58:42.679743] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:58:42.718743] [DEBUG] [LOCAL ] LPG: Loaded 39643 existing records from primary storage. [2025-10-16T19:58:42.719016] [INFO ] [MAIN ] LPG: Loaded 39643 existing records. [2025-10-16T19:58:42.895988] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:58:42.896581] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-16T19:58:42.896639] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-16T19:58:42.896976] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-16T19:58:42.897045] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-16T19:58:43.147957] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-16T19:58:43.246521] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:58:43.942819] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-16T19:58:44.127035] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T19:58:44.523796] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T19:58:44.742876] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-16T19:58:45.131343] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T19:58:45.542811] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-16T19:58:46.085226] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T19:58:46.342825] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-16T19:58:46.770276] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-16T19:58:46.822216] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T19:58:47.142842] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-16T19:58:47.423739] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-16T19:58:47.942827] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-16T19:58:48.742842] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-16T19:58:49.542829] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-16T19:58:49.808218] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T19:58:50.031480] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T19:58:50.051496] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T19:58:50.342828] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-16T19:58:51.142850] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-16T19:58:51.934310] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T19:58:51.944073] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-16T19:58:52.689408] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T19:58:52.722198] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T19:58:52.742789] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-16T19:58:53.542796] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-16T19:58:53.584397] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T19:58:54.342857] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-16T19:58:55.075901] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-16T19:58:55.142803] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-16T19:58:55.595606] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T19:58:55.942872] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-16T19:58:56.372001] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T19:58:56.742871] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-16T19:58:57.542830] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-16T19:58:57.754555] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T19:58:58.288220] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T19:58:58.342798] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-16T19:58:58.517321] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T19:58:59.142809] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-16T19:58:59.724513] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T19:58:59.942786] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-16T19:59:00.228764] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T19:59:00.573408] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-16T19:59:00.574466] [INFO ] [REMOTE ] LOCL: Full fetch complete (4543 records). [2025-10-16T19:59:00.574535] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-16T19:59:00.748555] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-16T19:59:00.939663] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-16T19:59:00.939754] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-16T19:59:00.939907] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-16T19:59:00.939948] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-16T19:59:00.940360] [DEBUG] [LOCAL ] LOCL: Trimmed 4543 records to 3809 (keeping 200 days of data) [2025-10-16T19:59:00.961045] [DEBUG] [LOCAL ] LOCL: Primary data saved (3809 records). [2025-10-16T19:59:00.961108] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-16T19:59:00.961179] [INFO ] [MAIN ] Update Progress: 1268/2369 symbols completed. LOCL took 35.8s. Estimated remaining: 2h 35m 23s. Rate: 7.1 symbols/min [2025-10-16T19:59:01.129391] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:59:01.155582] [DEBUG] [LOCAL ] LPL: Loaded 28287 existing records from primary storage. [2025-10-16T19:59:01.155847] [INFO ] [MAIN ] LPL: Loaded 28287 existing records. [2025-10-16T19:59:01.356120] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:59:01.356365] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-16T19:59:01.356424] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-16T19:59:01.356699] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-16T19:59:01.356772] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-16T19:59:01.547317] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-16T19:59:01.743160] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:59:02.288063] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T19:59:02.342804] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-16T19:59:03.142779] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-16T19:59:03.241109] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T19:59:03.928172] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-16T19:59:03.942767] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-16T19:59:04.369393] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-16T19:59:04.742785] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-16T19:59:04.955752] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T19:59:05.542807] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-16T19:59:06.203416] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T19:59:06.342821] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-16T19:59:07.142863] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-16T19:59:07.299331] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T19:59:07.941418] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-16T19:59:07.949326] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-16T19:59:08.357695] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T19:59:08.363069] [INFO ] [REMOTE ] LOMA: Full fetch complete (47946 records). [2025-10-16T19:59:08.363218] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-16T19:59:08.747972] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-16T19:59:08.761226] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-16T19:59:08.761321] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-16T19:59:08.762221] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-16T19:59:08.762287] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-16T19:59:08.763566] [DEBUG] [LOCAL ] LOMA: Trimmed 47946 records to 32954 (keeping 200 days of data) [2025-10-16T19:59:08.960286] [DEBUG] [LOCAL ] LOMA: Primary data saved (32954 records). [2025-10-16T19:59:08.960673] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-16T19:59:08.960776] [INFO ] [MAIN ] Update Progress: 1269/2369 symbols completed. LOMA took 32.5s. Estimated remaining: 2h 35m 14s. Rate: 7.1 symbols/min [2025-10-16T19:59:09.085465] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T19:59:09.147229] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:59:09.184476] [DEBUG] [LOCAL ] LPX: Loaded 40329 existing records from primary storage. [2025-10-16T19:59:09.184810] [INFO ] [MAIN ] LPX: Loaded 40329 existing records. [2025-10-16T19:59:09.361378] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:59:09.361720] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-16T19:59:09.361778] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-16T19:59:09.362380] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-16T19:59:09.362441] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-16T19:59:09.547941] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-16T19:59:09.718248] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:59:09.960113] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T19:59:10.342832] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-16T19:59:11.142811] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-16T19:59:11.499184] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-16T19:59:11.842547] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T19:59:11.942854] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-16T19:59:12.641211] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T19:59:12.647018] [INFO ] [REMOTE ] LPG: Full fetch complete (59195 records). [2025-10-16T19:59:12.647201] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-16T19:59:12.752078] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-16T19:59:13.084016] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-16T19:59:13.084100] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-16T19:59:13.085038] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-16T19:59:13.085099] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-16T19:59:13.086397] [DEBUG] [LOCAL ] LPG: Trimmed 59195 records to 39877 (keeping 200 days of data) [2025-10-16T19:59:13.327000] [DEBUG] [LOCAL ] LPG: Primary data saved (39877 records). [2025-10-16T19:59:13.327153] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-16T19:59:13.327265] [INFO ] [MAIN ] Update Progress: 1270/2369 symbols completed. LPG took 30.8s. Estimated remaining: 2h 35m 2s. Rate: 7.1 symbols/min [2025-10-16T19:59:13.505090] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:59:13.543408] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-16T19:59:13.545259] [DEBUG] [LOCAL ] LRN: Loaded 39565 existing records from primary storage. [2025-10-16T19:59:13.545554] [INFO ] [MAIN ] LRN: Loaded 39565 existing records. [2025-10-16T19:59:13.735862] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:59:13.736401] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-16T19:59:13.736575] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-16T19:59:13.737040] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-16T19:59:13.737098] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-16T19:59:14.007480] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-16T19:59:14.134087] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:59:14.165417] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-16T19:59:14.342793] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-16T19:59:15.132711] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T19:59:15.142770] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-16T19:59:15.300455] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-16T19:59:15.942828] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-16T19:59:16.617091] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T19:59:16.742791] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-16T19:59:17.542817] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-16T19:59:17.588024] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T19:59:17.822061] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-16T19:59:18.342833] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-16T19:59:18.926379] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T19:59:19.142784] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-16T19:59:19.381856] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-16T19:59:19.942823] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-16T19:59:20.742837] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-16T19:59:20.805348] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T19:59:21.036312] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T19:59:21.542810] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-16T19:59:22.223266] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T19:59:22.342801] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-16T19:59:22.845768] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-16T19:59:23.142817] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-16T19:59:23.683621] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T19:59:23.942821] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-16T19:59:24.483186] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T19:59:24.742819] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-16T19:59:25.049244] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T19:59:25.542809] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-16T19:59:26.338688] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T19:59:26.348115] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-16T19:59:27.058453] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T19:59:27.142837] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-16T19:59:27.255454] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T19:59:27.262356] [INFO ] [REMOTE ] LOW: Full fetch complete (76715 records). [2025-10-16T19:59:27.262472] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-16T19:59:27.649000] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-16T19:59:27.649081] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-16T19:59:27.650140] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-16T19:59:27.650204] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-16T19:59:27.651575] [DEBUG] [LOCAL ] LOW: Trimmed 76715 records to 53379 (keeping 200 days of data) [2025-10-16T19:59:27.946073] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-16T19:59:27.999988] [DEBUG] [LOCAL ] LOW: Primary data saved (53379 records). [2025-10-16T19:59:28.000152] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-16T19:59:28.000871] [INFO ] [MAIN ] Update Progress: 1271/2369 symbols completed. LOW took 47.1s. Estimated remaining: 2h 34m 59s. Rate: 7.1 symbols/min [2025-10-16T19:59:28.185850] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:59:28.227345] [DEBUG] [LOCAL ] LSPD: Loaded 42581 existing records from primary storage. [2025-10-16T19:59:28.227662] [INFO ] [MAIN ] LSPD: Loaded 42581 existing records. [2025-10-16T19:59:28.402505] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:59:28.402904] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-16T19:59:28.403005] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-16T19:59:28.403600] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-16T19:59:28.403690] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-16T19:59:28.770315] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:59:28.764888] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-16T19:59:28.793416] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T19:59:29.184565] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T19:59:29.542825] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-16T19:59:29.978629] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-16T19:59:30.342837] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-16T19:59:30.691091] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T19:59:31.142829] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-16T19:59:31.942837] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-16T19:59:31.986224] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-16T19:59:31.991629] [INFO ] [REMOTE ] LPL: Full fetch complete (36934 records). [2025-10-16T19:59:31.991765] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-16T19:59:32.378486] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-16T19:59:32.378591] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-16T19:59:32.379532] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-16T19:59:32.379678] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-16T19:59:32.381055] [DEBUG] [LOCAL ] LPL: Trimmed 36934 records to 28587 (keeping 200 days of data) [2025-10-16T19:59:32.483562] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T19:59:32.574366] [DEBUG] [LOCAL ] LPL: Primary data saved (28587 records). [2025-10-16T19:59:32.574525] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-16T19:59:32.574610] [INFO ] [MAIN ] Update Progress: 1272/2369 symbols completed. LPL took 31.6s. Estimated remaining: 2h 34m 47s. Rate: 7.1 symbols/min [2025-10-16T19:59:32.747063] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:59:32.747127] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-16T19:59:32.779179] [DEBUG] [LOCAL ] LTC: Loaded 30625 existing records from primary storage. [2025-10-16T19:59:32.779490] [INFO ] [MAIN ] LTC: Loaded 30625 existing records. [2025-10-16T19:59:32.972191] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:59:32.972593] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-16T19:59:32.972730] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-16T19:59:32.973115] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-16T19:59:32.973232] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-16T19:59:33.357638] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:59:33.359471] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T19:59:33.542875] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-16T19:59:34.342810] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-16T19:59:34.404851] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T19:59:35.117677] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T19:59:35.123619] [INFO ] [REMOTE ] LPX: Full fetch complete (58987 records). [2025-10-16T19:59:35.123861] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-16T19:59:35.148070] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-16T19:59:35.527967] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-16T19:59:35.528102] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-16T19:59:35.529199] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-16T19:59:35.529268] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-16T19:59:35.530637] [DEBUG] [LOCAL ] LPX: Trimmed 58987 records to 40611 (keeping 200 days of data) [2025-10-16T19:59:35.789871] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T19:59:35.838415] [DEBUG] [LOCAL ] LPX: Primary data saved (40611 records). [2025-10-16T19:59:35.838562] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-16T19:59:35.838692] [INFO ] [MAIN ] Update Progress: 1273/2369 symbols completed. LPX took 26.9s. Estimated remaining: 2h 34m 34s. Rate: 7.1 symbols/min [2025-10-16T19:59:35.951700] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-10-16T19:59:36.033825] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:59:36.083113] [DEBUG] [LOCAL ] LTH: Loaded 51743 existing records from primary storage. [2025-10-16T19:59:36.083473] [INFO ] [MAIN ] LTH: Loaded 51743 existing records. [2025-10-16T19:59:36.261878] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:59:36.262138] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-16T19:59:36.262195] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-16T19:59:36.263102] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-16T19:59:36.263162] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-16T19:59:36.618172] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:59:36.720561] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T19:59:36.742801] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-16T19:59:37.144171] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T19:59:37.542819] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-16T19:59:38.271921] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T19:59:38.342772] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-16T19:59:38.810124] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T19:59:39.142816] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-10-16T19:59:39.934425] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T19:59:39.944133] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-16T19:59:40.202869] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:59:40.742825] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-16T19:59:41.297985] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:59:41.542818] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-16T19:59:42.280465] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T19:59:42.342774] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-16T19:59:42.740513] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T19:59:43.142827] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-16T19:59:43.756188] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T19:59:43.942826] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-16T19:59:44.495558] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T19:59:44.742873] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-16T19:59:45.386532] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T19:59:45.542808] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-16T19:59:46.342810] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-16T19:59:46.452263] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T19:59:46.823128] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T19:59:47.142803] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-16T19:59:47.666228] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T19:59:47.942851] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-16T19:59:48.494614] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T19:59:48.742791] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-16T19:59:49.062763] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T19:59:49.542844] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-16T19:59:50.181610] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T19:59:50.186408] [INFO ] [REMOTE ] LRN: Full fetch complete (58446 records). [2025-10-16T19:59:50.186508] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-16T19:59:50.362360] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-16T19:59:50.574670] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-16T19:59:50.574812] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-16T19:59:50.575756] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-16T19:59:50.575838] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-16T19:59:50.577067] [DEBUG] [LOCAL ] LRN: Trimmed 58446 records to 39819 (keeping 200 days of data) [2025-10-16T19:59:50.723273] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T19:59:50.846332] [DEBUG] [LOCAL ] LRN: Primary data saved (39819 records). [2025-10-16T19:59:50.846454] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-16T19:59:50.846525] [INFO ] [MAIN ] Update Progress: 1274/2369 symbols completed. LRN took 37.5s. Estimated remaining: 2h 34m 32s. Rate: 7.1 symbols/min [2025-10-16T19:59:51.009787] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:59:51.047339] [DEBUG] [LOCAL ] LTM: Loaded 38692 existing records from primary storage. [2025-10-16T19:59:51.047691] [INFO ] [MAIN ] LTM: Loaded 38692 existing records. [2025-10-16T19:59:51.146595] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-16T19:59:51.226438] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:59:51.226631] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-16T19:59:51.226711] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-16T19:59:51.227436] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-16T19:59:51.227493] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-16T19:59:51.573441] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:59:51.894771] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T19:59:51.942781] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-16T19:59:52.586995] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T19:59:52.742816] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-10-16T19:59:53.409031] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T19:59:53.542803] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-16T19:59:53.706352] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-16T19:59:54.342839] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-16T19:59:55.142835] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-16T19:59:55.347926] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T19:59:55.789770] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T19:59:55.942797] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-16T19:59:56.215062] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T19:59:56.742825] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-16T19:59:57.187834] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-16T19:59:57.542828] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-16T19:59:57.752148] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T19:59:58.342838] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-16T19:59:59.150436] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-16T19:59:59.170441] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T19:59:59.299702] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T19:59:59.942835] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-16T20:00:00.193415] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-16T20:00:00.742833] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-16T20:00:01.463755] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T20:00:01.470584] [INFO ] [REMOTE ] LTC: Full fetch complete (43714 records). [2025-10-16T20:00:01.470850] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-16T20:00:01.542849] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-16T20:00:01.960604] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-16T20:00:01.960763] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-16T20:00:01.961969] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-16T20:00:01.962069] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-16T20:00:01.963587] [DEBUG] [LOCAL ] LTC: Trimmed 43714 records to 30810 (keeping 200 days of data) [2025-10-16T20:00:02.215453] [DEBUG] [LOCAL ] LTC: Primary data saved (30810 records). [2025-10-16T20:00:02.215787] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-16T20:00:02.215894] [INFO ] [MAIN ] Update Progress: 1275/2369 symbols completed. LTC took 29.6s. Estimated remaining: 2h 34m 26s. Rate: 7.1 symbols/min [2025-10-16T20:00:02.346371] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-16T20:00:02.402636] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:00:02.430344] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T20:00:02.496953] [DEBUG] [LOCAL ] LU: Loaded 49048 existing records from primary storage. [2025-10-16T20:00:02.497278] [INFO ] [MAIN ] LU: Loaded 49048 existing records. [2025-10-16T20:00:02.684034] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:00:02.684291] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-16T20:00:02.684340] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-16T20:00:02.685120] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-16T20:00:02.685181] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-16T20:00:03.067184] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:00:03.142828] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-16T20:00:03.414543] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T20:00:03.942829] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-16T20:00:04.109420] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T20:00:04.307738] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-16T20:00:04.742914] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-16T20:00:05.542914] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-16T20:00:05.994982] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-16T20:00:06.342785] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-16T20:00:06.491866] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T20:00:06.497317] [INFO ] [REMOTE ] LSPD: Full fetch complete (62015 records). [2025-10-16T20:00:06.497418] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-16T20:00:06.869938] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T20:00:06.933202] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-16T20:00:06.933281] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-16T20:00:06.934208] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-16T20:00:06.934286] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-16T20:00:06.935495] [DEBUG] [LOCAL ] LSPD: Trimmed 62015 records to 42885 (keeping 200 days of data) [2025-10-16T20:00:07.148041] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-10-16T20:00:07.201179] [DEBUG] [LOCAL ] LSPD: Primary data saved (42885 records). [2025-10-16T20:00:07.201318] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-16T20:00:07.201400] [INFO ] [MAIN ] Update Progress: 1276/2369 symbols completed. LSPD took 39.2s. Estimated remaining: 2h 34m 14s. Rate: 7.1 symbols/min [2025-10-16T20:00:07.364895] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:00:07.408803] [DEBUG] [LOCAL ] LUCK: Loaded 24196 existing records from primary storage. [2025-10-16T20:00:07.409061] [INFO ] [MAIN ] LUCK: Loaded 24196 existing records. [2025-10-16T20:00:07.585440] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:00:07.585728] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-16T20:00:07.585784] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-16T20:00:07.585975] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-16T20:00:07.586031] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-16T20:00:07.962371] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:00:07.957758] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-16T20:00:07.996896] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T20:00:08.742818] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-16T20:00:08.973638] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T20:00:09.398358] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T20:00:09.542845] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-16T20:00:10.080526] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T20:00:10.342810] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-10-16T20:00:11.142799] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-16T20:00:11.215588] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T20:00:11.270252] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-16T20:00:11.942831] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-16T20:00:12.742846] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-16T20:00:12.981129] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T20:00:13.430226] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T20:00:13.542822] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-16T20:00:13.825230] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T20:00:14.342822] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-16T20:00:14.704381] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T20:00:15.142806] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-16T20:00:15.907728] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T20:00:15.942791] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-16T20:00:16.327253] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T20:00:16.742859] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-16T20:00:17.542805] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-16T20:00:17.618351] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T20:00:17.628467] [INFO ] [REMOTE ] LTH: Full fetch complete (74715 records). [2025-10-16T20:00:17.628693] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-16T20:00:18.042230] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-16T20:00:18.042368] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-16T20:00:18.043675] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-16T20:00:18.043744] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-16T20:00:18.045222] [DEBUG] [LOCAL ] LTH: Trimmed 74715 records to 52110 (keeping 200 days of data) [2025-10-16T20:00:18.359380] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-16T20:00:18.418768] [DEBUG] [LOCAL ] LTH: Primary data saved (52110 records). [2025-10-16T20:00:18.419274] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-16T20:00:18.419987] [INFO ] [MAIN ] Update Progress: 1277/2369 symbols completed. LTH took 42.6s. Estimated remaining: 2h 34m 8s. Rate: 7.1 symbols/min [2025-10-16T20:00:18.421996] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T20:00:19.142838] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-16T20:00:19.212488] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T20:00:19.835687] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T20:00:19.942836] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-16T20:00:20.742866] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-16T20:00:21.042120] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T20:00:21.454234] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-16T20:00:21.460731] [INFO ] [REMOTE ] LTM: Full fetch complete (50526 records). [2025-10-16T20:00:21.460859] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-16T20:00:21.552922] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-16T20:00:21.922347] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-16T20:00:21.922425] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-16T20:00:21.923281] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-16T20:00:21.923343] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-16T20:00:21.924317] [DEBUG] [LOCAL ] LTM: Trimmed 50526 records to 39065 (keeping 200 days of data) [2025-10-16T20:00:22.183996] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T20:00:22.199170] [DEBUG] [LOCAL ] LTM: Primary data saved (39065 records). [2025-10-16T20:00:22.199685] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-16T20:00:22.199794] [INFO ] [MAIN ] Update Progress: 1278/2369 symbols completed. LTM took 31.4s. Estimated remaining: 2h 33m 56s. Rate: 7.1 symbols/min [2025-10-16T20:00:22.342877] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-16T20:00:22.623351] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T20:00:23.142807] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-16T20:00:24.031451] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T20:00:24.046787] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-16T20:00:24.106629] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T20:00:24.742917] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-16T20:00:25.836890] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T20:00:25.847857] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-16T20:00:25.926551] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T20:00:26.342878] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-16T20:00:27.346588] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-16T20:00:27.352052] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-16T20:00:27.392558] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T20:00:27.942867] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-16T20:00:28.111936] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T20:00:28.114599] [INFO ] [REMOTE ] LUCK: Full fetch complete (39793 records). [2025-10-16T20:00:28.114706] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-16T20:00:28.481924] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-16T20:00:28.481998] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-16T20:00:28.482801] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-16T20:00:28.482863] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-16T20:00:28.483745] [DEBUG] [LOCAL ] LUCK: Trimmed 39793 records to 24314 (keeping 200 days of data) [2025-10-16T20:00:28.621185] [DEBUG] [LOCAL ] LUCK: Primary data saved (24314 records). [2025-10-16T20:00:28.621310] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-16T20:00:28.621384] [INFO ] [MAIN ] Update Progress: 1279/2369 symbols completed. LUCK took 21.4s. Estimated remaining: 2h 33m 45s. Rate: 7.1 symbols/min [2025-10-16T20:00:29.528619] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T20:00:29.539667] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-16T20:00:31.096930] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T20:00:31.108793] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-16T20:00:32.845366] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T20:00:32.857154] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-16T20:00:34.681091] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T20:00:34.687840] [INFO ] [REMOTE ] LU: Full fetch complete (70788 records). [2025-10-16T20:00:34.687991] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-16T20:00:35.077427] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-16T20:00:35.077504] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-16T20:00:35.078518] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-16T20:00:35.078581] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-16T20:00:35.079944] [DEBUG] [LOCAL ] LU: Trimmed 70788 records to 49412 (keeping 200 days of data) [2025-10-16T20:00:35.358052] [DEBUG] [LOCAL ] LU: Primary data saved (49412 records). [2025-10-16T20:00:35.358218] [INFO ] [MAIN ] LU: Full history saved. [2025-10-16T20:00:35.358316] [INFO ] [MAIN ] Update Progress: 1280/2369 symbols completed. LU took 33.1s. Estimated remaining: 2h 33m 35s. Rate: 7.1 symbols/min [2025-10-16T20:00:35.943982] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:00:36.106810] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:00:36.125881] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-16T20:00:36.126022] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-16T20:00:36.125558] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:00:36.102183] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:00:36.126807] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-16T20:00:36.127741] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-16T20:00:36.127951] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-16T20:00:36.128130] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-16T20:00:36.514763] [DEBUG] [LOCAL ] LVS: Loaded 53570 existing records from primary storage. [2025-10-16T20:00:36.513183] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-16T20:00:36.516522] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-16T20:00:36.516177] [DEBUG] [LOCAL ] LUMN: Loaded 53646 existing records from primary storage. [2025-10-16T20:00:36.538797] [INFO ] [MAIN ] LVS: Loaded 53570 existing records. [2025-10-16T20:00:36.554489] [INFO ] [MAIN ] LUMN: Loaded 53646 existing records. [2025-10-16T20:00:36.821446] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:00:36.895251] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-10-16T20:00:37.074910] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:00:37.115113] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-16T20:00:37.199077] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-16T20:00:37.182502] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:00:37.205144] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:00:37.205574] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-16T20:00:37.205741] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-16T20:00:37.205874] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-16T20:00:37.205968] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-16T20:00:37.206337] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-16T20:00:37.206410] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-16T20:00:37.218179] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-16T20:00:37.218045] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:00:37.218099] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-16T20:00:37.241353] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-16T20:00:37.241618] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-16T20:00:37.271811] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-10-16T20:00:37.330483] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:00:37.517337] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-16T20:00:37.559988] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:00:37.611024] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-16T20:00:37.826761] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-16T20:00:37.955979] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-16T20:00:38.039599] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-16T20:00:38.071781] [INFO ] [MAIN ] Update Progress: 1281/2369 symbols completed. LUXE took 2.7s. Estimated remaining: 2h 33m 22s. Rate: 7.1 symbols/min [2025-10-16T20:00:38.424972] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:00:38.511278] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:00:38.514742] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-10-16T20:00:38.514169] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:00:38.564876] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-10-16T20:00:38.564562] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:00:38.559987] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-10-16T20:00:38.586387] [DEBUG] [LOCAL ] LVWR: Loaded 18485 existing records from primary storage. [2025-10-16T20:00:38.586680] [INFO ] [MAIN ] LVWR: Loaded 18485 existing records. [2025-10-16T20:00:38.765713] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:00:38.765924] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-16T20:00:38.765974] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-16T20:00:38.766343] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-16T20:00:38.766402] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-16T20:00:39.136780] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:00:39.137108] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-10-16T20:00:39.716361] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-16T20:00:39.718147] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-16T20:00:40.371790] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T20:00:40.382765] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-16T20:00:40.603398] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-16T20:00:40.619463] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-16T20:00:40.626947] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-16T20:00:40.627943] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T20:00:40.641396] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-16T20:00:40.639086] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-16T20:00:41.272216] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-16T20:00:41.273894] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-16T20:00:41.823868] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-16T20:00:41.825569] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-16T20:00:42.037571] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T20:00:42.048551] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-16T20:00:42.123089] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T20:00:42.134035] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-16T20:00:42.195939] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T20:00:42.342881] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-16T20:00:42.410270] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-16T20:00:43.142802] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-16T20:00:43.929449] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-16T20:00:43.943157] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-16T20:00:43.975996] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T20:00:44.121897] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T20:00:44.161750] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-16T20:00:44.742835] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-16T20:00:45.542831] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-16T20:00:45.577614] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T20:00:46.342792] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-16T20:00:46.672407] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-16T20:00:47.142850] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-16T20:00:47.320059] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T20:00:47.942818] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-16T20:00:48.169834] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T20:00:48.648359] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-16T20:00:48.742784] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-16T20:00:48.920165] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T20:00:49.542812] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-16T20:00:50.342819] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-16T20:00:50.416589] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-16T20:00:50.759588] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-16T20:00:51.142837] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-16T20:00:51.942221] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T20:00:51.946288] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-16T20:00:52.742820] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-16T20:00:52.962863] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T20:00:53.201833] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-16T20:00:53.542859] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-16T20:00:54.241717] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T20:00:54.342809] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-16T20:00:55.142841] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-16T20:00:55.569439] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-16T20:00:55.942833] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-16T20:00:56.270353] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-16T20:00:56.271240] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-16T20:00:56.285922] [INFO ] [REMOTE ] LVWR: Full fetch complete (20576 records). [2025-10-16T20:00:56.285997] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-16T20:00:56.639301] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-16T20:00:56.639385] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-16T20:00:56.639863] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-16T20:00:56.639924] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-16T20:00:56.640518] [DEBUG] [LOCAL ] LVWR: Trimmed 20576 records to 18520 (keeping 200 days of data) [2025-10-16T20:00:56.747983] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-16T20:00:56.747886] [DEBUG] [LOCAL ] LVWR: Primary data saved (18520 records). [2025-10-16T20:00:56.749177] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-16T20:00:56.749263] [INFO ] [MAIN ] Update Progress: 1282/2369 symbols completed. LVWR took 18.7s. Estimated remaining: 2h 33m 22s. Rate: 7.1 symbols/min [2025-10-16T20:00:56.916451] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:00:56.963819] [DEBUG] [LOCAL ] LW: Loaded 51215 existing records from primary storage. [2025-10-16T20:00:56.964153] [INFO ] [MAIN ] LW: Loaded 51215 existing records. [2025-10-16T20:00:57.148704] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:00:57.148922] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-16T20:00:57.148970] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-16T20:00:57.150032] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-16T20:00:57.150111] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-16T20:00:57.547381] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-16T20:00:57.733094] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T20:00:57.728230] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:00:58.342816] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-16T20:00:58.548690] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-16T20:00:59.142856] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-16T20:00:59.500940] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-16T20:00:59.942818] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-16T20:01:00.390477] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-16T20:01:00.742818] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-10-16T20:01:00.790493] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T20:01:01.542905] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-16T20:01:02.047290] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-16T20:01:02.342959] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-16T20:01:02.747374] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-16T20:01:03.142778] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-16T20:01:03.326629] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T20:01:03.942819] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-16T20:01:04.390684] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-16T20:01:04.724680] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T20:01:04.742768] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-16T20:01:05.542811] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-16T20:01:05.895400] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-16T20:01:05.902440] [INFO ] [REMOTE ] LUMN: Full fetch complete (77779 records). [2025-10-16T20:01:05.902556] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-16T20:01:06.304235] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-16T20:01:06.304354] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-16T20:01:06.305559] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-16T20:01:06.305721] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-16T20:01:06.344338] [DEBUG] [LOCAL ] LUMN: Trimmed 77779 records to 54036 (keeping 200 days of data) [2025-10-16T20:01:06.344020] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-16T20:01:06.354717] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T20:01:06.677052] [DEBUG] [LOCAL ] LUMN: Primary data saved (54036 records). [2025-10-16T20:01:06.677195] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-16T20:01:06.677751] [INFO ] [MAIN ] Update Progress: 1283/2369 symbols completed. LUMN took 31.3s. Estimated remaining: 2h 33m 15s. Rate: 7.1 symbols/min [2025-10-16T20:01:06.855537] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:01:06.873200] [DEBUG] [LOCAL ] LXFR: Loaded 16648 existing records from primary storage. [2025-10-16T20:01:06.873472] [INFO ] [MAIN ] LXFR: Loaded 16648 existing records. [2025-10-16T20:01:07.080827] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:01:07.081080] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-16T20:01:07.081128] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-16T20:01:07.081509] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-16T20:01:07.081566] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-16T20:01:07.151255] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-16T20:01:07.458586] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:01:07.497236] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-16T20:01:07.942787] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-16T20:01:08.212967] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T20:01:08.715883] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-16T20:01:08.722838] [INFO ] [REMOTE ] LUV: Full fetch complete (77865 records). [2025-10-16T20:01:08.723006] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-16T20:01:08.753048] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-10-16T20:01:08.844391] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T20:01:08.886844] [INFO ] [REMOTE ] LVS: Full fetch complete (77705 records). [2025-10-16T20:01:08.897307] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-16T20:01:09.560012] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-16T20:01:09.614569] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-16T20:01:09.627023] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-16T20:01:09.664737] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-16T20:01:09.669691] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-16T20:01:09.689215] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-16T20:01:09.689550] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-16T20:01:09.690293] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-16T20:01:09.690378] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-16T20:01:09.692237] [DEBUG] [LOCAL ] LUV: Trimmed 77865 records to 54079 (keeping 200 days of data) [2025-10-16T20:01:09.692629] [DEBUG] [LOCAL ] LVS: Trimmed 77705 records to 53960 (keeping 200 days of data) [2025-10-16T20:01:09.913853] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T20:01:10.279367] [DEBUG] [LOCAL ] LVS: Primary data saved (53960 records). [2025-10-16T20:01:10.280190] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-16T20:01:10.280310] [INFO ] [MAIN ] Update Progress: 1284/2369 symbols completed. LVS took 34.9s. Estimated remaining: 2h 33m 2s. Rate: 7.1 symbols/min [2025-10-16T20:01:10.350872] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-16T20:01:10.494870] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:01:10.597783] [DEBUG] [LOCAL ] LUV: Primary data saved (54079 records). [2025-10-16T20:01:10.598003] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-16T20:01:10.598738] [INFO ] [MAIN ] Update Progress: 1285/2369 symbols completed. LUV took 35.2s. Estimated remaining: 2h 32m 47s. Rate: 7.1 symbols/min [2025-10-16T20:01:10.757008] [DEBUG] [LOCAL ] LXP: Loaded 50765 existing records from primary storage. [2025-10-16T20:01:10.785757] [INFO ] [MAIN ] LXP: Loaded 50765 existing records. [2025-10-16T20:01:10.815682] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:01:11.015389] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:01:11.016396] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-16T20:01:11.025851] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-16T20:01:11.026508] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-16T20:01:11.026466] [DEBUG] [LOCAL ] LXU: Loaded 31770 existing records from primary storage. [2025-10-16T20:01:11.026634] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-16T20:01:11.031982] [INFO ] [MAIN ] LXU: Loaded 31770 existing records. [2025-10-16T20:01:11.400170] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:01:11.434895] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-16T20:01:11.462046] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-16T20:01:11.495611] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-16T20:01:11.495943] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-16T20:01:11.630130] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T20:01:11.699528] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-16T20:01:11.888295] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:01:11.951622] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-10-16T20:01:11.953635] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-16T20:01:12.111606] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:01:12.722895] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T20:01:12.742774] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-10-16T20:01:13.542792] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-16T20:01:13.634271] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T20:01:13.844056] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T20:01:14.342870] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-16T20:01:15.142928] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T20:01:15.143104] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-16T20:01:15.168017] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-16T20:01:15.942847] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-16T20:01:16.575549] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T20:01:16.742820] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-16T20:01:17.193452] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T20:01:17.542872] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-16T20:01:18.350238] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-16T20:01:18.352454] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T20:01:18.408181] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-16T20:01:19.142779] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-16T20:01:19.542783] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T20:01:19.942804] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-16T20:01:20.189121] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T20:01:20.742859] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-16T20:01:21.542851] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-16T20:01:21.724677] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T20:01:22.350035] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-16T20:01:22.382280] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T20:01:22.559709] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T20:01:23.142822] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-16T20:01:23.774827] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T20:01:23.826725] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-16T20:01:23.942841] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-16T20:01:24.742835] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-16T20:01:24.912703] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T20:01:25.542979] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-16T20:01:26.342840] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-16T20:01:26.483121] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T20:01:27.142872] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-16T20:01:27.269334] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T20:01:27.823570] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T20:01:27.942771] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-16T20:01:28.169555] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T20:01:28.742843] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-16T20:01:29.325434] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T20:01:29.542826] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-16T20:01:29.720328] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T20:01:29.722523] [INFO ] [REMOTE ] LXFR: Full fetch complete (24767 records). [2025-10-16T20:01:29.722593] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-16T20:01:30.086850] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-16T20:01:30.086956] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-16T20:01:30.087481] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-16T20:01:30.087524] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-16T20:01:30.088139] [DEBUG] [LOCAL ] LXFR: Trimmed 24767 records to 16731 (keeping 200 days of data) [2025-10-16T20:01:30.186097] [DEBUG] [LOCAL ] LXFR: Primary data saved (16731 records). [2025-10-16T20:01:30.186231] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-16T20:01:30.186307] [INFO ] [MAIN ] Update Progress: 1286/2369 symbols completed. LXFR took 23.5s. Estimated remaining: 2h 32m 48s. Rate: 7.1 symbols/min [2025-10-16T20:01:30.362024] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:01:30.359442] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-16T20:01:30.412934] [DEBUG] [LOCAL ] LYB: Loaded 53618 existing records from primary storage. [2025-10-16T20:01:30.413296] [INFO ] [MAIN ] LYB: Loaded 53618 existing records. [2025-10-16T20:01:30.593417] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:01:30.593688] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-16T20:01:30.593747] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-16T20:01:30.594521] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-16T20:01:30.594579] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-16T20:01:31.032233] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:01:31.035606] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T20:01:31.142829] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-16T20:01:31.857053] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T20:01:31.942844] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-10-16T20:01:32.439229] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-16T20:01:32.742811] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-16T20:01:33.542874] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-16T20:01:33.862461] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T20:01:34.342888] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-16T20:01:34.577445] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T20:01:35.043987] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T20:01:35.142854] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-16T20:01:35.826251] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T20:01:35.942831] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-16T20:01:36.742830] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-16T20:01:36.883713] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T20:01:37.542799] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-16T20:01:37.658750] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T20:01:37.958804] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T20:01:38.342808] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-16T20:01:39.142832] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-16T20:01:39.285405] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T20:01:39.942832] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-16T20:01:40.031245] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T20:01:40.742790] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-16T20:01:40.834326] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T20:01:41.324670] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T20:01:41.542814] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-16T20:01:42.342808] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-16T20:01:42.393992] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-16T20:01:42.648084] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-16T20:01:42.659591] [INFO ] [REMOTE ] LW: Full fetch complete (74762 records). [2025-10-16T20:01:42.660101] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-16T20:01:43.048953] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-16T20:01:43.049095] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-16T20:01:43.050170] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-16T20:01:43.050237] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-16T20:01:43.051742] [DEBUG] [LOCAL ] LW: Trimmed 74762 records to 51587 (keeping 200 days of data) [2025-10-16T20:01:43.146716] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-16T20:01:43.358018] [DEBUG] [LOCAL ] LW: Primary data saved (51587 records). [2025-10-16T20:01:43.358162] [INFO ] [MAIN ] LW: Full history saved. [2025-10-16T20:01:43.358823] [INFO ] [MAIN ] Update Progress: 1287/2369 symbols completed. LW took 46.6s. Estimated remaining: 2h 32m 44s. Rate: 7.1 symbols/min [2025-10-16T20:01:43.522208] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:01:43.569988] [DEBUG] [LOCAL ] LYG: Loaded 52693 existing records from primary storage. [2025-10-16T20:01:43.570303] [INFO ] [MAIN ] LYG: Loaded 52693 existing records. [2025-10-16T20:01:43.742991] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:01:43.743215] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-16T20:01:43.743262] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-16T20:01:43.744246] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-16T20:01:43.744303] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-16T20:01:43.953129] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-16T20:01:44.102464] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:01:44.136570] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T20:01:44.183584] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T20:01:44.187605] [INFO ] [REMOTE ] LXU: Full fetch complete (45328 records). [2025-10-16T20:01:44.187734] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-16T20:01:44.571221] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-16T20:01:44.571315] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-16T20:01:44.572251] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-16T20:01:44.572328] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-16T20:01:44.573372] [DEBUG] [LOCAL ] LXU: Trimmed 45328 records to 31987 (keeping 200 days of data) [2025-10-16T20:01:44.742858] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-16T20:01:44.756939] [DEBUG] [LOCAL ] LXU: Primary data saved (31987 records). [2025-10-16T20:01:44.757121] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-16T20:01:44.757254] [INFO ] [MAIN ] Update Progress: 1288/2369 symbols completed. LXU took 34.2s. Estimated remaining: 2h 32m 29s. Rate: 7.1 symbols/min [2025-10-16T20:01:44.946140] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:01:44.995664] [DEBUG] [LOCAL ] LYV: Loaded 51136 existing records from primary storage. [2025-10-16T20:01:44.996071] [INFO ] [MAIN ] LYV: Loaded 51136 existing records. [2025-10-16T20:01:45.174263] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:01:45.174479] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-16T20:01:45.174541] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-16T20:01:45.174910] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-16T20:01:45.174983] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-16T20:01:45.542908] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-10-16T20:01:45.573500] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:01:45.594967] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T20:01:46.342784] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-10-16T20:01:46.795764] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-16T20:01:46.940494] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T20:01:47.142876] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-16T20:01:47.635704] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-16T20:01:47.942810] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-16T20:01:48.742806] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-16T20:01:48.936849] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T20:01:49.527166] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T20:01:49.542757] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-16T20:01:50.032779] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T20:01:50.342823] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-16T20:01:51.142809] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-16T20:01:51.239009] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T20:01:51.933489] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T20:01:51.940076] [INFO ] [REMOTE ] LXP: Full fetch complete (72870 records). [2025-10-16T20:01:51.940209] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-16T20:01:51.952108] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-16T20:01:52.338699] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-16T20:01:52.338858] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-16T20:01:52.340056] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-16T20:01:52.340126] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-16T20:01:52.341737] [DEBUG] [LOCAL ] LXP: Trimmed 72870 records to 51132 (keeping 200 days of data) [2025-10-16T20:01:52.652753] [DEBUG] [LOCAL ] LXP: Primary data saved (51132 records). [2025-10-16T20:01:52.652894] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-16T20:01:52.652974] [INFO ] [MAIN ] Update Progress: 1289/2369 symbols completed. LXP took 42.4s. Estimated remaining: 2h 32m 20s. Rate: 7.1 symbols/min [2025-10-16T20:01:52.745858] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-16T20:01:52.832004] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:01:52.864593] [DEBUG] [LOCAL ] LZB: Loaded 35168 existing records from primary storage. [2025-10-16T20:01:52.864960] [INFO ] [MAIN ] LZB: Loaded 35168 existing records. [2025-10-16T20:01:53.046718] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:01:53.047150] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-16T20:01:53.047229] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-16T20:01:53.048240] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-16T20:01:53.048304] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-16T20:01:53.322792] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-16T20:01:53.459209] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:01:53.542778] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-10-16T20:01:53.758875] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T20:01:54.342835] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-16T20:01:54.587541] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T20:01:54.761406] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-16T20:01:55.142810] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-16T20:01:55.942819] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-16T20:01:56.197390] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T20:01:56.574245] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T20:01:56.742815] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-16T20:01:57.542830] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-16T20:01:57.887423] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T20:01:58.023518] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T20:01:58.342816] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-16T20:01:59.142842] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-16T20:01:59.463550] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T20:01:59.722203] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T20:01:59.942828] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-16T20:02:00.615757] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T20:02:00.742812] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-16T20:02:01.556601] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-16T20:02:01.584860] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T20:02:02.342785] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-16T20:02:02.694918] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-16T20:02:02.779543] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T20:02:03.142804] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-16T20:02:03.942814] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-16T20:02:04.149096] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T20:02:04.587522] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T20:02:04.742790] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-16T20:02:05.542787] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-16T20:02:05.716522] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T20:02:06.342985] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-16T20:02:06.478092] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T20:02:07.142778] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-16T20:02:07.324530] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T20:02:07.524005] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-16T20:02:07.943472] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T20:02:07.943591] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-16T20:02:07.952410] [INFO ] [REMOTE ] LYB: Full fetch complete (77628 records). [2025-10-16T20:02:07.952708] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-16T20:02:08.340542] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-16T20:02:08.340618] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-16T20:02:08.341675] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-16T20:02:08.341738] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-16T20:02:08.343096] [DEBUG] [LOCAL ] LYB: Trimmed 77628 records to 54008 (keeping 200 days of data) [2025-10-16T20:02:08.680024] [DEBUG] [LOCAL ] LYB: Primary data saved (54008 records). [2025-10-16T20:02:08.680189] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-16T20:02:08.681102] [INFO ] [MAIN ] Update Progress: 1290/2369 symbols completed. LYB took 38.5s. Estimated remaining: 2h 32m 18s. Rate: 7.1 symbols/min [2025-10-16T20:02:08.747931] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-16T20:02:08.858110] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:02:08.872762] [DEBUG] [LOCAL ] LZM: Loaded 14485 existing records from primary storage. [2025-10-16T20:02:08.873029] [INFO ] [MAIN ] LZM: Loaded 14485 existing records. [2025-10-16T20:02:09.057040] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:02:09.057290] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-16T20:02:09.057347] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-16T20:02:09.057693] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-16T20:02:09.057750] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-16T20:02:09.437278] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:02:09.449499] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T20:02:09.542809] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-16T20:02:10.342818] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-10-16T20:02:10.605579] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-16T20:02:10.760880] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-16T20:02:11.024025] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T20:02:11.142789] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-16T20:02:11.942805] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-16T20:02:12.512077] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T20:02:12.742806] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-16T20:02:13.542825] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-16T20:02:13.752548] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T20:02:14.304604] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T20:02:14.342770] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-16T20:02:15.142782] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-16T20:02:15.340368] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T20:02:15.411672] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T20:02:15.784097] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-16T20:02:15.942797] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-16T20:02:16.742825] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-16T20:02:17.347338] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-16T20:02:17.352162] [INFO ] [REMOTE ] LZB: Full fetch complete (50841 records). [2025-10-16T20:02:17.352291] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-16T20:02:17.553796] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-16T20:02:17.655700] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T20:02:17.694931] [INFO ] [REMOTE ] LYV: Full fetch complete (74122 records). [2025-10-16T20:02:17.710437] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-16T20:02:17.882149] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-16T20:02:17.885289] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-16T20:02:17.886178] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-16T20:02:17.886532] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-16T20:02:17.941716] [DEBUG] [LOCAL ] LZB: Trimmed 50841 records to 35417 (keeping 200 days of data) [2025-10-16T20:02:18.301023] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-16T20:02:18.301120] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-16T20:02:18.305622] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-16T20:02:18.308959] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-16T20:02:18.318673] [DEBUG] [LOCAL ] LYV: Trimmed 74122 records to 51498 (keeping 200 days of data) [2025-10-16T20:02:18.366719] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-16T20:02:18.527793] [DEBUG] [LOCAL ] LZB: Primary data saved (35417 records). [2025-10-16T20:02:18.529203] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-16T20:02:18.532838] [INFO ] [MAIN ] Update Progress: 1291/2369 symbols completed. LZB took 25.9s. Estimated remaining: 2h 32m 11s. Rate: 7.1 symbols/min [2025-10-16T20:02:18.818198] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:02:18.905365] [DEBUG] [LOCAL ] LYV: Primary data saved (51498 records). [2025-10-16T20:02:18.905557] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-16T20:02:18.906207] [INFO ] [MAIN ] Update Progress: 1292/2369 symbols completed. LYV took 34.1s. Estimated remaining: 2h 31m 56s. Rate: 7.1 symbols/min [2025-10-16T20:02:19.114772] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:02:19.116831] [DEBUG] [LOCAL ] M: Loaded 53545 existing records from primary storage. [2025-10-16T20:02:19.117308] [INFO ] [MAIN ] M: Loaded 53545 existing records. [2025-10-16T20:02:19.258313] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T20:02:19.324052] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-16T20:02:19.323239] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:02:19.325074] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-16T20:02:19.325153] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-16T20:02:19.326221] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-16T20:02:19.326284] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-16T20:02:19.492279] [DEBUG] [LOCAL ] MA: Loaded 52480 existing records from primary storage. [2025-10-16T20:02:19.552537] [INFO ] [MAIN ] MA: Loaded 52480 existing records. [2025-10-16T20:02:19.803268] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-16T20:02:19.930852] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:02:19.959718] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-16T20:02:19.963576] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:02:19.964583] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-16T20:02:19.964700] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-16T20:02:19.965926] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-16T20:02:19.965989] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-16T20:02:20.235815] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-16T20:02:20.336354] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:02:20.742821] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-16T20:02:21.542791] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-10-16T20:02:21.856612] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-16T20:02:21.875177] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T20:02:21.879623] [INFO ] [REMOTE ] LYG: Full fetch complete (76215 records). [2025-10-16T20:02:21.880604] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-16T20:02:22.266098] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-16T20:02:22.266195] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-16T20:02:22.267244] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-16T20:02:22.267318] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-16T20:02:22.268886] [DEBUG] [LOCAL ] LYG: Trimmed 76215 records to 53078 (keeping 200 days of data) [2025-10-16T20:02:22.350417] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-16T20:02:22.570817] [DEBUG] [LOCAL ] LYG: Primary data saved (53078 records). [2025-10-16T20:02:22.570970] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-16T20:02:22.571598] [INFO ] [MAIN ] Update Progress: 1293/2369 symbols completed. LYG took 39.2s. Estimated remaining: 2h 31m 43s. Rate: 7.1 symbols/min [2025-10-16T20:02:22.746353] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:02:22.788662] [DEBUG] [LOCAL ] MAA: Loaded 42905 existing records from primary storage. [2025-10-16T20:02:22.788954] [INFO ] [MAIN ] MAA: Loaded 42905 existing records. [2025-10-16T20:02:22.971798] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:02:22.971998] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-16T20:02:22.972060] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-16T20:02:22.972831] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-16T20:02:22.972889] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-16T20:02:23.145422] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-10-16T20:02:23.265106] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T20:02:23.349396] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:02:23.458548] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T20:02:23.942817] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-16T20:02:24.544611] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-16T20:02:24.742829] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-10-16T20:02:25.272470] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-16T20:02:25.542813] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-16T20:02:25.935070] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T20:02:26.318969] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-16T20:02:26.342780] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-16T20:02:27.142793] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-16T20:02:27.173196] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-16T20:02:27.942806] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-16T20:02:28.413073] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T20:02:28.742809] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-16T20:02:29.542812] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-16T20:02:29.909203] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-16T20:02:30.342845] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-16T20:02:30.454529] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T20:02:31.142788] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-16T20:02:31.168186] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T20:02:31.321289] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T20:02:31.942813] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-16T20:02:32.725458] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T20:02:32.742766] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-16T20:02:33.414841] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T20:02:33.542837] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-16T20:02:34.342888] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-16T20:02:34.494576] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T20:02:34.791839] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T20:02:35.142809] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-16T20:02:35.254382] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T20:02:35.257636] [INFO ] [REMOTE ] LZM: Full fetch complete (19501 records). [2025-10-16T20:02:35.257746] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-16T20:02:35.623879] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-16T20:02:35.623958] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-16T20:02:35.624420] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-16T20:02:35.624461] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-16T20:02:35.625135] [DEBUG] [LOCAL ] LZM: Trimmed 19501 records to 14661 (keeping 200 days of data) [2025-10-16T20:02:35.706913] [DEBUG] [LOCAL ] LZM: Primary data saved (14661 records). [2025-10-16T20:02:35.707050] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-16T20:02:35.707130] [INFO ] [MAIN ] Update Progress: 1294/2369 symbols completed. LZM took 27.0s. Estimated remaining: 2h 31m 38s. Rate: 7.1 symbols/min [2025-10-16T20:02:35.881768] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:02:35.928162] [DEBUG] [LOCAL ] MAC: Loaded 49774 existing records from primary storage. [2025-10-16T20:02:35.928529] [INFO ] [MAIN ] MAC: Loaded 49774 existing records. [2025-10-16T20:02:35.949025] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-16T20:02:36.108511] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:02:36.108787] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-16T20:02:36.108840] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-16T20:02:36.109714] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-16T20:02:36.109785] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-16T20:02:36.466832] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:02:36.742816] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-10-16T20:02:37.035547] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-16T20:02:37.542786] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-16T20:02:38.041718] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-16T20:02:38.342792] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-16T20:02:38.444688] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T20:02:39.142859] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-16T20:02:39.577754] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-16T20:02:39.659262] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T20:02:39.942828] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-16T20:02:40.742836] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-16T20:02:40.820345] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T20:02:41.542856] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-16T20:02:41.847165] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-16T20:02:42.282557] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T20:02:42.342816] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-16T20:02:43.119424] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T20:02:43.142791] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-16T20:02:43.948030] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-16T20:02:43.951006] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T20:02:44.311856] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T20:02:44.742828] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-16T20:02:45.542783] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-16T20:02:45.757048] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T20:02:45.917195] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T20:02:46.342854] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-16T20:02:47.142822] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-16T20:02:47.492596] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-16T20:02:47.948467] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-16T20:02:47.969395] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T20:02:48.742853] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-16T20:02:49.116929] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-16T20:02:49.422207] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T20:02:49.542814] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-16T20:02:50.342849] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-16T20:02:50.501571] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T20:02:51.142871] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-16T20:02:51.795503] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T20:02:51.935490] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-16T20:02:51.946469] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-16T20:02:52.742799] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-16T20:02:52.968866] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T20:02:53.260749] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T20:02:53.542821] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-16T20:02:54.030948] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T20:02:54.342837] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-16T20:02:55.096146] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T20:02:55.142808] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-16T20:02:55.942828] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-16T20:02:56.307145] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T20:02:56.314331] [INFO ] [REMOTE ] M: Full fetch complete (77658 records). [2025-10-16T20:02:56.314477] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-16T20:02:56.700304] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-16T20:02:56.700386] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-16T20:02:56.701565] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-16T20:02:56.701629] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-16T20:02:56.703105] [DEBUG] [LOCAL ] M: Trimmed 77658 records to 53935 (keeping 200 days of data) [2025-10-16T20:02:56.758738] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-16T20:02:57.034946] [DEBUG] [LOCAL ] M: Primary data saved (53935 records). [2025-10-16T20:02:57.035076] [INFO ] [MAIN ] M: Full history saved. [2025-10-16T20:02:57.035152] [INFO ] [MAIN ] Update Progress: 1295/2369 symbols completed. M took 38.5s. Estimated remaining: 2h 31m 41s. Rate: 7.1 symbols/min [2025-10-16T20:02:57.204944] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:02:57.235943] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-16T20:02:57.275882] [DEBUG] [LOCAL ] MAGN: Loaded 36089 existing records from primary storage. [2025-10-16T20:02:57.276154] [INFO ] [MAIN ] MAGN: Loaded 36089 existing records. [2025-10-16T20:02:57.461696] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:02:57.462094] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-16T20:02:57.462181] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-16T20:02:57.462751] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-16T20:02:57.462890] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-16T20:02:57.565273] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-16T20:02:57.807960] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-16T20:02:57.874443] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:02:58.131850] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T20:02:58.138538] [INFO ] [REMOTE ] MAA: Full fetch complete (61637 records). [2025-10-16T20:02:58.138736] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-16T20:02:58.342913] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-10-16T20:02:58.686781] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-16T20:02:58.686915] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-16T20:02:58.689277] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-16T20:02:58.689467] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-16T20:02:58.691342] [DEBUG] [LOCAL ] MAA: Trimmed 61637 records to 43214 (keeping 200 days of data) [2025-10-16T20:02:59.097980] [DEBUG] [LOCAL ] MAA: Primary data saved (43214 records). [2025-10-16T20:02:59.098205] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-16T20:02:59.099147] [INFO ] [MAIN ] Update Progress: 1296/2369 symbols completed. MAA took 36.5s. Estimated remaining: 2h 31m 27s. Rate: 7.1 symbols/min [2025-10-16T20:02:59.152786] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-16T20:02:59.307789] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:02:59.350662] [DEBUG] [LOCAL ] MAIN: Loaded 41822 existing records from primary storage. [2025-10-16T20:02:59.350995] [INFO ] [MAIN ] MAIN: Loaded 41822 existing records. [2025-10-16T20:02:59.550516] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:02:59.550969] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-16T20:02:59.551082] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-16T20:02:59.551490] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-16T20:02:59.551554] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-16T20:02:59.690488] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-16T20:02:59.960898] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-16T20:02:59.996629] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:02:59.999555] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T20:03:00.431001] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-16T20:03:00.742815] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-10-16T20:03:01.542820] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-16T20:03:02.012766] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-16T20:03:02.020565] [INFO ] [REMOTE ] MA: Full fetch complete (76408 records). [2025-10-16T20:03:02.020824] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-16T20:03:02.296304] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T20:03:02.343631] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-16T20:03:02.476796] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-16T20:03:02.476907] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-16T20:03:02.478207] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-16T20:03:02.478321] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-16T20:03:02.498549] [DEBUG] [LOCAL ] MA: Trimmed 76408 records to 52869 (keeping 200 days of data) [2025-10-16T20:03:02.500397] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T20:03:02.843168] [DEBUG] [LOCAL ] MA: Primary data saved (52869 records). [2025-10-16T20:03:02.843352] [INFO ] [MAIN ] MA: Full history saved. [2025-10-16T20:03:02.844121] [INFO ] [MAIN ] Update Progress: 1297/2369 symbols completed. MA took 43.9s. Estimated remaining: 2h 31m 15s. Rate: 7.1 symbols/min [2025-10-16T20:03:03.011724] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:03:03.056470] [DEBUG] [LOCAL ] MAN: Loaded 44037 existing records from primary storage. [2025-10-16T20:03:03.056801] [INFO ] [MAIN ] MAN: Loaded 44037 existing records. [2025-10-16T20:03:03.148194] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-16T20:03:03.241190] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:03:03.241388] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-16T20:03:03.241436] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-16T20:03:03.241613] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-16T20:03:03.241687] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-16T20:03:03.593745] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:03:03.942823] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-10-16T20:03:04.122636] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T20:03:04.679892] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T20:03:04.742837] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-16T20:03:05.080106] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T20:03:05.542814] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-16T20:03:06.181913] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T20:03:06.342805] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-16T20:03:06.702894] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T20:03:07.142801] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-16T20:03:07.942878] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-16T20:03:08.100672] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T20:03:08.400799] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-16T20:03:08.742812] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-16T20:03:09.358440] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T20:03:09.542811] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-16T20:03:09.803627] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T20:03:10.342814] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-16T20:03:11.142798] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-16T20:03:11.302108] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-16T20:03:11.308636] [INFO ] [REMOTE ] MAC: Full fetch complete (71561 records). [2025-10-16T20:03:11.308806] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-16T20:03:11.707935] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-16T20:03:11.708013] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-16T20:03:11.709134] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-16T20:03:11.709219] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-16T20:03:11.710619] [DEBUG] [LOCAL ] MAC: Trimmed 71561 records to 50114 (keeping 200 days of data) [2025-10-16T20:03:11.948357] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-16T20:03:12.026745] [DEBUG] [LOCAL ] MAC: Primary data saved (50114 records). [2025-10-16T20:03:12.026851] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-16T20:03:12.027386] [INFO ] [MAIN ] Update Progress: 1298/2369 symbols completed. MAC took 36.3s. Estimated remaining: 2h 31m 7s. Rate: 7.1 symbols/min [2025-10-16T20:03:12.199379] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:03:12.225727] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T20:03:12.254026] [DEBUG] [LOCAL ] MANU: Loaded 27055 existing records from primary storage. [2025-10-16T20:03:12.254288] [INFO ] [MAIN ] MANU: Loaded 27055 existing records. [2025-10-16T20:03:12.427375] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:03:12.427571] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-16T20:03:12.427780] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-16T20:03:12.428297] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-16T20:03:12.428354] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-16T20:03:12.728631] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T20:03:12.744238] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-16T20:03:12.816734] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:03:13.438519] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T20:03:13.542811] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-10-16T20:03:14.342842] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-16T20:03:14.660034] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-16T20:03:14.688706] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T20:03:15.142836] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-16T20:03:15.829374] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T20:03:15.942835] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-16T20:03:16.227329] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T20:03:16.742829] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-16T20:03:16.997115] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T20:03:17.542867] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-16T20:03:18.342866] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-16T20:03:18.406726] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T20:03:19.115736] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T20:03:19.142778] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-16T20:03:19.421543] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T20:03:19.942852] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-16T20:03:20.742897] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-16T20:03:20.859396] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T20:03:20.929889] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-16T20:03:21.542854] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-16T20:03:22.122771] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T20:03:22.342816] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-16T20:03:23.090322] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T20:03:23.142811] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-16T20:03:23.724639] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T20:03:23.942868] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-16T20:03:24.617596] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T20:03:24.742840] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-16T20:03:25.232774] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T20:03:25.542845] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-16T20:03:26.342871] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-16T20:03:26.651783] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T20:03:26.937886] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T20:03:27.142832] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-16T20:03:27.942842] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-16T20:03:28.257224] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-16T20:03:28.263133] [INFO ] [REMOTE ] MAGN: Full fetch complete (51862 records). [2025-10-16T20:03:28.263240] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-16T20:03:28.640217] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-16T20:03:28.640327] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-16T20:03:28.641213] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-16T20:03:28.641283] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-16T20:03:28.642508] [DEBUG] [LOCAL ] MAGN: Trimmed 51862 records to 36411 (keeping 200 days of data) [2025-10-16T20:03:28.749846] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-16T20:03:28.848537] [DEBUG] [LOCAL ] MAGN: Primary data saved (36411 records). [2025-10-16T20:03:28.848718] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-16T20:03:28.848809] [INFO ] [MAIN ] Update Progress: 1299/2369 symbols completed. MAGN took 31.8s. Estimated remaining: 2h 31m 5s. Rate: 7.1 symbols/min [2025-10-16T20:03:29.015505] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:03:29.065160] [DEBUG] [LOCAL ] MAS: Loaded 52288 existing records from primary storage. [2025-10-16T20:03:29.065567] [INFO ] [MAIN ] MAS: Loaded 52288 existing records. [2025-10-16T20:03:29.238944] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:03:29.239171] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-16T20:03:29.239218] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-16T20:03:29.240048] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-16T20:03:29.240105] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-16T20:03:29.612344] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:03:29.612921] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-10-16T20:03:29.919031] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T20:03:29.973868] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T20:03:30.342791] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-16T20:03:30.438826] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (3.30 seconds). [2025-10-16T20:03:30.999106] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T20:03:31.142809] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-16T20:03:31.674001] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T20:03:31.942850] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-16T20:03:32.742798] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-16T20:03:33.054792] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-16T20:03:33.062273] [INFO ] [REMOTE ] MAIN: Full fetch complete (60413 records). [2025-10-16T20:03:33.062407] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-16T20:03:33.462096] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-16T20:03:33.462224] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-16T20:03:33.463258] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-16T20:03:33.463373] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-16T20:03:33.464732] [DEBUG] [LOCAL ] MAIN: Trimmed 60413 records to 42123 (keeping 200 days of data) [2025-10-16T20:03:33.551749] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-16T20:03:33.610081] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T20:03:33.753092] [DEBUG] [LOCAL ] MAIN: Primary data saved (42123 records). [2025-10-16T20:03:33.753218] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-16T20:03:33.753292] [INFO ] [MAIN ] Update Progress: 1300/2369 symbols completed. MAIN took 34.7s. Estimated remaining: 2h 30m 54s. Rate: 7.1 symbols/min [2025-10-16T20:03:33.918127] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:03:33.950795] [DEBUG] [LOCAL ] MATV: Loaded 35661 existing records from primary storage. [2025-10-16T20:03:33.951108] [INFO ] [MAIN ] MATV: Loaded 35661 existing records. [2025-10-16T20:03:34.134113] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:03:34.134328] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-16T20:03:34.134376] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-16T20:03:34.135005] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-16T20:03:34.135063] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-16T20:03:34.351455] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-16T20:03:34.514538] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:03:34.548916] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T20:03:34.803625] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T20:03:35.142862] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-16T20:03:35.811406] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T20:03:35.942811] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-16T20:03:36.694130] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T20:03:36.720085] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T20:03:36.742775] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-16T20:03:37.542831] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-16T20:03:38.109998] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-16T20:03:38.342874] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-10-16T20:03:38.934911] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T20:03:38.941075] [INFO ] [REMOTE ] MAN: Full fetch complete (62621 records). [2025-10-16T20:03:38.941225] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-16T20:03:39.148021] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-16T20:03:39.357155] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-16T20:03:39.357294] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-16T20:03:39.358422] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-16T20:03:39.358490] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-16T20:03:39.359855] [DEBUG] [LOCAL ] MAN: Trimmed 62621 records to 44417 (keeping 200 days of data) [2025-10-16T20:03:39.612394] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T20:03:39.652441] [DEBUG] [LOCAL ] MAN: Primary data saved (44417 records). [2025-10-16T20:03:39.652594] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-16T20:03:39.653346] [INFO ] [MAIN ] Update Progress: 1301/2369 symbols completed. MAN took 36.8s. Estimated remaining: 2h 30m 43s. Rate: 7.1 symbols/min [2025-10-16T20:03:39.855937] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:03:39.893362] [DEBUG] [LOCAL ] MATX: Loaded 31970 existing records from primary storage. [2025-10-16T20:03:39.893707] [INFO ] [MAIN ] MATX: Loaded 31970 existing records. [2025-10-16T20:03:39.948051] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-16T20:03:40.119116] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:03:40.119387] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-16T20:03:40.119471] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-16T20:03:40.119862] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-16T20:03:40.119960] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-16T20:03:40.543258] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:03:40.742819] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-10-16T20:03:40.988415] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T20:03:41.073229] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T20:03:41.542813] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-16T20:03:41.784118] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T20:03:42.342880] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-16T20:03:43.142824] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-16T20:03:43.286774] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T20:03:43.497273] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T20:03:43.942828] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-16T20:03:44.548739] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T20:03:44.552877] [INFO ] [REMOTE ] MANU: Full fetch complete (39010 records). [2025-10-16T20:03:44.552964] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-16T20:03:44.747961] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-16T20:03:44.933016] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-16T20:03:44.933095] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-16T20:03:44.933880] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-16T20:03:44.933944] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-16T20:03:44.934822] [DEBUG] [LOCAL ] MANU: Trimmed 39010 records to 27328 (keeping 200 days of data) [2025-10-16T20:03:45.089687] [DEBUG] [LOCAL ] MANU: Primary data saved (27328 records). [2025-10-16T20:03:45.089820] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-16T20:03:45.089898] [INFO ] [MAIN ] Update Progress: 1302/2369 symbols completed. MANU took 33.1s. Estimated remaining: 2h 30m 32s. Rate: 7.1 symbols/min [2025-10-16T20:03:45.259911] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:03:45.290068] [DEBUG] [LOCAL ] MAX: Loaded 31010 existing records from primary storage. [2025-10-16T20:03:45.290361] [INFO ] [MAIN ] MAX: Loaded 31010 existing records. [2025-10-16T20:03:45.464191] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:03:45.464398] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-16T20:03:45.464445] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-16T20:03:45.465012] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-16T20:03:45.465068] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-16T20:03:45.544154] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-16T20:03:45.867620] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:03:45.901605] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-16T20:03:46.184392] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T20:03:46.342846] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-16T20:03:47.148185] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-10-16T20:03:47.151157] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T20:03:47.932343] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T20:03:47.942768] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-16T20:03:48.597339] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T20:03:48.742840] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-16T20:03:49.155947] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T20:03:49.542907] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-16T20:03:50.329502] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T20:03:50.342861] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-16T20:03:50.786001] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-16T20:03:51.142895] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-16T20:03:51.942781] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-16T20:03:52.104233] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T20:03:52.699241] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T20:03:52.742880] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-16T20:03:53.542828] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-16T20:03:53.775331] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-16T20:03:54.248081] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T20:03:54.342778] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-16T20:03:54.891283] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T20:03:55.142806] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-16T20:03:55.942847] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-16T20:03:56.208683] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-16T20:03:56.385173] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T20:03:56.742792] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-16T20:03:57.170379] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T20:03:57.542874] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-16T20:03:58.053255] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-16T20:03:58.342832] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-16T20:03:59.142810] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-16T20:03:59.234172] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T20:03:59.698307] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T20:03:59.942848] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-16T20:04:00.257996] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T20:04:00.742833] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-16T20:04:00.884964] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-16T20:04:01.542800] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-16T20:04:01.987115] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T20:04:02.342826] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-16T20:04:02.969729] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T20:04:03.142839] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-16T20:04:03.942798] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-16T20:04:04.140543] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-16T20:04:04.190343] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T20:04:04.195321] [INFO ] [REMOTE ] MATX: Full fetch complete (43709 records). [2025-10-16T20:04:04.195513] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-16T20:04:04.628200] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-16T20:04:04.628336] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-16T20:04:04.629713] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-16T20:04:04.629783] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-16T20:04:04.631392] [DEBUG] [LOCAL ] MATX: Trimmed 43709 records to 32188 (keeping 200 days of data) [2025-10-16T20:04:04.745292] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-16T20:04:04.866482] [DEBUG] [LOCAL ] MATX: Primary data saved (32188 records). [2025-10-16T20:04:04.866735] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-16T20:04:04.866859] [INFO ] [MAIN ] Update Progress: 1303/2369 symbols completed. MATX took 25.2s. Estimated remaining: 2h 30m 33s. Rate: 7.1 symbols/min [2025-10-16T20:04:05.071296] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:04:05.101437] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T20:04:05.153953] [DEBUG] [LOCAL ] MBC: Loaded 43915 existing records from primary storage. [2025-10-16T20:04:05.154396] [INFO ] [MAIN ] MBC: Loaded 43915 existing records. [2025-10-16T20:04:05.350325] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:04:05.350615] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-16T20:04:05.350701] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-16T20:04:05.351554] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-16T20:04:05.351618] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-16T20:04:05.549576] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-16T20:04:05.764630] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:04:06.342823] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-10-16T20:04:06.562131] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T20:04:06.571328] [INFO ] [REMOTE ] MAS: Full fetch complete (75267 records). [2025-10-16T20:04:06.571627] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-16T20:04:06.807927] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T20:04:07.051776] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-16T20:04:07.051865] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-16T20:04:07.052928] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-16T20:04:07.052995] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-16T20:04:07.054454] [DEBUG] [LOCAL ] MAS: Trimmed 75267 records to 52671 (keeping 200 days of data) [2025-10-16T20:04:07.149138] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-16T20:04:07.437400] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T20:04:07.454394] [DEBUG] [LOCAL ] MAS: Primary data saved (52671 records). [2025-10-16T20:04:07.454508] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-16T20:04:07.454596] [INFO ] [MAIN ] Update Progress: 1304/2369 symbols completed. MAS took 38.6s. Estimated remaining: 2h 30m 20s. Rate: 7.1 symbols/min [2025-10-16T20:04:07.630285] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:04:07.656264] [DEBUG] [LOCAL ] MBI: Loaded 24330 existing records from primary storage. [2025-10-16T20:04:07.657246] [INFO ] [MAIN ] MBI: Loaded 24330 existing records. [2025-10-16T20:04:07.841261] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:04:07.841577] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-16T20:04:07.841628] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-16T20:04:07.842153] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-16T20:04:07.842214] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-16T20:04:07.944292] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-16T20:04:08.259332] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:04:08.615349] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T20:04:08.619534] [INFO ] [REMOTE ] MATV: Full fetch complete (52292 records). [2025-10-16T20:04:08.619671] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-16T20:04:08.754249] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-16T20:04:08.990635] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-16T20:04:08.990748] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-16T20:04:08.991692] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-16T20:04:08.991755] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-16T20:04:08.992838] [DEBUG] [LOCAL ] MATV: Trimmed 52292 records to 35854 (keeping 200 days of data) [2025-10-16T20:04:09.202152] [DEBUG] [LOCAL ] MATV: Primary data saved (35854 records). [2025-10-16T20:04:09.202313] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-16T20:04:09.202458] [INFO ] [MAIN ] Update Progress: 1305/2369 symbols completed. MATV took 35.4s. Estimated remaining: 2h 30m 6s. Rate: 7.1 symbols/min [2025-10-16T20:04:09.389180] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:04:09.412636] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T20:04:09.460538] [DEBUG] [LOCAL ] MC: Loaded 43982 existing records from primary storage. [2025-10-16T20:04:09.460894] [INFO ] [MAIN ] MC: Loaded 43982 existing records. [2025-10-16T20:04:09.549139] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-10-16T20:04:09.638865] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:04:09.639091] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-16T20:04:09.639141] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-16T20:04:09.639396] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-16T20:04:09.639436] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-16T20:04:09.985228] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:04:10.050560] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-16T20:04:10.342813] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-16T20:04:10.843670] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-16T20:04:11.142826] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-16T20:04:11.802854] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T20:04:11.942790] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-16T20:04:12.201057] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T20:04:12.742785] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-16T20:04:13.054136] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T20:04:13.542861] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-10-16T20:04:14.009552] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-16T20:04:14.342886] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-16T20:04:14.924180] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T20:04:15.142804] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-16T20:04:15.668138] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T20:04:15.942807] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-16T20:04:16.618924] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T20:04:16.742809] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-16T20:04:17.542879] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-16T20:04:17.587604] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T20:04:17.813374] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T20:04:18.342914] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-16T20:04:18.880271] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T20:04:19.142872] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-16T20:04:19.529197] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T20:04:19.942797] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-16T20:04:20.258041] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T20:04:20.742871] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-16T20:04:21.542779] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-16T20:04:21.602037] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T20:04:21.701627] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T20:04:22.342809] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-16T20:04:22.714579] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T20:04:23.142803] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-16T20:04:23.600459] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-16T20:04:23.942839] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-16T20:04:24.485720] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T20:04:24.742822] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-16T20:04:24.913785] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T20:04:24.919466] [INFO ] [REMOTE ] MAX: Full fetch complete (45534 records). [2025-10-16T20:04:24.919602] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-16T20:04:25.291851] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-16T20:04:25.291930] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-16T20:04:25.292765] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-16T20:04:25.292827] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-16T20:04:25.293779] [DEBUG] [LOCAL ] MAX: Trimmed 45534 records to 31247 (keeping 200 days of data) [2025-10-16T20:04:25.471479] [DEBUG] [LOCAL ] MAX: Primary data saved (31247 records). [2025-10-16T20:04:25.471627] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-16T20:04:25.471748] [INFO ] [MAIN ] Update Progress: 1306/2369 symbols completed. MAX took 40.4s. Estimated remaining: 2h 30m 4s. Rate: 7.1 symbols/min [2025-10-16T20:04:25.547916] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-16T20:04:25.638708] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:04:25.651557] [DEBUG] [LOCAL ] MCB: Loaded 11339 existing records from primary storage. [2025-10-16T20:04:25.651814] [INFO ] [MAIN ] MCB: Loaded 11339 existing records. [2025-10-16T20:04:25.824102] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:04:25.824327] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-16T20:04:25.824375] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-16T20:04:25.824565] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-16T20:04:25.824606] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-16T20:04:26.177244] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:04:26.258701] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T20:04:26.342780] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-16T20:04:26.895700] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T20:04:27.142797] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-16T20:04:27.928850] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T20:04:27.942768] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-16T20:04:28.532607] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T20:04:28.742842] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-10-16T20:04:29.494671] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T20:04:29.522321] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T20:04:29.542766] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-16T20:04:30.342824] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-16T20:04:30.966800] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T20:04:31.053135] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T20:04:31.142836] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-16T20:04:31.942866] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-16T20:04:32.565861] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T20:04:32.574100] [INFO ] [REMOTE ] MC: Full fetch complete (63010 records). [2025-10-16T20:04:32.574283] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-16T20:04:32.751018] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-16T20:04:32.963221] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-16T20:04:32.963298] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-16T20:04:32.964257] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-16T20:04:32.964332] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-16T20:04:32.965544] [DEBUG] [LOCAL ] MC: Trimmed 63010 records to 44275 (keeping 200 days of data) [2025-10-16T20:04:33.067450] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T20:04:33.245408] [DEBUG] [LOCAL ] MC: Primary data saved (44275 records). [2025-10-16T20:04:33.245535] [INFO ] [MAIN ] MC: Full history saved. [2025-10-16T20:04:33.245610] [INFO ] [MAIN ] Update Progress: 1307/2369 symbols completed. MC took 24.0s. Estimated remaining: 2h 29m 55s. Rate: 7.1 symbols/min [2025-10-16T20:04:33.409444] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:04:33.409566] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-16T20:04:33.409602] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-16T20:04:33.409729] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-16T20:04:33.409773] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-16T20:04:33.409817] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-16T20:04:33.409849] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-16T20:04:33.550761] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-16T20:04:33.767983] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:04:34.294202] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T20:04:34.342778] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-16T20:04:34.765122] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-16T20:04:35.142805] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-10-16T20:04:35.766713] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T20:04:35.942795] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-16T20:04:36.742786] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-16T20:04:36.898305] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T20:04:37.292094] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-16T20:04:37.542835] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-16T20:04:38.342861] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-16T20:04:38.388979] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T20:04:38.896476] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T20:04:39.142840] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-16T20:04:39.883014] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T20:04:39.942782] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-16T20:04:40.194440] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T20:04:40.742798] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-16T20:04:40.773536] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-16T20:04:41.542821] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-16T20:04:42.342782] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-16T20:04:42.690897] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-16T20:04:42.702558] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T20:04:43.142795] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-16T20:04:43.942917] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-16T20:04:44.101751] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-16T20:04:44.113083] [INFO ] [REMOTE ] MBC: Full fetch complete (63239 records). [2025-10-16T20:04:44.113409] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-16T20:04:44.627482] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-16T20:04:44.627589] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-16T20:04:44.629034] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-16T20:04:44.629294] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-16T20:04:44.630782] [DEBUG] [LOCAL ] MBC: Trimmed 63239 records to 44249 (keeping 200 days of data) [2025-10-16T20:04:44.744768] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-16T20:04:44.914625] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-16T20:04:44.924573] [DEBUG] [LOCAL ] MBC: Primary data saved (44249 records). [2025-10-16T20:04:44.924691] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-16T20:04:44.925406] [INFO ] [MAIN ] Update Progress: 1308/2369 symbols completed. MBC took 40.1s. Estimated remaining: 2h 29m 49s. Rate: 7.1 symbols/min [2025-10-16T20:04:45.105606] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:04:45.138991] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-16T20:04:45.152951] [DEBUG] [LOCAL ] MCI: Loaded 6403 existing records from primary storage. [2025-10-16T20:04:45.153520] [INFO ] [MAIN ] MCI: Loaded 6403 existing records. [2025-10-16T20:04:45.331313] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:04:45.331533] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-16T20:04:45.331581] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-16T20:04:45.331784] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-16T20:04:45.331852] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-16T20:04:45.548006] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-16T20:04:45.685031] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:04:46.019207] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-16T20:04:46.022832] [INFO ] [REMOTE ] MBI: Full fetch complete (36384 records). [2025-10-16T20:04:46.022919] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-16T20:04:46.319173] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T20:04:46.343025] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-16T20:04:46.411759] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-16T20:04:46.411838] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-16T20:04:46.412609] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-16T20:04:46.412672] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-16T20:04:46.413550] [DEBUG] [LOCAL ] MBI: Trimmed 36384 records to 24511 (keeping 200 days of data) [2025-10-16T20:04:46.543492] [DEBUG] [LOCAL ] MBI: Primary data saved (24511 records). [2025-10-16T20:04:46.543630] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-16T20:04:46.543748] [INFO ] [MAIN ] Update Progress: 1309/2369 symbols completed. MBI took 39.1s. Estimated remaining: 2h 29m 35s. Rate: 7.1 symbols/min [2025-10-16T20:04:46.712383] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:04:46.748286] [DEBUG] [LOCAL ] MCK: Loaded 38560 existing records from primary storage. [2025-10-16T20:04:46.748593] [INFO ] [MAIN ] MCK: Loaded 38560 existing records. [2025-10-16T20:04:46.921213] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:04:46.921416] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-16T20:04:46.921463] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-16T20:04:46.921926] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-16T20:04:46.921983] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-16T20:04:47.142807] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-16T20:04:47.274993] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:04:47.942813] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-10-16T20:04:47.954146] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T20:04:48.438294] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-16T20:04:48.546333] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-16T20:04:48.742790] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-16T20:04:49.542914] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-16T20:04:49.701008] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T20:04:50.108689] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-16T20:04:50.342860] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-10-16T20:04:51.142818] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-16T20:04:51.914291] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T20:04:51.942789] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-16T20:04:51.999485] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T20:04:52.721137] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-16T20:04:52.742843] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-16T20:04:53.267206] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-16T20:04:53.542869] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-16T20:04:54.276712] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T20:04:54.342898] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-16T20:04:55.144471] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-16T20:04:55.146630] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-16T20:04:55.920509] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T20:04:55.942760] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-16T20:04:56.538435] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T20:04:56.742862] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-16T20:04:57.542823] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-16T20:04:57.574841] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T20:04:58.342818] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-16T20:04:59.142844] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-16T20:04:59.252909] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T20:04:59.254803] [INFO ] [REMOTE ] MCB: Full fetch complete (16601 records). [2025-10-16T20:04:59.254879] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-16T20:04:59.621105] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-16T20:04:59.621225] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-16T20:04:59.621801] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-16T20:04:59.621974] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-16T20:04:59.622754] [DEBUG] [LOCAL ] MCB: Trimmed 16601 records to 11454 (keeping 200 days of data) [2025-10-16T20:04:59.696540] [DEBUG] [LOCAL ] MCB: Primary data saved (11454 records). [2025-10-16T20:04:59.696700] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-16T20:04:59.696796] [INFO ] [MAIN ] Update Progress: 1310/2369 symbols completed. MCB took 34.2s. Estimated remaining: 2h 29m 30s. Rate: 7.1 symbols/min [2025-10-16T20:04:59.899555] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-16T20:04:59.925923] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:04:59.942812] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-16T20:04:59.947686] [DEBUG] [LOCAL ] MCN: Loaded 8174 existing records from primary storage. [2025-10-16T20:04:59.947915] [INFO ] [MAIN ] MCN: Loaded 8174 existing records. [2025-10-16T20:05:00.124244] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:05:00.124448] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-16T20:05:00.124496] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-16T20:05:00.124805] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-16T20:05:00.124865] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-16T20:05:00.482833] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:05:00.649059] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T20:05:00.742819] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-10-16T20:05:01.478222] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T20:05:01.542820] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-16T20:05:02.203962] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-16T20:05:02.342853] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-16T20:05:03.142836] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-16T20:05:03.196126] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T20:05:03.196416] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-16T20:05:03.867033] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-16T20:05:03.942825] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-16T20:05:04.742853] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-16T20:05:05.542824] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-16T20:05:05.594276] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T20:05:06.296433] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T20:05:06.342835] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-16T20:05:06.722045] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T20:05:07.142810] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-16T20:05:07.942860] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-16T20:05:08.177243] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T20:05:08.566708] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T20:05:08.742796] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-16T20:05:08.932460] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T20:05:09.542831] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-16T20:05:10.303559] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-16T20:05:10.336719] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T20:05:10.345416] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-16T20:05:11.109686] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T20:05:11.142848] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-16T20:05:11.942841] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-16T20:05:12.587171] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T20:05:12.742910] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-16T20:05:13.542853] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-16T20:05:13.668014] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T20:05:13.669437] [INFO ] [REMOTE ] MCI: Full fetch complete (9932 records). [2025-10-16T20:05:13.669596] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-16T20:05:14.040091] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-16T20:05:14.040220] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-16T20:05:14.040509] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-16T20:05:14.040586] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-16T20:05:14.041270] [DEBUG] [LOCAL ] MCI: Trimmed 9932 records to 6436 (keeping 200 days of data) [2025-10-16T20:05:14.099729] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-16T20:05:14.120142] [DEBUG] [LOCAL ] MCI: Primary data saved (6436 records). [2025-10-16T20:05:14.120259] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-16T20:05:14.120332] [INFO ] [MAIN ] Update Progress: 1311/2369 symbols completed. MCI took 29.2s. Estimated remaining: 2h 29m 26s. Rate: 7.1 symbols/min [2025-10-16T20:05:14.293542] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:05:14.316792] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T20:05:14.346601] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-16T20:05:14.348816] [DEBUG] [LOCAL ] MCO: Loaded 39462 existing records from primary storage. [2025-10-16T20:05:14.349192] [INFO ] [MAIN ] MCO: Loaded 39462 existing records. [2025-10-16T20:05:14.521906] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:05:14.522131] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-16T20:05:14.522180] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-16T20:05:14.522528] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-16T20:05:14.522568] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-16T20:05:14.866075] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:05:15.142813] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-10-16T20:05:15.194113] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T20:05:15.942811] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-16T20:05:16.670093] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T20:05:16.742799] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-16T20:05:16.771715] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T20:05:16.778603] [INFO ] [REMOTE ] MCD: Full fetch complete (77153 records). [2025-10-16T20:05:16.778764] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-16T20:05:16.967513] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T20:05:16.968267] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:05:16.968337] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:05:16.968416] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-16T20:05:16.968501] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-16T20:05:16.968538] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-16T20:05:16.968576] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-16T20:05:16.968633] [INFO ] [MAIN ] Update Progress: 1312/2369 symbols completed. MCD took 43.7s. Estimated remaining: 2h 29m 13s. Rate: 7.1 symbols/min [2025-10-16T20:05:17.132313] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:05:17.142806] [DEBUG] [LOCAL ] MCR: Loaded 8895 existing records from primary storage. [2025-10-16T20:05:17.143024] [INFO ] [MAIN ] MCR: Loaded 8895 existing records. [2025-10-16T20:05:17.313980] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:05:17.314188] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-16T20:05:17.314234] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-16T20:05:17.314381] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-16T20:05:17.314418] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-16T20:05:17.547908] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-16T20:05:17.664226] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:05:18.145330] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T20:05:18.174051] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T20:05:18.342829] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-16T20:05:19.142821] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-10-16T20:05:19.848113] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T20:05:19.935207] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-16T20:05:19.942761] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-16T20:05:20.742825] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-16T20:05:20.866303] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T20:05:21.542828] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-16T20:05:22.230456] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T20:05:22.302778] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-16T20:05:22.342783] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-16T20:05:22.778109] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T20:05:23.142810] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-16T20:05:23.942797] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-16T20:05:23.991894] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T20:05:23.993815] [INFO ] [REMOTE ] MCN: Full fetch complete (11709 records). [2025-10-16T20:05:23.993890] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-16T20:05:24.386023] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-16T20:05:24.386107] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-16T20:05:24.386389] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-16T20:05:24.386432] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-16T20:05:24.386932] [DEBUG] [LOCAL ] MCN: Trimmed 11709 records to 8214 (keeping 200 days of data) [2025-10-16T20:05:24.434368] [DEBUG] [LOCAL ] MCN: Primary data saved (8214 records). [2025-10-16T20:05:24.434499] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-16T20:05:24.434580] [INFO ] [MAIN ] Update Progress: 1313/2369 symbols completed. MCN took 24.7s. Estimated remaining: 2h 29m 4s. Rate: 7.1 symbols/min [2025-10-16T20:05:24.599018] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:05:24.632973] [DEBUG] [LOCAL ] MCS: Loaded 21099 existing records from primary storage. [2025-10-16T20:05:24.633251] [INFO ] [MAIN ] MCS: Loaded 21099 existing records. [2025-10-16T20:05:24.747990] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-16T20:05:24.814706] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:05:24.814986] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-16T20:05:24.815052] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-16T20:05:24.815331] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-16T20:05:24.815410] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-16T20:05:25.169023] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:05:25.542873] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-16T20:05:25.647172] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T20:05:26.276084] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T20:05:26.342827] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-10-16T20:05:26.521054] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T20:05:27.142843] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-16T20:05:27.372322] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T20:05:27.942825] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-16T20:05:28.431897] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T20:05:28.742822] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-16T20:05:28.934703] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T20:05:29.542829] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-16T20:05:30.040071] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T20:05:30.045307] [INFO ] [REMOTE ] MCK: Full fetch complete (56788 records). [2025-10-16T20:05:30.045455] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-16T20:05:30.349681] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-16T20:05:30.350420] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-16T20:05:30.453346] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-16T20:05:30.453445] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-16T20:05:30.454430] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-16T20:05:30.454495] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-16T20:05:30.455734] [DEBUG] [LOCAL ] MCK: Trimmed 56788 records to 38825 (keeping 200 days of data) [2025-10-16T20:05:30.697947] [DEBUG] [LOCAL ] MCK: Primary data saved (38825 records). [2025-10-16T20:05:30.698091] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-16T20:05:30.698171] [INFO ] [MAIN ] Update Progress: 1314/2369 symbols completed. MCK took 44.2s. Estimated remaining: 2h 28m 54s. Rate: 7.1 symbols/min [2025-10-16T20:05:30.862492] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:05:30.885024] [DEBUG] [LOCAL ] MCY: Loaded 23955 existing records from primary storage. [2025-10-16T20:05:30.885283] [INFO ] [MAIN ] MCY: Loaded 23955 existing records. [2025-10-16T20:05:31.058679] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:05:31.058872] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-16T20:05:31.058924] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-16T20:05:31.059108] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-16T20:05:31.059164] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-16T20:05:31.147899] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-16T20:05:31.438042] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:05:31.608211] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-16T20:05:31.829756] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T20:05:31.942820] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-16T20:05:32.742870] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-10-16T20:05:33.478948] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T20:05:33.542815] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-16T20:05:34.010330] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T20:05:34.342858] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-16T20:05:34.885546] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T20:05:35.065549] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-16T20:05:35.142812] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-16T20:05:35.874340] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-16T20:05:35.942828] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-16T20:05:36.527687] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-16T20:05:36.742847] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-16T20:05:37.542863] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-16T20:05:38.154596] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T20:05:38.174409] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-16T20:05:38.342804] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-16T20:05:38.979407] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T20:05:39.142805] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-16T20:05:39.759238] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T20:05:39.942843] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-16T20:05:40.742853] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-16T20:05:41.409493] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T20:05:41.542847] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-16T20:05:42.342801] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-16T20:05:42.395602] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T20:05:42.963032] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T20:05:43.142787] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-16T20:05:43.170952] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-16T20:05:43.942778] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-16T20:05:44.383067] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-16T20:05:44.742823] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-16T20:05:45.178923] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T20:05:45.377610] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-16T20:05:45.379294] [INFO ] [REMOTE ] MCR: Full fetch complete (13865 records). [2025-10-16T20:05:45.379365] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-16T20:05:45.548516] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-16T20:05:45.755087] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-16T20:05:45.755170] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-16T20:05:45.755514] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-16T20:05:45.755553] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-16T20:05:45.756078] [DEBUG] [LOCAL ] MCR: Trimmed 13865 records to 8958 (keeping 200 days of data) [2025-10-16T20:05:45.805853] [DEBUG] [LOCAL ] MCR: Primary data saved (8958 records). [2025-10-16T20:05:45.805974] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-16T20:05:45.806051] [INFO ] [MAIN ] Update Progress: 1315/2369 symbols completed. MCR took 28.8s. Estimated remaining: 2h 28m 51s. Rate: 7.1 symbols/min [2025-10-16T20:05:45.971480] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:05:46.008538] [DEBUG] [LOCAL ] MD: Loaded 38550 existing records from primary storage. [2025-10-16T20:05:46.008835] [INFO ] [MAIN ] MD: Loaded 38550 existing records. [2025-10-16T20:05:46.182300] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:05:46.182449] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-16T20:05:46.182495] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-16T20:05:46.182690] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-16T20:05:46.182747] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-16T20:05:46.359168] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-16T20:05:46.538975] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:05:47.142808] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-10-16T20:05:47.306585] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T20:05:47.751222] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-16T20:05:47.942822] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-16T20:05:48.550525] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T20:05:48.742829] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-16T20:05:49.008093] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T20:05:49.542821] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-16T20:05:49.831473] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T20:05:50.342893] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-16T20:05:50.952967] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T20:05:51.142854] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-16T20:05:51.680914] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T20:05:51.942857] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-16T20:05:52.461142] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T20:05:52.742800] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-16T20:05:52.946118] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T20:05:53.542832] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-16T20:05:53.876937] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T20:05:54.342835] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-16T20:05:54.618024] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T20:05:55.142784] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-16T20:05:55.640289] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T20:05:55.942857] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-16T20:05:56.731927] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T20:05:56.737771] [INFO ] [REMOTE ] MCO: Full fetch complete (57887 records). [2025-10-16T20:05:56.737900] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-16T20:05:56.749800] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-16T20:05:57.129830] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-16T20:05:57.129934] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-16T20:05:57.130909] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-16T20:05:57.130990] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-16T20:05:57.147000] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T20:05:57.152419] [DEBUG] [LOCAL ] MCO: Trimmed 57887 records to 39795 (keeping 200 days of data) [2025-10-16T20:05:57.406223] [DEBUG] [LOCAL ] MCO: Primary data saved (39795 records). [2025-10-16T20:05:57.406455] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-16T20:05:57.406556] [INFO ] [MAIN ] Update Progress: 1316/2369 symbols completed. MCO took 43.3s. Estimated remaining: 2h 28m 45s. Rate: 7.1 symbols/min [2025-10-16T20:05:57.553132] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-16T20:05:57.582293] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:05:57.590987] [DEBUG] [LOCAL ] MDST: Loaded 5952 existing records from primary storage. [2025-10-16T20:05:57.591207] [INFO ] [MAIN ] MDST: Loaded 5952 existing records. [2025-10-16T20:05:57.775056] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:05:57.775274] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-16T20:05:57.775322] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-16T20:05:57.775465] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-16T20:05:57.775502] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-16T20:05:58.070196] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-16T20:05:58.151865] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:05:58.342876] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-10-16T20:05:59.105979] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-16T20:05:59.142769] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-16T20:05:59.204853] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T20:05:59.722212] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T20:05:59.942876] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-16T20:06:00.550802] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-16T20:06:00.742834] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-16T20:06:01.542877] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-16T20:06:02.166409] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T20:06:02.342839] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-16T20:06:02.630712] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T20:06:03.146627] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-16T20:06:03.150940] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T20:06:03.942808] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-16T20:06:04.606167] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T20:06:04.742837] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-16T20:06:05.187427] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-16T20:06:05.191908] [INFO ] [REMOTE ] MCS: Full fetch complete (30668 records). [2025-10-16T20:06:05.192057] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-16T20:06:05.552713] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-16T20:06:05.605964] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-16T20:06:05.606050] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-16T20:06:05.606790] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-16T20:06:05.606872] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-16T20:06:05.607834] [DEBUG] [LOCAL ] MCS: Trimmed 30668 records to 21302 (keeping 200 days of data) [2025-10-16T20:06:05.744914] [DEBUG] [LOCAL ] MCS: Primary data saved (21302 records). [2025-10-16T20:06:05.745047] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-16T20:06:05.745125] [INFO ] [MAIN ] Update Progress: 1317/2369 symbols completed. MCS took 41.3s. Estimated remaining: 2h 28m 36s. Rate: 7.1 symbols/min [2025-10-16T20:06:06.250491] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T20:06:06.323002] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T20:06:06.342808] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-16T20:06:07.142811] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-16T20:06:07.741162] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-16T20:06:07.762751] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T20:06:07.942770] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-16T20:06:08.499144] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-16T20:06:08.742876] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-16T20:06:09.542803] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-16T20:06:10.106066] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T20:06:10.112868] [INFO ] [REMOTE ] MD: Full fetch complete (55162 records). [2025-10-16T20:06:10.113057] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-16T20:06:10.363255] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-16T20:06:10.523009] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-16T20:06:10.523106] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-16T20:06:10.524078] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-16T20:06:10.524141] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-16T20:06:10.525265] [DEBUG] [LOCAL ] MD: Trimmed 55162 records to 38831 (keeping 200 days of data) [2025-10-16T20:06:10.754377] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T20:06:10.787263] [DEBUG] [LOCAL ] MD: Primary data saved (38831 records). [2025-10-16T20:06:10.787413] [INFO ] [MAIN ] MD: Full history saved. [2025-10-16T20:06:10.787521] [INFO ] [MAIN ] Update Progress: 1318/2369 symbols completed. MD took 25.0s. Estimated remaining: 2h 28m 25s. Rate: 7.1 symbols/min [2025-10-16T20:06:10.991885] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T20:06:11.142797] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-16T20:06:11.861144] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-16T20:06:11.942867] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-16T20:06:12.687214] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-16T20:06:12.742856] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-16T20:06:13.542889] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-16T20:06:13.867822] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-16T20:06:13.871164] [INFO ] [REMOTE ] MCY: Full fetch complete (41123 records). [2025-10-16T20:06:13.871266] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-16T20:06:14.247874] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-16T20:06:14.247958] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-16T20:06:14.248806] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-16T20:06:14.248873] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-16T20:06:14.249903] [DEBUG] [LOCAL ] MCY: Trimmed 41123 records to 24134 (keeping 200 days of data) [2025-10-16T20:06:14.348398] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T20:06:14.355703] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-16T20:06:14.415055] [DEBUG] [LOCAL ] MCY: Primary data saved (24134 records). [2025-10-16T20:06:14.415199] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-16T20:06:14.415277] [INFO ] [MAIN ] Update Progress: 1319/2369 symbols completed. MCY took 43.7s. Estimated remaining: 2h 28m 13s. Rate: 7.1 symbols/min [2025-10-16T20:06:15.101897] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T20:06:15.103526] [INFO ] [REMOTE ] MDST: Full fetch complete (8801 records). [2025-10-16T20:06:15.103599] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-16T20:06:15.458458] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-16T20:06:15.458579] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-16T20:06:15.458841] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-16T20:06:15.458902] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-16T20:06:15.459354] [DEBUG] [LOCAL ] MDST: Trimmed 8801 records to 6060 (keeping 200 days of data) [2025-10-16T20:06:15.495515] [DEBUG] [LOCAL ] MDST: Primary data saved (6060 records). [2025-10-16T20:06:15.495623] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-16T20:06:15.495743] [INFO ] [MAIN ] Update Progress: 1320/2369 symbols completed. MDST took 18.1s. Estimated remaining: 2h 27m 58s. Rate: 7.1 symbols/min [2025-10-16T20:06:16.042184] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:06:16.071333] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:06:16.122577] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:06:16.199175] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:06:16.209408] [DEBUG] [LOCAL ] MEC: Loaded 16364 existing records from primary storage. [2025-10-16T20:06:16.211592] [INFO ] [MAIN ] MEC: Loaded 16364 existing records. [2025-10-16T20:06:16.277118] [DEBUG] [LOCAL ] MDV: Loaded 8465 existing records from primary storage. [2025-10-16T20:06:16.294548] [INFO ] [MAIN ] MDV: Loaded 8465 existing records. [2025-10-16T20:06:16.553684] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:06:16.566580] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-16T20:06:16.565530] [DEBUG] [LOCAL ] MDU: Loaded 48061 existing records from primary storage. [2025-10-16T20:06:16.570549] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-16T20:06:16.570707] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-16T20:06:16.571106] [INFO ] [MAIN ] MDU: Loaded 48061 existing records. [2025-10-16T20:06:16.603325] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-16T20:06:16.701633] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-16T20:06:16.770051] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-16T20:06:16.978718] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:06:17.078225] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-16T20:06:17.105634] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-16T20:06:17.140164] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:06:17.151020] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-16T20:06:17.193555] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-16T20:06:17.204056] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-16T20:06:17.198812] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-16T20:06:17.233157] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:06:17.242912] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-16T20:06:17.242872] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-16T20:06:17.244015] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-16T20:06:17.345435] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-16T20:06:17.480966] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-16T20:06:17.515414] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-16T20:06:17.919454] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:06:18.003925] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-10-16T20:06:18.499841] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:06:18.494625] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:06:18.502879] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-10-16T20:06:18.528517] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-10-16T20:06:18.532256] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:06:18.533291] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-10-16T20:06:19.164220] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T20:06:19.168035] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-16T20:06:19.262880] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-16T20:06:19.264843] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-16T20:06:20.057330] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T20:06:20.061532] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-16T20:06:20.066711] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T20:06:20.237476] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T20:06:20.316796] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T20:06:20.495698] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T20:06:20.742832] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-16T20:06:21.542791] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-16T20:06:21.693633] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T20:06:21.946770] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T20:06:22.342854] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-16T20:06:23.142835] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-16T20:06:23.926112] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-16T20:06:23.942771] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-16T20:06:24.131455] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-16T20:06:24.697036] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-16T20:06:24.742774] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-16T20:06:25.542839] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-16T20:06:25.572692] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T20:06:26.342823] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-16T20:06:27.133591] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T20:06:27.144461] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-16T20:06:27.947977] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-16T20:06:27.975098] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T20:06:27.996510] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T20:06:28.742889] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-16T20:06:29.454346] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-16T20:06:29.532669] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T20:06:29.542771] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-16T20:06:30.342836] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-16T20:06:31.047248] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-16T20:06:31.079456] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T20:06:31.142823] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-16T20:06:31.942923] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-16T20:06:32.742798] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-16T20:06:32.922465] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T20:06:33.331382] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-16T20:06:33.542825] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-16T20:06:33.604010] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T20:06:34.342790] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-16T20:06:34.369102] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T20:06:34.370565] [INFO ] [REMOTE ] MDV: Full fetch complete (11698 records). [2025-10-16T20:06:34.370702] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-16T20:06:34.732884] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-16T20:06:34.732958] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-16T20:06:34.733263] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-16T20:06:34.733304] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-16T20:06:34.733769] [DEBUG] [LOCAL ] MDV: Trimmed 11698 records to 8490 (keeping 200 days of data) [2025-10-16T20:06:34.784080] [DEBUG] [LOCAL ] MDV: Primary data saved (8490 records). [2025-10-16T20:06:34.784191] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-16T20:06:34.784281] [INFO ] [MAIN ] Update Progress: 1321/2369 symbols completed. MDV took 19.3s. Estimated remaining: 2h 27m 58s. Rate: 7.1 symbols/min [2025-10-16T20:06:34.952914] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:06:34.974042] [DEBUG] [LOCAL ] MED: Loaded 21236 existing records from primary storage. [2025-10-16T20:06:34.974281] [INFO ] [MAIN ] MED: Loaded 21236 existing records. [2025-10-16T20:06:35.147108] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-16T20:06:35.147017] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:06:35.148091] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-16T20:06:35.148147] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-16T20:06:35.148501] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-16T20:06:35.148567] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-16T20:06:35.521915] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:06:35.942832] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-10-16T20:06:36.218615] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-16T20:06:36.294400] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T20:06:36.742838] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-16T20:06:37.115915] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T20:06:37.542799] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-16T20:06:38.342780] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-16T20:06:38.499898] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-16T20:06:38.622075] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-16T20:06:39.142835] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-16T20:06:39.424246] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T20:06:39.942815] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-16T20:06:40.643839] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T20:06:40.742785] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-16T20:06:41.036486] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T20:06:41.542811] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-16T20:06:42.342847] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-16T20:06:42.726110] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T20:06:42.767214] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T20:06:43.142823] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-16T20:06:43.812039] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-16T20:06:43.884695] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T20:06:43.942844] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-16T20:06:44.742907] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-16T20:06:44.871188] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T20:06:45.542871] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-16T20:06:46.343207] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-16T20:06:46.349484] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T20:06:46.752477] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T20:06:47.142884] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-16T20:06:47.942881] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-16T20:06:48.142819] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T20:06:48.176424] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T20:06:48.742874] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-16T20:06:49.543398] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T20:06:49.543618] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-16T20:06:50.342843] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-16T20:06:50.574701] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T20:06:50.741375] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-16T20:06:51.142818] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-16T20:06:51.711345] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T20:06:51.942848] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-16T20:06:52.107030] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T20:06:52.113942] [INFO ] [REMOTE ] MDT: Full fetch complete (77857 records). [2025-10-16T20:06:52.114051] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-16T20:06:52.494708] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-16T20:06:52.494790] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-16T20:06:52.495876] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-16T20:06:52.495940] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-16T20:06:52.497333] [DEBUG] [LOCAL ] MDT: Trimmed 77857 records to 54068 (keeping 200 days of data) [2025-10-16T20:06:52.609334] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-16T20:06:52.748212] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-16T20:06:52.845985] [DEBUG] [LOCAL ] MDT: Primary data saved (54068 records). [2025-10-16T20:06:52.846124] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-16T20:06:52.846265] [INFO ] [MAIN ] Update Progress: 1322/2369 symbols completed. MDT took 37.3s. Estimated remaining: 2h 27m 57s. Rate: 7.1 symbols/min [2025-10-16T20:06:53.014794] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:06:53.045726] [DEBUG] [LOCAL ] MEG: Loaded 31598 existing records from primary storage. [2025-10-16T20:06:53.045994] [INFO ] [MAIN ] MEG: Loaded 31598 existing records. [2025-10-16T20:06:53.216206] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:06:53.216391] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-16T20:06:53.216449] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-16T20:06:53.216882] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-16T20:06:53.216952] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-16T20:06:53.556515] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-16T20:06:53.561111] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:06:53.757463] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T20:06:54.342863] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-10-16T20:06:55.142838] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-16T20:06:55.233979] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T20:06:55.823096] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T20:06:55.942827] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-16T20:06:55.963084] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T20:06:56.742856] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-16T20:06:56.805978] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-16T20:06:57.542831] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-16T20:06:58.124941] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T20:06:58.342800] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-16T20:06:58.429815] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T20:06:59.142816] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-16T20:06:59.315242] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T20:06:59.317776] [INFO ] [REMOTE ] MEC: Full fetch complete (22797 records). [2025-10-16T20:06:59.317848] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-16T20:06:59.672069] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-16T20:06:59.672144] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-16T20:06:59.672622] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-16T20:06:59.672828] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-16T20:06:59.673427] [DEBUG] [LOCAL ] MEC: Trimmed 22797 records to 16519 (keeping 200 days of data) [2025-10-16T20:06:59.769049] [DEBUG] [LOCAL ] MEC: Primary data saved (16519 records). [2025-10-16T20:06:59.769189] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-16T20:06:59.769270] [INFO ] [MAIN ] Update Progress: 1323/2369 symbols completed. MEC took 44.2s. Estimated remaining: 2h 27m 48s. Rate: 7.1 symbols/min [2025-10-16T20:06:59.932111] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:06:59.946232] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-16T20:06:59.956312] [DEBUG] [LOCAL ] MEGI: Loaded 19796 existing records from primary storage. [2025-10-16T20:06:59.956526] [INFO ] [MAIN ] MEGI: Loaded 19796 existing records. [2025-10-16T20:07:00.127908] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:07:00.128117] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-16T20:07:00.128164] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-16T20:07:00.128516] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-16T20:07:00.128589] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-16T20:07:00.468623] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:07:00.742842] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-10-16T20:07:00.827271] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T20:07:00.834103] [INFO ] [REMOTE ] MDU: Full fetch complete (70643 records). [2025-10-16T20:07:00.834224] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-16T20:07:00.977953] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-16T20:07:01.031963] [INFO ] [REMOTE ] MED: Full fetch complete (31965 records). [2025-10-16T20:07:01.078892] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-16T20:07:01.451351] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-16T20:07:01.488029] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-16T20:07:01.499770] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-16T20:07:01.510222] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-16T20:07:01.548089] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-16T20:07:01.548461] [DEBUG] [LOCAL ] MDU: Trimmed 70643 records to 48446 (keeping 200 days of data) [2025-10-16T20:07:01.611368] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-16T20:07:01.611488] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-16T20:07:01.612046] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-16T20:07:01.612137] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-16T20:07:01.700429] [DEBUG] [LOCAL ] MED: Trimmed 31965 records to 21369 (keeping 200 days of data) [2025-10-16T20:07:01.866316] [DEBUG] [LOCAL ] MED: Primary data saved (21369 records). [2025-10-16T20:07:01.867304] [INFO ] [MAIN ] MED: Full history saved. [2025-10-16T20:07:01.867940] [INFO ] [MAIN ] Update Progress: 1324/2369 symbols completed. MED took 27.1s. Estimated remaining: 2h 27m 34s. Rate: 7.1 symbols/min [2025-10-16T20:07:02.149829] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:07:02.170973] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T20:07:02.209726] [DEBUG] [LOCAL ] MEI: Loaded 31678 existing records from primary storage. [2025-10-16T20:07:02.212078] [INFO ] [MAIN ] MEI: Loaded 31678 existing records. [2025-10-16T20:07:02.357382] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-16T20:07:02.401738] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:07:02.405115] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-16T20:07:02.405203] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-16T20:07:02.424987] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-16T20:07:02.440603] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-16T20:07:02.671855] [DEBUG] [LOCAL ] MDU: Primary data saved (48446 records). [2025-10-16T20:07:02.710953] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-16T20:07:02.737902] [INFO ] [MAIN ] Update Progress: 1325/2369 symbols completed. MDU took 47.2s. Estimated remaining: 2h 27m 20s. Rate: 7.1 symbols/min [2025-10-16T20:07:02.857174] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:07:02.989400] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:07:03.036936] [DEBUG] [LOCAL ] MET: Loaded 53316 existing records from primary storage. [2025-10-16T20:07:03.037240] [INFO ] [MAIN ] MET: Loaded 53316 existing records. [2025-10-16T20:07:03.159576] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T20:07:03.147698] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-10-16T20:07:03.252174] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:07:03.258623] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-16T20:07:03.259129] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T20:07:03.258738] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-16T20:07:03.264843] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-16T20:07:03.264907] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-16T20:07:03.606120] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:07:03.942790] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-16T20:07:04.572533] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T20:07:04.742788] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-16T20:07:04.948709] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T20:07:05.542846] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-16T20:07:06.137698] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T20:07:06.342849] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-16T20:07:06.665451] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T20:07:07.142818] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-10-16T20:07:07.439824] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T20:07:07.942799] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-16T20:07:08.742796] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-16T20:07:08.968339] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T20:07:09.003575] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T20:07:09.542828] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-16T20:07:10.149375] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T20:07:10.342884] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-16T20:07:11.142868] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-16T20:07:11.395304] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T20:07:11.639215] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-16T20:07:11.942788] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-16T20:07:12.010106] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T20:07:12.742800] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-16T20:07:13.128977] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T20:07:13.542879] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-16T20:07:14.173682] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T20:07:14.342775] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-16T20:07:14.670590] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T20:07:15.142792] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-16T20:07:15.942783] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-16T20:07:16.000044] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T20:07:16.547865] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T20:07:16.742786] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-16T20:07:16.940248] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T20:07:17.542871] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-16T20:07:17.951793] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T20:07:18.342814] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-16T20:07:18.967579] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T20:07:19.142820] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-16T20:07:19.790749] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T20:07:19.795404] [INFO ] [REMOTE ] MEG: Full fetch complete (47563 records). [2025-10-16T20:07:19.795569] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-16T20:07:19.951389] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-16T20:07:20.172042] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-16T20:07:20.172120] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-16T20:07:20.172958] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-16T20:07:20.173019] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-16T20:07:20.174020] [DEBUG] [LOCAL ] MEG: Trimmed 47563 records to 31847 (keeping 200 days of data) [2025-10-16T20:07:20.355157] [DEBUG] [LOCAL ] MEG: Primary data saved (31847 records). [2025-10-16T20:07:20.355303] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-16T20:07:20.355394] [INFO ] [MAIN ] Update Progress: 1326/2369 symbols completed. MEG took 27.5s. Estimated remaining: 2h 27m 18s. Rate: 7.1 symbols/min [2025-10-16T20:07:20.529764] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:07:20.569373] [DEBUG] [LOCAL ] MFA: Loaded 45762 existing records from primary storage. [2025-10-16T20:07:20.569725] [INFO ] [MAIN ] MFA: Loaded 45762 existing records. [2025-10-16T20:07:20.743266] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-16T20:07:20.747125] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:07:20.748762] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-16T20:07:20.748835] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-16T20:07:20.749047] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-16T20:07:20.749095] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-16T20:07:21.111407] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:07:21.114206] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-16T20:07:21.147526] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T20:07:21.542855] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-10-16T20:07:21.801766] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T20:07:22.342814] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-16T20:07:23.142788] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-16T20:07:23.215381] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T20:07:23.942792] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-16T20:07:24.011035] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T20:07:24.246164] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T20:07:24.742805] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-16T20:07:25.478723] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T20:07:25.542771] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-16T20:07:26.002774] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T20:07:26.342808] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-16T20:07:27.147866] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-16T20:07:27.162488] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T20:07:27.531603] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-16T20:07:27.942820] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-16T20:07:28.742843] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-16T20:07:28.979748] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-16T20:07:29.542811] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-16T20:07:29.698678] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T20:07:30.210392] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T20:07:30.342799] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-16T20:07:31.142804] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-16T20:07:31.491981] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-16T20:07:31.649731] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T20:07:31.942789] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-16T20:07:32.650695] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T20:07:32.742829] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-16T20:07:33.542825] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-16T20:07:33.665903] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T20:07:33.906339] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T20:07:34.342844] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-16T20:07:35.142829] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-16T20:07:35.220603] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T20:07:35.709684] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-16T20:07:35.942815] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-16T20:07:36.742847] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-16T20:07:36.927281] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T20:07:37.379925] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T20:07:37.386928] [INFO ] [REMOTE ] MEI: Full fetch complete (45450 records). [2025-10-16T20:07:37.387140] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-16T20:07:37.548816] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-16T20:07:37.815532] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-16T20:07:37.821439] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-16T20:07:37.822454] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-16T20:07:37.822542] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-16T20:07:37.823978] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T20:07:37.829161] [DEBUG] [LOCAL ] MEI: Trimmed 45450 records to 31898 (keeping 200 days of data) [2025-10-16T20:07:38.012538] [DEBUG] [LOCAL ] MEI: Primary data saved (31898 records). [2025-10-16T20:07:38.012695] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-16T20:07:38.012803] [INFO ] [MAIN ] Update Progress: 1327/2369 symbols completed. MEI took 36.1s. Estimated remaining: 2h 27m 17s. Rate: 7.1 symbols/min [2025-10-16T20:07:38.183055] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:07:38.189132] [DEBUG] [LOCAL ] MFAN: Loaded 4377 existing records from primary storage. [2025-10-16T20:07:38.189331] [INFO ] [MAIN ] MFAN: Loaded 4377 existing records. [2025-10-16T20:07:38.359271] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-16T20:07:38.409979] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:07:38.410207] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-16T20:07:38.410256] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-16T20:07:38.410459] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-16T20:07:38.410517] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-16T20:07:38.827533] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:07:38.936768] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T20:07:39.142781] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-16T20:07:39.446883] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T20:07:39.449463] [INFO ] [REMOTE ] MEGI: Full fetch complete (29453 records). [2025-10-16T20:07:39.449537] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-16T20:07:39.812081] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-16T20:07:39.812154] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-16T20:07:39.812753] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-16T20:07:39.812815] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-16T20:07:39.813470] [DEBUG] [LOCAL ] MEGI: Trimmed 29453 records to 19957 (keeping 200 days of data) [2025-10-16T20:07:39.935459] [DEBUG] [LOCAL ] MEGI: Primary data saved (19957 records). [2025-10-16T20:07:39.935595] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-16T20:07:39.935697] [INFO ] [MAIN ] Update Progress: 1328/2369 symbols completed. MEGI took 40.2s. Estimated remaining: 2h 27m 4s. Rate: 7.1 symbols/min [2025-10-16T20:07:39.949189] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-16T20:07:40.116794] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:07:40.122702] [DEBUG] [LOCAL ] MFAO: Loaded 3980 existing records from primary storage. [2025-10-16T20:07:40.122929] [INFO ] [MAIN ] MFAO: Loaded 3980 existing records. [2025-10-16T20:07:40.301382] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:07:40.301627] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-16T20:07:40.301713] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-16T20:07:40.301948] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-16T20:07:40.302006] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-16T20:07:40.660611] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:07:40.686568] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T20:07:40.742765] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-16T20:07:40.985283] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T20:07:40.993246] [INFO ] [REMOTE ] MET: Full fetch complete (77358 records). [2025-10-16T20:07:40.993389] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-16T20:07:41.378487] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-16T20:07:41.378637] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-16T20:07:41.379808] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-16T20:07:41.379871] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-16T20:07:41.381460] [DEBUG] [LOCAL ] MET: Trimmed 77358 records to 53706 (keeping 200 days of data) [2025-10-16T20:07:41.556799] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-10-16T20:07:41.709548] [DEBUG] [LOCAL ] MET: Primary data saved (53706 records). [2025-10-16T20:07:41.709714] [INFO ] [MAIN ] MET: Full history saved. [2025-10-16T20:07:41.710467] [INFO ] [MAIN ] Update Progress: 1329/2369 symbols completed. MET took 39.0s. Estimated remaining: 2h 26m 50s. Rate: 7.1 symbols/min [2025-10-16T20:07:41.877569] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:07:41.927856] [DEBUG] [LOCAL ] MFC: Loaded 51094 existing records from primary storage. [2025-10-16T20:07:41.928164] [INFO ] [MAIN ] MFC: Loaded 51094 existing records. [2025-10-16T20:07:42.036235] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-16T20:07:42.115695] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:07:42.115898] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-16T20:07:42.115979] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-16T20:07:42.117033] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-16T20:07:42.117094] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-16T20:07:42.347960] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-16T20:07:42.483454] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:07:42.499970] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T20:07:42.925001] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T20:07:43.142881] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-10-16T20:07:43.942834] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-16T20:07:44.391538] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T20:07:44.742821] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-16T20:07:44.803592] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T20:07:45.359588] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-16T20:07:45.542822] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-16T20:07:46.127087] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-16T20:07:46.342845] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-10-16T20:07:46.794222] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-16T20:07:47.142831] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-16T20:07:47.695457] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T20:07:47.942815] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-16T20:07:48.542166] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T20:07:48.742820] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-16T20:07:49.542852] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-16T20:07:50.342850] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-16T20:07:50.451663] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T20:07:50.796287] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-16T20:07:51.142800] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-16T20:07:51.243323] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T20:07:51.496845] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-16T20:07:51.942886] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-16T20:07:52.517297] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T20:07:52.742803] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-16T20:07:53.315448] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T20:07:53.542812] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-16T20:07:54.342821] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-16T20:07:54.890666] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-16T20:07:55.142823] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-16T20:07:55.232821] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T20:07:55.669869] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-16T20:07:55.942811] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-16T20:07:56.587859] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-16T20:07:56.742813] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-16T20:07:57.542822] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-16T20:07:58.099908] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-16T20:07:58.342832] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-16T20:07:58.486361] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T20:07:58.492482] [INFO ] [REMOTE ] MFA: Full fetch complete (65446 records). [2025-10-16T20:07:58.492616] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-16T20:07:58.878007] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-16T20:07:58.878093] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-16T20:07:58.879121] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-16T20:07:58.879187] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-16T20:07:58.880465] [DEBUG] [LOCAL ] MFA: Trimmed 65446 records to 46093 (keeping 200 days of data) [2025-10-16T20:07:58.975710] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T20:07:59.144487] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-16T20:07:59.168223] [DEBUG] [LOCAL ] MFA: Primary data saved (46093 records). [2025-10-16T20:07:59.168341] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-16T20:07:59.168897] [INFO ] [MAIN ] Update Progress: 1330/2369 symbols completed. MFA took 38.8s. Estimated remaining: 2h 26m 48s. Rate: 7.1 symbols/min [2025-10-16T20:07:59.334222] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:07:59.382797] [DEBUG] [LOCAL ] MFG: Loaded 49508 existing records from primary storage. [2025-10-16T20:07:59.383113] [INFO ] [MAIN ] MFG: Loaded 49508 existing records. [2025-10-16T20:07:59.557285] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:07:59.557508] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-16T20:07:59.557556] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-16T20:07:59.557764] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-16T20:07:59.557821] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-16T20:07:59.635031] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-16T20:07:59.926397] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:07:59.942780] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-10-16T20:08:00.742812] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-16T20:08:01.535570] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T20:08:01.547088] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-16T20:08:02.093726] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-16T20:08:02.342844] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-16T20:08:02.406447] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T20:08:03.142823] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-16T20:08:03.732729] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T20:08:03.733823] [INFO ] [REMOTE ] MFAO: Full fetch complete (5453 records). [2025-10-16T20:08:03.733904] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-16T20:08:03.951737] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-16T20:08:04.057489] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T20:08:04.128306] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-16T20:08:04.128406] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-16T20:08:04.128588] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-16T20:08:04.128628] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-16T20:08:04.129026] [DEBUG] [LOCAL ] MFAO: Trimmed 5453 records to 3992 (keeping 200 days of data) [2025-10-16T20:08:04.153017] [DEBUG] [LOCAL ] MFAO: Primary data saved (3992 records). [2025-10-16T20:08:04.153091] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-16T20:08:04.153166] [INFO ] [MAIN ] Update Progress: 1331/2369 symbols completed. MFAO took 24.2s. Estimated remaining: 2h 26m 37s. Rate: 7.1 symbols/min [2025-10-16T20:08:04.326010] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:08:04.341486] [DEBUG] [LOCAL ] MFM: Loaded 14602 existing records from primary storage. [2025-10-16T20:08:04.341757] [INFO ] [MAIN ] MFM: Loaded 14602 existing records. [2025-10-16T20:08:04.518052] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:08:04.518261] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-16T20:08:04.518310] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-16T20:08:04.518525] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-16T20:08:04.518583] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-16T20:08:04.753829] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-16T20:08:04.868677] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:08:05.542800] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-10-16T20:08:05.735534] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T20:08:06.281955] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T20:08:06.298508] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-16T20:08:06.342777] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-16T20:08:07.068104] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-16T20:08:07.142765] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-16T20:08:07.942832] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-16T20:08:07.982268] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T20:08:08.742844] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-16T20:08:09.471419] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T20:08:09.542778] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-16T20:08:09.575581] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T20:08:09.872281] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-16T20:08:10.342801] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-16T20:08:11.142780] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-16T20:08:11.542919] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-16T20:08:11.942859] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-16T20:08:12.605817] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T20:08:12.607370] [INFO ] [REMOTE ] MFAN: Full fetch complete (5898 records). [2025-10-16T20:08:12.607463] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-16T20:08:12.752421] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-16T20:08:12.990528] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-16T20:08:12.990669] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-16T20:08:12.990872] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-16T20:08:12.991006] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-16T20:08:12.991637] [DEBUG] [LOCAL ] MFAN: Trimmed 5898 records to 4392 (keeping 200 days of data) [2025-10-16T20:08:13.046042] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T20:08:13.063615] [DEBUG] [LOCAL ] MFAN: Primary data saved (4392 records). [2025-10-16T20:08:13.063778] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-16T20:08:13.063859] [INFO ] [MAIN ] Update Progress: 1332/2369 symbols completed. MFAN took 35.1s. Estimated remaining: 2h 26m 29s. Rate: 7.1 symbols/min [2025-10-16T20:08:13.234989] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:08:13.235159] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-16T20:08:13.235196] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-16T20:08:13.235311] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-16T20:08:13.235351] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-16T20:08:13.235391] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-16T20:08:13.235423] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-16T20:08:13.556902] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-16T20:08:13.601714] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:08:14.342824] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-10-16T20:08:14.381115] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T20:08:14.410693] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T20:08:14.736734] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-16T20:08:15.142809] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-16T20:08:15.942870] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-16T20:08:16.742820] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-16T20:08:16.951532] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T20:08:17.542863] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-16T20:08:17.698521] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T20:08:17.718379] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-16T20:08:17.811437] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-16T20:08:18.342850] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-16T20:08:19.142841] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-16T20:08:19.386076] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-16T20:08:19.398211] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T20:08:19.942858] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-16T20:08:20.742866] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-16T20:08:21.053453] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-16T20:08:21.539397] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T20:08:21.542924] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-16T20:08:21.855163] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-16T20:08:22.342837] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-16T20:08:23.142816] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-16T20:08:23.389536] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-16T20:08:23.942827] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-16T20:08:24.041663] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T20:08:24.185519] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-16T20:08:24.742832] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-16T20:08:25.542824] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-16T20:08:26.322124] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T20:08:26.342773] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-16T20:08:26.514415] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T20:08:26.668098] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-16T20:08:27.142827] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-16T20:08:27.646803] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-16T20:08:27.942838] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-16T20:08:28.742864] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-16T20:08:29.542837] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-16T20:08:29.668398] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T20:08:30.088550] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-16T20:08:30.342805] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-16T20:08:30.611205] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-16T20:08:30.936118] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T20:08:30.937264] [INFO ] [REMOTE ] MFSB: Full fetch complete (1903 records). [2025-10-16T20:08:30.937334] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-16T20:08:31.113418] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-16T20:08:31.113692] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:08:31.113781] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:08:31.113874] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-16T20:08:31.113958] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-16T20:08:31.113998] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-16T20:08:31.114040] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-16T20:08:31.114098] [INFO ] [MAIN ] Update Progress: 1333/2369 symbols completed. MFSB took 18.1s. Estimated remaining: 2h 26m 28s. Rate: 7.1 symbols/min [2025-10-16T20:08:31.147930] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-16T20:08:31.285385] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:08:31.293034] [DEBUG] [LOCAL ] MFSG: Loaded 5774 existing records from primary storage. [2025-10-16T20:08:31.293243] [INFO ] [MAIN ] MFSG: Loaded 5774 existing records. [2025-10-16T20:08:31.487950] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:08:31.488143] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-16T20:08:31.488207] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-16T20:08:31.488419] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-16T20:08:31.488476] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-16T20:08:31.860152] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:08:31.942774] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-10-16T20:08:31.960894] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T20:08:32.306819] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-16T20:08:32.742827] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-16T20:08:33.542827] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-16T20:08:33.659062] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T20:08:33.661346] [INFO ] [REMOTE ] MFM: Full fetch complete (19414 records). [2025-10-16T20:08:33.661424] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-16T20:08:34.021214] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-16T20:08:34.021294] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-16T20:08:34.021714] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-16T20:08:34.021774] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-16T20:08:34.022382] [DEBUG] [LOCAL ] MFM: Trimmed 19414 records to 14665 (keeping 200 days of data) [2025-10-16T20:08:34.106931] [DEBUG] [LOCAL ] MFM: Primary data saved (14665 records). [2025-10-16T20:08:34.107082] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-16T20:08:34.107159] [INFO ] [MAIN ] Update Progress: 1334/2369 symbols completed. MFM took 30.0s. Estimated remaining: 2h 26m 15s. Rate: 7.1 symbols/min [2025-10-16T20:08:34.272090] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:08:34.283689] [DEBUG] [LOCAL ] MFSI: Loaded 12132 existing records from primary storage. [2025-10-16T20:08:34.283894] [INFO ] [MAIN ] MFSI: Loaded 12132 existing records. [2025-10-16T20:08:34.347912] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-16T20:08:34.465098] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:08:34.465342] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-16T20:08:34.465446] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-16T20:08:34.465892] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-16T20:08:34.465953] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-16T20:08:34.826898] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:08:34.829502] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T20:08:35.142783] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-16T20:08:35.271298] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T20:08:35.278006] [INFO ] [REMOTE ] MFG: Full fetch complete (69581 records). [2025-10-16T20:08:35.278131] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-16T20:08:35.587282] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T20:08:35.679554] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-16T20:08:35.679629] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-16T20:08:35.680631] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-16T20:08:35.680714] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-16T20:08:35.681961] [DEBUG] [LOCAL ] MFG: Trimmed 69581 records to 49867 (keeping 200 days of data) [2025-10-16T20:08:35.951118] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-10-16T20:08:35.954551] [DEBUG] [LOCAL ] MFG: Primary data saved (49867 records). [2025-10-16T20:08:35.954674] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-16T20:08:35.955268] [INFO ] [MAIN ] Update Progress: 1335/2369 symbols completed. MFG took 36.8s. Estimated remaining: 2h 26m 2s. Rate: 7.1 symbols/min [2025-10-16T20:08:36.126214] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:08:36.131398] [DEBUG] [LOCAL ] MFSV: Loaded 2827 existing records from primary storage. [2025-10-16T20:08:36.131562] [INFO ] [MAIN ] MFSV: Loaded 2827 existing records. [2025-10-16T20:08:36.304795] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:08:36.304992] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-16T20:08:36.305041] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-16T20:08:36.305168] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-16T20:08:36.305207] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-16T20:08:36.657595] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:08:36.658201] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T20:08:36.742771] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-10-16T20:08:37.060835] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-16T20:08:37.542794] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-16T20:08:38.342818] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-16T20:08:38.804919] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-16T20:08:39.142790] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-16T20:08:39.267693] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T20:08:39.786382] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-16T20:08:39.942815] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-16T20:08:40.514072] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T20:08:40.742875] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-16T20:08:41.329672] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-16T20:08:41.542832] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-16T20:08:42.055335] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-16T20:08:42.342835] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-16T20:08:42.961070] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-16T20:08:43.142862] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-16T20:08:43.942908] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-16T20:08:44.282530] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-16T20:08:44.742881] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-16T20:08:44.850818] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T20:08:45.307195] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T20:08:45.542858] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-16T20:08:45.959445] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-16T20:08:46.342817] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-16T20:08:46.774500] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-16T20:08:47.142852] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-16T20:08:47.942809] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-16T20:08:48.490280] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T20:08:48.742823] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-16T20:08:48.884931] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T20:08:48.891448] [INFO ] [REMOTE ] MFC: Full fetch complete (74367 records). [2025-10-16T20:08:48.891599] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-16T20:08:49.211483] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-16T20:08:49.281193] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-16T20:08:49.281261] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-16T20:08:49.282443] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-16T20:08:49.282509] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-16T20:08:49.283967] [DEBUG] [LOCAL ] MFC: Trimmed 74367 records to 51434 (keeping 200 days of data) [2025-10-16T20:08:49.567342] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-16T20:08:49.613477] [DEBUG] [LOCAL ] MFC: Primary data saved (51434 records). [2025-10-16T20:08:49.613667] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-16T20:08:49.614303] [INFO ] [MAIN ] Update Progress: 1336/2369 symbols completed. MFC took 1m 8s. Estimated remaining: 2h 25m 57s. Rate: 7.1 symbols/min [2025-10-16T20:08:49.788196] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:08:49.804963] [DEBUG] [LOCAL ] MG: Loaded 15861 existing records from primary storage. [2025-10-16T20:08:49.805236] [INFO ] [MAIN ] MG: Loaded 15861 existing records. [2025-10-16T20:08:49.988621] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:08:49.988862] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-16T20:08:49.988911] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-16T20:08:49.989272] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-16T20:08:49.989356] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-16T20:08:50.274197] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-16T20:08:50.351422] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-16T20:08:50.357552] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:08:50.922737] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T20:08:51.142834] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-16T20:08:51.942788] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-16T20:08:51.949212] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T20:08:52.742813] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-16T20:08:52.828139] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T20:08:53.542787] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-10-16T20:08:53.558063] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-16T20:08:53.559891] [INFO ] [REMOTE ] MFSG: Full fetch complete (6644 records). [2025-10-16T20:08:53.559963] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-16T20:08:53.934169] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-16T20:08:53.934242] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-16T20:08:53.934430] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-16T20:08:53.934473] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-16T20:08:53.934894] [DEBUG] [LOCAL ] MFSG: Trimmed 6644 records to 5852 (keeping 200 days of data) [2025-10-16T20:08:53.971007] [DEBUG] [LOCAL ] MFSG: Primary data saved (5852 records). [2025-10-16T20:08:53.971139] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-16T20:08:53.971221] [INFO ] [MAIN ] Update Progress: 1337/2369 symbols completed. MFSG took 22.9s. Estimated remaining: 2h 25m 46s. Rate: 7.1 symbols/min [2025-10-16T20:08:54.143623] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:08:54.190844] [DEBUG] [LOCAL ] MGA: Loaded 50591 existing records from primary storage. [2025-10-16T20:08:54.191191] [INFO ] [MAIN ] MGA: Loaded 50591 existing records. [2025-10-16T20:08:54.348521] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-16T20:08:54.380687] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:08:54.380952] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-16T20:08:54.381004] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-16T20:08:54.381940] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-16T20:08:54.382000] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-16T20:08:54.684076] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T20:08:54.766316] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:08:55.133955] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-16T20:08:55.142755] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-16T20:08:55.922482] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T20:08:55.942765] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-16T20:08:56.742884] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-10-16T20:08:56.848162] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-16T20:08:57.542822] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-16T20:08:58.342785] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-16T20:08:58.452826] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T20:08:58.534934] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T20:08:58.618526] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-16T20:08:59.142920] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-16T20:08:59.942816] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-16T20:09:00.073148] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T20:09:00.742820] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-16T20:09:01.542832] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-16T20:09:01.765110] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T20:09:01.767842] [INFO ] [REMOTE ] MFSI: Full fetch complete (14632 records). [2025-10-16T20:09:01.767936] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-16T20:09:02.155241] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-16T20:09:02.155383] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-16T20:09:02.156011] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-16T20:09:02.156302] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-16T20:09:02.167887] [DEBUG] [LOCAL ] MFSI: Trimmed 14632 records to 12301 (keeping 200 days of data) [2025-10-16T20:09:02.169278] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-16T20:09:02.257707] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-16T20:09:02.288335] [DEBUG] [LOCAL ] MFSI: Primary data saved (12301 records). [2025-10-16T20:09:02.288521] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-16T20:09:02.288603] [INFO ] [MAIN ] Update Progress: 1338/2369 symbols completed. MFSI took 28.2s. Estimated remaining: 2h 25m 37s. Rate: 7.1 symbols/min [2025-10-16T20:09:02.351485] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-16T20:09:02.464035] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:09:02.469884] [DEBUG] [LOCAL ] MGF: Loaded 4154 existing records from primary storage. [2025-10-16T20:09:02.470116] [INFO ] [MAIN ] MGF: Loaded 4154 existing records. [2025-10-16T20:09:02.657377] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:09:02.657602] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-16T20:09:02.657675] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-16T20:09:02.657881] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-16T20:09:02.657922] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-16T20:09:02.906088] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T20:09:03.043468] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:09:03.142851] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-10-16T20:09:03.911907] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T20:09:03.942776] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-16T20:09:04.633359] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T20:09:04.742767] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-16T20:09:05.542900] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-16T20:09:06.321898] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T20:09:06.342782] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-16T20:09:06.404679] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T20:09:07.142805] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-16T20:09:07.480939] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T20:09:07.942843] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-16T20:09:08.519489] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T20:09:08.742866] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-16T20:09:09.086479] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-16T20:09:09.088247] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T20:09:09.542878] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-16T20:09:10.342888] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-16T20:09:10.907351] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-16T20:09:11.142811] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-16T20:09:11.241496] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T20:09:11.643087] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-16T20:09:11.942874] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-16T20:09:12.531801] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T20:09:12.742805] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-16T20:09:13.318464] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T20:09:13.542807] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-16T20:09:14.116267] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T20:09:14.342823] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-16T20:09:14.913125] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T20:09:15.142813] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-16T20:09:15.942857] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-16T20:09:16.742733] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-16T20:09:16.937749] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T20:09:16.993690] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T20:09:17.108443] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-16T20:09:17.542869] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-16T20:09:18.342839] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-16T20:09:18.609475] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-16T20:09:19.142878] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-16T20:09:19.725057] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T20:09:19.942852] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-16T20:09:20.011935] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T20:09:20.742788] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-16T20:09:20.958449] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T20:09:21.508412] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-16T20:09:21.509723] [INFO ] [REMOTE ] MFSV: Full fetch complete (3557 records). [2025-10-16T20:09:21.509795] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-16T20:09:21.548772] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-16T20:09:21.869296] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-16T20:09:21.869372] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-16T20:09:21.869512] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-16T20:09:21.869573] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-16T20:09:21.869964] [DEBUG] [LOCAL ] MFSV: Trimmed 3557 records to 2875 (keeping 200 days of data) [2025-10-16T20:09:21.887128] [DEBUG] [LOCAL ] MFSV: Primary data saved (2875 records). [2025-10-16T20:09:21.887248] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-16T20:09:21.887325] [INFO ] [MAIN ] Update Progress: 1339/2369 symbols completed. MFSV took 45.9s. Estimated remaining: 2h 25m 37s. Rate: 7.1 symbols/min [2025-10-16T20:09:22.057401] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:09:22.110110] [DEBUG] [LOCAL ] MGM: Loaded 53607 existing records from primary storage. [2025-10-16T20:09:22.110536] [INFO ] [MAIN ] MGM: Loaded 53607 existing records. [2025-10-16T20:09:22.283443] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:09:22.283689] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-16T20:09:22.283747] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-16T20:09:22.284529] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-16T20:09:22.284596] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-16T20:09:22.347958] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-16T20:09:22.633743] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:09:23.142818] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-10-16T20:09:23.275672] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T20:09:23.303261] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T20:09:23.942819] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-16T20:09:24.622819] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-16T20:09:24.742786] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-16T20:09:25.032147] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-16T20:09:25.542869] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-16T20:09:25.728958] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T20:09:26.109753] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T20:09:26.110900] [INFO ] [REMOTE ] MGF: Full fetch complete (5812 records). [2025-10-16T20:09:26.110969] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-16T20:09:26.348020] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-16T20:09:26.462801] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-16T20:09:26.462874] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-16T20:09:26.463027] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-16T20:09:26.463067] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-16T20:09:26.463429] [DEBUG] [LOCAL ] MGF: Trimmed 5812 records to 4176 (keeping 200 days of data) [2025-10-16T20:09:26.486947] [DEBUG] [LOCAL ] MGF: Primary data saved (4176 records). [2025-10-16T20:09:26.487021] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-16T20:09:26.487091] [INFO ] [MAIN ] Update Progress: 1340/2369 symbols completed. MGF took 24.2s. Estimated remaining: 2h 25m 26s. Rate: 7.1 symbols/min [2025-10-16T20:09:26.649237] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:09:26.656739] [DEBUG] [LOCAL ] MGR: Loaded 5619 existing records from primary storage. [2025-10-16T20:09:26.656957] [INFO ] [MAIN ] MGR: Loaded 5619 existing records. [2025-10-16T20:09:26.837520] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:09:26.837817] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-16T20:09:26.837871] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-16T20:09:26.838126] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-16T20:09:26.838185] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-16T20:09:27.147923] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-16T20:09:27.203907] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:09:27.942856] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-10-16T20:09:28.143261] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T20:09:28.145489] [INFO ] [REMOTE ] MG: Full fetch complete (23565 records). [2025-10-16T20:09:28.145558] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-16T20:09:28.557243] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-16T20:09:28.557665] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-16T20:09:28.560915] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-16T20:09:28.559617] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-16T20:09:28.561139] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-16T20:09:28.573571] [DEBUG] [LOCAL ] MG: Trimmed 23565 records to 15959 (keeping 200 days of data) [2025-10-16T20:09:28.688486] [DEBUG] [LOCAL ] MG: Primary data saved (15959 records). [2025-10-16T20:09:28.688742] [INFO ] [MAIN ] MG: Full history saved. [2025-10-16T20:09:28.688869] [INFO ] [MAIN ] Update Progress: 1341/2369 symbols completed. MG took 39.1s. Estimated remaining: 2h 25m 12s. Rate: 7.1 symbols/min [2025-10-16T20:09:28.747525] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-16T20:09:28.813484] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T20:09:28.889427] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:09:28.897002] [DEBUG] [LOCAL ] MGRB: Loaded 4034 existing records from primary storage. [2025-10-16T20:09:28.897287] [INFO ] [MAIN ] MGRB: Loaded 4034 existing records. [2025-10-16T20:09:29.082210] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:09:29.082530] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-16T20:09:29.082582] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-16T20:09:29.082969] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-16T20:09:29.083030] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-16T20:09:29.462255] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:09:29.542814] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-10-16T20:09:30.332214] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-16T20:09:30.342778] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-16T20:09:30.545012] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T20:09:30.998811] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-16T20:09:31.142821] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-16T20:09:31.942889] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-16T20:09:32.742873] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-16T20:09:32.988900] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T20:09:33.077495] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-16T20:09:33.542828] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-16T20:09:33.600555] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T20:09:34.175305] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-16T20:09:34.342861] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-16T20:09:34.905339] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-16T20:09:35.142882] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-16T20:09:35.942832] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-16T20:09:36.742874] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-16T20:09:36.858167] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T20:09:37.340346] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T20:09:37.542800] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-16T20:09:37.825284] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T20:09:38.342899] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-16T20:09:38.824298] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-16T20:09:39.142851] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-16T20:09:39.325333] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-16T20:09:39.332367] [INFO ] [REMOTE ] MGA: Full fetch complete (73729 records). [2025-10-16T20:09:39.332507] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-16T20:09:39.711386] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-16T20:09:39.711461] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-16T20:09:39.712521] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-16T20:09:39.712586] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-16T20:09:39.713954] [DEBUG] [LOCAL ] MGA: Trimmed 73729 records to 50889 (keeping 200 days of data) [2025-10-16T20:09:39.805135] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-16T20:09:39.947799] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-16T20:09:40.027172] [DEBUG] [LOCAL ] MGA: Primary data saved (50889 records). [2025-10-16T20:09:40.027327] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-16T20:09:40.027405] [INFO ] [MAIN ] Update Progress: 1342/2369 symbols completed. MGA took 46.1s. Estimated remaining: 2h 25m 6s. Rate: 7.1 symbols/min [2025-10-16T20:09:40.192464] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:09:40.196192] [DEBUG] [LOCAL ] MGRD: Loaded 2232 existing records from primary storage. [2025-10-16T20:09:40.196341] [INFO ] [MAIN ] MGRD: Loaded 2232 existing records. [2025-10-16T20:09:40.374819] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:09:40.375075] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-16T20:09:40.375124] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-16T20:09:40.375329] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-16T20:09:40.375414] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-16T20:09:40.669988] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T20:09:40.745562] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:09:40.745700] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-16T20:09:41.336420] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T20:09:41.542881] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-16T20:09:42.342818] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-16T20:09:42.930972] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-16T20:09:43.142871] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-16T20:09:43.446832] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T20:09:43.474251] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-16T20:09:43.942822] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-16T20:09:44.581535] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-16T20:09:44.742883] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-16T20:09:45.372935] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-16T20:09:45.542818] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-16T20:09:46.342867] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-16T20:09:47.058261] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-16T20:09:47.142799] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-16T20:09:47.312849] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T20:09:47.738297] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-16T20:09:47.942830] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-10-16T20:09:48.489053] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-16T20:09:48.742822] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-16T20:09:49.082606] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-16T20:09:49.542836] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-16T20:09:49.918661] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-16T20:09:50.342884] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-16T20:09:50.676072] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-16T20:09:51.142851] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-16T20:09:51.942813] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-16T20:09:52.742884] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-16T20:09:53.183102] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T20:09:53.542814] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-16T20:09:54.006624] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-16T20:09:54.007617] [INFO ] [REMOTE ] MGRB: Full fetch complete (5665 records). [2025-10-16T20:09:54.007718] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-16T20:09:54.351190] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-16T20:09:54.382719] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-16T20:09:54.382806] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-16T20:09:54.382971] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-16T20:09:54.383031] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-16T20:09:54.383397] [DEBUG] [LOCAL ] MGRB: Trimmed 5665 records to 4045 (keeping 200 days of data) [2025-10-16T20:09:54.409085] [DEBUG] [LOCAL ] MGRB: Primary data saved (4045 records). [2025-10-16T20:09:54.409166] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-16T20:09:54.409243] [INFO ] [MAIN ] Update Progress: 1343/2369 symbols completed. MGRB took 25.7s. Estimated remaining: 2h 25m 2s. Rate: 7.1 symbols/min [2025-10-16T20:09:54.571636] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:09:54.579312] [DEBUG] [LOCAL ] MGRE: Loaded 6560 existing records from primary storage. [2025-10-16T20:09:54.579510] [INFO ] [MAIN ] MGRE: Loaded 6560 existing records. [2025-10-16T20:09:54.754066] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:09:54.754308] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-16T20:09:54.754363] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-16T20:09:54.754672] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-16T20:09:54.754733] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-16T20:09:55.126703] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:09:55.142769] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-10-16T20:09:55.520988] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (4.38 seconds). [2025-10-16T20:09:55.522792] [INFO ] [REMOTE ] MGR: Full fetch complete (7957 records). [2025-10-16T20:09:55.522886] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-16T20:09:55.857171] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T20:09:55.916131] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-16T20:09:55.916368] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-16T20:09:55.916767] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-16T20:09:55.916855] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-16T20:09:55.917984] [DEBUG] [LOCAL ] MGR: Trimmed 7957 records to 5641 (keeping 200 days of data) [2025-10-16T20:09:55.945798] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-16T20:09:55.955890] [DEBUG] [LOCAL ] MGR: Primary data saved (5641 records). [2025-10-16T20:09:55.956032] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-16T20:09:55.956117] [INFO ] [MAIN ] Update Progress: 1344/2369 symbols completed. MGR took 29.5s. Estimated remaining: 2h 24m 48s. Rate: 7.1 symbols/min [2025-10-16T20:09:56.084398] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (4.14 seconds). [2025-10-16T20:09:56.167637] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:09:56.202516] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T20:09:56.255412] [DEBUG] [LOCAL ] MGY: Loaded 52423 existing records from primary storage. [2025-10-16T20:09:56.255789] [INFO ] [MAIN ] MGY: Loaded 52423 existing records. [2025-10-16T20:09:56.433326] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:09:56.433548] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-16T20:09:56.433599] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-16T20:09:56.434635] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-16T20:09:56.434728] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-16T20:09:56.698018] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T20:09:56.747919] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-16T20:09:56.799853] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:09:57.420975] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T20:09:57.542854] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-16T20:09:58.342885] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-16T20:09:58.777931] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-16T20:09:59.142807] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-10-16T20:09:59.270773] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T20:09:59.942824] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-16T20:10:00.751532] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-16T20:10:00.756855] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T20:10:01.236871] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-16T20:10:01.336259] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T20:10:01.542804] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-16T20:10:02.342869] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-16T20:10:02.821572] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-16T20:10:03.142824] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-16T20:10:03.360405] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T20:10:03.746003] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T20:10:03.942839] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-16T20:10:04.742814] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-16T20:10:05.542571] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T20:10:05.542794] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-16T20:10:05.632388] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T20:10:05.639352] [INFO ] [REMOTE ] MGM: Full fetch complete (77760 records). [2025-10-16T20:10:05.639510] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-16T20:10:05.921548] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-16T20:10:06.037356] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-16T20:10:06.037439] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-16T20:10:06.038526] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-16T20:10:06.038592] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-16T20:10:06.040059] [DEBUG] [LOCAL ] MGM: Trimmed 77760 records to 53997 (keeping 200 days of data) [2025-10-16T20:10:06.342966] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-16T20:10:06.362947] [DEBUG] [LOCAL ] MGM: Primary data saved (53997 records). [2025-10-16T20:10:06.363060] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-16T20:10:06.363717] [INFO ] [MAIN ] Update Progress: 1345/2369 symbols completed. MGM took 44.5s. Estimated remaining: 2h 24m 41s. Rate: 7.1 symbols/min [2025-10-16T20:10:06.535206] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:10:06.535437] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-16T20:10:06.535517] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-16T20:10:06.535639] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-16T20:10:06.535760] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-16T20:10:06.535826] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-16T20:10:06.535862] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-16T20:10:06.883974] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:10:07.142830] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-10-16T20:10:07.342959] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:10:07.343361] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-10-16T20:10:07.343450] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:10:07.343497] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-16T20:10:07.343556] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:10:07.343628] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-16T20:10:07.343725] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-16T20:10:07.343768] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-16T20:10:07.343809] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-16T20:10:07.343856] [INFO ] [MAIN ] Update Progress: 1346/2369 symbols completed. MH took 1.0s. Estimated remaining: 2h 24m 27s. Rate: 7.1 symbols/min [2025-10-16T20:10:07.517623] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:10:07.531400] [DEBUG] [LOCAL ] MHD: Loaded 12201 existing records from primary storage. [2025-10-16T20:10:07.531667] [INFO ] [MAIN ] MHD: Loaded 12201 existing records. [2025-10-16T20:10:07.712315] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:10:07.712677] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-16T20:10:07.712757] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-16T20:10:07.713100] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-16T20:10:07.713158] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-16T20:10:07.952022] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-16T20:10:08.111507] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:10:08.150177] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T20:10:08.742804] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-10-16T20:10:08.781327] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T20:10:09.542817] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-16T20:10:10.018180] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T20:10:10.342847] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-16T20:10:10.957356] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-16T20:10:11.142808] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-16T20:10:11.370260] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T20:10:11.942845] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-16T20:10:12.153680] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T20:10:12.227087] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-16T20:10:12.742839] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-16T20:10:13.542829] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-16T20:10:13.620292] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T20:10:14.342815] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-16T20:10:14.707811] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-16T20:10:15.046991] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T20:10:15.142795] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-16T20:10:15.937460] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T20:10:15.942780] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-16T20:10:16.377730] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-16T20:10:16.742811] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-16T20:10:17.232689] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T20:10:17.233545] [INFO ] [REMOTE ] MGRD: Full fetch complete (3464 records). [2025-10-16T20:10:17.233611] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-16T20:10:17.551465] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-16T20:10:17.622758] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-16T20:10:17.622834] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-16T20:10:17.622963] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-16T20:10:17.623002] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-16T20:10:17.623357] [DEBUG] [LOCAL ] MGRD: Trimmed 3464 records to 2246 (keeping 200 days of data) [2025-10-16T20:10:17.637352] [DEBUG] [LOCAL ] MGRD: Primary data saved (2246 records). [2025-10-16T20:10:17.637425] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-16T20:10:17.637494] [INFO ] [MAIN ] Update Progress: 1347/2369 symbols completed. MGRD took 37.6s. Estimated remaining: 2h 24m 20s. Rate: 7.1 symbols/min [2025-10-16T20:10:17.816409] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:10:17.825976] [DEBUG] [LOCAL ] MHF: Loaded 8872 existing records from primary storage. [2025-10-16T20:10:17.826212] [INFO ] [MAIN ] MHF: Loaded 8872 existing records. [2025-10-16T20:10:18.010441] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:10:18.010710] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-16T20:10:18.010767] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-16T20:10:18.011045] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-16T20:10:18.011102] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-16T20:10:18.346451] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-16T20:10:18.383880] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:10:19.049332] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-16T20:10:19.142789] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-16T20:10:19.303508] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T20:10:19.942815] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-16T20:10:20.126633] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T20:10:20.742832] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-10-16T20:10:21.495090] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T20:10:21.542813] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-16T20:10:21.765545] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T20:10:22.240571] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-16T20:10:22.342810] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-16T20:10:23.017309] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-16T20:10:23.142804] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-16T20:10:23.792318] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T20:10:23.942829] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-16T20:10:24.742825] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-16T20:10:25.542806] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-16T20:10:25.708314] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T20:10:25.722313] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T20:10:25.723418] [INFO ] [REMOTE ] MGRE: Full fetch complete (9270 records). [2025-10-16T20:10:25.723488] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-16T20:10:26.112341] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T20:10:26.120695] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-16T20:10:26.125413] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-16T20:10:26.125760] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-16T20:10:26.126226] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-16T20:10:26.126736] [DEBUG] [LOCAL ] MGRE: Trimmed 9270 records to 6594 (keeping 200 days of data) [2025-10-16T20:10:26.166918] [DEBUG] [LOCAL ] MGRE: Primary data saved (6594 records). [2025-10-16T20:10:26.167069] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-16T20:10:26.167169] [INFO ] [MAIN ] Update Progress: 1348/2369 symbols completed. MGRE took 31.8s. Estimated remaining: 2h 24m 12s. Rate: 7.1 symbols/min [2025-10-16T20:10:26.333394] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:10:26.342873] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-16T20:10:26.376819] [DEBUG] [LOCAL ] MHK: Loaded 42138 existing records from primary storage. [2025-10-16T20:10:26.377110] [INFO ] [MAIN ] MHK: Loaded 42138 existing records. [2025-10-16T20:10:26.552555] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:10:26.552829] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-16T20:10:26.552881] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-16T20:10:26.553730] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-16T20:10:26.553791] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-16T20:10:26.900610] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:10:27.142867] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-16T20:10:27.869346] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-16T20:10:27.942797] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-10-16T20:10:28.124108] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T20:10:28.742858] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-16T20:10:29.531223] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T20:10:29.542768] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-16T20:10:30.342888] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-16T20:10:30.538247] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T20:10:30.548855] [INFO ] [REMOTE ] MGY: Full fetch complete (75945 records). [2025-10-16T20:10:30.549088] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-16T20:10:31.137701] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-16T20:10:31.137864] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-16T20:10:31.139597] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-16T20:10:31.146965] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-16T20:10:31.145390] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-16T20:10:31.149925] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T20:10:31.179531] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T20:10:31.178044] [DEBUG] [LOCAL ] MGY: Trimmed 75945 records to 52803 (keeping 200 days of data) [2025-10-16T20:10:31.520039] [DEBUG] [LOCAL ] MGY: Primary data saved (52803 records). [2025-10-16T20:10:31.520175] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-16T20:10:31.520255] [INFO ] [MAIN ] Update Progress: 1349/2369 symbols completed. MGY took 35.6s. Estimated remaining: 2h 24m 1s. Rate: 7.1 symbols/min [2025-10-16T20:10:31.685868] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:10:31.686030] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-16T20:10:31.686066] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-16T20:10:31.686196] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-16T20:10:31.686237] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-16T20:10:31.686277] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-16T20:10:31.686308] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-16T20:10:31.943673] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-16T20:10:31.944134] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-16T20:10:32.065258] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:10:32.742863] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-16T20:10:33.474249] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T20:10:33.542794] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-16T20:10:33.598321] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T20:10:34.342854] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-10-16T20:10:34.701041] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-16T20:10:35.063495] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T20:10:35.142849] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-16T20:10:35.942821] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-16T20:10:36.742806] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-16T20:10:36.849049] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T20:10:36.883381] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-16T20:10:37.098677] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-16T20:10:37.542797] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-16T20:10:37.869982] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-16T20:10:38.342878] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-16T20:10:38.669796] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-16T20:10:39.142816] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-16T20:10:39.557296] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-16T20:10:39.942823] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-16T20:10:40.742830] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-16T20:10:41.402303] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T20:10:41.493568] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-16T20:10:41.542780] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-16T20:10:42.342791] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-16T20:10:42.428067] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T20:10:43.142807] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-16T20:10:43.836603] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T20:10:43.866679] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T20:10:43.942774] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-16T20:10:44.742811] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-16T20:10:45.493902] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T20:10:45.495874] [INFO ] [REMOTE ] MHD: Full fetch complete (18290 records). [2025-10-16T20:10:45.495966] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-16T20:10:45.548389] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-16T20:10:45.860152] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-16T20:10:45.876163] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-16T20:10:45.888393] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-16T20:10:45.888486] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-16T20:10:45.891189] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-16T20:10:45.901738] [DEBUG] [LOCAL ] MHD: Trimmed 18290 records to 12286 (keeping 200 days of data) [2025-10-16T20:10:45.977238] [DEBUG] [LOCAL ] MHD: Primary data saved (12286 records). [2025-10-16T20:10:45.977380] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-16T20:10:45.977462] [INFO ] [MAIN ] Update Progress: 1350/2369 symbols completed. MHD took 38.6s. Estimated remaining: 2h 23m 57s. Rate: 7.1 symbols/min [2025-10-16T20:10:46.178543] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-16T20:10:46.180370] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:10:46.194991] [DEBUG] [LOCAL ] MHN: Loaded 7476 existing records from primary storage. [2025-10-16T20:10:46.195279] [INFO ] [MAIN ] MHN: Loaded 7476 existing records. [2025-10-16T20:10:46.350477] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-16T20:10:46.391238] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:10:46.391676] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-16T20:10:46.391776] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-16T20:10:46.392103] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-16T20:10:46.392185] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-16T20:10:46.813226] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:10:46.936289] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T20:10:47.142828] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-10-16T20:10:47.813259] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-16T20:10:47.942828] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-16T20:10:48.687447] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T20:10:48.742855] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-16T20:10:49.462910] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-16T20:10:49.542896] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-16T20:10:50.342830] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-16T20:10:50.361873] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-16T20:10:50.690721] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-16T20:10:51.142950] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-16T20:10:51.942826] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-16T20:10:51.959803] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-16T20:10:52.673591] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T20:10:52.742813] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-16T20:10:52.972319] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-16T20:10:53.542807] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-16T20:10:54.342812] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-16T20:10:54.437249] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T20:10:55.142808] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-16T20:10:55.164522] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-16T20:10:55.773687] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-16T20:10:55.942810] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-16T20:10:56.420047] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-16T20:10:56.742834] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-16T20:10:57.075246] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-16T20:10:57.542812] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-16T20:10:57.877376] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-16T20:10:58.342814] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-16T20:10:59.142818] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-16T20:10:59.746269] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-16T20:10:59.816849] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T20:10:59.942792] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-16T20:11:00.742786] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-16T20:11:00.814173] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T20:11:00.815986] [INFO ] [REMOTE ] MHF: Full fetch complete (12873 records). [2025-10-16T20:11:00.816055] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-16T20:11:01.176330] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-16T20:11:01.176408] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-16T20:11:01.176719] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-16T20:11:01.176814] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-16T20:11:01.177270] [DEBUG] [LOCAL ] MHF: Trimmed 12873 records to 9009 (keeping 200 days of data) [2025-10-16T20:11:01.228978] [DEBUG] [LOCAL ] MHF: Primary data saved (9009 records). [2025-10-16T20:11:01.229094] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-16T20:11:01.229168] [INFO ] [MAIN ] Update Progress: 1351/2369 symbols completed. MHF took 43.6s. Estimated remaining: 2h 23m 53s. Rate: 7.1 symbols/min [2025-10-16T20:11:01.399258] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:11:01.421118] [DEBUG] [LOCAL ] MHO: Loaded 23792 existing records from primary storage. [2025-10-16T20:11:01.421363] [INFO ] [MAIN ] MHO: Loaded 23792 existing records. [2025-10-16T20:11:01.531350] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T20:11:01.547034] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-16T20:11:01.612673] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:11:01.612856] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-16T20:11:01.612903] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-16T20:11:01.613329] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-16T20:11:01.613386] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-16T20:11:01.973207] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:11:02.012592] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-16T20:11:02.013417] [INFO ] [REMOTE ] MHLA: Full fetch complete (1503 records). [2025-10-16T20:11:02.013489] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-16T20:11:02.194818] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-16T20:11:02.195043] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:11:02.195113] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:11:02.195187] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-16T20:11:02.195263] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-16T20:11:02.195321] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-16T20:11:02.195367] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-16T20:11:02.195423] [INFO ] [MAIN ] Update Progress: 1352/2369 symbols completed. MHLA took 30.7s. Estimated remaining: 2h 23m 39s. Rate: 7.1 symbols/min [2025-10-16T20:11:02.347404] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-16T20:11:02.372774] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:11:02.373141] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-16T20:11:02.373186] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-16T20:11:02.373301] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-16T20:11:02.373342] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-16T20:11:02.373381] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-16T20:11:02.373412] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-16T20:11:02.722063] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:11:03.142843] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-16T20:11:03.911080] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T20:11:03.939525] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T20:11:03.947873] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-10-16T20:11:04.149147] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:11:04.149473] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-10-16T20:11:04.149566] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:11:04.149614] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-16T20:11:04.149710] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:11:04.149785] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-16T20:11:04.149848] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-16T20:11:04.149887] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-16T20:11:04.149928] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-16T20:11:04.149976] [INFO ] [MAIN ] Update Progress: 1353/2369 symbols completed. MIAX took 2.0s. Estimated remaining: 2h 23m 26s. Rate: 7.1 symbols/min [2025-10-16T20:11:04.322086] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:11:04.335416] [DEBUG] [LOCAL ] MIN: Loaded 13871 existing records from primary storage. [2025-10-16T20:11:04.335637] [INFO ] [MAIN ] MIN: Loaded 13871 existing records. [2025-10-16T20:11:04.510679] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:11:04.510889] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-16T20:11:04.510937] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-16T20:11:04.511344] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-16T20:11:04.511408] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-16T20:11:04.747988] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-16T20:11:04.863550] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:11:05.206313] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-16T20:11:05.542758] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-16T20:11:06.342823] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-16T20:11:07.028263] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T20:11:07.033826] [INFO ] [REMOTE ] MHK: Full fetch complete (61176 records). [2025-10-16T20:11:07.034024] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-16T20:11:07.147996] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-10-16T20:11:07.336555] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T20:11:07.356067] [INFO ] [REMOTE ] MHN: Full fetch complete (11549 records). [2025-10-16T20:11:07.378782] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-16T20:11:07.616225] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-16T20:11:07.630795] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-16T20:11:07.647428] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-16T20:11:07.649495] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-16T20:11:07.749927] [DEBUG] [LOCAL ] MHK: Trimmed 61176 records to 42422 (keeping 200 days of data) [2025-10-16T20:11:07.934639] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-16T20:11:07.936538] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-16T20:11:07.937457] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-16T20:11:07.937923] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-16T20:11:07.945588] [DEBUG] [LOCAL ] MHN: Trimmed 11549 records to 7527 (keeping 200 days of data) [2025-10-16T20:11:07.947527] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-10-16T20:11:08.015460] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T20:11:08.017503] [DEBUG] [LOCAL ] MHN: Primary data saved (7527 records). [2025-10-16T20:11:08.018775] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-16T20:11:08.021111] [INFO ] [MAIN ] Update Progress: 1354/2369 symbols completed. MHN took 22.0s. Estimated remaining: 2h 23m 14s. Rate: 7.1 symbols/min [2025-10-16T20:11:08.279796] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:11:08.378932] [DEBUG] [LOCAL ] MIR: Loaded 51281 existing records from primary storage. [2025-10-16T20:11:08.380638] [INFO ] [MAIN ] MIR: Loaded 51281 existing records. [2025-10-16T20:11:08.611769] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:11:08.611865] [DEBUG] [LOCAL ] MHK: Primary data saved (42422 records). [2025-10-16T20:11:08.612183] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-16T20:11:08.612322] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-16T20:11:08.612452] [INFO ] [MAIN ] Update Progress: 1355/2369 symbols completed. MHK took 42.4s. Estimated remaining: 2h 22m 60s. Rate: 7.1 symbols/min [2025-10-16T20:11:08.612553] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-16T20:11:08.677573] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-16T20:11:08.688753] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-16T20:11:08.745267] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-16T20:11:08.901537] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:11:08.911958] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-16T20:11:08.917187] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-16T20:11:08.922465] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-16T20:11:08.936121] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-16T20:11:08.946563] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-16T20:11:08.955149] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-16T20:11:09.344489] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:11:09.514244] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:11:09.532468] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T20:11:09.542774] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-10-16T20:11:09.628147] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T20:11:09.935492] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-16T20:11:10.342853] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-10-16T20:11:11.142827] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-16T20:11:11.926727] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T20:11:11.942836] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-16T20:11:12.033955] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T20:11:12.742825] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-16T20:11:13.237147] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T20:11:13.542821] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-16T20:11:14.342799] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-16T20:11:14.465877] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T20:11:14.516074] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-16T20:11:14.678875] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-16T20:11:15.142804] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-16T20:11:15.942829] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-16T20:11:16.370960] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T20:11:16.426090] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T20:11:16.742818] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-16T20:11:17.542839] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-16T20:11:17.600658] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T20:11:18.091991] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-16T20:11:18.342844] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-16T20:11:19.142920] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-16T20:11:19.641473] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T20:11:19.942831] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-16T20:11:20.463197] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T20:11:20.742842] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-16T20:11:20.792886] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T20:11:21.542835] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-16T20:11:22.342805] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-16T20:11:22.403753] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T20:11:22.419902] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-16T20:11:23.142889] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-16T20:11:23.541920] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-16T20:11:23.631952] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-16T20:11:23.942834] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-16T20:11:24.276622] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-16T20:11:24.742811] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-16T20:11:25.542790] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-16T20:11:25.857977] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T20:11:26.342803] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-16T20:11:26.424024] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T20:11:27.142840] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-16T20:11:27.942796] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-16T20:11:28.014165] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T20:11:28.218770] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T20:11:28.742854] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-16T20:11:29.012060] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-16T20:11:29.026100] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T20:11:29.542870] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-16T20:11:30.342858] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-16T20:11:30.826967] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-16T20:11:31.142837] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-16T20:11:31.255921] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T20:11:31.942817] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-16T20:11:32.507085] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T20:11:32.690104] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T20:11:32.742801] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-16T20:11:33.542781] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-16T20:11:33.704015] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T20:11:33.707434] [INFO ] [REMOTE ] MIN: Full fetch complete (18048 records). [2025-10-16T20:11:33.707509] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-16T20:11:34.078572] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-16T20:11:34.078674] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-16T20:11:34.079113] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-16T20:11:34.079154] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-16T20:11:34.079717] [DEBUG] [LOCAL ] MIN: Trimmed 18048 records to 14021 (keeping 200 days of data) [2025-10-16T20:11:34.162141] [DEBUG] [LOCAL ] MIN: Primary data saved (14021 records). [2025-10-16T20:11:34.162285] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-16T20:11:34.162367] [INFO ] [MAIN ] Update Progress: 1356/2369 symbols completed. MIN took 30.0s. Estimated remaining: 2h 23m 4s. Rate: 7.1 symbols/min [2025-10-16T20:11:34.355558] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-16T20:11:34.358446] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:11:34.363332] [DEBUG] [LOCAL ] MITP: Loaded 2320 existing records from primary storage. [2025-10-16T20:11:34.363697] [INFO ] [MAIN ] MITP: Loaded 2320 existing records. [2025-10-16T20:11:34.541776] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:11:34.542020] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-16T20:11:34.542073] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-16T20:11:34.542247] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-16T20:11:34.542303] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-16T20:11:34.729612] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-16T20:11:34.920393] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:11:35.142822] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-16T20:11:35.942814] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-10-16T20:11:36.004418] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T20:11:36.348758] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T20:11:36.351961] [INFO ] [REMOTE ] MHO: Full fetch complete (36671 records). [2025-10-16T20:11:36.352104] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-16T20:11:36.456447] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-16T20:11:36.733089] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-16T20:11:36.733184] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-16T20:11:36.734001] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-16T20:11:36.734074] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-16T20:11:36.734943] [DEBUG] [LOCAL ] MHO: Trimmed 36671 records to 23951 (keeping 200 days of data) [2025-10-16T20:11:36.784789] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-16T20:11:36.877981] [DEBUG] [LOCAL ] MHO: Primary data saved (23951 records). [2025-10-16T20:11:36.878114] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-16T20:11:36.878205] [INFO ] [MAIN ] Update Progress: 1357/2369 symbols completed. MHO took 35.6s. Estimated remaining: 2h 22m 51s. Rate: 7.1 symbols/min [2025-10-16T20:11:37.252939] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T20:11:37.542842] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-16T20:11:37.981441] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T20:11:38.342833] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-16T20:11:38.757724] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-16T20:11:39.142822] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-16T20:11:39.604024] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-16T20:11:39.942878] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-16T20:11:40.742831] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-16T20:11:41.391887] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T20:11:41.521206] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T20:11:41.542807] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-16T20:11:42.342891] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-16T20:11:43.142806] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-16T20:11:43.202104] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T20:11:43.213741] [INFO ] [REMOTE ] MITN: Full fetch complete (2369 records). [2025-10-16T20:11:43.231017] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-16T20:11:43.302546] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T20:11:43.421849] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-16T20:11:43.422064] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:11:43.422146] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:11:43.422229] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-16T20:11:43.422306] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-16T20:11:43.422384] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-16T20:11:43.422464] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-16T20:11:43.422553] [INFO ] [MAIN ] Update Progress: 1358/2369 symbols completed. MITN took 34.8s. Estimated remaining: 2h 22m 41s. Rate: 7.1 symbols/min [2025-10-16T20:11:43.677911] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-16T20:11:43.942828] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-16T20:11:44.500535] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-16T20:11:44.742828] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-16T20:11:45.077744] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-16T20:11:45.542875] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-16T20:11:45.966803] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-16T20:11:46.342876] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-16T20:11:46.790870] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T20:11:47.142806] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-16T20:11:47.560685] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-16T20:11:47.942885] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-16T20:11:48.742881] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-16T20:11:49.181590] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-16T20:11:49.182375] [INFO ] [REMOTE ] MITP: Full fetch complete (3275 records). [2025-10-16T20:11:49.182442] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-16T20:11:49.579155] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-16T20:11:49.579317] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-16T20:11:49.579460] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-16T20:11:49.579584] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-16T20:11:49.580148] [DEBUG] [LOCAL ] MITP: Trimmed 3275 records to 2328 (keeping 200 days of data) [2025-10-16T20:11:49.620740] [DEBUG] [LOCAL ] MITP: Primary data saved (2328 records). [2025-10-16T20:11:49.621392] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-16T20:11:49.621481] [INFO ] [MAIN ] Update Progress: 1359/2369 symbols completed. MITP took 15.5s. Estimated remaining: 2h 22m 31s. Rate: 7.1 symbols/min [2025-10-16T20:11:49.622564] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T20:11:49.634145] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-16T20:11:51.466685] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T20:11:51.478958] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-16T20:11:53.350776] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-16T20:11:53.360090] [INFO ] [REMOTE ] MIR: Full fetch complete (73881 records). [2025-10-16T20:11:53.360223] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-16T20:11:53.741129] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-16T20:11:53.741236] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-16T20:11:53.742321] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-16T20:11:53.742383] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-16T20:11:53.743737] [DEBUG] [LOCAL ] MIR: Trimmed 73881 records to 51674 (keeping 200 days of data) [2025-10-16T20:11:54.038471] [DEBUG] [LOCAL ] MIR: Primary data saved (51674 records). [2025-10-16T20:11:54.038603] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-16T20:11:54.038703] [INFO ] [MAIN ] Update Progress: 1360/2369 symbols completed. MIR took 46.0s. Estimated remaining: 2h 22m 20s. Rate: 7.1 symbols/min [2025-10-16T20:11:54.637709] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:11:54.669869] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:11:54.709865] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:11:54.762202] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:11:54.785944] [DEBUG] [LOCAL ] MIY: Loaded 6260 existing records from primary storage. [2025-10-16T20:11:54.787622] [INFO ] [MAIN ] MIY: Loaded 6260 existing records. [2025-10-16T20:11:54.810407] [DEBUG] [LOCAL ] MITT: Loaded 22621 existing records from primary storage. [2025-10-16T20:11:54.837170] [INFO ] [MAIN ] MITT: Loaded 22621 existing records. [2025-10-16T20:11:55.014136] [DEBUG] [LOCAL ] MKL: Loaded 34067 existing records from primary storage. [2025-10-16T20:11:55.067036] [INFO ] [MAIN ] MKL: Loaded 34067 existing records. [2025-10-16T20:11:55.212992] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:11:55.251963] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-16T20:11:55.280604] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:11:55.291302] [DEBUG] [LOCAL ] MKC: Loaded 52520 existing records from primary storage. [2025-10-16T20:11:55.291910] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-16T20:11:55.292164] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-16T20:11:55.291988] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-16T20:11:55.292439] [INFO ] [MAIN ] MKC: Loaded 52520 existing records. [2025-10-16T20:11:55.306822] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-16T20:11:55.306979] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-16T20:11:55.322691] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-16T20:11:55.343533] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-16T20:11:55.804602] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:11:56.017357] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-16T20:11:56.083251] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:11:56.153779] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-16T20:11:56.138175] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-16T20:11:56.172392] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-16T20:11:56.177910] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-16T20:11:56.190855] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-16T20:11:56.196769] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-16T20:11:56.271507] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-16T20:11:56.391328] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:11:56.425473] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-10-16T20:11:56.502812] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:11:56.543623] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-10-16T20:11:57.033887] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:11:57.040116] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-10-16T20:11:57.116522] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:11:57.116906] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-10-16T20:11:57.438617] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-16T20:11:57.441347] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-16T20:11:57.848508] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T20:11:57.855298] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-16T20:11:58.114133] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T20:11:58.115980] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-16T20:11:58.355079] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T20:11:58.361917] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-16T20:11:58.780498] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-16T20:11:58.786111] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-16T20:11:58.935243] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-16T20:11:58.945782] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-16T20:11:58.949688] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T20:11:59.142772] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-16T20:11:59.397928] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-16T20:11:59.579946] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-16T20:11:59.605900] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T20:11:59.942799] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-16T20:12:00.381292] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T20:12:00.742810] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-16T20:12:01.512045] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T20:12:01.542783] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-16T20:12:01.718750] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T20:12:02.342807] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-16T20:12:03.142851] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-16T20:12:03.342739] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T20:12:03.723372] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T20:12:03.881801] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T20:12:03.942783] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-16T20:12:04.301865] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-16T20:12:04.742836] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-16T20:12:05.470053] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-16T20:12:05.542834] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-16T20:12:06.342822] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-16T20:12:07.136839] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T20:12:07.142766] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-16T20:12:07.413537] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T20:12:07.714815] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-16T20:12:07.942816] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-16T20:12:08.742817] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-16T20:12:09.060072] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T20:12:09.542833] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-16T20:12:10.235125] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T20:12:10.342785] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-16T20:12:11.142844] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-16T20:12:11.328313] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T20:12:11.893915] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T20:12:11.942792] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-16T20:12:12.304897] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-16T20:12:12.596099] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T20:12:12.742798] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-16T20:12:13.542832] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-16T20:12:14.280328] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T20:12:14.342789] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-16T20:12:14.585371] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T20:12:14.838872] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-16T20:12:14.841263] [INFO ] [REMOTE ] MIY: Full fetch complete (8900 records). [2025-10-16T20:12:14.841378] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-16T20:12:15.148123] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-16T20:12:15.326145] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-16T20:12:15.326256] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-16T20:12:15.326770] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-16T20:12:15.326850] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-16T20:12:15.327731] [DEBUG] [LOCAL ] MIY: Trimmed 8900 records to 6309 (keeping 200 days of data) [2025-10-16T20:12:15.381316] [DEBUG] [LOCAL ] MIY: Primary data saved (6309 records). [2025-10-16T20:12:15.381478] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-16T20:12:15.381570] [INFO ] [MAIN ] Update Progress: 1361/2369 symbols completed. MIY took 21.3s. Estimated remaining: 2h 22m 21s. Rate: 7.1 symbols/min [2025-10-16T20:12:15.616773] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:12:15.663389] [DEBUG] [LOCAL ] MLI: Loaded 43495 existing records from primary storage. [2025-10-16T20:12:15.663745] [INFO ] [MAIN ] MLI: Loaded 43495 existing records. [2025-10-16T20:12:15.879807] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:12:15.880041] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-16T20:12:15.880097] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-16T20:12:15.881042] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-16T20:12:15.881107] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-16T20:12:15.954567] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-16T20:12:16.259206] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:12:16.273624] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T20:12:16.742811] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-16T20:12:17.274689] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T20:12:17.542867] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-10-16T20:12:17.808104] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T20:12:18.342902] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-16T20:12:19.142798] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-16T20:12:19.182599] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T20:12:19.942876] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-16T20:12:20.147844] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T20:12:20.291448] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-16T20:12:20.294587] [INFO ] [REMOTE ] MITT: Full fetch complete (34009 records). [2025-10-16T20:12:20.294686] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-16T20:12:20.664136] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-16T20:12:20.664226] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-16T20:12:20.664939] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-16T20:12:20.665000] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-16T20:12:20.665788] [DEBUG] [LOCAL ] MITT: Trimmed 34009 records to 22805 (keeping 200 days of data) [2025-10-16T20:12:20.747297] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-16T20:12:20.796707] [DEBUG] [LOCAL ] MITT: Primary data saved (22805 records). [2025-10-16T20:12:20.796823] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-16T20:12:20.796896] [INFO ] [MAIN ] Update Progress: 1362/2369 symbols completed. MITT took 26.8s. Estimated remaining: 2h 22m 10s. Rate: 7.1 symbols/min [2025-10-16T20:12:20.965041] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:12:20.991359] [DEBUG] [LOCAL ] MLM: Loaded 29252 existing records from primary storage. [2025-10-16T20:12:20.991607] [INFO ] [MAIN ] MLM: Loaded 29252 existing records. [2025-10-16T20:12:21.171665] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:12:21.172046] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-16T20:12:21.172145] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-16T20:12:21.172747] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-16T20:12:21.172803] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-16T20:12:21.369749] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T20:12:21.562177] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:12:21.543495] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-16T20:12:22.342782] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-16T20:12:22.470853] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T20:12:22.951868] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T20:12:23.142863] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-10-16T20:12:23.544072] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T20:12:23.942891] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-16T20:12:24.727340] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T20:12:24.742780] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-16T20:12:25.347222] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T20:12:25.542810] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-16T20:12:25.995251] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-16T20:12:26.342815] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-16T20:12:26.934930] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T20:12:27.142791] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-16T20:12:27.942855] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-16T20:12:27.961164] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T20:12:28.564289] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T20:12:28.568953] [INFO ] [REMOTE ] MKL: Full fetch complete (49987 records). [2025-10-16T20:12:28.569056] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-16T20:12:28.754168] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-16T20:12:28.974928] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-16T20:12:28.975025] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-16T20:12:28.975919] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-16T20:12:28.975983] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-16T20:12:28.977078] [DEBUG] [LOCAL ] MKL: Trimmed 49987 records to 34376 (keeping 200 days of data) [2025-10-16T20:12:29.197265] [DEBUG] [LOCAL ] MKL: Primary data saved (34376 records). [2025-10-16T20:12:29.197406] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-16T20:12:29.197489] [INFO ] [MAIN ] Update Progress: 1363/2369 symbols completed. MKL took 35.2s. Estimated remaining: 2h 22m 1s. Rate: 7.1 symbols/min [2025-10-16T20:12:29.374162] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:12:29.401660] [DEBUG] [LOCAL ] MLNK: Loaded 26767 existing records from primary storage. [2025-10-16T20:12:29.401933] [INFO ] [MAIN ] MLNK: Loaded 26767 existing records. [2025-10-16T20:12:29.559140] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-16T20:12:29.600366] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:12:29.600974] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-10-16T20:12:29.601067] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-10-16T20:12:29.601670] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-10-16T20:12:29.601732] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-10-16T20:12:29.924009] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T20:12:30.022892] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:12:30.342809] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-10-16T20:12:30.444221] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T20:12:31.142786] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-16T20:12:31.270636] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T20:12:31.374121] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T20:12:31.942891] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-10-16T20:12:32.542740] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T20:12:32.742780] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-16T20:12:32.969425] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T20:12:33.542810] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-16T20:12:34.185724] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T20:12:34.342796] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-16T20:12:35.142787] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-16T20:12:35.455170] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T20:12:35.489517] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T20:12:35.942837] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-16T20:12:36.646744] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T20:12:36.742815] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-10-16T20:12:37.171575] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T20:12:37.542919] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-16T20:12:37.719041] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T20:12:38.342848] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-10-16T20:12:38.576421] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-16T20:12:39.142887] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-16T20:12:39.486220] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T20:12:39.942809] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-10-16T20:12:40.742828] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-16T20:12:40.781444] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T20:12:40.928267] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T20:12:41.542864] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-16T20:12:42.249371] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T20:12:42.342791] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-16T20:12:43.142914] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-10-16T20:12:43.284434] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T20:12:43.659122] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T20:12:43.939551] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T20:12:43.944755] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-16T20:12:44.742807] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-10-16T20:12:45.293624] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-16T20:12:45.297169] [INFO ] [REMOTE ] MLM: Full fetch complete (45332 records). [2025-10-16T20:12:45.297251] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-16T20:12:45.548019] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-16T20:12:45.720255] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-16T20:12:45.720349] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-16T20:12:45.721226] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-16T20:12:45.721304] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-16T20:12:45.737007] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T20:12:45.742735] [DEBUG] [LOCAL ] MLM: Trimmed 45332 records to 29440 (keeping 200 days of data) [2025-10-16T20:12:45.924868] [DEBUG] [LOCAL ] MLM: Primary data saved (29440 records). [2025-10-16T20:12:45.925025] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-16T20:12:45.925116] [INFO ] [MAIN ] Update Progress: 1364/2369 symbols completed. MLM took 25.1s. Estimated remaining: 2h 21m 59s. Rate: 7.1 symbols/min [2025-10-16T20:12:46.091021] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:12:46.095429] [DEBUG] [LOCAL ] MLP: Loaded 3075 existing records from primary storage. [2025-10-16T20:12:46.095581] [INFO ] [MAIN ] MLP: Loaded 3075 existing records. [2025-10-16T20:12:46.269621] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:12:46.269801] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-16T20:12:46.269865] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-16T20:12:46.270013] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-16T20:12:46.270054] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-16T20:12:46.347982] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-10-16T20:12:46.625966] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:12:47.142839] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-16T20:12:47.174764] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T20:12:47.181593] [INFO ] [REMOTE ] MKC: Full fetch complete (75933 records). [2025-10-16T20:12:47.181735] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-16T20:12:47.572487] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-16T20:12:47.579940] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-16T20:12:47.592979] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-16T20:12:47.593095] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-16T20:12:47.595258] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T20:12:47.604530] [DEBUG] [LOCAL ] MKC: Trimmed 75933 records to 52909 (keeping 200 days of data) [2025-10-16T20:12:47.933184] [DEBUG] [LOCAL ] MKC: Primary data saved (52909 records). [2025-10-16T20:12:47.933355] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-16T20:12:47.933465] [INFO ] [MAIN ] Update Progress: 1365/2369 symbols completed. MKC took 53.8s. Estimated remaining: 2h 21m 46s. Rate: 7.1 symbols/min [2025-10-16T20:12:47.947989] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-10-16T20:12:48.102087] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:12:48.113806] [DEBUG] [LOCAL ] MLR: Loaded 12461 existing records from primary storage. [2025-10-16T20:12:48.114011] [INFO ] [MAIN ] MLR: Loaded 12461 existing records. [2025-10-16T20:12:48.288297] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:12:48.288491] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-16T20:12:48.288542] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-16T20:12:48.288850] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-16T20:12:48.288909] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-16T20:12:48.644499] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:12:48.705797] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-16T20:12:48.745318] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-10-16T20:12:48.751778] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T20:12:49.542859] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-16T20:12:50.090750] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T20:12:50.342806] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-16T20:12:50.935538] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-16T20:12:51.001574] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T20:12:51.142784] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-16T20:12:51.495709] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-16T20:12:51.942803] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-16T20:12:52.431086] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-16T20:12:52.742796] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-10-16T20:12:53.542844] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-10-16T20:12:53.592212] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T20:12:54.342822] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-16T20:12:54.924809] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T20:12:55.142883] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-16T20:12:55.534549] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-16T20:12:55.741291] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-16T20:12:55.942850] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-16T20:12:56.519679] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T20:12:56.742825] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-16T20:12:57.542807] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-16T20:12:58.128021] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-16T20:12:58.342795] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-16T20:12:58.402411] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T20:12:58.407879] [INFO ] [REMOTE ] MLI: Full fetch complete (63181 records). [2025-10-16T20:12:58.408014] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-16T20:12:58.789206] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-16T20:12:58.789296] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-16T20:12:58.790320] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-16T20:12:58.790389] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-16T20:12:58.791592] [DEBUG] [LOCAL ] MLI: Trimmed 63181 records to 43798 (keeping 200 days of data) [2025-10-16T20:12:59.064272] [DEBUG] [LOCAL ] MLI: Primary data saved (43798 records). [2025-10-16T20:12:59.064414] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-16T20:12:59.065086] [INFO ] [MAIN ] Update Progress: 1366/2369 symbols completed. MLI took 43.7s. Estimated remaining: 2h 21m 39s. Rate: 7.1 symbols/min [2025-10-16T20:12:59.148592] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-10. [2025-10-16T20:12:59.237336] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:12:59.294550] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T20:12:59.295701] [DEBUG] [LOCAL ] MMC: Loaded 51929 existing records from primary storage. [2025-10-16T20:12:59.299317] [INFO ] [MAIN ] MMC: Loaded 51929 existing records. [2025-10-16T20:12:59.472347] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:12:59.472545] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-16T20:12:59.472594] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-16T20:12:59.473569] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-16T20:12:59.473628] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-16T20:12:59.828262] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:12:59.942831] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-16T20:13:00.564779] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T20:13:00.570164] [INFO ] [REMOTE ] MLNK: Full fetch complete (37139 records). [2025-10-16T20:13:00.570278] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-10-16T20:13:00.772167] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-16T20:13:01.010703] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-10-16T20:13:01.010812] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-10-16T20:13:01.019766] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-10-16T20:13:01.020401] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-10-16T20:13:01.020820] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T20:13:01.025562] [DEBUG] [LOCAL ] MLNK: Trimmed 37139 records to 27069 (keeping 200 days of data) [2025-10-16T20:13:01.197085] [DEBUG] [LOCAL ] MLNK: Primary data saved (27069 records). [2025-10-16T20:13:01.197226] [INFO ] [MAIN ] MLNK: Full history saved. [2025-10-16T20:13:01.197313] [INFO ] [MAIN ] Update Progress: 1367/2369 symbols completed. MLNK took 32.0s. Estimated remaining: 2h 21m 26s. Rate: 7.1 symbols/min [2025-10-16T20:13:01.328165] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-16T20:13:01.410664] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:13:01.422914] [DEBUG] [LOCAL ] MMD: Loaded 10914 existing records from primary storage. [2025-10-16T20:13:01.423133] [INFO ] [MAIN ] MMD: Loaded 10914 existing records. [2025-10-16T20:13:01.543009] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-16T20:13:01.634808] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:13:01.635064] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-16T20:13:01.635150] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-16T20:13:01.635492] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-16T20:13:01.635554] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-16T20:13:02.002274] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:13:02.070282] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-16T20:13:02.342858] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-16T20:13:02.917399] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T20:13:03.142862] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-16T20:13:03.746313] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-16T20:13:03.747694] [INFO ] [REMOTE ] MLP: Full fetch complete (4447 records). [2025-10-16T20:13:03.747791] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-16T20:13:03.948179] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-10-16T20:13:04.112619] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-16T20:13:04.112746] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-16T20:13:04.112956] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-16T20:13:04.113005] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-16T20:13:04.113353] [DEBUG] [LOCAL ] MLP: Trimmed 4447 records to 3090 (keeping 200 days of data) [2025-10-16T20:13:04.130934] [DEBUG] [LOCAL ] MLP: Primary data saved (3090 records). [2025-10-16T20:13:04.131003] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-16T20:13:04.131074] [INFO ] [MAIN ] Update Progress: 1368/2369 symbols completed. MLP took 18.2s. Estimated remaining: 2h 21m 14s. Rate: 7.1 symbols/min [2025-10-16T20:13:04.295810] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:13:04.310960] [DEBUG] [LOCAL ] MMI: Loaded 15512 existing records from primary storage. [2025-10-16T20:13:04.311247] [INFO ] [MAIN ] MMI: Loaded 15512 existing records. [2025-10-16T20:13:04.482517] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:13:04.482752] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-16T20:13:04.482804] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-16T20:13:04.483256] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-16T20:13:04.483318] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-16T20:13:04.746161] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-16T20:13:04.850724] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:13:05.053143] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T20:13:05.542821] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-16T20:13:05.678741] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-16T20:13:06.342879] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-10-16T20:13:06.462671] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T20:13:07.142886] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-16T20:13:07.942864] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-16T20:13:08.085729] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T20:13:08.130310] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T20:13:08.542516] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-16T20:13:08.742836] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-16T20:13:09.542791] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-16T20:13:09.598195] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T20:13:10.342829] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-10-16T20:13:11.126506] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T20:13:11.142779] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-16T20:13:11.310176] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-16T20:13:11.942429] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-16T20:13:11.945030] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-16T20:13:12.742874] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-16T20:13:13.512599] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-16T20:13:13.542771] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-16T20:13:13.982243] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-16T20:13:14.342809] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-16T20:13:14.755250] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T20:13:15.142862] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-16T20:13:15.949406] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-16T20:13:15.948593] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-16T20:13:16.155163] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T20:13:16.742836] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-16T20:13:16.943384] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-16T20:13:17.447847] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T20:13:17.542844] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-16T20:13:18.342783] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-16T20:13:18.557726] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T20:13:19.142875] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-16T20:13:19.942850] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-16T20:13:20.162207] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T20:13:20.199387] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T20:13:20.742791] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-16T20:13:20.905481] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T20:13:20.907900] [INFO ] [REMOTE ] MLR: Full fetch complete (19003 records). [2025-10-16T20:13:20.907972] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-16T20:13:21.272121] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-16T20:13:21.272200] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-16T20:13:21.272678] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-16T20:13:21.272741] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-16T20:13:21.273278] [DEBUG] [LOCAL ] MLR: Trimmed 19003 records to 12546 (keeping 200 days of data) [2025-10-16T20:13:21.341009] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T20:13:21.360573] [DEBUG] [LOCAL ] MLR: Primary data saved (12546 records). [2025-10-16T20:13:21.360734] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-16T20:13:21.360825] [INFO ] [MAIN ] Update Progress: 1369/2369 symbols completed. MLR took 33.4s. Estimated remaining: 2h 21m 12s. Rate: 7.1 symbols/min [2025-10-16T20:13:21.531813] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:13:21.532005] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-16T20:13:21.532050] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-16T20:13:21.532142] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-16T20:13:21.532180] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-16T20:13:21.532221] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-16T20:13:21.532253] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-16T20:13:21.552360] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-16T20:13:21.923939] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:13:22.342871] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-10-16T20:13:22.385264] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T20:13:22.554451] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:13:22.554878] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-10-16T20:13:22.554987] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:13:22.555045] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-16T20:13:22.555136] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:13:22.555211] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-16T20:13:22.555276] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-16T20:13:22.555326] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-16T20:13:22.555391] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-16T20:13:22.555459] [INFO ] [MAIN ] Update Progress: 1370/2369 symbols completed. MMID took 1.2s. Estimated remaining: 2h 20m 58s. Rate: 7.1 symbols/min [2025-10-16T20:13:22.723412] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:13:22.723605] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-16T20:13:22.723661] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-16T20:13:22.723786] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-16T20:13:22.723826] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-16T20:13:22.723867] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-16T20:13:22.723898] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-16T20:13:23.100736] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:13:23.142878] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-16T20:13:23.883571] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-16T20:13:23.942886] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-16T20:13:24.742782] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-16T20:13:25.020024] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-16T20:13:25.534165] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T20:13:25.542759] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-16T20:13:26.338076] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T20:13:26.342767] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-16T20:13:27.143284] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-16T20:13:27.144359] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T20:13:27.147485] [INFO ] [REMOTE ] MMD: Full fetch complete (17226 records). [2025-10-16T20:13:27.147577] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-16T20:13:27.510932] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-16T20:13:27.511008] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-16T20:13:27.511411] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-16T20:13:27.511451] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-16T20:13:27.512013] [DEBUG] [LOCAL ] MMD: Trimmed 17226 records to 10974 (keeping 200 days of data) [2025-10-16T20:13:27.577361] [DEBUG] [LOCAL ] MMD: Primary data saved (10974 records). [2025-10-16T20:13:27.577495] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-16T20:13:27.577572] [INFO ] [MAIN ] Update Progress: 1371/2369 symbols completed. MMD took 26.4s. Estimated remaining: 2h 20m 47s. Rate: 7.1 symbols/min [2025-10-16T20:13:27.745189] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:13:27.797289] [DEBUG] [LOCAL ] MMM: Loaded 53114 existing records from primary storage. [2025-10-16T20:13:27.797610] [INFO ] [MAIN ] MMM: Loaded 53114 existing records. [2025-10-16T20:13:27.949690] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-16T20:13:27.985312] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:13:27.985520] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-16T20:13:27.985570] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-16T20:13:27.985810] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-16T20:13:27.985868] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-16T20:13:28.332468] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-16T20:13:28.367719] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:13:28.742861] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-16T20:13:29.542846] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-10-16T20:13:29.860232] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-16T20:13:29.886586] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T20:13:29.895161] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-16T20:13:30.342876] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-16T20:13:31.142829] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-16T20:13:31.942804] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-16T20:13:32.059121] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-16T20:13:32.160994] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T20:13:32.245622] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-16T20:13:32.742878] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-16T20:13:33.542825] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-16T20:13:33.855335] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-16T20:13:33.893322] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-16T20:13:34.342818] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-16T20:13:35.142853] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-10-16T20:13:35.942831] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-16T20:13:36.041374] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T20:13:36.208486] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-16T20:13:36.742890] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-16T20:13:37.091850] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T20:13:37.542834] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-16T20:13:37.564258] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T20:13:37.648464] [DEBUG] [REMOTE ] MMC: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-16T20:13:37.648755] [WARN ] [REMOTE ] MMC: No data returned for month 2025-07 [2025-10-16T20:13:37.648845] [FATAL] [REMOTE ] MMC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:13:37.648945] [FATAL] [MAIN ] MMC: Failed to fetch primary data. [2025-10-16T20:13:37.649014] [WARN ] [MAIN ] MMC: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:13:37.649091] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-16T20:13:37.649167] [DEBUG] [LOCAL ] MMC: No primary data file found to delete. [2025-10-16T20:13:37.649274] [INFO ] [LOCAL ] MMC: Starting deletion of derivative data. [2025-10-16T20:13:37.649461] [DEBUG] [LOCAL ] MMC: Deleted derivative data file. [2025-10-16T20:13:37.650004] [INFO ] [MAIN ] Update Progress: 1372/2369 symbols completed. MMC took 38.6s. Estimated remaining: 2h 20m 40s. Rate: 7.1 symbols/min [2025-10-16T20:13:37.823795] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:13:37.856421] [DEBUG] [LOCAL ] MMS: Loaded 33758 existing records from primary storage. [2025-10-16T20:13:37.856731] [INFO ] [MAIN ] MMS: Loaded 33758 existing records. [2025-10-16T20:13:38.031613] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:13:38.031820] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-16T20:13:38.031867] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-16T20:13:38.032511] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-16T20:13:38.032567] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-16T20:13:38.352223] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-16T20:13:38.383884] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:13:39.142842] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-16T20:13:39.396763] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T20:13:39.399611] [INFO ] [REMOTE ] MMI: Full fetch complete (21737 records). [2025-10-16T20:13:39.399707] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-16T20:13:39.753931] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-16T20:13:39.754003] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-16T20:13:39.754442] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-16T20:13:39.754481] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-16T20:13:39.755092] [DEBUG] [LOCAL ] MMI: Trimmed 21737 records to 15671 (keeping 200 days of data) [2025-10-16T20:13:39.847880] [DEBUG] [LOCAL ] MMI: Primary data saved (15671 records). [2025-10-16T20:13:39.848013] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-16T20:13:39.848091] [INFO ] [MAIN ] Update Progress: 1373/2369 symbols completed. MMI took 35.7s. Estimated remaining: 2h 20m 27s. Rate: 7.1 symbols/min [2025-10-16T20:13:39.947896] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-10-16T20:13:40.023101] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:13:40.033209] [DEBUG] [LOCAL ] MMT: Loaded 10346 existing records from primary storage. [2025-10-16T20:13:40.033435] [INFO ] [MAIN ] MMT: Loaded 10346 existing records. [2025-10-16T20:13:40.234663] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:13:40.234890] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-16T20:13:40.234938] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-16T20:13:40.235227] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-16T20:13:40.235283] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-16T20:13:40.580965] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:13:40.742834] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-10-16T20:13:41.048919] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-16T20:13:41.452261] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T20:13:41.542799] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-16T20:13:41.552501] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-16T20:13:42.342826] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-16T20:13:43.126120] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T20:13:43.142776] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-16T20:13:43.491963] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-16T20:13:43.942794] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-16T20:13:44.020704] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T20:13:44.742861] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-16T20:13:45.542783] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-16T20:13:45.983819] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-16T20:13:46.083374] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-16T20:13:46.246328] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T20:13:46.342817] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-16T20:13:46.762250] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-16T20:13:47.142847] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-16T20:13:47.942782] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-16T20:13:48.107559] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-16T20:13:48.213242] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-16T20:13:48.742825] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-16T20:13:49.542843] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-16T20:13:49.891384] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-16T20:13:50.342788] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-16T20:13:50.747433] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T20:13:50.781963] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-16T20:13:51.142823] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-16T20:13:51.504049] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-16T20:13:51.942821] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-16T20:13:52.742825] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-16T20:13:53.358109] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T20:13:53.415969] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T20:13:53.416930] [INFO ] [REMOTE ] MMKT: Full fetch complete (2113 records). [2025-10-16T20:13:53.416999] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-16T20:13:53.545346] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-16T20:13:53.643627] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-16T20:13:53.643891] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:13:53.643954] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:13:53.644001] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-16T20:13:53.644056] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-16T20:13:53.644111] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-16T20:13:53.644178] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-16T20:13:53.644239] [INFO ] [MAIN ] Update Progress: 1374/2369 symbols completed. MMKT took 31.1s. Estimated remaining: 2h 20m 22s. Rate: 7.1 symbols/min [2025-10-16T20:13:53.842405] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:13:53.859834] [DEBUG] [LOCAL ] MMU: Loaded 16587 existing records from primary storage. [2025-10-16T20:13:53.860111] [INFO ] [MAIN ] MMU: Loaded 16587 existing records. [2025-10-16T20:13:54.072892] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:13:54.073135] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-16T20:13:54.073218] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-16T20:13:54.073722] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-16T20:13:54.073786] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-16T20:13:54.348062] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-16T20:13:54.459916] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:13:55.142781] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-10-16T20:13:55.369409] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-16T20:13:55.529247] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-16T20:13:55.942844] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-16T20:13:56.209988] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T20:13:56.742812] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-16T20:13:57.284984] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T20:13:57.349589] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T20:13:57.542812] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-16T20:13:58.333588] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-16T20:13:58.342738] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-16T20:13:59.142835] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-16T20:13:59.437122] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T20:13:59.853528] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T20:13:59.942802] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-16T20:14:00.742819] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-16T20:14:01.023813] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T20:14:01.542795] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-16T20:14:01.770873] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T20:14:02.342802] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-16T20:14:03.142797] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-16T20:14:03.290950] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T20:14:03.752863] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T20:14:03.942893] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-16T20:14:03.958473] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T20:14:04.742863] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-16T20:14:05.412531] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T20:14:05.542828] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-16T20:14:05.835247] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T20:14:06.342847] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-16T20:14:07.087183] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-16T20:14:07.142801] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-16T20:14:07.614346] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-16T20:14:07.923872] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T20:14:07.925484] [INFO ] [REMOTE ] MMT: Full fetch complete (16073 records). [2025-10-16T20:14:07.925573] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-16T20:14:07.947915] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-16T20:14:08.326376] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-16T20:14:08.326538] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-16T20:14:08.326967] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-16T20:14:08.327029] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-16T20:14:08.327527] [DEBUG] [LOCAL ] MMT: Trimmed 16073 records to 10392 (keeping 200 days of data) [2025-10-16T20:14:08.392972] [DEBUG] [LOCAL ] MMT: Primary data saved (10392 records). [2025-10-16T20:14:08.393129] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-16T20:14:08.393215] [INFO ] [MAIN ] Update Progress: 1375/2369 symbols completed. MMT took 28.5s. Estimated remaining: 2h 20m 18s. Rate: 7.1 symbols/min [2025-10-16T20:14:08.562241] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:14:08.585707] [DEBUG] [LOCAL ] MNR: Loaded 24924 existing records from primary storage. [2025-10-16T20:14:08.585992] [INFO ] [MAIN ] MNR: Loaded 24924 existing records. [2025-10-16T20:14:08.744233] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-16T20:14:08.765624] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:14:08.767017] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-16T20:14:08.767068] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-16T20:14:08.767793] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-16T20:14:08.767867] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-16T20:14:09.129696] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:14:09.542799] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-16T20:14:09.741867] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T20:14:10.068511] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-16T20:14:10.342824] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-16T20:14:10.452790] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-16T20:14:11.142841] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-10-16T20:14:11.317998] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-16T20:14:11.942854] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-16T20:14:12.154624] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-16T20:14:12.742825] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-16T20:14:12.868747] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T20:14:13.542791] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-16T20:14:14.342785] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-16T20:14:14.625704] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-16T20:14:14.860479] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T20:14:15.142782] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-16T20:14:15.446448] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-16T20:14:15.631190] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T20:14:15.637976] [INFO ] [REMOTE ] MMM: Full fetch complete (77213 records). [2025-10-16T20:14:15.638098] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-16T20:14:15.950247] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-16T20:14:16.074520] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-16T20:14:16.074614] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-16T20:14:16.076018] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-16T20:14:16.076095] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-16T20:14:16.077700] [DEBUG] [LOCAL ] MMM: Trimmed 77213 records to 53503 (keeping 200 days of data) [2025-10-16T20:14:16.500235] [DEBUG] [LOCAL ] MMM: Primary data saved (53503 records). [2025-10-16T20:14:16.500450] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-16T20:14:16.501074] [INFO ] [MAIN ] Update Progress: 1376/2369 symbols completed. MMM took 48.9s. Estimated remaining: 2h 20m 9s. Rate: 7.1 symbols/min [2025-10-16T20:14:16.743291] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:14:16.743407] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-16T20:14:16.797719] [DEBUG] [LOCAL ] MNSO: Loaded 44171 existing records from primary storage. [2025-10-16T20:14:16.798180] [INFO ] [MAIN ] MNSO: Loaded 44171 existing records. [2025-10-16T20:14:17.018972] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:14:17.019439] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-16T20:14:17.019566] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-16T20:14:17.019816] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-16T20:14:17.019880] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-16T20:14:17.122224] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T20:14:17.417240] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:14:17.542772] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-10-16T20:14:18.146496] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T20:14:18.342805] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-16T20:14:19.142808] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-16T20:14:19.218892] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T20:14:19.312773] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T20:14:19.942826] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-16T20:14:20.328042] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-16T20:14:20.742817] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-16T20:14:21.542803] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-16T20:14:21.584455] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T20:14:21.587232] [INFO ] [REMOTE ] MMU: Full fetch complete (25050 records). [2025-10-16T20:14:21.587417] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-16T20:14:21.765140] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T20:14:21.993528] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-16T20:14:21.993631] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-16T20:14:21.994264] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-16T20:14:21.994327] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-16T20:14:21.995215] [DEBUG] [LOCAL ] MMU: Trimmed 25050 records to 16691 (keeping 200 days of data) [2025-10-16T20:14:22.093130] [DEBUG] [LOCAL ] MMU: Primary data saved (16691 records). [2025-10-16T20:14:22.093282] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-16T20:14:22.093363] [INFO ] [MAIN ] Update Progress: 1377/2369 symbols completed. MMU took 28.4s. Estimated remaining: 2h 19m 59s. Rate: 7.1 symbols/min [2025-10-16T20:14:22.256444] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:14:22.256665] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-16T20:14:22.256722] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-16T20:14:22.256833] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-16T20:14:22.256873] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-16T20:14:22.256913] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-16T20:14:22.256948] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-16T20:14:22.350020] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-16T20:14:22.609616] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:14:22.628620] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T20:14:23.142839] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-16T20:14:23.851254] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T20:14:23.855974] [INFO ] [REMOTE ] MMS: Full fetch complete (51483 records). [2025-10-16T20:14:23.856078] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-16T20:14:23.947972] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-16T20:14:24.183796] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T20:14:24.282351] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-16T20:14:24.282426] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-16T20:14:24.283310] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-16T20:14:24.283371] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-16T20:14:24.284463] [DEBUG] [LOCAL ] MMS: Trimmed 51483 records to 34018 (keeping 200 days of data) [2025-10-16T20:14:24.497138] [DEBUG] [LOCAL ] MMS: Primary data saved (34018 records). [2025-10-16T20:14:24.497322] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-16T20:14:24.497413] [INFO ] [MAIN ] Update Progress: 1378/2369 symbols completed. MMS took 46.8s. Estimated remaining: 2h 19m 46s. Rate: 7.1 symbols/min [2025-10-16T20:14:24.671860] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:14:24.672029] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-16T20:14:24.672068] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-16T20:14:24.672204] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-16T20:14:24.672275] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-16T20:14:24.672340] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-16T20:14:24.672392] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-16T20:14:24.751005] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-10-16T20:14:24.993271] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:14:25.013744] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-10-16T20:14:25.033174] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:14:25.029332] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:14:25.033663] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-16T20:14:25.033738] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:14:25.033812] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-16T20:14:25.033886] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-16T20:14:25.033923] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-16T20:14:25.033962] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-16T20:14:25.034012] [INFO ] [MAIN ] Update Progress: 1379/2369 symbols completed. MNTN took 2.9s. Estimated remaining: 2h 19m 32s. Rate: 7.1 symbols/min [2025-10-16T20:14:25.211132] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:14:25.252816] [DEBUG] [LOCAL ] MOD: Loaded 44781 existing records from primary storage. [2025-10-16T20:14:25.253142] [INFO ] [MAIN ] MOD: Loaded 44781 existing records. [2025-10-16T20:14:25.434096] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:14:25.434382] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-16T20:14:25.434549] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-16T20:14:25.435510] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-16T20:14:25.435569] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-16T20:14:25.543664] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-10-16T20:14:25.809231] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-16T20:14:25.821340] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:14:26.342891] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-10-16T20:14:27.142848] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-16T20:14:27.942847] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-16T20:14:27.998637] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-16T20:14:28.031142] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T20:14:28.532491] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T20:14:28.742803] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-16T20:14:29.228135] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T20:14:29.542870] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-16T20:14:30.342832] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-16T20:14:30.479552] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T20:14:31.142875] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-16T20:14:31.866194] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-16T20:14:31.942791] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-16T20:14:32.037971] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T20:14:32.391610] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-16T20:14:32.742815] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-16T20:14:33.452406] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T20:14:33.542768] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-16T20:14:33.571545] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T20:14:34.342861] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-16T20:14:34.945076] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T20:14:35.142808] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-16T20:14:35.942863] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-16T20:14:36.072501] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T20:14:36.742778] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-16T20:14:37.106829] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T20:14:37.362212] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-16T20:14:37.542876] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-16T20:14:38.342795] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-16T20:14:38.424172] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T20:14:39.142791] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-16T20:14:39.443727] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-16T20:14:39.626473] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-16T20:14:39.942844] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-16T20:14:40.742775] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-16T20:14:40.843609] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T20:14:41.542788] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-16T20:14:41.783498] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T20:14:41.810065] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T20:14:42.342821] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-16T20:14:43.142873] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-16T20:14:43.780719] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-16T20:14:43.847736] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T20:14:43.942845] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-16T20:14:44.396104] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T20:14:44.400367] [INFO ] [REMOTE ] MNR: Full fetch complete (36827 records). [2025-10-16T20:14:44.400464] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-16T20:14:44.743165] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-16T20:14:44.782213] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-16T20:14:44.782294] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-16T20:14:44.783091] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-16T20:14:44.783152] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-16T20:14:44.784100] [DEBUG] [LOCAL ] MNR: Trimmed 36827 records to 25091 (keeping 200 days of data) [2025-10-16T20:14:44.943210] [DEBUG] [LOCAL ] MNR: Primary data saved (25091 records). [2025-10-16T20:14:44.943367] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-16T20:14:44.943500] [INFO ] [MAIN ] Update Progress: 1380/2369 symbols completed. MNR took 36.6s. Estimated remaining: 2h 19m 32s. Rate: 7.1 symbols/min [2025-10-16T20:14:45.118823] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:14:45.164951] [DEBUG] [LOCAL ] MODG: Loaded 51597 existing records from primary storage. [2025-10-16T20:14:45.165520] [INFO ] [MAIN ] MODG: Loaded 51597 existing records. [2025-10-16T20:14:45.355473] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:14:45.355719] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-16T20:14:45.355813] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-16T20:14:45.356680] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-16T20:14:45.356738] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-16T20:14:45.560339] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-16T20:14:45.713587] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:14:46.119816] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-16T20:14:46.199343] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T20:14:46.342813] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-16T20:14:47.142829] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-16T20:14:47.370671] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T20:14:47.942873] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-16T20:14:48.605975] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-16T20:14:48.742803] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-16T20:14:48.800366] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T20:14:48.806759] [INFO ] [REMOTE ] MNSO: Full fetch complete (64793 records). [2025-10-16T20:14:48.806931] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-16T20:14:49.205350] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-16T20:14:49.205531] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-16T20:14:49.206613] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-16T20:14:49.206845] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-16T20:14:49.208300] [DEBUG] [LOCAL ] MNSO: Trimmed 64793 records to 44550 (keeping 200 days of data) [2025-10-16T20:14:49.326543] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T20:14:49.527671] [DEBUG] [LOCAL ] MNSO: Primary data saved (44550 records). [2025-10-16T20:14:49.527823] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-16T20:14:49.528290] [INFO ] [MAIN ] Update Progress: 1381/2369 symbols completed. MNSO took 33.0s. Estimated remaining: 2h 19m 20s. Rate: 7.1 symbols/min [2025-10-16T20:14:49.552726] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-16T20:14:49.721537] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:14:49.765853] [DEBUG] [LOCAL ] MOH: Loaded 42649 existing records from primary storage. [2025-10-16T20:14:49.766204] [INFO ] [MAIN ] MOH: Loaded 42649 existing records. [2025-10-16T20:14:49.942102] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:14:49.942317] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-16T20:14:49.942363] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-16T20:14:49.943075] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-10-16T20:14:49.943131] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-16T20:14:50.326813] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:14:50.342779] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-10-16T20:14:50.720308] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T20:14:51.142853] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-16T20:14:51.437531] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T20:14:51.942831] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-10-16T20:14:51.968180] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T20:14:52.742809] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-16T20:14:53.541249] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-16T20:14:53.552004] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-16T20:14:53.654795] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T20:14:53.724052] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T20:14:54.342861] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-16T20:14:54.768185] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T20:14:55.142793] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-16T20:14:55.942772] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-16T20:14:56.181297] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-16T20:14:56.742842] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-16T20:14:56.824119] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T20:14:57.542835] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-16T20:14:58.033820] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-16T20:14:58.344478] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T20:14:58.343076] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-16T20:14:59.149932] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-16T20:14:59.154018] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T20:14:59.161059] [INFO ] [REMOTE ] MOD: Full fetch complete (66376 records). [2025-10-16T20:14:59.161220] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-16T20:14:59.293617] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-16T20:14:59.317388] [INFO ] [REMOTE ] MO: Full fetch complete (77541 records). [2025-10-16T20:14:59.327891] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-16T20:14:59.797093] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-16T20:14:59.812273] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-16T20:14:59.816130] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-16T20:14:59.814957] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T20:14:59.816222] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-16T20:14:59.817031] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:14:59.817280] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:14:59.817356] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-16T20:14:59.817484] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-16T20:14:59.817564] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-16T20:14:59.817992] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-16T20:14:59.818216] [INFO ] [MAIN ] Update Progress: 1382/2369 symbols completed. MO took 35.3s. Estimated remaining: 2h 19m 13s. Rate: 7.1 symbols/min [2025-10-16T20:14:59.876047] [DEBUG] [LOCAL ] MOD: Trimmed 66376 records to 45085 (keeping 200 days of data) [2025-10-16T20:14:59.982513] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-16T20:15:00.120546] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:15:00.268262] [DEBUG] [LOCAL ] MOD: Primary data saved (45085 records). [2025-10-16T20:15:00.268514] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-16T20:15:00.269177] [INFO ] [MAIN ] Update Progress: 1383/2369 symbols completed. MOD took 35.2s. Estimated remaining: 2h 18m 59s. Rate: 7.1 symbols/min [2025-10-16T20:15:00.420704] [DEBUG] [LOCAL ] MOS: Loaded 53508 existing records from primary storage. [2025-10-16T20:15:00.440480] [INFO ] [MAIN ] MOS: Loaded 53508 existing records. [2025-10-16T20:15:00.572869] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:15:00.687222] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:15:00.687726] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-16T20:15:00.687827] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-16T20:15:00.693779] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-16T20:15:00.693851] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-16T20:15:00.794772] [DEBUG] [LOCAL ] MOV: Loaded 21692 existing records from primary storage. [2025-10-16T20:15:00.806253] [INFO ] [MAIN ] MOV: Loaded 21692 existing records. [2025-10-16T20:15:01.114354] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:15:01.153227] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-16T20:15:01.159140] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-16T20:15:01.170180] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-10-16T20:15:01.182583] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-16T20:15:01.417203] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:15:01.430859] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-10-16T20:15:01.425396] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-16T20:15:01.547149] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-16T20:15:01.739480] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T20:15:01.790514] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:15:02.342821] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-16T20:15:03.142928] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-10-16T20:15:03.396997] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T20:15:03.458075] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-16T20:15:03.947958] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-16T20:15:03.958207] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T20:15:04.401283] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T20:15:04.742830] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-16T20:15:05.542843] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-16T20:15:05.981821] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-16T20:15:06.342781] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-16T20:15:06.446988] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T20:15:06.553805] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T20:15:07.142813] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-16T20:15:07.828597] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T20:15:07.942818] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-16T20:15:08.742872] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-16T20:15:08.899322] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T20:15:08.936530] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T20:15:09.542876] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-16T20:15:10.342853] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-16T20:15:10.664783] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T20:15:10.725903] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T20:15:11.142836] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-16T20:15:11.862622] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T20:15:11.942792] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-16T20:15:12.573163] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T20:15:12.742834] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-16T20:15:13.040461] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T20:15:13.542802] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-16T20:15:13.990104] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-16T20:15:14.342800] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-16T20:15:15.142777] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-16T20:15:15.454356] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T20:15:15.634703] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-16T20:15:15.942836] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-16T20:15:16.742793] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-16T20:15:17.008350] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T20:15:17.083715] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-16T20:15:17.542885] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-16T20:15:18.342793] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-16T20:15:18.738387] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-16T20:15:19.142859] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-16T20:15:19.576390] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-16T20:15:19.942810] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-16T20:15:20.229685] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T20:15:20.263084] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T20:15:20.742826] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-16T20:15:21.490634] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T20:15:21.512632] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-16T20:15:21.542766] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-16T20:15:22.342781] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-16T20:15:22.535474] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T20:15:22.538069] [INFO ] [REMOTE ] MOV: Full fetch complete (30551 records). [2025-10-16T20:15:22.538137] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-16T20:15:22.906137] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-16T20:15:22.906210] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-16T20:15:22.906829] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-16T20:15:22.906889] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-16T20:15:22.907569] [DEBUG] [LOCAL ] MOV: Trimmed 30551 records to 21798 (keeping 200 days of data) [2025-10-16T20:15:23.037132] [DEBUG] [LOCAL ] MOV: Primary data saved (21798 records). [2025-10-16T20:15:23.037247] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-16T20:15:23.037319] [INFO ] [MAIN ] Update Progress: 1384/2369 symbols completed. MOV took 22.8s. Estimated remaining: 2h 19m 1s. Rate: 7.1 symbols/min [2025-10-16T20:15:23.147917] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-16T20:15:23.212985] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:15:23.261622] [DEBUG] [LOCAL ] MP: Loaded 53722 existing records from primary storage. [2025-10-16T20:15:23.261961] [INFO ] [MAIN ] MP: Loaded 53722 existing records. [2025-10-16T20:15:23.435596] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:15:23.435807] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-16T20:15:23.435853] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-16T20:15:23.436805] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-10-16T20:15:23.436862] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-16T20:15:23.785266] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:15:23.942776] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-10-16T20:15:23.981573] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T20:15:24.742787] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-16T20:15:25.059778] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-16T20:15:25.542869] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-16T20:15:25.889307] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T20:15:26.342803] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-16T20:15:26.488061] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T20:15:27.142804] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-16T20:15:27.272722] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T20:15:27.942796] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-16T20:15:28.197333] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T20:15:28.718436] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T20:15:28.724265] [INFO ] [REMOTE ] MOH: Full fetch complete (59262 records). [2025-10-16T20:15:28.724409] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-16T20:15:28.748089] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-16T20:15:29.106218] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-16T20:15:29.106292] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-16T20:15:29.107214] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-16T20:15:29.107275] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-16T20:15:29.108437] [DEBUG] [LOCAL ] MOH: Trimmed 59262 records to 42970 (keeping 200 days of data) [2025-10-16T20:15:29.365785] [DEBUG] [LOCAL ] MOH: Primary data saved (42970 records). [2025-10-16T20:15:29.365907] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-16T20:15:29.366410] [INFO ] [MAIN ] Update Progress: 1385/2369 symbols completed. MOH took 39.8s. Estimated remaining: 2h 18m 51s. Rate: 7.1 symbols/min [2025-10-16T20:15:29.543863] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:15:29.543924] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-16T20:15:29.552730] [DEBUG] [LOCAL ] MPA: Loaded 5368 existing records from primary storage. [2025-10-16T20:15:29.552932] [INFO ] [MAIN ] MPA: Loaded 5368 existing records. [2025-10-16T20:15:29.728934] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T20:15:29.758190] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:15:29.758482] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-16T20:15:29.758533] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-16T20:15:29.758770] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-16T20:15:29.758843] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-16T20:15:29.758736] [INFO ] [REMOTE ] MODG: Full fetch complete (74898 records). [2025-10-16T20:15:29.790028] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-16T20:15:30.446848] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:15:30.447354] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-10-16T20:15:30.549346] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-16T20:15:30.549506] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-16T20:15:30.550785] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-16T20:15:30.550906] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-16T20:15:30.552410] [DEBUG] [LOCAL ] MODG: Trimmed 74898 records to 51962 (keeping 200 days of data) [2025-10-16T20:15:30.689985] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-16T20:15:30.881091] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-16T20:15:30.888077] [DEBUG] [LOCAL ] MODG: Primary data saved (51962 records). [2025-10-16T20:15:30.888147] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-16T20:15:30.888228] [INFO ] [MAIN ] Update Progress: 1386/2369 symbols completed. MODG took 45.9s. Estimated remaining: 2h 18m 37s. Rate: 7.1 symbols/min [2025-10-16T20:15:31.057326] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:15:31.105131] [DEBUG] [LOCAL ] MPC: Loaded 52051 existing records from primary storage. [2025-10-16T20:15:31.105425] [INFO ] [MAIN ] MPC: Loaded 52051 existing records. [2025-10-16T20:15:31.148020] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-16T20:15:31.291574] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:15:31.291976] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-16T20:15:31.292069] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-16T20:15:31.293285] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-10-16T20:15:31.293345] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-16T20:15:31.626935] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-16T20:15:31.715011] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:15:31.737426] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-16T20:15:31.942796] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-16T20:15:32.742820] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-16T20:15:33.542841] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-10-16T20:15:33.763993] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T20:15:34.342855] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-16T20:15:34.664599] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-16T20:15:34.873072] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T20:15:35.142835] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-16T20:15:35.942794] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-16T20:15:36.268415] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-16T20:15:36.278850] [INFO ] [REMOTE ] MOS: Full fetch complete (77628 records). [2025-10-16T20:15:36.279077] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-16T20:15:36.687060] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-16T20:15:36.687135] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-16T20:15:36.688189] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-16T20:15:36.688253] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-16T20:15:36.689807] [DEBUG] [LOCAL ] MOS: Trimmed 77628 records to 53898 (keeping 200 days of data) [2025-10-16T20:15:36.751499] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-16T20:15:37.020709] [DEBUG] [LOCAL ] MOS: Primary data saved (53898 records). [2025-10-16T20:15:37.020971] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-16T20:15:37.021715] [INFO ] [MAIN ] Update Progress: 1387/2369 symbols completed. MOS took 37.2s. Estimated remaining: 2h 18m 27s. Rate: 7.1 symbols/min [2025-10-16T20:15:37.196679] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:15:37.229721] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-16T20:15:37.284295] [DEBUG] [LOCAL ] MPLX: Loaded 50757 existing records from primary storage. [2025-10-16T20:15:37.284592] [INFO ] [MAIN ] MPLX: Loaded 50757 existing records. [2025-10-16T20:15:37.439968] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-16T20:15:37.469833] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:15:37.470409] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-16T20:15:37.470518] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-16T20:15:37.473957] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-10-16T20:15:37.474043] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-16T20:15:37.542870] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-16T20:15:37.834023] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:15:37.866140] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-16T20:15:38.342798] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-16T20:15:39.142811] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-10-16T20:15:39.251721] [DEBUG] [REMOTE ] MPLX: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-16T20:15:39.252078] [WARN ] [REMOTE ] MPLX: No data returned for month 2024-12 [2025-10-16T20:15:39.252189] [FATAL] [REMOTE ] MPLX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:15:39.252248] [FATAL] [MAIN ] MPLX: Failed to fetch primary data. [2025-10-16T20:15:39.252302] [WARN ] [MAIN ] MPLX: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:15:39.252381] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-16T20:15:39.252502] [DEBUG] [LOCAL ] MPLX: No primary data file found to delete. [2025-10-16T20:15:39.252580] [INFO ] [LOCAL ] MPLX: Starting deletion of derivative data. [2025-10-16T20:15:39.252857] [DEBUG] [LOCAL ] MPLX: Deleted derivative data file. [2025-10-16T20:15:39.253554] [INFO ] [MAIN ] Update Progress: 1388/2369 symbols completed. MPLX took 2.2s. Estimated remaining: 2h 18m 14s. Rate: 7.1 symbols/min [2025-10-16T20:15:39.430581] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:15:39.437714] [DEBUG] [LOCAL ] MPV: Loaded 4661 existing records from primary storage. [2025-10-16T20:15:39.437928] [INFO ] [MAIN ] MPV: Loaded 4661 existing records. [2025-10-16T20:15:39.616178] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:15:39.616458] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-16T20:15:39.616554] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-16T20:15:39.616865] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-10-16T20:15:39.616923] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-16T20:15:39.949474] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-16T20:15:39.980498] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:15:40.012233] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-16T20:15:40.063442] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T20:15:40.604675] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-16T20:15:40.742825] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-16T20:15:41.362877] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-16T20:15:41.542804] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-10-16T20:15:42.232807] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-16T20:15:42.342810] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-16T20:15:42.944607] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T20:15:43.142814] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-16T20:15:43.942823] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-16T20:15:44.742792] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-16T20:15:45.291734] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-16T20:15:45.360306] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T20:15:45.358029] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-16T20:15:45.542809] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-16T20:15:46.209749] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-16T20:15:46.342839] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-16T20:15:47.142842] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-16T20:15:47.942828] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-16T20:15:48.179317] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T20:15:48.556915] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T20:15:48.742813] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-16T20:15:49.543432] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-16T20:15:49.554007] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-16T20:15:49.571089] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-16T20:15:50.342825] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-16T20:15:50.972887] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-16T20:15:51.142796] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-16T20:15:51.400710] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-16T20:15:51.942820] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-16T20:15:52.037356] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T20:15:52.742813] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-16T20:15:53.542797] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-16T20:15:53.612044] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T20:15:53.613271] [INFO ] [REMOTE ] MPA: Full fetch complete (7083 records). [2025-10-16T20:15:53.613340] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-16T20:15:53.975034] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-16T20:15:53.975111] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-16T20:15:53.975322] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-16T20:15:53.975363] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-16T20:15:53.975812] [DEBUG] [LOCAL ] MPA: Trimmed 7083 records to 5378 (keeping 200 days of data) [2025-10-16T20:15:54.012157] [DEBUG] [LOCAL ] MPA: Primary data saved (5378 records). [2025-10-16T20:15:54.012309] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-16T20:15:54.012397] [INFO ] [MAIN ] Update Progress: 1389/2369 symbols completed. MPA took 24.6s. Estimated remaining: 2h 18m 10s. Rate: 7.1 symbols/min [2025-10-16T20:15:54.190147] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:15:54.242258] [DEBUG] [LOCAL ] MPW: Loaded 53496 existing records from primary storage. [2025-10-16T20:15:54.242618] [INFO ] [MAIN ] MPW: Loaded 53496 existing records. [2025-10-16T20:15:54.345251] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-16T20:15:54.435444] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:15:54.435916] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-16T20:15:54.436023] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-16T20:15:54.437070] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-10-16T20:15:54.437131] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-16T20:15:54.621376] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-16T20:15:54.840488] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:15:55.128802] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-16T20:15:55.142769] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-16T20:15:55.378597] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-16T20:15:55.759746] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-16T20:15:55.942826] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-10-16T20:15:56.742825] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-16T20:15:57.542825] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-16T20:15:57.732284] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T20:15:58.130665] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T20:15:58.342838] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-16T20:15:58.483859] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T20:15:58.952934] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T20:15:59.142831] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-16T20:15:59.632708] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T20:15:59.942818] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-16T20:16:00.693988] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T20:16:00.742869] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-16T20:16:01.542863] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-16T20:16:02.342845] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-16T20:16:02.910694] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-16T20:16:03.067770] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T20:16:03.142825] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-16T20:16:03.599236] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-16T20:16:03.601011] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-16T20:16:03.602252] [INFO ] [REMOTE ] MPV: Full fetch complete (7766 records). [2025-10-16T20:16:03.612282] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-16T20:16:03.950520] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-16T20:16:03.984546] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-16T20:16:03.984632] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-16T20:16:03.984927] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-16T20:16:03.984974] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-16T20:16:03.985402] [DEBUG] [LOCAL ] MPV: Trimmed 7766 records to 4676 (keeping 200 days of data) [2025-10-16T20:16:04.016596] [DEBUG] [LOCAL ] MPV: Primary data saved (4676 records). [2025-10-16T20:16:04.016769] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-16T20:16:04.016862] [INFO ] [MAIN ] Update Progress: 1390/2369 symbols completed. MPV took 24.8s. Estimated remaining: 2h 18m 3s. Rate: 7.1 symbols/min [2025-10-16T20:16:04.202321] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:16:04.209082] [DEBUG] [LOCAL ] MPX: Loaded 4065 existing records from primary storage. [2025-10-16T20:16:04.209337] [INFO ] [MAIN ] MPX: Loaded 4065 existing records. [2025-10-16T20:16:04.412737] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:16:04.412953] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-16T20:16:04.413002] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-16T20:16:04.413196] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-10-16T20:16:04.413243] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-16T20:16:04.755051] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-16T20:16:04.775255] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:16:05.542870] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-10-16T20:16:06.342830] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-16T20:16:06.368398] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T20:16:06.613977] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-16T20:16:06.707974] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-10-16T20:16:07.142861] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-16T20:16:07.942809] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-16T20:16:07.971481] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T20:16:07.980212] [INFO ] [REMOTE ] MPC: Full fetch complete (75493 records). [2025-10-16T20:16:07.980366] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-16T20:16:07.981145] [FATAL] [VALIDATOR ] MPC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:16:07.981235] [FATAL] [MAIN ] MPC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:16:07.981278] [WARN ] [MAIN ] MPC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:16:07.981316] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-16T20:16:07.981372] [DEBUG] [LOCAL ] MPC: No primary data file found to delete. [2025-10-16T20:16:07.981407] [INFO ] [LOCAL ] MPC: Starting deletion of derivative data. [2025-10-16T20:16:07.981555] [DEBUG] [LOCAL ] MPC: Deleted derivative data file. [2025-10-16T20:16:07.981671] [INFO ] [MAIN ] Update Progress: 1391/2369 symbols completed. MPC took 37.1s. Estimated remaining: 2h 17m 51s. Rate: 7.1 symbols/min [2025-10-16T20:16:08.186505] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-16T20:16:08.184888] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:16:08.205451] [DEBUG] [LOCAL ] MQT: Loaded 8325 existing records from primary storage. [2025-10-16T20:16:08.205729] [INFO ] [MAIN ] MQT: Loaded 8325 existing records. [2025-10-16T20:16:08.383974] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:16:08.384161] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-16T20:16:08.384209] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-16T20:16:08.384428] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-10-16T20:16:08.384469] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-16T20:16:08.780632] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-16T20:16:08.786003] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:16:09.542790] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-10-16T20:16:09.591956] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-16T20:16:10.342803] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-16T20:16:10.484686] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-16T20:16:10.754730] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-10-16T20:16:11.142850] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-16T20:16:11.942854] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-16T20:16:12.056976] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T20:16:12.208138] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T20:16:12.742787] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-16T20:16:12.830558] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T20:16:12.839914] [INFO ] [REMOTE ] MP: Full fetch complete (77170 records). [2025-10-16T20:16:12.840054] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-16T20:16:12.840920] [FATAL] [VALIDATOR ] MP: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:16:12.841051] [FATAL] [MAIN ] MP: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:16:12.841127] [WARN ] [MAIN ] MP: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:16:12.841199] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-16T20:16:12.841264] [DEBUG] [LOCAL ] MP: No primary data file found to delete. [2025-10-16T20:16:12.841300] [INFO ] [LOCAL ] MP: Starting deletion of derivative data. [2025-10-16T20:16:12.841460] [DEBUG] [LOCAL ] MP: Deleted derivative data file. [2025-10-16T20:16:12.842177] [INFO ] [MAIN ] Update Progress: 1392/2369 symbols completed. MP took 49.8s. Estimated remaining: 2h 17m 40s. Rate: 7.1 symbols/min [2025-10-16T20:16:13.012731] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:16:13.012971] [DEBUG] [LOCAL ] MQY: No existing data file found in primary storage. [2025-10-16T20:16:13.013021] [WARN ] [MAIN ] MQY: No existing data found, performing full refresh instead. [2025-10-16T20:16:13.013137] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-16T20:16:13.013177] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-16T20:16:13.013218] [DEBUG] [LOCAL ] MQY: No primary data file found to delete. [2025-10-16T20:16:13.013249] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-16T20:16:13.362070] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:16:13.542869] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-16T20:16:14.342790] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-16T20:16:14.409266] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T20:16:14.741909] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T20:16:15.142846] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-10-16T20:16:15.237592] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T20:16:15.942834] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-16T20:16:16.609475] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T20:16:16.609721] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-16T20:16:16.742818] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-16T20:16:17.542905] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-16T20:16:17.597205] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-16T20:16:18.342819] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-16T20:16:19.057194] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T20:16:19.142775] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-16T20:16:19.628237] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-16T20:16:19.891164] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-16T20:16:19.942793] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-16T20:16:20.647182] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-16T20:16:20.742844] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-16T20:16:21.542822] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-16T20:16:22.342821] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-16T20:16:22.780763] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-16T20:16:22.860444] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-16T20:16:23.142848] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-16T20:16:23.211873] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-16T20:16:23.942773] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-16T20:16:24.332103] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T20:16:24.625128] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-16T20:16:24.742850] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-16T20:16:25.542791] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-16T20:16:25.919295] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T20:16:26.342805] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-16T20:16:27.116246] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-16T20:16:27.142782] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-16T20:16:27.664875] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-16T20:16:27.746017] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-16T20:16:27.747114] [INFO ] [REMOTE ] MPX: Full fetch complete (6560 records). [2025-10-16T20:16:27.747184] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-16T20:16:27.952508] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-16T20:16:28.121810] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-10-16T20:16:28.121888] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-10-16T20:16:28.122106] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-10-16T20:16:28.122164] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-10-16T20:16:28.122583] [DEBUG] [LOCAL ] MPX: Trimmed 6560 records to 4074 (keeping 200 days of data) [2025-10-16T20:16:28.146639] [DEBUG] [LOCAL ] MPX: Primary data saved (4074 records). [2025-10-16T20:16:28.146788] [INFO ] [MAIN ] MPX: Full history saved. [2025-10-16T20:16:28.146871] [INFO ] [MAIN ] Update Progress: 1393/2369 symbols completed. MPX took 24.1s. Estimated remaining: 2h 17m 37s. Rate: 7.1 symbols/min [2025-10-16T20:16:28.313791] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:16:28.313953] [DEBUG] [LOCAL ] MRC: No existing data file found in primary storage. [2025-10-16T20:16:28.313991] [WARN ] [MAIN ] MRC: No existing data found, performing full refresh instead. [2025-10-16T20:16:28.314100] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-16T20:16:28.314141] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-16T20:16:28.314182] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-16T20:16:28.314214] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-16T20:16:28.666786] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:16:28.742789] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-10-16T20:16:29.291460] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T20:16:29.542851] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-16T20:16:30.113871] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T20:16:30.342851] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-16T20:16:30.734848] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T20:16:31.061161] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-16T20:16:31.142830] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-16T20:16:31.734059] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-16T20:16:31.942833] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-16T20:16:32.742794] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-16T20:16:32.877171] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T20:16:33.542834] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-16T20:16:33.706555] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-16T20:16:34.342868] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-16T20:16:35.142832] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-16T20:16:35.647146] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-16T20:16:35.935572] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T20:16:35.943016] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-16T20:16:35.954145] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T20:16:36.742866] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-16T20:16:37.542778] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-16T20:16:37.821715] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T20:16:37.896605] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-16T20:16:38.342831] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-16T20:16:38.387706] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T20:16:39.142862] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-16T20:16:39.942844] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-16T20:16:40.323914] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T20:16:40.354810] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-16T20:16:40.361546] [INFO ] [REMOTE ] MPW: Full fetch complete (77598 records). [2025-10-16T20:16:40.361688] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-16T20:16:40.745756] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-10-16T20:16:40.745524] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-16T20:16:40.746846] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-10-16T20:16:40.747955] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-10-16T20:16:40.748140] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-10-16T20:16:40.749674] [DEBUG] [LOCAL ] MPW: Trimmed 77598 records to 53886 (keeping 200 days of data) [2025-10-16T20:16:41.062720] [DEBUG] [LOCAL ] MPW: Primary data saved (53886 records). [2025-10-16T20:16:41.062871] [INFO ] [MAIN ] MPW: Full history saved. [2025-10-16T20:16:41.063413] [INFO ] [MAIN ] Update Progress: 1394/2369 symbols completed. MPW took 47.1s. Estimated remaining: 2h 17m 31s. Rate: 7.1 symbols/min [2025-10-16T20:16:41.231514] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:16:41.231821] [DEBUG] [LOCAL ] MRK: No existing data file found in primary storage. [2025-10-16T20:16:41.231881] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-10-16T20:16:41.232075] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-16T20:16:41.232126] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-16T20:16:41.232169] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-16T20:16:41.232202] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-16T20:16:41.553082] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-16T20:16:41.593549] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T20:16:41.635920] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:16:41.636708] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T20:16:42.342835] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-16T20:16:42.781469] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T20:16:43.093160] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T20:16:43.094613] [INFO ] [REMOTE ] MQT: Full fetch complete (13110 records). [2025-10-16T20:16:43.094713] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-16T20:16:43.148072] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-16T20:16:43.450941] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-16T20:16:43.451024] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-16T20:16:43.451319] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-16T20:16:43.451356] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-16T20:16:43.451829] [DEBUG] [LOCAL ] MQT: Trimmed 13110 records to 8377 (keeping 200 days of data) [2025-10-16T20:16:43.501576] [DEBUG] [LOCAL ] MQT: Primary data saved (8377 records). [2025-10-16T20:16:43.501761] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-16T20:16:43.501854] [INFO ] [MAIN ] Update Progress: 1395/2369 symbols completed. MQT took 35.5s. Estimated remaining: 2h 17m 19s. Rate: 7.1 symbols/min [2025-10-16T20:16:43.670876] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:16:43.671074] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-16T20:16:43.671127] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-16T20:16:43.671238] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-16T20:16:43.671278] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-16T20:16:43.671318] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-16T20:16:43.671350] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-16T20:16:43.947994] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-16T20:16:44.020844] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:16:44.742795] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-10-16T20:16:44.776022] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T20:16:44.777474] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T20:16:44.788337] [INFO ] [REMOTE ] MQY: Full fetch complete (26299 records). [2025-10-16T20:16:44.788514] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-16T20:16:44.789589] [FATAL] [VALIDATOR ] MQY: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:16:44.789707] [FATAL] [MAIN ] MQY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:16:44.789775] [WARN ] [MAIN ] MQY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:16:44.789849] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-16T20:16:44.789914] [DEBUG] [LOCAL ] MQY: No primary data file found to delete. [2025-10-16T20:16:44.789949] [INFO ] [LOCAL ] MQY: Starting deletion of derivative data. [2025-10-16T20:16:44.789988] [DEBUG] [LOCAL ] MQY: No derivative data file found to delete. [2025-10-16T20:16:44.790041] [INFO ] [MAIN ] Update Progress: 1396/2369 symbols completed. MQY took 31.9s. Estimated remaining: 2h 17m 5s. Rate: 7.1 symbols/min [2025-10-16T20:16:44.958576] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:16:44.958780] [DEBUG] [LOCAL ] MS: No existing data file found in primary storage. [2025-10-16T20:16:44.958839] [WARN ] [MAIN ] MS: No existing data found, performing full refresh instead. [2025-10-16T20:16:44.958971] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-16T20:16:44.959026] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-16T20:16:44.959080] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-16T20:16:44.959115] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-16T20:16:45.314571] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:16:45.542831] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-16T20:16:46.342823] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-10-16T20:16:47.000878] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-16T20:16:47.150512] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-16T20:16:47.168169] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T20:16:47.942857] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-16T20:16:48.278830] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T20:16:48.742818] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-10-16T20:16:49.022463] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:16:49.022871] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-10-16T20:16:49.022981] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:16:49.023065] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-16T20:16:49.023142] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:16:49.023222] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-16T20:16:49.023306] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-16T20:16:49.023382] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-16T20:16:49.023464] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-16T20:16:49.023545] [INFO ] [MAIN ] Update Progress: 1397/2369 symbols completed. MRP took 5.5s. Estimated remaining: 2h 16m 54s. Rate: 7.1 symbols/min [2025-10-16T20:16:49.137846] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-16T20:16:49.413691] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-16T20:16:49.542808] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-16T20:16:50.342869] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-16T20:16:51.142855] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-16T20:16:51.844853] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T20:16:51.942782] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-16T20:16:52.016077] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-16T20:16:52.742807] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-16T20:16:53.191884] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-16T20:16:53.542784] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-16T20:16:53.626443] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T20:16:54.342808] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-16T20:16:55.028339] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-16T20:16:55.142903] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-16T20:16:55.391291] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-16T20:16:55.509797] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-16T20:16:55.942868] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-16T20:16:56.742827] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-16T20:16:57.562230] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-16T20:16:57.573496] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-16T20:16:58.034187] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T20:16:58.091919] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-16T20:16:58.342845] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-16T20:16:58.716051] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-16T20:16:58.720679] [INFO ] [REMOTE ] MRC: Full fetch complete (54843 records). [2025-10-16T20:16:58.720817] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-16T20:16:58.721491] [FATAL] [VALIDATOR ] MRC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:16:58.721578] [FATAL] [MAIN ] MRC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:16:58.721626] [WARN ] [MAIN ] MRC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:16:58.721739] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-16T20:16:58.721817] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-16T20:16:58.721865] [INFO ] [LOCAL ] MRC: Starting deletion of derivative data. [2025-10-16T20:16:58.721921] [DEBUG] [LOCAL ] MRC: No derivative data file found to delete. [2025-10-16T20:16:58.721993] [INFO ] [MAIN ] Update Progress: 1398/2369 symbols completed. MRC took 30.6s. Estimated remaining: 2h 16m 46s. Rate: 7.1 symbols/min [2025-10-16T20:16:59.142838] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-16T20:17:00.142359] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-16T20:17:00.153534] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-16T20:17:01.517077] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-16T20:17:01.528168] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-16T20:17:02.524236] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-16T20:17:02.535153] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-16T20:17:03.731392] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-16T20:17:03.742688] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-16T20:17:05.175160] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-16T20:17:05.186876] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-16T20:17:05.707389] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-16T20:17:05.721764] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-16T20:17:07.552440] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-16T20:17:07.563976] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-16T20:17:08.003013] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-16T20:17:08.014809] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-16T20:17:09.974638] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-16T20:17:09.989874] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-16T20:17:10.132856] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-16T20:17:10.144744] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-16T20:17:10.365802] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-16T20:17:10.372261] [INFO ] [REMOTE ] MRK: Full fetch complete (77578 records). [2025-10-16T20:17:10.372418] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-16T20:17:10.373176] [FATAL] [VALIDATOR ] MRK: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:17:10.373265] [FATAL] [MAIN ] MRK: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:17:10.373308] [WARN ] [MAIN ] MRK: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:17:10.373345] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-16T20:17:10.373402] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-16T20:17:10.373435] [INFO ] [LOCAL ] MRK: Starting deletion of derivative data. [2025-10-16T20:17:10.373475] [DEBUG] [LOCAL ] MRK: No derivative data file found to delete. [2025-10-16T20:17:10.373531] [INFO ] [MAIN ] Update Progress: 1399/2369 symbols completed. MRK took 29.3s. Estimated remaining: 2h 16m 40s. Rate: 7.1 symbols/min [2025-10-16T20:17:12.332692] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-16T20:17:12.345703] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-16T20:17:13.190493] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T20:17:13.198133] [INFO ] [REMOTE ] MS: Full fetch complete (77466 records). [2025-10-16T20:17:13.198314] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-16T20:17:13.199292] [FATAL] [VALIDATOR ] MS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:17:13.199397] [FATAL] [MAIN ] MS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:17:13.199440] [WARN ] [MAIN ] MS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:17:13.199508] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-16T20:17:13.199575] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-16T20:17:13.199609] [INFO ] [LOCAL ] MS: Starting deletion of derivative data. [2025-10-16T20:17:13.199684] [DEBUG] [LOCAL ] MS: No derivative data file found to delete. [2025-10-16T20:17:13.199762] [INFO ] [MAIN ] Update Progress: 1400/2369 symbols completed. MS took 28.4s. Estimated remaining: 2h 16m 28s. Rate: 7.1 symbols/min [2025-10-16T20:17:13.755230] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:17:13.831925] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:17:13.822380] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-16T20:17:13.883926] [DEBUG] [LOCAL ] MSA: No existing data file found in primary storage. [2025-10-16T20:17:13.883733] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-16T20:17:13.901278] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-16T20:17:13.893494] [WARN ] [MAIN ] MSA: No existing data found, performing full refresh instead. [2025-10-16T20:17:13.917842] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-16T20:17:13.921308] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:17:13.921671] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-16T20:17:13.918002] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-16T20:17:13.922044] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-16T20:17:13.922398] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-16T20:17:13.922949] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-16T20:17:13.923063] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-16T20:17:14.179993] [DEBUG] [LOCAL ] MSB: Loaded 7796 existing records from primary storage. [2025-10-16T20:17:14.224123] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:17:14.233395] [INFO ] [MAIN ] MSB: Loaded 7796 existing records. [2025-10-16T20:17:14.266533] [DEBUG] [LOCAL ] MSCI: No existing data file found in primary storage. [2025-10-16T20:17:14.394675] [WARN ] [MAIN ] MSCI: No existing data found, performing full refresh instead. [2025-10-16T20:17:14.548504] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-16T20:17:14.617117] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-16T20:17:14.697728] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-16T20:17:14.744672] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-16T20:17:15.013409] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:17:15.033960] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:17:15.043412] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-10-16T20:17:15.057601] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-16T20:17:15.091047] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:17:15.102984] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-16T20:17:15.108867] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-10-16T20:17:15.118885] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-10-16T20:17:15.124414] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-16T20:17:15.600151] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-16T20:17:15.599996] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:17:15.640463] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-10-16T20:17:15.633566] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-16T20:17:15.781772] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:17:15.782089] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-10-16T20:17:16.269387] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T20:17:16.273877] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-16T20:17:16.292825] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-16T20:17:16.294134] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-16T20:17:16.536195] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T20:17:16.538035] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-16T20:17:16.759177] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-16T20:17:16.760639] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-16T20:17:17.055465] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T20:17:17.059169] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-16T20:17:17.227140] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-16T20:17:17.228214] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-16T20:17:17.264751] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T20:17:17.288101] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T20:17:17.542864] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-16T20:17:17.637168] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-16T20:17:18.214311] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T20:17:18.342808] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-16T20:17:18.460735] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T20:17:18.857853] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-16T20:17:19.142817] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-16T20:17:19.942809] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-16T20:17:20.083016] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-16T20:17:20.742875] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-16T20:17:21.033117] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T20:17:21.201863] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-16T20:17:21.542813] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-16T20:17:22.058936] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-16T20:17:22.342850] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-16T20:17:23.142820] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-16T20:17:23.806514] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T20:17:23.942783] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-16T20:17:24.742839] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-16T20:17:24.770197] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-16T20:17:24.790782] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T20:17:25.542868] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-16T20:17:26.024436] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T20:17:26.342830] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-16T20:17:27.149144] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-16T20:17:27.152375] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T20:17:27.171266] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T20:17:27.942894] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-16T20:17:28.104363] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-16T20:17:28.538117] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T20:17:28.742801] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-16T20:17:29.533627] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-16T20:17:29.542766] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-16T20:17:30.342777] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-16T20:17:30.407730] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-16T20:17:31.142840] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-16T20:17:31.497556] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T20:17:31.942799] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-16T20:17:32.136986] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T20:17:32.742785] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-16T20:17:33.065410] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-16T20:17:33.542848] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-16T20:17:34.078734] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-16T20:17:34.079459] [INFO ] [REMOTE ] MSC: Full fetch complete (2539 records). [2025-10-16T20:17:34.079523] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-16T20:17:34.277298] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-16T20:17:34.272246] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-16T20:17:34.285055] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:17:34.285130] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:17:34.285202] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-16T20:17:34.285267] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-16T20:17:34.285303] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-16T20:17:34.285342] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-16T20:17:34.285396] [INFO ] [MAIN ] Update Progress: 1401/2369 symbols completed. MSC took 21.0s. Estimated remaining: 2h 16m 28s. Rate: 7.1 symbols/min [2025-10-16T20:17:34.347927] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-16T20:17:34.453106] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:17:34.468374] [DEBUG] [LOCAL ] MSD: Loaded 16546 existing records from primary storage. [2025-10-16T20:17:34.468607] [INFO ] [MAIN ] MSD: Loaded 16546 existing records. [2025-10-16T20:17:34.641090] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:17:34.641272] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-16T20:17:34.641318] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-16T20:17:34.641708] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-10-16T20:17:34.641770] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-16T20:17:34.983915] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:17:35.142772] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-10-16T20:17:35.347271] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T20:17:35.942842] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-16T20:17:36.163550] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T20:17:36.742862] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-16T20:17:36.749952] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T20:17:37.542791] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-16T20:17:37.775949] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T20:17:38.342860] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-16T20:17:38.976378] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-16T20:17:38.978833] [INFO ] [REMOTE ] MSA: Full fetch complete (25646 records). [2025-10-16T20:17:38.978928] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-16T20:17:38.979370] [FATAL] [VALIDATOR ] MSA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:17:38.979466] [FATAL] [MAIN ] MSA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:17:38.979540] [WARN ] [MAIN ] MSA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:17:38.979626] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-16T20:17:38.979753] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-16T20:17:38.979809] [INFO ] [LOCAL ] MSA: Starting deletion of derivative data. [2025-10-16T20:17:38.979853] [DEBUG] [LOCAL ] MSA: No derivative data file found to delete. [2025-10-16T20:17:38.979905] [INFO ] [MAIN ] Update Progress: 1402/2369 symbols completed. MSA took 25.8s. Estimated remaining: 2h 16m 17s. Rate: 7.1 symbols/min [2025-10-16T20:17:39.159367] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:17:39.156345] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-16T20:17:39.160344] [DEBUG] [LOCAL ] MSDL: No existing data file found in primary storage. [2025-10-16T20:17:39.160518] [WARN ] [MAIN ] MSDL: No existing data found, performing full refresh instead. [2025-10-16T20:17:39.160803] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-16T20:17:39.160858] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-16T20:17:39.160903] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-16T20:17:39.160937] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-16T20:17:39.549733] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:17:39.559953] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-16T20:17:39.942821] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-10-16T20:17:39.984828] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T20:17:39.986282] [INFO ] [REMOTE ] MSB: Full fetch complete (13031 records). [2025-10-16T20:17:39.986354] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-16T20:17:40.343230] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-10-16T20:17:40.343304] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-10-16T20:17:40.343594] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-10-16T20:17:40.343633] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-10-16T20:17:40.344119] [DEBUG] [LOCAL ] MSB: Trimmed 13031 records to 7883 (keeping 200 days of data) [2025-10-16T20:17:40.390510] [DEBUG] [LOCAL ] MSB: Primary data saved (7883 records). [2025-10-16T20:17:40.390611] [INFO ] [MAIN ] MSB: Full history saved. [2025-10-16T20:17:40.390711] [INFO ] [MAIN ] Update Progress: 1403/2369 symbols completed. MSB took 27.2s. Estimated remaining: 2h 16m 4s. Rate: 7.1 symbols/min [2025-10-16T20:17:40.555194] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:17:40.555329] [DEBUG] [LOCAL ] MSGE: No existing data file found in primary storage. [2025-10-16T20:17:40.555365] [WARN ] [MAIN ] MSGE: No existing data found, performing full refresh instead. [2025-10-16T20:17:40.555471] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-16T20:17:40.555511] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-16T20:17:40.555551] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-16T20:17:40.555582] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-16T20:17:40.749613] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-16T20:17:40.912753] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:17:41.429956] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T20:17:41.542782] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-16T20:17:41.803351] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T20:17:42.342788] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-10-16T20:17:43.104274] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T20:17:43.142770] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-16T20:17:43.776454] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T20:17:43.942811] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-16T20:17:44.747894] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-16T20:17:44.761810] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T20:17:45.373821] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T20:17:45.483122] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T20:17:45.542790] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-16T20:17:46.342836] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-16T20:17:46.597556] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T20:17:47.142821] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-16T20:17:47.531445] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T20:17:47.942819] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-16T20:17:48.742830] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-16T20:17:48.815965] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T20:17:49.228913] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T20:17:49.542845] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-16T20:17:50.086703] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T20:17:50.342824] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-16T20:17:50.456150] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T20:17:51.142836] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-16T20:17:51.867776] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T20:17:51.916593] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T20:17:51.942769] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-16T20:17:52.522142] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T20:17:52.742832] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-16T20:17:53.542810] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-16T20:17:54.077048] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T20:17:54.342808] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-16T20:17:54.702113] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T20:17:55.142870] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-16T20:17:55.867872] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T20:17:55.942778] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-16T20:17:56.742785] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-16T20:17:56.840463] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T20:17:57.326863] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T20:17:57.542804] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-16T20:17:58.127932] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T20:17:58.342849] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-16T20:17:58.747373] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T20:17:59.142862] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-16T20:17:59.942793] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-16T20:18:00.069776] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T20:18:00.523694] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T20:18:00.742805] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-16T20:18:01.481134] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T20:18:01.542771] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-16T20:18:01.557870] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T20:18:02.342935] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-16T20:18:03.085967] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T20:18:03.090433] [INFO ] [REMOTE ] MSCI: Full fetch complete (50210 records). [2025-10-16T20:18:03.090550] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-16T20:18:03.091422] [FATAL] [VALIDATOR ] MSCI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:18:03.091541] [FATAL] [MAIN ] MSCI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:18:03.091618] [WARN ] [MAIN ] MSCI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:18:03.091743] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-16T20:18:03.091848] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-16T20:18:03.091935] [INFO ] [LOCAL ] MSCI: Starting deletion of derivative data. [2025-10-16T20:18:03.092008] [DEBUG] [LOCAL ] MSCI: No derivative data file found to delete. [2025-10-16T20:18:03.092080] [INFO ] [MAIN ] Update Progress: 1404/2369 symbols completed. MSCI took 49.9s. Estimated remaining: 2h 16m 5s. Rate: 7.1 symbols/min [2025-10-16T20:18:03.159363] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-16T20:18:03.267725] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:18:03.267947] [DEBUG] [LOCAL ] MSGS: No existing data file found in primary storage. [2025-10-16T20:18:03.268031] [WARN ] [MAIN ] MSGS: No existing data found, performing full refresh instead. [2025-10-16T20:18:03.268284] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-16T20:18:03.268385] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-16T20:18:03.268510] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-16T20:18:03.268607] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-16T20:18:03.450819] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T20:18:03.670195] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:18:03.942817] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-16T20:18:04.463273] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T20:18:04.466850] [INFO ] [REMOTE ] MSD: Full fetch complete (23182 records). [2025-10-16T20:18:04.466937] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-16T20:18:04.751367] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-16T20:18:04.873044] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-10-16T20:18:04.873206] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-10-16T20:18:04.873774] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-10-16T20:18:04.873839] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-10-16T20:18:04.874903] [DEBUG] [LOCAL ] MSD: Trimmed 23182 records to 16669 (keeping 200 days of data) [2025-10-16T20:18:04.971150] [DEBUG] [LOCAL ] MSD: Primary data saved (16669 records). [2025-10-16T20:18:04.971296] [INFO ] [MAIN ] MSD: Full history saved. [2025-10-16T20:18:04.971377] [INFO ] [MAIN ] Update Progress: 1405/2369 symbols completed. MSD took 30.7s. Estimated remaining: 2h 15m 52s. Rate: 7.1 symbols/min [2025-10-16T20:18:05.142336] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:18:05.142523] [DEBUG] [LOCAL ] MSI: No existing data file found in primary storage. [2025-10-16T20:18:05.142560] [WARN ] [MAIN ] MSI: No existing data found, performing full refresh instead. [2025-10-16T20:18:05.142698] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-16T20:18:05.142750] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-16T20:18:05.142792] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-16T20:18:05.142825] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-16T20:18:05.504122] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:18:05.551531] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-10-16T20:18:05.570473] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T20:18:06.050298] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-16T20:18:06.260617] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T20:18:06.342794] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-16T20:18:07.064081] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T20:18:07.069507] [INFO ] [REMOTE ] MSDL: Full fetch complete (55721 records). [2025-10-16T20:18:07.069605] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-16T20:18:07.070183] [FATAL] [VALIDATOR ] MSDL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:18:07.070269] [FATAL] [MAIN ] MSDL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:18:07.070313] [WARN ] [MAIN ] MSDL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:18:07.070353] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-16T20:18:07.070419] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-16T20:18:07.070454] [INFO ] [LOCAL ] MSDL: Starting deletion of derivative data. [2025-10-16T20:18:07.070492] [DEBUG] [LOCAL ] MSDL: No derivative data file found to delete. [2025-10-16T20:18:07.070545] [INFO ] [MAIN ] Update Progress: 1406/2369 symbols completed. MSDL took 28.1s. Estimated remaining: 2h 15m 39s. Rate: 7.1 symbols/min [2025-10-16T20:18:07.148016] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-16T20:18:07.236799] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:18:07.236960] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-16T20:18:07.236996] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-16T20:18:07.237127] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-16T20:18:07.237168] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-16T20:18:07.237208] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-16T20:18:07.237242] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-16T20:18:07.582940] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:18:07.942785] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-10-16T20:18:08.174095] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T20:18:08.742838] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-16T20:18:09.542785] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-10-16T20:18:09.646061] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T20:18:09.799853] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T20:18:09.891096] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:18:09.891421] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-10-16T20:18:09.891515] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:18:09.891566] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-10-16T20:18:09.891623] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:18:09.891715] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-16T20:18:09.891778] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-16T20:18:09.891813] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-16T20:18:09.891851] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-16T20:18:09.891896] [INFO ] [MAIN ] Update Progress: 1407/2369 symbols completed. MSIF took 2.8s. Estimated remaining: 2h 15m 27s. Rate: 7.1 symbols/min [2025-10-16T20:18:10.062948] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:18:10.063113] [DEBUG] [LOCAL ] MSM: No existing data file found in primary storage. [2025-10-16T20:18:10.063151] [WARN ] [MAIN ] MSM: No existing data found, performing full refresh instead. [2025-10-16T20:18:10.063266] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-16T20:18:10.063308] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-16T20:18:10.063351] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-16T20:18:10.063385] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-16T20:18:10.347907] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-16T20:18:10.419093] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:18:11.142779] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-16T20:18:11.564544] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T20:18:11.942822] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-16T20:18:12.742807] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-10-16T20:18:13.293045] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T20:18:13.542846] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-16T20:18:13.769869] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-16T20:18:14.329051] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T20:18:14.345820] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-16T20:18:14.347397] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T20:18:15.142811] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-16T20:18:15.942825] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-16T20:18:15.988160] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T20:18:16.742854] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-16T20:18:16.946030] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T20:18:17.033564] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T20:18:17.542812] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-16T20:18:18.218972] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T20:18:18.342788] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-16T20:18:18.645634] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T20:18:19.142787] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-16T20:18:19.235282] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-16T20:18:19.942806] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-16T20:18:20.418596] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-16T20:18:20.742789] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-16T20:18:21.542797] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-16T20:18:21.673341] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T20:18:21.963219] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T20:18:22.214235] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-16T20:18:22.342855] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-16T20:18:23.142821] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-16T20:18:23.942889] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-16T20:18:23.985586] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T20:18:24.742788] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-16T20:18:24.807817] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T20:18:25.291601] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T20:18:25.542828] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-16T20:18:26.238025] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T20:18:26.243513] [INFO ] [REMOTE ] MSGE: Full fetch complete (40171 records). [2025-10-16T20:18:26.243676] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-16T20:18:26.244450] [FATAL] [VALIDATOR ] MSGE: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:18:26.244568] [FATAL] [MAIN ] MSGE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:18:26.244677] [WARN ] [MAIN ] MSGE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:18:26.244770] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-16T20:18:26.244848] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-16T20:18:26.244908] [INFO ] [LOCAL ] MSGE: Starting deletion of derivative data. [2025-10-16T20:18:26.244990] [DEBUG] [LOCAL ] MSGE: No derivative data file found to delete. [2025-10-16T20:18:26.245062] [INFO ] [MAIN ] Update Progress: 1408/2369 symbols completed. MSGE took 45.9s. Estimated remaining: 2h 15m 24s. Rate: 7.1 symbols/min [2025-10-16T20:18:26.348869] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-16T20:18:26.428260] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:18:26.428578] [DEBUG] [LOCAL ] MT: No existing data file found in primary storage. [2025-10-16T20:18:26.428637] [WARN ] [MAIN ] MT: No existing data found, performing full refresh instead. [2025-10-16T20:18:26.428933] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-16T20:18:26.439633] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-16T20:18:26.446328] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-16T20:18:26.446398] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-16T20:18:26.513347] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T20:18:26.804459] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:18:27.142886] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-10-16T20:18:27.517169] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T20:18:27.942810] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-16T20:18:28.742816] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-16T20:18:29.143674] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-16T20:18:29.542818] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-16T20:18:30.128964] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T20:18:30.131725] [INFO ] [REMOTE ] MSGS: Full fetch complete (23620 records). [2025-10-16T20:18:30.131800] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-16T20:18:30.132258] [FATAL] [VALIDATOR ] MSGS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:18:30.132339] [FATAL] [MAIN ] MSGS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:18:30.132384] [WARN ] [MAIN ] MSGS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:18:30.132454] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-16T20:18:30.132533] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-16T20:18:30.132610] [INFO ] [LOCAL ] MSGS: Starting deletion of derivative data. [2025-10-16T20:18:30.132724] [DEBUG] [LOCAL ] MSGS: No derivative data file found to delete. [2025-10-16T20:18:30.132810] [INFO ] [MAIN ] Update Progress: 1409/2369 symbols completed. MSGS took 27.0s. Estimated remaining: 2h 15m 12s. Rate: 7.1 symbols/min [2025-10-16T20:18:30.308556] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (3.17 seconds). [2025-10-16T20:18:30.351992] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:18:30.351078] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-16T20:18:30.352215] [DEBUG] [LOCAL ] MTB: No existing data file found in primary storage. [2025-10-16T20:18:30.353178] [WARN ] [MAIN ] MTB: No existing data found, performing full refresh instead. [2025-10-16T20:18:30.353317] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-16T20:18:30.353359] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-16T20:18:30.353399] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-16T20:18:30.353430] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-16T20:18:30.709083] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:18:31.142773] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-16T20:18:31.487044] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-10-16T20:18:31.942778] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-16T20:18:32.362594] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T20:18:32.522591] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T20:18:32.742863] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-16T20:18:33.542824] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-16T20:18:33.652534] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T20:18:34.342857] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-10-16T20:18:34.577586] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-16T20:18:35.107400] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T20:18:35.142820] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-16T20:18:35.942836] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-16T20:18:36.396466] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-16T20:18:36.742790] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-16T20:18:37.013982] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T20:18:37.542824] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-16T20:18:37.662952] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T20:18:38.342879] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-16T20:18:38.749533] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T20:18:39.048678] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T20:18:39.142814] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-16T20:18:39.810291] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T20:18:39.942785] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-16T20:18:40.742794] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-16T20:18:40.951359] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T20:18:40.980488] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T20:18:40.985005] [INFO ] [REMOTE ] MSM: Full fetch complete (51884 records). [2025-10-16T20:18:40.985101] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-16T20:18:40.985627] [FATAL] [VALIDATOR ] MSM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:18:40.985775] [FATAL] [MAIN ] MSM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:18:40.985818] [WARN ] [MAIN ] MSM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:18:40.985885] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-16T20:18:40.985961] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-16T20:18:40.986015] [INFO ] [LOCAL ] MSM: Starting deletion of derivative data. [2025-10-16T20:18:40.986058] [DEBUG] [LOCAL ] MSM: No derivative data file found to delete. [2025-10-16T20:18:40.986112] [INFO ] [MAIN ] Update Progress: 1410/2369 symbols completed. MSM took 31.1s. Estimated remaining: 2h 15m 5s. Rate: 7.1 symbols/min [2025-10-16T20:18:41.156813] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:18:41.172558] [DEBUG] [LOCAL ] MTD: Loaded 15452 existing records from primary storage. [2025-10-16T20:18:41.172820] [INFO ] [MAIN ] MTD: Loaded 15452 existing records. [2025-10-16T20:18:41.350240] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:18:41.350438] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-16T20:18:41.350483] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-16T20:18:41.351695] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-10-16T20:18:41.351754] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-16T20:18:41.548556] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-16T20:18:41.708491] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:18:42.342858] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-16T20:18:42.691756] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-16T20:18:43.151942] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-10-16T20:18:43.157751] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T20:18:43.942789] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-16T20:18:44.055474] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T20:18:44.064013] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-16T20:18:44.742821] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-16T20:18:45.504063] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T20:18:45.509100] [INFO ] [REMOTE ] MSI: Full fetch complete (57882 records). [2025-10-16T20:18:45.509220] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-16T20:18:45.509932] [FATAL] [VALIDATOR ] MSI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:18:45.510017] [FATAL] [MAIN ] MSI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:18:45.510059] [WARN ] [MAIN ] MSI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:18:45.510098] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-16T20:18:45.510183] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-16T20:18:45.510239] [INFO ] [LOCAL ] MSI: Starting deletion of derivative data. [2025-10-16T20:18:45.510294] [DEBUG] [LOCAL ] MSI: No derivative data file found to delete. [2025-10-16T20:18:45.510370] [INFO ] [MAIN ] Update Progress: 1411/2369 symbols completed. MSI took 40.5s. Estimated remaining: 2h 14m 54s. Rate: 7.1 symbols/min [2025-10-16T20:18:45.547915] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-16T20:18:45.702119] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:18:45.702283] [DEBUG] [LOCAL ] MTDR: No existing data file found in primary storage. [2025-10-16T20:18:45.702321] [WARN ] [MAIN ] MTDR: No existing data found, performing full refresh instead. [2025-10-16T20:18:45.702435] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-16T20:18:45.702476] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-16T20:18:45.702518] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-16T20:18:45.702551] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-16T20:18:46.059200] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:18:46.342785] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-10-16T20:18:46.583138] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-16T20:18:46.770067] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-16T20:18:47.142812] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-16T20:18:47.947923] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-16T20:18:47.964570] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T20:18:48.742784] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-16T20:18:48.781837] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T20:18:49.102266] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T20:18:49.542843] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-16T20:18:50.342823] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-16T20:18:50.550506] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T20:18:51.142804] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-16T20:18:51.367829] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T20:18:51.403486] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-16T20:18:51.942848] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-16T20:18:52.742873] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-16T20:18:52.962600] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T20:18:53.542852] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-16T20:18:54.114890] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T20:18:54.342806] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-16T20:18:54.436312] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-16T20:18:55.142826] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-16T20:18:55.645522] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-16T20:18:55.712632] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-16T20:18:55.942824] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-16T20:18:56.603168] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T20:18:56.742833] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-16T20:18:57.542803] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-16T20:18:57.946913] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-16T20:18:58.342785] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-16T20:18:58.661373] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T20:18:58.725894] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T20:18:59.142819] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-16T20:18:59.942776] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-16T20:19:00.063409] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T20:19:00.742838] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-16T20:19:01.137547] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T20:19:01.195572] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T20:19:01.542861] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-16T20:19:02.342840] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-16T20:19:02.395842] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T20:19:02.425981] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T20:19:03.142857] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-16T20:19:03.942786] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-16T20:19:03.996225] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T20:19:04.102794] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T20:19:04.742824] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-16T20:19:05.542794] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-16T20:19:05.760823] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T20:19:05.763143] [INFO ] [REMOTE ] MTD: Full fetch complete (21439 records). [2025-10-16T20:19:05.763214] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-16T20:19:06.148635] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-16T20:19:06.160051] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-10-16T20:19:06.168783] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-10-16T20:19:06.169810] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-10-16T20:19:06.169888] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-10-16T20:19:06.171140] [DEBUG] [LOCAL ] MTD: Trimmed 21439 records to 15539 (keeping 200 days of data) [2025-10-16T20:19:06.267810] [DEBUG] [LOCAL ] MTD: Primary data saved (15539 records). [2025-10-16T20:19:06.267949] [INFO ] [MAIN ] MTD: Full history saved. [2025-10-16T20:19:06.268029] [INFO ] [MAIN ] Update Progress: 1412/2369 symbols completed. MTD took 25.3s. Estimated remaining: 2h 14m 54s. Rate: 7.1 symbols/min [2025-10-16T20:19:06.347913] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-16T20:19:06.439824] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:19:06.439970] [DEBUG] [LOCAL ] MTG: No existing data file found in primary storage. [2025-10-16T20:19:06.440007] [WARN ] [MAIN ] MTG: No existing data found, performing full refresh instead. [2025-10-16T20:19:06.440144] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-16T20:19:06.440211] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-16T20:19:06.440265] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-16T20:19:06.440301] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-16T20:19:06.795875] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:19:07.142787] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-10-16T20:19:07.357861] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T20:19:07.834388] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T20:19:07.942779] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-16T20:19:08.740952] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T20:19:08.746847] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-16T20:19:08.748394] [INFO ] [REMOTE ] MTB: Full fetch complete (67828 records). [2025-10-16T20:19:08.748517] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-16T20:19:08.749808] [FATAL] [VALIDATOR ] MTB: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:19:08.749923] [FATAL] [MAIN ] MTB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:19:08.749990] [WARN ] [MAIN ] MTB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:19:08.750062] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-16T20:19:08.750128] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-16T20:19:08.750183] [INFO ] [LOCAL ] MTB: Starting deletion of derivative data. [2025-10-16T20:19:08.750227] [DEBUG] [LOCAL ] MTB: No derivative data file found to delete. [2025-10-16T20:19:08.750328] [INFO ] [MAIN ] Update Progress: 1413/2369 symbols completed. MTB took 38.6s. Estimated remaining: 2h 14m 42s. Rate: 7.1 symbols/min [2025-10-16T20:19:08.953135] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:19:08.953329] [DEBUG] [LOCAL ] MTH: No existing data file found in primary storage. [2025-10-16T20:19:08.953425] [WARN ] [MAIN ] MTH: No existing data found, performing full refresh instead. [2025-10-16T20:19:08.953551] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-16T20:19:08.953599] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-16T20:19:08.953750] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-16T20:19:08.953844] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-16T20:19:09.240065] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-16T20:19:09.355820] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:19:09.371964] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-16T20:19:09.378896] [INFO ] [REMOTE ] MT: Full fetch complete (73398 records). [2025-10-16T20:19:09.379040] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-16T20:19:09.379845] [FATAL] [VALIDATOR ] MT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:19:09.379934] [FATAL] [MAIN ] MT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:19:09.379980] [WARN ] [MAIN ] MT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:19:09.380044] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-16T20:19:09.380109] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-16T20:19:09.380148] [INFO ] [LOCAL ] MT: Starting deletion of derivative data. [2025-10-16T20:19:09.380235] [DEBUG] [LOCAL ] MT: No derivative data file found to delete. [2025-10-16T20:19:09.380300] [INFO ] [MAIN ] Update Progress: 1414/2369 symbols completed. MT took 43.1s. Estimated remaining: 2h 14m 28s. Rate: 7.1 symbols/min [2025-10-16T20:19:09.548902] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:19:09.548967] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-10-16T20:19:09.549943] [DEBUG] [LOCAL ] MTN: No existing data file found in primary storage. [2025-10-16T20:19:09.549993] [WARN ] [MAIN ] MTN: No existing data found, performing full refresh instead. [2025-10-16T20:19:09.550096] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-16T20:19:09.550137] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-16T20:19:09.550177] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-16T20:19:09.550209] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-16T20:19:09.966188] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:19:10.342892] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-16T20:19:11.142820] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-10-16T20:19:11.362289] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T20:19:11.942794] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-16T20:19:12.184679] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-16T20:19:12.699108] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T20:19:12.742778] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-16T20:19:13.184778] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-16T20:19:13.542880] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-16T20:19:14.342856] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-16T20:19:14.516163] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T20:19:15.142835] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-16T20:19:15.361188] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T20:19:15.942825] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-16T20:19:16.186611] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-16T20:19:16.742777] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-16T20:19:16.826419] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T20:19:17.542819] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-16T20:19:17.769911] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T20:19:18.342845] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-16T20:19:18.563008] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T20:19:18.766151] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T20:19:19.142856] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-16T20:19:19.874316] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T20:19:19.942786] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-16T20:19:20.742805] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-16T20:19:21.118599] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-16T20:19:21.542806] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-16T20:19:21.682774] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T20:19:22.065186] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T20:19:22.342785] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-16T20:19:23.150995] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-16T20:19:23.152493] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T20:19:23.942808] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-16T20:19:24.144758] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-16T20:19:24.742790] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-16T20:19:24.889209] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-16T20:19:24.895429] [INFO ] [REMOTE ] MTDR: Full fetch complete (73759 records). [2025-10-16T20:19:24.895540] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-16T20:19:24.896216] [FATAL] [VALIDATOR ] MTDR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:19:24.896300] [FATAL] [MAIN ] MTDR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:19:24.896342] [WARN ] [MAIN ] MTDR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:19:24.896380] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-16T20:19:24.896434] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-16T20:19:24.896468] [INFO ] [LOCAL ] MTDR: Starting deletion of derivative data. [2025-10-16T20:19:24.896506] [DEBUG] [LOCAL ] MTDR: No derivative data file found to delete. [2025-10-16T20:19:24.896579] [INFO ] [MAIN ] Update Progress: 1415/2369 symbols completed. MTDR took 39.4s. Estimated remaining: 2h 14m 24s. Rate: 7.1 symbols/min [2025-10-16T20:19:25.087413] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:19:25.087605] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-16T20:19:25.087737] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-16T20:19:25.087924] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-16T20:19:25.088023] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-16T20:19:25.088082] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-16T20:19:25.088117] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-16T20:19:25.432526] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-16T20:19:25.476674] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:19:25.542805] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-16T20:19:26.143662] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T20:19:26.342846] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-16T20:19:27.142849] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-16T20:19:27.215184] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T20:19:27.942822] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-16T20:19:28.186692] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T20:19:28.740715] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T20:19:28.748856] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-10-16T20:19:29.157288] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-16T20:19:29.440733] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T20:19:29.542829] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-16T20:19:30.105669] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T20:19:30.342810] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-16T20:19:31.142794] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-16T20:19:31.652312] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-16T20:19:31.942818] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-16T20:19:32.207460] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-16T20:19:32.742814] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-16T20:19:33.542777] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-16T20:19:33.806972] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-16T20:19:33.965404] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T20:19:34.342827] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-16T20:19:35.142798] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-16T20:19:35.188359] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T20:19:35.942827] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-16T20:19:36.098146] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T20:19:36.437546] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-16T20:19:36.742813] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-16T20:19:36.994596] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T20:19:37.542824] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-16T20:19:38.342788] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-16T20:19:38.463130] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T20:19:38.491489] [INFO ] [REMOTE ] MTH: Full fetch complete (63609 records). [2025-10-16T20:19:38.491866] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-16T20:19:38.493198] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T20:19:38.501986] [FATAL] [VALIDATOR ] MTH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:19:38.502480] [FATAL] [MAIN ] MTH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:19:38.502576] [WARN ] [MAIN ] MTH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:19:38.502685] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-16T20:19:38.503054] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-16T20:19:38.503112] [INFO ] [LOCAL ] MTH: Starting deletion of derivative data. [2025-10-16T20:19:38.503158] [DEBUG] [LOCAL ] MTH: No derivative data file found to delete. [2025-10-16T20:19:38.503218] [INFO ] [MAIN ] Update Progress: 1416/2369 symbols completed. MTH took 29.8s. Estimated remaining: 2h 14m 19s. Rate: 7.1 symbols/min [2025-10-16T20:19:38.672026] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:19:38.672198] [DEBUG] [LOCAL ] MTRN: No existing data file found in primary storage. [2025-10-16T20:19:38.672236] [WARN ] [MAIN ] MTRN: No existing data found, performing full refresh instead. [2025-10-16T20:19:38.672348] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-16T20:19:38.672392] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-16T20:19:38.672434] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-16T20:19:38.672468] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-16T20:19:39.023566] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:19:39.142822] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-16T20:19:39.909750] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-16T20:19:39.915122] [INFO ] [REMOTE ] MTN: Full fetch complete (56583 records). [2025-10-16T20:19:39.915226] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-16T20:19:39.915893] [FATAL] [VALIDATOR ] MTN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:19:39.915975] [FATAL] [MAIN ] MTN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:19:39.916037] [WARN ] [MAIN ] MTN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:19:39.916125] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-16T20:19:39.916209] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-16T20:19:39.916261] [INFO ] [LOCAL ] MTN: Starting deletion of derivative data. [2025-10-16T20:19:39.916327] [DEBUG] [LOCAL ] MTN: No derivative data file found to delete. [2025-10-16T20:19:39.916399] [INFO ] [MAIN ] Update Progress: 1417/2369 symbols completed. MTN took 30.5s. Estimated remaining: 2h 14m 6s. Rate: 7.1 symbols/min [2025-10-16T20:19:39.947969] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-16T20:19:40.096006] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:19:40.096223] [DEBUG] [LOCAL ] MTUS: No existing data file found in primary storage. [2025-10-16T20:19:40.096287] [WARN ] [MAIN ] MTUS: No existing data found, performing full refresh instead. [2025-10-16T20:19:40.096404] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-16T20:19:40.096448] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-16T20:19:40.096521] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-16T20:19:40.096581] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-16T20:19:40.274451] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T20:19:40.506563] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:19:40.512238] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-16T20:19:40.742796] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-10-16T20:19:41.542829] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-16T20:19:42.090858] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-16T20:19:42.211608] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T20:19:42.342814] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-16T20:19:43.142808] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-10-16T20:19:43.942787] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-16T20:19:44.159602] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T20:19:44.203091] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-16T20:19:44.742837] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-16T20:19:45.242141] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T20:19:45.542815] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-16T20:19:46.342784] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-16T20:19:46.545008] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-16T20:19:46.992414] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T20:19:47.142881] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-16T20:19:47.327085] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T20:19:47.936109] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T20:19:47.942844] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-16T20:19:48.742810] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-16T20:19:49.376913] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T20:19:49.542778] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-16T20:19:49.679402] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T20:19:50.342835] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-16T20:19:50.917738] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T20:19:50.984826] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T20:19:51.142811] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-16T20:19:51.942808] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-16T20:19:52.541938] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T20:19:52.614261] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T20:19:52.620426] [INFO ] [REMOTE ] MTG: Full fetch complete (73829 records). [2025-10-16T20:19:52.620581] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-16T20:19:52.621307] [FATAL] [VALIDATOR ] MTG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:19:52.621395] [FATAL] [MAIN ] MTG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:19:52.621438] [WARN ] [MAIN ] MTG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:19:52.621507] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-16T20:19:52.621571] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-16T20:19:52.621607] [INFO ] [LOCAL ] MTG: Starting deletion of derivative data. [2025-10-16T20:19:52.621676] [DEBUG] [LOCAL ] MTG: No derivative data file found to delete. [2025-10-16T20:19:52.621755] [INFO ] [MAIN ] Update Progress: 1418/2369 symbols completed. MTG took 46.4s. Estimated remaining: 2h 14m 1s. Rate: 7.1 symbols/min [2025-10-16T20:19:52.747948] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-16T20:19:52.805184] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:19:52.805391] [DEBUG] [LOCAL ] MTW: No existing data file found in primary storage. [2025-10-16T20:19:52.805434] [WARN ] [MAIN ] MTW: No existing data found, performing full refresh instead. [2025-10-16T20:19:52.805539] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-16T20:19:52.805580] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-16T20:19:52.805619] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-16T20:19:52.805681] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-16T20:19:53.155253] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:19:53.542817] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-16T20:19:54.004521] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-16T20:19:54.050358] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T20:19:54.342820] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-10-16T20:19:55.142851] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-16T20:19:55.641524] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-16T20:19:55.643955] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T20:19:55.942822] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-16T20:19:56.742826] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-16T20:19:57.025023] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-16T20:19:57.236231] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T20:19:57.237206] [INFO ] [REMOTE ] MTR: Full fetch complete (2424 records). [2025-10-16T20:19:57.237300] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-16T20:19:57.435130] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T20:19:57.435344] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:19:57.435413] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:19:57.435486] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-16T20:19:57.435551] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-16T20:19:57.435588] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-16T20:19:57.435626] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-16T20:19:57.435718] [INFO ] [MAIN ] Update Progress: 1419/2369 symbols completed. MTR took 32.5s. Estimated remaining: 2h 13m 50s. Rate: 7.1 symbols/min [2025-10-16T20:19:57.547914] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-16T20:19:57.650472] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:19:57.650710] [DEBUG] [LOCAL ] MTX: No existing data file found in primary storage. [2025-10-16T20:19:57.650769] [WARN ] [MAIN ] MTX: No existing data found, performing full refresh instead. [2025-10-16T20:19:57.650901] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-16T20:19:57.650951] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-16T20:19:57.651007] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-16T20:19:57.651042] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-16T20:19:58.047300] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:19:58.342835] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-16T20:19:58.812062] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T20:19:59.142880] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-10-16T20:19:59.477267] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-16T20:19:59.942860] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-16T20:20:00.270429] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T20:20:00.742879] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-16T20:20:01.542866] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-16T20:20:01.562996] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T20:20:02.067635] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T20:20:02.342833] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-16T20:20:03.142782] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-16T20:20:03.942872] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-16T20:20:04.443024] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-16T20:20:04.742891] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-16T20:20:05.295467] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T20:20:05.542840] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-16T20:20:05.844786] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (4.30 seconds). [2025-10-16T20:20:06.021571] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-16T20:20:06.342789] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-16T20:20:06.878494] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (4.54 seconds). [2025-10-16T20:20:06.923580] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T20:20:07.142883] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-16T20:20:07.853795] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T20:20:07.942838] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-16T20:20:08.428533] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T20:20:08.513505] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T20:20:08.516913] [INFO ] [REMOTE ] MTRN: Full fetch complete (23857 records). [2025-10-16T20:20:08.517029] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-16T20:20:08.517594] [FATAL] [VALIDATOR ] MTRN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:20:08.517742] [FATAL] [MAIN ] MTRN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:20:08.517809] [WARN ] [MAIN ] MTRN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:20:08.517883] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-16T20:20:08.517950] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-16T20:20:08.517986] [INFO ] [LOCAL ] MTRN: Starting deletion of derivative data. [2025-10-16T20:20:08.518026] [DEBUG] [LOCAL ] MTRN: No derivative data file found to delete. [2025-10-16T20:20:08.518081] [INFO ] [MAIN ] Update Progress: 1420/2369 symbols completed. MTRN took 30.0s. Estimated remaining: 2h 13m 43s. Rate: 7.1 symbols/min [2025-10-16T20:20:08.720446] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:20:08.720683] [DEBUG] [LOCAL ] MTZ: No existing data file found in primary storage. [2025-10-16T20:20:08.720738] [WARN ] [MAIN ] MTZ: No existing data found, performing full refresh instead. [2025-10-16T20:20:08.720848] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-16T20:20:08.720890] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-16T20:20:08.720932] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-16T20:20:08.720964] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-16T20:20:08.751277] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-16T20:20:09.143182] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:20:09.542832] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-16T20:20:10.269516] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T20:20:10.342798] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-10-16T20:20:10.726367] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T20:20:11.142813] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-16T20:20:11.874013] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T20:20:11.942812] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-16T20:20:12.222357] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-16T20:20:12.742857] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-16T20:20:13.542843] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-16T20:20:13.777674] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T20:20:14.265712] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T20:20:14.342811] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-16T20:20:14.658328] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T20:20:15.142842] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-16T20:20:15.784037] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T20:20:15.942807] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-16T20:20:16.536707] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T20:20:16.747287] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-16T20:20:16.754798] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T20:20:17.542860] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-16T20:20:18.128285] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T20:20:18.342818] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-16T20:20:19.142781] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-16T20:20:19.322790] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T20:20:19.715130] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T20:20:19.942822] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-16T20:20:20.742828] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-16T20:20:21.263883] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-16T20:20:21.542839] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-16T20:20:21.851545] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-16T20:20:22.061461] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T20:20:22.103716] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-16T20:20:22.106913] [INFO ] [REMOTE ] MTUS: Full fetch complete (41212 records). [2025-10-16T20:20:22.106998] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-16T20:20:22.107476] [FATAL] [VALIDATOR ] MTUS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:20:22.107559] [FATAL] [MAIN ] MTUS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:20:22.107601] [WARN ] [MAIN ] MTUS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:20:22.107694] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-16T20:20:22.107763] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-16T20:20:22.107797] [INFO ] [LOCAL ] MTUS: Starting deletion of derivative data. [2025-10-16T20:20:22.107835] [DEBUG] [LOCAL ] MTUS: No derivative data file found to delete. [2025-10-16T20:20:22.107885] [INFO ] [MAIN ] Update Progress: 1421/2369 symbols completed. MTUS took 42.2s. Estimated remaining: 2h 13m 38s. Rate: 7.1 symbols/min [2025-10-16T20:20:22.272057] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:20:22.284127] [DEBUG] [LOCAL ] MUA: Loaded 11546 existing records from primary storage. [2025-10-16T20:20:22.284348] [INFO ] [MAIN ] MUA: Loaded 11546 existing records. [2025-10-16T20:20:22.347927] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-16T20:20:22.463009] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:20:22.463342] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-16T20:20:22.463399] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-16T20:20:22.463798] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-10-16T20:20:22.463858] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-16T20:20:22.849809] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:20:23.142836] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-16T20:20:23.942873] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-16T20:20:24.243222] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T20:20:24.675902] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T20:20:24.742831] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-16T20:20:25.294219] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T20:20:25.542796] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-16T20:20:26.242230] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T20:20:26.342843] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-16T20:20:26.683245] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-16T20:20:26.988835] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-16T20:20:26.991996] [INFO ] [REMOTE ] MTW: Full fetch complete (37953 records). [2025-10-16T20:20:26.992096] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-16T20:20:26.992698] [FATAL] [VALIDATOR ] MTW: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:20:26.992785] [FATAL] [MAIN ] MTW: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:20:26.992828] [WARN ] [MAIN ] MTW: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:20:26.992867] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-16T20:20:26.992923] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-16T20:20:26.992958] [INFO ] [LOCAL ] MTW: Starting deletion of derivative data. [2025-10-16T20:20:26.992995] [DEBUG] [LOCAL ] MTW: No derivative data file found to delete. [2025-10-16T20:20:26.993048] [INFO ] [MAIN ] Update Progress: 1422/2369 symbols completed. MTW took 34.4s. Estimated remaining: 2h 13m 27s. Rate: 7.1 symbols/min [2025-10-16T20:20:27.149604] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-16T20:20:27.170353] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:20:27.170553] [DEBUG] [LOCAL ] MUC: No existing data file found in primary storage. [2025-10-16T20:20:27.170595] [WARN ] [MAIN ] MUC: No existing data found, performing full refresh instead. [2025-10-16T20:20:27.170730] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-16T20:20:27.170775] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-16T20:20:27.170816] [DEBUG] [LOCAL ] MUC: No primary data file found to delete. [2025-10-16T20:20:27.170848] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-16T20:20:27.518417] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:20:27.864519] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-16T20:20:27.867057] [INFO ] [REMOTE ] MTX: Full fetch complete (31264 records). [2025-10-16T20:20:27.867129] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-16T20:20:27.867548] [FATAL] [VALIDATOR ] MTX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:20:27.867629] [FATAL] [MAIN ] MTX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:20:27.867713] [WARN ] [MAIN ] MTX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:20:27.867759] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-16T20:20:27.867813] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-16T20:20:27.867847] [INFO ] [LOCAL ] MTX: Starting deletion of derivative data. [2025-10-16T20:20:27.867884] [DEBUG] [LOCAL ] MTX: No derivative data file found to delete. [2025-10-16T20:20:27.867934] [INFO ] [MAIN ] Update Progress: 1423/2369 symbols completed. MTX took 30.4s. Estimated remaining: 2h 13m 14s. Rate: 7.1 symbols/min [2025-10-16T20:20:27.947981] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-10-16T20:20:28.036587] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:20:28.048045] [DEBUG] [LOCAL ] MUE: Loaded 11930 existing records from primary storage. [2025-10-16T20:20:28.048249] [INFO ] [MAIN ] MUE: Loaded 11930 existing records. [2025-10-16T20:20:28.223122] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:20:28.223340] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-16T20:20:28.223388] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-16T20:20:28.223706] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-10-16T20:20:28.223763] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-16T20:20:28.568083] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:20:28.742800] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-16T20:20:29.203276] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T20:20:29.542842] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-10-16T20:20:30.342807] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-16T20:20:30.367500] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T20:20:30.727167] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T20:20:31.097304] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T20:20:31.142781] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-16T20:20:31.925145] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T20:20:31.942774] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-10-16T20:20:32.742836] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-16T20:20:33.279312] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T20:20:33.361405] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-16T20:20:33.542831] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-16T20:20:34.342812] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-16T20:20:34.630608] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T20:20:35.142814] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-16T20:20:35.902431] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T20:20:35.942799] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-16T20:20:36.151098] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T20:20:36.665784] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-16T20:20:36.742801] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-16T20:20:37.542813] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-16T20:20:37.689308] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T20:20:38.342805] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-16T20:20:38.705947] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-16T20:20:39.142786] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-16T20:20:39.375990] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T20:20:39.942806] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-16T20:20:40.742815] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-16T20:20:40.872978] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T20:20:40.994148] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T20:20:41.542794] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-16T20:20:41.771628] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T20:20:42.342843] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-16T20:20:42.611498] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T20:20:43.142816] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-16T20:20:43.947898] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-16T20:20:43.962124] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T20:20:44.182404] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T20:20:44.742792] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-16T20:20:45.227626] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T20:20:45.385680] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-16T20:20:45.542781] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-16T20:20:46.342794] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-16T20:20:46.494860] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T20:20:47.077503] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T20:20:47.083217] [INFO ] [REMOTE ] MTZ: Full fetch complete (63551 records). [2025-10-16T20:20:47.083384] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-16T20:20:47.084241] [FATAL] [VALIDATOR ] MTZ: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:20:47.084340] [FATAL] [MAIN ] MTZ: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:20:47.084384] [WARN ] [MAIN ] MTZ: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:20:47.084423] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-16T20:20:47.084481] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-16T20:20:47.084529] [INFO ] [LOCAL ] MTZ: Starting deletion of derivative data. [2025-10-16T20:20:47.084598] [DEBUG] [LOCAL ] MTZ: No derivative data file found to delete. [2025-10-16T20:20:47.084679] [INFO ] [MAIN ] Update Progress: 1424/2369 symbols completed. MTZ took 38.6s. Estimated remaining: 2h 13m 12s. Rate: 7.1 symbols/min [2025-10-16T20:20:47.148757] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-16T20:20:47.263606] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:20:47.263805] [DEBUG] [LOCAL ] MUFG: No existing data file found in primary storage. [2025-10-16T20:20:47.263859] [WARN ] [MAIN ] MUFG: No existing data found, performing full refresh instead. [2025-10-16T20:20:47.263967] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-16T20:20:47.264008] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-16T20:20:47.264049] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-16T20:20:47.264081] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-16T20:20:47.607988] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:20:47.942810] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-10-16T20:20:48.076197] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T20:20:48.742812] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-16T20:20:49.542801] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-16T20:20:49.841577] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-16T20:20:49.937881] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T20:20:50.189253] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-16T20:20:50.342800] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-16T20:20:51.142880] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-16T20:20:51.942816] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-16T20:20:52.276497] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T20:20:52.742803] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-16T20:20:52.832127] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-16T20:20:53.185607] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T20:20:53.542789] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-16T20:20:53.626972] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T20:20:54.342793] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-16T20:20:54.464277] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T20:20:55.142860] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-16T20:20:55.543251] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T20:20:55.942816] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-16T20:20:56.281912] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T20:20:56.742884] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-16T20:20:56.793439] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T20:20:56.796107] [INFO ] [REMOTE ] MUE: Full fetch complete (15994 records). [2025-10-16T20:20:56.796276] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-16T20:20:57.361544] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-16T20:20:57.361675] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-16T20:20:57.362209] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-16T20:20:57.362329] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-16T20:20:57.363123] [DEBUG] [LOCAL ] MUE: Trimmed 15994 records to 12115 (keeping 200 days of data) [2025-10-16T20:20:57.440325] [DEBUG] [LOCAL ] MUE: Primary data saved (12115 records). [2025-10-16T20:20:57.440483] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-16T20:20:57.440565] [INFO ] [MAIN ] Update Progress: 1425/2369 symbols completed. MUE took 29.6s. Estimated remaining: 2h 13m 5s. Rate: 7.1 symbols/min [2025-10-16T20:20:57.547020] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-16T20:20:57.632345] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T20:20:57.631862] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:20:57.634987] [DEBUG] [LOCAL ] MUJ: No existing data file found in primary storage. [2025-10-16T20:20:57.635459] [WARN ] [MAIN ] MUJ: No existing data found, performing full refresh instead. [2025-10-16T20:20:57.635947] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-16T20:20:57.635995] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-16T20:20:57.636038] [DEBUG] [LOCAL ] MUJ: No primary data file found to delete. [2025-10-16T20:20:57.636071] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-16T20:20:57.980899] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:20:58.342849] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-16T20:20:59.142860] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-16T20:20:59.228131] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T20:20:59.230155] [INFO ] [REMOTE ] MUA: Full fetch complete (18449 records). [2025-10-16T20:20:59.230277] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-16T20:20:59.641069] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-10-16T20:20:59.641444] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-10-16T20:20:59.644306] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-16T20:20:59.642699] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-10-16T20:20:59.654407] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-10-16T20:20:59.656015] [DEBUG] [LOCAL ] MUA: Trimmed 18449 records to 11602 (keeping 200 days of data) [2025-10-16T20:20:59.725863] [DEBUG] [LOCAL ] MUA: Primary data saved (11602 records). [2025-10-16T20:20:59.725987] [INFO ] [MAIN ] MUA: Full history saved. [2025-10-16T20:20:59.726065] [INFO ] [MAIN ] Update Progress: 1426/2369 symbols completed. MUA took 37.6s. Estimated remaining: 2h 12m 53s. Rate: 7.1 symbols/min [2025-10-16T20:20:59.892605] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:20:59.892806] [DEBUG] [LOCAL ] MUR: No existing data file found in primary storage. [2025-10-16T20:20:59.892848] [WARN ] [MAIN ] MUR: No existing data found, performing full refresh instead. [2025-10-16T20:20:59.892956] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-16T20:20:59.892997] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-16T20:20:59.893037] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-16T20:20:59.893069] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-16T20:20:59.952476] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-16T20:21:00.266422] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:21:00.406853] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T20:21:00.742840] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-10-16T20:21:01.542840] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-10-16T20:21:02.097583] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T20:21:02.342863] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-16T20:21:02.470788] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-16T20:21:02.699231] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-16T20:21:02.701941] [INFO ] [REMOTE ] MUC: Full fetch complete (29375 records). [2025-10-16T20:21:02.702014] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-16T20:21:02.702437] [FATAL] [VALIDATOR ] MUC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:21:02.702518] [FATAL] [MAIN ] MUC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:21:02.702562] [WARN ] [MAIN ] MUC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:21:02.702625] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-16T20:21:02.702726] [DEBUG] [LOCAL ] MUC: No primary data file found to delete. [2025-10-16T20:21:02.702770] [INFO ] [LOCAL ] MUC: Starting deletion of derivative data. [2025-10-16T20:21:02.702811] [DEBUG] [LOCAL ] MUC: No derivative data file found to delete. [2025-10-16T20:21:02.702862] [INFO ] [MAIN ] Update Progress: 1427/2369 symbols completed. MUC took 35.7s. Estimated remaining: 2h 12m 40s. Rate: 7.1 symbols/min [2025-10-16T20:21:02.865895] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:21:02.866019] [DEBUG] [LOCAL ] MUSA: No existing data file found in primary storage. [2025-10-16T20:21:02.866056] [WARN ] [MAIN ] MUSA: No existing data found, performing full refresh instead. [2025-10-16T20:21:02.866177] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-16T20:21:02.866218] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-16T20:21:02.866259] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-16T20:21:02.866289] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-16T20:21:03.148029] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-16T20:21:03.217136] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:21:03.942833] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-10-16T20:21:04.300145] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T20:21:04.532207] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (2.99 seconds). [2025-10-16T20:21:04.742836] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-16T20:21:04.826050] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-16T20:21:05.542873] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-16T20:21:06.342828] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-16T20:21:06.788165] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-16T20:21:06.873692] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T20:21:07.091815] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T20:21:07.142789] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-16T20:21:07.942793] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-16T20:21:08.062071] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-16T20:21:08.742823] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-16T20:21:09.432167] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T20:21:09.542777] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-16T20:21:09.709298] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-16T20:21:10.342799] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-16T20:21:10.897974] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-16T20:21:11.142865] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-16T20:21:11.942875] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-16T20:21:12.234788] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-16T20:21:12.381159] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-16T20:21:12.742861] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-16T20:21:13.343245] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T20:21:13.507172] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T20:21:13.542775] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-16T20:21:14.342828] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-16T20:21:14.682768] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T20:21:15.142812] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-16T20:21:15.942791] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-16T20:21:16.196926] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-16T20:21:16.732912] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T20:21:16.742768] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-16T20:21:17.287452] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T20:21:17.542852] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-16T20:21:18.342803] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-16T20:21:18.535064] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T20:21:19.142869] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-16T20:21:19.844579] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-16T20:21:19.942799] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-16T20:21:20.339950] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-16T20:21:20.742872] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-16T20:21:20.961016] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T20:21:21.542825] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-16T20:21:22.049359] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-16T20:21:22.091182] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T20:21:22.342840] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-16T20:21:22.830229] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T20:21:23.142831] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-16T20:21:23.942857] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-16T20:21:24.257631] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-16T20:21:24.458033] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T20:21:24.564174] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-16T20:21:24.566531] [INFO ] [REMOTE ] MUJ: Full fetch complete (19756 records). [2025-10-16T20:21:24.566601] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-16T20:21:24.567080] [FATAL] [VALIDATOR ] MUJ: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:21:24.567162] [FATAL] [MAIN ] MUJ: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:21:24.567204] [WARN ] [MAIN ] MUJ: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:21:24.567272] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-16T20:21:24.567334] [DEBUG] [LOCAL ] MUJ: No primary data file found to delete. [2025-10-16T20:21:24.567383] [INFO ] [LOCAL ] MUJ: Starting deletion of derivative data. [2025-10-16T20:21:24.567450] [DEBUG] [LOCAL ] MUJ: No derivative data file found to delete. [2025-10-16T20:21:24.567506] [INFO ] [MAIN ] Update Progress: 1428/2369 symbols completed. MUJ took 27.1s. Estimated remaining: 2h 12m 41s. Rate: 7.1 symbols/min [2025-10-16T20:21:24.731706] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:21:24.731866] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-16T20:21:24.731902] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-16T20:21:24.732011] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-16T20:21:24.732057] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-16T20:21:24.732097] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-16T20:21:24.732127] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-16T20:21:24.751986] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-16T20:21:25.081204] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:21:25.542809] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-16T20:21:26.342842] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-16T20:21:26.826156] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-16T20:21:27.095721] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T20:21:27.099718] [INFO ] [REMOTE ] MUSA: Full fetch complete (35161 records). [2025-10-16T20:21:27.099830] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-16T20:21:27.100453] [FATAL] [VALIDATOR ] MUSA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:21:27.100556] [FATAL] [MAIN ] MUSA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:21:27.100612] [WARN ] [MAIN ] MUSA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:21:27.100715] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-16T20:21:27.100829] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-16T20:21:27.100896] [INFO ] [LOCAL ] MUSA: Starting deletion of derivative data. [2025-10-16T20:21:27.100958] [DEBUG] [LOCAL ] MUSA: No derivative data file found to delete. [2025-10-16T20:21:27.101036] [INFO ] [MAIN ] Update Progress: 1429/2369 symbols completed. MUSA took 24.4s. Estimated remaining: 2h 12m 29s. Rate: 7.1 symbols/min [2025-10-16T20:21:27.149296] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-16T20:21:27.282372] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:21:27.282525] [DEBUG] [LOCAL ] MUX: No existing data file found in primary storage. [2025-10-16T20:21:27.282569] [WARN ] [MAIN ] MUX: No existing data found, performing full refresh instead. [2025-10-16T20:21:27.282709] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-16T20:21:27.282761] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-16T20:21:27.282808] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-16T20:21:27.282852] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-16T20:21:27.661679] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:21:27.691480] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-16T20:21:27.942879] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-10-16T20:21:28.742865] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-16T20:21:29.101680] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-16T20:21:29.448274] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T20:21:29.542805] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-16T20:21:30.342846] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-16T20:21:30.776831] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-16T20:21:31.005133] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T20:21:31.142777] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-16T20:21:31.942787] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-16T20:21:32.270831] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-16T20:21:32.643008] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T20:21:32.742775] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-16T20:21:33.542846] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-16T20:21:33.932874] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-16T20:21:34.150226] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-16T20:21:34.156404] [INFO ] [REMOTE ] MUFG: Full fetch complete (75440 records). [2025-10-16T20:21:34.156541] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-16T20:21:34.157340] [FATAL] [VALIDATOR ] MUFG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:21:34.157439] [FATAL] [MAIN ] MUFG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:21:34.157482] [WARN ] [MAIN ] MUFG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:21:34.157520] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-16T20:21:34.157577] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-16T20:21:34.157612] [INFO ] [LOCAL ] MUFG: Starting deletion of derivative data. [2025-10-16T20:21:34.157715] [DEBUG] [LOCAL ] MUFG: No derivative data file found to delete. [2025-10-16T20:21:34.157779] [INFO ] [MAIN ] Update Progress: 1430/2369 symbols completed. MUFG took 47.1s. Estimated remaining: 2h 12m 19s. Rate: 7.1 symbols/min [2025-10-16T20:21:34.327344] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:21:34.340705] [DEBUG] [LOCAL ] MVF: Loaded 12768 existing records from primary storage. [2025-10-16T20:21:34.340943] [INFO ] [MAIN ] MVF: Loaded 12768 existing records. [2025-10-16T20:21:34.351935] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-10-16T20:21:34.523843] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:21:34.524183] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-16T20:21:34.524336] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-16T20:21:34.524961] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-10-16T20:21:34.525021] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-16T20:21:34.701864] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-16T20:21:34.755282] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-16T20:21:34.947745] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:21:35.142833] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-16T20:21:35.461283] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:21:35.461631] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-16T20:21:35.461764] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:21:35.461834] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-16T20:21:35.461869] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:21:35.461905] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-16T20:21:35.461958] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-16T20:21:35.462000] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-16T20:21:35.462038] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-16T20:21:35.462081] [INFO ] [MAIN ] Update Progress: 1431/2369 symbols completed. MUSE took 10.9s. Estimated remaining: 2h 12m 6s. Rate: 7.1 symbols/min [2025-10-16T20:21:35.631964] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:21:35.641195] [DEBUG] [LOCAL ] MVO: Loaded 8824 existing records from primary storage. [2025-10-16T20:21:35.641420] [INFO ] [MAIN ] MVO: Loaded 8824 existing records. [2025-10-16T20:21:35.815293] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:21:35.815506] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-16T20:21:35.815552] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-16T20:21:35.815844] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-10-16T20:21:35.815901] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-16T20:21:35.954288] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-16T20:21:36.173456] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:21:36.742871] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-10-16T20:21:37.542814] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-16T20:21:37.576170] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T20:21:37.645102] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T20:21:38.342822] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-16T20:21:39.142877] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-10-16T20:21:39.519410] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-16T20:21:39.562695] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-16T20:21:39.942833] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-16T20:21:40.231680] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T20:21:40.742828] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-16T20:21:41.542814] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-16T20:21:41.679261] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T20:21:41.908956] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T20:21:42.342823] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-16T20:21:42.450308] [DEBUG] [REMOTE ] MVO: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-16T20:21:42.450668] [WARN ] [REMOTE ] MVO: No data returned for month 2025-03 [2025-10-16T20:21:42.450797] [FATAL] [REMOTE ] MVO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:21:42.450914] [FATAL] [MAIN ] MVO: Failed to fetch primary data. [2025-10-16T20:21:42.451003] [WARN ] [MAIN ] MVO: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:21:42.451100] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-16T20:21:42.451185] [DEBUG] [LOCAL ] MVO: No primary data file found to delete. [2025-10-16T20:21:42.451224] [INFO ] [LOCAL ] MVO: Starting deletion of derivative data. [2025-10-16T20:21:42.451405] [DEBUG] [LOCAL ] MVO: Deleted derivative data file. [2025-10-16T20:21:42.451492] [INFO ] [MAIN ] Update Progress: 1432/2369 symbols completed. MVO took 7.0s. Estimated remaining: 2h 11m 57s. Rate: 7.1 symbols/min [2025-10-16T20:21:42.621488] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:21:42.631855] [DEBUG] [LOCAL ] MVT: Loaded 10021 existing records from primary storage. [2025-10-16T20:21:42.632103] [INFO ] [MAIN ] MVT: Loaded 10021 existing records. [2025-10-16T20:21:42.809085] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:21:42.809488] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-16T20:21:42.809554] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-16T20:21:42.809882] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-10-16T20:21:42.809941] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-16T20:21:43.143625] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-16T20:21:43.193937] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:21:43.196068] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T20:21:43.942778] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-16T20:21:43.974490] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T20:21:43.980944] [INFO ] [REMOTE ] MUR: Full fetch complete (76444 records). [2025-10-16T20:21:43.981088] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-16T20:21:43.981923] [FATAL] [VALIDATOR ] MUR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:21:43.982015] [FATAL] [MAIN ] MUR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:21:43.982060] [WARN ] [MAIN ] MUR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:21:43.982108] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-16T20:21:43.982179] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-16T20:21:43.982229] [INFO ] [LOCAL ] MUR: Starting deletion of derivative data. [2025-10-16T20:21:43.982287] [DEBUG] [LOCAL ] MUR: No derivative data file found to delete. [2025-10-16T20:21:43.982363] [INFO ] [MAIN ] Update Progress: 1433/2369 symbols completed. MUR took 44.3s. Estimated remaining: 2h 11m 44s. Rate: 7.1 symbols/min [2025-10-16T20:21:44.156491] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:21:44.156636] [DEBUG] [LOCAL ] MWA: No existing data file found in primary storage. [2025-10-16T20:21:44.156713] [WARN ] [MAIN ] MWA: No existing data found, performing full refresh instead. [2025-10-16T20:21:44.156833] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-16T20:21:44.156930] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-16T20:21:44.156996] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-16T20:21:44.157053] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-16T20:21:44.512443] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:21:44.742813] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-10-16T20:21:45.542792] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-16T20:21:45.592876] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T20:21:45.747497] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-16T20:21:46.342835] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-16T20:21:46.430099] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T20:21:47.142808] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-16T20:21:47.948481] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-10-16T20:21:47.972168] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T20:21:48.043770] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T20:21:48.742836] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-16T20:21:49.546132] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-16T20:21:49.582875] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T20:21:49.594700] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T20:21:50.342807] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-16T20:21:50.566950] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T20:21:51.142856] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-16T20:21:51.942790] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-16T20:21:52.118616] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T20:21:52.164628] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T20:21:52.742859] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-16T20:21:53.542808] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-16T20:21:53.873563] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-16T20:21:54.342820] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-16T20:21:54.513044] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T20:21:54.649073] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-16T20:21:55.142823] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-16T20:21:55.281881] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-16T20:21:55.849046] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T20:21:55.942795] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-16T20:21:56.742834] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-16T20:21:57.542882] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-16T20:21:57.681418] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T20:21:57.864962] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-16T20:21:58.342901] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-16T20:21:58.587254] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T20:21:59.142799] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-16T20:21:59.219601] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T20:21:59.542437] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-16T20:21:59.548732] [INFO ] [REMOTE ] MUX: Full fetch complete (60537 records). [2025-10-16T20:21:59.548841] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-16T20:21:59.549438] [FATAL] [VALIDATOR ] MUX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:21:59.549524] [FATAL] [MAIN ] MUX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:21:59.549571] [WARN ] [MAIN ] MUX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:21:59.549684] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-16T20:21:59.549773] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-16T20:21:59.549822] [INFO ] [LOCAL ] MUX: Starting deletion of derivative data. [2025-10-16T20:21:59.549884] [DEBUG] [LOCAL ] MUX: No derivative data file found to delete. [2025-10-16T20:21:59.549957] [INFO ] [MAIN ] Update Progress: 1434/2369 symbols completed. MUX took 32.4s. Estimated remaining: 2h 11m 40s. Rate: 7.1 symbols/min [2025-10-16T20:21:59.720675] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:21:59.744756] [DEBUG] [LOCAL ] MX: Loaded 22327 existing records from primary storage. [2025-10-16T20:21:59.745080] [INFO ] [MAIN ] MX: Loaded 22327 existing records. [2025-10-16T20:21:59.920985] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:21:59.921181] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-16T20:21:59.921248] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-16T20:21:59.921748] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-10-16T20:21:59.921808] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-16T20:21:59.950583] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-16T20:22:00.286769] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:22:00.742820] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-16T20:22:01.542819] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-16T20:22:01.689755] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T20:22:02.008864] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-16T20:22:02.342814] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-16T20:22:02.541934] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T20:22:03.142796] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-16T20:22:03.271077] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T20:22:03.942824] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-16T20:22:04.742790] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-10-16T20:22:04.802110] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T20:22:05.102185] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T20:22:05.542811] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-16T20:22:06.025427] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T20:22:06.342803] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-16T20:22:07.142788] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-16T20:22:07.398856] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-16T20:22:07.448984] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T20:22:07.942810] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-16T20:22:07.981856] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T20:22:08.742902] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-16T20:22:09.189172] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T20:22:09.542834] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-16T20:22:10.342808] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-16T20:22:10.441909] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T20:22:10.660490] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T20:22:11.142779] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-16T20:22:11.530087] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T20:22:11.712790] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T20:22:11.714364] [INFO ] [REMOTE ] MVT: Full fetch complete (13978 records). [2025-10-16T20:22:11.714468] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-16T20:22:11.950911] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-16T20:22:12.074365] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-16T20:22:12.074629] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-16T20:22:12.074979] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-16T20:22:12.075026] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-16T20:22:12.075714] [DEBUG] [LOCAL ] MVT: Trimmed 13978 records to 10069 (keeping 200 days of data) [2025-10-16T20:22:12.137260] [DEBUG] [LOCAL ] MVT: Primary data saved (10069 records). [2025-10-16T20:22:12.137383] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-16T20:22:12.137460] [INFO ] [MAIN ] Update Progress: 1435/2369 symbols completed. MVT took 29.7s. Estimated remaining: 2h 11m 34s. Rate: 7.1 symbols/min [2025-10-16T20:22:12.328527] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:22:12.328721] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-16T20:22:12.328769] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-16T20:22:12.328876] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-16T20:22:12.328917] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-16T20:22:12.328958] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-16T20:22:12.328990] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-16T20:22:12.689443] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:22:12.742817] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-10-16T20:22:13.279722] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-16T20:22:13.542846] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-16T20:22:13.761775] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T20:22:14.148733] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T20:22:14.342823] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-16T20:22:14.975857] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-16T20:22:15.142878] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-16T20:22:15.942834] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-16T20:22:16.433235] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T20:22:16.742825] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-16T20:22:17.542816] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-16T20:22:17.734851] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T20:22:17.736974] [INFO ] [REMOTE ] MVF: Full fetch complete (18449 records). [2025-10-16T20:22:17.737071] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-16T20:22:18.038829] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-16T20:22:18.163175] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-10-16T20:22:18.163265] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-10-16T20:22:18.163743] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-10-16T20:22:18.163806] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-10-16T20:22:18.164488] [DEBUG] [LOCAL ] MVF: Trimmed 18449 records to 12832 (keeping 200 days of data) [2025-10-16T20:22:18.239514] [DEBUG] [LOCAL ] MVF: Primary data saved (12832 records). [2025-10-16T20:22:18.239689] [INFO ] [MAIN ] MVF: Full history saved. [2025-10-16T20:22:18.239794] [INFO ] [MAIN ] Update Progress: 1436/2369 symbols completed. MVF took 44.1s. Estimated remaining: 2h 11m 24s. Rate: 7.1 symbols/min [2025-10-16T20:22:18.348018] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-16T20:22:18.412852] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:22:18.419905] [DEBUG] [LOCAL ] MXF: Loaded 5589 existing records from primary storage. [2025-10-16T20:22:18.420113] [INFO ] [MAIN ] MXF: Loaded 5589 existing records. [2025-10-16T20:22:18.594880] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:22:18.595090] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-16T20:22:18.595137] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-16T20:22:18.595390] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-10-16T20:22:18.595461] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-16T20:22:18.963073] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:22:18.977083] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T20:22:19.142806] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-16T20:22:19.727751] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T20:22:19.942858] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-10-16T20:22:20.281861] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-16T20:22:20.742830] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-16T20:22:20.832786] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-16T20:22:21.301554] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-16T20:22:21.542873] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-16T20:22:22.342851] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-16T20:22:22.457114] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T20:22:23.099848] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T20:22:23.105536] [INFO ] [REMOTE ] MWA: Full fetch complete (67627 records). [2025-10-16T20:22:23.105758] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-16T20:22:23.106426] [FATAL] [VALIDATOR ] MWA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:22:23.106528] [FATAL] [MAIN ] MWA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:22:23.106604] [WARN ] [MAIN ] MWA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:22:23.106715] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-16T20:22:23.106789] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-16T20:22:23.106826] [INFO ] [LOCAL ] MWA: Starting deletion of derivative data. [2025-10-16T20:22:23.106866] [DEBUG] [LOCAL ] MWA: No derivative data file found to delete. [2025-10-16T20:22:23.106922] [INFO ] [MAIN ] Update Progress: 1437/2369 symbols completed. MWA took 39.1s. Estimated remaining: 2h 11m 13s. Rate: 7.1 symbols/min [2025-10-16T20:22:23.142791] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-16T20:22:23.777413] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-16T20:22:23.942844] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-16T20:22:24.477837] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-16T20:22:24.742851] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-16T20:22:25.208112] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-16T20:22:25.542810] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-16T20:22:26.147317] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T20:22:26.342806] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-16T20:22:27.142872] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-16T20:22:27.942850] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-16T20:22:28.014490] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-16T20:22:28.195844] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-16T20:22:28.479960] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-16T20:22:28.742881] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-16T20:22:29.542834] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-16T20:22:29.617686] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-16T20:22:30.066918] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-16T20:22:30.342806] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-16T20:22:31.142849] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-16T20:22:31.450087] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T20:22:31.942833] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-16T20:22:31.998919] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T20:22:32.296010] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-16T20:22:32.296866] [INFO ] [REMOTE ] MXE: Full fetch complete (2594 records). [2025-10-16T20:22:32.296935] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-16T20:22:32.489293] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-16T20:22:32.489529] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:22:32.489599] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:22:32.489693] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-16T20:22:32.489763] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-16T20:22:32.489801] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-16T20:22:32.489840] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-16T20:22:32.489896] [INFO ] [MAIN ] Update Progress: 1438/2369 symbols completed. MXE took 20.4s. Estimated remaining: 2h 11m 5s. Rate: 7.1 symbols/min [2025-10-16T20:22:32.742825] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-16T20:22:33.542875] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-16T20:22:33.890045] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T20:22:34.342788] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-16T20:22:34.485395] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-16T20:22:35.142879] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-16T20:22:35.631795] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T20:22:35.942903] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-16T20:22:35.988237] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T20:22:36.742829] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-16T20:22:37.357789] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-16T20:22:37.542816] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-16T20:22:38.296226] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T20:22:38.342872] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-16T20:22:38.956837] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-16T20:22:38.958687] [INFO ] [REMOTE ] MXF: Full fetch complete (9928 records). [2025-10-16T20:22:38.958790] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-16T20:22:39.342614] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-10-16T20:22:39.342723] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-10-16T20:22:39.343000] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-10-16T20:22:39.343041] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-10-16T20:22:39.343491] [DEBUG] [LOCAL ] MXF: Trimmed 9928 records to 5645 (keeping 200 days of data) [2025-10-16T20:22:39.382857] [DEBUG] [LOCAL ] MXF: Primary data saved (5645 records). [2025-10-16T20:22:39.383235] [INFO ] [MAIN ] MXF: Full history saved. [2025-10-16T20:22:39.383330] [INFO ] [MAIN ] Update Progress: 1439/2369 symbols completed. MXF took 21.1s. Estimated remaining: 2h 10m 56s. Rate: 7.1 symbols/min [2025-10-16T20:22:40.650780] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (4.71 seconds). [2025-10-16T20:22:40.656049] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-16T20:22:41.841604] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T20:22:41.846313] [INFO ] [REMOTE ] MX: Full fetch complete (31412 records). [2025-10-16T20:22:41.846516] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-16T20:22:42.371844] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-10-16T20:22:42.371965] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-10-16T20:22:42.372775] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-10-16T20:22:42.372839] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-10-16T20:22:42.373997] [DEBUG] [LOCAL ] MX: Trimmed 31412 records to 22465 (keeping 200 days of data) [2025-10-16T20:22:42.507318] [DEBUG] [LOCAL ] MX: Primary data saved (22465 records). [2025-10-16T20:22:42.507457] [INFO ] [MAIN ] MX: Full history saved. [2025-10-16T20:22:42.507542] [INFO ] [MAIN ] Update Progress: 1440/2369 symbols completed. MX took 43.0s. Estimated remaining: 2h 10m 44s. Rate: 7.1 symbols/min [2025-10-16T20:22:43.225804] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:22:43.236991] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:22:43.264286] [DEBUG] [LOCAL ] MYD: No existing data file found in primary storage. [2025-10-16T20:22:43.318674] [WARN ] [MAIN ] MYD: No existing data found, performing full refresh instead. [2025-10-16T20:22:43.318563] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:22:43.343880] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:22:43.346794] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-16T20:22:43.347100] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-16T20:22:43.346948] [DEBUG] [LOCAL ] MYI: No existing data file found in primary storage. [2025-10-16T20:22:43.347283] [DEBUG] [LOCAL ] MYE: No existing data file found in primary storage. [2025-10-16T20:22:43.347477] [WARN ] [MAIN ] MYI: No existing data found, performing full refresh instead. [2025-10-16T20:22:43.347683] [DEBUG] [LOCAL ] MYD: No primary data file found to delete. [2025-10-16T20:22:43.347590] [WARN ] [MAIN ] MYE: No existing data found, performing full refresh instead. [2025-10-16T20:22:43.352014] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-16T20:22:43.352294] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-16T20:22:43.352195] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-16T20:22:43.352764] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-16T20:22:43.370126] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-16T20:22:43.370255] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-10-16T20:22:43.352594] [DEBUG] [LOCAL ] MYN: Loaded 9786 existing records from primary storage. [2025-10-16T20:22:43.377264] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-16T20:22:43.370451] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-16T20:22:43.412462] [INFO ] [MAIN ] MYN: Loaded 9786 existing records. [2025-10-16T20:22:43.417689] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-16T20:22:44.461599] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:22:44.567534] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-16T20:22:44.589714] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-16T20:22:44.677062] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:22:44.682403] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:22:44.692240] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-10-16T20:22:44.686984] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-10-16T20:22:44.692475] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-10-16T20:22:44.707995] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-16T20:22:44.769785] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:22:44.813816] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-10-16T20:22:45.132939] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:22:45.133262] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-10-16T20:22:46.008444] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T20:22:46.013039] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-16T20:22:46.046988] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-16T20:22:46.050490] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-16T20:22:46.141906] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T20:22:46.148045] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-16T20:22:46.225425] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T20:22:46.232077] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-16T20:22:46.651045] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-16T20:22:46.654005] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-16T20:22:46.780380] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-16T20:22:47.142812] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-16T20:22:47.358392] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T20:22:47.424517] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T20:22:47.474249] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T20:22:47.856951] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-16T20:22:47.942826] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-16T20:22:48.742778] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-16T20:22:49.132077] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T20:22:49.542804] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-16T20:22:49.926134] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T20:22:50.342811] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-16T20:22:50.699403] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-16T20:22:51.142826] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-16T20:22:51.745132] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T20:22:51.942853] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-16T20:22:52.742878] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-16T20:22:53.542896] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-16T20:23:05.111976] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (13.97 seconds). [2025-10-16T20:23:05.115046] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-16T20:23:05.553389] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (13.61 seconds). [2025-10-16T20:23:05.561053] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-16T20:23:05.725822] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (12.18 seconds). [2025-10-16T20:23:05.731349] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-16T20:23:06.207487] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T20:23:06.210249] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-16T20:23:06.746240] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T20:23:06.749889] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-16T20:23:06.973199] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (14.23 seconds). [2025-10-16T20:23:06.978492] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-16T20:23:07.570700] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-16T20:23:07.573185] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-16T20:23:07.851561] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T20:23:07.855255] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-16T20:23:08.237078] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-16T20:23:08.240337] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-16T20:23:08.350002] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-10-16T20:23:08.355854] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-16T20:23:08.543784] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T20:23:08.549374] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-16T20:23:09.036481] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-16T20:23:09.040173] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-16T20:23:09.112163] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-16T20:23:09.115091] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-16T20:23:09.545476] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T20:23:09.549529] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-16T20:23:09.790262] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T20:23:09.796027] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-16T20:23:09.914728] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-16T20:23:09.918113] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-16T20:23:10.049377] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T20:23:10.053904] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-16T20:23:10.630415] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-16T20:23:10.633278] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-16T20:23:10.660053] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T20:23:10.664397] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-16T20:23:10.838373] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-16T20:23:10.841609] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-16T20:23:11.172964] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T20:23:11.178108] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-16T20:23:11.432157] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T20:23:11.436401] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T20:23:11.443246] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-16T20:23:11.444180] [INFO ] [REMOTE ] MYN: Full fetch complete (14997 records). [2025-10-16T20:23:11.444276] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-16T20:23:11.683299] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T20:23:11.734597] [INFO ] [REMOTE ] MYD: Full fetch complete (20130 records). [2025-10-16T20:23:11.746286] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-16T20:23:11.747035] [FATAL] [VALIDATOR ] MYD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:23:11.762706] [FATAL] [MAIN ] MYD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:23:11.787286] [WARN ] [MAIN ] MYD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:23:11.797402] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-16T20:23:11.806535] [DEBUG] [LOCAL ] MYD: No primary data file found to delete. [2025-10-16T20:23:11.821756] [INFO ] [LOCAL ] MYD: Starting deletion of derivative data. [2025-10-16T20:23:11.830433] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-16T20:23:11.830548] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-16T20:23:11.830521] [DEBUG] [LOCAL ] MYD: No derivative data file found to delete. [2025-10-16T20:23:11.830982] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-16T20:23:11.831057] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-16T20:23:11.831165] [INFO ] [MAIN ] Update Progress: 1441/2369 symbols completed. MYD took 29.3s. Estimated remaining: 2h 10m 49s. Rate: 7.1 symbols/min [2025-10-16T20:23:11.907114] [DEBUG] [LOCAL ] MYN: Trimmed 14997 records to 9866 (keeping 200 days of data) [2025-10-16T20:23:12.057287] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:23:12.059776] [DEBUG] [LOCAL ] NABL: No existing data file found in primary storage. [2025-10-16T20:23:12.064775] [WARN ] [MAIN ] NABL: No existing data found, performing full refresh instead. [2025-10-16T20:23:12.067138] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-16T20:23:12.068927] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-16T20:23:12.070002] [DEBUG] [LOCAL ] MYN: Primary data saved (9866 records). [2025-10-16T20:23:12.070127] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-16T20:23:12.070235] [INFO ] [MAIN ] Update Progress: 1442/2369 symbols completed. MYN took 29.6s. Estimated remaining: 2h 10m 35s. Rate: 7.1 symbols/min [2025-10-16T20:23:12.070086] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-16T20:23:12.082004] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-16T20:23:12.426468] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:23:12.489063] [DEBUG] [LOCAL ] NAC: No existing data file found in primary storage. [2025-10-16T20:23:12.518998] [WARN ] [MAIN ] NAC: No existing data found, performing full refresh instead. [2025-10-16T20:23:12.535746] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-16T20:23:12.552340] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-16T20:23:12.578805] [DEBUG] [LOCAL ] NAC: No primary data file found to delete. [2025-10-16T20:23:12.601300] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T20:23:12.590816] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-16T20:23:12.644260] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-16T20:23:12.670679] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:23:12.671346] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T20:23:12.747882] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-10-16T20:23:13.010779] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:23:13.542718] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-16T20:23:13.942271] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T20:23:14.267581] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T20:23:14.342804] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-16T20:23:14.676022] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T20:23:15.142834] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-10-16T20:23:15.626755] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T20:23:15.943025] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-16T20:23:16.626688] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T20:23:16.643703] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T20:23:16.646068] [INFO ] [REMOTE ] MYI: Full fetch complete (28269 records). [2025-10-16T20:23:16.646157] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-16T20:23:16.646635] [FATAL] [VALIDATOR ] MYI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:23:16.646744] [FATAL] [MAIN ] MYI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:23:16.646819] [WARN ] [MAIN ] MYI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:23:16.646911] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-16T20:23:16.647003] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-10-16T20:23:16.647053] [INFO ] [LOCAL ] MYI: Starting deletion of derivative data. [2025-10-16T20:23:16.647099] [DEBUG] [LOCAL ] MYI: No derivative data file found to delete. [2025-10-16T20:23:16.647157] [INFO ] [MAIN ] Update Progress: 1443/2369 symbols completed. MYI took 34.1s. Estimated remaining: 2h 10m 24s. Rate: 7.1 symbols/min [2025-10-16T20:23:16.747927] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-16T20:23:16.846881] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:23:16.847065] [DEBUG] [LOCAL ] NAD: No existing data file found in primary storage. [2025-10-16T20:23:16.847127] [WARN ] [MAIN ] NAD: No existing data found, performing full refresh instead. [2025-10-16T20:23:16.847258] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-16T20:23:16.847334] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-16T20:23:16.847430] [DEBUG] [LOCAL ] NAD: No primary data file found to delete. [2025-10-16T20:23:16.847506] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-16T20:23:17.208514] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:23:17.463371] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T20:23:17.466577] [INFO ] [REMOTE ] MYE: Full fetch complete (35984 records). [2025-10-16T20:23:17.466717] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-16T20:23:17.467257] [FATAL] [VALIDATOR ] MYE: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:23:17.467341] [FATAL] [MAIN ] MYE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:23:17.467384] [WARN ] [MAIN ] MYE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:23:17.467423] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-16T20:23:17.467478] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-16T20:23:17.467513] [INFO ] [LOCAL ] MYE: Starting deletion of derivative data. [2025-10-16T20:23:17.467551] [DEBUG] [LOCAL ] MYE: No derivative data file found to delete. [2025-10-16T20:23:17.467604] [INFO ] [MAIN ] Update Progress: 1444/2369 symbols completed. MYE took 35.0s. Estimated remaining: 2h 10m 11s. Rate: 7.1 symbols/min [2025-10-16T20:23:17.547941] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-10-16T20:23:17.643342] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:23:17.643525] [DEBUG] [LOCAL ] NAN: No existing data file found in primary storage. [2025-10-16T20:23:17.643562] [WARN ] [MAIN ] NAN: No existing data found, performing full refresh instead. [2025-10-16T20:23:17.643706] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-16T20:23:17.643757] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-16T20:23:17.643798] [DEBUG] [LOCAL ] NAN: No primary data file found to delete. [2025-10-16T20:23:17.643830] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-16T20:23:18.000452] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:23:18.342880] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-10-16T20:23:19.142836] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-16T20:23:19.194226] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T20:23:19.206406] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-16T20:23:19.942781] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-16T20:23:20.338162] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T20:23:20.742901] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-16T20:23:21.298121] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-16T20:23:21.542850] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-16T20:23:21.767435] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T20:23:22.342816] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-16T20:23:23.067560] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T20:23:23.142829] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-16T20:23:23.600952] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T20:23:23.942851] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-16T20:23:24.293960] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T20:23:24.742822] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-16T20:23:25.364270] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T20:23:25.542852] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-16T20:23:25.762429] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T20:23:26.342866] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-16T20:23:27.142843] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-16T20:23:27.173163] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T20:23:27.653416] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T20:23:27.942827] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-16T20:23:28.034330] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-16T20:23:28.742803] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-16T20:23:29.035928] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T20:23:29.542829] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-16T20:23:30.241748] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T20:23:30.342799] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-16T20:23:30.854330] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-16T20:23:31.142820] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-16T20:23:31.347767] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T20:23:31.942812] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-16T20:23:32.742822] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-16T20:23:32.907816] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-16T20:23:33.424771] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T20:23:33.542814] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-16T20:23:33.758280] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T20:23:34.342912] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-16T20:23:34.846352] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-16T20:23:35.142823] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-16T20:23:35.235178] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T20:23:35.942793] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-16T20:23:36.283329] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T20:23:36.742795] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-16T20:23:36.814617] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T20:23:37.542787] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-16T20:23:37.696763] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T20:23:38.342800] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-16T20:23:38.720493] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T20:23:39.142808] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-16T20:23:39.949626] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-16T20:23:39.955592] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T20:23:40.620950] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T20:23:40.742797] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-16T20:23:41.437978] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T20:23:41.525431] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T20:23:41.529893] [INFO ] [REMOTE ] NAD: Full fetch complete (48762 records). [2025-10-16T20:23:41.530022] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-16T20:23:41.530811] [FATAL] [VALIDATOR ] NAD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:23:41.530898] [FATAL] [MAIN ] NAD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:23:41.530940] [WARN ] [MAIN ] NAD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:23:41.531009] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-16T20:23:41.531094] [DEBUG] [LOCAL ] NAD: No primary data file found to delete. [2025-10-16T20:23:41.531171] [INFO ] [LOCAL ] NAD: Starting deletion of derivative data. [2025-10-16T20:23:41.531239] [DEBUG] [LOCAL ] NAD: No derivative data file found to delete. [2025-10-16T20:23:41.531298] [INFO ] [MAIN ] Update Progress: 1445/2369 symbols completed. NAD took 24.9s. Estimated remaining: 2h 10m 13s. Rate: 7.1 symbols/min [2025-10-16T20:23:41.552897] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-16T20:23:41.703981] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:23:41.749167] [DEBUG] [LOCAL ] NAT: Loaded 49224 existing records from primary storage. [2025-10-16T20:23:41.749496] [INFO ] [MAIN ] NAT: Loaded 49224 existing records. [2025-10-16T20:23:41.929694] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:23:41.929935] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-16T20:23:41.930000] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-16T20:23:41.930239] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-10-16T20:23:41.930311] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-16T20:23:42.288258] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:23:42.342791] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-16T20:23:42.460247] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T20:23:42.463517] [INFO ] [REMOTE ] NAC: Full fetch complete (35322 records). [2025-10-16T20:23:42.463623] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-16T20:23:42.464287] [FATAL] [VALIDATOR ] NAC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:23:42.464378] [FATAL] [MAIN ] NAC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:23:42.464421] [WARN ] [MAIN ] NAC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:23:42.464462] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-16T20:23:42.464525] [DEBUG] [LOCAL ] NAC: No primary data file found to delete. [2025-10-16T20:23:42.464560] [INFO ] [LOCAL ] NAC: Starting deletion of derivative data. [2025-10-16T20:23:42.464599] [DEBUG] [LOCAL ] NAC: No derivative data file found to delete. [2025-10-16T20:23:42.464718] [INFO ] [MAIN ] Update Progress: 1446/2369 symbols completed. NAC took 30.4s. Estimated remaining: 2h 9m 59s. Rate: 7.1 symbols/min [2025-10-16T20:23:42.653833] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:23:42.654000] [DEBUG] [LOCAL ] NATL: No existing data file found in primary storage. [2025-10-16T20:23:42.654039] [WARN ] [MAIN ] NATL: No existing data found, performing full refresh instead. [2025-10-16T20:23:42.654152] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-16T20:23:42.654192] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-16T20:23:42.654233] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-16T20:23:42.654266] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-16T20:23:43.022959] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:23:43.111729] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-16T20:23:43.142821] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-16T20:23:43.942847] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-10-16T20:23:44.084522] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T20:23:44.742827] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-10-16T20:23:45.139980] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T20:23:45.542873] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-16T20:23:46.342784] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-16T20:23:46.747879] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T20:23:46.784014] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-16T20:23:46.994358] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-16T20:23:47.142811] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-16T20:23:47.942819] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-16T20:23:48.260988] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T20:23:48.742824] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-16T20:23:49.346109] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T20:23:49.542843] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-16T20:23:50.306439] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T20:23:50.342781] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-16T20:23:50.376448] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T20:23:51.142813] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-16T20:23:51.714719] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T20:23:51.716065] [INFO ] [REMOTE ] NAN: Full fetch complete (13420 records). [2025-10-16T20:23:51.716185] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-16T20:23:51.716670] [FATAL] [VALIDATOR ] NAN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:23:51.716746] [FATAL] [MAIN ] NAN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:23:51.716813] [WARN ] [MAIN ] NAN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:23:51.716882] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-16T20:23:51.716945] [DEBUG] [LOCAL ] NAN: No primary data file found to delete. [2025-10-16T20:23:51.716980] [INFO ] [LOCAL ] NAN: Starting deletion of derivative data. [2025-10-16T20:23:51.717060] [DEBUG] [LOCAL ] NAN: No derivative data file found to delete. [2025-10-16T20:23:51.717130] [INFO ] [MAIN ] Update Progress: 1447/2369 symbols completed. NAN took 34.2s. Estimated remaining: 2h 9m 51s. Rate: 7.1 symbols/min [2025-10-16T20:23:51.893038] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:23:51.898712] [DEBUG] [LOCAL ] NAZ: Loaded 2663 existing records from primary storage. [2025-10-16T20:23:51.898919] [INFO ] [MAIN ] NAZ: Loaded 2663 existing records. [2025-10-16T20:23:51.954353] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-16T20:23:52.093261] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:23:52.093565] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-16T20:23:52.093742] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-16T20:23:52.093946] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-10-16T20:23:52.093994] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-16T20:23:52.275085] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-16T20:23:52.493067] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:23:52.742852] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-10-16T20:23:53.331287] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-16T20:23:53.462961] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T20:23:53.542827] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-16T20:23:54.342816] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-16T20:23:55.100486] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T20:23:55.142806] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-16T20:23:55.942789] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-16T20:23:56.120518] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T20:23:56.533761] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-16T20:23:56.742825] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-16T20:23:56.985681] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T20:23:57.542863] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-16T20:23:57.647356] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-16T20:23:58.342818] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-16T20:23:58.901858] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T20:23:58.947834] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T20:23:59.142795] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-16T20:23:59.942816] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-16T20:24:00.589326] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T20:24:00.742822] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-16T20:24:01.542831] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-16T20:24:01.650542] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T20:24:01.655524] [INFO ] [REMOTE ] NABL: Full fetch complete (56726 records). [2025-10-16T20:24:01.655753] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-16T20:24:01.656534] [FATAL] [VALIDATOR ] NABL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:24:01.656689] [FATAL] [MAIN ] NABL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:24:01.656744] [WARN ] [MAIN ] NABL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:24:01.656788] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-16T20:24:01.656847] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-16T20:24:01.656882] [INFO ] [LOCAL ] NABL: Starting deletion of derivative data. [2025-10-16T20:24:01.656920] [DEBUG] [LOCAL ] NABL: No derivative data file found to delete. [2025-10-16T20:24:01.656994] [INFO ] [MAIN ] Update Progress: 1448/2369 symbols completed. NABL took 49.8s. Estimated remaining: 2h 9m 44s. Rate: 7.1 symbols/min [2025-10-16T20:24:01.858456] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:24:01.869902] [DEBUG] [LOCAL ] NBB: Loaded 9062 existing records from primary storage. [2025-10-16T20:24:01.870121] [INFO ] [MAIN ] NBB: Loaded 9062 existing records. [2025-10-16T20:24:02.101617] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:24:02.104468] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-16T20:24:02.104525] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-16T20:24:02.106248] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-10-16T20:24:02.106204] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-16T20:24:02.116214] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-16T20:24:02.354093] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-16T20:24:02.468960] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:24:02.810966] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-16T20:24:03.142816] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-16T20:24:03.942850] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-16T20:24:04.369042] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-16T20:24:04.628056] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-16T20:24:04.670447] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T20:24:04.742824] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-16T20:24:05.542862] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-10-16T20:24:06.247757] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T20:24:06.342882] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-16T20:24:06.580071] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T20:24:07.142866] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-16T20:24:07.784428] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-16T20:24:07.942807] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-16T20:24:08.237626] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-16T20:24:08.742845] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-16T20:24:08.982098] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-16T20:24:09.542814] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-16T20:24:10.235293] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T20:24:10.239387] [INFO ] [REMOTE ] NATL: Full fetch complete (45152 records). [2025-10-16T20:24:10.239549] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-16T20:24:10.240231] [FATAL] [VALIDATOR ] NATL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:24:10.240317] [FATAL] [MAIN ] NATL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:24:10.240359] [WARN ] [MAIN ] NATL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:24:10.240398] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-16T20:24:10.240455] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-16T20:24:10.240489] [INFO ] [LOCAL ] NATL: Starting deletion of derivative data. [2025-10-16T20:24:10.240528] [DEBUG] [LOCAL ] NATL: No derivative data file found to delete. [2025-10-16T20:24:10.240580] [INFO ] [MAIN ] Update Progress: 1449/2369 symbols completed. NATL took 27.8s. Estimated remaining: 2h 9m 36s. Rate: 7.1 symbols/min [2025-10-16T20:24:10.345041] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-16T20:24:10.416850] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:24:10.417112] [DEBUG] [LOCAL ] NBHC: No existing data file found in primary storage. [2025-10-16T20:24:10.417244] [WARN ] [MAIN ] NBHC: No existing data found, performing full refresh instead. [2025-10-16T20:24:10.417419] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-16T20:24:10.417464] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-16T20:24:10.417506] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-16T20:24:10.417539] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-16T20:24:10.799286] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T20:24:10.811792] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:24:11.062729] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T20:24:11.142797] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-16T20:24:11.942899] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-16T20:24:12.510263] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T20:24:12.742824] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-16T20:24:12.938465] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T20:24:13.542827] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-10-16T20:24:13.569233] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T20:24:14.342809] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-16T20:24:14.696857] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T20:24:15.142782] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-16T20:24:15.293619] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T20:24:15.942825] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-16T20:24:16.742822] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-16T20:24:17.047325] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-16T20:24:17.084543] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T20:24:17.155497] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T20:24:17.542875] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-16T20:24:18.342785] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-16T20:24:18.689979] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T20:24:18.985766] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-16T20:24:19.142856] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-16T20:24:19.942798] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-16T20:24:19.984490] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T20:24:20.742822] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-16T20:24:21.119971] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T20:24:21.210307] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T20:24:21.542862] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-16T20:24:22.147490] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-16T20:24:22.342843] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-16T20:24:23.067483] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T20:24:23.142818] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-16T20:24:23.942791] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-16T20:24:23.990550] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T20:24:24.742814] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-16T20:24:25.542816] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-16T20:24:25.654505] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T20:24:25.784429] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T20:24:25.791178] [INFO ] [REMOTE ] NAT: Full fetch complete (72238 records). [2025-10-16T20:24:25.791328] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-16T20:24:26.065910] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-16T20:24:26.088808] [INFO ] [REMOTE ] NAZ: Full fetch complete (4186 records). [2025-10-16T20:24:26.099590] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-16T20:24:26.324803] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-10-16T20:24:26.325286] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-10-16T20:24:26.332105] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-10-16T20:24:26.337314] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-10-16T20:24:26.347931] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-16T20:24:26.473113] [DEBUG] [LOCAL ] NAT: Trimmed 72238 records to 49601 (keeping 200 days of data) [2025-10-16T20:24:26.700352] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-16T20:24:26.706266] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-16T20:24:26.707252] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-16T20:24:26.709859] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-16T20:24:26.712556] [DEBUG] [LOCAL ] NAZ: Trimmed 4186 records to 2683 (keeping 200 days of data) [2025-10-16T20:24:26.744291] [DEBUG] [LOCAL ] NAZ: Primary data saved (2683 records). [2025-10-16T20:24:26.747189] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-16T20:24:26.747297] [INFO ] [MAIN ] Update Progress: 1450/2369 symbols completed. NAZ took 35.0s. Estimated remaining: 2h 9m 32s. Rate: 7.1 symbols/min [2025-10-16T20:24:27.039737] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:24:27.042710] [DEBUG] [LOCAL ] NBR: No existing data file found in primary storage. [2025-10-16T20:24:27.048080] [WARN ] [MAIN ] NBR: No existing data found, performing full refresh instead. [2025-10-16T20:24:27.053724] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-16T20:24:27.054935] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-16T20:24:27.058330] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-16T20:24:27.061906] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-16T20:24:27.146280] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-16T20:24:27.255548] [DEBUG] [LOCAL ] NAT: Primary data saved (49601 records). [2025-10-16T20:24:27.279797] [INFO ] [MAIN ] NAT: Full history saved. [2025-10-16T20:24:27.280529] [INFO ] [MAIN ] Update Progress: 1451/2369 symbols completed. NAT took 45.7s. Estimated remaining: 2h 9m 19s. Rate: 7.1 symbols/min [2025-10-16T20:24:27.457763] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T20:24:27.661995] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:24:27.680553] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:24:27.681044] [DEBUG] [LOCAL ] NBXG: No existing data file found in primary storage. [2025-10-16T20:24:27.681091] [WARN ] [MAIN ] NBXG: No existing data found, performing full refresh instead. [2025-10-16T20:24:27.681206] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-16T20:24:27.681247] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-16T20:24:27.681287] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-16T20:24:27.681321] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-16T20:24:27.949792] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-16T20:24:28.031962] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:24:28.414061] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-16T20:24:28.742866] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-10-16T20:24:28.840991] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T20:24:28.842619] [INFO ] [REMOTE ] NBB: Full fetch complete (13518 records). [2025-10-16T20:24:28.842726] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-16T20:24:29.203240] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-16T20:24:29.203313] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-16T20:24:29.203586] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-16T20:24:29.203624] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-16T20:24:29.204103] [DEBUG] [LOCAL ] NBB: Trimmed 13518 records to 9114 (keeping 200 days of data) [2025-10-16T20:24:29.259896] [DEBUG] [LOCAL ] NBB: Primary data saved (9114 records). [2025-10-16T20:24:29.260023] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-16T20:24:29.260099] [INFO ] [MAIN ] Update Progress: 1452/2369 symbols completed. NBB took 27.6s. Estimated remaining: 2h 9m 6s. Rate: 7.1 symbols/min [2025-10-16T20:24:29.436611] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:24:29.441559] [DEBUG] [LOCAL ] NC: Loaded 1963 existing records from primary storage. [2025-10-16T20:24:29.441763] [INFO ] [MAIN ] NC: Loaded 1963 existing records. [2025-10-16T20:24:29.544753] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-16T20:24:29.625697] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:24:29.625895] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-16T20:24:29.625950] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-16T20:24:29.626261] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-10-16T20:24:29.626335] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-16T20:24:29.988085] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:24:30.215019] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T20:24:30.342792] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-16T20:24:30.956728] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T20:24:31.142817] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-10-16T20:24:31.456756] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T20:24:31.942883] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-10-16T20:24:32.576937] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-16T20:24:32.708014] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T20:24:32.742781] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-16T20:24:33.542854] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-16T20:24:34.173916] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T20:24:34.342783] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-16T20:24:34.728379] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T20:24:35.142812] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-16T20:24:35.582084] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-16T20:24:35.942813] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-16T20:24:36.471896] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T20:24:36.742814] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-16T20:24:37.147153] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T20:24:37.542833] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-16T20:24:38.227724] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T20:24:38.342807] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-16T20:24:38.620356] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T20:24:39.142821] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-16T20:24:39.666545] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T20:24:39.942841] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-16T20:24:40.606440] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T20:24:40.742787] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-16T20:24:41.024628] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T20:24:41.542810] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-16T20:24:42.169018] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-16T20:24:42.280468] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T20:24:42.342784] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-16T20:24:43.014396] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T20:24:43.142888] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-16T20:24:43.711691] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-16T20:24:43.942857] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-16T20:24:44.742820] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-16T20:24:45.181520] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T20:24:45.542902] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-16T20:24:46.279789] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T20:24:46.342776] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-16T20:24:46.897292] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T20:24:47.142848] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-16T20:24:47.867396] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T20:24:47.942811] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-16T20:24:47.984381] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T20:24:48.646005] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T20:24:48.649825] [INFO ] [REMOTE ] NBHC: Full fetch complete (32786 records). [2025-10-16T20:24:48.649956] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-16T20:24:48.650695] [FATAL] [VALIDATOR ] NBHC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:24:48.650826] [FATAL] [MAIN ] NBHC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:24:48.650892] [WARN ] [MAIN ] NBHC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:24:48.650977] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-16T20:24:48.651054] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-16T20:24:48.651099] [INFO ] [LOCAL ] NBHC: Starting deletion of derivative data. [2025-10-16T20:24:48.651149] [DEBUG] [LOCAL ] NBHC: No derivative data file found to delete. [2025-10-16T20:24:48.651216] [INFO ] [MAIN ] Update Progress: 1453/2369 symbols completed. NBHC took 38.4s. Estimated remaining: 2h 9m 5s. Rate: 7.1 symbols/min [2025-10-16T20:24:48.747971] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-16T20:24:48.822432] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:24:48.834124] [DEBUG] [LOCAL ] NCA: Loaded 9994 existing records from primary storage. [2025-10-16T20:24:48.834357] [INFO ] [MAIN ] NCA: Loaded 9994 existing records. [2025-10-16T20:24:49.013862] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:24:49.014249] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-16T20:24:49.014297] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-16T20:24:49.014439] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-10-16T20:24:49.014477] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-16T20:24:49.365952] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:24:49.542806] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-10-16T20:24:50.320857] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T20:24:50.342813] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-16T20:24:50.653981] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T20:24:51.142830] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-16T20:24:51.706606] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T20:24:51.885451] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T20:24:51.942767] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-16T20:24:52.742809] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-16T20:24:53.234738] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T20:24:53.333545] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T20:24:53.542810] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-16T20:24:54.106381] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-16T20:24:54.342788] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-16T20:24:55.142853] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-16T20:24:55.903289] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T20:24:55.942770] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-16T20:24:56.267858] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T20:24:56.343382] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-16T20:24:56.347227] [INFO ] [REMOTE ] NBR: Full fetch complete (49066 records). [2025-10-16T20:24:56.347337] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-16T20:24:56.347953] [FATAL] [VALIDATOR ] NBR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:24:56.348036] [FATAL] [MAIN ] NBR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:24:56.348079] [WARN ] [MAIN ] NBR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:24:56.348153] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-16T20:24:56.348215] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-16T20:24:56.348252] [INFO ] [LOCAL ] NBR: Starting deletion of derivative data. [2025-10-16T20:24:56.348327] [DEBUG] [LOCAL ] NBR: No derivative data file found to delete. [2025-10-16T20:24:56.348398] [INFO ] [MAIN ] Update Progress: 1454/2369 symbols completed. NBR took 29.6s. Estimated remaining: 2h 8m 56s. Rate: 7.1 symbols/min [2025-10-16T20:24:56.524577] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:24:56.524755] [DEBUG] [LOCAL ] NCDL: No existing data file found in primary storage. [2025-10-16T20:24:56.524799] [WARN ] [MAIN ] NCDL: No existing data found, performing full refresh instead. [2025-10-16T20:24:56.524914] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-16T20:24:56.524953] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-16T20:24:56.524996] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-16T20:24:56.525027] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-16T20:24:56.747946] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-16T20:24:56.914184] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:24:57.542795] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-16T20:24:57.765673] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T20:24:58.142101] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T20:24:58.342873] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-10-16T20:24:59.142838] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-16T20:24:59.784434] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T20:24:59.942807] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-16T20:25:00.386256] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T20:25:00.742861] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-16T20:25:01.300541] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-16T20:25:01.339625] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T20:25:01.542825] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-16T20:25:02.342858] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-16T20:25:02.859873] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T20:25:02.860580] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-16T20:25:02.868386] [INFO ] [REMOTE ] NBXG: Full fetch complete (32466 records). [2025-10-16T20:25:02.868466] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-10-16T20:25:02.868991] [FATAL] [VALIDATOR ] NBXG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:25:02.869071] [FATAL] [MAIN ] NBXG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:25:02.869113] [WARN ] [MAIN ] NBXG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:25:02.869182] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-16T20:25:02.869243] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-16T20:25:02.869277] [INFO ] [LOCAL ] NBXG: Starting deletion of derivative data. [2025-10-16T20:25:02.869315] [DEBUG] [LOCAL ] NBXG: No derivative data file found to delete. [2025-10-16T20:25:02.869366] [INFO ] [MAIN ] Update Progress: 1455/2369 symbols completed. NBXG took 35.6s. Estimated remaining: 2h 8m 46s. Rate: 7.1 symbols/min [2025-10-16T20:25:03.043764] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:25:03.043962] [DEBUG] [LOCAL ] NCLH: No existing data file found in primary storage. [2025-10-16T20:25:03.044015] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-10-16T20:25:03.044123] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-16T20:25:03.044165] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-16T20:25:03.044206] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-16T20:25:03.044237] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-16T20:25:03.149374] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-16T20:25:03.420070] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:25:03.901385] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T20:25:03.942818] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-16T20:25:04.742790] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-10-16T20:25:04.825031] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T20:25:05.542826] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-16T20:25:06.342880] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-16T20:25:06.416092] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-16T20:25:06.833814] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-16T20:25:07.142818] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-16T20:25:07.665328] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T20:25:07.942813] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-16T20:25:08.587134] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T20:25:08.588146] [INFO ] [REMOTE ] NC: Full fetch complete (2754 records). [2025-10-16T20:25:08.588221] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-16T20:25:08.744158] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-16T20:25:08.955044] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-10-16T20:25:08.955117] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-10-16T20:25:08.955220] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-10-16T20:25:08.955257] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-10-16T20:25:08.955577] [DEBUG] [LOCAL ] NC: Trimmed 2754 records to 1982 (keeping 200 days of data) [2025-10-16T20:25:08.967820] [DEBUG] [LOCAL ] NC: Primary data saved (1982 records). [2025-10-16T20:25:08.967878] [INFO ] [MAIN ] NC: Full history saved. [2025-10-16T20:25:08.967939] [INFO ] [MAIN ] Update Progress: 1456/2369 symbols completed. NC took 39.7s. Estimated remaining: 2h 8m 36s. Rate: 7.1 symbols/min [2025-10-16T20:25:09.137048] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:25:09.153941] [DEBUG] [LOCAL ] NCV: Loaded 13954 existing records from primary storage. [2025-10-16T20:25:09.154189] [INFO ] [MAIN ] NCV: Loaded 13954 existing records. [2025-10-16T20:25:09.337240] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:25:09.337494] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-16T20:25:09.337570] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-16T20:25:09.337918] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-10-16T20:25:09.337987] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-16T20:25:09.505718] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T20:25:09.566540] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-16T20:25:09.675494] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-16T20:25:09.788489] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:25:10.342772] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-16T20:25:10.649085] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T20:25:11.142822] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-16T20:25:11.942830] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-16T20:25:12.337678] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T20:25:12.435499] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-16T20:25:12.742810] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-16T20:25:12.930385] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T20:25:13.542785] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-16T20:25:13.878105] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-16T20:25:14.177562] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-16T20:25:14.342802] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-16T20:25:15.060360] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-16T20:25:15.142791] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-10-16T20:25:15.942841] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-16T20:25:16.393914] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-16T20:25:16.742807] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-16T20:25:17.316187] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T20:25:17.542793] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-16T20:25:17.854822] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T20:25:18.342825] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-16T20:25:18.752573] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-16T20:25:19.142795] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-16T20:25:19.222712] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T20:25:19.942815] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-16T20:25:20.742875] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-16T20:25:21.074154] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T20:25:21.418109] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-16T20:25:21.484435] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T20:25:21.485759] [INFO ] [REMOTE ] NCA: Full fetch complete (14538 records). [2025-10-16T20:25:21.485830] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-16T20:25:21.547951] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-16T20:25:21.902141] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-16T20:25:21.902227] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-16T20:25:21.902613] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-16T20:25:21.902702] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-16T20:25:21.903253] [DEBUG] [LOCAL ] NCA: Trimmed 14538 records to 10015 (keeping 200 days of data) [2025-10-16T20:25:21.965216] [DEBUG] [LOCAL ] NCA: Primary data saved (10015 records). [2025-10-16T20:25:21.965377] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-16T20:25:21.965466] [INFO ] [MAIN ] Update Progress: 1457/2369 symbols completed. NCA took 33.3s. Estimated remaining: 2h 8m 31s. Rate: 7.1 symbols/min [2025-10-16T20:25:22.138556] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:25:22.152016] [DEBUG] [LOCAL ] NCZ: Loaded 12383 existing records from primary storage. [2025-10-16T20:25:22.152227] [INFO ] [MAIN ] NCZ: Loaded 12383 existing records. [2025-10-16T20:25:22.324105] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:25:22.324309] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-16T20:25:22.324357] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-16T20:25:22.324562] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-10-16T20:25:22.324618] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-16T20:25:22.354158] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-16T20:25:22.665230] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:25:23.142815] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-10-16T20:25:23.562600] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T20:25:23.890003] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T20:25:23.942779] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-16T20:25:23.986590] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-16T20:25:24.673586] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T20:25:24.677250] [INFO ] [REMOTE ] NCDL: Full fetch complete (32917 records). [2025-10-16T20:25:24.677357] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-16T20:25:24.677970] [FATAL] [VALIDATOR ] NCDL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:25:24.678077] [FATAL] [MAIN ] NCDL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:25:24.678144] [WARN ] [MAIN ] NCDL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:25:24.678217] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-16T20:25:24.678306] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-16T20:25:24.678365] [INFO ] [LOCAL ] NCDL: Starting deletion of derivative data. [2025-10-16T20:25:24.678410] [DEBUG] [LOCAL ] NCDL: No derivative data file found to delete. [2025-10-16T20:25:24.678465] [INFO ] [MAIN ] Update Progress: 1458/2369 symbols completed. NCDL took 28.3s. Estimated remaining: 2h 8m 19s. Rate: 7.1 symbols/min [2025-10-16T20:25:24.747900] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-16T20:25:24.850767] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:25:24.850933] [DEBUG] [LOCAL ] NDMO: No existing data file found in primary storage. [2025-10-16T20:25:24.850969] [WARN ] [MAIN ] NDMO: No existing data found, performing full refresh instead. [2025-10-16T20:25:24.851079] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-16T20:25:24.851119] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-16T20:25:24.851159] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-16T20:25:24.851188] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-16T20:25:25.208068] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:25:25.542843] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-10-16T20:25:26.342817] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-16T20:25:26.879294] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T20:25:26.994348] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-16T20:25:27.142843] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-16T20:25:27.312294] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T20:25:27.942827] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-16T20:25:28.742796] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-16T20:25:28.916114] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-16T20:25:29.097492] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-16T20:25:29.542771] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-16T20:25:29.703370] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T20:25:30.342830] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-16T20:25:31.142773] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-16T20:25:31.230079] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-16T20:25:31.606283] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T20:25:31.942817] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-16T20:25:32.206958] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T20:25:32.742819] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-16T20:25:32.850314] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T20:25:33.542843] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-16T20:25:33.782595] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T20:25:34.342833] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-16T20:25:34.597273] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T20:25:35.142797] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-16T20:25:35.345700] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T20:25:35.840547] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-16T20:25:35.942820] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-16T20:25:36.742821] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-16T20:25:37.542818] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-16T20:25:37.618605] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T20:25:38.342814] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-16T20:25:38.605063] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-16T20:25:38.649748] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-16T20:25:38.879809] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-16T20:25:39.142788] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-16T20:25:39.942800] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-16T20:25:40.212708] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T20:25:40.742812] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-16T20:25:40.962231] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T20:25:41.542818] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-16T20:25:42.342842] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-16T20:25:42.531638] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T20:25:43.050364] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-16T20:25:43.142801] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-16T20:25:43.204221] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-16T20:25:43.942831] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-16T20:25:43.988327] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T20:25:43.994940] [INFO ] [REMOTE ] NCLH: Full fetch complete (77543 records). [2025-10-16T20:25:43.995121] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-16T20:25:43.996070] [FATAL] [VALIDATOR ] NCLH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:25:43.996179] [FATAL] [MAIN ] NCLH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:25:43.996223] [WARN ] [MAIN ] NCLH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:25:43.996262] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-16T20:25:43.996320] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-16T20:25:43.996356] [INFO ] [LOCAL ] NCLH: Starting deletion of derivative data. [2025-10-16T20:25:43.996395] [DEBUG] [LOCAL ] NCLH: No derivative data file found to delete. [2025-10-16T20:25:43.996450] [INFO ] [MAIN ] Update Progress: 1459/2369 symbols completed. NCLH took 41.1s. Estimated remaining: 2h 8m 17s. Rate: 7.1 symbols/min [2025-10-16T20:25:44.175137] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:25:44.175347] [DEBUG] [LOCAL ] NE: No existing data file found in primary storage. [2025-10-16T20:25:44.175404] [WARN ] [MAIN ] NE: No existing data found, performing full refresh instead. [2025-10-16T20:25:44.175521] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-16T20:25:44.175601] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-16T20:25:44.175693] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-16T20:25:44.175743] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-16T20:25:44.529214] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:25:44.742803] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-16T20:25:45.064739] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T20:25:45.542789] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-10-16T20:25:45.709500] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T20:25:46.342871] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-16T20:25:47.100448] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T20:25:47.142765] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-16T20:25:47.403215] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T20:25:47.942839] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-16T20:25:48.745751] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-16T20:25:48.751567] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T20:25:48.953472] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T20:25:49.542854] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-16T20:25:49.935920] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T20:25:49.938512] [INFO ] [REMOTE ] NCZ: Full fetch complete (21050 records). [2025-10-16T20:25:49.938585] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-16T20:25:50.307522] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-16T20:25:50.307612] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-16T20:25:50.308136] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-16T20:25:50.308189] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-16T20:25:50.308769] [DEBUG] [LOCAL ] NCZ: Trimmed 21050 records to 12477 (keeping 200 days of data) [2025-10-16T20:25:50.345823] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-16T20:25:50.387269] [DEBUG] [LOCAL ] NCZ: Primary data saved (12477 records). [2025-10-16T20:25:50.387377] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-16T20:25:50.387465] [INFO ] [MAIN ] Update Progress: 1460/2369 symbols completed. NCZ took 28.4s. Estimated remaining: 2h 8m 7s. Rate: 7.1 symbols/min [2025-10-16T20:25:50.561378] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:25:50.561557] [DEBUG] [LOCAL ] NEA: No existing data file found in primary storage. [2025-10-16T20:25:50.561596] [WARN ] [MAIN ] NEA: No existing data found, performing full refresh instead. [2025-10-16T20:25:50.561754] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-16T20:25:50.561810] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-16T20:25:50.561854] [DEBUG] [LOCAL ] NEA: No primary data file found to delete. [2025-10-16T20:25:50.561886] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-16T20:25:50.919034] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:25:51.142787] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-10-16T20:25:51.221157] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T20:25:51.242987] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-16T20:25:51.942835] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-16T20:25:52.742838] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-16T20:25:52.837414] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T20:25:53.542781] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-16T20:25:53.790584] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-16T20:25:53.831519] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T20:25:54.342824] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-16T20:25:54.929117] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T20:25:55.142815] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-16T20:25:55.942838] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-16T20:25:56.115291] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T20:25:56.304792] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T20:25:56.742873] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-16T20:25:57.405791] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T20:25:57.542830] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-16T20:25:57.894218] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T20:25:58.342855] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-16T20:25:58.906609] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-16T20:25:58.908903] [INFO ] [REMOTE ] NDMO: Full fetch complete (23588 records). [2025-10-16T20:25:58.908975] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-16T20:25:58.909418] [FATAL] [VALIDATOR ] NDMO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:25:58.909501] [FATAL] [MAIN ] NDMO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:25:58.909543] [WARN ] [MAIN ] NDMO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:25:58.909598] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-16T20:25:58.909718] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-16T20:25:58.909779] [INFO ] [LOCAL ] NDMO: Starting deletion of derivative data. [2025-10-16T20:25:58.909836] [DEBUG] [LOCAL ] NDMO: No derivative data file found to delete. [2025-10-16T20:25:58.909924] [INFO ] [MAIN ] Update Progress: 1461/2369 symbols completed. NDMO took 34.2s. Estimated remaining: 2h 7m 59s. Rate: 7.1 symbols/min [2025-10-16T20:25:59.081624] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:25:59.081817] [DEBUG] [LOCAL ] NEE: No existing data file found in primary storage. [2025-10-16T20:25:59.081858] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-10-16T20:25:59.081972] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-16T20:25:59.082015] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-16T20:25:59.082057] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-16T20:25:59.082089] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-16T20:25:59.148365] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-16T20:25:59.469713] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:25:59.504397] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-16T20:25:59.942785] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-16T20:26:00.234496] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T20:26:00.742801] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-16T20:26:01.388242] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T20:26:01.542870] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-16T20:26:02.224724] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T20:26:02.342878] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-16T20:26:03.142838] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-10-16T20:26:03.275613] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T20:26:03.334716] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T20:26:03.338567] [INFO ] [REMOTE ] NCV: Full fetch complete (22306 records). [2025-10-16T20:26:03.338707] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-16T20:26:03.702720] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-10-16T20:26:03.702801] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-10-16T20:26:03.703258] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-10-16T20:26:03.703297] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-10-16T20:26:03.703873] [DEBUG] [LOCAL ] NCV: Trimmed 22306 records to 14028 (keeping 200 days of data) [2025-10-16T20:26:03.796253] [DEBUG] [LOCAL ] NCV: Primary data saved (14028 records). [2025-10-16T20:26:03.796361] [INFO ] [MAIN ] NCV: Full history saved. [2025-10-16T20:26:03.796437] [INFO ] [MAIN ] Update Progress: 1462/2369 symbols completed. NCV took 54.8s. Estimated remaining: 2h 7m 48s. Rate: 7.1 symbols/min [2025-10-16T20:26:03.945153] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-16T20:26:03.970695] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:26:03.970789] [DEBUG] [LOCAL ] NEM: No existing data file found in primary storage. [2025-10-16T20:26:03.970827] [WARN ] [MAIN ] NEM: No existing data found, performing full refresh instead. [2025-10-16T20:26:03.970954] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-16T20:26:03.971010] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-16T20:26:03.971054] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-16T20:26:03.971088] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-16T20:26:04.323103] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:26:04.742810] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-16T20:26:05.246511] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-16T20:26:05.542857] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-16T20:26:05.991729] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-16T20:26:06.242854] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T20:26:06.342767] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-16T20:26:07.142862] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-16T20:26:07.799212] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-16T20:26:07.904191] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T20:26:07.942771] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-16T20:26:08.742790] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-16T20:26:08.852772] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T20:26:09.542237] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T20:26:09.544966] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-10-16T20:26:10.342787] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-16T20:26:10.440184] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T20:26:11.142816] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-16T20:26:11.713701] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-16T20:26:11.942806] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-16T20:26:12.022833] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T20:26:12.608350] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T20:26:12.742801] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-16T20:26:13.542889] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-16T20:26:14.073182] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-16T20:26:14.342871] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-16T20:26:14.470094] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T20:26:14.476745] [INFO ] [REMOTE ] NE: Full fetch complete (75393 records). [2025-10-16T20:26:14.476930] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-16T20:26:14.477883] [FATAL] [VALIDATOR ] NE: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:26:14.477975] [FATAL] [MAIN ] NE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:26:14.478022] [WARN ] [MAIN ] NE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:26:14.478063] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-16T20:26:14.478119] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-16T20:26:14.478156] [INFO ] [LOCAL ] NE: Starting deletion of derivative data. [2025-10-16T20:26:14.478195] [DEBUG] [LOCAL ] NE: No derivative data file found to delete. [2025-10-16T20:26:14.478251] [INFO ] [MAIN ] Update Progress: 1463/2369 symbols completed. NE took 30.5s. Estimated remaining: 2h 7m 41s. Rate: 7.1 symbols/min [2025-10-16T20:26:14.653913] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:26:14.654144] [DEBUG] [LOCAL ] NET: No existing data file found in primary storage. [2025-10-16T20:26:14.654199] [WARN ] [MAIN ] NET: No existing data found, performing full refresh instead. [2025-10-16T20:26:14.654310] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-16T20:26:14.654350] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-16T20:26:14.654391] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-16T20:26:14.654422] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-16T20:26:15.076830] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:26:15.110191] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-16T20:26:15.142782] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-16T20:26:15.942804] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-10-16T20:26:16.674314] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-16T20:26:16.742799] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-16T20:26:17.435104] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-16T20:26:17.542784] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-16T20:26:18.173593] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-16T20:26:18.342859] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-16T20:26:19.035174] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-16T20:26:19.142828] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-16T20:26:19.824350] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-16T20:26:19.942839] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-16T20:26:20.470908] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-16T20:26:20.742820] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-16T20:26:21.542848] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-16T20:26:21.686587] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-16T20:26:22.075844] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-16T20:26:22.342831] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-16T20:26:22.658094] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-16T20:26:23.097983] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T20:26:23.142782] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-16T20:26:23.887947] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T20:26:23.892030] [INFO ] [REMOTE ] NEA: Full fetch complete (50898 records). [2025-10-16T20:26:23.892114] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-16T20:26:23.892827] [FATAL] [VALIDATOR ] NEA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:26:23.892920] [FATAL] [MAIN ] NEA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:26:23.892994] [WARN ] [MAIN ] NEA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:26:23.893083] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-16T20:26:23.893157] [DEBUG] [LOCAL ] NEA: No primary data file found to delete. [2025-10-16T20:26:23.893205] [INFO ] [LOCAL ] NEA: Starting deletion of derivative data. [2025-10-16T20:26:23.893274] [DEBUG] [LOCAL ] NEA: No derivative data file found to delete. [2025-10-16T20:26:23.893332] [INFO ] [MAIN ] Update Progress: 1464/2369 symbols completed. NEA took 33.5s. Estimated remaining: 2h 7m 33s. Rate: 7.1 symbols/min [2025-10-16T20:26:23.949107] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-16T20:26:24.071282] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:26:24.071453] [DEBUG] [LOCAL ] NEU: No existing data file found in primary storage. [2025-10-16T20:26:24.071507] [WARN ] [MAIN ] NEU: No existing data found, performing full refresh instead. [2025-10-16T20:26:24.071667] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-16T20:26:24.071733] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-16T20:26:24.071784] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-16T20:26:24.071817] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-16T20:26:24.428221] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:26:24.461522] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-16T20:26:24.742871] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-10-16T20:26:25.437398] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-16T20:26:25.542785] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-16T20:26:26.246944] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-16T20:26:26.305390] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T20:26:26.342780] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-16T20:26:27.142821] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-16T20:26:27.935774] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-16T20:26:27.942763] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-16T20:26:28.520860] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T20:26:28.602818] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-16T20:26:28.742865] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-16T20:26:29.542869] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-16T20:26:30.342790] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-16T20:26:30.395522] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-16T20:26:31.107911] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-16T20:26:31.142791] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-16T20:26:31.942856] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-16T20:26:32.346121] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-16T20:26:32.515195] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T20:26:32.742819] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-16T20:26:33.391740] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-16T20:26:33.542825] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-16T20:26:34.342816] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-16T20:26:34.778053] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T20:26:35.018968] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-16T20:26:35.142863] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-16T20:26:35.942810] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-16T20:26:36.509058] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-16T20:26:36.742866] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-16T20:26:37.542855] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-16T20:26:37.647968] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-16T20:26:37.692976] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T20:26:37.943618] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-16T20:26:37.950507] [INFO ] [REMOTE ] NEE: Full fetch complete (77497 records). [2025-10-16T20:26:37.950733] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-16T20:26:37.951616] [FATAL] [VALIDATOR ] NEE: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:26:37.951789] [FATAL] [MAIN ] NEE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:26:37.951834] [WARN ] [MAIN ] NEE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:26:37.951902] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-16T20:26:37.951968] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-16T20:26:37.952004] [INFO ] [LOCAL ] NEE: Starting deletion of derivative data. [2025-10-16T20:26:37.952043] [DEBUG] [LOCAL ] NEE: No derivative data file found to delete. [2025-10-16T20:26:37.952120] [INFO ] [MAIN ] Update Progress: 1465/2369 symbols completed. NEE took 39.0s. Estimated remaining: 2h 7m 28s. Rate: 7.1 symbols/min [2025-10-16T20:26:38.126291] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:26:38.149593] [DEBUG] [LOCAL ] NEXA: Loaded 5247 existing records from primary storage. [2025-10-16T20:26:38.162612] [INFO ] [MAIN ] NEXA: Loaded 5247 existing records. [2025-10-16T20:26:38.200788] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-16T20:26:38.351715] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-16T20:26:38.357010] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:26:38.358197] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-16T20:26:38.358254] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-16T20:26:38.358457] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-10-16T20:26:38.358513] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-16T20:26:38.702500] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:26:39.142781] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-16T20:26:39.380765] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-16T20:26:39.387185] [INFO ] [REMOTE ] NEM: Full fetch complete (77497 records). [2025-10-16T20:26:39.387338] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-16T20:26:39.388264] [FATAL] [VALIDATOR ] NEM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:26:39.388399] [FATAL] [MAIN ] NEM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:26:39.388443] [WARN ] [MAIN ] NEM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:26:39.388516] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-16T20:26:39.388583] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-16T20:26:39.388621] [INFO ] [LOCAL ] NEM: Starting deletion of derivative data. [2025-10-16T20:26:39.388706] [DEBUG] [LOCAL ] NEM: No derivative data file found to delete. [2025-10-16T20:26:39.388778] [INFO ] [MAIN ] Update Progress: 1466/2369 symbols completed. NEM took 35.6s. Estimated remaining: 2h 7m 15s. Rate: 7.1 symbols/min [2025-10-16T20:26:39.560169] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:26:39.560341] [DEBUG] [LOCAL ] NFG: No existing data file found in primary storage. [2025-10-16T20:26:39.560380] [WARN ] [MAIN ] NFG: No existing data found, performing full refresh instead. [2025-10-16T20:26:39.560495] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-16T20:26:39.560536] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-16T20:26:39.560577] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-16T20:26:39.560609] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-16T20:26:39.912080] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:26:39.942775] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-10-16T20:26:40.078733] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-16T20:26:40.742827] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-16T20:26:41.471029] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T20:26:41.542790] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-16T20:26:41.585694] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T20:26:42.342837] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-10-16T20:26:43.142789] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-16T20:26:43.227190] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-16T20:26:43.253817] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T20:26:43.427767] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-16T20:26:43.429391] [INFO ] [REMOTE ] NEU: Full fetch complete (10746 records). [2025-10-16T20:26:43.429476] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-16T20:26:43.429923] [FATAL] [VALIDATOR ] NEU: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:26:43.430006] [FATAL] [MAIN ] NEU: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:26:43.430048] [WARN ] [MAIN ] NEU: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:26:43.430118] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-16T20:26:43.430183] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-16T20:26:43.430218] [INFO ] [LOCAL ] NEU: Starting deletion of derivative data. [2025-10-16T20:26:43.430256] [DEBUG] [LOCAL ] NEU: No derivative data file found to delete. [2025-10-16T20:26:43.430308] [INFO ] [MAIN ] Update Progress: 1467/2369 symbols completed. NEU took 19.5s. Estimated remaining: 2h 7m 4s. Rate: 7.1 symbols/min [2025-10-16T20:26:43.634199] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:26:43.634400] [DEBUG] [LOCAL ] NFJ: No existing data file found in primary storage. [2025-10-16T20:26:43.634468] [WARN ] [MAIN ] NFJ: No existing data found, performing full refresh instead. [2025-10-16T20:26:43.634585] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-16T20:26:43.634673] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-16T20:26:43.634742] [DEBUG] [LOCAL ] NFJ: No primary data file found to delete. [2025-10-16T20:26:43.634777] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-16T20:26:43.948028] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-16T20:26:44.058551] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:26:44.742810] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-10-16T20:26:45.542784] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-16T20:26:45.926590] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T20:26:46.344399] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-16T20:26:46.342858] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-16T20:26:46.432364] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T20:26:47.142856] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-16T20:26:47.823117] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-16T20:26:47.907771] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T20:26:47.942770] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-16T20:26:48.742816] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-16T20:26:49.542785] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-16T20:26:49.637146] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T20:26:49.907522] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T20:26:50.199869] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-16T20:26:50.342823] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-16T20:26:51.142780] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-16T20:26:51.511482] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T20:26:51.942811] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-16T20:26:52.725465] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T20:26:52.742769] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-16T20:26:53.542867] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-16T20:26:54.168692] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-16T20:26:54.342814] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-16T20:26:54.396988] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-16T20:26:54.446895] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T20:26:54.938036] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-16T20:26:55.142800] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-16T20:26:55.942829] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-16T20:26:56.697275] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T20:26:56.742819] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-16T20:26:57.542870] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-16T20:26:58.159297] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-16T20:26:58.288670] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-16T20:26:58.342789] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-16T20:26:58.478459] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T20:26:59.061850] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T20:26:59.142798] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-16T20:26:59.942786] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-16T20:27:00.281968] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T20:27:00.742809] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-16T20:27:01.497118] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-16T20:27:01.542772] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-16T20:27:01.923598] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-16T20:27:02.104789] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-16T20:27:02.342839] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-16T20:27:03.142842] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-16T20:27:03.589500] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-16T20:27:03.942847] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-16T20:27:04.742813] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-16T20:27:05.192565] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-16T20:27:05.542867] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-16T20:27:05.605006] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T20:27:05.855380] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T20:27:06.342783] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-16T20:27:06.424029] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T20:27:06.430179] [INFO ] [REMOTE ] NET: Full fetch complete (76545 records). [2025-10-16T20:27:06.430298] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-16T20:27:06.431186] [FATAL] [VALIDATOR ] NET: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:27:06.431305] [FATAL] [MAIN ] NET: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:27:06.431386] [WARN ] [MAIN ] NET: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:27:06.431486] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-16T20:27:06.431564] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-16T20:27:06.431600] [INFO ] [LOCAL ] NET: Starting deletion of derivative data. [2025-10-16T20:27:06.431659] [DEBUG] [LOCAL ] NET: No derivative data file found to delete. [2025-10-16T20:27:06.431757] [INFO ] [MAIN ] Update Progress: 1468/2369 symbols completed. NET took 52.0s. Estimated remaining: 2h 7m 5s. Rate: 7.1 symbols/min [2025-10-16T20:27:06.597951] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:27:06.598115] [DEBUG] [LOCAL ] NGG: No existing data file found in primary storage. [2025-10-16T20:27:06.598151] [WARN ] [MAIN ] NGG: No existing data found, performing full refresh instead. [2025-10-16T20:27:06.598257] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-16T20:27:06.598322] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-16T20:27:06.598376] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-16T20:27:06.598467] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-16T20:27:06.942704] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:27:07.142774] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-10-16T20:27:07.721290] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T20:27:07.942800] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-16T20:27:08.742793] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-16T20:27:08.883937] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-16T20:27:08.916298] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T20:27:09.542852] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-16T20:27:10.086406] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T20:27:10.342809] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-16T20:27:10.559622] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T20:27:10.562195] [INFO ] [REMOTE ] NEXA: Full fetch complete (8175 records). [2025-10-16T20:27:10.562272] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-16T20:27:10.936544] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-10-16T20:27:10.936675] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-10-16T20:27:10.937030] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-10-16T20:27:10.937094] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-10-16T20:27:10.937585] [DEBUG] [LOCAL ] NEXA: Trimmed 8175 records to 5326 (keeping 200 days of data) [2025-10-16T20:27:10.974437] [DEBUG] [LOCAL ] NEXA: Primary data saved (5326 records). [2025-10-16T20:27:10.974921] [INFO ] [MAIN ] NEXA: Full history saved. [2025-10-16T20:27:10.975055] [INFO ] [MAIN ] Update Progress: 1469/2369 symbols completed. NEXA took 33.0s. Estimated remaining: 2h 6m 54s. Rate: 7.1 symbols/min [2025-10-16T20:27:11.149129] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-16T20:27:11.149056] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:27:11.184622] [DEBUG] [LOCAL ] NGL: Loaded 30004 existing records from primary storage. [2025-10-16T20:27:11.184990] [INFO ] [MAIN ] NGL: Loaded 30004 existing records. [2025-10-16T20:27:11.375104] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:27:11.375515] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-16T20:27:11.375586] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-16T20:27:11.376302] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-10-16T20:27:11.376375] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-16T20:27:11.583462] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T20:27:11.805822] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:27:11.852610] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T20:27:11.858354] [INFO ] [REMOTE ] NFG: Full fetch complete (57023 records). [2025-10-16T20:27:11.858515] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-16T20:27:11.859454] [FATAL] [VALIDATOR ] NFG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:27:11.859551] [FATAL] [MAIN ] NFG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:27:11.859595] [WARN ] [MAIN ] NFG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:27:11.859661] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-16T20:27:11.859780] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-16T20:27:11.859838] [INFO ] [LOCAL ] NFG: Starting deletion of derivative data. [2025-10-16T20:27:11.859885] [DEBUG] [LOCAL ] NFG: No derivative data file found to delete. [2025-10-16T20:27:11.859952] [INFO ] [MAIN ] Update Progress: 1470/2369 symbols completed. NFG took 32.5s. Estimated remaining: 2h 6m 41s. Rate: 7.1 symbols/min [2025-10-16T20:27:11.948032] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-10-16T20:27:12.044413] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:27:12.057929] [DEBUG] [LOCAL ] NGS: Loaded 11176 existing records from primary storage. [2025-10-16T20:27:12.058232] [INFO ] [MAIN ] NGS: Loaded 11176 existing records. [2025-10-16T20:27:12.238355] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:27:12.238698] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-16T20:27:12.238761] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-16T20:27:12.239171] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-10-16T20:27:12.239228] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-16T20:27:12.601040] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:27:12.742857] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-16T20:27:13.113810] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T20:27:13.542865] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-16T20:27:14.342867] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-10-16T20:27:14.529889] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-16T20:27:14.791411] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T20:27:14.916965] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T20:27:15.142845] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-16T20:27:15.942856] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-16T20:27:16.518441] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T20:27:16.521611] [INFO ] [REMOTE ] NFJ: Full fetch complete (29891 records). [2025-10-16T20:27:16.521739] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-16T20:27:16.522273] [FATAL] [VALIDATOR ] NFJ: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:27:16.522362] [FATAL] [MAIN ] NFJ: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:27:16.522407] [WARN ] [MAIN ] NFJ: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:27:16.522477] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-16T20:27:16.522548] [DEBUG] [LOCAL ] NFJ: No primary data file found to delete. [2025-10-16T20:27:16.522588] [INFO ] [LOCAL ] NFJ: Starting deletion of derivative data. [2025-10-16T20:27:16.522633] [DEBUG] [LOCAL ] NFJ: No derivative data file found to delete. [2025-10-16T20:27:16.522737] [INFO ] [MAIN ] Update Progress: 1471/2369 symbols completed. NFJ took 33.1s. Estimated remaining: 2h 6m 30s. Rate: 7.1 symbols/min [2025-10-16T20:27:16.704824] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:27:16.705116] [DEBUG] [LOCAL ] NGVC: No existing data file found in primary storage. [2025-10-16T20:27:16.705185] [WARN ] [MAIN ] NGVC: No existing data found, performing full refresh instead. [2025-10-16T20:27:16.705535] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-16T20:27:16.705602] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-16T20:27:16.705806] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-16T20:27:16.705861] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-16T20:27:16.750037] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-16T20:27:17.008854] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-16T20:27:17.140233] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:27:17.542881] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-16T20:27:18.043112] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T20:27:18.197389] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-16T20:27:18.342835] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-16T20:27:19.142847] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-16T20:27:19.583233] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T20:27:19.942845] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-16T20:27:20.625093] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T20:27:20.742799] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-16T20:27:21.150363] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T20:27:21.542894] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-10-16T20:27:21.576074] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T20:27:22.342841] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-16T20:27:22.744435] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T20:27:23.142867] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-16T20:27:23.647222] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T20:27:23.825140] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-16T20:27:23.942878] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-16T20:27:24.742819] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-16T20:27:25.166964] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T20:27:25.542805] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-16T20:27:26.342778] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-16T20:27:26.591546] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T20:27:26.653380] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T20:27:27.142826] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-16T20:27:27.273958] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T20:27:27.942782] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-16T20:27:28.342881] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T20:27:28.537406] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T20:27:28.742813] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-16T20:27:29.542813] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-16T20:27:30.342789] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-16T20:27:30.659207] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-16T20:27:30.946317] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T20:27:31.142810] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-16T20:27:31.159326] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T20:27:31.942822] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-16T20:27:32.742898] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-16T20:27:33.105173] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-16T20:27:33.162682] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T20:27:33.542798] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-16T20:27:34.282985] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T20:27:34.342794] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-16T20:27:35.142821] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-16T20:27:35.287941] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-16T20:27:35.708608] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T20:27:35.810230] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-16T20:27:35.942811] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-16T20:27:36.742804] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-16T20:27:37.542854] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-16T20:27:37.606172] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T20:27:38.013395] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-16T20:27:38.342799] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-16T20:27:38.392913] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T20:27:39.142815] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-16T20:27:39.942799] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-16T20:27:40.011010] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-16T20:27:40.099864] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T20:27:40.742795] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-16T20:27:41.542796] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-16T20:27:41.609569] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T20:27:41.719836] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T20:27:41.725552] [INFO ] [REMOTE ] NGG: Full fetch complete (66210 records). [2025-10-16T20:27:41.725717] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-16T20:27:41.726519] [FATAL] [VALIDATOR ] NGG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:27:41.726608] [FATAL] [MAIN ] NGG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:27:41.726684] [WARN ] [MAIN ] NGG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:27:41.726765] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-16T20:27:41.726845] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-16T20:27:41.726884] [INFO ] [LOCAL ] NGG: Starting deletion of derivative data. [2025-10-16T20:27:41.726924] [DEBUG] [LOCAL ] NGG: No derivative data file found to delete. [2025-10-16T20:27:41.726980] [INFO ] [MAIN ] Update Progress: 1472/2369 symbols completed. NGG took 35.3s. Estimated remaining: 2h 6m 32s. Rate: 7.1 symbols/min [2025-10-16T20:27:41.901816] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:27:41.901993] [DEBUG] [LOCAL ] NGVT: No existing data file found in primary storage. [2025-10-16T20:27:41.902031] [WARN ] [MAIN ] NGVT: No existing data found, performing full refresh instead. [2025-10-16T20:27:41.902152] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-16T20:27:41.902193] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-16T20:27:41.902237] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-16T20:27:41.902313] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-16T20:27:42.263966] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:27:42.342777] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-16T20:27:42.374854] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T20:27:43.142841] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-16T20:27:43.748059] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T20:27:43.920341] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T20:27:43.922019] [INFO ] [REMOTE ] NGS: Full fetch complete (17166 records). [2025-10-16T20:27:43.922108] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-16T20:27:43.950797] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-10-16T20:27:44.290123] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-10-16T20:27:44.290230] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-10-16T20:27:44.290702] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-10-16T20:27:44.290767] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-10-16T20:27:44.291483] [DEBUG] [LOCAL ] NGS: Trimmed 17166 records to 11249 (keeping 200 days of data) [2025-10-16T20:27:44.365950] [DEBUG] [LOCAL ] NGS: Primary data saved (11249 records). [2025-10-16T20:27:44.366094] [INFO ] [MAIN ] NGS: Full history saved. [2025-10-16T20:27:44.366176] [INFO ] [MAIN ] Update Progress: 1473/2369 symbols completed. NGS took 32.5s. Estimated remaining: 2h 6m 20s. Rate: 7.1 symbols/min [2025-10-16T20:27:44.537191] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:27:44.537357] [DEBUG] [LOCAL ] NHI: No existing data file found in primary storage. [2025-10-16T20:27:44.537393] [WARN ] [MAIN ] NHI: No existing data found, performing full refresh instead. [2025-10-16T20:27:44.537503] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-16T20:27:44.537543] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-16T20:27:44.537584] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-16T20:27:44.537616] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-16T20:27:44.748005] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-16T20:27:44.897335] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:27:45.360769] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T20:27:45.542801] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-10-16T20:27:45.984619] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-16T20:27:45.987870] [INFO ] [REMOTE ] NGL: Full fetch complete (41566 records). [2025-10-16T20:27:45.987954] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-16T20:27:46.343997] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-16T20:27:46.359736] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-10-16T20:27:46.359816] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-10-16T20:27:46.360755] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-10-16T20:27:46.360819] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-10-16T20:27:46.362034] [DEBUG] [LOCAL ] NGL: Trimmed 41566 records to 30150 (keeping 200 days of data) [2025-10-16T20:27:46.532853] [DEBUG] [LOCAL ] NGL: Primary data saved (30150 records). [2025-10-16T20:27:46.532981] [INFO ] [MAIN ] NGL: Full history saved. [2025-10-16T20:27:46.533058] [INFO ] [MAIN ] Update Progress: 1474/2369 symbols completed. NGL took 35.6s. Estimated remaining: 2h 6m 7s. Rate: 7.1 symbols/min [2025-10-16T20:27:46.708581] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:27:46.708796] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-10-16T20:27:46.708840] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-10-16T20:27:46.708981] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-16T20:27:46.709051] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-16T20:27:46.709105] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-16T20:27:46.709139] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-16T20:27:46.879273] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T20:27:47.085277] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:27:47.142771] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-10-16T20:27:47.705044] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T20:27:47.942827] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-16T20:27:48.742789] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-16T20:27:49.030420] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-16T20:27:49.057630] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T20:27:49.542847] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-16T20:27:49.776446] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T20:27:50.342833] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-16T20:27:50.859672] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T20:27:51.145621] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-16T20:27:51.147313] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T20:27:51.942816] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-16T20:27:52.742784] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-16T20:27:53.062300] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-16T20:27:53.088961] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T20:27:53.542855] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-16T20:27:53.978554] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-16T20:27:54.342810] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-16T20:27:54.873838] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T20:27:55.142831] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-16T20:27:55.942832] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-16T20:27:56.071187] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T20:27:56.291124] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T20:27:56.742851] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-16T20:27:56.865191] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-16T20:27:57.087756] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-16T20:27:57.090964] [INFO ] [REMOTE ] NGVC: Full fetch complete (30852 records). [2025-10-16T20:27:57.091051] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-16T20:27:57.091502] [FATAL] [VALIDATOR ] NGVC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:27:57.091599] [FATAL] [MAIN ] NGVC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:27:57.091706] [WARN ] [MAIN ] NGVC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:27:57.091796] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-16T20:27:57.091871] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-16T20:27:57.091912] [INFO ] [LOCAL ] NGVC: Starting deletion of derivative data. [2025-10-16T20:27:57.091954] [DEBUG] [LOCAL ] NGVC: No derivative data file found to delete. [2025-10-16T20:27:57.092010] [INFO ] [MAIN ] Update Progress: 1475/2369 symbols completed. NGVC took 40.6s. Estimated remaining: 2h 6m 0s. Rate: 7.1 symbols/min [2025-10-16T20:27:57.257405] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:27:57.257564] [DEBUG] [LOCAL ] NIC: No existing data file found in primary storage. [2025-10-16T20:27:57.257602] [WARN ] [MAIN ] NIC: No existing data found, performing full refresh instead. [2025-10-16T20:27:57.257763] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-16T20:27:57.257827] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-16T20:27:57.257876] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-16T20:27:57.257911] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-16T20:27:57.547918] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-16T20:27:57.611508] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:27:58.342873] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-10-16T20:27:59.047992] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T20:27:59.142788] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-16T20:27:59.219119] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-16T20:27:59.942845] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-16T20:28:00.378738] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-16T20:28:00.743329] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-16T20:28:01.149822] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T20:28:01.542772] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-16T20:28:01.687766] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T20:28:02.342856] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-16T20:28:03.142766] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-16T20:28:03.212167] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T20:28:03.518851] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-16T20:28:03.942905] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-16T20:28:04.512225] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T20:28:04.742822] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-16T20:28:05.122953] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T20:28:05.542870] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-16T20:28:06.139244] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T20:28:06.342903] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-16T20:28:06.774316] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-16T20:28:07.142799] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-16T20:28:07.294395] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T20:28:07.942830] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-16T20:28:08.381865] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T20:28:08.742859] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-16T20:28:08.942000] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T20:28:09.542799] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-16T20:28:09.656291] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T20:28:10.342807] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-16T20:28:10.969442] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-16T20:28:11.142807] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-16T20:28:11.217926] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T20:28:11.942792] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-16T20:28:12.082677] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T20:28:12.742806] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-16T20:28:13.542789] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-16T20:28:13.624302] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T20:28:13.883570] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-16T20:28:14.329877] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T20:28:14.332821] [INFO ] [REMOTE ] NHI: Full fetch complete (31321 records). [2025-10-16T20:28:14.332934] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-16T20:28:14.333514] [FATAL] [VALIDATOR ] NHI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:28:14.333611] [FATAL] [MAIN ] NHI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:28:14.333694] [WARN ] [MAIN ] NHI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:28:14.333779] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-16T20:28:14.333875] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-16T20:28:14.333941] [INFO ] [LOCAL ] NHI: Starting deletion of derivative data. [2025-10-16T20:28:14.334000] [DEBUG] [LOCAL ] NHI: No derivative data file found to delete. [2025-10-16T20:28:14.334072] [INFO ] [MAIN ] Update Progress: 1476/2369 symbols completed. NHI took 30.0s. Estimated remaining: 2h 5m 57s. Rate: 7.1 symbols/min [2025-10-16T20:28:14.347916] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-16T20:28:14.543053] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:28:14.556203] [DEBUG] [LOCAL ] NIE: Loaded 11908 existing records from primary storage. [2025-10-16T20:28:14.556453] [INFO ] [MAIN ] NIE: Loaded 11908 existing records. [2025-10-16T20:28:14.735587] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:28:14.735823] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-16T20:28:14.735872] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-16T20:28:14.736236] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-10-16T20:28:14.736294] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-16T20:28:14.996457] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-16T20:28:15.022761] [INFO ] [REMOTE ] NGVT: Full fetch complete (34336 records). [2025-10-16T20:28:15.036712] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-16T20:28:15.048142] [FATAL] [VALIDATOR ] NGVT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:28:15.053371] [FATAL] [MAIN ] NGVT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:28:15.068883] [WARN ] [MAIN ] NGVT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:28:15.098951] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-16T20:28:15.102626] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-16T20:28:15.127435] [INFO ] [LOCAL ] NGVT: Starting deletion of derivative data. [2025-10-16T20:28:15.127579] [DEBUG] [LOCAL ] NGVT: No derivative data file found to delete. [2025-10-16T20:28:15.127347] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:28:15.127725] [INFO ] [MAIN ] Update Progress: 1477/2369 symbols completed. NGVT took 33.4s. Estimated remaining: 2h 5m 44s. Rate: 7.1 symbols/min [2025-10-16T20:28:15.142775] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-10-16T20:28:15.942894] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-16T20:28:16.279869] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T20:28:16.742869] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-16T20:28:16.918187] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-16T20:28:17.542806] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-16T20:28:18.342849] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-16T20:28:18.521903] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T20:28:18.633395] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T20:28:19.057734] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T20:28:19.142784] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-16T20:28:19.942833] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-16T20:28:20.064286] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T20:28:20.742824] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-16T20:28:21.542785] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-16T20:28:21.752768] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T20:28:21.841875] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T20:28:22.059241] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-16T20:28:22.342819] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-16T20:28:23.142789] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-16T20:28:23.368016] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T20:28:23.423562] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-16T20:28:23.425180] [INFO ] [REMOTE ] NIC: Full fetch complete (12400 records). [2025-10-16T20:28:23.425252] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-16T20:28:23.425621] [FATAL] [VALIDATOR ] NIC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:28:23.425730] [FATAL] [MAIN ] NIC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:28:23.425800] [WARN ] [MAIN ] NIC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:28:23.425883] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-16T20:28:23.425980] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-16T20:28:23.426030] [INFO ] [LOCAL ] NIC: Starting deletion of derivative data. [2025-10-16T20:28:23.426074] [DEBUG] [LOCAL ] NIC: No derivative data file found to delete. [2025-10-16T20:28:23.426129] [INFO ] [MAIN ] Update Progress: 1478/2369 symbols completed. NIC took 26.3s. Estimated remaining: 2h 5m 35s. Rate: 7.1 symbols/min [2025-10-16T20:28:23.942810] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-16T20:28:24.742796] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-16T20:28:24.981445] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-16T20:28:25.542863] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-16T20:28:26.329816] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T20:28:26.342769] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-16T20:28:26.672334] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T20:28:27.142821] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-16T20:28:27.391297] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-16T20:28:27.942851] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-16T20:28:28.791980] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T20:28:28.803126] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-16T20:28:28.865474] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-16T20:28:29.542853] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-16T20:28:30.576989] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T20:28:30.580279] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-16T20:28:30.707316] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-16T20:28:31.142896] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-16T20:28:31.577944] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T20:28:31.580162] [INFO ] [REMOTE ] NIE: Full fetch complete (16734 records). [2025-10-16T20:28:31.580244] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-16T20:28:31.967345] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-16T20:28:31.967450] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-16T20:28:31.967956] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-16T20:28:31.968035] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-16T20:28:31.968966] [DEBUG] [LOCAL ] NIE: Trimmed 16734 records to 11965 (keeping 200 days of data) [2025-10-16T20:28:32.041884] [DEBUG] [LOCAL ] NIE: Primary data saved (11965 records). [2025-10-16T20:28:32.042004] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-16T20:28:32.042080] [INFO ] [MAIN ] Update Progress: 1479/2369 symbols completed. NIE took 17.7s. Estimated remaining: 2h 5m 27s. Rate: 7.1 symbols/min [2025-10-16T20:28:32.064039] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T20:28:32.070292] [INFO ] [REMOTE ] NI: Full fetch complete (77104 records). [2025-10-16T20:28:32.070388] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-16T20:28:32.071047] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:28:32.071132] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:28:32.071174] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:28:32.071239] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-16T20:28:32.071301] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-16T20:28:32.071337] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-10-16T20:28:32.071376] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-10-16T20:28:32.071429] [INFO ] [MAIN ] Update Progress: 1480/2369 symbols completed. NI took 45.5s. Estimated remaining: 2h 5m 13s. Rate: 7.1 symbols/min [2025-10-16T20:28:32.702021] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:28:32.737378] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-16T20:28:32.736209] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:28:32.737245] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:28:32.765578] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:28:32.763624] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-16T20:28:32.766421] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-16T20:28:32.766618] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-16T20:28:32.766751] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-16T20:28:32.766830] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-16T20:28:32.881315] [DEBUG] [LOCAL ] NIM: Loaded 3526 existing records from primary storage. [2025-10-16T20:28:32.885819] [INFO ] [MAIN ] NIM: Loaded 3526 existing records. [2025-10-16T20:28:32.993857] [DEBUG] [LOCAL ] NINE: Loaded 28362 existing records from primary storage. [2025-10-16T20:28:33.123501] [INFO ] [MAIN ] NINE: Loaded 28362 existing records. [2025-10-16T20:28:33.456842] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:28:33.422709] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-16T20:28:33.468188] [INFO ] [MAIN ] NIO: Loaded 53802 existing records. [2025-10-16T20:28:33.467831] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-10-16T20:28:33.529510] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:28:33.547262] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-16T20:28:33.603375] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-16T20:28:33.679112] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-10-16T20:28:33.729257] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-16T20:28:33.710244] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:28:33.775181] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-16T20:28:33.797171] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-16T20:28:33.807635] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-10-16T20:28:33.849997] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-16T20:28:33.957127] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:28:33.966072] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-10-16T20:28:33.982319] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:28:33.982582] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:28:33.997679] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-16T20:28:33.992325] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-16T20:28:34.013288] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-16T20:28:34.023712] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:28:34.055370] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-10-16T20:28:34.091902] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-16T20:28:34.119720] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-16T20:28:34.214088] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-16T20:28:34.255802] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-16T20:28:34.317904] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-16T20:28:34.375631] [INFO ] [MAIN ] Update Progress: 1481/2369 symbols completed. NIQ took 2.3s. Estimated remaining: 2h 5m 1s. Rate: 7.1 symbols/min [2025-10-16T20:28:34.926681] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:28:34.989600] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-10-16T20:28:35.196666] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:28:35.236293] [DEBUG] [LOCAL ] NJR: No existing data file found in primary storage. [2025-10-16T20:28:35.235608] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:28:35.246965] [WARN ] [MAIN ] NJR: No existing data found, performing full refresh instead. [2025-10-16T20:28:35.247332] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-10-16T20:28:35.252634] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-16T20:28:35.258890] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-16T20:28:35.278301] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-16T20:28:35.278394] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-16T20:28:35.417676] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:28:35.417983] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-10-16T20:28:35.662825] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:28:35.663156] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-10-16T20:28:35.884712] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T20:28:35.942829] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-16T20:28:36.600836] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-16T20:28:36.742837] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-16T20:28:37.100849] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T20:28:37.175429] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T20:28:37.276683] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-16T20:28:37.542772] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-16T20:28:38.025770] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-10-16T20:28:38.075698] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-16T20:28:38.342825] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-16T20:28:39.109269] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T20:28:39.142786] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-16T20:28:39.942861] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-16T20:28:40.742848] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-16T20:28:40.993070] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T20:28:41.442795] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T20:28:41.542830] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-16T20:28:42.342889] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-16T20:28:42.562507] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-10-16T20:28:43.003872] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T20:28:43.028620] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T20:28:43.142898] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-16T20:28:43.942795] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-16T20:28:44.652101] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T20:28:44.742830] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-16T20:28:45.230321] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T20:28:45.456777] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-16T20:28:45.542898] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-16T20:28:46.342859] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-16T20:28:47.079762] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T20:28:47.142799] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-16T20:28:47.942842] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-16T20:28:48.748014] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-16T20:28:48.761373] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T20:28:48.862593] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-10-16T20:28:49.324819] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T20:28:49.376387] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T20:28:49.542825] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-16T20:28:50.342864] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-16T20:28:51.054133] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T20:28:51.142766] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-16T20:28:51.630779] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T20:28:51.942817] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-16T20:28:52.681313] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-16T20:28:52.742771] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-16T20:28:52.948238] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T20:28:53.226864] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-16T20:28:53.227731] [INFO ] [REMOTE ] NIM: Full fetch complete (6361 records). [2025-10-16T20:28:53.227799] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-16T20:28:53.545670] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-16T20:28:53.577510] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-10-16T20:28:53.577596] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-10-16T20:28:53.577837] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-10-16T20:28:53.577893] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-10-16T20:28:53.578300] [DEBUG] [LOCAL ] NIM: Trimmed 6361 records to 3564 (keeping 200 days of data) [2025-10-16T20:28:53.601022] [DEBUG] [LOCAL ] NIM: Primary data saved (3564 records). [2025-10-16T20:28:53.601112] [INFO ] [MAIN ] NIM: Full history saved. [2025-10-16T20:28:53.601189] [INFO ] [MAIN ] Update Progress: 1482/2369 symbols completed. NIM took 21.5s. Estimated remaining: 2h 4m 59s. Rate: 7.1 symbols/min [2025-10-16T20:28:53.764389] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:28:53.764552] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-16T20:28:53.764588] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-16T20:28:53.764719] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-16T20:28:53.764765] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-16T20:28:53.764806] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-16T20:28:53.764839] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-16T20:28:54.106935] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:28:54.342809] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-16T20:28:55.131600] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T20:28:55.142766] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-16T20:28:55.942792] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-10-16T20:28:56.689157] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T20:28:56.742781] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-16T20:28:56.846414] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T20:28:56.983880] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-16T20:28:57.542829] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-16T20:28:57.994924] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T20:28:58.342865] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-16T20:28:59.142784] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-16T20:28:59.189075] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T20:28:59.942792] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-16T20:29:00.191488] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-16T20:29:00.606267] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T20:29:00.742788] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-16T20:29:01.068331] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T20:29:01.542804] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-16T20:29:02.099556] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T20:29:02.342861] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-16T20:29:02.484118] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-16T20:29:03.142891] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-16T20:29:03.942835] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-16T20:29:04.742814] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-16T20:29:04.793067] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T20:29:04.950495] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-16T20:29:05.059092] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T20:29:05.542813] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-16T20:29:05.833676] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T20:29:05.958358] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-16T20:29:06.342869] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-16T20:29:07.142817] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-16T20:29:07.278437] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-16T20:29:07.942828] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-16T20:29:08.742844] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-16T20:29:08.791133] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T20:29:09.211787] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-16T20:29:09.216099] [INFO ] [REMOTE ] NINE: Full fetch complete (43465 records). [2025-10-16T20:29:09.216268] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-16T20:29:09.547994] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-16T20:29:09.628709] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-10-16T20:29:09.628795] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-10-16T20:29:09.629629] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-10-16T20:29:09.629708] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-10-16T20:29:09.630621] [DEBUG] [LOCAL ] NINE: Trimmed 43465 records to 28660 (keeping 200 days of data) [2025-10-16T20:29:09.792158] [DEBUG] [LOCAL ] NINE: Primary data saved (28660 records). [2025-10-16T20:29:09.792292] [INFO ] [MAIN ] NINE: Full history saved. [2025-10-16T20:29:09.792374] [INFO ] [MAIN ] Update Progress: 1483/2369 symbols completed. NINE took 37.7s. Estimated remaining: 2h 4m 56s. Rate: 7.1 symbols/min [2025-10-16T20:29:09.960333] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:29:09.974524] [DEBUG] [LOCAL ] NKX: Loaded 13656 existing records from primary storage. [2025-10-16T20:29:09.974789] [INFO ] [MAIN ] NKX: Loaded 13656 existing records. [2025-10-16T20:29:10.146849] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:29:10.147071] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-16T20:29:10.147118] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-16T20:29:10.147463] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-10-16T20:29:10.147521] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-16T20:29:10.348502] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-16T20:29:10.521568] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:29:10.676160] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T20:29:11.121738] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-16T20:29:11.144634] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-10-16T20:29:11.146947] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T20:29:11.151998] [INFO ] [REMOTE ] NJR: Full fetch complete (54609 records). [2025-10-16T20:29:11.152090] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-16T20:29:11.152780] [FATAL] [VALIDATOR ] NJR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:29:11.152863] [FATAL] [MAIN ] NJR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:29:11.152936] [WARN ] [MAIN ] NJR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:29:11.153007] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-16T20:29:11.153070] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-16T20:29:11.153116] [INFO ] [LOCAL ] NJR: Starting deletion of derivative data. [2025-10-16T20:29:11.153183] [DEBUG] [LOCAL ] NJR: No derivative data file found to delete. [2025-10-16T20:29:11.153240] [INFO ] [MAIN ] Update Progress: 1484/2369 symbols completed. NJR took 36.8s. Estimated remaining: 2h 4m 43s. Rate: 7.1 symbols/min [2025-10-16T20:29:11.324151] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:29:11.324327] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-16T20:29:11.324392] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-16T20:29:11.324509] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-16T20:29:11.324550] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-16T20:29:11.324591] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-16T20:29:11.324622] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-16T20:29:11.672537] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:29:11.942829] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-10-16T20:29:12.303288] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T20:29:12.716573] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T20:29:12.742764] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-16T20:29:13.429202] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T20:29:13.542821] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-16T20:29:14.342802] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-16T20:29:14.691614] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-16T20:29:15.142820] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-16T20:29:15.305237] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T20:29:15.942833] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-16T20:29:16.742835] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-16T20:29:16.938521] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T20:29:17.408288] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T20:29:17.542781] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-16T20:29:17.823482] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-16T20:29:18.204092] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-16T20:29:18.342813] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-16T20:29:19.041920] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-16T20:29:19.142853] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-16T20:29:19.942828] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-16T20:29:20.189126] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T20:29:20.742880] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-16T20:29:21.542845] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-16T20:29:21.676939] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-16T20:29:22.102620] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-16T20:29:22.134790] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-16T20:29:22.342831] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-16T20:29:23.112560] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-16T20:29:23.142848] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-16T20:29:23.942854] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-16T20:29:24.742783] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-16T20:29:24.824873] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T20:29:25.542864] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-16T20:29:25.892003] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-16T20:29:26.305300] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-16T20:29:26.342780] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-16T20:29:27.142815] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-16T20:29:27.234972] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-16T20:29:27.355103] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T20:29:27.617998] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-16T20:29:27.625031] [INFO ] [REMOTE ] NIO: Full fetch complete (77982 records). [2025-10-16T20:29:27.625166] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-16T20:29:27.947986] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-16T20:29:28.022009] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-10-16T20:29:28.022102] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-10-16T20:29:28.023359] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-10-16T20:29:28.023427] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-10-16T20:29:28.025039] [DEBUG] [LOCAL ] NIO: Trimmed 77982 records to 54192 (keeping 200 days of data) [2025-10-16T20:29:28.341333] [DEBUG] [LOCAL ] NIO: Primary data saved (54192 records). [2025-10-16T20:29:28.341592] [INFO ] [MAIN ] NIO: Full history saved. [2025-10-16T20:29:28.341730] [INFO ] [MAIN ] Update Progress: 1485/2369 symbols completed. NIO took 56.3s. Estimated remaining: 2h 4m 40s. Rate: 7.1 symbols/min [2025-10-16T20:29:28.509481] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:29:28.509695] [DEBUG] [LOCAL ] NLOP: No existing data file found in primary storage. [2025-10-16T20:29:28.509747] [WARN ] [MAIN ] NLOP: No existing data found, performing full refresh instead. [2025-10-16T20:29:28.509889] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-16T20:29:28.509931] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-16T20:29:28.509972] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-16T20:29:28.510017] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-16T20:29:28.748016] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-16T20:29:28.861243] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T20:29:28.866425] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:29:29.542804] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-16T20:29:29.867406] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T20:29:30.342815] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-16T20:29:30.420736] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T20:29:30.427176] [INFO ] [REMOTE ] NKE: Full fetch complete (76827 records). [2025-10-16T20:29:30.427291] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-16T20:29:30.428075] [FATAL] [VALIDATOR ] NKE: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:29:30.428158] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:29:30.428200] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:29:30.428238] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-16T20:29:30.428318] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-16T20:29:30.428378] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-16T20:29:30.428424] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-16T20:29:30.428480] [INFO ] [MAIN ] Update Progress: 1486/2369 symbols completed. NKE took 36.8s. Estimated remaining: 2h 4m 27s. Rate: 7.1 symbols/min [2025-10-16T20:29:30.598142] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:29:30.598319] [DEBUG] [LOCAL ] NLY: No existing data file found in primary storage. [2025-10-16T20:29:30.598375] [WARN ] [MAIN ] NLY: No existing data found, performing full refresh instead. [2025-10-16T20:29:30.598484] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-16T20:29:30.598563] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-16T20:29:30.598627] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-16T20:29:30.598694] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-16T20:29:30.941056] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:29:31.142801] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-10-16T20:29:31.292138] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T20:29:31.942823] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-16T20:29:32.628127] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-16T20:29:32.742798] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-16T20:29:33.213788] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-16T20:29:33.367328] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-16T20:29:33.368992] [INFO ] [REMOTE ] NL: Full fetch complete (6925 records). [2025-10-16T20:29:33.369072] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-16T20:29:33.551037] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-16T20:29:33.558023] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T20:29:33.559296] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:29:33.559370] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:29:33.559442] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-16T20:29:33.559507] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-16T20:29:33.559544] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-16T20:29:33.559582] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-16T20:29:33.559638] [INFO ] [MAIN ] Update Progress: 1487/2369 symbols completed. NL took 22.4s. Estimated remaining: 2h 4m 16s. Rate: 7.1 symbols/min [2025-10-16T20:29:33.726607] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:29:33.740163] [DEBUG] [LOCAL ] NMAI: Loaded 12861 existing records from primary storage. [2025-10-16T20:29:33.740377] [INFO ] [MAIN ] NMAI: Loaded 12861 existing records. [2025-10-16T20:29:33.912243] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:29:33.912444] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-16T20:29:33.912498] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-16T20:29:33.912938] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-10-16T20:29:33.912996] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-16T20:29:34.263908] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:29:34.342815] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-10-16T20:29:34.780949] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T20:29:35.142810] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-10-16T20:29:35.191880] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T20:29:35.942846] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-16T20:29:36.233538] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T20:29:36.742813] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-16T20:29:37.019487] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T20:29:37.542804] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-16T20:29:37.687018] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T20:29:37.689023] [INFO ] [REMOTE ] NKX: Full fetch complete (19173 records). [2025-10-16T20:29:37.689108] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-16T20:29:38.064845] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-10-16T20:29:38.064929] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-10-16T20:29:38.065388] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-10-16T20:29:38.065427] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-10-16T20:29:38.066064] [DEBUG] [LOCAL ] NKX: Trimmed 19173 records to 13736 (keeping 200 days of data) [2025-10-16T20:29:38.149798] [DEBUG] [LOCAL ] NKX: Primary data saved (13736 records). [2025-10-16T20:29:38.149934] [INFO ] [MAIN ] NKX: Full history saved. [2025-10-16T20:29:38.150014] [INFO ] [MAIN ] Update Progress: 1488/2369 symbols completed. NKX took 28.4s. Estimated remaining: 2h 4m 5s. Rate: 7.1 symbols/min [2025-10-16T20:29:38.347908] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:29:38.346108] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-16T20:29:38.349060] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-16T20:29:38.349123] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-16T20:29:38.349257] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-16T20:29:38.349313] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-16T20:29:38.349366] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-16T20:29:38.349411] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-16T20:29:38.734008] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:29:38.735791] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T20:29:39.142789] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-16T20:29:39.321976] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T20:29:39.942837] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-10-16T20:29:40.262291] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:29:40.262694] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-10-16T20:29:40.262768] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:29:40.262818] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-16T20:29:40.262851] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:29:40.262888] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-16T20:29:40.262939] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-16T20:29:40.262973] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-16T20:29:40.263012] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-16T20:29:40.263056] [INFO ] [MAIN ] Update Progress: 1489/2369 symbols completed. NMAX took 2.1s. Estimated remaining: 2h 3m 53s. Rate: 7.1 symbols/min [2025-10-16T20:29:40.433473] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:29:40.433673] [DEBUG] [LOCAL ] NMCO: No existing data file found in primary storage. [2025-10-16T20:29:40.433773] [WARN ] [MAIN ] NMCO: No existing data found, performing full refresh instead. [2025-10-16T20:29:40.433890] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-16T20:29:40.433933] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-16T20:29:40.433975] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-16T20:29:40.434007] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-16T20:29:40.750694] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-16T20:29:40.793849] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:29:41.045464] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-16T20:29:41.542778] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-16T20:29:41.761903] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T20:29:42.342888] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-16T20:29:43.142838] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-16T20:29:43.323057] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T20:29:43.393832] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T20:29:43.942838] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-10-16T20:29:44.137190] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T20:29:44.742861] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-16T20:29:45.375102] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T20:29:45.542838] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-16T20:29:45.882206] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T20:29:46.342750] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-16T20:29:46.588880] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T20:29:47.142797] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-16T20:29:47.294577] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-16T20:29:47.942811] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-16T20:29:48.742793] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-16T20:29:48.970967] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T20:29:49.193976] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-16T20:29:49.542820] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-16T20:29:49.623423] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T20:29:50.342792] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-16T20:29:50.353884] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-16T20:29:51.142808] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-16T20:29:51.326776] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T20:29:51.942845] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-16T20:29:52.334009] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T20:29:52.742826] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-16T20:29:52.877706] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T20:29:53.542775] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-16T20:29:53.615877] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T20:29:54.342835] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-16T20:29:54.653607] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-16T20:29:55.142783] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-16T20:29:55.357569] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T20:29:55.942842] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-16T20:29:56.150791] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T20:29:56.742843] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-16T20:29:56.957286] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T20:29:57.542805] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-16T20:29:57.862505] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T20:29:58.342784] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-16T20:29:58.641013] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T20:29:59.068495] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T20:29:59.142789] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-16T20:29:59.942840] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-16T20:30:00.203399] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T20:30:00.742817] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-16T20:30:00.957501] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T20:30:01.542960] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-16T20:30:02.342872] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-16T20:30:02.625555] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-16T20:30:02.627981] [INFO ] [REMOTE ] NMAI: Full fetch complete (19752 records). [2025-10-16T20:30:02.628072] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-16T20:30:03.035088] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-10-16T20:30:03.035309] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-10-16T20:30:03.035924] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-10-16T20:30:03.036029] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-10-16T20:30:03.037359] [DEBUG] [LOCAL ] NMAI: Trimmed 19752 records to 12951 (keeping 200 days of data) [2025-10-16T20:30:03.132984] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-16T20:30:03.144814] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-16T20:30:03.165187] [DEBUG] [LOCAL ] NMAI: Primary data saved (12951 records). [2025-10-16T20:30:03.165752] [INFO ] [MAIN ] NMAI: Full history saved. [2025-10-16T20:30:03.165846] [INFO ] [MAIN ] Update Progress: 1490/2369 symbols completed. NMAI took 29.6s. Estimated remaining: 2h 3m 53s. Rate: 7.1 symbols/min [2025-10-16T20:30:03.352164] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:30:03.362775] [DEBUG] [LOCAL ] NMG: Loaded 10641 existing records from primary storage. [2025-10-16T20:30:03.362979] [INFO ] [MAIN ] NMG: Loaded 10641 existing records. [2025-10-16T20:30:03.540299] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T20:30:03.563833] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:30:03.565033] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-16T20:30:03.565128] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-16T20:30:03.565492] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-10-16T20:30:03.565555] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-16T20:30:03.923969] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:30:03.939959] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T20:30:03.941663] [INFO ] [REMOTE ] NLOP: Full fetch complete (17711 records). [2025-10-16T20:30:03.941743] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-16T20:30:03.942235] [FATAL] [VALIDATOR ] NLOP: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:30:03.942332] [FATAL] [MAIN ] NLOP: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:30:03.942376] [WARN ] [MAIN ] NLOP: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:30:03.942444] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-16T20:30:03.942507] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-16T20:30:03.942544] [INFO ] [LOCAL ] NLOP: Starting deletion of derivative data. [2025-10-16T20:30:03.942585] [DEBUG] [LOCAL ] NLOP: No derivative data file found to delete. [2025-10-16T20:30:03.942637] [INFO ] [MAIN ] Update Progress: 1491/2369 symbols completed. NLOP took 35.6s. Estimated remaining: 2h 3m 40s. Rate: 7.1 symbols/min [2025-10-16T20:30:03.942872] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-10-16T20:30:04.122495] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:30:04.128432] [DEBUG] [LOCAL ] NMI: Loaded 4054 existing records from primary storage. [2025-10-16T20:30:04.128627] [INFO ] [MAIN ] NMI: Loaded 4054 existing records. [2025-10-16T20:30:04.318636] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:30:04.318872] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-16T20:30:04.318920] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-16T20:30:04.319139] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-10-16T20:30:04.319196] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-16T20:30:04.693612] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:30:04.742769] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-10-16T20:30:04.963136] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T20:30:05.335044] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-16T20:30:05.542861] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-16T20:30:06.342796] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-16T20:30:06.632375] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T20:30:07.142839] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-16T20:30:07.942832] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-16T20:30:08.336728] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T20:30:08.649442] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T20:30:08.725343] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-16T20:30:08.742811] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-16T20:30:09.393562] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-16T20:30:09.395803] [INFO ] [REMOTE ] NMCO: Full fetch complete (23132 records). [2025-10-16T20:30:09.395942] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-16T20:30:09.396465] [FATAL] [VALIDATOR ] NMCO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:30:09.396570] [FATAL] [MAIN ] NMCO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:30:09.396669] [WARN ] [MAIN ] NMCO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:30:09.396767] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-16T20:30:09.396889] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-16T20:30:09.396936] [INFO ] [LOCAL ] NMCO: Starting deletion of derivative data. [2025-10-16T20:30:09.396986] [DEBUG] [LOCAL ] NMCO: No derivative data file found to delete. [2025-10-16T20:30:09.397081] [INFO ] [MAIN ] Update Progress: 1492/2369 symbols completed. NMCO took 29.1s. Estimated remaining: 2h 3m 30s. Rate: 7.1 symbols/min [2025-10-16T20:30:09.547901] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-16T20:30:09.598405] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:30:09.598569] [DEBUG] [LOCAL ] NMM: No existing data file found in primary storage. [2025-10-16T20:30:09.598614] [WARN ] [MAIN ] NMM: No existing data found, performing full refresh instead. [2025-10-16T20:30:09.598742] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-16T20:30:09.598785] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-16T20:30:09.598827] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-16T20:30:09.598860] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-16T20:30:09.969213] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:30:10.342810] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-10-16T20:30:11.142853] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-16T20:30:11.520504] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T20:30:11.600637] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-16T20:30:11.837382] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-16T20:30:11.942814] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-16T20:30:12.523415] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T20:30:12.742820] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-16T20:30:13.542830] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-16T20:30:14.342793] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-16T20:30:14.404335] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-16T20:30:14.980882] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-16T20:30:15.142789] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-16T20:30:15.345829] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T20:30:15.866076] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T20:30:15.942883] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-16T20:30:16.742878] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-16T20:30:17.542810] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-16T20:30:17.787399] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T20:30:17.909571] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T20:30:18.052317] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-16T20:30:18.342844] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-16T20:30:19.142847] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-16T20:30:19.345902] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-16T20:30:19.870823] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T20:30:19.942782] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-16T20:30:20.626507] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-16T20:30:20.742788] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-16T20:30:21.542862] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-16T20:30:21.579019] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-16T20:30:22.342819] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-16T20:30:22.809985] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T20:30:23.137839] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T20:30:23.142756] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-16T20:30:23.911704] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T20:30:23.942772] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-16T20:30:24.631486] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-16T20:30:24.742837] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-16T20:30:25.362096] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-16T20:30:25.363240] [INFO ] [REMOTE ] NMI: Full fetch complete (5760 records). [2025-10-16T20:30:25.363310] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-16T20:30:25.547904] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-16T20:30:25.770576] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-16T20:30:25.770687] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-16T20:30:25.770875] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-16T20:30:25.770916] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-16T20:30:25.771293] [DEBUG] [LOCAL ] NMI: Trimmed 5760 records to 4065 (keeping 200 days of data) [2025-10-16T20:30:25.794875] [DEBUG] [LOCAL ] NMI: Primary data saved (4065 records). [2025-10-16T20:30:25.794955] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-16T20:30:25.795024] [INFO ] [MAIN ] Update Progress: 1493/2369 symbols completed. NMI took 21.9s. Estimated remaining: 2h 3m 26s. Rate: 7.1 symbols/min [2025-10-16T20:30:25.965590] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:30:25.997610] [DEBUG] [LOCAL ] NMR: Loaded 35582 existing records from primary storage. [2025-10-16T20:30:25.997930] [INFO ] [MAIN ] NMR: Loaded 35582 existing records. [2025-10-16T20:30:26.177060] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:30:26.177263] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-16T20:30:26.177309] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-16T20:30:26.177896] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-10-16T20:30:26.177954] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-16T20:30:26.348051] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-16T20:30:26.531763] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:30:26.573021] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T20:30:27.142819] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-16T20:30:27.942810] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-10-16T20:30:28.009616] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T20:30:28.534294] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-16T20:30:28.742811] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-16T20:30:29.509751] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-16T20:30:29.536571] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T20:30:29.536797] [INFO ] [REMOTE ] NLY: Full fetch complete (77312 records). [2025-10-16T20:30:29.543698] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-16T20:30:29.543479] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-16T20:30:29.545424] [FATAL] [VALIDATOR ] NLY: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:30:29.545617] [FATAL] [MAIN ] NLY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:30:29.545702] [WARN ] [MAIN ] NLY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:30:29.545770] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-16T20:30:29.545844] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-16T20:30:29.545898] [INFO ] [LOCAL ] NLY: Starting deletion of derivative data. [2025-10-16T20:30:29.545940] [DEBUG] [LOCAL ] NLY: No derivative data file found to delete. [2025-10-16T20:30:29.545995] [INFO ] [MAIN ] Update Progress: 1494/2369 symbols completed. NLY took 59.1s. Estimated remaining: 2h 3m 15s. Rate: 7.1 symbols/min [2025-10-16T20:30:29.711023] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:30:29.715390] [DEBUG] [LOCAL ] NMS: Loaded 2910 existing records from primary storage. [2025-10-16T20:30:29.715544] [INFO ] [MAIN ] NMS: Loaded 2910 existing records. [2025-10-16T20:30:29.886132] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:30:29.886338] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-16T20:30:29.886385] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-16T20:30:29.886575] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-10-16T20:30:29.886631] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-16T20:30:30.224740] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:30:30.342802] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-10-16T20:30:31.120953] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-16T20:30:31.142773] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T20:30:31.142843] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-16T20:30:31.942809] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-16T20:30:31.973535] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T20:30:32.742802] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-16T20:30:33.420775] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T20:30:33.422767] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T20:30:33.542837] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-16T20:30:34.342879] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-16T20:30:35.054364] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T20:30:35.070750] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-16T20:30:35.142775] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-16T20:30:35.942863] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-16T20:30:35.951244] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T20:30:36.742805] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-16T20:30:37.542801] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-16T20:30:37.625618] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T20:30:37.715142] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T20:30:38.010756] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-16T20:30:38.342818] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-16T20:30:39.142893] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-16T20:30:39.422532] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T20:30:39.698205] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T20:30:39.942822] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-16T20:30:40.742799] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-16T20:30:40.935552] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T20:30:41.307986] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T20:30:41.542830] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-16T20:30:42.342815] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-16T20:30:42.990682] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T20:30:42.995587] [INFO ] [REMOTE ] NMG: Full fetch complete (15344 records). [2025-10-16T20:30:42.995697] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-16T20:30:43.147984] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-16T20:30:43.485683] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-10-16T20:30:43.485847] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-10-16T20:30:43.492100] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-10-16T20:30:43.492191] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-10-16T20:30:43.497526] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-16T20:30:43.497766] [DEBUG] [LOCAL ] NMG: Trimmed 15344 records to 11020 (keeping 200 days of data) [2025-10-16T20:30:43.565218] [DEBUG] [LOCAL ] NMG: Primary data saved (11020 records). [2025-10-16T20:30:43.565361] [INFO ] [MAIN ] NMG: Full history saved. [2025-10-16T20:30:43.565446] [INFO ] [MAIN ] Update Progress: 1495/2369 symbols completed. NMG took 40.4s. Estimated remaining: 2h 3m 9s. Rate: 7.1 symbols/min [2025-10-16T20:30:43.733496] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:30:43.737955] [DEBUG] [LOCAL ] NMT: Loaded 2835 existing records from primary storage. [2025-10-16T20:30:43.738147] [INFO ] [MAIN ] NMT: Loaded 2835 existing records. [2025-10-16T20:30:43.913586] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:30:43.913830] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-16T20:30:43.913880] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-16T20:30:43.914091] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-10-16T20:30:43.914149] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-16T20:30:43.947898] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-16T20:30:44.274198] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:30:44.740747] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-16T20:30:44.750288] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-16T20:30:44.770019] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T20:30:45.542818] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-16T20:30:45.578351] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T20:30:46.342822] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-10-16T20:30:46.965542] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T20:30:47.062603] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-16T20:30:47.142780] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-16T20:30:47.715550] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-16T20:30:47.942779] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-16T20:30:48.569248] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-16T20:30:48.742808] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-16T20:30:49.357289] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T20:30:49.542800] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-16T20:30:50.097625] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-16T20:30:50.099733] [INFO ] [REMOTE ] NMM: Full fetch complete (21606 records). [2025-10-16T20:30:50.099827] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-16T20:30:50.100490] [FATAL] [VALIDATOR ] NMM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:30:50.100579] [FATAL] [MAIN ] NMM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:30:50.100621] [WARN ] [MAIN ] NMM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:30:50.100699] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-16T20:30:50.100765] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-16T20:30:50.100799] [INFO ] [LOCAL ] NMM: Starting deletion of derivative data. [2025-10-16T20:30:50.100837] [DEBUG] [LOCAL ] NMM: No derivative data file found to delete. [2025-10-16T20:30:50.100889] [INFO ] [MAIN ] Update Progress: 1496/2369 symbols completed. NMM took 40.7s. Estimated remaining: 2h 2m 60s. Rate: 7.1 symbols/min [2025-10-16T20:30:50.270339] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:30:50.270602] [DEBUG] [LOCAL ] NMZ: No existing data file found in primary storage. [2025-10-16T20:30:50.270680] [WARN ] [MAIN ] NMZ: No existing data found, performing full refresh instead. [2025-10-16T20:30:50.270804] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-16T20:30:50.270859] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-16T20:30:50.270904] [DEBUG] [LOCAL ] NMZ: No primary data file found to delete. [2025-10-16T20:30:50.270937] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-16T20:30:50.347890] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-16T20:30:50.626417] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:30:51.080113] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T20:30:51.142820] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-16T20:30:51.942829] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-16T20:30:52.659500] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-16T20:30:52.682378] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T20:30:52.742833] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-10-16T20:30:53.542847] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-16T20:30:53.972579] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T20:30:54.030020] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-16T20:30:54.342845] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-16T20:30:54.899102] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-16T20:30:55.142827] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-16T20:30:55.942864] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-16T20:30:56.653383] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-16T20:30:56.683903] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T20:30:56.742772] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-16T20:30:57.542860] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-16T20:30:58.327827] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T20:30:58.342772] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-16T20:30:58.796880] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T20:30:59.142865] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-16T20:30:59.784547] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T20:30:59.789746] [INFO ] [REMOTE ] NMR: Full fetch complete (51234 records). [2025-10-16T20:30:59.789874] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-16T20:30:59.951182] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-16T20:31:00.187909] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-10-16T20:31:00.188111] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-10-16T20:31:00.189176] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-10-16T20:31:00.189284] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-10-16T20:31:00.190486] [DEBUG] [LOCAL ] NMR: Trimmed 51234 records to 35856 (keeping 200 days of data) [2025-10-16T20:31:00.289119] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T20:31:00.408360] [DEBUG] [LOCAL ] NMR: Primary data saved (35856 records). [2025-10-16T20:31:00.408525] [INFO ] [MAIN ] NMR: Full history saved. [2025-10-16T20:31:00.408616] [INFO ] [MAIN ] Update Progress: 1497/2369 symbols completed. NMR took 34.6s. Estimated remaining: 2h 2m 53s. Rate: 7.1 symbols/min [2025-10-16T20:31:00.572364] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:31:00.583550] [DEBUG] [LOCAL ] NNI: Loaded 10444 existing records from primary storage. [2025-10-16T20:31:00.584621] [INFO ] [MAIN ] NNI: Loaded 10444 existing records. [2025-10-16T20:31:00.652004] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-16T20:31:00.749821] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-16T20:31:00.772398] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:31:00.772727] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-16T20:31:00.772793] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-16T20:31:00.773111] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-10-16T20:31:00.773167] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-16T20:31:01.116854] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:31:01.542832] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-16T20:31:01.602619] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-16T20:31:02.342848] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-16T20:31:02.690395] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T20:31:02.947304] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-16T20:31:02.948298] [INFO ] [REMOTE ] NMS: Full fetch complete (4074 records). [2025-10-16T20:31:02.948389] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-16T20:31:03.143677] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-16T20:31:03.348325] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-16T20:31:03.348407] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-16T20:31:03.348550] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-16T20:31:03.348587] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-16T20:31:03.348959] [DEBUG] [LOCAL ] NMS: Trimmed 4074 records to 2924 (keeping 200 days of data) [2025-10-16T20:31:03.366391] [DEBUG] [LOCAL ] NMS: Primary data saved (2924 records). [2025-10-16T20:31:03.366456] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-16T20:31:03.366525] [INFO ] [MAIN ] Update Progress: 1498/2369 symbols completed. NMS took 33.8s. Estimated remaining: 2h 2m 41s. Rate: 7.1 symbols/min [2025-10-16T20:31:03.529665] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:31:03.529857] [DEBUG] [LOCAL ] NNN: No existing data file found in primary storage. [2025-10-16T20:31:03.529895] [WARN ] [MAIN ] NNN: No existing data found, performing full refresh instead. [2025-10-16T20:31:03.530006] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-16T20:31:03.530047] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-16T20:31:03.530086] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-16T20:31:03.530118] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-16T20:31:03.922022] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:31:03.942779] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-10-16T20:31:04.661143] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T20:31:04.742845] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-16T20:31:05.542777] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-16T20:31:05.793336] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T20:31:05.939748] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-16T20:31:05.999846] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T20:31:06.342811] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-16T20:31:07.142879] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-16T20:31:07.804308] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-16T20:31:07.942870] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-16T20:31:08.256386] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-16T20:31:08.560598] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T20:31:08.742874] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-10-16T20:31:09.542811] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-16T20:31:09.626233] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-16T20:31:10.139451] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-16T20:31:10.140325] [INFO ] [REMOTE ] NMT: Full fetch complete (3951 records). [2025-10-16T20:31:10.140393] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-16T20:31:10.348020] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-16T20:31:10.491381] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-16T20:31:10.491477] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-16T20:31:10.491622] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-16T20:31:10.491694] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-16T20:31:10.492041] [DEBUG] [LOCAL ] NMT: Trimmed 3951 records to 2854 (keeping 200 days of data) [2025-10-16T20:31:10.509148] [DEBUG] [LOCAL ] NMT: Primary data saved (2854 records). [2025-10-16T20:31:10.509212] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-16T20:31:10.509280] [INFO ] [MAIN ] Update Progress: 1499/2369 symbols completed. NMT took 26.9s. Estimated remaining: 2h 2m 32s. Rate: 7.1 symbols/min [2025-10-16T20:31:10.672676] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:31:10.679352] [DEBUG] [LOCAL ] NNY: Loaded 5659 existing records from primary storage. [2025-10-16T20:31:10.679527] [INFO ] [MAIN ] NNY: Loaded 5659 existing records. [2025-10-16T20:31:10.853619] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:31:10.853844] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-16T20:31:10.853891] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-16T20:31:10.854175] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-10-16T20:31:10.854233] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-16T20:31:11.148084] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-16T20:31:11.203334] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:31:11.632985] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T20:31:11.942811] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-16T20:31:12.742784] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-16T20:31:12.793079] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T20:31:13.005771] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-16T20:31:13.542806] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-16T20:31:13.924451] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-16T20:31:14.342870] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-10-16T20:31:15.142781] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-16T20:31:15.247341] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T20:31:15.403900] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-16T20:31:15.942879] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-16T20:31:16.279623] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T20:31:16.742874] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-16T20:31:17.476240] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-16T20:31:17.542823] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-16T20:31:18.035760] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-16T20:31:18.273888] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T20:31:18.342832] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-16T20:31:19.142804] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-16T20:31:19.291223] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T20:31:19.942784] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-16T20:31:20.306876] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T20:31:20.742803] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-16T20:31:20.802256] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-16T20:31:21.483758] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T20:31:21.487299] [INFO ] [REMOTE ] NMZ: Full fetch complete (31164 records). [2025-10-16T20:31:21.487396] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-16T20:31:21.487982] [FATAL] [VALIDATOR ] NMZ: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:31:21.488083] [FATAL] [MAIN ] NMZ: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:31:21.488138] [WARN ] [MAIN ] NMZ: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:31:21.488216] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-16T20:31:21.488330] [DEBUG] [LOCAL ] NMZ: No primary data file found to delete. [2025-10-16T20:31:21.488392] [INFO ] [LOCAL ] NMZ: Starting deletion of derivative data. [2025-10-16T20:31:21.488452] [DEBUG] [LOCAL ] NMZ: No derivative data file found to delete. [2025-10-16T20:31:21.488524] [INFO ] [MAIN ] Update Progress: 1500/2369 symbols completed. NMZ took 31.4s. Estimated remaining: 2h 2m 25s. Rate: 7.1 symbols/min [2025-10-16T20:31:21.551069] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-16T20:31:21.688407] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:31:21.688616] [DEBUG] [LOCAL ] NOA: No existing data file found in primary storage. [2025-10-16T20:31:21.688711] [WARN ] [MAIN ] NOA: No existing data found, performing full refresh instead. [2025-10-16T20:31:21.688849] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-16T20:31:21.688919] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-16T20:31:21.689021] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-16T20:31:21.689082] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-16T20:31:22.050434] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:31:22.294111] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T20:31:22.342829] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-16T20:31:23.142815] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-16T20:31:23.206472] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T20:31:23.942832] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-16T20:31:24.673352] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T20:31:24.742798] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-16T20:31:24.970280] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T20:31:25.542784] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-16T20:31:25.686260] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T20:31:26.133774] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-16T20:31:26.342810] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-16T20:31:27.142793] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-10-16T20:31:27.210446] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-16T20:31:27.942808] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-16T20:31:28.007077] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-16T20:31:28.712556] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T20:31:28.742857] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-16T20:31:29.542836] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-16T20:31:30.342806] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-16T20:31:30.470555] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T20:31:30.513849] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T20:31:30.914850] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T20:31:31.142824] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-16T20:31:31.750612] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-16T20:31:31.752283] [INFO ] [REMOTE ] NNY: Full fetch complete (8350 records). [2025-10-16T20:31:31.752374] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-16T20:31:31.948193] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-16T20:31:32.119039] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-16T20:31:32.119114] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-16T20:31:32.119342] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-16T20:31:32.119382] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-16T20:31:32.119854] [DEBUG] [LOCAL ] NNY: Trimmed 8350 records to 5723 (keeping 200 days of data) [2025-10-16T20:31:32.154744] [DEBUG] [LOCAL ] NNY: Primary data saved (5723 records). [2025-10-16T20:31:32.154876] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-16T20:31:32.154955] [INFO ] [MAIN ] Update Progress: 1501/2369 symbols completed. NNY took 21.6s. Estimated remaining: 2h 2m 18s. Rate: 7.1 symbols/min [2025-10-16T20:31:32.323595] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:31:32.323781] [DEBUG] [LOCAL ] NOAH: No existing data file found in primary storage. [2025-10-16T20:31:32.323825] [WARN ] [MAIN ] NOAH: No existing data found, performing full refresh instead. [2025-10-16T20:31:32.323938] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-16T20:31:32.323981] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-16T20:31:32.324025] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-16T20:31:32.324059] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-16T20:31:32.677148] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:31:32.742787] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-16T20:31:32.963799] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T20:31:33.542814] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-10-16T20:31:33.676575] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T20:31:34.342806] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-16T20:31:34.876983] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T20:31:35.142780] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-16T20:31:35.528105] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T20:31:35.942864] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-16T20:31:36.742844] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-16T20:31:36.964011] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T20:31:37.010607] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-16T20:31:37.542793] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-16T20:31:37.685310] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-16T20:31:38.342867] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-16T20:31:38.614155] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T20:31:39.142900] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-16T20:31:39.942866] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-16T20:31:39.991617] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T20:31:40.104955] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T20:31:40.742827] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-16T20:31:41.089875] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T20:31:41.542873] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-16T20:31:42.343159] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-16T20:31:42.408600] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-16T20:31:42.493936] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T20:31:43.142775] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-16T20:31:43.206403] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T20:31:43.942895] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-16T20:31:43.972983] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T20:31:43.978669] [INFO ] [REMOTE ] NNN: Full fetch complete (70013 records). [2025-10-16T20:31:43.978797] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-16T20:31:43.979606] [FATAL] [VALIDATOR ] NNN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:31:43.979748] [FATAL] [MAIN ] NNN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:31:43.979816] [WARN ] [MAIN ] NNN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:31:43.979889] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-16T20:31:43.979953] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-16T20:31:43.979998] [INFO ] [LOCAL ] NNN: Starting deletion of derivative data. [2025-10-16T20:31:43.980064] [DEBUG] [LOCAL ] NNN: No derivative data file found to delete. [2025-10-16T20:31:43.980132] [INFO ] [MAIN ] Update Progress: 1502/2369 symbols completed. NNN took 40.6s. Estimated remaining: 2h 2m 11s. Rate: 7.1 symbols/min [2025-10-16T20:31:44.153062] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:31:44.153231] [DEBUG] [LOCAL ] NOC: No existing data file found in primary storage. [2025-10-16T20:31:44.153267] [WARN ] [MAIN ] NOC: No existing data found, performing full refresh instead. [2025-10-16T20:31:44.153384] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-16T20:31:44.153426] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-16T20:31:44.153494] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-16T20:31:44.153529] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-16T20:31:44.497922] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:31:44.742785] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-10-16T20:31:44.835883] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-16T20:31:45.542843] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-16T20:31:46.342803] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-16T20:31:46.434158] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T20:31:46.529774] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T20:31:47.142843] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-16T20:31:47.355680] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T20:31:47.942859] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-16T20:31:48.518937] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T20:31:48.710471] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-16T20:31:48.712091] [INFO ] [REMOTE ] NNI: Full fetch complete (12995 records). [2025-10-16T20:31:48.712159] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-16T20:31:48.748031] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-16T20:31:49.077610] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-10-16T20:31:49.077709] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-10-16T20:31:49.078004] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-10-16T20:31:49.078055] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-10-16T20:31:49.078563] [DEBUG] [LOCAL ] NNI: Trimmed 12995 records to 10533 (keeping 200 days of data) [2025-10-16T20:31:49.141429] [DEBUG] [LOCAL ] NNI: Primary data saved (10533 records). [2025-10-16T20:31:49.141545] [INFO ] [MAIN ] NNI: Full history saved. [2025-10-16T20:31:49.141636] [INFO ] [MAIN ] Update Progress: 1503/2369 symbols completed. NNI took 48.7s. Estimated remaining: 2h 2m 1s. Rate: 7.1 symbols/min [2025-10-16T20:31:49.335014] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:31:49.335175] [DEBUG] [LOCAL ] NOG: No existing data file found in primary storage. [2025-10-16T20:31:49.335212] [WARN ] [MAIN ] NOG: No existing data found, performing full refresh instead. [2025-10-16T20:31:49.335353] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-16T20:31:49.335429] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-16T20:31:49.335497] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-16T20:31:49.335533] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-16T20:31:49.551063] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-16T20:31:49.687081] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:31:50.342853] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-16T20:31:50.558849] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T20:31:50.858184] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T20:31:51.142789] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-16T20:31:51.687186] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T20:31:51.942826] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-16T20:31:51.950559] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T20:31:51.953252] [INFO ] [REMOTE ] NOA: Full fetch complete (22419 records). [2025-10-16T20:31:51.953325] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-16T20:31:51.953857] [FATAL] [VALIDATOR ] NOA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:31:51.953930] [FATAL] [MAIN ] NOA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:31:51.953992] [WARN ] [MAIN ] NOA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:31:51.954059] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-16T20:31:51.954118] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-16T20:31:51.954153] [INFO ] [LOCAL ] NOA: Starting deletion of derivative data. [2025-10-16T20:31:51.954191] [DEBUG] [LOCAL ] NOA: No derivative data file found to delete. [2025-10-16T20:31:51.954243] [INFO ] [MAIN ] Update Progress: 1504/2369 symbols completed. NOA took 30.5s. Estimated remaining: 2h 1m 49s. Rate: 7.1 symbols/min [2025-10-16T20:31:52.126054] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:31:52.173148] [DEBUG] [LOCAL ] NOK: Loaded 53622 existing records from primary storage. [2025-10-16T20:31:52.173492] [INFO ] [MAIN ] NOK: Loaded 53622 existing records. [2025-10-16T20:31:52.349918] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:31:52.350188] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-16T20:31:52.350251] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-16T20:31:52.351136] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-10-16T20:31:52.351194] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-16T20:31:52.698460] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:31:52.742780] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-10-16T20:31:53.397032] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-16T20:31:53.542847] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-16T20:31:54.342837] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-10-16T20:31:54.965377] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-16T20:31:55.142796] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-16T20:31:55.313890] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T20:31:55.942816] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-16T20:31:56.150436] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T20:31:56.742806] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-16T20:31:57.066191] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-16T20:31:57.542784] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-16T20:31:57.683328] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T20:31:58.342843] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-16T20:31:58.586439] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-16T20:31:59.036329] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T20:31:59.142855] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-16T20:31:59.729803] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-16T20:31:59.942848] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-16T20:32:00.335989] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T20:32:00.742829] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-16T20:32:01.542857] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-16T20:32:01.796887] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-16T20:32:01.986428] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-16T20:32:02.342816] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-16T20:32:03.142799] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-16T20:32:03.315221] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T20:32:03.360396] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-16T20:32:03.942835] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-16T20:32:04.742835] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-16T20:32:05.164687] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-16T20:32:05.542874] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-16T20:32:06.336911] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-16T20:32:06.347565] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-16T20:32:06.709782] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-16T20:32:06.828339] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T20:32:07.142904] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-16T20:32:07.942821] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-16T20:32:08.256824] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-16T20:32:08.747936] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-16T20:32:08.769748] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T20:32:09.478349] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T20:32:09.481053] [INFO ] [REMOTE ] NOAH: Full fetch complete (27604 records). [2025-10-16T20:32:09.481146] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-16T20:32:09.481738] [FATAL] [VALIDATOR ] NOAH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:32:09.481827] [FATAL] [MAIN ] NOAH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:32:09.481868] [WARN ] [MAIN ] NOAH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:32:09.481906] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-16T20:32:09.481961] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-16T20:32:09.481994] [INFO ] [LOCAL ] NOAH: Starting deletion of derivative data. [2025-10-16T20:32:09.482031] [DEBUG] [LOCAL ] NOAH: No derivative data file found to delete. [2025-10-16T20:32:09.482084] [INFO ] [MAIN ] Update Progress: 1505/2369 symbols completed. NOAH took 37.3s. Estimated remaining: 2h 1m 46s. Rate: 7.1 symbols/min [2025-10-16T20:32:09.551665] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-16T20:32:09.665892] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:32:09.666124] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-16T20:32:09.666174] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-16T20:32:09.666433] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-16T20:32:09.666537] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-16T20:32:09.666693] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-16T20:32:09.666756] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-16T20:32:10.089361] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:32:10.083193] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-16T20:32:10.342806] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-16T20:32:11.142843] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-16T20:32:11.522254] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T20:32:11.942852] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-16T20:32:12.446517] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-16T20:32:12.705037] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T20:32:12.742771] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-16T20:32:13.343512] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T20:32:13.542795] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-16T20:32:14.342803] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-10-16T20:32:14.922750] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-16T20:32:15.142777] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-16T20:32:15.421346] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-16T20:32:15.461226] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T20:32:15.942826] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-16T20:32:16.742878] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-16T20:32:17.159028] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T20:32:17.174054] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-16T20:32:17.542822] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-16T20:32:18.167437] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-16T20:32:18.342831] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-16T20:32:19.142830] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-16T20:32:19.466853] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-16T20:32:19.582902] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T20:32:19.942846] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-16T20:32:20.581624] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-16T20:32:20.689250] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-16T20:32:20.742830] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-16T20:32:21.542839] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-16T20:32:22.101789] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-16T20:32:22.342836] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-16T20:32:22.876187] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-16T20:32:22.901403] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-16T20:32:22.908589] [INFO ] [REMOTE ] NOK: Full fetch complete (77769 records). [2025-10-16T20:32:22.908785] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-16T20:32:23.147937] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-16T20:32:23.308633] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-10-16T20:32:23.308750] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-10-16T20:32:23.309877] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-10-16T20:32:23.309942] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-10-16T20:32:23.311447] [DEBUG] [LOCAL ] NOK: Trimmed 77769 records to 54012 (keeping 200 days of data) [2025-10-16T20:32:23.626171] [DEBUG] [LOCAL ] NOK: Primary data saved (54012 records). [2025-10-16T20:32:23.626319] [INFO ] [MAIN ] NOK: Full history saved. [2025-10-16T20:32:23.626401] [INFO ] [MAIN ] Update Progress: 1506/2369 symbols completed. NOK took 31.7s. Estimated remaining: 2h 1m 41s. Rate: 7.1 symbols/min [2025-10-16T20:32:23.809931] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:32:23.810093] [DEBUG] [LOCAL ] NOMD: No existing data file found in primary storage. [2025-10-16T20:32:23.810131] [WARN ] [MAIN ] NOMD: No existing data found, performing full refresh instead. [2025-10-16T20:32:23.810247] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-16T20:32:23.810287] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-16T20:32:23.810328] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-16T20:32:23.810362] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-16T20:32:23.953604] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-16T20:32:24.188726] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:32:24.742865] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-16T20:32:24.953707] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T20:32:25.231372] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-16T20:32:25.542810] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-16T20:32:26.055986] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-16T20:32:26.069744] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-16T20:32:26.342848] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-16T20:32:27.142839] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-16T20:32:27.942810] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-16T20:32:27.970804] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T20:32:27.977131] [INFO ] [REMOTE ] NOG: Full fetch complete (73854 records). [2025-10-16T20:32:27.977248] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-16T20:32:27.978055] [FATAL] [VALIDATOR ] NOG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:32:27.978160] [FATAL] [MAIN ] NOG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:32:27.978230] [WARN ] [MAIN ] NOG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:32:27.978330] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-16T20:32:27.978396] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-16T20:32:27.978432] [INFO ] [LOCAL ] NOG: Starting deletion of derivative data. [2025-10-16T20:32:27.978474] [DEBUG] [LOCAL ] NOG: No derivative data file found to delete. [2025-10-16T20:32:27.978530] [INFO ] [MAIN ] Update Progress: 1507/2369 symbols completed. NOG took 38.8s. Estimated remaining: 2h 1m 30s. Rate: 7.1 symbols/min [2025-10-16T20:32:28.150562] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:32:28.172872] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T20:32:28.211663] [DEBUG] [LOCAL ] NOTE: Loaded 40429 existing records from primary storage. [2025-10-16T20:32:28.211945] [INFO ] [MAIN ] NOTE: Loaded 40429 existing records. [2025-10-16T20:32:28.387364] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-16T20:32:28.393363] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:32:28.394697] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-16T20:32:28.394757] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-16T20:32:28.395391] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-10-16T20:32:28.395453] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-16T20:32:28.749306] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:32:28.746214] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-16T20:32:29.302332] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-16T20:32:29.542808] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-16T20:32:30.291322] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T20:32:30.295932] [INFO ] [REMOTE ] NOC: Full fetch complete (61562 records). [2025-10-16T20:32:30.296054] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-16T20:32:30.296803] [FATAL] [VALIDATOR ] NOC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:32:30.296892] [FATAL] [MAIN ] NOC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:32:30.296935] [WARN ] [MAIN ] NOC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:32:30.297000] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-16T20:32:30.297064] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-16T20:32:30.297100] [INFO ] [LOCAL ] NOC: Starting deletion of derivative data. [2025-10-16T20:32:30.297139] [DEBUG] [LOCAL ] NOC: No derivative data file found to delete. [2025-10-16T20:32:30.297194] [INFO ] [MAIN ] Update Progress: 1508/2369 symbols completed. NOC took 46.3s. Estimated remaining: 2h 1m 18s. Rate: 7.1 symbols/min [2025-10-16T20:32:30.349285] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-10-16T20:32:30.470529] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:32:30.470750] [DEBUG] [LOCAL ] NOV: No existing data file found in primary storage. [2025-10-16T20:32:30.470798] [WARN ] [MAIN ] NOV: No existing data found, performing full refresh instead. [2025-10-16T20:32:30.470909] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-16T20:32:30.470951] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-16T20:32:30.470992] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-16T20:32:30.471025] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-16T20:32:30.817514] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:32:31.142804] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-10-16T20:32:31.942815] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-10-16T20:32:32.010275] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T20:32:32.742783] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-16T20:32:33.150831] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-16T20:32:33.542816] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-16T20:32:34.019997] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-16T20:32:34.021692] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-16T20:32:34.022467] [INFO ] [REMOTE ] NOM: Full fetch complete (1556 records). [2025-10-16T20:32:34.031552] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-16T20:32:34.219023] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-16T20:32:34.219365] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:32:34.219454] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:32:34.219689] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-16T20:32:34.219793] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-16T20:32:34.219864] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-16T20:32:34.219933] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-16T20:32:34.220057] [INFO ] [MAIN ] Update Progress: 1509/2369 symbols completed. NOM took 24.7s. Estimated remaining: 2h 1m 7s. Rate: 7.1 symbols/min [2025-10-16T20:32:34.344737] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-16T20:32:34.350616] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T20:32:34.430530] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:32:34.430716] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-10-16T20:32:34.430764] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-10-16T20:32:34.430897] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-16T20:32:34.430955] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-16T20:32:34.431002] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-16T20:32:34.431035] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-16T20:32:34.775749] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:32:35.142868] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-10-16T20:32:35.942913] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-16T20:32:36.351286] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T20:32:36.742794] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-16T20:32:37.263346] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-16T20:32:37.478949] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T20:32:37.542818] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-16T20:32:38.342860] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-16T20:32:38.751974] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-16T20:32:39.142844] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-16T20:32:39.294160] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-16T20:32:39.353687] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T20:32:39.942837] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-16T20:32:40.742865] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-16T20:32:41.095119] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T20:32:41.542826] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-16T20:32:42.258930] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-16T20:32:42.342779] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-16T20:32:42.583925] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T20:32:43.142872] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-16T20:32:43.178826] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T20:32:43.942905] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-16T20:32:44.521795] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-16T20:32:44.742804] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-16T20:32:45.041593] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T20:32:45.354183] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T20:32:45.542873] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-16T20:32:46.342845] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-16T20:32:46.519822] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T20:32:47.142792] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-16T20:32:47.517079] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T20:32:47.942848] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-16T20:32:48.714372] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-16T20:32:48.742765] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-16T20:32:48.784185] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T20:32:49.542808] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-16T20:32:49.743940] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-16T20:32:50.342816] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-16T20:32:50.707501] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T20:32:51.142842] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-16T20:32:51.369204] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T20:32:51.908712] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T20:32:51.942771] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-16T20:32:52.742883] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-16T20:32:53.246431] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-16T20:32:53.547930] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-16T20:32:53.564475] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T20:32:54.342837] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-16T20:32:54.469183] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T20:32:55.142829] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-16T20:32:55.555141] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-16T20:32:55.880924] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T20:32:55.942833] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-16T20:32:56.742837] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-16T20:32:57.127430] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T20:32:57.542818] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-16T20:32:58.036832] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T20:32:58.231725] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-16T20:32:58.342812] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-16T20:32:59.142815] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-16T20:32:59.190879] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T20:32:59.197301] [INFO ] [REMOTE ] NOMD: Full fetch complete (60024 records). [2025-10-16T20:32:59.197468] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-16T20:32:59.198164] [FATAL] [VALIDATOR ] NOMD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:32:59.198253] [FATAL] [MAIN ] NOMD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:32:59.198328] [WARN ] [MAIN ] NOMD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:32:59.198397] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-16T20:32:59.198461] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-16T20:32:59.198496] [INFO ] [LOCAL ] NOMD: Starting deletion of derivative data. [2025-10-16T20:32:59.198534] [DEBUG] [LOCAL ] NOMD: No derivative data file found to delete. [2025-10-16T20:32:59.198599] [INFO ] [MAIN ] Update Progress: 1510/2369 symbols completed. NOMD took 35.6s. Estimated remaining: 2h 1m 8s. Rate: 7.1 symbols/min [2025-10-16T20:32:59.383660] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:32:59.383913] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-16T20:32:59.383974] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-16T20:32:59.384098] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-16T20:32:59.384242] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-16T20:32:59.384326] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-16T20:32:59.384393] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-16T20:32:59.770262] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-16T20:32:59.775518] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:32:59.942806] [INFO ] [REMOTE ] NP: Fetching primary data for 2024-12. [2025-10-16T20:33:00.235844] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:33:00.236164] [WARN ] [REMOTE ] NP: No data returned for month 2024-12 [2025-10-16T20:33:00.236269] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:33:00.236327] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-16T20:33:00.236370] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:33:00.236436] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-16T20:33:00.236500] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-16T20:33:00.236536] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-16T20:33:00.236576] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-16T20:33:00.236621] [INFO ] [MAIN ] Update Progress: 1511/2369 symbols completed. NP took 1.0s. Estimated remaining: 2h 0m 55s. Rate: 7.1 symbols/min [2025-10-16T20:33:00.403149] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:33:00.403346] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-16T20:33:00.403391] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-16T20:33:00.403518] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-16T20:33:00.403558] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-16T20:33:00.403598] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-16T20:33:00.403628] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-16T20:33:00.748012] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-16T20:33:00.786183] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:33:01.542837] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-16T20:33:01.577820] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-16T20:33:02.342835] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-10-16T20:33:02.558430] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T20:33:02.686472] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:33:02.686813] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-10-16T20:33:02.686899] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:33:02.686971] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-16T20:33:02.687036] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:33:02.687107] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-16T20:33:02.687171] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-16T20:33:02.687206] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-16T20:33:02.687245] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-16T20:33:02.687290] [INFO ] [MAIN ] Update Progress: 1512/2369 symbols completed. NPB took 2.5s. Estimated remaining: 2h 0m 43s. Rate: 7.1 symbols/min [2025-10-16T20:33:02.855830] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:33:02.856000] [DEBUG] [LOCAL ] NPCT: No existing data file found in primary storage. [2025-10-16T20:33:02.856037] [WARN ] [MAIN ] NPCT: No existing data found, performing full refresh instead. [2025-10-16T20:33:02.856158] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-16T20:33:02.856198] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-16T20:33:02.856238] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-16T20:33:02.856270] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-16T20:33:03.147966] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-16T20:33:03.206211] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:33:03.565425] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-16T20:33:03.942786] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-16T20:33:04.742848] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-16T20:33:05.043269] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-16T20:33:05.542851] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-16T20:33:05.665010] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T20:33:05.671380] [INFO ] [REMOTE ] NOV: Full fetch complete (76774 records). [2025-10-16T20:33:05.671491] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-16T20:33:05.672409] [FATAL] [VALIDATOR ] NOV: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:33:05.672620] [FATAL] [MAIN ] NOV: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:33:05.672720] [WARN ] [MAIN ] NOV: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:33:05.672797] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-16T20:33:05.672863] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-16T20:33:05.672906] [INFO ] [LOCAL ] NOV: Starting deletion of derivative data. [2025-10-16T20:33:05.672944] [DEBUG] [LOCAL ] NOV: No derivative data file found to delete. [2025-10-16T20:33:05.673002] [INFO ] [MAIN ] Update Progress: 1513/2369 symbols completed. NOV took 35.4s. Estimated remaining: 2h 0m 32s. Rate: 7.1 symbols/min [2025-10-16T20:33:05.850975] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:33:05.878755] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-16T20:33:05.895321] [DEBUG] [LOCAL ] NPFD: Loaded 10070 existing records from primary storage. [2025-10-16T20:33:05.895552] [INFO ] [MAIN ] NPFD: Loaded 10070 existing records. [2025-10-16T20:33:06.074895] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:33:06.075200] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-16T20:33:06.075263] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-16T20:33:06.075405] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-10-16T20:33:06.075449] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-16T20:33:06.200456] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T20:33:06.252281] [INFO ] [REMOTE ] NOW: Full fetch complete (70437 records). [2025-10-16T20:33:06.268576] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-16T20:33:06.315426] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:33:06.347528] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-16T20:33:06.354491] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:33:06.366070] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:33:06.377095] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-16T20:33:06.377566] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-16T20:33:06.377617] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-10-16T20:33:06.378009] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-10-16T20:33:06.393771] [INFO ] [MAIN ] Update Progress: 1514/2369 symbols completed. NOW took 32.2s. Estimated remaining: 2h 0m 19s. Rate: 7.1 symbols/min [2025-10-16T20:33:06.552269] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:33:06.630007] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:33:06.640620] [DEBUG] [LOCAL ] NPK: Loaded 8408 existing records from primary storage. [2025-10-16T20:33:06.640863] [INFO ] [MAIN ] NPK: Loaded 8408 existing records. [2025-10-16T20:33:06.813882] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:33:06.814074] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-16T20:33:06.814118] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-16T20:33:06.814281] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-10-16T20:33:06.814348] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-16T20:33:07.145127] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-10-16T20:33:07.169677] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:33:07.809522] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T20:33:07.942781] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-10-16T20:33:08.373793] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T20:33:08.742814] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-16T20:33:08.996501] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-16T20:33:09.542915] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-10-16T20:33:10.022211] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T20:33:10.026518] [INFO ] [REMOTE ] NOTE: Full fetch complete (61940 records). [2025-10-16T20:33:10.026708] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-16T20:33:10.347944] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-16T20:33:10.440706] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-10-16T20:33:10.446723] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-10-16T20:33:10.448469] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-10-16T20:33:10.448869] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-10-16T20:33:10.448782] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-16T20:33:10.452342] [DEBUG] [LOCAL ] NOTE: Trimmed 61940 records to 40633 (keeping 200 days of data) [2025-10-16T20:33:10.686900] [DEBUG] [LOCAL ] NOTE: Primary data saved (40633 records). [2025-10-16T20:33:10.687024] [INFO ] [MAIN ] NOTE: Full history saved. [2025-10-16T20:33:10.687100] [INFO ] [MAIN ] Update Progress: 1515/2369 symbols completed. NOTE took 42.7s. Estimated remaining: 2h 0m 8s. Rate: 7.1 symbols/min [2025-10-16T20:33:10.854127] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:33:10.854290] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-10-16T20:33:10.854327] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-10-16T20:33:10.854439] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-16T20:33:10.854480] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-16T20:33:10.854520] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-16T20:33:10.854552] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-16T20:33:11.148023] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-16T20:33:11.205422] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:33:11.641984] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T20:33:11.942792] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-10-16T20:33:12.137273] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T20:33:12.742832] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-16T20:33:12.789063] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T20:33:13.542800] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-16T20:33:13.610001] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T20:33:14.342825] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-16T20:33:14.484433] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T20:33:15.142792] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-16T20:33:15.379871] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T20:33:15.942821] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-16T20:33:15.999824] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T20:33:16.747911] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-16T20:33:16.756596] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-16T20:33:17.542807] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-16T20:33:18.085413] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T20:33:18.342821] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-16T20:33:18.714422] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T20:33:19.142871] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-16T20:33:19.252716] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T20:33:19.942815] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-16T20:33:20.602285] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T20:33:20.742873] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-16T20:33:20.770101] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T20:33:21.542831] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-16T20:33:21.611043] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T20:33:22.342818] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-16T20:33:23.096465] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T20:33:23.142897] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-16T20:33:23.182550] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T20:33:23.942852] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-16T20:33:24.742859] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-16T20:33:24.805068] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T20:33:25.112916] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T20:33:25.542825] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-16T20:33:25.689422] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T20:33:26.342849] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-16T20:33:26.705865] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-16T20:33:26.864607] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-16T20:33:27.142850] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-16T20:33:27.942864] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-16T20:33:28.742790] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-16T20:33:28.801143] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-16T20:33:28.854594] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-16T20:33:29.542802] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-16T20:33:29.606307] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T20:33:30.342811] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-16T20:33:30.503417] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T20:33:31.094936] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-16T20:33:31.142776] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-16T20:33:31.942782] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-16T20:33:32.087553] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-16T20:33:32.742830] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-16T20:33:33.063530] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T20:33:33.542855] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-16T20:33:33.813114] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T20:33:34.342876] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-16T20:33:34.420451] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T20:33:34.422423] [INFO ] [REMOTE ] NPFD: Full fetch complete (14647 records). [2025-10-16T20:33:34.422515] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-16T20:33:34.793455] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-10-16T20:33:34.793546] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-10-16T20:33:34.793977] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-10-16T20:33:34.794056] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-10-16T20:33:34.794561] [DEBUG] [LOCAL ] NPFD: Trimmed 14647 records to 10130 (keeping 200 days of data) [2025-10-16T20:33:34.854788] [DEBUG] [LOCAL ] NPFD: Primary data saved (10130 records). [2025-10-16T20:33:34.854915] [INFO ] [MAIN ] NPFD: Full history saved. [2025-10-16T20:33:34.854995] [INFO ] [MAIN ] Update Progress: 1516/2369 symbols completed. NPFD took 29.2s. Estimated remaining: 2h 0m 8s. Rate: 7.1 symbols/min [2025-10-16T20:33:35.019741] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:33:35.019921] [DEBUG] [LOCAL ] NPO: No existing data file found in primary storage. [2025-10-16T20:33:35.019977] [WARN ] [MAIN ] NPO: No existing data found, performing full refresh instead. [2025-10-16T20:33:35.020094] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-16T20:33:35.020136] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-16T20:33:35.020178] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-16T20:33:35.020256] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-16T20:33:35.156791] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-16T20:33:35.386868] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:33:35.444436] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-16T20:33:35.942789] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-16T20:33:36.079557] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-16T20:33:36.742802] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-16T20:33:37.009684] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T20:33:37.478080] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-16T20:33:37.542787] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-16T20:33:38.342741] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-10-16T20:33:38.423357] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T20:33:38.425231] [INFO ] [REMOTE ] NPK: Full fetch complete (11112 records). [2025-10-16T20:33:38.425302] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-16T20:33:38.818109] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-10-16T20:33:38.818224] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-10-16T20:33:38.818561] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-10-16T20:33:38.818618] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-10-16T20:33:38.819162] [DEBUG] [LOCAL ] NPK: Trimmed 11112 records to 8494 (keeping 200 days of data) [2025-10-16T20:33:38.878989] [DEBUG] [LOCAL ] NPK: Primary data saved (8494 records). [2025-10-16T20:33:38.879133] [INFO ] [MAIN ] NPK: Full history saved. [2025-10-16T20:33:38.879229] [INFO ] [MAIN ] Update Progress: 1517/2369 symbols completed. NPK took 32.5s. Estimated remaining: 1h 59m 57s. Rate: 7.1 symbols/min [2025-10-16T20:33:39.142873] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-16T20:33:39.403249] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T20:33:39.942806] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-16T20:33:40.690865] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T20:33:40.705133] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T20:33:40.742766] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-16T20:33:41.542896] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-16T20:33:42.342849] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-16T20:33:42.382557] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T20:33:42.535191] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T20:33:42.900612] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-16T20:33:42.902605] [INFO ] [REMOTE ] NPCT: Full fetch complete (24574 records). [2025-10-16T20:33:42.902725] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-16T20:33:42.903196] [FATAL] [VALIDATOR ] NPCT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:33:42.903278] [FATAL] [MAIN ] NPCT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:33:42.903321] [WARN ] [MAIN ] NPCT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:33:42.903386] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-16T20:33:42.903446] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-16T20:33:42.903481] [INFO ] [LOCAL ] NPCT: Starting deletion of derivative data. [2025-10-16T20:33:42.903522] [DEBUG] [LOCAL ] NPCT: No derivative data file found to delete. [2025-10-16T20:33:42.903573] [INFO ] [MAIN ] Update Progress: 1518/2369 symbols completed. NPCT took 40.2s. Estimated remaining: 1h 59m 47s. Rate: 7.1 symbols/min [2025-10-16T20:33:43.142818] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-16T20:33:43.942876] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-16T20:33:44.780905] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T20:33:44.789927] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-16T20:33:45.122179] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T20:33:45.542856] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-16T20:33:46.447307] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T20:33:46.454946] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-16T20:33:47.109808] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T20:33:47.142764] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-16T20:33:47.288572] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T20:33:47.293401] [INFO ] [REMOTE ] NPKI: Full fetch complete (55730 records). [2025-10-16T20:33:47.293517] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-16T20:33:47.294184] [FATAL] [VALIDATOR ] NPKI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:33:47.294270] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:33:47.294313] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:33:47.294349] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-16T20:33:47.294410] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-16T20:33:47.294448] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-10-16T20:33:47.294487] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-10-16T20:33:47.294540] [INFO ] [MAIN ] Update Progress: 1519/2369 symbols completed. NPKI took 36.6s. Estimated remaining: 1h 59m 36s. Rate: 7.1 symbols/min [2025-10-16T20:33:47.906036] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T20:33:47.942766] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-16T20:33:48.985358] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T20:33:48.988668] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-16T20:33:49.927674] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T20:33:49.930916] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-16T20:33:50.944677] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T20:33:50.948112] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-16T20:33:51.980621] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T20:33:51.985143] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-16T20:33:52.677369] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T20:33:52.681423] [INFO ] [REMOTE ] NPO: Full fetch complete (18623 records). [2025-10-16T20:33:52.681518] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-16T20:33:52.682059] [FATAL] [VALIDATOR ] NPO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:33:52.682146] [FATAL] [MAIN ] NPO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:33:52.682194] [WARN ] [MAIN ] NPO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:33:52.682263] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-16T20:33:52.682331] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-16T20:33:52.682369] [INFO ] [LOCAL ] NPO: Starting deletion of derivative data. [2025-10-16T20:33:52.682446] [DEBUG] [LOCAL ] NPO: No derivative data file found to delete. [2025-10-16T20:33:52.682567] [INFO ] [MAIN ] Update Progress: 1520/2369 symbols completed. NPO took 17.8s. Estimated remaining: 1h 59m 26s. Rate: 7.1 symbols/min [2025-10-16T20:33:53.354910] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:33:53.359265] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:33:53.376609] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:33:53.394101] [DEBUG] [LOCAL ] NPWR: No existing data file found in primary storage. [2025-10-16T20:33:53.396517] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:33:53.396775] [WARN ] [MAIN ] NPWR: No existing data found, performing full refresh instead. [2025-10-16T20:33:53.394278] [DEBUG] [LOCAL ] NQP: No existing data file found in primary storage. [2025-10-16T20:33:53.397477] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-16T20:33:53.397752] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-16T20:33:53.397297] [WARN ] [MAIN ] NQP: No existing data found, performing full refresh instead. [2025-10-16T20:33:53.397953] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-16T20:33:53.398046] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-16T20:33:53.398176] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-16T20:33:53.398255] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-16T20:33:53.409820] [DEBUG] [LOCAL ] NQP: No primary data file found to delete. [2025-10-16T20:33:53.454685] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-16T20:33:53.527862] [DEBUG] [LOCAL ] NPV: Loaded 5356 existing records from primary storage. [2025-10-16T20:33:53.612838] [INFO ] [MAIN ] NPV: Loaded 5356 existing records. [2025-10-16T20:33:53.785803] [DEBUG] [LOCAL ] NRDY: Loaded 32694 existing records from primary storage. [2025-10-16T20:33:53.866546] [INFO ] [MAIN ] NRDY: Loaded 32694 existing records. [2025-10-16T20:33:54.320536] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:33:54.436176] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:33:54.449501] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-10-16T20:33:54.462854] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-16T20:33:54.494998] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-16T20:33:54.501364] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:33:54.525063] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-10-16T20:33:54.525183] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-16T20:33:54.524972] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:33:54.525594] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-16T20:33:54.525536] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-10-16T20:33:54.525724] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-16T20:33:54.547382] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-10-16T20:33:54.590972] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-16T20:33:55.239547] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:33:55.247287] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-10-16T20:33:55.268777] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:33:55.269145] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-10-16T20:33:55.897190] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T20:33:55.900221] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-16T20:33:56.099874] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T20:33:56.107347] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-16T20:33:56.205076] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-16T20:33:56.742874] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-16T20:33:56.754173] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T20:33:57.029133] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T20:33:57.418534] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T20:33:57.542796] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-16T20:33:58.342802] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-16T20:33:58.364834] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T20:33:58.450701] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-16T20:33:59.022762] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-16T20:33:59.142843] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-16T20:33:59.942841] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-16T20:34:00.742876] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-16T20:34:00.815037] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T20:34:01.542829] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-16T20:34:01.557417] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-16T20:34:01.730287] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T20:34:02.342920] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-16T20:34:02.420342] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-16T20:34:03.029553] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-16T20:34:03.142810] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-16T20:34:03.942879] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-16T20:34:03.971682] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T20:34:04.742875] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-16T20:34:05.542794] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-16T20:34:05.721765] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T20:34:05.740062] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T20:34:06.342857] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-16T20:34:07.011882] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T20:34:07.142801] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-16T20:34:07.942834] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-16T20:34:08.027316] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T20:34:08.313235] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T20:34:08.403151] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-16T20:34:08.742810] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-16T20:34:09.542858] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-16T20:34:10.324673] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-16T20:34:10.342785] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-16T20:34:10.409074] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T20:34:11.142819] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-16T20:34:11.874524] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T20:34:11.876532] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T20:34:11.942803] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-16T20:34:12.720745] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-16T20:34:12.742805] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-16T20:34:13.542609] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T20:34:13.543939] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-16T20:34:13.544616] [INFO ] [REMOTE ] NPV: Full fetch complete (7158 records). [2025-10-16T20:34:13.545566] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-16T20:34:13.911398] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-16T20:34:13.911479] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-16T20:34:13.911696] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-16T20:34:13.911755] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-16T20:34:13.912239] [DEBUG] [LOCAL ] NPV: Trimmed 7158 records to 5385 (keeping 200 days of data) [2025-10-16T20:34:13.950357] [DEBUG] [LOCAL ] NPV: Primary data saved (5385 records). [2025-10-16T20:34:13.950517] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-16T20:34:13.950672] [INFO ] [MAIN ] Update Progress: 1521/2369 symbols completed. NPV took 21.3s. Estimated remaining: 1h 59m 24s. Rate: 7.1 symbols/min [2025-10-16T20:34:14.123257] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:34:14.136011] [DEBUG] [LOCAL ] NREF: Loaded 7865 existing records from primary storage. [2025-10-16T20:34:14.136325] [INFO ] [MAIN ] NREF: Loaded 7865 existing records. [2025-10-16T20:34:14.347844] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-16T20:34:14.351765] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:34:14.352870] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-16T20:34:14.352922] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-16T20:34:14.353077] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-10-16T20:34:14.353117] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-16T20:34:14.513690] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-16T20:34:14.776914] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:34:15.142838] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-16T20:34:15.946941] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-16T20:34:15.939942] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T20:34:15.956622] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-16T20:34:16.742812] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-10-16T20:34:17.542862] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-16T20:34:17.824903] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-16T20:34:17.854999] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-16T20:34:18.342844] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-16T20:34:18.432736] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T20:34:19.142863] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-16T20:34:19.942803] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-16T20:34:20.372197] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-16T20:34:20.742778] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-16T20:34:21.022529] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T20:34:21.058033] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T20:34:21.542827] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-16T20:34:22.228485] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T20:34:22.296725] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T20:34:22.298176] [INFO ] [REMOTE ] NQP: Full fetch complete (12995 records). [2025-10-16T20:34:22.298253] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-16T20:34:22.351292] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-16T20:34:22.704015] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-10-16T20:34:22.704099] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-10-16T20:34:22.704438] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-10-16T20:34:22.704526] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-10-16T20:34:22.705284] [DEBUG] [LOCAL ] NQP: Trimmed 12995 records to 9287 (keeping 200 days of data) [2025-10-16T20:34:22.765876] [DEBUG] [LOCAL ] NQP: Primary data saved (9287 records). [2025-10-16T20:34:22.766023] [INFO ] [MAIN ] NQP: Full history saved. [2025-10-16T20:34:22.766098] [INFO ] [MAIN ] Update Progress: 1522/2369 symbols completed. NQP took 30.1s. Estimated remaining: 1h 59m 16s. Rate: 7.1 symbols/min [2025-10-16T20:34:22.935090] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:34:22.935247] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-10-16T20:34:22.935283] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-10-16T20:34:22.935395] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-16T20:34:22.935435] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-16T20:34:22.935475] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-16T20:34:22.935507] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-16T20:34:23.147952] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-16T20:34:23.289892] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:34:23.833929] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T20:34:23.856256] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T20:34:23.942814] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-16T20:34:24.683531] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T20:34:24.742831] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-16T20:34:25.542781] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-16T20:34:26.121307] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T20:34:26.342819] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-16T20:34:27.142827] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-10-16T20:34:27.273894] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T20:34:27.739223] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T20:34:27.942810] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-16T20:34:28.742794] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-16T20:34:28.996116] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T20:34:29.542852] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-16T20:34:29.562697] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T20:34:29.587874] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T20:34:30.342856] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-16T20:34:31.142864] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-16T20:34:31.691736] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-16T20:34:31.749589] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T20:34:31.754222] [INFO ] [REMOTE ] NRDY: Full fetch complete (50616 records). [2025-10-16T20:34:31.754326] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-16T20:34:31.947758] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-16T20:34:32.037301] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T20:34:32.145848] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-10-16T20:34:32.145921] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-10-16T20:34:32.146932] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-10-16T20:34:32.146997] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-10-16T20:34:32.148110] [DEBUG] [LOCAL ] NRDY: Trimmed 50616 records to 32903 (keeping 200 days of data) [2025-10-16T20:34:32.327393] [DEBUG] [LOCAL ] NRDY: Primary data saved (32903 records). [2025-10-16T20:34:32.327524] [INFO ] [MAIN ] NRDY: Full history saved. [2025-10-16T20:34:32.327600] [INFO ] [MAIN ] Update Progress: 1523/2369 symbols completed. NRDY took 39.6s. Estimated remaining: 1h 59m 8s. Rate: 7.1 symbols/min [2025-10-16T20:34:32.501967] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:34:32.541232] [DEBUG] [LOCAL ] NRGV: Loaded 43749 existing records from primary storage. [2025-10-16T20:34:32.541535] [INFO ] [MAIN ] NRGV: Loaded 43749 existing records. [2025-10-16T20:34:32.718010] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:34:32.718215] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-16T20:34:32.718273] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-16T20:34:32.718480] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-10-16T20:34:32.718530] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-16T20:34:32.750469] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-16T20:34:33.084142] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:34:33.542777] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-16T20:34:33.752549] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T20:34:33.758608] [INFO ] [REMOTE ] NPWR: Full fetch complete (60156 records). [2025-10-16T20:34:33.758743] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-16T20:34:33.759336] [FATAL] [VALIDATOR ] NPWR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:34:33.759437] [FATAL] [MAIN ] NPWR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:34:33.759512] [WARN ] [MAIN ] NPWR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:34:33.759603] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-16T20:34:33.759709] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-16T20:34:33.759759] [INFO ] [LOCAL ] NPWR: Starting deletion of derivative data. [2025-10-16T20:34:33.759800] [DEBUG] [LOCAL ] NPWR: No derivative data file found to delete. [2025-10-16T20:34:33.759856] [INFO ] [MAIN ] Update Progress: 1524/2369 symbols completed. NPWR took 41.1s. Estimated remaining: 1h 58m 56s. Rate: 7.1 symbols/min [2025-10-16T20:34:33.928153] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:34:33.928373] [DEBUG] [LOCAL ] NRK: No existing data file found in primary storage. [2025-10-16T20:34:33.928519] [WARN ] [MAIN ] NRK: No existing data found, performing full refresh instead. [2025-10-16T20:34:33.928748] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-16T20:34:33.928819] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-16T20:34:33.928885] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-10-16T20:34:33.928954] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-16T20:34:34.152983] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-16T20:34:34.334420] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-16T20:34:34.332996] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:34:34.344332] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-16T20:34:35.142795] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-10-16T20:34:35.269597] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T20:34:35.942839] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-16T20:34:36.573816] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-16T20:34:36.742820] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-10-16T20:34:36.915817] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T20:34:37.542814] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-16T20:34:38.342909] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-16T20:34:38.478861] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T20:34:38.613202] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T20:34:39.142880] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-16T20:34:39.942823] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-16T20:34:40.252046] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T20:34:40.742792] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-16T20:34:41.216505] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-10-16T20:34:41.542803] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-16T20:34:41.661010] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T20:34:41.707476] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T20:34:42.093310] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-16T20:34:42.342821] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-16T20:34:43.142852] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-16T20:34:43.412469] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-16T20:34:43.942868] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-16T20:34:44.742865] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-16T20:34:44.754758] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T20:34:44.756366] [INFO ] [REMOTE ] NREF: Full fetch complete (10977 records). [2025-10-16T20:34:44.756442] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-16T20:34:45.114145] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-10-16T20:34:45.114391] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-10-16T20:34:45.114840] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-10-16T20:34:45.114914] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-10-16T20:34:45.115565] [DEBUG] [LOCAL ] NREF: Trimmed 10977 records to 7915 (keeping 200 days of data) [2025-10-16T20:34:45.162945] [DEBUG] [LOCAL ] NREF: Primary data saved (7915 records). [2025-10-16T20:34:45.163082] [INFO ] [MAIN ] NREF: Full history saved. [2025-10-16T20:34:45.163165] [INFO ] [MAIN ] Update Progress: 1525/2369 symbols completed. NREF took 31.2s. Estimated remaining: 1h 58m 49s. Rate: 7.1 symbols/min [2025-10-16T20:34:45.332130] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:34:45.366152] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-16T20:34:45.368993] [DEBUG] [LOCAL ] NRP: Loaded 4190 existing records from primary storage. [2025-10-16T20:34:45.369363] [INFO ] [MAIN ] NRP: Loaded 4190 existing records. [2025-10-16T20:34:45.556765] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-16T20:34:45.561527] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:34:45.563445] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-16T20:34:45.563517] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-16T20:34:45.564168] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-10-16T20:34:45.564228] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-16T20:34:45.913489] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:34:46.204784] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T20:34:46.342790] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-16T20:34:46.733422] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-16T20:34:47.142880] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-16T20:34:47.905259] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T20:34:47.942856] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-16T20:34:48.329708] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-16T20:34:48.742832] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-16T20:34:49.542833] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-10-16T20:34:49.841942] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T20:34:50.342839] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-16T20:34:50.690198] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T20:34:50.993558] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (3.05 seconds). [2025-10-16T20:34:51.142820] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-16T20:34:51.942862] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-16T20:34:52.235139] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-16T20:34:52.401167] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-16T20:34:52.643051] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-16T20:34:52.742805] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-16T20:34:53.542865] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-16T20:34:54.342898] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-16T20:34:55.142834] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-16T20:34:55.232701] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T20:34:55.275725] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T20:34:55.329143] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-10-16T20:34:55.942814] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-16T20:34:56.014878] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-16T20:34:56.742877] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-16T20:34:57.545604] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-16T20:34:57.547173] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-16T20:34:58.185980] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-16T20:34:58.342813] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-16T20:34:58.691359] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T20:34:59.142891] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-16T20:34:59.942899] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-16T20:35:00.376939] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-16T20:35:00.742802] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-16T20:35:00.822291] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T20:35:00.880284] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T20:35:01.542849] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-16T20:35:02.152217] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-16T20:35:02.342841] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-16T20:35:02.798857] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-16T20:35:02.796869] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-16T20:35:02.815911] [INFO ] [REMOTE ] NRK: Full fetch complete (27450 records). [2025-10-16T20:35:02.816002] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-16T20:35:02.816859] [FATAL] [VALIDATOR ] NRK: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:35:02.816953] [FATAL] [MAIN ] NRK: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:35:02.817003] [WARN ] [MAIN ] NRK: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:35:02.817070] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-16T20:35:02.817136] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-10-16T20:35:02.817171] [INFO ] [LOCAL ] NRK: Starting deletion of derivative data. [2025-10-16T20:35:02.817255] [DEBUG] [LOCAL ] NRK: No derivative data file found to delete. [2025-10-16T20:35:02.817315] [INFO ] [MAIN ] Update Progress: 1526/2369 symbols completed. NRK took 29.1s. Estimated remaining: 1h 58m 46s. Rate: 7.1 symbols/min [2025-10-16T20:35:02.982359] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:35:02.989489] [DEBUG] [LOCAL ] NRT: Loaded 4917 existing records from primary storage. [2025-10-16T20:35:02.989721] [INFO ] [MAIN ] NRT: Loaded 4917 existing records. [2025-10-16T20:35:03.156511] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-16T20:35:03.161349] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:35:03.162571] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-16T20:35:03.162639] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-16T20:35:03.162855] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-10-16T20:35:03.162910] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-16T20:35:03.505718] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:35:03.942782] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-10-16T20:35:04.389295] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-16T20:35:04.395453] [INFO ] [REMOTE ] NRG: Full fetch complete (76422 records). [2025-10-16T20:35:04.395567] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-16T20:35:04.396351] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:35:04.396439] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:35:04.396482] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:35:04.396519] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-16T20:35:04.396573] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-16T20:35:04.396607] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-10-16T20:35:04.396684] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-10-16T20:35:04.396758] [INFO ] [MAIN ] Update Progress: 1527/2369 symbols completed. NRG took 41.6s. Estimated remaining: 1h 58m 34s. Rate: 7.1 symbols/min [2025-10-16T20:35:04.561087] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:35:04.561242] [DEBUG] [LOCAL ] NRUC: No existing data file found in primary storage. [2025-10-16T20:35:04.561278] [WARN ] [MAIN ] NRUC: No existing data found, performing full refresh instead. [2025-10-16T20:35:04.561386] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-16T20:35:04.561427] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-16T20:35:04.561467] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-16T20:35:04.561498] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-16T20:35:04.753303] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-16T20:35:04.909217] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:35:05.342193] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T20:35:05.542879] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-10-16T20:35:06.342829] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-16T20:35:06.894056] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T20:35:06.952182] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T20:35:07.047966] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-16T20:35:07.142813] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-16T20:35:07.942822] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-16T20:35:08.742861] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-16T20:35:08.882357] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T20:35:08.992189] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T20:35:09.351718] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T20:35:09.542848] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-16T20:35:10.280854] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T20:35:10.342795] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-16T20:35:11.142834] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-16T20:35:11.754350] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-16T20:35:11.942802] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-16T20:35:12.220248] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-16T20:35:12.670766] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T20:35:12.742828] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-16T20:35:13.499907] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T20:35:13.542784] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-16T20:35:14.216979] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-16T20:35:14.342822] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-16T20:35:15.142830] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-16T20:35:15.915572] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-16T20:35:15.942767] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-16T20:35:16.267366] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-16T20:35:16.274053] [INFO ] [REMOTE ] NRGV: Full fetch complete (62485 records). [2025-10-16T20:35:16.274171] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-16T20:35:16.566350] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-16T20:35:16.583700] [INFO ] [REMOTE ] NRP: Full fetch complete (6368 records). [2025-10-16T20:35:16.594024] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-16T20:35:16.756345] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-16T20:35:16.759676] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-10-16T20:35:16.781910] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-10-16T20:35:16.818070] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-10-16T20:35:16.827548] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-10-16T20:35:16.924602] [DEBUG] [LOCAL ] NRGV: Trimmed 62485 records to 44137 (keeping 200 days of data) [2025-10-16T20:35:17.135192] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-10-16T20:35:17.135564] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-10-16T20:35:17.138347] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-10-16T20:35:17.138424] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-10-16T20:35:17.143055] [DEBUG] [LOCAL ] NRP: Trimmed 6368 records to 4218 (keeping 200 days of data) [2025-10-16T20:35:17.188157] [DEBUG] [LOCAL ] NRP: Primary data saved (4218 records). [2025-10-16T20:35:17.188335] [INFO ] [MAIN ] NRP: Full history saved. [2025-10-16T20:35:17.188516] [INFO ] [MAIN ] Update Progress: 1528/2369 symbols completed. NRP took 32.0s. Estimated remaining: 1h 58m 27s. Rate: 7.1 symbols/min [2025-10-16T20:35:17.457575] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:35:17.458693] [DEBUG] [LOCAL ] NSA: No existing data file found in primary storage. [2025-10-16T20:35:17.458818] [WARN ] [MAIN ] NSA: No existing data found, performing full refresh instead. [2025-10-16T20:35:17.459484] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-16T20:35:17.460351] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-16T20:35:17.462129] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-16T20:35:17.464934] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-16T20:35:17.556072] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T20:35:17.555924] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-16T20:35:17.814980] [DEBUG] [LOCAL ] NRGV: Primary data saved (44137 records). [2025-10-16T20:35:17.832362] [INFO ] [MAIN ] NRGV: Full history saved. [2025-10-16T20:35:17.843003] [INFO ] [MAIN ] Update Progress: 1529/2369 symbols completed. NRGV took 45.5s. Estimated remaining: 1h 58m 15s. Rate: 7.1 symbols/min [2025-10-16T20:35:17.914143] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:35:18.037975] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:35:18.038120] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-10-16T20:35:18.038156] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-10-16T20:35:18.038284] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-16T20:35:18.038337] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-16T20:35:18.038380] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-16T20:35:18.038412] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-16T20:35:18.347971] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-16T20:35:18.388375] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:35:18.392697] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T20:35:19.086519] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T20:35:19.142831] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-16T20:35:19.762747] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-16T20:35:19.942803] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-16T20:35:20.559912] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T20:35:20.742829] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-10-16T20:35:21.542874] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-16T20:35:22.259147] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T20:35:22.258966] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T20:35:22.342823] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-16T20:35:23.142872] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-16T20:35:23.155032] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T20:35:23.926459] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T20:35:23.942775] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-16T20:35:24.625986] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-16T20:35:24.742810] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-10-16T20:35:25.542809] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-16T20:35:26.026958] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-16T20:35:26.028018] [INFO ] [REMOTE ] NRUC: Full fetch complete (5341 records). [2025-10-16T20:35:26.028088] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-16T20:35:26.028492] [FATAL] [VALIDATOR ] NRUC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:35:26.028588] [FATAL] [MAIN ] NRUC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:35:26.028684] [WARN ] [MAIN ] NRUC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:35:26.028793] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-16T20:35:26.028867] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-16T20:35:26.028904] [INFO ] [LOCAL ] NRUC: Starting deletion of derivative data. [2025-10-16T20:35:26.028943] [DEBUG] [LOCAL ] NRUC: No derivative data file found to delete. [2025-10-16T20:35:26.028998] [INFO ] [MAIN ] Update Progress: 1530/2369 symbols completed. NRUC took 21.6s. Estimated remaining: 1h 58m 6s. Rate: 7.1 symbols/min [2025-10-16T20:35:26.201279] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:35:26.201561] [DEBUG] [LOCAL ] NSP: No existing data file found in primary storage. [2025-10-16T20:35:26.201619] [WARN ] [MAIN ] NSP: No existing data found, performing full refresh instead. [2025-10-16T20:35:26.201787] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-16T20:35:26.201843] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-16T20:35:26.201887] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-16T20:35:26.201920] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-16T20:35:26.348431] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-16T20:35:26.567999] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:35:26.595479] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T20:35:27.142840] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-16T20:35:27.942855] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-16T20:35:27.988177] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T20:35:28.617182] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-16T20:35:28.742828] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-16T20:35:29.063063] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-16T20:35:29.542830] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-16T20:35:30.254082] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-16T20:35:30.255146] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T20:35:30.342769] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-16T20:35:31.142812] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-10-16T20:35:31.942798] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-16T20:35:32.190351] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T20:35:32.586839] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T20:35:32.742779] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-16T20:35:32.816939] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-16T20:35:33.542799] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-16T20:35:34.342849] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-16T20:35:34.478672] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T20:35:34.939507] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T20:35:34.983319] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T20:35:35.142804] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-16T20:35:35.942811] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-16T20:35:36.620122] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T20:35:36.742822] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-16T20:35:37.542780] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-16T20:35:37.804218] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-16T20:35:38.203923] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T20:35:38.205091] [INFO ] [REMOTE ] NRT: Full fetch complete (7951 records). [2025-10-16T20:35:38.205159] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-16T20:35:38.342810] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-16T20:35:38.415388] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T20:35:38.590935] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-10-16T20:35:38.591010] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-10-16T20:35:38.591225] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-10-16T20:35:38.591264] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-10-16T20:35:38.591679] [DEBUG] [LOCAL ] NRT: Trimmed 7951 records to 4958 (keeping 200 days of data) [2025-10-16T20:35:38.623112] [DEBUG] [LOCAL ] NRT: Primary data saved (4958 records). [2025-10-16T20:35:38.623217] [INFO ] [MAIN ] NRT: Full history saved. [2025-10-16T20:35:38.623294] [INFO ] [MAIN ] Update Progress: 1531/2369 symbols completed. NRT took 35.8s. Estimated remaining: 1h 57m 60s. Rate: 7.1 symbols/min [2025-10-16T20:35:38.793608] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:35:38.793805] [DEBUG] [LOCAL ] NTB: No existing data file found in primary storage. [2025-10-16T20:35:38.793848] [WARN ] [MAIN ] NTB: No existing data found, performing full refresh instead. [2025-10-16T20:35:38.793971] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-16T20:35:38.794013] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-16T20:35:38.794053] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-16T20:35:38.794086] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-16T20:35:39.144665] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-16T20:35:39.144566] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:35:39.942798] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-10-16T20:35:40.283191] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-16T20:35:40.742834] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-16T20:35:40.971092] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-16T20:35:41.171909] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T20:35:41.542813] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-16T20:35:42.256244] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T20:35:42.342793] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-16T20:35:43.103075] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T20:35:43.142867] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-16T20:35:43.942816] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-16T20:35:44.290213] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T20:35:44.324348] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-16T20:35:44.742882] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-16T20:35:45.405926] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T20:35:45.542831] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-16T20:35:46.041926] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T20:35:46.342834] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-16T20:35:47.065945] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T20:35:47.142811] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-16T20:35:47.942878] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-16T20:35:48.394940] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-16T20:35:48.464839] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T20:35:48.742837] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-16T20:35:49.241895] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T20:35:49.542897] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-16T20:35:50.342789] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-16T20:35:50.533477] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T20:35:50.791384] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-16T20:35:51.142897] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-16T20:35:51.709286] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T20:35:51.942871] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-16T20:35:52.742813] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-16T20:35:52.918366] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T20:35:53.038891] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T20:35:53.274128] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-16T20:35:53.282115] [INFO ] [REMOTE ] NSA: Full fetch complete (62217 records). [2025-10-16T20:35:53.282279] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-16T20:35:53.283184] [FATAL] [VALIDATOR ] NSA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:35:53.283285] [FATAL] [MAIN ] NSA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:35:53.283339] [WARN ] [MAIN ] NSA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:35:53.283406] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-16T20:35:53.283500] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-16T20:35:53.283551] [INFO ] [LOCAL ] NSA: Starting deletion of derivative data. [2025-10-16T20:35:53.283605] [DEBUG] [LOCAL ] NSA: No derivative data file found to delete. [2025-10-16T20:35:53.283722] [INFO ] [MAIN ] Update Progress: 1532/2369 symbols completed. NSA took 36.1s. Estimated remaining: 1h 57m 55s. Rate: 7.1 symbols/min [2025-10-16T20:35:53.457494] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:35:53.457742] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-16T20:35:53.457788] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-16T20:35:53.457862] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-16T20:35:53.457897] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-16T20:35:53.457936] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-16T20:35:53.457968] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-16T20:35:53.552278] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-16T20:35:53.806256] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:35:54.342914] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-10-16T20:35:54.761455] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-16T20:35:55.009340] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-16T20:35:55.142817] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-16T20:35:55.942919] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-16T20:35:56.549411] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T20:35:56.715468] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-16T20:35:56.742854] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-16T20:35:57.542882] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-16T20:35:58.161154] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-16T20:35:58.342843] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-16T20:35:58.434343] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T20:35:58.907066] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T20:35:59.142861] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-16T20:35:59.677489] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-16T20:35:59.942807] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-16T20:36:00.742770] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-16T20:36:01.134438] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T20:36:01.542876] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-16T20:36:02.342796] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-16T20:36:02.498398] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T20:36:02.605203] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T20:36:03.142886] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-16T20:36:03.942829] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-16T20:36:04.128500] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T20:36:04.277429] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T20:36:04.613375] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-16T20:36:04.742826] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-16T20:36:05.485552] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T20:36:05.490497] [INFO ] [REMOTE ] NSP: Full fetch complete (49842 records). [2025-10-16T20:36:05.490677] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-16T20:36:05.491430] [FATAL] [VALIDATOR ] NSP: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:36:05.491532] [FATAL] [MAIN ] NSP: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:36:05.491575] [WARN ] [MAIN ] NSP: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:36:05.491615] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-16T20:36:05.491712] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-16T20:36:05.491767] [INFO ] [LOCAL ] NSP: Starting deletion of derivative data. [2025-10-16T20:36:05.491809] [DEBUG] [LOCAL ] NSP: No derivative data file found to delete. [2025-10-16T20:36:05.491864] [INFO ] [MAIN ] Update Progress: 1533/2369 symbols completed. NSP took 39.5s. Estimated remaining: 1h 57m 49s. Rate: 7.1 symbols/min [2025-10-16T20:36:05.552980] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-16T20:36:05.677890] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:36:05.678061] [DEBUG] [LOCAL ] NTR: No existing data file found in primary storage. [2025-10-16T20:36:05.678098] [WARN ] [MAIN ] NTR: No existing data found, performing full refresh instead. [2025-10-16T20:36:05.678209] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-16T20:36:05.678279] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-16T20:36:05.678348] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-16T20:36:05.678383] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-16T20:36:06.023084] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:36:06.340022] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T20:36:06.342759] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-16T20:36:07.022438] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-16T20:36:07.142812] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-16T20:36:07.670627] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-16T20:36:07.942836] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-16T20:36:08.742825] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-16T20:36:09.449463] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-16T20:36:09.452308] [INFO ] [REMOTE ] NTB: Full fetch complete (30515 records). [2025-10-16T20:36:09.452380] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-16T20:36:09.452843] [FATAL] [VALIDATOR ] NTB: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:36:09.452924] [FATAL] [MAIN ] NTB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:36:09.452966] [WARN ] [MAIN ] NTB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:36:09.453003] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-16T20:36:09.453055] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-16T20:36:09.453089] [INFO ] [LOCAL ] NTB: Starting deletion of derivative data. [2025-10-16T20:36:09.453128] [DEBUG] [LOCAL ] NTB: No derivative data file found to delete. [2025-10-16T20:36:09.453179] [INFO ] [MAIN ] Update Progress: 1534/2369 symbols completed. NTB took 30.8s. Estimated remaining: 1h 57m 38s. Rate: 7.1 symbols/min [2025-10-16T20:36:09.548722] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-10-16T20:36:09.624008] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:36:09.624255] [DEBUG] [LOCAL ] NTST: No existing data file found in primary storage. [2025-10-16T20:36:09.624306] [WARN ] [MAIN ] NTST: No existing data found, performing full refresh instead. [2025-10-16T20:36:09.624412] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-16T20:36:09.624453] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-16T20:36:09.624495] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-16T20:36:09.624527] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-16T20:36:09.980814] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:36:10.011276] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-16T20:36:10.342834] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-10-16T20:36:11.142817] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-16T20:36:11.453420] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-16T20:36:11.454414] [INFO ] [REMOTE ] NTEST: Full fetch complete (1963 records). [2025-10-16T20:36:11.454631] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-16T20:36:11.457268] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-16T20:36:11.455365] [FATAL] [VALIDATOR ] NTEST: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:36:11.467747] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:36:11.468722] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:36:11.468802] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-16T20:36:11.468876] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-16T20:36:11.468913] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-16T20:36:11.468952] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-16T20:36:11.469026] [INFO ] [MAIN ] Update Progress: 1535/2369 symbols completed. NTEST took 18.2s. Estimated remaining: 1h 57m 26s. Rate: 7.1 symbols/min [2025-10-16T20:36:11.655879] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:36:11.656104] [DEBUG] [LOCAL ] NU: No existing data file found in primary storage. [2025-10-16T20:36:11.656159] [WARN ] [MAIN ] NU: No existing data found, performing full refresh instead. [2025-10-16T20:36:11.656271] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-16T20:36:11.656313] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-16T20:36:11.656355] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-16T20:36:11.656388] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-16T20:36:11.943043] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-16T20:36:12.018879] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:36:12.041625] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T20:36:12.742832] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-16T20:36:13.542874] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-10-16T20:36:13.886101] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-16T20:36:14.342874] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-16T20:36:14.982569] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-16T20:36:15.142850] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-16T20:36:15.942884] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-16T20:36:16.036333] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-16T20:36:16.078531] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T20:36:16.742841] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-16T20:36:17.071171] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-16T20:36:17.160635] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-16T20:36:17.542807] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-16T20:36:17.596291] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T20:36:17.602075] [INFO ] [REMOTE ] NSC: Full fetch complete (70579 records). [2025-10-16T20:36:17.602225] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-16T20:36:17.603040] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:36:17.603147] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:36:17.603210] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:36:17.603282] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-16T20:36:17.603348] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-16T20:36:17.603383] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-10-16T20:36:17.603422] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-10-16T20:36:17.603489] [INFO ] [MAIN ] Update Progress: 1536/2369 symbols completed. NSC took 59.8s. Estimated remaining: 1h 57m 16s. Rate: 7.1 symbols/min [2025-10-16T20:36:17.769434] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:36:17.769629] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-16T20:36:17.769705] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-16T20:36:17.769830] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-16T20:36:17.769872] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-16T20:36:17.769914] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-16T20:36:17.769946] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-16T20:36:18.124838] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:36:18.342777] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-16T20:36:19.066563] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T20:36:19.142887] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-10-16T20:36:19.942826] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-16T20:36:20.273251] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-16T20:36:20.742821] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-16T20:36:21.270044] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-16T20:36:21.369882] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T20:36:21.542829] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-16T20:36:22.342825] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-16T20:36:22.926748] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-16T20:36:23.142786] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-16T20:36:23.545018] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-16T20:36:23.747692] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T20:36:23.942826] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-16T20:36:24.742816] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-16T20:36:25.542848] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-16T20:36:25.608674] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-16T20:36:25.963919] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T20:36:26.068682] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-16T20:36:26.342825] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-16T20:36:27.142863] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-16T20:36:27.538013] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T20:36:27.715739] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T20:36:27.942821] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-16T20:36:28.742885] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-16T20:36:29.542862] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-16T20:36:30.536386] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-16T20:36:30.547214] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-16T20:36:30.666174] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (3.52 seconds). [2025-10-16T20:36:31.142824] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-16T20:36:31.647178] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.90 seconds). [2025-10-16T20:36:31.942815] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-16T20:36:32.105971] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-16T20:36:32.687024] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-16T20:36:32.742833] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-16T20:36:33.542875] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-16T20:36:34.368411] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-16T20:36:34.380412] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-16T20:36:34.650732] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-16T20:36:34.876029] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T20:36:35.142868] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-16T20:36:35.458533] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (4.32 seconds). [2025-10-16T20:36:35.719700] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T20:36:35.725413] [INFO ] [REMOTE ] NTST: Full fetch complete (61407 records). [2025-10-16T20:36:35.725551] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-16T20:36:35.726225] [FATAL] [VALIDATOR ] NTST: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:36:35.726324] [FATAL] [MAIN ] NTST: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:36:35.726396] [WARN ] [MAIN ] NTST: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:36:35.726482] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-16T20:36:35.726558] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-16T20:36:35.726594] [INFO ] [LOCAL ] NTST: Starting deletion of derivative data. [2025-10-16T20:36:35.726634] [DEBUG] [LOCAL ] NTST: No derivative data file found to delete. [2025-10-16T20:36:35.726746] [INFO ] [MAIN ] Update Progress: 1537/2369 symbols completed. NTST took 26.3s. Estimated remaining: 1h 57m 13s. Rate: 7.1 symbols/min [2025-10-16T20:36:35.898768] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:36:35.898987] [DEBUG] [LOCAL ] NUS: No existing data file found in primary storage. [2025-10-16T20:36:35.899037] [WARN ] [MAIN ] NUS: No existing data found, performing full refresh instead. [2025-10-16T20:36:35.899148] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-16T20:36:35.899188] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-16T20:36:35.899227] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-16T20:36:35.899259] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-16T20:36:35.952298] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-16T20:36:36.247506] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:36:36.687760] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-16T20:36:36.742798] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-16T20:36:37.542873] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-16T20:36:38.085738] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-16T20:36:38.342864] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-16T20:36:38.945680] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-16T20:36:39.103910] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T20:36:39.142815] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-16T20:36:39.942862] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-10-16T20:36:40.440308] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-16T20:36:40.742883] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-16T20:36:41.110211] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T20:36:41.202111] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T20:36:41.542925] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-16T20:36:42.342865] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-16T20:36:42.711709] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-16T20:36:42.992398] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T20:36:43.142773] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-16T20:36:43.591192] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T20:36:43.942785] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-16T20:36:44.033398] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T20:36:44.040191] [INFO ] [REMOTE ] NTR: Full fetch complete (76131 records). [2025-10-16T20:36:44.040331] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-16T20:36:44.041274] [FATAL] [VALIDATOR ] NTR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:36:44.041373] [FATAL] [MAIN ] NTR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:36:44.041417] [WARN ] [MAIN ] NTR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:36:44.041490] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-16T20:36:44.041572] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-16T20:36:44.041672] [INFO ] [LOCAL ] NTR: Starting deletion of derivative data. [2025-10-16T20:36:44.041759] [DEBUG] [LOCAL ] NTR: No derivative data file found to delete. [2025-10-16T20:36:44.041848] [INFO ] [MAIN ] Update Progress: 1538/2369 symbols completed. NTR took 38.5s. Estimated remaining: 1h 57m 4s. Rate: 7.1 symbols/min [2025-10-16T20:36:44.210984] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:36:44.232977] [DEBUG] [LOCAL ] NUV: Loaded 23747 existing records from primary storage. [2025-10-16T20:36:44.233226] [INFO ] [MAIN ] NUV: Loaded 23747 existing records. [2025-10-16T20:36:44.407631] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:36:44.407826] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-16T20:36:44.407872] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-16T20:36:44.408175] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-10-16T20:36:44.408232] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-16T20:36:44.752299] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-16T20:36:44.758630] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:36:45.542851] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-10-16T20:36:46.342838] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-16T20:36:46.433770] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-16T20:36:46.861817] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-16T20:36:47.142826] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-16T20:36:47.333714] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T20:36:47.631415] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T20:36:47.942870] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-16T20:36:48.742859] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-16T20:36:48.937448] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T20:36:49.551703] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-16T20:36:49.554360] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T20:36:49.595850] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T20:36:50.348206] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-16T20:36:50.352358] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T20:36:50.358875] [INFO ] [REMOTE ] NUE: Full fetch complete (74469 records). [2025-10-16T20:36:50.359002] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-16T20:36:50.359838] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:36:50.359922] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:36:50.359965] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:36:50.360030] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-16T20:36:50.360094] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-16T20:36:50.360130] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-16T20:36:50.360170] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-16T20:36:50.360226] [INFO ] [MAIN ] Update Progress: 1539/2369 symbols completed. NUE took 32.8s. Estimated remaining: 1h 56m 55s. Rate: 7.1 symbols/min [2025-10-16T20:36:50.527754] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:36:50.527929] [DEBUG] [LOCAL ] NUVB: No existing data file found in primary storage. [2025-10-16T20:36:50.527967] [WARN ] [MAIN ] NUVB: No existing data found, performing full refresh instead. [2025-10-16T20:36:50.528079] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-16T20:36:50.528120] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-16T20:36:50.528160] [DEBUG] [LOCAL ] NUVB: No primary data file found to delete. [2025-10-16T20:36:50.528192] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-16T20:36:50.874419] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:36:51.142804] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-16T20:36:51.942884] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-10-16T20:36:52.122490] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T20:36:52.742843] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-16T20:36:53.542834] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-16T20:36:53.623529] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-16T20:36:53.909237] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-16T20:36:54.066846] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T20:36:54.342843] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-16T20:36:54.739303] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T20:36:55.142820] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-16T20:36:55.942890] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-16T20:36:56.605698] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-16T20:36:56.684865] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T20:36:56.742777] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-16T20:36:56.952834] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T20:36:57.542819] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-16T20:36:58.106615] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-16T20:36:58.342867] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-16T20:36:59.079028] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T20:36:59.142823] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-16T20:36:59.942808] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-16T20:37:00.124778] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T20:37:00.748525] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-16T20:37:00.751178] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T20:37:01.264464] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T20:37:01.542842] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-16T20:37:02.342789] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-16T20:37:02.424555] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T20:37:02.431262] [INFO ] [REMOTE ] NU: Full fetch complete (77535 records). [2025-10-16T20:37:02.431424] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-16T20:37:02.432159] [FATAL] [VALIDATOR ] NU: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:37:02.432255] [FATAL] [MAIN ] NU: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:37:02.432297] [WARN ] [MAIN ] NU: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:37:02.432360] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-16T20:37:02.432450] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-16T20:37:02.432498] [INFO ] [LOCAL ] NU: Starting deletion of derivative data. [2025-10-16T20:37:02.432552] [DEBUG] [LOCAL ] NU: No derivative data file found to delete. [2025-10-16T20:37:02.432629] [INFO ] [MAIN ] Update Progress: 1540/2369 symbols completed. NU took 51.0s. Estimated remaining: 1h 56m 48s. Rate: 7.1 symbols/min [2025-10-16T20:37:02.608029] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:37:02.617576] [DEBUG] [LOCAL ] NUW: Loaded 6769 existing records from primary storage. [2025-10-16T20:37:02.617851] [INFO ] [MAIN ] NUW: Loaded 6769 existing records. [2025-10-16T20:37:02.804542] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-16T20:37:02.836510] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:37:02.847674] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-16T20:37:02.848280] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-16T20:37:02.848671] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-10-16T20:37:02.848733] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-16T20:37:03.147892] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-16T20:37:03.207762] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:37:03.864319] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T20:37:03.942823] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-16T20:37:04.436069] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T20:37:04.742829] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-16T20:37:05.453568] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-16T20:37:05.458220] [INFO ] [REMOTE ] NUS: Full fetch complete (53544 records). [2025-10-16T20:37:05.458333] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-16T20:37:05.459021] [FATAL] [VALIDATOR ] NUS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:37:05.459120] [FATAL] [MAIN ] NUS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:37:05.459163] [WARN ] [MAIN ] NUS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:37:05.459229] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-16T20:37:05.459291] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-16T20:37:05.459327] [INFO ] [LOCAL ] NUS: Starting deletion of derivative data. [2025-10-16T20:37:05.459366] [DEBUG] [LOCAL ] NUS: No derivative data file found to delete. [2025-10-16T20:37:05.459419] [INFO ] [MAIN ] Update Progress: 1541/2369 symbols completed. NUS took 29.7s. Estimated remaining: 1h 56m 37s. Rate: 7.1 symbols/min [2025-10-16T20:37:05.548027] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-16T20:37:05.662346] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T20:37:05.697526] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:37:05.704108] [DEBUG] [LOCAL ] NVG: No existing data file found in primary storage. [2025-10-16T20:37:05.704273] [WARN ] [MAIN ] NVG: No existing data found, performing full refresh instead. [2025-10-16T20:37:05.704437] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-16T20:37:05.704805] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-16T20:37:05.704871] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-10-16T20:37:05.704906] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-16T20:37:06.058415] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:37:06.342885] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-10-16T20:37:06.901173] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T20:37:07.142844] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-10-16T20:37:07.784746] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T20:37:07.942833] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-16T20:37:08.048521] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-16T20:37:08.742859] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-16T20:37:09.310007] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T20:37:09.376286] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-16T20:37:09.542829] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-16T20:37:10.342817] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-16T20:37:10.837859] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T20:37:11.142837] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-16T20:37:11.588892] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T20:37:11.942822] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-16T20:37:12.032415] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T20:37:12.742889] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-16T20:37:13.117225] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T20:37:13.542814] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-16T20:37:14.342843] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-16T20:37:14.694095] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-16T20:37:14.758235] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-16T20:37:15.142815] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-16T20:37:15.582541] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-16T20:37:15.942799] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-16T20:37:16.306924] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T20:37:16.742832] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-16T20:37:17.422089] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T20:37:17.542789] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-16T20:37:17.596281] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-16T20:37:18.342832] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-16T20:37:19.142796] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-16T20:37:19.573019] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-16T20:37:19.639387] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-16T20:37:19.942787] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-16T20:37:20.021453] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-16T20:37:20.742879] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-16T20:37:21.160176] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-16T20:37:21.164687] [INFO ] [REMOTE ] NUV: Full fetch complete (34053 records). [2025-10-16T20:37:21.164789] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-16T20:37:21.537665] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-16T20:37:21.537754] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-16T20:37:21.538546] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-16T20:37:21.538611] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-16T20:37:21.539396] [DEBUG] [LOCAL ] NUV: Trimmed 34053 records to 23972 (keeping 200 days of data) [2025-10-16T20:37:21.589514] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-16T20:37:21.682000] [DEBUG] [LOCAL ] NUV: Primary data saved (23972 records). [2025-10-16T20:37:21.682128] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-16T20:37:21.682206] [INFO ] [MAIN ] Update Progress: 1542/2369 symbols completed. NUV took 37.6s. Estimated remaining: 1h 56m 32s. Rate: 7.1 symbols/min [2025-10-16T20:37:21.857703] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:37:21.857899] [DEBUG] [LOCAL ] NVGS: No existing data file found in primary storage. [2025-10-16T20:37:21.857955] [WARN ] [MAIN ] NVGS: No existing data found, performing full refresh instead. [2025-10-16T20:37:21.858070] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-16T20:37:21.858113] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-16T20:37:21.858156] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-16T20:37:21.858189] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-16T20:37:22.216804] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:37:22.342836] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-10-16T20:37:22.782565] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-16T20:37:22.810081] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T20:37:23.142819] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-16T20:37:23.414132] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T20:37:23.942814] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-16T20:37:24.460746] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T20:37:24.742883] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-16T20:37:25.150001] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T20:37:25.542927] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-16T20:37:26.342866] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-16T20:37:26.833513] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T20:37:26.965303] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-16T20:37:27.142837] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-16T20:37:27.519833] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T20:37:27.942888] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-16T20:37:28.172718] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T20:37:28.742891] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-16T20:37:29.442467] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T20:37:29.447507] [INFO ] [REMOTE ] NVG: Full fetch complete (39683 records). [2025-10-16T20:37:29.447681] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-16T20:37:29.448453] [FATAL] [VALIDATOR ] NVG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:37:29.448555] [FATAL] [MAIN ] NVG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:37:29.448606] [WARN ] [MAIN ] NVG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:37:29.448719] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-16T20:37:29.448800] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-10-16T20:37:29.448876] [INFO ] [LOCAL ] NVG: Starting deletion of derivative data. [2025-10-16T20:37:29.448956] [DEBUG] [LOCAL ] NVG: No derivative data file found to delete. [2025-10-16T20:37:29.449049] [INFO ] [MAIN ] Update Progress: 1543/2369 symbols completed. NVG took 24.0s. Estimated remaining: 1h 56m 24s. Rate: 7.1 symbols/min [2025-10-16T20:37:29.551513] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-16T20:37:29.637732] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:37:29.637898] [DEBUG] [LOCAL ] NVO: No existing data file found in primary storage. [2025-10-16T20:37:29.637937] [WARN ] [MAIN ] NVO: No existing data found, performing full refresh instead. [2025-10-16T20:37:29.638048] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-16T20:37:29.638088] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-16T20:37:29.638128] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-16T20:37:29.638160] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-16T20:37:30.007017] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:37:30.025724] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-16T20:37:30.032710] [INFO ] [REMOTE ] NUVB: Full fetch complete (73256 records). [2025-10-16T20:37:30.032823] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-16T20:37:30.347985] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-16T20:37:30.424361] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-10-16T20:37:30.424435] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-10-16T20:37:30.425480] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-10-16T20:37:30.425544] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-10-16T20:37:30.426923] [DEBUG] [LOCAL ] NUVB: Trimmed 73256 records to 51956 (keeping 200 days of data) [2025-10-16T20:37:30.516533] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T20:37:30.726023] [DEBUG] [LOCAL ] NUVB: Primary data saved (51956 records). [2025-10-16T20:37:30.726152] [INFO ] [MAIN ] NUVB: Full history saved. [2025-10-16T20:37:30.726223] [INFO ] [MAIN ] Update Progress: 1544/2369 symbols completed. NUVB took 40.4s. Estimated remaining: 1h 56m 11s. Rate: 7.1 symbols/min [2025-10-16T20:37:30.897460] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:37:30.917002] [DEBUG] [LOCAL ] NVR: Loaded 18536 existing records from primary storage. [2025-10-16T20:37:30.917250] [INFO ] [MAIN ] NVR: Loaded 18536 existing records. [2025-10-16T20:37:31.091723] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:37:31.091933] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-16T20:37:31.092001] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-16T20:37:31.092164] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-10-16T20:37:31.092202] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-16T20:37:31.154676] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-10-16T20:37:31.447201] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:37:31.831821] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T20:37:31.942804] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-16T20:37:32.502360] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T20:37:32.742857] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-16T20:37:33.422290] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T20:37:33.428978] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T20:37:33.542780] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-16T20:37:34.342815] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-16T20:37:35.045087] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T20:37:35.142891] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-16T20:37:35.585796] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-16T20:37:35.942816] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-16T20:37:36.639967] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T20:37:36.727938] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-16T20:37:36.742774] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-16T20:37:37.542881] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-16T20:37:37.599577] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T20:37:38.342885] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-10-16T20:37:39.067292] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T20:37:39.142814] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-16T20:37:39.640193] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T20:37:39.942923] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-16T20:37:40.171532] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T20:37:40.635735] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-16T20:37:40.742799] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-16T20:37:41.429408] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-16T20:37:41.542803] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-16T20:37:42.342847] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-16T20:37:42.545707] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T20:37:43.142822] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-16T20:37:43.550722] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T20:37:43.609799] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-16T20:37:43.942835] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-16T20:37:44.742856] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-16T20:37:45.133842] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-16T20:37:45.542821] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-16T20:37:45.891124] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T20:37:46.342788] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-16T20:37:46.696206] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T20:37:47.142869] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-16T20:37:47.708080] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T20:37:47.709188] [INFO ] [REMOTE ] NUW: Full fetch complete (10931 records). [2025-10-16T20:37:47.709259] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-16T20:37:47.919936] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T20:37:47.948505] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-16T20:37:48.140386] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-10-16T20:37:48.140546] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-10-16T20:37:48.140947] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-10-16T20:37:48.141017] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-10-16T20:37:48.141727] [DEBUG] [LOCAL ] NUW: Trimmed 10931 records to 6785 (keeping 200 days of data) [2025-10-16T20:37:48.192804] [DEBUG] [LOCAL ] NUW: Primary data saved (6785 records). [2025-10-16T20:37:48.192987] [INFO ] [MAIN ] NUW: Full history saved. [2025-10-16T20:37:48.193106] [INFO ] [MAIN ] Update Progress: 1545/2369 symbols completed. NUW took 45.8s. Estimated remaining: 1h 56m 8s. Rate: 7.1 symbols/min [2025-10-16T20:37:48.445935] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:37:48.446157] [DEBUG] [LOCAL ] NVRI: No existing data file found in primary storage. [2025-10-16T20:37:48.446207] [WARN ] [MAIN ] NVRI: No existing data found, performing full refresh instead. [2025-10-16T20:37:48.446351] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-16T20:37:48.446428] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-16T20:37:48.446523] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-16T20:37:48.446604] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-16T20:37:48.755144] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-16T20:37:48.887318] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:37:49.146237] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-16T20:37:49.542804] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-16T20:37:50.071983] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T20:37:50.291483] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T20:37:50.294934] [INFO ] [REMOTE ] NVGS: Full fetch complete (41892 records). [2025-10-16T20:37:50.295013] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-16T20:37:50.295489] [FATAL] [VALIDATOR ] NVGS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:37:50.295570] [FATAL] [MAIN ] NVGS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:37:50.295638] [WARN ] [MAIN ] NVGS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:37:50.295730] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-16T20:37:50.295793] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-16T20:37:50.295829] [INFO ] [LOCAL ] NVGS: Starting deletion of derivative data. [2025-10-16T20:37:50.295868] [DEBUG] [LOCAL ] NVGS: No derivative data file found to delete. [2025-10-16T20:37:50.295921] [INFO ] [MAIN ] Update Progress: 1546/2369 symbols completed. NVGS took 28.6s. Estimated remaining: 1h 55m 56s. Rate: 7.1 symbols/min [2025-10-16T20:37:50.352343] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-16T20:37:50.470265] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:37:50.470421] [DEBUG] [LOCAL ] NVS: No existing data file found in primary storage. [2025-10-16T20:37:50.470460] [WARN ] [MAIN ] NVS: No existing data found, performing full refresh instead. [2025-10-16T20:37:50.470676] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-16T20:37:50.470732] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-16T20:37:50.470777] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-16T20:37:50.470811] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-16T20:37:50.819592] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:37:51.142784] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-10-16T20:37:51.467418] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T20:37:51.942861] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-10-16T20:37:52.742885] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-16T20:37:53.440811] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-16T20:37:53.542778] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-16T20:37:53.608750] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T20:37:53.875375] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T20:37:54.342821] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-16T20:37:55.142841] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-16T20:37:55.323946] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T20:37:55.942813] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-16T20:37:56.614733] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T20:37:56.742810] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-16T20:37:57.317292] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-10-16T20:37:57.542792] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-16T20:37:57.833293] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-16T20:37:57.898365] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T20:37:57.953276] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-16T20:37:57.959575] [INFO ] [REMOTE ] NVO: Full fetch complete (77574 records). [2025-10-16T20:37:57.959727] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-16T20:37:57.960537] [FATAL] [VALIDATOR ] NVO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:37:57.960674] [FATAL] [MAIN ] NVO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:37:57.960751] [WARN ] [MAIN ] NVO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:37:57.960845] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-16T20:37:57.960926] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-16T20:37:57.960963] [INFO ] [LOCAL ] NVO: Starting deletion of derivative data. [2025-10-16T20:37:57.961002] [DEBUG] [LOCAL ] NVO: No derivative data file found to delete. [2025-10-16T20:37:57.961057] [INFO ] [MAIN ] Update Progress: 1547/2369 symbols completed. NVO took 28.5s. Estimated remaining: 1h 55m 47s. Rate: 7.1 symbols/min [2025-10-16T20:37:58.126676] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:37:58.126843] [DEBUG] [LOCAL ] NVST: No existing data file found in primary storage. [2025-10-16T20:37:58.126881] [WARN ] [MAIN ] NVST: No existing data found, performing full refresh instead. [2025-10-16T20:37:58.127017] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-16T20:37:58.127078] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-16T20:37:58.127126] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-16T20:37:58.127160] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-16T20:37:58.352281] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-16T20:37:58.479499] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:37:59.142891] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-10-16T20:37:59.685898] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T20:37:59.942819] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-10-16T20:38:00.742845] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-16T20:38:00.983104] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-16T20:38:01.223840] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T20:38:01.542807] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-10-16T20:38:02.342849] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-16T20:38:02.577222] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T20:38:02.610627] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T20:38:03.142818] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-16T20:38:03.942777] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-10-16T20:38:04.026886] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T20:38:04.612539] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-16T20:38:04.742804] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-10-16T20:38:05.206337] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-16T20:38:05.542803] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-16T20:38:05.598063] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-16T20:38:06.342787] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-16T20:38:07.142851] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-10. [2025-10-16T20:38:07.385491] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-16T20:38:07.942911] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-16T20:38:07.965001] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T20:38:08.299071] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-16T20:38:08.302041] [INFO ] [REMOTE ] NVR: Full fetch complete (29112 records). [2025-10-16T20:38:08.302114] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-10-16T20:38:08.665433] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-10-16T20:38:08.665510] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-10-16T20:38:08.666124] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-10-16T20:38:08.666184] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-10-16T20:38:08.666856] [DEBUG] [LOCAL ] NVR: Trimmed 29112 records to 18674 (keeping 200 days of data) [2025-10-16T20:38:08.747867] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-16T20:38:08.782845] [DEBUG] [LOCAL ] NVR: Primary data saved (18674 records). [2025-10-16T20:38:08.782977] [INFO ] [MAIN ] NVR: Full history saved. [2025-10-16T20:38:08.783056] [INFO ] [MAIN ] Update Progress: 1548/2369 symbols completed. NVR took 38.1s. Estimated remaining: 1h 55m 40s. Rate: 7.1 symbols/min [2025-10-16T20:38:08.949310] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:38:08.949479] [DEBUG] [LOCAL ] NVT: No existing data file found in primary storage. [2025-10-16T20:38:08.949515] [WARN ] [MAIN ] NVT: No existing data found, performing full refresh instead. [2025-10-16T20:38:08.949627] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-16T20:38:08.949708] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-16T20:38:08.949760] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-16T20:38:08.949840] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-16T20:38:09.306919] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:38:09.542777] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-10-16T20:38:09.889665] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-16T20:38:10.342787] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-16T20:38:10.515939] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T20:38:10.972778] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T20:38:11.142831] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-16T20:38:11.677038] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T20:38:11.942833] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-16T20:38:12.742822] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-16T20:38:12.958627] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T20:38:13.542780] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-16T20:38:13.821019] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-16T20:38:14.203972] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T20:38:14.342815] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-16T20:38:15.031902] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T20:38:15.142781] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-16T20:38:15.945024] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-16T20:38:15.949339] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T20:38:16.742793] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-16T20:38:17.321676] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-16T20:38:17.542786] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-16T20:38:17.814739] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-16T20:38:17.926002] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T20:38:18.342801] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-16T20:38:19.142741] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-16T20:38:19.435101] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-16T20:38:19.942859] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-16T20:38:20.373603] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-16T20:38:20.745938] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-16T20:38:20.751094] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T20:38:21.542828] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-16T20:38:21.823038] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-16T20:38:22.342886] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-16T20:38:22.719917] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T20:38:23.093070] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T20:38:23.098696] [INFO ] [REMOTE ] NVRI: Full fetch complete (55746 records). [2025-10-16T20:38:23.098907] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-16T20:38:23.099898] [FATAL] [VALIDATOR ] NVRI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:38:23.100077] [FATAL] [MAIN ] NVRI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:38:23.100148] [WARN ] [MAIN ] NVRI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:38:23.100199] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-16T20:38:23.100257] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-16T20:38:23.100291] [INFO ] [LOCAL ] NVRI: Starting deletion of derivative data. [2025-10-16T20:38:23.100329] [DEBUG] [LOCAL ] NVRI: No derivative data file found to delete. [2025-10-16T20:38:23.100385] [INFO ] [MAIN ] Update Progress: 1549/2369 symbols completed. NVRI took 34.9s. Estimated remaining: 1h 55m 34s. Rate: 7.1 symbols/min [2025-10-16T20:38:23.147964] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-16T20:38:23.276369] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:38:23.276667] [DEBUG] [LOCAL ] NWG: No existing data file found in primary storage. [2025-10-16T20:38:23.276777] [WARN ] [MAIN ] NWG: No existing data found, performing full refresh instead. [2025-10-16T20:38:23.276932] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-16T20:38:23.276995] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-16T20:38:23.277142] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-16T20:38:23.277197] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-16T20:38:23.471180] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-16T20:38:23.677918] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:38:23.942813] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-10-16T20:38:24.217551] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T20:38:24.229291] [INFO ] [REMOTE ] NVS: Full fetch complete (74720 records). [2025-10-16T20:38:24.229508] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-16T20:38:24.230625] [FATAL] [VALIDATOR ] NVS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:38:24.230755] [FATAL] [MAIN ] NVS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:38:24.230828] [WARN ] [MAIN ] NVS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:38:24.230903] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-16T20:38:24.230971] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-16T20:38:24.231008] [INFO ] [LOCAL ] NVS: Starting deletion of derivative data. [2025-10-16T20:38:24.231049] [DEBUG] [LOCAL ] NVS: No derivative data file found to delete. [2025-10-16T20:38:24.231105] [INFO ] [MAIN ] Update Progress: 1550/2369 symbols completed. NVS took 33.9s. Estimated remaining: 1h 55m 22s. Rate: 7.1 symbols/min [2025-10-16T20:38:24.425316] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:38:24.425486] [DEBUG] [LOCAL ] NWN: No existing data file found in primary storage. [2025-10-16T20:38:24.425523] [WARN ] [MAIN ] NWN: No existing data found, performing full refresh instead. [2025-10-16T20:38:24.425635] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-16T20:38:24.425714] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-16T20:38:24.425768] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-16T20:38:24.425808] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-16T20:38:24.748050] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-16T20:38:24.777465] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:38:25.542838] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-10-16T20:38:25.831354] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-16T20:38:26.342834] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-16T20:38:26.494328] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T20:38:26.586090] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T20:38:27.142855] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-16T20:38:27.942787] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-16T20:38:28.238718] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T20:38:28.654303] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T20:38:28.742813] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-16T20:38:29.283331] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T20:38:29.542820] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-16T20:38:30.342792] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-16T20:38:30.542598] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T20:38:30.742717] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T20:38:31.142901] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-16T20:38:31.942868] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-16T20:38:32.294430] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-16T20:38:32.742858] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-16T20:38:33.019703] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-16T20:38:33.181634] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-16T20:38:33.542817] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-16T20:38:34.342819] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-16T20:38:34.623880] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-16T20:38:35.113270] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T20:38:35.142815] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-16T20:38:35.873049] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T20:38:35.942766] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-16T20:38:36.307507] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-16T20:38:36.742808] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-16T20:38:37.542837] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-16T20:38:37.776336] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T20:38:38.342849] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-16T20:38:38.757782] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T20:38:38.958879] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T20:38:39.142807] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-16T20:38:39.942806] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-16T20:38:40.216015] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T20:38:40.573767] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T20:38:40.742901] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-16T20:38:41.542798] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-16T20:38:41.707401] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-16T20:38:41.733085] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T20:38:42.342861] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-16T20:38:42.530460] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T20:38:42.536795] [INFO ] [REMOTE ] NVST: Full fetch complete (74007 records). [2025-10-16T20:38:42.536937] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-16T20:38:42.537666] [FATAL] [VALIDATOR ] NVST: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:38:42.537782] [FATAL] [MAIN ] NVST: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:38:42.537864] [WARN ] [MAIN ] NVST: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:38:42.537947] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-16T20:38:42.538026] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-16T20:38:42.538077] [INFO ] [LOCAL ] NVST: Starting deletion of derivative data. [2025-10-16T20:38:42.538132] [DEBUG] [LOCAL ] NVST: No derivative data file found to delete. [2025-10-16T20:38:42.538208] [INFO ] [MAIN ] Update Progress: 1551/2369 symbols completed. NVST took 44.6s. Estimated remaining: 1h 55m 19s. Rate: 7.1 symbols/min [2025-10-16T20:38:42.710469] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:38:42.710674] [DEBUG] [LOCAL ] NX: No existing data file found in primary storage. [2025-10-16T20:38:42.710728] [WARN ] [MAIN ] NX: No existing data found, performing full refresh instead. [2025-10-16T20:38:42.710843] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-16T20:38:42.710883] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-16T20:38:42.710925] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-16T20:38:42.710968] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-16T20:38:43.054943] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:38:43.142818] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-10-16T20:38:43.942837] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-16T20:38:44.463382] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-16T20:38:44.658748] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T20:38:44.742789] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-16T20:38:45.240230] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T20:38:45.542943] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-16T20:38:46.037131] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T20:38:46.040250] [INFO ] [REMOTE ] NWN: Full fetch complete (37164 records). [2025-10-16T20:38:46.040379] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-16T20:38:46.040978] [FATAL] [VALIDATOR ] NWN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:38:46.041065] [FATAL] [MAIN ] NWN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:38:46.041108] [WARN ] [MAIN ] NWN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:38:46.041173] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-16T20:38:46.041265] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-16T20:38:46.041308] [INFO ] [LOCAL ] NWN: Starting deletion of derivative data. [2025-10-16T20:38:46.041355] [DEBUG] [LOCAL ] NWN: No derivative data file found to delete. [2025-10-16T20:38:46.041427] [INFO ] [MAIN ] Update Progress: 1552/2369 symbols completed. NWN took 21.8s. Estimated remaining: 1h 55m 8s. Rate: 7.1 symbols/min [2025-10-16T20:38:46.216996] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:38:46.224781] [DEBUG] [LOCAL ] NXC: Loaded 4142 existing records from primary storage. [2025-10-16T20:38:46.241220] [INFO ] [MAIN ] NXC: Loaded 4142 existing records. [2025-10-16T20:38:46.347943] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-16T20:38:46.347835] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T20:38:46.447954] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:38:46.448158] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-16T20:38:46.448205] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-16T20:38:46.448421] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-10-16T20:38:46.448478] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-16T20:38:46.793979] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:38:47.142824] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-10-16T20:38:47.740850] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T20:38:47.942824] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-16T20:38:47.955782] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-16T20:38:48.742817] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-16T20:38:49.327073] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T20:38:49.542788] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-16T20:38:49.755283] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T20:38:50.342814] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-16T20:38:51.142802] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-16T20:38:51.215574] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T20:38:51.942778] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-16T20:38:52.322073] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T20:38:52.502684] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-16T20:38:52.677001] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T20:38:52.742790] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-16T20:38:53.542823] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-16T20:38:54.347302] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-16T20:38:54.351965] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T20:38:55.142784] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-16T20:38:55.235542] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T20:38:55.264895] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T20:38:55.271869] [INFO ] [REMOTE ] NVT: Full fetch complete (74442 records). [2025-10-16T20:38:55.272027] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-16T20:38:55.272971] [FATAL] [VALIDATOR ] NVT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:38:55.273093] [FATAL] [MAIN ] NVT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:38:55.273149] [WARN ] [MAIN ] NVT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:38:55.273219] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-16T20:38:55.273299] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-16T20:38:55.273378] [INFO ] [LOCAL ] NVT: Starting deletion of derivative data. [2025-10-16T20:38:55.273459] [DEBUG] [LOCAL ] NVT: No derivative data file found to delete. [2025-10-16T20:38:55.273528] [INFO ] [MAIN ] Update Progress: 1553/2369 symbols completed. NVT took 46.5s. Estimated remaining: 1h 54m 60s. Rate: 7.1 symbols/min [2025-10-16T20:38:55.454366] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:38:55.454555] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-16T20:38:55.454591] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-16T20:38:55.454726] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-16T20:38:55.454772] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-16T20:38:55.454813] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-16T20:38:55.454844] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-16T20:38:55.800428] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:38:55.886411] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T20:38:55.942789] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-10-16T20:38:56.217942] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:38:56.218302] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-10-16T20:38:56.218409] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:38:56.218501] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-16T20:38:56.218576] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:38:56.218674] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-16T20:38:56.218779] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-16T20:38:56.218835] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-16T20:38:56.218880] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-16T20:38:56.218928] [INFO ] [MAIN ] Update Progress: 1554/2369 symbols completed. NXDR took 0.9s. Estimated remaining: 1h 54m 47s. Rate: 7.1 symbols/min [2025-10-16T20:38:56.439726] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:38:56.456761] [DEBUG] [LOCAL ] NXDT: Loaded 14958 existing records from primary storage. [2025-10-16T20:38:56.457046] [INFO ] [MAIN ] NXDT: Loaded 14958 existing records. [2025-10-16T20:38:56.641826] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:38:56.642033] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-16T20:38:56.642081] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-16T20:38:56.642237] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-10-16T20:38:56.642276] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-16T20:38:56.744376] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-16T20:38:57.011160] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:38:57.542813] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-10-16T20:38:58.327146] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T20:38:58.342771] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-16T20:38:58.705089] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T20:38:59.142828] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-16T20:38:59.814512] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T20:38:59.942793] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-16T20:38:59.956854] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-16T20:39:00.742794] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-16T20:39:00.844969] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T20:39:01.542824] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-16T20:39:02.319268] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T20:39:02.342795] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-16T20:39:02.813030] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-16T20:39:02.831109] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-16T20:39:03.142831] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-16T20:39:03.868966] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-16T20:39:03.942787] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-16T20:39:04.742863] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-16T20:39:05.094950] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T20:39:05.168878] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-16T20:39:05.542797] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-16T20:39:06.342822] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-16T20:39:07.017081] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T20:39:07.142786] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-16T20:39:07.213907] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T20:39:07.219932] [INFO ] [REMOTE ] NWG: Full fetch complete (73580 records). [2025-10-16T20:39:07.220046] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-16T20:39:07.220863] [FATAL] [VALIDATOR ] NWG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:39:07.220947] [FATAL] [MAIN ] NWG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:39:07.221014] [WARN ] [MAIN ] NWG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:39:07.221087] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-16T20:39:07.221152] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-16T20:39:07.221188] [INFO ] [LOCAL ] NWG: Starting deletion of derivative data. [2025-10-16T20:39:07.221228] [DEBUG] [LOCAL ] NWG: No derivative data file found to delete. [2025-10-16T20:39:07.221284] [INFO ] [MAIN ] Update Progress: 1555/2369 symbols completed. NWG took 44.1s. Estimated remaining: 1h 54m 40s. Rate: 7.1 symbols/min [2025-10-16T20:39:07.388272] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:39:07.437987] [DEBUG] [LOCAL ] NXE: Loaded 53044 existing records from primary storage. [2025-10-16T20:39:07.438340] [INFO ] [MAIN ] NXE: Loaded 53044 existing records. [2025-10-16T20:39:07.610681] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:39:07.610927] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-16T20:39:07.610984] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-16T20:39:07.611183] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-10-16T20:39:07.611238] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-16T20:39:07.947519] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-16T20:39:07.961017] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:39:08.742847] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-10-16T20:39:08.769896] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T20:39:09.164532] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T20:39:09.542806] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-16T20:39:10.342791] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-16T20:39:10.810372] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-16T20:39:11.097481] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T20:39:11.146076] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T20:39:11.145348] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-16T20:39:11.942837] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-16T20:39:12.380782] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-16T20:39:12.742817] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-16T20:39:13.542846] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-16T20:39:13.638765] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T20:39:13.914521] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T20:39:14.342786] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-16T20:39:14.788096] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-16T20:39:14.789089] [INFO ] [REMOTE ] NXC: Full fetch complete (5698 records). [2025-10-16T20:39:14.789181] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-16T20:39:15.141160] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-16T20:39:15.141254] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-16T20:39:15.141452] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-16T20:39:15.141493] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-16T20:39:15.141881] [DEBUG] [LOCAL ] NXC: Trimmed 5698 records to 4147 (keeping 200 days of data) [2025-10-16T20:39:15.152711] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-16T20:39:15.171113] [DEBUG] [LOCAL ] NXC: Primary data saved (4147 records). [2025-10-16T20:39:15.171873] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-16T20:39:15.172008] [INFO ] [MAIN ] Update Progress: 1556/2369 symbols completed. NXC took 29.1s. Estimated remaining: 1h 54m 32s. Rate: 7.1 symbols/min [2025-10-16T20:39:15.344715] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:39:15.345033] [DEBUG] [LOCAL ] NXG: No existing data file found in primary storage. [2025-10-16T20:39:15.345087] [WARN ] [MAIN ] NXG: No existing data found, performing full refresh instead. [2025-10-16T20:39:15.369330] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-16T20:39:15.372169] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-16T20:39:15.372306] [DEBUG] [LOCAL ] NXG: No primary data file found to delete. [2025-10-16T20:39:15.372358] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-16T20:39:15.418507] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-16T20:39:15.742139] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T20:39:15.771938] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:39:15.773073] [INFO ] [REMOTE ] NX: Full fetch complete (47897 records). [2025-10-16T20:39:15.773250] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-16T20:39:15.774006] [FATAL] [VALIDATOR ] NX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:39:15.774093] [FATAL] [MAIN ] NX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:39:15.774137] [WARN ] [MAIN ] NX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:39:15.774205] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-16T20:39:15.774271] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-16T20:39:15.774308] [INFO ] [LOCAL ] NX: Starting deletion of derivative data. [2025-10-16T20:39:15.774347] [DEBUG] [LOCAL ] NX: No derivative data file found to delete. [2025-10-16T20:39:15.774405] [INFO ] [MAIN ] Update Progress: 1557/2369 symbols completed. NX took 33.2s. Estimated remaining: 1h 54m 19s. Rate: 7.1 symbols/min [2025-10-16T20:39:15.942829] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-16T20:39:16.742821] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-16T20:39:17.542811] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-10-16T20:39:17.688518] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T20:39:17.723042] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T20:39:18.342827] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-16T20:39:18.494931] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T20:39:19.110607] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T20:39:19.142823] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-16T20:39:19.942843] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-16T20:39:19.964732] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T20:39:20.742864] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-16T20:39:21.542772] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-16T20:39:21.791583] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T20:39:21.852711] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-16T20:39:22.268153] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T20:39:22.342802] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-16T20:39:23.142792] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-16T20:39:23.247998] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-16T20:39:23.797327] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T20:39:23.942823] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-16T20:39:24.742843] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-16T20:39:24.848554] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T20:39:25.542854] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-16T20:39:26.342832] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-16T20:39:26.448889] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T20:39:26.622036] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T20:39:26.992982] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-16T20:39:26.995215] [INFO ] [REMOTE ] NXDT: Full fetch complete (24411 records). [2025-10-16T20:39:26.995288] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-16T20:39:27.150366] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-16T20:39:27.371161] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-10-16T20:39:27.371237] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-10-16T20:39:27.371825] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-10-16T20:39:27.371898] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-10-16T20:39:27.372534] [DEBUG] [LOCAL ] NXDT: Trimmed 24411 records to 15151 (keeping 200 days of data) [2025-10-16T20:39:27.457782] [DEBUG] [LOCAL ] NXDT: Primary data saved (15151 records). [2025-10-16T20:39:27.457917] [INFO ] [MAIN ] NXDT: Full history saved. [2025-10-16T20:39:27.457997] [INFO ] [MAIN ] Update Progress: 1558/2369 symbols completed. NXDT took 31.2s. Estimated remaining: 1h 54m 12s. Rate: 7.1 symbols/min [2025-10-16T20:39:27.942843] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-16T20:39:28.220050] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T20:39:28.742863] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-16T20:39:29.705762] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T20:39:29.709159] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-16T20:39:29.924975] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-16T20:39:30.342847] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-16T20:39:30.637863] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T20:39:31.142867] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-16T20:39:32.233598] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T20:39:32.236915] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-16T20:39:32.729848] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-16T20:39:32.742777] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-16T20:39:33.110508] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T20:39:33.112429] [INFO ] [REMOTE ] NXG: Full fetch complete (14621 records). [2025-10-16T20:39:33.112511] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-16T20:39:33.488920] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-10-16T20:39:33.489001] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-10-16T20:39:33.489343] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-10-16T20:39:33.489383] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-10-16T20:39:33.489937] [DEBUG] [LOCAL ] NXG: Trimmed 14621 records to 10561 (keeping 200 days of data) [2025-10-16T20:39:33.554314] [DEBUG] [LOCAL ] NXG: Primary data saved (10561 records). [2025-10-16T20:39:33.554452] [INFO ] [MAIN ] NXG: Full history saved. [2025-10-16T20:39:33.554524] [INFO ] [MAIN ] Update Progress: 1559/2369 symbols completed. NXG took 18.4s. Estimated remaining: 1h 54m 3s. Rate: 7.1 symbols/min [2025-10-16T20:39:34.919685] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-16T20:39:34.931507] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-16T20:39:36.904896] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T20:39:36.916006] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-16T20:39:38.976711] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-16T20:39:38.987981] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-16T20:39:41.124407] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-16T20:39:41.131271] [INFO ] [REMOTE ] NXE: Full fetch complete (76945 records). [2025-10-16T20:39:41.131397] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-16T20:39:41.522792] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-10-16T20:39:41.522916] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-10-16T20:39:41.524019] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-10-16T20:39:41.524079] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-10-16T20:39:41.525480] [DEBUG] [LOCAL ] NXE: Trimmed 76945 records to 53434 (keeping 200 days of data) [2025-10-16T20:39:41.829011] [DEBUG] [LOCAL ] NXE: Primary data saved (53434 records). [2025-10-16T20:39:41.829160] [INFO ] [MAIN ] NXE: Full history saved. [2025-10-16T20:39:41.829796] [INFO ] [MAIN ] Update Progress: 1560/2369 symbols completed. NXE took 34.6s. Estimated remaining: 1h 53m 54s. Rate: 7.1 symbols/min [2025-10-16T20:39:42.423160] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:39:42.451622] [DEBUG] [LOCAL ] NXJ: No existing data file found in primary storage. [2025-10-16T20:39:42.533393] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:39:42.530290] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:39:42.533518] [WARN ] [MAIN ] NXJ: No existing data found, performing full refresh instead. [2025-10-16T20:39:42.534472] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:39:42.534682] [DEBUG] [LOCAL ] NXRT: No existing data file found in primary storage. [2025-10-16T20:39:42.535242] [WARN ] [MAIN ] NXRT: No existing data found, performing full refresh instead. [2025-10-16T20:39:42.535723] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-16T20:39:42.535852] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-16T20:39:42.535928] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-16T20:39:42.535972] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-16T20:39:42.535767] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-16T20:39:42.542013] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-16T20:39:42.559665] [DEBUG] [LOCAL ] NXJ: No primary data file found to delete. [2025-10-16T20:39:42.619462] [DEBUG] [LOCAL ] NXN: Loaded 2264 existing records from primary storage. [2025-10-16T20:39:42.624886] [INFO ] [MAIN ] NXN: Loaded 2264 existing records. [2025-10-16T20:39:42.602039] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-16T20:39:42.745488] [DEBUG] [LOCAL ] NXP: Loaded 12319 existing records from primary storage. [2025-10-16T20:39:42.836564] [INFO ] [MAIN ] NXP: Loaded 12319 existing records. [2025-10-16T20:39:43.127665] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:39:43.205175] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-16T20:39:43.237177] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-16T20:39:43.283582] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-10-16T20:39:43.318474] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-16T20:39:43.480438] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:39:43.561335] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:39:43.613256] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-10-16T20:39:43.586594] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-16T20:39:43.637064] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-16T20:39:43.691666] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-10-16T20:39:43.691945] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-16T20:39:43.898342] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:39:43.925272] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-10-16T20:39:44.327848] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:39:44.328198] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-10-16T20:39:44.407213] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:39:44.407517] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-10-16T20:39:44.596440] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T20:39:44.599483] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-16T20:39:45.420810] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T20:39:45.425225] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-16T20:39:45.455579] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T20:39:45.456966] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-16T20:39:45.493300] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T20:39:45.496504] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-16T20:39:45.554296] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T20:39:45.557541] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-16T20:39:46.130260] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T20:39:46.131547] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-16T20:39:46.176421] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T20:39:46.179824] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-16T20:39:46.252492] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T20:39:46.255600] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-16T20:39:46.332238] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T20:39:46.335864] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-16T20:39:46.730072] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T20:39:46.731571] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-16T20:39:46.809923] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T20:39:46.883810] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-16T20:39:47.142793] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-16T20:39:47.281274] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-16T20:39:47.412390] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-16T20:39:47.849121] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-16T20:39:47.942880] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-16T20:39:48.472099] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-16T20:39:48.742874] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-16T20:39:49.542847] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-16T20:39:49.668099] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-16T20:39:50.342789] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-16T20:39:50.739994] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-16T20:39:51.142852] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-16T20:39:51.404535] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T20:39:51.942777] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-16T20:39:52.303847] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-16T20:39:52.742823] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-16T20:39:52.983970] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-16T20:39:53.296839] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-16T20:39:53.542834] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-16T20:39:54.342786] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-16T20:39:54.612271] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T20:39:55.142795] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-16T20:39:55.402685] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T20:39:55.942880] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-16T20:39:55.972205] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T20:39:56.577327] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T20:39:56.742805] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-16T20:39:57.542796] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-16T20:39:57.851243] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T20:39:58.342783] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-16T20:39:58.464542] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T20:39:59.142798] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-16T20:39:59.400124] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T20:39:59.942829] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-16T20:40:00.146898] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-16T20:40:00.742813] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-16T20:40:01.175135] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T20:40:01.253300] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-16T20:40:01.542843] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-16T20:40:02.342857] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-16T20:40:02.805034] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-16T20:40:03.142870] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-16T20:40:03.350517] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T20:40:03.942806] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-16T20:40:04.093191] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T20:40:04.742835] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-16T20:40:04.874860] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T20:40:05.201575] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-16T20:40:05.203389] [INFO ] [REMOTE ] NXJ: Full fetch complete (20441 records). [2025-10-16T20:40:05.203460] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-16T20:40:05.203915] [FATAL] [VALIDATOR ] NXJ: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:40:05.203998] [FATAL] [MAIN ] NXJ: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:40:05.204039] [WARN ] [MAIN ] NXJ: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:40:05.204105] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-16T20:40:05.204170] [DEBUG] [LOCAL ] NXJ: No primary data file found to delete. [2025-10-16T20:40:05.204205] [INFO ] [LOCAL ] NXJ: Starting deletion of derivative data. [2025-10-16T20:40:05.204243] [DEBUG] [LOCAL ] NXJ: No derivative data file found to delete. [2025-10-16T20:40:05.204293] [INFO ] [MAIN ] Update Progress: 1561/2369 symbols completed. NXJ took 23.4s. Estimated remaining: 1h 53m 53s. Rate: 7.1 symbols/min [2025-10-16T20:40:05.370691] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:40:05.370868] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-16T20:40:05.370905] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-16T20:40:05.371014] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-16T20:40:05.371054] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-16T20:40:05.371094] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-16T20:40:05.371126] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-16T20:40:05.546937] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-16T20:40:05.738447] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:40:06.342812] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-10-16T20:40:06.668531] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T20:40:06.879754] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-16T20:40:07.142782] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-16T20:40:07.942885] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-16T20:40:08.157921] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T20:40:08.566967] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-16T20:40:08.742826] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-16T20:40:09.295417] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T20:40:09.542875] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-16T20:40:10.151514] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-16T20:40:10.342794] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-16T20:40:10.902181] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-16T20:40:10.903074] [INFO ] [REMOTE ] NXN: Full fetch complete (3490 records). [2025-10-16T20:40:10.903143] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-16T20:40:11.148041] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-16T20:40:11.254931] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-16T20:40:11.255001] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-16T20:40:11.255110] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-16T20:40:11.255147] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-16T20:40:11.255469] [DEBUG] [LOCAL ] NXN: Trimmed 3490 records to 2271 (keeping 200 days of data) [2025-10-16T20:40:11.269166] [DEBUG] [LOCAL ] NXN: Primary data saved (2271 records). [2025-10-16T20:40:11.269223] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-16T20:40:11.269298] [INFO ] [MAIN ] Update Progress: 1562/2369 symbols completed. NXN took 29.4s. Estimated remaining: 1h 53m 44s. Rate: 7.1 symbols/min [2025-10-16T20:40:11.435483] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:40:11.435672] [DEBUG] [LOCAL ] NYT: No existing data file found in primary storage. [2025-10-16T20:40:11.435728] [WARN ] [MAIN ] NYT: No existing data found, performing full refresh instead. [2025-10-16T20:40:11.435842] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-16T20:40:11.435910] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-16T20:40:11.435977] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-16T20:40:11.436022] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-16T20:40:11.761216] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T20:40:11.803622] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:40:11.942774] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-10-16T20:40:12.742878] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-16T20:40:13.532025] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T20:40:13.533925] [INFO ] [REMOTE ] NXP: Full fetch complete (16826 records). [2025-10-16T20:40:13.533994] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-16T20:40:13.547904] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-16T20:40:13.902567] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-16T20:40:13.902672] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-16T20:40:13.903069] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-16T20:40:13.903111] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-16T20:40:13.903732] [DEBUG] [LOCAL ] NXP: Trimmed 16826 records to 12378 (keeping 200 days of data) [2025-10-16T20:40:13.989912] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-16T20:40:14.016704] [DEBUG] [LOCAL ] NXP: Primary data saved (12378 records). [2025-10-16T20:40:14.016857] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-16T20:40:14.016961] [INFO ] [MAIN ] Update Progress: 1563/2369 symbols completed. NXP took 32.2s. Estimated remaining: 1h 53m 32s. Rate: 7.1 symbols/min [2025-10-16T20:40:14.206078] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:40:14.206233] [DEBUG] [LOCAL ] NZF: No existing data file found in primary storage. [2025-10-16T20:40:14.206270] [WARN ] [MAIN ] NZF: No existing data found, performing full refresh instead. [2025-10-16T20:40:14.206377] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-16T20:40:14.206417] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-16T20:40:14.206457] [DEBUG] [LOCAL ] NZF: No primary data file found to delete. [2025-10-16T20:40:14.206489] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-16T20:40:14.299574] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-16T20:40:14.349463] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-16T20:40:14.563128] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:40:15.142777] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-16T20:40:15.531825] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-16T20:40:15.942814] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-10-16T20:40:16.742804] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-16T20:40:16.835078] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T20:40:17.016487] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-16T20:40:17.019287] [INFO ] [REMOTE ] NXRT: Full fetch complete (25748 records). [2025-10-16T20:40:17.019381] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-16T20:40:17.019911] [FATAL] [VALIDATOR ] NXRT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:40:17.019996] [FATAL] [MAIN ] NXRT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:40:17.020038] [WARN ] [MAIN ] NXRT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:40:17.020088] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-16T20:40:17.020165] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-16T20:40:17.020202] [INFO ] [LOCAL ] NXRT: Starting deletion of derivative data. [2025-10-16T20:40:17.020241] [DEBUG] [LOCAL ] NXRT: No derivative data file found to delete. [2025-10-16T20:40:17.020297] [INFO ] [MAIN ] Update Progress: 1564/2369 symbols completed. NXRT took 35.2s. Estimated remaining: 1h 53m 21s. Rate: 7.1 symbols/min [2025-10-16T20:40:17.190527] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:40:17.190753] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-16T20:40:17.190800] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-16T20:40:17.190925] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-16T20:40:17.190966] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-16T20:40:17.191006] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-16T20:40:17.191037] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-16T20:40:17.546149] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-16T20:40:17.569632] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:40:17.823098] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T20:40:18.342816] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-16T20:40:18.705365] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-16T20:40:19.147926] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-10-16T20:40:19.162761] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T20:40:19.942839] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-16T20:40:20.742831] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-16T20:40:21.251747] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-16T20:40:21.542820] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-16T20:40:21.924514] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-16T20:40:21.966399] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.82 seconds). [2025-10-16T20:40:22.342819] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-16T20:40:22.977866] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T20:40:23.142795] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-16T20:40:23.942815] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-16T20:40:24.267767] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T20:40:24.360114] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-16T20:40:24.749810] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-16T20:40:24.756081] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-16T20:40:25.542806] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-16T20:40:26.342786] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-16T20:40:26.704160] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T20:40:26.771157] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-16T20:40:27.142809] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-16T20:40:27.794348] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T20:40:27.942821] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-16T20:40:28.143786] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-16T20:40:28.415137] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-16T20:40:28.415906] [INFO ] [REMOTE ] NYC: Full fetch complete (1865 records). [2025-10-16T20:40:28.415975] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-16T20:40:28.595335] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-16T20:40:28.595529] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:40:28.595597] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:40:28.595691] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-16T20:40:28.595761] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-16T20:40:28.595798] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-16T20:40:28.595837] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-16T20:40:28.595889] [INFO ] [MAIN ] Update Progress: 1565/2369 symbols completed. NYC took 23.4s. Estimated remaining: 1h 53m 14s. Rate: 7.1 symbols/min [2025-10-16T20:40:28.749172] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-16T20:40:28.766814] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:40:28.767854] [DEBUG] [LOCAL ] OBDC: No existing data file found in primary storage. [2025-10-16T20:40:28.767905] [WARN ] [MAIN ] OBDC: No existing data found, performing full refresh instead. [2025-10-16T20:40:28.768071] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-16T20:40:28.768166] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-16T20:40:28.768218] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-16T20:40:28.768281] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-16T20:40:29.113267] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:40:29.542810] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-16T20:40:30.342820] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-16T20:40:31.142846] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-10-16T20:40:31.391376] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-16T20:40:31.465940] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-16T20:40:31.521878] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T20:40:31.942852] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-16T20:40:32.747932] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-16T20:40:32.766515] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T20:40:33.542736] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-16T20:40:33.653759] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T20:40:34.342794] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-16T20:40:35.142790] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-16T20:40:35.409783] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T20:40:35.456711] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-16T20:40:35.942809] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-16T20:40:36.244582] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-16T20:40:36.602276] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T20:40:36.742824] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-16T20:40:37.542831] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-16T20:40:37.863021] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-16T20:40:37.902380] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-16T20:40:38.342811] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-16T20:40:39.142840] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-16T20:40:39.942790] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-16T20:40:40.152717] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-16T20:40:40.264593] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T20:40:40.742983] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-16T20:40:40.977465] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T20:40:41.335520] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T20:40:41.542812] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-16T20:40:42.342821] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-16T20:40:42.548261] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T20:40:43.017199] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T20:40:43.142816] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-16T20:40:43.943114] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-16T20:40:43.949518] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T20:40:44.490524] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T20:40:44.742819] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-16T20:40:45.277548] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-16T20:40:45.283512] [INFO ] [REMOTE ] NYT: Full fetch complete (71887 records). [2025-10-16T20:40:45.283721] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-16T20:40:45.284537] [FATAL] [VALIDATOR ] NYT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:40:45.284630] [FATAL] [MAIN ] NYT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:40:45.284735] [WARN ] [MAIN ] NYT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:40:45.284784] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-16T20:40:45.284871] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-16T20:40:45.284939] [INFO ] [LOCAL ] NYT: Starting deletion of derivative data. [2025-10-16T20:40:45.285005] [DEBUG] [LOCAL ] NYT: No derivative data file found to delete. [2025-10-16T20:40:45.285070] [INFO ] [MAIN ] Update Progress: 1566/2369 symbols completed. NYT took 34.0s. Estimated remaining: 1h 53m 10s. Rate: 7.1 symbols/min [2025-10-16T20:40:45.457067] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:40:45.457229] [DEBUG] [LOCAL ] OBK: No existing data file found in primary storage. [2025-10-16T20:40:45.457265] [WARN ] [MAIN ] OBK: No existing data found, performing full refresh instead. [2025-10-16T20:40:45.457375] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-16T20:40:45.457419] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-16T20:40:45.457460] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-16T20:40:45.457490] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-16T20:40:45.548278] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-16T20:40:45.825362] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:40:46.342815] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-16T20:40:46.395671] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-16T20:40:47.142837] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-16T20:40:47.500391] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-16T20:40:47.683153] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T20:40:47.942812] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-16T20:40:48.734806] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T20:40:48.738822] [INFO ] [REMOTE ] NZF: Full fetch complete (42258 records). [2025-10-16T20:40:48.738978] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-16T20:40:48.739681] [FATAL] [VALIDATOR ] NZF: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:40:48.739776] [FATAL] [MAIN ] NZF: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:40:48.739821] [WARN ] [MAIN ] NZF: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:40:48.739869] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-16T20:40:48.739935] [DEBUG] [LOCAL ] NZF: No primary data file found to delete. [2025-10-16T20:40:48.739972] [INFO ] [LOCAL ] NZF: Starting deletion of derivative data. [2025-10-16T20:40:48.740012] [DEBUG] [LOCAL ] NZF: No derivative data file found to delete. [2025-10-16T20:40:48.740074] [INFO ] [MAIN ] Update Progress: 1567/2369 symbols completed. NZF took 34.7s. Estimated remaining: 1h 52m 59s. Rate: 7.1 symbols/min [2025-10-16T20:40:48.752604] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-10-16T20:40:48.916756] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:40:48.916982] [DEBUG] [LOCAL ] OC: No existing data file found in primary storage. [2025-10-16T20:40:48.917024] [WARN ] [MAIN ] OC: No existing data found, performing full refresh instead. [2025-10-16T20:40:48.917100] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-16T20:40:48.917143] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-16T20:40:48.917212] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-16T20:40:48.917250] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-16T20:40:49.274228] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:40:49.542801] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-10-16T20:40:49.990845] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-10-16T20:40:50.013833] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T20:40:50.342819] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-16T20:40:50.862586] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T20:40:51.142865] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-16T20:40:51.234947] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T20:40:51.942872] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-16T20:40:52.742892] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-16T20:40:52.823872] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T20:40:53.015180] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T20:40:53.542866] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-16T20:40:54.342818] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-16T20:40:55.142791] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-16T20:40:55.330529] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T20:40:55.380632] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-16T20:40:55.721253] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T20:40:55.816390] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-16T20:40:55.942835] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-16T20:40:56.742859] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-16T20:40:57.072617] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T20:40:57.542904] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-16T20:40:58.342885] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-16T20:40:58.557697] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T20:40:59.142818] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-16T20:40:59.890382] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-16T20:40:59.952148] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-16T20:40:59.971920] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T20:41:00.742752] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-16T20:41:01.059668] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T20:41:01.066101] [INFO ] [REMOTE ] O: Full fetch complete (77182 records). [2025-10-16T20:41:01.066251] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-16T20:41:01.067027] [FATAL] [VALIDATOR ] O: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:41:01.067120] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:41:01.067164] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:41:01.067234] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-16T20:41:01.067300] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-16T20:41:01.067358] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-16T20:41:01.067398] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-16T20:41:01.067453] [INFO ] [MAIN ] Update Progress: 1568/2369 symbols completed. O took 44.0s. Estimated remaining: 1h 52m 52s. Rate: 7.1 symbols/min [2025-10-16T20:41:01.247442] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:41:01.256836] [DEBUG] [LOCAL ] OCFT: Loaded 7359 existing records from primary storage. [2025-10-16T20:41:01.257061] [INFO ] [MAIN ] OCFT: Loaded 7359 existing records. [2025-10-16T20:41:01.468167] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:41:01.468706] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-16T20:41:01.469030] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-16T20:41:01.470451] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-16T20:41:01.473987] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-10-16T20:41:01.480610] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-16T20:41:01.549162] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-16T20:41:01.883130] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:41:02.342804] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-16T20:41:02.421145] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T20:41:02.660862] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-16T20:41:03.142891] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-10-16T20:41:03.796678] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-16T20:41:03.942765] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-16T20:41:04.291593] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-16T20:41:04.612804] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-16T20:41:04.742826] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-16T20:41:05.542851] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-16T20:41:06.342865] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-16T20:41:06.681145] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-16T20:41:06.741975] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-16T20:41:07.142793] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-16T20:41:07.282191] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T20:41:07.942842] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-16T20:41:08.084272] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T20:41:08.090571] [INFO ] [REMOTE ] OBDC: Full fetch complete (74951 records). [2025-10-16T20:41:08.090729] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-16T20:41:08.091386] [FATAL] [VALIDATOR ] OBDC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:41:08.091475] [FATAL] [MAIN ] OBDC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:41:08.091518] [WARN ] [MAIN ] OBDC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:41:08.091557] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-16T20:41:08.091612] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-16T20:41:08.091698] [INFO ] [LOCAL ] OBDC: Starting deletion of derivative data. [2025-10-16T20:41:08.091794] [DEBUG] [LOCAL ] OBDC: No derivative data file found to delete. [2025-10-16T20:41:08.091859] [INFO ] [MAIN ] Update Progress: 1569/2369 symbols completed. OBDC took 39.5s. Estimated remaining: 1h 52m 43s. Rate: 7.1 symbols/min [2025-10-16T20:41:08.256163] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:41:08.266450] [DEBUG] [LOCAL ] ODC: Loaded 8543 existing records from primary storage. [2025-10-16T20:41:08.266679] [INFO ] [MAIN ] ODC: Loaded 8543 existing records. [2025-10-16T20:41:08.444004] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:41:08.444231] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-16T20:41:08.444281] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-16T20:41:08.444432] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-10-16T20:41:08.444472] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-16T20:41:08.754158] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-16T20:41:08.793914] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:41:09.045142] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T20:41:09.542797] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-16T20:41:09.747749] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T20:41:10.342779] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-16T20:41:10.601807] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T20:41:11.141434] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-16T20:41:11.145526] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-16T20:41:11.942782] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-16T20:41:12.247077] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T20:41:12.742818] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-10-16T20:41:13.492549] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T20:41:13.542782] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-16T20:41:13.670577] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T20:41:14.236856] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T20:41:14.239522] [INFO ] [REMOTE ] OBK: Full fetch complete (23788 records). [2025-10-16T20:41:14.239678] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-16T20:41:14.240226] [FATAL] [VALIDATOR ] OBK: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:41:14.240328] [FATAL] [MAIN ] OBK: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:41:14.240402] [WARN ] [MAIN ] OBK: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:41:14.240490] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-16T20:41:14.240564] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-16T20:41:14.240601] [INFO ] [LOCAL ] OBK: Starting deletion of derivative data. [2025-10-16T20:41:14.240720] [DEBUG] [LOCAL ] OBK: No derivative data file found to delete. [2025-10-16T20:41:14.240832] [INFO ] [MAIN ] Update Progress: 1570/2369 symbols completed. OBK took 29.0s. Estimated remaining: 1h 52m 34s. Rate: 7.1 symbols/min [2025-10-16T20:41:14.346018] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-16T20:41:14.419478] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:41:14.448535] [DEBUG] [LOCAL ] ODV: Loaded 28950 existing records from primary storage. [2025-10-16T20:41:14.448902] [INFO ] [MAIN ] ODV: Loaded 28950 existing records. [2025-10-16T20:41:14.626570] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:41:14.626833] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-16T20:41:14.626891] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-16T20:41:14.627064] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-10-16T20:41:14.627101] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-16T20:41:14.986952] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:41:15.142784] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-16T20:41:15.333395] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T20:41:15.939603] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T20:41:15.942755] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-16T20:41:16.707139] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T20:41:16.742763] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-16T20:41:17.542808] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-16T20:41:17.666290] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-16T20:41:18.342819] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-16T20:41:19.147895] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-10-16T20:41:19.173360] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T20:41:19.175552] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T20:41:19.942817] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-16T20:41:20.360592] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-16T20:41:20.724200] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T20:41:20.742803] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-16T20:41:21.542817] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-16T20:41:21.624959] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T20:41:22.342856] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-16T20:41:23.142813] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-16T20:41:23.233363] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T20:41:23.261139] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T20:41:23.942866] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-16T20:41:23.978890] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-16T20:41:24.573388] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T20:41:24.742889] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-16T20:41:25.542843] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-16T20:41:25.573788] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T20:41:26.342852] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-16T20:41:26.401512] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-16T20:41:27.142847] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-16T20:41:27.207310] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-16T20:41:27.942815] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-16T20:41:28.225368] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-16T20:41:28.635470] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-16T20:41:28.742801] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-16T20:41:29.542837] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-16T20:41:29.639101] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-16T20:41:30.016986] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-16T20:41:30.022988] [INFO ] [REMOTE ] OC: Full fetch complete (64201 records). [2025-10-16T20:41:30.023113] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-16T20:41:30.023940] [FATAL] [VALIDATOR ] OC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:41:30.024054] [FATAL] [MAIN ] OC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:41:30.024130] [WARN ] [MAIN ] OC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:41:30.024220] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-16T20:41:30.024297] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-16T20:41:30.024334] [INFO ] [LOCAL ] OC: Starting deletion of derivative data. [2025-10-16T20:41:30.024375] [DEBUG] [LOCAL ] OC: No derivative data file found to delete. [2025-10-16T20:41:30.024432] [INFO ] [MAIN ] Update Progress: 1571/2369 symbols completed. OC took 41.3s. Estimated remaining: 1h 52m 29s. Rate: 7.1 symbols/min [2025-10-16T20:41:30.191792] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:41:30.191943] [DEBUG] [LOCAL ] OEC: No existing data file found in primary storage. [2025-10-16T20:41:30.191979] [WARN ] [MAIN ] OEC: No existing data found, performing full refresh instead. [2025-10-16T20:41:30.192118] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-16T20:41:30.192185] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-16T20:41:30.192235] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-16T20:41:30.192268] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-16T20:41:30.345397] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-16T20:41:30.551501] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:41:31.142863] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-10-16T20:41:31.693769] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T20:41:31.942857] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-16T20:41:32.667089] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T20:41:32.742864] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-16T20:41:33.016991] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-16T20:41:33.542925] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-16T20:41:34.164000] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T20:41:34.178751] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T20:41:34.342871] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-16T20:41:35.142845] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-16T20:41:35.284778] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-16T20:41:35.942812] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-16T20:41:36.241074] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T20:41:36.510067] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T20:41:36.511837] [INFO ] [REMOTE ] ODC: Full fetch complete (11224 records). [2025-10-16T20:41:36.511909] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-16T20:41:36.748031] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-16T20:41:36.896276] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-10-16T20:41:36.896376] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-10-16T20:41:36.896750] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-10-16T20:41:36.896813] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-10-16T20:41:36.897381] [DEBUG] [LOCAL ] ODC: Trimmed 11224 records to 8619 (keeping 200 days of data) [2025-10-16T20:41:36.949581] [DEBUG] [LOCAL ] ODC: Primary data saved (8619 records). [2025-10-16T20:41:36.949750] [INFO ] [MAIN ] ODC: Full history saved. [2025-10-16T20:41:36.949839] [INFO ] [MAIN ] Update Progress: 1572/2369 symbols completed. ODC took 28.9s. Estimated remaining: 1h 52m 20s. Rate: 7.1 symbols/min [2025-10-16T20:41:37.121942] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:41:37.122116] [DEBUG] [LOCAL ] OFG: No existing data file found in primary storage. [2025-10-16T20:41:37.122152] [WARN ] [MAIN ] OFG: No existing data found, performing full refresh instead. [2025-10-16T20:41:37.122269] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-16T20:41:37.122309] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-16T20:41:37.122349] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-16T20:41:37.122380] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-16T20:41:37.479754] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:41:37.506661] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T20:41:37.507776] [INFO ] [REMOTE ] OCFT: Full fetch complete (11651 records). [2025-10-16T20:41:37.507849] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-16T20:41:37.548000] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-16T20:41:37.871415] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-10-16T20:41:37.871493] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-10-16T20:41:37.871730] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-10-16T20:41:37.871789] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-10-16T20:41:37.872204] [DEBUG] [LOCAL ] OCFT: Trimmed 11651 records to 7370 (keeping 200 days of data) [2025-10-16T20:41:37.910998] [DEBUG] [LOCAL ] OCFT: Primary data saved (7370 records). [2025-10-16T20:41:37.911102] [INFO ] [MAIN ] OCFT: Full history saved. [2025-10-16T20:41:37.911191] [INFO ] [MAIN ] Update Progress: 1573/2369 symbols completed. OCFT took 36.8s. Estimated remaining: 1h 52m 7s. Rate: 7.1 symbols/min [2025-10-16T20:41:38.076249] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:41:38.076397] [DEBUG] [LOCAL ] OGE: No existing data file found in primary storage. [2025-10-16T20:41:38.076439] [WARN ] [MAIN ] OGE: No existing data found, performing full refresh instead. [2025-10-16T20:41:38.076546] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-16T20:41:38.076586] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-16T20:41:38.076625] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-16T20:41:38.076705] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-16T20:41:38.345822] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-16T20:41:38.426861] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:41:39.070138] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T20:41:39.142805] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-16T20:41:39.859467] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T20:41:39.942854] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-16T20:41:40.733576] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T20:41:40.743005] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-10-16T20:41:41.145486] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T20:41:41.542891] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-16T20:41:42.342879] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-16T20:41:42.479401] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T20:41:42.688003] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T20:41:43.142837] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-16T20:41:43.916886] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T20:41:43.942839] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-16T20:41:44.742824] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-16T20:41:44.770679] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T20:41:45.542803] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-16T20:41:45.607264] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T20:41:46.232012] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T20:41:46.237872] [INFO ] [REMOTE ] ODV: Full fetch complete (35151 records). [2025-10-16T20:41:46.237951] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-16T20:41:46.347974] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-16T20:41:46.605667] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-10-16T20:41:46.605757] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-10-16T20:41:46.606494] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-10-16T20:41:46.606542] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-10-16T20:41:46.607392] [DEBUG] [LOCAL ] ODV: Trimmed 35151 records to 29311 (keeping 200 days of data) [2025-10-16T20:41:46.778391] [DEBUG] [LOCAL ] ODV: Primary data saved (29311 records). [2025-10-16T20:41:46.778673] [INFO ] [MAIN ] ODV: Full history saved. [2025-10-16T20:41:46.778790] [INFO ] [MAIN ] Update Progress: 1574/2369 symbols completed. ODV took 32.5s. Estimated remaining: 1h 51m 59s. Rate: 7.1 symbols/min [2025-10-16T20:41:47.013609] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:41:47.014069] [DEBUG] [LOCAL ] OGN: No existing data file found in primary storage. [2025-10-16T20:41:47.014306] [WARN ] [MAIN ] OGN: No existing data found, performing full refresh instead. [2025-10-16T20:41:47.014720] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-16T20:41:47.014950] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-16T20:41:47.015038] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-16T20:41:47.015085] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-16T20:41:47.151561] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-10-16T20:41:47.151445] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T20:41:47.426257] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:41:47.942829] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-16T20:41:48.117786] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T20:41:48.458403] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T20:41:48.742815] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-16T20:41:49.480759] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T20:41:49.542786] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-16T20:41:49.733407] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T20:41:50.342826] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-10-16T20:41:51.050260] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T20:41:51.142848] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-16T20:41:51.942812] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-16T20:41:52.264054] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T20:41:52.633007] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T20:41:52.742781] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-16T20:41:53.421925] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T20:41:53.542775] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-16T20:41:54.342789] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-16T20:41:54.678192] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-16T20:41:55.142862] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-16T20:41:55.232843] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T20:41:55.697538] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T20:41:55.942794] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-16T20:41:56.742885] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-16T20:41:56.952669] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T20:41:57.157796] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T20:41:57.542878] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-16T20:41:58.133102] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T20:41:58.342876] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-16T20:41:59.142847] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-16T20:41:59.199124] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T20:41:59.942880] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-16T20:42:00.269855] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-16T20:42:00.417288] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T20:42:00.742810] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-16T20:42:01.542805] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-16T20:42:01.751772] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T20:42:02.342771] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-16T20:42:02.536991] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T20:42:02.561539] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T20:42:03.024562] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T20:42:03.029352] [INFO ] [REMOTE ] OEC: Full fetch complete (53014 records). [2025-10-16T20:42:03.029490] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-16T20:42:03.030211] [FATAL] [VALIDATOR ] OEC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:42:03.030298] [FATAL] [MAIN ] OEC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:42:03.030343] [WARN ] [MAIN ] OEC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:42:03.030382] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-16T20:42:03.030442] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-16T20:42:03.030477] [INFO ] [LOCAL ] OEC: Starting deletion of derivative data. [2025-10-16T20:42:03.030532] [DEBUG] [LOCAL ] OEC: No derivative data file found to delete. [2025-10-16T20:42:03.030609] [INFO ] [MAIN ] Update Progress: 1575/2369 symbols completed. OEC took 33.0s. Estimated remaining: 1h 51m 55s. Rate: 7.1 symbols/min [2025-10-16T20:42:03.143727] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-16T20:42:03.226024] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:42:03.226174] [DEBUG] [LOCAL ] OGS: No existing data file found in primary storage. [2025-10-16T20:42:03.226212] [WARN ] [MAIN ] OGS: No existing data found, performing full refresh instead. [2025-10-16T20:42:03.226322] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-16T20:42:03.226365] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-16T20:42:03.226409] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-16T20:42:03.226466] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-16T20:42:03.645016] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:42:03.942789] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-10-16T20:42:04.742839] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-16T20:42:04.965045] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T20:42:05.393518] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T20:42:05.542809] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-16T20:42:05.923187] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T20:42:06.342829] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-16T20:42:07.142868] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-16T20:42:07.589803] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-16T20:42:07.679368] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T20:42:07.942800] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-16T20:42:08.284825] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T20:42:08.742793] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-16T20:42:09.119595] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T20:42:09.542853] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-16T20:42:10.219703] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T20:42:10.342789] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-16T20:42:10.639778] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T20:42:11.142813] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-16T20:42:11.732952] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T20:42:11.735973] [INFO ] [REMOTE ] OFG: Full fetch complete (33635 records). [2025-10-16T20:42:11.736053] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-16T20:42:11.736831] [FATAL] [VALIDATOR ] OFG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:42:11.737109] [FATAL] [MAIN ] OFG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:42:11.737181] [WARN ] [MAIN ] OFG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:42:11.737260] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-16T20:42:11.737336] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-16T20:42:11.737376] [INFO ] [LOCAL ] OFG: Starting deletion of derivative data. [2025-10-16T20:42:11.737416] [DEBUG] [LOCAL ] OFG: No derivative data file found to delete. [2025-10-16T20:42:11.737499] [INFO ] [MAIN ] Update Progress: 1576/2369 symbols completed. OFG took 34.8s. Estimated remaining: 1h 51m 46s. Rate: 7.1 symbols/min [2025-10-16T20:42:11.919253] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:42:11.919555] [DEBUG] [LOCAL ] OHI: No existing data file found in primary storage. [2025-10-16T20:42:11.919612] [WARN ] [MAIN ] OHI: No existing data found, performing full refresh instead. [2025-10-16T20:42:11.919744] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-16T20:42:11.919787] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-16T20:42:11.919826] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-16T20:42:11.919858] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-16T20:42:11.949371] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-16T20:42:12.278805] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:42:12.307505] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-16T20:42:12.742852] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-10-16T20:42:13.542883] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-16T20:42:13.713038] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T20:42:14.342810] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-16T20:42:14.568770] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T20:42:15.021717] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T20:42:15.043770] [INFO ] [REMOTE ] OGE: Full fetch complete (66571 records). [2025-10-16T20:42:15.046398] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-16T20:42:15.047904] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T20:42:15.054496] [FATAL] [VALIDATOR ] OGE: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:42:15.055249] [FATAL] [MAIN ] OGE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:42:15.055334] [WARN ] [MAIN ] OGE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:42:15.055424] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-16T20:42:15.055500] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-16T20:42:15.055537] [INFO ] [LOCAL ] OGE: Starting deletion of derivative data. [2025-10-16T20:42:15.055638] [DEBUG] [LOCAL ] OGE: No derivative data file found to delete. [2025-10-16T20:42:15.055756] [INFO ] [MAIN ] Update Progress: 1577/2369 symbols completed. OGE took 37.1s. Estimated remaining: 1h 51m 35s. Rate: 7.1 symbols/min [2025-10-16T20:42:15.147910] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-16T20:42:15.232213] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:42:15.232387] [DEBUG] [LOCAL ] OI: No existing data file found in primary storage. [2025-10-16T20:42:15.232424] [WARN ] [MAIN ] OI: No existing data found, performing full refresh instead. [2025-10-16T20:42:15.232542] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-16T20:42:15.232583] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-16T20:42:15.232703] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-16T20:42:15.232759] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-16T20:42:15.581026] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:42:15.942814] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-10-16T20:42:16.742806] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-16T20:42:16.815342] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T20:42:17.542777] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-16T20:42:17.646125] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T20:42:18.285084] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T20:42:18.342781] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-16T20:42:19.142801] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-16T20:42:19.182101] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T20:42:19.791718] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T20:42:19.942879] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-16T20:42:20.742854] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-16T20:42:20.795289] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T20:42:21.015807] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T20:42:21.542813] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-16T20:42:22.342806] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-16T20:42:22.771327] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-16T20:42:23.042049] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T20:42:23.142806] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-16T20:42:23.942777] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-16T20:42:24.420885] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-16T20:42:24.494465] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T20:42:24.742828] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-16T20:42:25.542825] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-16T20:42:25.957575] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T20:42:26.342859] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-16T20:42:26.682220] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-16T20:42:26.749789] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T20:42:27.142815] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-16T20:42:27.942800] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-16T20:42:27.986746] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T20:42:28.035821] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T20:42:28.039467] [INFO ] [REMOTE ] OGS: Full fetch complete (47604 records). [2025-10-16T20:42:28.039576] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-16T20:42:28.040168] [FATAL] [VALIDATOR ] OGS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:42:28.040267] [FATAL] [MAIN ] OGS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:42:28.040343] [WARN ] [MAIN ] OGS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:42:28.040436] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-16T20:42:28.040515] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-16T20:42:28.040554] [INFO ] [LOCAL ] OGS: Starting deletion of derivative data. [2025-10-16T20:42:28.040593] [DEBUG] [LOCAL ] OGS: No derivative data file found to delete. [2025-10-16T20:42:28.040670] [INFO ] [MAIN ] Update Progress: 1578/2369 symbols completed. OGS took 25.0s. Estimated remaining: 1h 51m 29s. Rate: 7.1 symbols/min [2025-10-16T20:42:28.213465] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:42:28.228053] [DEBUG] [LOCAL ] OIA: Loaded 13137 existing records from primary storage. [2025-10-16T20:42:28.228317] [INFO ] [MAIN ] OIA: Loaded 13137 existing records. [2025-10-16T20:42:28.408354] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:42:28.408572] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-16T20:42:28.408620] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-16T20:42:28.408835] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-10-16T20:42:28.408892] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-16T20:42:28.752590] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-16T20:42:28.765408] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:42:29.542795] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-10-16T20:42:29.887015] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-16T20:42:30.342800] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-16T20:42:30.684726] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-16T20:42:30.804384] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T20:42:31.142805] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-16T20:42:31.942796] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-16T20:42:32.117380] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T20:42:32.742785] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-16T20:42:32.875471] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T20:42:32.882272] [INFO ] [REMOTE ] OGN: Full fetch complete (76581 records). [2025-10-16T20:42:32.882444] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-16T20:42:32.883265] [FATAL] [VALIDATOR ] OGN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:42:32.883349] [FATAL] [MAIN ] OGN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:42:32.883418] [WARN ] [MAIN ] OGN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:42:32.883535] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-16T20:42:32.883611] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-16T20:42:32.883688] [INFO ] [LOCAL ] OGN: Starting deletion of derivative data. [2025-10-16T20:42:32.883755] [DEBUG] [LOCAL ] OGN: No derivative data file found to delete. [2025-10-16T20:42:32.883818] [INFO ] [MAIN ] Update Progress: 1579/2369 symbols completed. OGN took 46.1s. Estimated remaining: 1h 51m 19s. Rate: 7.1 symbols/min [2025-10-16T20:42:33.075249] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:42:33.077857] [DEBUG] [LOCAL ] OII: No existing data file found in primary storage. [2025-10-16T20:42:33.078001] [WARN ] [MAIN ] OII: No existing data found, performing full refresh instead. [2025-10-16T20:42:33.078753] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-16T20:42:33.079907] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-16T20:42:33.080078] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-16T20:42:33.090019] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-16T20:42:33.090352] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-16T20:42:33.437723] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:42:33.542805] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-10-16T20:42:33.783962] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-16T20:42:34.342822] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-16T20:42:35.142776] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-16T20:42:35.183015] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T20:42:35.312796] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-16T20:42:35.942817] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-16T20:42:36.742873] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-16T20:42:37.217962] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-16T20:42:37.542867] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-16T20:42:37.712470] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T20:42:38.334066] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T20:42:38.342766] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-16T20:42:39.142811] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-16T20:42:39.317158] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T20:42:39.908514] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T20:42:39.926119] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-16T20:42:39.942776] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-16T20:42:40.742817] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-16T20:42:40.936965] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T20:42:41.542832] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-16T20:42:42.342804] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-16T20:42:42.379149] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T20:42:42.610891] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T20:42:43.142818] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-16T20:42:43.948264] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-16T20:42:43.961587] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T20:42:43.991772] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T20:42:43.998771] [INFO ] [REMOTE ] OHI: Full fetch complete (74918 records). [2025-10-16T20:42:43.998940] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-16T20:42:44.000569] [FATAL] [VALIDATOR ] OHI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:42:44.000861] [FATAL] [MAIN ] OHI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:42:44.000937] [WARN ] [MAIN ] OHI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:42:44.001018] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-16T20:42:44.001092] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-16T20:42:44.001132] [INFO ] [LOCAL ] OHI: Starting deletion of derivative data. [2025-10-16T20:42:44.001174] [DEBUG] [LOCAL ] OHI: No derivative data file found to delete. [2025-10-16T20:42:44.001244] [INFO ] [MAIN ] Update Progress: 1580/2369 symbols completed. OHI took 32.3s. Estimated remaining: 1h 51m 12s. Rate: 7.1 symbols/min [2025-10-16T20:42:44.171343] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:42:44.213382] [DEBUG] [LOCAL ] OIS: Loaded 40031 existing records from primary storage. [2025-10-16T20:42:44.213760] [INFO ] [MAIN ] OIS: Loaded 40031 existing records. [2025-10-16T20:42:44.386431] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:42:44.386628] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-16T20:42:44.386709] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-16T20:42:44.386942] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-10-16T20:42:44.386998] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-16T20:42:44.732498] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:42:44.742775] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-10-16T20:42:45.542845] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-16T20:42:45.843822] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-16T20:42:45.923851] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T20:42:46.342830] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-16T20:42:47.140186] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T20:42:47.148559] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-16T20:42:47.902835] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T20:42:47.942807] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-16T20:42:48.501508] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T20:42:48.742836] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-16T20:42:49.373766] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T20:42:49.542851] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-16T20:42:50.342882] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-16T20:42:50.395871] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T20:42:51.142853] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-16T20:42:51.281952] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T20:42:51.942874] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-16T20:42:51.979974] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T20:42:52.358455] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T20:42:52.742882] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-16T20:42:53.542818] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-16T20:42:53.659550] [DEBUG] [REMOTE ] OIA: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-16T20:42:53.672162] [WARN ] [REMOTE ] OIA: No data returned for month 2025-06 [2025-10-16T20:42:53.672810] [FATAL] [REMOTE ] OIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:42:53.676013] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T20:42:53.673241] [FATAL] [MAIN ] OIA: Failed to fetch primary data. [2025-10-16T20:42:53.687493] [WARN ] [MAIN ] OIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:42:53.687848] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-16T20:42:53.687931] [DEBUG] [LOCAL ] OIA: No primary data file found to delete. [2025-10-16T20:42:53.688041] [INFO ] [LOCAL ] OIA: Starting deletion of derivative data. [2025-10-16T20:42:53.688638] [DEBUG] [LOCAL ] OIA: Deleted derivative data file. [2025-10-16T20:42:53.688794] [INFO ] [MAIN ] Update Progress: 1581/2369 symbols completed. OIA took 25.6s. Estimated remaining: 1h 51m 4s. Rate: 7.1 symbols/min [2025-10-16T20:42:53.874017] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:42:53.874344] [DEBUG] [LOCAL ] OKE: No existing data file found in primary storage. [2025-10-16T20:42:53.874387] [WARN ] [MAIN ] OKE: No existing data found, performing full refresh instead. [2025-10-16T20:42:53.874475] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-16T20:42:53.874513] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-16T20:42:53.874554] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-16T20:42:53.874588] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-16T20:42:54.251427] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:42:54.342814] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-16T20:42:54.530450] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T20:42:55.142844] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-10-16T20:42:55.942857] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-16T20:42:55.995400] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T20:42:56.742811] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-16T20:42:57.081772] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T20:42:57.464205] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T20:42:57.470352] [INFO ] [REMOTE ] OI: Full fetch complete (67958 records). [2025-10-16T20:42:57.470496] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-16T20:42:57.472385] [FATAL] [VALIDATOR ] OI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:42:57.472820] [FATAL] [MAIN ] OI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:42:57.472896] [WARN ] [MAIN ] OI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:42:57.472977] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-16T20:42:57.473105] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-16T20:42:57.473159] [INFO ] [LOCAL ] OI: Starting deletion of derivative data. [2025-10-16T20:42:57.473203] [DEBUG] [LOCAL ] OI: No derivative data file found to delete. [2025-10-16T20:42:57.473289] [INFO ] [MAIN ] Update Progress: 1582/2369 symbols completed. OI took 42.4s. Estimated remaining: 1h 50m 53s. Rate: 7.1 symbols/min [2025-10-16T20:42:57.544313] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-16T20:42:57.692356] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T20:42:57.713108] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:42:57.722165] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-10-16T20:42:57.723120] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-10-16T20:42:57.723324] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-16T20:42:57.723884] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-16T20:42:57.723975] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-16T20:42:57.724022] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-16T20:42:58.115304] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:42:58.342839] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-16T20:42:59.142824] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-16T20:42:59.363764] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T20:42:59.942784] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-16T20:42:59.969442] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T20:43:00.742816] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-10-16T20:43:01.398866] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-16T20:43:01.542809] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-16T20:43:01.794133] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T20:43:02.342878] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-16T20:43:03.142805] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-16T20:43:03.520790] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-16T20:43:03.576582] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.83 seconds). [2025-10-16T20:43:03.884339] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T20:43:03.942798] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-16T20:43:04.742836] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-16T20:43:04.826832] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T20:43:04.831874] [INFO ] [REMOTE ] OII: Full fetch complete (61488 records). [2025-10-16T20:43:04.831974] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-16T20:43:04.832673] [FATAL] [VALIDATOR ] OII: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:43:04.832774] [FATAL] [MAIN ] OII: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:43:04.832829] [WARN ] [MAIN ] OII: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:43:04.832871] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-16T20:43:04.832932] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-16T20:43:04.832967] [INFO ] [LOCAL ] OII: Starting deletion of derivative data. [2025-10-16T20:43:04.833029] [DEBUG] [LOCAL ] OII: No derivative data file found to delete. [2025-10-16T20:43:04.833084] [INFO ] [MAIN ] Update Progress: 1583/2369 symbols completed. OII took 31.9s. Estimated remaining: 1h 50m 44s. Rate: 7.1 symbols/min [2025-10-16T20:43:05.034730] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:43:05.035250] [DEBUG] [LOCAL ] OLN: No existing data file found in primary storage. [2025-10-16T20:43:05.035305] [WARN ] [MAIN ] OLN: No existing data found, performing full refresh instead. [2025-10-16T20:43:05.036818] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T20:43:05.037016] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-16T20:43:05.046161] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-16T20:43:05.046331] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-16T20:43:05.046388] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-16T20:43:05.408384] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:43:05.542776] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-10-16T20:43:06.342841] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-16T20:43:06.732371] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-16T20:43:07.142799] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-16T20:43:07.387560] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-16T20:43:07.942817] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-16T20:43:08.742852] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-16T20:43:09.066996] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-16T20:43:09.119212] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-16T20:43:09.334731] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T20:43:09.542812] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-16T20:43:10.342784] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-16T20:43:10.402574] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T20:43:11.142892] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-16T20:43:11.942830] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-16T20:43:12.211874] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-10-16T20:43:12.269910] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T20:43:12.399868] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-16T20:43:12.742818] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-16T20:43:13.542811] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-16T20:43:13.578713] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T20:43:14.342854] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-16T20:43:14.581145] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-16T20:43:14.914017] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T20:43:14.919051] [INFO ] [REMOTE ] OIS: Full fetch complete (57215 records). [2025-10-16T20:43:14.919178] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-16T20:43:15.148094] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-16T20:43:15.305131] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-10-16T20:43:15.305215] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-10-16T20:43:15.306249] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-10-16T20:43:15.306312] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-10-16T20:43:15.307466] [DEBUG] [LOCAL ] OIS: Trimmed 57215 records to 40306 (keeping 200 days of data) [2025-10-16T20:43:15.534343] [DEBUG] [LOCAL ] OIS: Primary data saved (40306 records). [2025-10-16T20:43:15.534479] [INFO ] [MAIN ] OIS: Full history saved. [2025-10-16T20:43:15.534594] [INFO ] [MAIN ] Update Progress: 1584/2369 symbols completed. OIS took 31.5s. Estimated remaining: 1h 50m 37s. Rate: 7.1 symbols/min [2025-10-16T20:43:15.711673] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:43:15.711848] [DEBUG] [LOCAL ] OLP: No existing data file found in primary storage. [2025-10-16T20:43:15.711885] [WARN ] [MAIN ] OLP: No existing data found, performing full refresh instead. [2025-10-16T20:43:15.711994] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-16T20:43:15.712034] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-16T20:43:15.712074] [DEBUG] [LOCAL ] OLP: No primary data file found to delete. [2025-10-16T20:43:15.712106] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-16T20:43:15.948062] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-16T20:43:16.075940] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:43:16.215465] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T20:43:16.742813] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-10-16T20:43:17.542789] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-16T20:43:17.736570] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T20:43:18.006445] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.86 seconds). [2025-10-16T20:43:18.074020] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-16T20:43:18.342802] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-16T20:43:19.142829] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-16T20:43:19.443639] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T20:43:19.942827] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-16T20:43:20.066790] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T20:43:20.335860] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-16T20:43:20.742836] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-16T20:43:21.542889] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-16T20:43:22.342798] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-16T20:43:22.457683] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T20:43:22.697452] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-10-16T20:43:22.859447] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-16T20:43:23.142845] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-16T20:43:23.893419] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T20:43:23.942817] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-16T20:43:24.014521] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-16T20:43:24.742843] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-16T20:43:25.542784] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-16T20:43:25.764748] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-16T20:43:25.812087] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-16T20:43:26.342826] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-16T20:43:27.142806] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-16T20:43:27.159793] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T20:43:27.942841] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-16T20:43:28.169215] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-10-16T20:43:28.742795] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-16T20:43:28.782579] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T20:43:28.993407] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T20:43:29.542805] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-16T20:43:30.342873] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-16T20:43:30.462281] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-16T20:43:30.827226] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-16T20:43:30.833513] [INFO ] [REMOTE ] OKE: Full fetch complete (77280 records). [2025-10-16T20:43:30.833628] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-16T20:43:30.834438] [FATAL] [VALIDATOR ] OKE: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:43:30.834528] [FATAL] [MAIN ] OKE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:43:30.834572] [WARN ] [MAIN ] OKE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:43:30.834635] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-16T20:43:30.834764] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-16T20:43:30.834821] [INFO ] [LOCAL ] OKE: Starting deletion of derivative data. [2025-10-16T20:43:30.834867] [DEBUG] [LOCAL ] OKE: No derivative data file found to delete. [2025-10-16T20:43:30.834924] [INFO ] [MAIN ] Update Progress: 1585/2369 symbols completed. OKE took 37.1s. Estimated remaining: 1h 50m 32s. Rate: 7.1 symbols/min [2025-10-16T20:43:30.999185] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:43:30.999340] [DEBUG] [LOCAL ] OMC: No existing data file found in primary storage. [2025-10-16T20:43:30.999376] [WARN ] [MAIN ] OMC: No existing data found, performing full refresh instead. [2025-10-16T20:43:30.999486] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-16T20:43:30.999526] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-16T20:43:30.999566] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-16T20:43:30.999597] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-16T20:43:31.146767] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-16T20:43:31.354928] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:43:31.423839] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-16T20:43:31.942864] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-10-16T20:43:32.742802] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-16T20:43:32.952351] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T20:43:33.542804] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-16T20:43:33.924573] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-16T20:43:34.342879] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-16T20:43:34.409040] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-16T20:43:35.142926] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-16T20:43:35.619154] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-10-16T20:43:35.942778] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-16T20:43:36.138476] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-16T20:43:36.742939] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-16T20:43:36.858223] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T20:43:37.080708] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-16T20:43:37.542911] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-16T20:43:38.342790] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-16T20:43:38.510839] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T20:43:38.544219] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T20:43:38.546418] [INFO ] [REMOTE ] OLP: Full fetch complete (14287 records). [2025-10-16T20:43:38.546499] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-16T20:43:38.930555] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-10-16T20:43:38.930697] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-10-16T20:43:38.931043] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-10-16T20:43:38.931085] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-10-16T20:43:38.931756] [DEBUG] [LOCAL ] OLP: Trimmed 14287 records to 10204 (keeping 200 days of data) [2025-10-16T20:43:38.994047] [DEBUG] [LOCAL ] OLP: Primary data saved (10204 records). [2025-10-16T20:43:38.994180] [INFO ] [MAIN ] OLP: Full history saved. [2025-10-16T20:43:38.994257] [INFO ] [MAIN ] Update Progress: 1586/2369 symbols completed. OLP took 23.5s. Estimated remaining: 1h 50m 23s. Rate: 7.1 symbols/min [2025-10-16T20:43:39.162169] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-16T20:43:39.165536] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:43:39.166699] [DEBUG] [LOCAL ] OMF: No existing data file found in primary storage. [2025-10-16T20:43:39.166761] [WARN ] [MAIN ] OMF: No existing data found, performing full refresh instead. [2025-10-16T20:43:39.166876] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-16T20:43:39.166922] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-16T20:43:39.166965] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-16T20:43:39.166998] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-16T20:43:39.524797] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:43:39.942817] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-10-16T20:43:40.117133] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-16T20:43:40.123359] [INFO ] [REMOTE ] OLN: Full fetch complete (74436 records). [2025-10-16T20:43:40.123476] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-16T20:43:40.124242] [FATAL] [VALIDATOR ] OLN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:43:40.124331] [FATAL] [MAIN ] OLN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:43:40.124373] [WARN ] [MAIN ] OLN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:43:40.124411] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-16T20:43:40.124466] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-16T20:43:40.124542] [INFO ] [LOCAL ] OLN: Starting deletion of derivative data. [2025-10-16T20:43:40.124604] [DEBUG] [LOCAL ] OLN: No derivative data file found to delete. [2025-10-16T20:43:40.124682] [INFO ] [MAIN ] Update Progress: 1587/2369 symbols completed. OLN took 35.3s. Estimated remaining: 1h 50m 11s. Rate: 7.1 symbols/min [2025-10-16T20:43:40.292217] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:43:40.292356] [DEBUG] [LOCAL ] OMI: No existing data file found in primary storage. [2025-10-16T20:43:40.292393] [WARN ] [MAIN ] OMI: No existing data found, performing full refresh instead. [2025-10-16T20:43:40.292498] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-16T20:43:40.292538] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-16T20:43:40.292582] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-16T20:43:40.292614] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-16T20:43:40.681551] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:43:40.742796] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-10-16T20:43:41.282225] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-10-16T20:43:41.542845] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-16T20:43:41.658848] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T20:43:42.266575] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T20:43:42.342789] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-16T20:43:43.142895] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-16T20:43:43.785098] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T20:43:43.942812] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-16T20:43:44.600096] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (3.06 seconds). [2025-10-16T20:43:44.747943] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-16T20:43:44.765745] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T20:43:45.318964] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T20:43:45.542837] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-16T20:43:46.342860] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-16T20:43:46.476189] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T20:43:47.142845] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-16T20:43:47.280213] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T20:43:47.942847] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-16T20:43:47.980371] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T20:43:47.986735] [INFO ] [REMOTE ] OKLO: Full fetch complete (77609 records). [2025-10-16T20:43:47.986861] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-16T20:43:47.987521] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:43:47.987610] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:43:47.987685] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:43:47.987768] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-16T20:43:47.987832] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-16T20:43:47.987869] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-10-16T20:43:47.987929] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-10-16T20:43:47.987986] [INFO ] [MAIN ] Update Progress: 1588/2369 symbols completed. OKLO took 50.5s. Estimated remaining: 1h 50m 2s. Rate: 7.1 symbols/min [2025-10-16T20:43:48.156476] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:43:48.190380] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T20:43:48.205279] [DEBUG] [LOCAL ] ONIT: Loaded 7657 existing records from primary storage. [2025-10-16T20:43:48.205517] [INFO ] [MAIN ] ONIT: Loaded 7657 existing records. [2025-10-16T20:43:48.375027] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:43:48.375239] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-16T20:43:48.375286] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-16T20:43:48.375492] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-10-16T20:43:48.375562] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-16T20:43:48.721195] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:43:48.742773] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-10-16T20:43:49.542798] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-16T20:43:49.651480] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-16T20:43:49.680296] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T20:43:50.342818] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-16T20:43:51.142832] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-16T20:43:51.378037] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-16T20:43:51.942803] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-16T20:43:52.176282] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T20:43:52.742856] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-16T20:43:52.944957] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T20:43:53.409130] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T20:43:53.542809] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-16T20:43:54.347893] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-16T20:43:54.363982] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T20:43:55.142787] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-16T20:43:55.297475] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T20:43:55.359131] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T20:43:55.942824] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-16T20:43:56.742826] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-16T20:43:56.791692] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-16T20:43:56.822585] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T20:43:57.542815] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-16T20:43:58.342807] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-16T20:43:58.483028] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T20:43:59.142856] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-16T20:43:59.287522] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T20:43:59.942821] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-16T20:44:00.187611] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T20:44:00.742784] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-16T20:44:01.075450] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-16T20:44:01.542830] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-10-16T20:44:01.814473] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T20:44:02.342826] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-16T20:44:02.372916] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T20:44:02.531145] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-16T20:44:03.142773] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-16T20:44:03.163026] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-16T20:44:03.168680] [INFO ] [REMOTE ] OMI: Full fetch complete (65065 records). [2025-10-16T20:44:03.168780] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-16T20:44:03.169524] [FATAL] [VALIDATOR ] OMI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:44:03.169609] [FATAL] [MAIN ] OMI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:44:03.169693] [WARN ] [MAIN ] OMI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:44:03.169780] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-16T20:44:03.169860] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-16T20:44:03.169911] [INFO ] [LOCAL ] OMI: Starting deletion of derivative data. [2025-10-16T20:44:03.169966] [DEBUG] [LOCAL ] OMI: No derivative data file found to delete. [2025-10-16T20:44:03.170053] [INFO ] [MAIN ] Update Progress: 1589/2369 symbols completed. OMI took 23.0s. Estimated remaining: 1h 49m 57s. Rate: 7.1 symbols/min [2025-10-16T20:44:03.334110] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:44:03.363221] [DEBUG] [LOCAL ] ONL: Loaded 29572 existing records from primary storage. [2025-10-16T20:44:03.363467] [INFO ] [MAIN ] ONL: Loaded 29572 existing records. [2025-10-16T20:44:03.540602] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:44:03.540868] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-16T20:44:03.540937] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-16T20:44:03.541184] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-10-16T20:44:03.541242] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-16T20:44:03.885601] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:44:03.942796] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-10-16T20:44:04.742851] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-16T20:44:04.881767] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T20:44:04.895385] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-16T20:44:05.542861] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-16T20:44:06.342798] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-10-16T20:44:06.726992] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T20:44:07.142826] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-10-16T20:44:07.181680] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T20:44:07.445103] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-16T20:44:07.942838] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-16T20:44:08.270729] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T20:44:08.742831] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-10-16T20:44:09.534904] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T20:44:09.542759] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-10-16T20:44:09.709006] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T20:44:10.342809] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-16T20:44:10.455985] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-16T20:44:11.138890] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T20:44:11.144704] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-16T20:44:11.146260] [INFO ] [REMOTE ] OMC: Full fetch complete (76820 records). [2025-10-16T20:44:11.146341] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-16T20:44:11.147257] [FATAL] [VALIDATOR ] OMC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:44:11.147369] [FATAL] [MAIN ] OMC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:44:11.147413] [WARN ] [MAIN ] OMC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:44:11.147476] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-16T20:44:11.147534] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-16T20:44:11.147567] [INFO ] [LOCAL ] OMC: Starting deletion of derivative data. [2025-10-16T20:44:11.147606] [DEBUG] [LOCAL ] OMC: No derivative data file found to delete. [2025-10-16T20:44:11.147683] [INFO ] [MAIN ] Update Progress: 1590/2369 symbols completed. OMC took 40.3s. Estimated remaining: 1h 49m 48s. Rate: 7.1 symbols/min [2025-10-16T20:44:11.313447] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:44:11.313602] [DEBUG] [LOCAL ] ONON: No existing data file found in primary storage. [2025-10-16T20:44:11.313638] [WARN ] [MAIN ] ONON: No existing data found, performing full refresh instead. [2025-10-16T20:44:11.313776] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-16T20:44:11.313816] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-16T20:44:11.313856] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-16T20:44:11.313890] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-16T20:44:11.657528] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:44:11.942807] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-16T20:44:12.742794] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-10-16T20:44:12.913892] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T20:44:13.306438] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-16T20:44:13.542859] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-16T20:44:14.342828] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-10-16T20:44:14.449702] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T20:44:14.456120] [INFO ] [REMOTE ] OMF: Full fetch complete (67273 records). [2025-10-16T20:44:14.456277] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-16T20:44:14.457165] [FATAL] [VALIDATOR ] OMF: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:44:14.457260] [FATAL] [MAIN ] OMF: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:44:14.457304] [WARN ] [MAIN ] OMF: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:44:14.457346] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-16T20:44:14.457405] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-16T20:44:14.457443] [INFO ] [LOCAL ] OMF: Starting deletion of derivative data. [2025-10-16T20:44:14.457483] [DEBUG] [LOCAL ] OMF: No derivative data file found to delete. [2025-10-16T20:44:14.457555] [INFO ] [MAIN ] Update Progress: 1591/2369 symbols completed. OMF took 35.5s. Estimated remaining: 1h 49m 37s. Rate: 7.1 symbols/min [2025-10-16T20:44:14.641833] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:44:14.662591] [DEBUG] [LOCAL ] ONTF: Loaded 22588 existing records from primary storage. [2025-10-16T20:44:14.662854] [INFO ] [MAIN ] ONTF: Loaded 22588 existing records. [2025-10-16T20:44:14.848818] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:44:14.849286] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-16T20:44:14.849405] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-16T20:44:14.849768] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-10-16T20:44:14.849983] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-16T20:44:15.057303] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-16T20:44:15.148036] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-16T20:44:15.281630] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:44:15.289029] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T20:44:15.942827] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-10-16T20:44:16.742846] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-16T20:44:17.163046] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-16T20:44:17.413455] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-16T20:44:17.542833] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-10-16T20:44:17.871479] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T20:44:18.146552] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T20:44:18.342892] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-16T20:44:19.142848] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-16T20:44:19.387822] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-16T20:44:19.942863] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-10. [2025-10-16T20:44:20.664402] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T20:44:20.665934] [INFO ] [REMOTE ] ONIT: Full fetch complete (11085 records). [2025-10-16T20:44:20.666043] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-10-16T20:44:20.752843] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-16T20:44:21.017413] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-10-16T20:44:21.017500] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-10-16T20:44:21.017854] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-10-16T20:44:21.017943] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-10-16T20:44:21.018412] [DEBUG] [LOCAL ] ONIT: Trimmed 11085 records to 7694 (keeping 200 days of data) [2025-10-16T20:44:21.061984] [DEBUG] [LOCAL ] ONIT: Primary data saved (7694 records). [2025-10-16T20:44:21.062112] [INFO ] [MAIN ] ONIT: Full history saved. [2025-10-16T20:44:21.062192] [INFO ] [MAIN ] Update Progress: 1592/2369 symbols completed. ONIT took 33.1s. Estimated remaining: 1h 49m 28s. Rate: 7.1 symbols/min [2025-10-16T20:44:21.229511] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:44:21.229873] [DEBUG] [LOCAL ] ONTO: No existing data file found in primary storage. [2025-10-16T20:44:21.229979] [WARN ] [MAIN ] ONTO: No existing data found, performing full refresh instead. [2025-10-16T20:44:21.230147] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-16T20:44:21.230339] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-16T20:44:21.230406] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-16T20:44:21.230440] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-16T20:44:21.459004] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-16T20:44:21.547616] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-16T20:44:21.606136] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-16T20:44:21.644754] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:44:22.342824] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-16T20:44:23.142789] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-16T20:44:23.167331] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T20:44:23.942799] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-16T20:44:24.365538] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T20:44:24.535149] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-16T20:44:24.742854] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-16T20:44:25.481210] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T20:44:25.542767] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-16T20:44:25.862244] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T20:44:26.342883] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-16T20:44:26.711093] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T20:44:27.142859] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-10-16T20:44:27.942877] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-16T20:44:28.548508] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-16T20:44:28.742864] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-16T20:44:28.783266] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T20:44:29.482510] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T20:44:29.542851] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-16T20:44:30.342815] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-16T20:44:31.002927] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-16T20:44:31.142868] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-16T20:44:31.300221] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-16T20:44:31.803043] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T20:44:31.942851] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-16T20:44:32.742785] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-16T20:44:33.064809] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T20:44:33.196168] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-16T20:44:33.542844] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-16T20:44:34.011593] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-16T20:44:34.342941] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-16T20:44:35.142854] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-16T20:44:35.730517] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-16T20:44:35.942784] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-16T20:44:36.102637] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T20:44:36.154004] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T20:44:36.742807] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-16T20:44:37.542852] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-16T20:44:37.789004] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T20:44:37.792232] [INFO ] [REMOTE ] ONL: Full fetch complete (42830 records). [2025-10-16T20:44:37.792334] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-16T20:44:38.171536] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-10-16T20:44:38.171634] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-10-16T20:44:38.172566] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-10-16T20:44:38.172613] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-10-16T20:44:38.173978] [DEBUG] [LOCAL ] ONL: Trimmed 42830 records to 29741 (keeping 200 days of data) [2025-10-16T20:44:38.289592] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-16T20:44:38.351763] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-16T20:44:38.386508] [DEBUG] [LOCAL ] ONL: Primary data saved (29741 records). [2025-10-16T20:44:38.386863] [INFO ] [MAIN ] ONL: Full history saved. [2025-10-16T20:44:38.386975] [INFO ] [MAIN ] Update Progress: 1593/2369 symbols completed. ONL took 35.2s. Estimated remaining: 1h 49m 24s. Rate: 7.1 symbols/min [2025-10-16T20:44:38.554908] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:44:38.555052] [DEBUG] [LOCAL ] OOMA: No existing data file found in primary storage. [2025-10-16T20:44:38.555089] [WARN ] [MAIN ] OOMA: No existing data found, performing full refresh instead. [2025-10-16T20:44:38.555195] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-16T20:44:38.555235] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-16T20:44:38.555321] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-16T20:44:38.555360] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-16T20:44:38.899016] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T20:44:38.941622] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:44:39.142793] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-16T20:44:39.942868] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-16T20:44:40.614701] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-16T20:44:40.743480] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-16T20:44:40.747339] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T20:44:40.884364] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T20:44:41.539115] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T20:44:41.544790] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-10-16T20:44:41.546155] [INFO ] [REMOTE ] ONON: Full fetch complete (77379 records). [2025-10-16T20:44:41.546234] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-16T20:44:41.547196] [FATAL] [VALIDATOR ] ONON: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:44:41.547285] [FATAL] [MAIN ] ONON: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:44:41.547350] [WARN ] [MAIN ] ONON: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:44:41.547420] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-16T20:44:41.547480] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-16T20:44:41.547515] [INFO ] [LOCAL ] ONON: Starting deletion of derivative data. [2025-10-16T20:44:41.547555] [DEBUG] [LOCAL ] ONON: No derivative data file found to delete. [2025-10-16T20:44:41.547611] [INFO ] [MAIN ] Update Progress: 1594/2369 symbols completed. ONON took 30.4s. Estimated remaining: 1h 49m 13s. Rate: 7.1 symbols/min [2025-10-16T20:44:41.714384] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:44:41.737619] [DEBUG] [LOCAL ] OPAD: Loaded 25096 existing records from primary storage. [2025-10-16T20:44:41.737887] [INFO ] [MAIN ] OPAD: Loaded 25096 existing records. [2025-10-16T20:44:41.911049] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:44:41.911236] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-16T20:44:41.911282] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-16T20:44:41.911473] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-10-16T20:44:41.911529] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-16T20:44:42.261989] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:44:42.342771] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-10-16T20:44:42.768851] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-16T20:44:43.142809] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-16T20:44:43.189475] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T20:44:43.942827] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-16T20:44:44.259082] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-16T20:44:44.742788] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-16T20:44:45.037518] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T20:44:45.542809] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-16T20:44:46.342786] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-16T20:44:46.539598] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T20:44:46.640500] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T20:44:47.142773] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-16T20:44:47.223939] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T20:44:47.942834] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-16T20:44:48.282176] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T20:44:48.735687] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-16T20:44:48.742759] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-16T20:44:49.542785] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-16T20:44:49.628848] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T20:44:50.342789] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-16T20:44:50.573709] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-16T20:44:50.576787] [INFO ] [REMOTE ] ONTF: Full fetch complete (31532 records). [2025-10-16T20:44:50.576866] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-16T20:44:50.961312] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-10-16T20:44:50.961386] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-10-16T20:44:50.962068] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-10-16T20:44:50.962130] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-10-16T20:44:50.962861] [DEBUG] [LOCAL ] ONTF: Trimmed 31532 records to 22800 (keeping 200 days of data) [2025-10-16T20:44:51.089470] [DEBUG] [LOCAL ] ONTF: Primary data saved (22800 records). [2025-10-16T20:44:51.089635] [INFO ] [MAIN ] ONTF: Full history saved. [2025-10-16T20:44:51.089756] [INFO ] [MAIN ] Update Progress: 1595/2369 symbols completed. ONTF took 36.6s. Estimated remaining: 1h 49m 5s. Rate: 7.1 symbols/min [2025-10-16T20:44:51.147922] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-16T20:44:51.281161] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:44:51.281318] [DEBUG] [LOCAL ] OPFI: No existing data file found in primary storage. [2025-10-16T20:44:51.281354] [WARN ] [MAIN ] OPFI: No existing data found, performing full refresh instead. [2025-10-16T20:44:51.281492] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-16T20:44:51.281556] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-16T20:44:51.281606] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-16T20:44:51.281638] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-16T20:44:51.632442] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:44:51.709697] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T20:44:51.942799] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-16T20:44:52.591192] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-16T20:44:52.742840] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-10-16T20:44:52.912935] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T20:44:53.542816] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-16T20:44:54.059831] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-16T20:44:54.341882] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T20:44:54.344556] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-16T20:44:55.142845] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-16T20:44:55.175415] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T20:44:55.942826] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-16T20:44:56.742881] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-16T20:44:56.852313] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T20:44:57.542790] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-16T20:44:57.694524] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T20:44:57.985596] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-16T20:44:58.342832] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-16T20:44:59.142824] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-16T20:44:59.427340] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T20:44:59.836509] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-16T20:44:59.902394] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T20:44:59.942770] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-16T20:45:00.742799] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-16T20:45:01.094974] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T20:45:01.542822] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-16T20:45:02.342803] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-16T20:45:02.747081] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-16T20:45:03.142788] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-16T20:45:03.426849] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T20:45:03.559738] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T20:45:03.942776] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-16T20:45:04.742865] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-16T20:45:05.137552] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-16T20:45:05.298999] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T20:45:05.542822] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-16T20:45:06.342802] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-16T20:45:06.459499] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T20:45:06.625134] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T20:45:07.142808] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-16T20:45:07.744090] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T20:45:07.942826] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-16T20:45:08.742822] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-16T20:45:09.550587] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-16T20:45:09.576552] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-16T20:45:09.996299] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-16T20:45:10.215111] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T20:45:10.273812] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T20:45:10.277397] [INFO ] [REMOTE ] OOMA: Full fetch complete (25718 records). [2025-10-16T20:45:10.277512] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-16T20:45:10.278194] [FATAL] [VALIDATOR ] OOMA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:45:10.278351] [FATAL] [MAIN ] OOMA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:45:10.278417] [WARN ] [MAIN ] OOMA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:45:10.278505] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-16T20:45:10.278620] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-16T20:45:10.278714] [INFO ] [LOCAL ] OOMA: Starting deletion of derivative data. [2025-10-16T20:45:10.278794] [DEBUG] [LOCAL ] OOMA: No derivative data file found to delete. [2025-10-16T20:45:10.278881] [INFO ] [MAIN ] Update Progress: 1596/2369 symbols completed. OOMA took 31.9s. Estimated remaining: 1h 49m 2s. Rate: 7.1 symbols/min [2025-10-16T20:45:10.353173] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-16T20:45:10.490343] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:45:10.505081] [DEBUG] [LOCAL ] OPP: Loaded 12199 existing records from primary storage. [2025-10-16T20:45:10.505353] [INFO ] [MAIN ] OPP: Loaded 12199 existing records. [2025-10-16T20:45:10.690206] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:45:10.690429] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-16T20:45:10.690474] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-16T20:45:10.690632] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-10-16T20:45:10.690715] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-16T20:45:11.049631] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:45:11.142817] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-16T20:45:11.931098] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T20:45:11.937152] [INFO ] [REMOTE ] ONTO: Full fetch complete (66815 records). [2025-10-16T20:45:11.937283] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-16T20:45:11.938070] [FATAL] [VALIDATOR ] ONTO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:45:11.938156] [FATAL] [MAIN ] ONTO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:45:11.938198] [WARN ] [MAIN ] ONTO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:45:11.938265] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-16T20:45:11.938346] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-16T20:45:11.938383] [INFO ] [LOCAL ] ONTO: Starting deletion of derivative data. [2025-10-16T20:45:11.938425] [DEBUG] [LOCAL ] ONTO: No derivative data file found to delete. [2025-10-16T20:45:11.938480] [INFO ] [MAIN ] Update Progress: 1597/2369 symbols completed. ONTO took 50.9s. Estimated remaining: 1h 48m 50s. Rate: 7.1 symbols/min [2025-10-16T20:45:11.942776] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-10-16T20:45:12.525046] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-16T20:45:12.534017] [INFO ] [REMOTE ] OPAD: Full fetch complete (27972 records). [2025-10-16T20:45:12.534185] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-16T20:45:12.752739] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-16T20:45:12.910050] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-10-16T20:45:12.910136] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-10-16T20:45:12.910760] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-10-16T20:45:12.910824] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-10-16T20:45:12.911789] [DEBUG] [LOCAL ] OPAD: Trimmed 27972 records to 25408 (keeping 200 days of data) [2025-10-16T20:45:13.055153] [DEBUG] [LOCAL ] OPAD: Primary data saved (25408 records). [2025-10-16T20:45:13.055294] [INFO ] [MAIN ] OPAD: Full history saved. [2025-10-16T20:45:13.055374] [INFO ] [MAIN ] Update Progress: 1598/2369 symbols completed. OPAD took 31.5s. Estimated remaining: 1h 48m 38s. Rate: 7.1 symbols/min [2025-10-16T20:45:13.085518] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T20:45:13.542839] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-16T20:45:14.492104] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T20:45:14.495468] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-16T20:45:14.521923] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T20:45:15.142815] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-16T20:45:15.478496] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T20:45:15.942816] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-16T20:45:16.834042] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-16T20:45:16.837083] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-16T20:45:17.080685] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T20:45:17.542803] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-16T20:45:17.799871] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-16T20:45:18.342789] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-16T20:45:19.294363] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-16T20:45:19.298701] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-16T20:45:19.422765] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T20:45:19.942863] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-16T20:45:20.150548] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T20:45:20.742889] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-16T20:45:21.668553] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T20:45:21.671697] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-16T20:45:21.743362] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-16T20:45:22.342914] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-16T20:45:22.445871] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T20:45:22.735392] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-16T20:45:22.741104] [INFO ] [REMOTE ] OPFI: Full fetch complete (68404 records). [2025-10-16T20:45:22.741257] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-16T20:45:22.742015] [FATAL] [VALIDATOR ] OPFI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:45:22.742108] [FATAL] [MAIN ] OPFI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:45:22.742150] [WARN ] [MAIN ] OPFI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:45:22.742202] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-16T20:45:22.742296] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-16T20:45:22.742356] [INFO ] [LOCAL ] OPFI: Starting deletion of derivative data. [2025-10-16T20:45:22.742434] [DEBUG] [LOCAL ] OPFI: No derivative data file found to delete. [2025-10-16T20:45:22.742510] [INFO ] [MAIN ] Update Progress: 1599/2369 symbols completed. OPFI took 31.7s. Estimated remaining: 1h 48m 30s. Rate: 7.1 symbols/min [2025-10-16T20:45:23.142892] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-16T20:45:24.038230] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T20:45:24.041396] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-16T20:45:25.027394] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T20:45:25.030443] [INFO ] [REMOTE ] OPP: Full fetch complete (17537 records). [2025-10-16T20:45:25.030607] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-16T20:45:25.414747] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-16T20:45:25.414826] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-16T20:45:25.415216] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-16T20:45:25.415255] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-16T20:45:25.415870] [DEBUG] [LOCAL ] OPP: Trimmed 17537 records to 12432 (keeping 200 days of data) [2025-10-16T20:45:25.491099] [DEBUG] [LOCAL ] OPP: Primary data saved (12432 records). [2025-10-16T20:45:25.491250] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-16T20:45:25.491332] [INFO ] [MAIN ] Update Progress: 1600/2369 symbols completed. OPP took 15.2s. Estimated remaining: 1h 48m 19s. Rate: 7.1 symbols/min [2025-10-16T20:45:26.172639] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:45:26.227373] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:45:26.225036] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:45:26.243132] [DEBUG] [LOCAL ] OR: No existing data file found in primary storage. [2025-10-16T20:45:26.209170] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-16T20:45:26.270111] [WARN ] [MAIN ] OR: No existing data found, performing full refresh instead. [2025-10-16T20:45:26.270712] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-16T20:45:26.289394] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-16T20:45:26.289545] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-16T20:45:26.289665] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-16T20:45:26.289106] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:45:26.289812] [DEBUG] [LOCAL ] ORA: No existing data file found in primary storage. [2025-10-16T20:45:26.289981] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-16T20:45:26.290127] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-16T20:45:26.290030] [WARN ] [MAIN ] ORA: No existing data found, performing full refresh instead. [2025-10-16T20:45:26.289877] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-16T20:45:26.290316] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-16T20:45:26.290433] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-16T20:45:26.290475] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-16T20:45:26.295947] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-16T20:45:26.296008] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-16T20:45:26.302709] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-16T20:45:26.984979] [DEBUG] [LOCAL ] ORC: Loaded 52512 existing records from primary storage. [2025-10-16T20:45:27.073115] [INFO ] [MAIN ] ORC: Loaded 52512 existing records. [2025-10-16T20:45:27.478377] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:45:27.485322] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:45:27.517422] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-10-16T20:45:27.506734] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-10-16T20:45:27.605279] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:45:27.624700] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-10-16T20:45:27.663578] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:45:27.663969] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-16T20:45:27.664045] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-16T20:45:27.664274] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-10-16T20:45:27.664331] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-16T20:45:28.013148] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:45:28.013458] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-10-16T20:45:28.562108] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T20:45:28.564050] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-16T20:45:29.301770] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T20:45:29.303324] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-16T20:45:29.345741] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T20:45:29.416757] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-16T20:45:29.542781] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-16T20:45:29.933155] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T20:45:29.956639] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T20:45:30.342808] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-16T20:45:31.090263] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-16T20:45:31.142777] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-16T20:45:31.269788] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T20:45:31.942866] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-16T20:45:32.041734] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T20:45:32.742862] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-16T20:45:33.542852] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-16T20:45:33.981036] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-16T20:45:34.255838] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T20:45:34.342777] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-16T20:45:35.026098] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T20:45:35.142777] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-16T20:45:35.594259] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-16T20:45:35.942867] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-16T20:45:36.742842] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-16T20:45:36.986575] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-16T20:45:37.542791] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-16T20:45:37.604895] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T20:45:37.631822] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-16T20:45:38.342829] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-16T20:45:39.104691] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T20:45:39.142821] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-16T20:45:39.234425] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-16T20:45:39.942879] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-16T20:45:40.683094] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T20:45:40.742820] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-16T20:45:41.542870] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-16T20:45:41.653119] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T20:45:42.351081] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-16T20:45:42.353640] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T20:45:42.442013] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-16T20:45:43.142899] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-16T20:45:43.942836] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-16T20:45:44.399828] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T20:45:44.629013] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-16T20:45:44.742860] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-16T20:45:45.385741] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T20:45:45.542810] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-16T20:45:46.342901] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-16T20:45:46.427519] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T20:45:46.477809] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T20:45:47.142884] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-16T20:45:47.924252] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T20:45:47.925702] [INFO ] [REMOTE ] OPY: Full fetch complete (10173 records). [2025-10-16T20:45:47.925777] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-16T20:45:47.947962] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-16T20:45:48.115600] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T20:45:48.115877] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:45:48.115946] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:45:48.116018] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-16T20:45:48.116080] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-16T20:45:48.116126] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-16T20:45:48.116191] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-16T20:45:48.116248] [INFO ] [MAIN ] Update Progress: 1601/2369 symbols completed. OPY took 22.6s. Estimated remaining: 1h 48m 17s. Rate: 7.1 symbols/min [2025-10-16T20:45:48.283701] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:45:48.283860] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-16T20:45:48.283897] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-16T20:45:48.284003] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-16T20:45:48.284044] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-16T20:45:48.284159] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-16T20:45:48.284236] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-16T20:45:48.678413] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-16T20:45:48.682053] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:45:48.742775] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-10-16T20:45:49.542834] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-16T20:45:49.802115] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-16T20:45:50.342813] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-16T20:45:51.142875] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-16T20:45:51.415805] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-16T20:45:51.942828] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-16T20:45:51.975920] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-16T20:45:52.163750] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T20:45:52.749036] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-16T20:45:52.753780] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T20:45:53.542870] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-16T20:45:54.342825] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-16T20:45:54.459951] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T20:45:54.647894] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-10-16T20:45:54.725054] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-16T20:45:55.142836] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-16T20:45:55.942806] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-16T20:45:56.545173] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-16T20:45:56.580352] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T20:45:56.585113] [INFO ] [REMOTE ] ORA: Full fetch complete (48792 records). [2025-10-16T20:45:56.585244] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-16T20:45:56.585897] [FATAL] [VALIDATOR ] ORA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:45:56.585982] [FATAL] [MAIN ] ORA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:45:56.586023] [WARN ] [MAIN ] ORA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:45:56.586062] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-16T20:45:56.586117] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-16T20:45:56.586151] [INFO ] [LOCAL ] ORA: Starting deletion of derivative data. [2025-10-16T20:45:56.586189] [DEBUG] [LOCAL ] ORA: No derivative data file found to delete. [2025-10-16T20:45:56.586240] [INFO ] [MAIN ] Update Progress: 1602/2369 symbols completed. ORA took 31.1s. Estimated remaining: 1h 48m 9s. Rate: 7.1 symbols/min [2025-10-16T20:45:56.752412] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-16T20:45:56.756322] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:45:56.757563] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-16T20:45:56.757675] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-16T20:45:56.757937] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-16T20:45:56.757988] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-16T20:45:56.758057] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-16T20:45:56.758091] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-16T20:45:57.167470] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:45:57.197935] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-16T20:45:57.542862] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-16T20:45:58.342922] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-16T20:45:58.561462] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T20:45:58.567627] [INFO ] [REMOTE ] OR: Full fetch complete (66187 records). [2025-10-16T20:45:58.567803] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-16T20:45:58.568569] [FATAL] [VALIDATOR ] OR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:45:58.568680] [FATAL] [MAIN ] OR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:45:58.568733] [WARN ] [MAIN ] OR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:45:58.568774] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-16T20:45:58.568831] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-16T20:45:58.568874] [INFO ] [LOCAL ] OR: Starting deletion of derivative data. [2025-10-16T20:45:58.568913] [DEBUG] [LOCAL ] OR: No derivative data file found to delete. [2025-10-16T20:45:58.568968] [INFO ] [MAIN ] Update Progress: 1603/2369 symbols completed. OR took 33.1s. Estimated remaining: 1h 47m 57s. Rate: 7.1 symbols/min [2025-10-16T20:45:58.735987] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:45:58.765346] [DEBUG] [LOCAL ] ORN: Loaded 30933 existing records from primary storage. [2025-10-16T20:45:58.765621] [INFO ] [MAIN ] ORN: Loaded 30933 existing records. [2025-10-16T20:45:58.944153] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:45:58.944536] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-16T20:45:58.945472] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-16T20:45:58.945724] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-10-16T20:45:58.945780] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-16T20:45:59.151122] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-10-16T20:45:59.314117] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:45:59.420598] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-10-16T20:45:59.942868] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-10-16T20:46:00.210398] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-16T20:46:00.742822] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-16T20:46:01.034286] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T20:46:01.542864] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-16T20:46:01.662027] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T20:46:02.342815] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-16T20:46:03.157215] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-16T20:46:03.163390] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-16T20:46:03.400530] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T20:46:03.942818] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-16T20:46:04.658429] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T20:46:04.742776] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-16T20:46:05.108640] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-10-16T20:46:05.413762] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T20:46:05.542792] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-16T20:46:06.017157] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T20:46:06.342810] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-16T20:46:07.142844] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-16T20:46:07.373355] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T20:46:07.942824] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-16T20:46:08.164564] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T20:46:08.742860] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-16T20:46:09.062637] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-16T20:46:09.542849] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-16T20:46:10.215917] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T20:46:10.342847] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-16T20:46:10.751075] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-10-16T20:46:11.142888] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-16T20:46:11.513276] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T20:46:11.793386] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-16T20:46:11.942853] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-16T20:46:12.742821] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-16T20:46:12.967342] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T20:46:13.272814] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T20:46:13.542804] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-16T20:46:14.342829] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-16T20:46:15.142822] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-16T20:46:15.374383] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-10-16T20:46:15.417835] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-16T20:46:15.942591] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T20:46:15.949156] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-16T20:46:16.742854] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-16T20:46:16.999523] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-16T20:46:17.006372] [INFO ] [REMOTE ] ORC: Full fetch complete (75569 records). [2025-10-16T20:46:17.006528] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-16T20:46:17.391587] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-10-16T20:46:17.391687] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-10-16T20:46:17.392784] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-10-16T20:46:17.392848] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-10-16T20:46:17.394241] [DEBUG] [LOCAL ] ORC: Trimmed 75569 records to 52895 (keeping 200 days of data) [2025-10-16T20:46:17.562078] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-16T20:46:17.729608] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T20:46:17.747807] [DEBUG] [LOCAL ] ORC: Primary data saved (52895 records). [2025-10-16T20:46:17.747928] [INFO ] [MAIN ] ORC: Full history saved. [2025-10-16T20:46:17.748634] [INFO ] [MAIN ] Update Progress: 1604/2369 symbols completed. ORC took 52.3s. Estimated remaining: 1h 47m 54s. Rate: 7.1 symbols/min [2025-10-16T20:46:17.927829] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:46:17.928001] [DEBUG] [LOCAL ] OSCR: No existing data file found in primary storage. [2025-10-16T20:46:17.928040] [WARN ] [MAIN ] OSCR: No existing data found, performing full refresh instead. [2025-10-16T20:46:17.928175] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-16T20:46:17.928263] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-16T20:46:17.928353] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-16T20:46:17.928407] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-16T20:46:18.316321] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:46:18.342798] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-10-16T20:46:19.010827] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-16T20:46:19.142808] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-16T20:46:19.672439] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.93 seconds). [2025-10-16T20:46:19.942825] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-16T20:46:20.356907] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-16T20:46:20.384175] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T20:46:20.742802] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-16T20:46:21.542854] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-16T20:46:22.102010] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T20:46:22.106027] [INFO ] [REMOTE ] ORN: Full fetch complete (45573 records). [2025-10-16T20:46:22.106151] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-16T20:46:22.348945] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-16T20:46:22.490290] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-10-16T20:46:22.490424] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-10-16T20:46:22.491354] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-10-16T20:46:22.491436] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-10-16T20:46:22.492732] [DEBUG] [LOCAL ] ORN: Trimmed 45573 records to 31147 (keeping 200 days of data) [2025-10-16T20:46:22.684404] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-16T20:46:22.711429] [DEBUG] [LOCAL ] ORN: Primary data saved (31147 records). [2025-10-16T20:46:22.711542] [INFO ] [MAIN ] ORN: Full history saved. [2025-10-16T20:46:22.711615] [INFO ] [MAIN ] Update Progress: 1605/2369 symbols completed. ORN took 24.1s. Estimated remaining: 1h 47m 44s. Rate: 7.1 symbols/min [2025-10-16T20:46:22.878692] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:46:22.878870] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-16T20:46:22.878907] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-16T20:46:22.879014] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-16T20:46:22.879055] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-16T20:46:22.879157] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-16T20:46:22.879198] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-16T20:46:23.148428] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-16T20:46:23.230119] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:46:23.468178] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-16T20:46:23.942803] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-10-16T20:46:24.161979] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T20:46:24.742857] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-16T20:46:25.542838] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-16T20:46:25.833883] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-16T20:46:25.873094] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-16T20:46:26.342791] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-16T20:46:26.442334] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T20:46:27.142828] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-16T20:46:27.687521] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-16T20:46:27.942854] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-16T20:46:28.742819] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-16T20:46:28.853403] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T20:46:28.972539] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-16T20:46:29.542808] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-16T20:46:29.644261] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T20:46:30.020056] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-16T20:46:30.026857] [INFO ] [REMOTE ] ORCL: Full fetch complete (77213 records). [2025-10-16T20:46:30.027030] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-16T20:46:30.027770] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:46:30.027885] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:46:30.027929] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:46:30.027993] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-16T20:46:30.028057] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-16T20:46:30.028092] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-16T20:46:30.028131] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-16T20:46:30.028184] [INFO ] [MAIN ] Update Progress: 1606/2369 symbols completed. ORCL took 41.9s. Estimated remaining: 1h 47m 35s. Rate: 7.1 symbols/min [2025-10-16T20:46:30.212863] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:46:30.213043] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-16T20:46:30.213082] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-16T20:46:30.213201] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-16T20:46:30.213242] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-16T20:46:30.213283] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-16T20:46:30.213315] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-16T20:46:30.355453] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-16T20:46:30.571807] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:46:30.644271] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-16T20:46:31.130523] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T20:46:31.136810] [INFO ] [REMOTE ] ORI: Full fetch complete (70109 records). [2025-10-16T20:46:31.136968] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-16T20:46:31.137829] [FATAL] [VALIDATOR ] ORI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:46:31.137928] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:46:31.137972] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:46:31.138011] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-16T20:46:31.138082] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-16T20:46:31.138136] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-16T20:46:31.138178] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-16T20:46:31.138261] [INFO ] [MAIN ] Update Progress: 1607/2369 symbols completed. ORI took 34.6s. Estimated remaining: 1h 47m 23s. Rate: 7.1 symbols/min [2025-10-16T20:46:31.149768] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-10-16T20:46:31.317518] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:46:31.317746] [DEBUG] [LOCAL ] OTIS: No existing data file found in primary storage. [2025-10-16T20:46:31.317800] [WARN ] [MAIN ] OTIS: No existing data found, performing full refresh instead. [2025-10-16T20:46:31.317919] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-16T20:46:31.317960] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-16T20:46:31.318025] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-16T20:46:31.318070] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-16T20:46:31.598744] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:46:31.599465] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-10-16T20:46:31.610210] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:46:31.620709] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-16T20:46:31.639305] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:46:31.669017] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-16T20:46:31.682803] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:46:31.683260] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-16T20:46:31.683323] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-16T20:46:31.683368] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-16T20:46:31.683414] [INFO ] [MAIN ] Update Progress: 1608/2369 symbols completed. OTF took 1.7s. Estimated remaining: 1h 47m 11s. Rate: 7.1 symbols/min [2025-10-16T20:46:31.854095] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:46:31.854265] [DEBUG] [LOCAL ] OUT: No existing data file found in primary storage. [2025-10-16T20:46:31.854302] [WARN ] [MAIN ] OUT: No existing data found, performing full refresh instead. [2025-10-16T20:46:31.854472] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-16T20:46:31.854520] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-16T20:46:31.854562] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-16T20:46:31.854593] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-16T20:46:31.947897] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-10-16T20:46:32.247853] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:46:32.742828] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-16T20:46:33.542845] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-16T20:46:33.845454] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-16T20:46:34.073988] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T20:46:34.342812] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-16T20:46:35.142810] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-16T20:46:35.671906] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-16T20:46:35.942815] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-16T20:46:35.994131] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T20:46:36.742885] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-10-16T20:46:36.900415] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-16T20:46:37.542849] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-16T20:46:38.274846] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T20:46:38.352950] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-16T20:46:38.377590] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-16T20:46:39.142891] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-16T20:46:39.373162] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T20:46:39.942821] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-16T20:46:40.104967] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T20:46:40.704728] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T20:46:40.742796] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-16T20:46:41.542872] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-16T20:46:42.342868] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-16T20:46:42.476871] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-16T20:46:42.731127] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-16T20:46:42.863011] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T20:46:43.142808] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-16T20:46:43.942826] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-16T20:46:44.097706] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T20:46:44.742797] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-16T20:46:45.017522] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T20:46:45.542823] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-16T20:46:46.342811] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-16T20:46:46.769898] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-16T20:46:46.860556] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-16T20:46:47.142810] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-16T20:46:47.177372] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T20:46:47.909127] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T20:46:47.942768] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-16T20:46:48.742824] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-16T20:46:49.542788] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-16T20:46:49.665601] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-16T20:46:49.734782] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T20:46:50.054334] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-16T20:46:50.342807] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-16T20:46:51.097858] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T20:46:51.142784] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-16T20:46:51.942792] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-16T20:46:52.742835] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-16T20:46:53.029791] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-16T20:46:53.152069] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T20:46:53.542790] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-16T20:46:53.645900] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-16T20:46:54.342870] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-16T20:46:54.427810] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T20:46:54.950195] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T20:46:55.142820] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-16T20:46:55.942796] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-16T20:46:56.403936] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T20:46:56.742824] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-16T20:46:56.837477] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T20:46:57.542786] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-16T20:46:57.636379] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T20:46:58.299908] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T20:46:58.306638] [INFO ] [REMOTE ] OSCR: Full fetch complete (77337 records). [2025-10-16T20:46:58.306858] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-16T20:46:58.308027] [FATAL] [VALIDATOR ] OSCR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:46:58.308145] [FATAL] [MAIN ] OSCR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:46:58.308190] [WARN ] [MAIN ] OSCR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:46:58.308260] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-16T20:46:58.308362] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-16T20:46:58.308421] [INFO ] [LOCAL ] OSCR: Starting deletion of derivative data. [2025-10-16T20:46:58.308468] [DEBUG] [LOCAL ] OSCR: No derivative data file found to delete. [2025-10-16T20:46:58.308528] [INFO ] [MAIN ] Update Progress: 1609/2369 symbols completed. OSCR took 40.6s. Estimated remaining: 1h 47m 11s. Rate: 7.1 symbols/min [2025-10-16T20:46:58.342953] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-16T20:46:58.494393] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:46:58.494747] [DEBUG] [LOCAL ] OVV: No existing data file found in primary storage. [2025-10-16T20:46:58.494944] [WARN ] [MAIN ] OVV: No existing data found, performing full refresh instead. [2025-10-16T20:46:58.495068] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-16T20:46:58.495111] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-16T20:46:58.495152] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-16T20:46:58.495183] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-16T20:46:58.634859] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-16T20:46:58.896086] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:46:59.142815] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-16T20:46:59.942846] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-16T20:47:00.096468] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T20:47:00.742795] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-10-16T20:47:00.767847] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T20:47:00.774175] [INFO ] [REMOTE ] OSK: Full fetch complete (60995 records). [2025-10-16T20:47:00.774317] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-16T20:47:00.775135] [FATAL] [VALIDATOR ] OSK: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:47:00.775224] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:47:00.775269] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:47:00.775341] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-16T20:47:00.775461] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-16T20:47:00.775539] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-16T20:47:00.775617] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-16T20:47:00.775728] [INFO ] [MAIN ] Update Progress: 1610/2369 symbols completed. OSK took 38.1s. Estimated remaining: 1h 46m 59s. Rate: 7.1 symbols/min [2025-10-16T20:47:00.966508] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:47:00.966773] [DEBUG] [LOCAL ] OWL: No existing data file found in primary storage. [2025-10-16T20:47:00.966826] [WARN ] [MAIN ] OWL: No existing data found, performing full refresh instead. [2025-10-16T20:47:00.967039] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-16T20:47:00.967173] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-16T20:47:00.967230] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-16T20:47:00.967364] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-16T20:47:01.165862] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-16T20:47:01.376847] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:47:01.542782] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-10-16T20:47:02.342815] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-16T20:47:02.765830] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-16T20:47:03.079161] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T20:47:03.084685] [INFO ] [REMOTE ] OUT: Full fetch complete (68820 records). [2025-10-16T20:47:03.084810] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-10-16T20:47:03.085421] [FATAL] [VALIDATOR ] OUT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:47:03.085506] [FATAL] [MAIN ] OUT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:47:03.085548] [WARN ] [MAIN ] OUT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:47:03.085612] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-16T20:47:03.085703] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-16T20:47:03.085752] [INFO ] [LOCAL ] OUT: Starting deletion of derivative data. [2025-10-16T20:47:03.085793] [DEBUG] [LOCAL ] OUT: No derivative data file found to delete. [2025-10-16T20:47:03.085847] [INFO ] [MAIN ] Update Progress: 1611/2369 symbols completed. OUT took 31.4s. Estimated remaining: 1h 46m 48s. Rate: 7.1 symbols/min [2025-10-16T20:47:03.148956] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-16T20:47:03.303074] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:47:03.323696] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T20:47:03.341584] [DEBUG] [LOCAL ] OWLT: Loaded 9352 existing records from primary storage. [2025-10-16T20:47:03.341809] [INFO ] [MAIN ] OWLT: Loaded 9352 existing records. [2025-10-16T20:47:03.528226] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:47:03.528506] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-16T20:47:03.528561] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-16T20:47:03.528911] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-10-16T20:47:03.528981] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-16T20:47:03.892041] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:47:03.942767] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-10-16T20:47:04.742821] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-16T20:47:04.829152] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-16T20:47:04.990282] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-16T20:47:05.542837] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-16T20:47:06.236243] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T20:47:06.342813] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-16T20:47:06.691774] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-16T20:47:06.808469] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-16T20:47:07.142816] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-16T20:47:07.942812] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-16T20:47:08.742790] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-16T20:47:08.859163] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T20:47:08.866003] [INFO ] [REMOTE ] OTIS: Full fetch complete (75966 records). [2025-10-16T20:47:08.866180] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-16T20:47:08.867029] [FATAL] [VALIDATOR ] OTIS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:47:08.867142] [FATAL] [MAIN ] OTIS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:47:08.867210] [WARN ] [MAIN ] OTIS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:47:08.867286] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-16T20:47:08.867352] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-16T20:47:08.867389] [INFO ] [LOCAL ] OTIS: Starting deletion of derivative data. [2025-10-16T20:47:08.867429] [DEBUG] [LOCAL ] OTIS: No derivative data file found to delete. [2025-10-16T20:47:08.867485] [INFO ] [MAIN ] Update Progress: 1612/2369 symbols completed. OTIS took 37.7s. Estimated remaining: 1h 46m 38s. Rate: 7.1 symbols/min [2025-10-16T20:47:09.042533] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:47:09.042833] [DEBUG] [LOCAL ] OXM: No existing data file found in primary storage. [2025-10-16T20:47:09.042895] [WARN ] [MAIN ] OXM: No existing data found, performing full refresh instead. [2025-10-16T20:47:09.043018] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-16T20:47:09.043074] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-16T20:47:09.043120] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-16T20:47:09.043154] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-16T20:47:09.231484] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-16T20:47:09.434903] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:47:09.542807] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-10-16T20:47:10.342792] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-16T20:47:10.631759] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-16T20:47:10.719049] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T20:47:11.142848] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-16T20:47:11.185510] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T20:47:11.942824] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-16T20:47:12.742865] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-16T20:47:13.192779] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-16T20:47:13.259446] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T20:47:13.262791] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-16T20:47:13.542872] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-16T20:47:14.342849] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-16T20:47:14.875080] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T20:47:14.923489] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T20:47:15.142890] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-16T20:47:15.942834] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-16T20:47:16.034579] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-16T20:47:16.742820] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-16T20:47:17.542860] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-16T20:47:17.655427] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-16T20:47:17.781549] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T20:47:18.342862] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-16T20:47:19.101537] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T20:47:19.142768] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-16T20:47:19.942827] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-16T20:47:20.265938] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T20:47:20.742831] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-16T20:47:20.777818] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-16T20:47:20.823620] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T20:47:21.542820] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-16T20:47:22.342896] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-16T20:47:22.550959] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T20:47:22.624783] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T20:47:23.142844] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-16T20:47:23.284906] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-16T20:47:23.942870] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-16T20:47:24.742828] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-16T20:47:24.844144] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T20:47:24.846568] [INFO ] [REMOTE ] OWLT: Full fetch complete (12128 records). [2025-10-16T20:47:24.846675] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-16T20:47:25.218429] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-10-16T20:47:25.218544] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-10-16T20:47:25.218944] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-10-16T20:47:25.219073] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-10-16T20:47:25.220204] [DEBUG] [LOCAL ] OWLT: Trimmed 12128 records to 9470 (keeping 200 days of data) [2025-10-16T20:47:25.314927] [DEBUG] [LOCAL ] OWLT: Primary data saved (9470 records). [2025-10-16T20:47:25.315383] [INFO ] [MAIN ] OWLT: Full history saved. [2025-10-16T20:47:25.316118] [INFO ] [MAIN ] Update Progress: 1613/2369 symbols completed. OWLT took 22.2s. Estimated remaining: 1h 46m 34s. Rate: 7.1 symbols/min [2025-10-16T20:47:25.318037] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-16T20:47:25.525110] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:47:25.525384] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-16T20:47:25.525422] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-16T20:47:25.525548] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-16T20:47:25.525589] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-16T20:47:25.525629] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-16T20:47:25.525704] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-16T20:47:25.548012] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-16T20:47:25.909014] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:47:26.268552] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T20:47:26.342788] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-16T20:47:27.142820] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-10-16T20:47:27.671581] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-16T20:47:27.941255] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T20:47:27.948459] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-16T20:47:28.742809] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-16T20:47:29.542815] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-16T20:47:29.805343] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-16T20:47:29.847638] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-10-16T20:47:29.875516] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T20:47:30.342832] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-16T20:47:31.142937] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-16T20:47:31.423700] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T20:47:31.942856] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-16T20:47:32.127203] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T20:47:32.742853] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-16T20:47:33.383259] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T20:47:33.387581] [INFO ] [REMOTE ] OXM: Full fetch complete (45979 records). [2025-10-16T20:47:33.387710] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-16T20:47:33.388331] [FATAL] [VALIDATOR ] OXM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:47:33.388408] [FATAL] [MAIN ] OXM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:47:33.388474] [WARN ] [MAIN ] OXM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:47:33.388543] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-16T20:47:33.388607] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-16T20:47:33.388665] [INFO ] [LOCAL ] OXM: Starting deletion of derivative data. [2025-10-16T20:47:33.388732] [DEBUG] [LOCAL ] OXM: No derivative data file found to delete. [2025-10-16T20:47:33.388789] [INFO ] [MAIN ] Update Progress: 1614/2369 symbols completed. OXM took 24.5s. Estimated remaining: 1h 46m 25s. Rate: 7.1 symbols/min [2025-10-16T20:47:33.553527] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-16T20:47:33.557137] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:47:33.557335] [DEBUG] [LOCAL ] PAAS: No existing data file found in primary storage. [2025-10-16T20:47:33.557397] [WARN ] [MAIN ] PAAS: No existing data found, performing full refresh instead. [2025-10-16T20:47:33.557662] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-16T20:47:33.557718] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-16T20:47:33.558054] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-16T20:47:33.558138] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-16T20:47:33.945275] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:47:33.948304] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-10-16T20:47:33.990374] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-16T20:47:34.342880] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-16T20:47:35.142823] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-16T20:47:35.742835] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-16T20:47:35.942781] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-16T20:47:36.363697] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-16T20:47:36.742877] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-16T20:47:37.542788] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-10-16T20:47:37.696083] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-16T20:47:37.897666] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-16T20:47:38.342905] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-16T20:47:38.381930] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T20:47:39.142817] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-16T20:47:39.587758] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-16T20:47:39.654276] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-16T20:47:39.660750] [INFO ] [REMOTE ] OWL: Full fetch complete (77319 records). [2025-10-16T20:47:39.660878] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-16T20:47:39.661664] [FATAL] [VALIDATOR ] OWL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:47:39.661757] [FATAL] [MAIN ] OWL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:47:39.661800] [WARN ] [MAIN ] OWL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:47:39.661839] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-16T20:47:39.661895] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-16T20:47:39.661930] [INFO ] [LOCAL ] OWL: Starting deletion of derivative data. [2025-10-16T20:47:39.661968] [DEBUG] [LOCAL ] OWL: No derivative data file found to delete. [2025-10-16T20:47:39.662023] [INFO ] [MAIN ] Update Progress: 1615/2369 symbols completed. OWL took 38.9s. Estimated remaining: 1h 46m 16s. Rate: 7.1 symbols/min [2025-10-16T20:47:39.828555] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:47:39.841877] [DEBUG] [LOCAL ] PAC: Loaded 11713 existing records from primary storage. [2025-10-16T20:47:39.842107] [INFO ] [MAIN ] PAC: Loaded 11713 existing records. [2025-10-16T20:47:39.942786] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-16T20:47:40.022147] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:47:40.022337] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-16T20:47:40.022384] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-16T20:47:40.022558] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-10-16T20:47:40.022615] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-16T20:47:40.377309] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:47:40.466832] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-16T20:47:40.742783] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-16T20:47:41.514721] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T20:47:41.542774] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-16T20:47:41.972136] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-16T20:47:41.978548] [INFO ] [REMOTE ] OVV: Full fetch complete (77135 records). [2025-10-16T20:47:41.978707] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-16T20:47:41.979539] [FATAL] [VALIDATOR ] OVV: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:47:41.979689] [FATAL] [MAIN ] OVV: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:47:41.979775] [WARN ] [MAIN ] OVV: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:47:41.979862] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-16T20:47:41.979937] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-16T20:47:41.979976] [INFO ] [LOCAL ] OVV: Starting deletion of derivative data. [2025-10-16T20:47:41.980016] [DEBUG] [LOCAL ] OVV: No derivative data file found to delete. [2025-10-16T20:47:41.980072] [INFO ] [MAIN ] Update Progress: 1616/2369 symbols completed. OVV took 43.7s. Estimated remaining: 1h 46m 4s. Rate: 7.1 symbols/min [2025-10-16T20:47:42.146910] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:47:42.179496] [DEBUG] [LOCAL ] PACK: Loaded 31968 existing records from primary storage. [2025-10-16T20:47:42.179789] [INFO ] [MAIN ] PACK: Loaded 31968 existing records. [2025-10-16T20:47:42.352759] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-10-16T20:47:42.359492] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:47:42.359746] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-16T20:47:42.360581] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-16T20:47:42.360958] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-10-16T20:47:42.361018] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-16T20:47:42.718213] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:47:43.093377] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-16T20:47:43.142783] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-16T20:47:43.332295] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T20:47:43.942818] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-10-16T20:47:44.742825] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-16T20:47:45.172635] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T20:47:45.542849] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-16T20:47:45.710420] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-16T20:47:46.342781] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-16T20:47:46.499044] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T20:47:46.589779] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T20:47:47.142883] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-16T20:47:47.942886] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-16T20:47:48.742853] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-16T20:47:48.940485] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-16T20:47:49.032172] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-16T20:47:49.056934] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T20:47:49.542784] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-16T20:47:49.663280] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T20:47:50.342809] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-16T20:47:51.142911] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-16T20:47:51.286298] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-16T20:47:51.942800] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-16T20:47:52.375769] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-10-16T20:47:52.742810] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-16T20:47:52.890318] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T20:47:53.245735] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T20:47:53.542776] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-16T20:47:53.938579] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T20:47:54.342829] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-16T20:47:55.036932] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T20:47:55.142850] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-16T20:47:55.684173] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-16T20:47:55.942811] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-16T20:47:56.742826] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-16T20:47:56.845412] [DEBUG] [REMOTE ] PAC: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-16T20:47:56.845731] [WARN ] [REMOTE ] PAC: No data returned for month 2025-06 [2025-10-16T20:47:56.845840] [FATAL] [REMOTE ] PAC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:47:56.845964] [FATAL] [MAIN ] PAC: Failed to fetch primary data. [2025-10-16T20:47:56.846051] [WARN ] [MAIN ] PAC: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:47:56.846145] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-16T20:47:56.846227] [DEBUG] [LOCAL ] PAC: No primary data file found to delete. [2025-10-16T20:47:56.846291] [INFO ] [LOCAL ] PAC: Starting deletion of derivative data. [2025-10-16T20:47:56.846448] [DEBUG] [LOCAL ] PAC: Deleted derivative data file. [2025-10-16T20:47:56.846545] [INFO ] [MAIN ] Update Progress: 1617/2369 symbols completed. PAC took 17.2s. Estimated remaining: 1h 45m 59s. Rate: 7.1 symbols/min [2025-10-16T20:47:57.020312] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:47:57.020499] [DEBUG] [LOCAL ] PACS: No existing data file found in primary storage. [2025-10-16T20:47:57.020549] [WARN ] [MAIN ] PACS: No existing data found, performing full refresh instead. [2025-10-16T20:47:57.020693] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-16T20:47:57.020746] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-16T20:47:57.020790] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-16T20:47:57.020825] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-16T20:47:57.392093] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:47:57.433235] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T20:47:57.542841] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-16T20:47:57.590767] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-16T20:47:58.342840] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-16T20:47:59.142871] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-10-16T20:47:59.942851] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-16T20:47:59.978519] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T20:48:00.231754] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-16T20:48:00.742789] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-16T20:48:00.824020] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T20:48:01.542801] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-16T20:48:02.242605] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T20:48:02.342822] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-16T20:48:02.406685] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-16T20:48:03.142834] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-16T20:48:03.787513] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-16T20:48:03.933766] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T20:48:03.942762] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-16T20:48:04.004759] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T20:48:04.012067] [INFO ] [REMOTE ] OXY: Full fetch complete (77195 records). [2025-10-16T20:48:04.012207] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-16T20:48:04.013201] [FATAL] [VALIDATOR ] OXY: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:48:04.013307] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:48:04.013351] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:48:04.013416] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-16T20:48:04.013492] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-16T20:48:04.013551] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-16T20:48:04.013637] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-16T20:48:04.013797] [INFO ] [MAIN ] Update Progress: 1618/2369 symbols completed. OXY took 38.7s. Estimated remaining: 1h 45m 50s. Rate: 7.1 symbols/min [2025-10-16T20:48:04.206222] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:48:04.206394] [DEBUG] [LOCAL ] PAG: No existing data file found in primary storage. [2025-10-16T20:48:04.206477] [WARN ] [MAIN ] PAG: No existing data found, performing full refresh instead. [2025-10-16T20:48:04.206627] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-16T20:48:04.206728] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-16T20:48:04.206802] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-16T20:48:04.206840] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-16T20:48:04.594814] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:48:04.742811] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-10-16T20:48:05.488385] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T20:48:05.542776] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-16T20:48:05.932675] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T20:48:06.342809] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-16T20:48:07.142853] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-16T20:48:07.187881] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T20:48:07.942822] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-16T20:48:08.365252] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-16T20:48:08.610435] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-16T20:48:08.742823] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-16T20:48:09.149975] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T20:48:09.542848] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-16T20:48:10.013256] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T20:48:10.342878] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-16T20:48:10.573304] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-16T20:48:11.142856] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-16T20:48:11.719737] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T20:48:11.942853] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-16T20:48:12.742828] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-16T20:48:12.774588] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T20:48:13.542818] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-16T20:48:13.648959] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T20:48:14.180262] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T20:48:14.329322] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-16T20:48:14.342773] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-16T20:48:15.142937] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-16T20:48:15.678202] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T20:48:15.942827] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-16T20:48:16.742869] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-16T20:48:17.447231] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-16T20:48:17.452459] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T20:48:17.542849] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-16T20:48:18.251183] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T20:48:18.342787] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-16T20:48:18.370428] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T20:48:18.376923] [INFO ] [REMOTE ] PAAS: Full fetch complete (77231 records). [2025-10-16T20:48:18.377050] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-16T20:48:18.377860] [FATAL] [VALIDATOR ] PAAS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:48:18.377973] [FATAL] [MAIN ] PAAS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:48:18.378056] [WARN ] [MAIN ] PAAS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:48:18.378146] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-16T20:48:18.378264] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-16T20:48:18.378321] [INFO ] [LOCAL ] PAAS: Starting deletion of derivative data. [2025-10-16T20:48:18.378366] [DEBUG] [LOCAL ] PAAS: No derivative data file found to delete. [2025-10-16T20:48:18.378426] [INFO ] [MAIN ] Update Progress: 1619/2369 symbols completed. PAAS took 45.0s. Estimated remaining: 1h 45m 44s. Rate: 7.1 symbols/min [2025-10-16T20:48:18.551710] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:48:18.551900] [DEBUG] [LOCAL ] PAGS: No existing data file found in primary storage. [2025-10-16T20:48:18.551939] [WARN ] [MAIN ] PAGS: No existing data found, performing full refresh instead. [2025-10-16T20:48:18.552109] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-16T20:48:18.552170] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-16T20:48:18.552218] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-16T20:48:18.552253] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-16T20:48:18.924133] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:48:19.142826] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-10-16T20:48:19.844495] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T20:48:19.942824] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-16T20:48:20.742798] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-16T20:48:21.173928] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-16T20:48:21.282127] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T20:48:21.286736] [INFO ] [REMOTE ] PACK: Full fetch complete (45034 records). [2025-10-16T20:48:21.286865] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-16T20:48:21.548038] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-16T20:48:21.661414] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-10-16T20:48:21.661495] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-10-16T20:48:21.662341] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-10-16T20:48:21.662404] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-10-16T20:48:21.663481] [DEBUG] [LOCAL ] PACK: Trimmed 45034 records to 32206 (keeping 200 days of data) [2025-10-16T20:48:21.856721] [DEBUG] [LOCAL ] PACK: Primary data saved (32206 records). [2025-10-16T20:48:21.856871] [INFO ] [MAIN ] PACK: Full history saved. [2025-10-16T20:48:21.856955] [INFO ] [MAIN ] Update Progress: 1620/2369 symbols completed. PACK took 39.9s. Estimated remaining: 1h 45m 33s. Rate: 7.1 symbols/min [2025-10-16T20:48:22.026680] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:48:22.032267] [DEBUG] [LOCAL ] PAI: Loaded 2732 existing records from primary storage. [2025-10-16T20:48:22.032444] [INFO ] [MAIN ] PAI: Loaded 2732 existing records. [2025-10-16T20:48:22.208145] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:48:22.208438] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-16T20:48:22.208508] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-16T20:48:22.215664] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-10-16T20:48:22.226268] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-16T20:48:22.290236] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T20:48:22.344610] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-16T20:48:22.662232] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:48:22.759467] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T20:48:23.142830] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-16T20:48:23.942818] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-10-16T20:48:24.286818] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-16T20:48:24.613624] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-16T20:48:24.742838] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-16T20:48:24.970574] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T20:48:25.542821] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-16T20:48:26.291269] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T20:48:26.296317] [INFO ] [REMOTE ] PACS: Full fetch complete (50417 records). [2025-10-16T20:48:26.296438] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-16T20:48:26.297097] [FATAL] [VALIDATOR ] PACS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:48:26.297184] [FATAL] [MAIN ] PACS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:48:26.297228] [WARN ] [MAIN ] PACS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:48:26.297295] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-16T20:48:26.297364] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-16T20:48:26.297425] [INFO ] [LOCAL ] PACS: Starting deletion of derivative data. [2025-10-16T20:48:26.297506] [DEBUG] [LOCAL ] PACS: No derivative data file found to delete. [2025-10-16T20:48:26.297572] [INFO ] [MAIN ] Update Progress: 1621/2369 symbols completed. PACS took 29.5s. Estimated remaining: 1h 45m 23s. Rate: 7.1 symbols/min [2025-10-16T20:48:26.347131] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-16T20:48:26.507390] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:48:26.507688] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-16T20:48:26.507790] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-16T20:48:26.508024] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-16T20:48:26.508095] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-16T20:48:26.508168] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-16T20:48:26.508293] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-16T20:48:26.752458] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-16T20:48:26.984639] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:48:27.142833] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-10-16T20:48:27.326214] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-16T20:48:27.424069] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:48:27.424350] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-10-16T20:48:27.424453] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:48:27.424530] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-16T20:48:27.424600] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:48:27.424697] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-16T20:48:27.424802] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-16T20:48:27.424873] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-16T20:48:27.424928] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-16T20:48:27.424976] [INFO ] [MAIN ] Update Progress: 1622/2369 symbols completed. PAII took 1.1s. Estimated remaining: 1h 45m 11s. Rate: 7.1 symbols/min [2025-10-16T20:48:27.594949] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:48:27.595143] [DEBUG] [LOCAL ] PAM: No existing data file found in primary storage. [2025-10-16T20:48:27.595182] [WARN ] [MAIN ] PAM: No existing data found, performing full refresh instead. [2025-10-16T20:48:27.595288] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-16T20:48:27.595332] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-16T20:48:27.595373] [DEBUG] [LOCAL ] PAM: No primary data file found to delete. [2025-10-16T20:48:27.595414] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-16T20:48:27.956801] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-16T20:48:27.962467] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:48:28.742826] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-10-16T20:48:29.542824] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-16T20:48:29.867980] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-16T20:48:30.283270] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T20:48:30.342827] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-16T20:48:30.478366] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T20:48:31.142868] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-16T20:48:31.861006] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-16T20:48:31.942796] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-16T20:48:32.191984] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T20:48:32.421628] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-16T20:48:32.742825] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-16T20:48:33.369073] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T20:48:33.542847] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-16T20:48:34.342833] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-16T20:48:34.910503] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T20:48:35.060481] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T20:48:35.142820] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-16T20:48:35.942870] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-16T20:48:36.508395] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T20:48:36.620123] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T20:48:36.742825] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-16T20:48:37.338203] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-16T20:48:37.542879] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-16T20:48:38.342848] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-16T20:48:38.855280] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T20:48:39.015948] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-16T20:48:39.142869] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-16T20:48:39.942821] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-16T20:48:40.361776] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T20:48:40.742800] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-16T20:48:40.980512] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T20:48:41.542810] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-16T20:48:42.298281] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T20:48:42.342768] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-16T20:48:42.835904] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T20:48:43.142811] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-16T20:48:43.942775] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-16T20:48:44.164471] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T20:48:44.209680] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T20:48:44.492974] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-16T20:48:44.742887] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-16T20:48:45.542852] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-16T20:48:45.934171] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T20:48:46.120931] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T20:48:46.123913] [INFO ] [REMOTE ] PAG: Full fetch complete (30494 records). [2025-10-16T20:48:46.124014] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-16T20:48:46.124492] [FATAL] [VALIDATOR ] PAG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:48:46.124576] [FATAL] [MAIN ] PAG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:48:46.124619] [WARN ] [MAIN ] PAG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:48:46.124703] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-16T20:48:46.124767] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-16T20:48:46.124804] [INFO ] [LOCAL ] PAG: Starting deletion of derivative data. [2025-10-16T20:48:46.124842] [DEBUG] [LOCAL ] PAG: No derivative data file found to delete. [2025-10-16T20:48:46.124895] [INFO ] [MAIN ] Update Progress: 1623/2369 symbols completed. PAG took 42.1s. Estimated remaining: 1h 45m 7s. Rate: 7.1 symbols/min [2025-10-16T20:48:46.306010] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:48:46.306165] [DEBUG] [LOCAL ] PAR: No existing data file found in primary storage. [2025-10-16T20:48:46.306201] [WARN ] [MAIN ] PAR: No existing data found, performing full refresh instead. [2025-10-16T20:48:46.306310] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-16T20:48:46.306350] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-16T20:48:46.306390] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-16T20:48:46.306421] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-16T20:48:46.347934] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-16T20:48:46.696411] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:48:47.142884] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-10-16T20:48:47.942811] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-16T20:48:48.282034] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T20:48:48.549121] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T20:48:48.684951] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-16T20:48:48.742864] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-16T20:48:49.542862] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-16T20:48:50.348010] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-16T20:48:50.365427] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T20:48:50.983601] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T20:48:50.984927] [INFO ] [REMOTE ] PAI: Full fetch complete (4132 records). [2025-10-16T20:48:50.985007] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-16T20:48:51.151292] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-16T20:48:51.385416] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-16T20:48:51.385514] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-16T20:48:51.385716] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-16T20:48:51.385778] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-16T20:48:51.386191] [DEBUG] [LOCAL ] PAI: Trimmed 4132 records to 2788 (keeping 200 days of data) [2025-10-16T20:48:51.404341] [DEBUG] [LOCAL ] PAI: Primary data saved (2788 records). [2025-10-16T20:48:51.404473] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-16T20:48:51.404591] [INFO ] [MAIN ] Update Progress: 1624/2369 symbols completed. PAI took 29.5s. Estimated remaining: 1h 44m 58s. Rate: 7.1 symbols/min [2025-10-16T20:48:51.578334] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:48:51.578705] [DEBUG] [LOCAL ] PARR: No existing data file found in primary storage. [2025-10-16T20:48:51.578777] [WARN ] [MAIN ] PARR: No existing data found, performing full refresh instead. [2025-10-16T20:48:51.579035] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-16T20:48:51.579105] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-16T20:48:51.579175] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-16T20:48:51.579218] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-16T20:48:51.782676] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-16T20:48:51.951605] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-16T20:48:52.005172] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:48:52.373207] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T20:48:52.742824] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-10-16T20:48:53.395133] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T20:48:53.542800] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-16T20:48:54.342801] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-16T20:48:54.449241] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T20:48:54.940035] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T20:48:55.142837] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-16T20:48:55.332443] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T20:48:55.942815] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-16T20:48:56.742787] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-16T20:48:57.132752] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-16T20:48:57.542841] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-16T20:48:57.622150] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T20:48:58.071774] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-16T20:48:58.078587] [INFO ] [REMOTE ] PAGS: Full fetch complete (76128 records). [2025-10-16T20:48:58.078794] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-16T20:48:58.079726] [FATAL] [VALIDATOR ] PAGS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:48:58.079826] [FATAL] [MAIN ] PAGS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:48:58.079869] [WARN ] [MAIN ] PAGS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:48:58.079935] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-16T20:48:58.080000] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-16T20:48:58.080035] [INFO ] [LOCAL ] PAGS: Starting deletion of derivative data. [2025-10-16T20:48:58.080074] [DEBUG] [LOCAL ] PAGS: No derivative data file found to delete. [2025-10-16T20:48:58.080130] [INFO ] [MAIN ] Update Progress: 1625/2369 symbols completed. PAGS took 39.7s. Estimated remaining: 1h 44m 48s. Rate: 7.1 symbols/min [2025-10-16T20:48:58.253447] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:48:58.253636] [DEBUG] [LOCAL ] PATH: No existing data file found in primary storage. [2025-10-16T20:48:58.253773] [WARN ] [MAIN ] PATH: No existing data found, performing full refresh instead. [2025-10-16T20:48:58.253936] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-16T20:48:58.253989] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-16T20:48:58.254145] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-16T20:48:58.254195] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-16T20:48:58.347219] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-16T20:48:58.348719] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T20:48:58.654549] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:48:59.142822] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-16T20:48:59.942798] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-10-16T20:49:00.029148] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T20:49:00.104293] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-16T20:49:00.742869] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-16T20:49:01.542879] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-16T20:49:02.156101] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T20:49:02.342868] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-16T20:49:02.468389] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-16T20:49:02.517568] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T20:49:02.521830] [INFO ] [REMOTE ] PAM: Full fetch complete (42045 records). [2025-10-16T20:49:02.521946] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-16T20:49:02.522543] [FATAL] [VALIDATOR ] PAM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:49:02.522630] [FATAL] [MAIN ] PAM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:49:02.522712] [WARN ] [MAIN ] PAM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:49:02.522760] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-16T20:49:02.522817] [DEBUG] [LOCAL ] PAM: No primary data file found to delete. [2025-10-16T20:49:02.522852] [INFO ] [LOCAL ] PAM: Starting deletion of derivative data. [2025-10-16T20:49:02.522891] [DEBUG] [LOCAL ] PAM: No derivative data file found to delete. [2025-10-16T20:49:02.522948] [INFO ] [MAIN ] Update Progress: 1626/2369 symbols completed. PAM took 35.1s. Estimated remaining: 1h 44m 38s. Rate: 7.1 symbols/min [2025-10-16T20:49:02.706787] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:49:02.706990] [DEBUG] [LOCAL ] PAXS: No existing data file found in primary storage. [2025-10-16T20:49:02.707038] [WARN ] [MAIN ] PAXS: No existing data found, performing full refresh instead. [2025-10-16T20:49:02.707173] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-16T20:49:02.707242] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-16T20:49:02.707310] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-16T20:49:02.707354] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-16T20:49:03.062450] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:49:03.142827] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-16T20:49:03.942853] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-10-16T20:49:04.087393] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T20:49:04.742850] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-16T20:49:05.309909] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T20:49:05.453812] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-16T20:49:05.542841] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-16T20:49:06.342822] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-16T20:49:06.555944] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T20:49:06.665313] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T20:49:07.142869] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-16T20:49:07.942857] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-16T20:49:08.597978] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-16T20:49:08.742910] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-16T20:49:08.777868] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T20:49:09.544825] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-16T20:49:09.550405] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T20:49:10.342874] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-16T20:49:11.142845] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-16T20:49:11.221218] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T20:49:11.296778] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-16T20:49:11.653734] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-16T20:49:11.942826] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-16T20:49:12.013105] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T20:49:12.742858] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-16T20:49:13.542853] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-16T20:49:13.701489] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T20:49:13.980203] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-16T20:49:14.342842] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-16T20:49:14.442303] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T20:49:14.447558] [INFO ] [REMOTE ] PAR: Full fetch complete (48652 records). [2025-10-16T20:49:14.447786] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-16T20:49:14.448509] [FATAL] [VALIDATOR ] PAR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:49:14.448628] [FATAL] [MAIN ] PAR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:49:14.448731] [WARN ] [MAIN ] PAR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:49:14.448826] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-16T20:49:14.448962] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-16T20:49:14.449035] [INFO ] [LOCAL ] PAR: Starting deletion of derivative data. [2025-10-16T20:49:14.449112] [DEBUG] [LOCAL ] PAR: No derivative data file found to delete. [2025-10-16T20:49:14.449207] [INFO ] [MAIN ] Update Progress: 1627/2369 symbols completed. PAR took 28.3s. Estimated remaining: 1h 44m 31s. Rate: 7.1 symbols/min [2025-10-16T20:49:14.616681] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:49:14.616838] [DEBUG] [LOCAL ] PAY: No existing data file found in primary storage. [2025-10-16T20:49:14.616875] [WARN ] [MAIN ] PAY: No existing data found, performing full refresh instead. [2025-10-16T20:49:14.617016] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-16T20:49:14.617082] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-16T20:49:14.617133] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-16T20:49:14.617166] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-16T20:49:14.963129] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:49:15.142777] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-10-16T20:49:15.942839] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-16T20:49:16.043716] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T20:49:16.690061] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T20:49:16.742788] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-16T20:49:16.770385] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-16T20:49:17.542818] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-16T20:49:18.224161] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T20:49:18.342777] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-16T20:49:19.142831] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-16T20:49:19.735815] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T20:49:19.942781] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-16T20:49:19.991584] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-16T20:49:20.062354] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-16T20:49:20.742809] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-16T20:49:21.338804] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T20:49:21.542834] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-16T20:49:22.342847] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-16T20:49:22.684855] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-16T20:49:22.857129] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-16T20:49:23.142815] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-16T20:49:23.751622] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T20:49:23.942810] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-16T20:49:24.322206] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T20:49:24.742880] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-16T20:49:25.542871] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-16T20:49:25.628180] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T20:49:26.025387] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-16T20:49:26.342821] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-16T20:49:27.142883] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-16T20:49:27.425595] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-16T20:49:27.952178] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-16T20:49:27.975700] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-16T20:49:28.682629] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T20:49:28.742833] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-16T20:49:29.201475] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T20:49:29.542877] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-16T20:49:30.199407] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T20:49:30.201977] [INFO ] [REMOTE ] PAXS: Full fetch complete (29738 records). [2025-10-16T20:49:30.202157] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-16T20:49:30.202806] [FATAL] [VALIDATOR ] PAXS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:49:30.202947] [FATAL] [MAIN ] PAXS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:49:30.203012] [WARN ] [MAIN ] PAXS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:49:30.203061] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-16T20:49:30.203116] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-16T20:49:30.203151] [INFO ] [LOCAL ] PAXS: Starting deletion of derivative data. [2025-10-16T20:49:30.203192] [DEBUG] [LOCAL ] PAXS: No derivative data file found to delete. [2025-10-16T20:49:30.203244] [INFO ] [MAIN ] Update Progress: 1628/2369 symbols completed. PAXS took 27.7s. Estimated remaining: 1h 44m 26s. Rate: 7.1 symbols/min [2025-10-16T20:49:30.346100] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-16T20:49:30.408085] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:49:30.409820] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T20:49:30.409899] [DEBUG] [LOCAL ] PAYC: No existing data file found in primary storage. [2025-10-16T20:49:30.418174] [WARN ] [MAIN ] PAYC: No existing data found, performing full refresh instead. [2025-10-16T20:49:30.418346] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-16T20:49:30.418706] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-16T20:49:30.418765] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-16T20:49:30.418799] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-16T20:49:30.767632] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:49:31.142837] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-10-16T20:49:31.942773] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-16T20:49:32.213141] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-16T20:49:32.747894] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-16T20:49:32.760378] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T20:49:33.530213] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T20:49:33.542766] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-16T20:49:34.132286] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T20:49:34.342783] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-16T20:49:35.148290] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-16T20:49:35.160731] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T20:49:35.942859] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-16T20:49:36.096975] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T20:49:36.599087] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T20:49:36.606403] [INFO ] [REMOTE ] PAY: Full fetch complete (53691 records). [2025-10-16T20:49:36.606571] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-16T20:49:36.607505] [FATAL] [VALIDATOR ] PAY: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:49:36.607611] [FATAL] [MAIN ] PAY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:49:36.607709] [WARN ] [MAIN ] PAY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:49:36.607798] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-16T20:49:36.607878] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-16T20:49:36.607927] [INFO ] [LOCAL ] PAY: Starting deletion of derivative data. [2025-10-16T20:49:36.607986] [DEBUG] [LOCAL ] PAY: No derivative data file found to delete. [2025-10-16T20:49:36.608064] [INFO ] [MAIN ] Update Progress: 1629/2369 symbols completed. PAY took 22.2s. Estimated remaining: 1h 44m 17s. Rate: 7.1 symbols/min [2025-10-16T20:49:36.753296] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-16T20:49:36.784787] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:49:36.784910] [DEBUG] [LOCAL ] PB: No existing data file found in primary storage. [2025-10-16T20:49:36.784947] [WARN ] [MAIN ] PB: No existing data found, performing full refresh instead. [2025-10-16T20:49:36.785050] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-16T20:49:36.785090] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-16T20:49:36.785130] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-16T20:49:36.785161] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-16T20:49:37.135193] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:49:37.542821] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-10-16T20:49:37.635247] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-16T20:49:38.342811] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-16T20:49:38.422005] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T20:49:38.851033] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-16T20:49:38.856807] [INFO ] [REMOTE ] PARR: Full fetch complete (68765 records). [2025-10-16T20:49:38.856930] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-16T20:49:38.857702] [FATAL] [VALIDATOR ] PARR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:49:38.857831] [FATAL] [MAIN ] PARR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:49:38.857896] [WARN ] [MAIN ] PARR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:49:38.857968] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-16T20:49:38.858032] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-16T20:49:38.858066] [INFO ] [LOCAL ] PARR: Starting deletion of derivative data. [2025-10-16T20:49:38.858105] [DEBUG] [LOCAL ] PARR: No derivative data file found to delete. [2025-10-16T20:49:38.858159] [INFO ] [MAIN ] Update Progress: 1630/2369 symbols completed. PARR took 47.5s. Estimated remaining: 1h 44m 5s. Rate: 7.1 symbols/min [2025-10-16T20:49:39.034509] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:49:39.034767] [DEBUG] [LOCAL ] PBA: No existing data file found in primary storage. [2025-10-16T20:49:39.034917] [WARN ] [MAIN ] PBA: No existing data found, performing full refresh instead. [2025-10-16T20:49:39.041862] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-16T20:49:39.052801] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-16T20:49:39.052980] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-16T20:49:39.053601] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-16T20:49:39.054341] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T20:49:39.148344] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-16T20:49:39.446381] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:49:39.942813] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-10-16T20:49:40.742842] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-16T20:49:41.542855] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-16T20:49:41.670227] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T20:49:41.732488] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-16T20:49:42.342846] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-16T20:49:42.458935] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T20:49:43.056510] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T20:49:43.142780] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-16T20:49:43.942809] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-16T20:49:44.069458] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T20:49:44.436421] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T20:49:44.442741] [INFO ] [REMOTE ] PATH: Full fetch complete (77461 records). [2025-10-16T20:49:44.442861] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-16T20:49:44.443559] [FATAL] [VALIDATOR ] PATH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:49:44.443666] [FATAL] [MAIN ] PATH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:49:44.443723] [WARN ] [MAIN ] PATH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:49:44.443795] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-16T20:49:44.443857] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-16T20:49:44.443893] [INFO ] [LOCAL ] PATH: Starting deletion of derivative data. [2025-10-16T20:49:44.443931] [DEBUG] [LOCAL ] PATH: No derivative data file found to delete. [2025-10-16T20:49:44.444000] [INFO ] [MAIN ] Update Progress: 1631/2369 symbols completed. PATH took 46.4s. Estimated remaining: 1h 43m 56s. Rate: 7.1 symbols/min [2025-10-16T20:49:44.615732] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:49:44.615908] [DEBUG] [LOCAL ] PBF: No existing data file found in primary storage. [2025-10-16T20:49:44.615977] [WARN ] [MAIN ] PBF: No existing data found, performing full refresh instead. [2025-10-16T20:49:44.616195] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-16T20:49:44.616279] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-16T20:49:44.616346] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-16T20:49:44.616385] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-16T20:49:44.745242] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-16T20:49:44.740040] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T20:49:44.997175] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:49:45.542817] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-16T20:49:46.342789] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-16T20:49:46.557687] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T20:49:47.142860] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-10-16T20:49:47.238324] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T20:49:47.718582] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T20:49:47.942822] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-16T20:49:48.742774] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-16T20:49:48.827444] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T20:49:49.437164] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T20:49:49.542814] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-16T20:49:50.342788] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-16T20:49:50.449109] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T20:49:51.142806] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-16T20:49:51.249335] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T20:49:51.845701] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T20:49:51.942809] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-16T20:49:52.742817] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-16T20:49:52.981782] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-16T20:49:53.542836] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-16T20:49:53.842797] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T20:49:54.342798] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-16T20:49:54.437165] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T20:49:55.142791] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-16T20:49:55.314470] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T20:49:55.738046] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T20:49:55.942798] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-16T20:49:56.742822] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-16T20:49:56.808031] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T20:49:57.437394] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T20:49:57.542774] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-16T20:49:58.317246] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T20:49:58.342779] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-16T20:49:59.142850] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-16T20:49:59.507996] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T20:49:59.775950] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T20:49:59.942866] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-16T20:50:00.752864] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-16T20:50:00.759863] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T20:50:01.270525] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T20:50:01.542875] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-16T20:50:02.342858] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-16T20:50:02.653609] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-16T20:50:03.142788] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-16T20:50:03.659820] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-16T20:50:03.942782] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-16T20:50:04.147957] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T20:50:04.742795] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-16T20:50:04.801087] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T20:50:05.542805] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-16T20:50:05.642009] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T20:50:06.342843] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-16T20:50:06.376594] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T20:50:07.142818] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-16T20:50:07.214719] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T20:50:07.942827] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-16T20:50:08.380440] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-16T20:50:08.675626] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T20:50:08.680376] [INFO ] [REMOTE ] PAYC: Full fetch complete (52876 records). [2025-10-16T20:50:08.680513] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-16T20:50:08.681229] [FATAL] [VALIDATOR ] PAYC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:50:08.681335] [FATAL] [MAIN ] PAYC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:50:08.681402] [WARN ] [MAIN ] PAYC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:50:08.681474] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-16T20:50:08.681537] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-16T20:50:08.681573] [INFO ] [LOCAL ] PAYC: Starting deletion of derivative data. [2025-10-16T20:50:08.681611] [DEBUG] [LOCAL ] PAYC: No derivative data file found to delete. [2025-10-16T20:50:08.681689] [INFO ] [MAIN ] Update Progress: 1632/2369 symbols completed. PAYC took 38.5s. Estimated remaining: 1h 43m 54s. Rate: 7.1 symbols/min [2025-10-16T20:50:08.748077] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-16T20:50:08.859945] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:50:08.860149] [DEBUG] [LOCAL ] PBH: No existing data file found in primary storage. [2025-10-16T20:50:08.860192] [WARN ] [MAIN ] PBH: No existing data found, performing full refresh instead. [2025-10-16T20:50:08.860307] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-16T20:50:08.860347] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-16T20:50:08.860388] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-16T20:50:08.860419] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-16T20:50:09.229762] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:50:09.258628] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-16T20:50:09.542805] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-16T20:50:10.321303] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T20:50:10.326770] [INFO ] [REMOTE ] PB: Full fetch complete (59116 records). [2025-10-16T20:50:10.326885] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-16T20:50:10.327795] [FATAL] [VALIDATOR ] PB: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:50:10.327898] [FATAL] [MAIN ] PB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:50:10.327986] [WARN ] [MAIN ] PB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:50:10.328080] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-16T20:50:10.328181] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-16T20:50:10.328287] [INFO ] [LOCAL ] PB: Starting deletion of derivative data. [2025-10-16T20:50:10.328382] [DEBUG] [LOCAL ] PB: No derivative data file found to delete. [2025-10-16T20:50:10.328475] [INFO ] [MAIN ] Update Progress: 1633/2369 symbols completed. PB took 33.7s. Estimated remaining: 1h 43m 43s. Rate: 7.1 symbols/min [2025-10-16T20:50:10.351630] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-10-16T20:50:10.513111] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:50:10.513268] [DEBUG] [LOCAL ] PBI: No existing data file found in primary storage. [2025-10-16T20:50:10.513311] [WARN ] [MAIN ] PBI: No existing data found, performing full refresh instead. [2025-10-16T20:50:10.513450] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-16T20:50:10.513508] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-16T20:50:10.513554] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-16T20:50:10.513590] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-16T20:50:10.879615] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:50:10.909552] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-16T20:50:11.142800] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-10-16T20:50:11.661169] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T20:50:11.942843] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-16T20:50:12.653924] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T20:50:12.742814] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-16T20:50:13.542879] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-16T20:50:14.120004] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-16T20:50:14.164065] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-16T20:50:14.170105] [INFO ] [REMOTE ] PBA: Full fetch complete (71313 records). [2025-10-16T20:50:14.170216] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-16T20:50:14.170994] [FATAL] [VALIDATOR ] PBA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:50:14.171083] [FATAL] [MAIN ] PBA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:50:14.171152] [WARN ] [MAIN ] PBA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:50:14.171225] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-16T20:50:14.171289] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-16T20:50:14.171327] [INFO ] [LOCAL ] PBA: Starting deletion of derivative data. [2025-10-16T20:50:14.171371] [DEBUG] [LOCAL ] PBA: No derivative data file found to delete. [2025-10-16T20:50:14.171494] [INFO ] [MAIN ] Update Progress: 1634/2369 symbols completed. PBA took 35.3s. Estimated remaining: 1h 43m 32s. Rate: 7.1 symbols/min [2025-10-16T20:50:14.343403] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T20:50:14.343550] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-16T20:50:14.372792] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:50:14.372909] [DEBUG] [LOCAL ] PBR: No existing data file found in primary storage. [2025-10-16T20:50:14.372958] [WARN ] [MAIN ] PBR: No existing data found, performing full refresh instead. [2025-10-16T20:50:14.373065] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-16T20:50:14.373105] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-16T20:50:14.373227] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-16T20:50:14.373440] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-16T20:50:14.723096] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:50:15.142884] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-16T20:50:15.942863] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-16T20:50:16.254418] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-16T20:50:16.617313] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T20:50:16.742787] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-16T20:50:17.542791] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-10-16T20:50:17.888264] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-16T20:50:18.120889] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T20:50:18.342805] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-16T20:50:18.882788] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-16T20:50:18.894234] [INFO ] [REMOTE ] PBF: Full fetch complete (76362 records). [2025-10-16T20:50:18.894428] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-16T20:50:18.895411] [FATAL] [VALIDATOR ] PBF: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:50:18.895518] [FATAL] [MAIN ] PBF: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:50:18.895571] [WARN ] [MAIN ] PBF: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:50:18.895677] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-16T20:50:18.895814] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-16T20:50:18.895878] [INFO ] [LOCAL ] PBF: Starting deletion of derivative data. [2025-10-16T20:50:18.895932] [DEBUG] [LOCAL ] PBF: No derivative data file found to delete. [2025-10-16T20:50:18.896006] [INFO ] [MAIN ] Update Progress: 1635/2369 symbols completed. PBF took 34.5s. Estimated remaining: 1h 43m 22s. Rate: 7.1 symbols/min [2025-10-16T20:50:19.065333] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:50:19.065491] [DEBUG] [LOCAL ] PBT: No existing data file found in primary storage. [2025-10-16T20:50:19.065527] [WARN ] [MAIN ] PBT: No existing data found, performing full refresh instead. [2025-10-16T20:50:19.065636] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-16T20:50:19.065711] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-16T20:50:19.065758] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-16T20:50:19.065790] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-16T20:50:19.148041] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-16T20:50:19.427272] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:50:19.549841] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-16T20:50:19.942868] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-10-16T20:50:20.482201] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T20:50:20.742888] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-16T20:50:21.086344] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T20:50:21.542842] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-16T20:50:22.342914] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-16T20:50:22.872350] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-16T20:50:23.003708] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T20:50:23.142780] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-16T20:50:23.446397] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T20:50:23.942822] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-16T20:50:24.416227] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T20:50:24.742816] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-16T20:50:25.542825] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-16T20:50:25.762995] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T20:50:25.954197] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-16T20:50:26.342833] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-16T20:50:26.981173] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T20:50:27.142808] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-16T20:50:27.942829] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-16T20:50:28.437351] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-16T20:50:28.609604] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T20:50:28.742820] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-16T20:50:29.409370] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T20:50:29.542857] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-16T20:50:30.342856] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-16T20:50:31.098272] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-16T20:50:31.131488] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T20:50:31.142767] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-16T20:50:31.481908] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T20:50:31.942855] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-16T20:50:32.742804] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-16T20:50:33.491596] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-16T20:50:33.542825] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-16T20:50:33.579133] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T20:50:34.342779] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-16T20:50:34.576338] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T20:50:34.648523] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-16T20:50:35.040354] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T20:50:35.044412] [INFO ] [REMOTE ] PBH: Full fetch complete (44247 records). [2025-10-16T20:50:35.044502] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-16T20:50:35.045050] [FATAL] [VALIDATOR ] PBH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:50:35.045131] [FATAL] [MAIN ] PBH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:50:35.045173] [WARN ] [MAIN ] PBH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:50:35.045239] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-16T20:50:35.045300] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-16T20:50:35.045334] [INFO ] [LOCAL ] PBH: Starting deletion of derivative data. [2025-10-16T20:50:35.045372] [DEBUG] [LOCAL ] PBH: No derivative data file found to delete. [2025-10-16T20:50:35.045424] [INFO ] [MAIN ] Update Progress: 1636/2369 symbols completed. PBH took 26.4s. Estimated remaining: 1h 43m 17s. Rate: 7.1 symbols/min [2025-10-16T20:50:35.143389] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-16T20:50:35.213290] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:50:35.223558] [DEBUG] [LOCAL ] PCF: Loaded 9040 existing records from primary storage. [2025-10-16T20:50:35.223797] [INFO ] [MAIN ] PCF: Loaded 9040 existing records. [2025-10-16T20:50:35.401506] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:50:35.401740] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-16T20:50:35.401792] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-16T20:50:35.401996] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-10-16T20:50:35.402053] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-16T20:50:35.761266] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:50:35.942825] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-10-16T20:50:36.742781] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-16T20:50:37.082399] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T20:50:37.437500] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-16T20:50:37.542781] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-16T20:50:37.820414] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T20:50:38.342786] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-16T20:50:38.401697] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T20:50:39.142797] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-16T20:50:39.529969] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T20:50:39.942840] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-16T20:50:40.080798] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T20:50:40.742824] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-16T20:50:41.542812] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-16T20:50:42.197593] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-16T20:50:42.198541] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-16T20:50:42.342780] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-16T20:50:42.584611] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-16T20:50:43.142818] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-16T20:50:43.264179] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-16T20:50:43.942822] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-16T20:50:44.739278] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T20:50:44.752670] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-16T20:50:44.855809] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T20:50:45.542800] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-16T20:50:45.860926] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T20:50:46.342835] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-16T20:50:46.470464] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T20:50:47.142843] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-16T20:50:47.942872] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-16T20:50:48.568831] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-16T20:50:48.742793] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-16T20:50:48.806393] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T20:50:49.060949] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T20:50:49.542807] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-16T20:50:50.342875] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-16T20:50:50.929360] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-16T20:50:51.142787] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-16T20:50:51.201662] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-16T20:50:51.395384] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T20:50:51.942845] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-16T20:50:52.035987] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T20:50:52.045517] [INFO ] [REMOTE ] PBR: Full fetch complete (77491 records). [2025-10-16T20:50:52.045676] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-16T20:50:52.046665] [FATAL] [VALIDATOR ] PBR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:50:52.046772] [FATAL] [MAIN ] PBR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:50:52.046845] [WARN ] [MAIN ] PBR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:50:52.046893] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-16T20:50:52.046961] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-16T20:50:52.047016] [INFO ] [LOCAL ] PBR: Starting deletion of derivative data. [2025-10-16T20:50:52.047094] [DEBUG] [LOCAL ] PBR: No derivative data file found to delete. [2025-10-16T20:50:52.047163] [INFO ] [MAIN ] Update Progress: 1637/2369 symbols completed. PBR took 37.9s. Estimated remaining: 1h 43m 12s. Rate: 7.1 symbols/min [2025-10-16T20:50:52.742811] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-16T20:50:53.542796] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-16T20:50:53.745926] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-16T20:50:53.915310] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T20:50:54.342856] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-16T20:50:54.414337] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T20:50:55.142781] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-16T20:50:55.308351] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T20:50:55.917989] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T20:50:55.924285] [INFO ] [REMOTE ] PBI: Full fetch complete (72012 records). [2025-10-16T20:50:55.924491] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-16T20:50:55.925341] [FATAL] [VALIDATOR ] PBI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:50:55.925467] [FATAL] [MAIN ] PBI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:50:55.925545] [WARN ] [MAIN ] PBI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:50:55.925637] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-16T20:50:55.925770] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-16T20:50:55.925811] [INFO ] [LOCAL ] PBI: Starting deletion of derivative data. [2025-10-16T20:50:55.925853] [DEBUG] [LOCAL ] PBI: No derivative data file found to delete. [2025-10-16T20:50:55.925913] [INFO ] [MAIN ] Update Progress: 1638/2369 symbols completed. PBI took 45.6s. Estimated remaining: 1h 43m 2s. Rate: 7.1 symbols/min [2025-10-16T20:50:55.942803] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-16T20:50:56.707340] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T20:50:56.709099] [INFO ] [REMOTE ] PCF: Full fetch complete (13687 records). [2025-10-16T20:50:56.709172] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-16T20:50:56.754122] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-16T20:50:57.090921] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-16T20:50:57.091014] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-16T20:50:57.091340] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-16T20:50:57.091380] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-16T20:50:57.092097] [DEBUG] [LOCAL ] PCF: Trimmed 13687 records to 9109 (keeping 200 days of data) [2025-10-16T20:50:57.143954] [DEBUG] [LOCAL ] PCF: Primary data saved (9109 records). [2025-10-16T20:50:57.144066] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-16T20:50:57.144135] [INFO ] [MAIN ] Update Progress: 1639/2369 symbols completed. PCF took 22.1s. Estimated remaining: 1h 42m 50s. Rate: 7.1 symbols/min [2025-10-16T20:50:57.434098] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T20:50:57.436582] [INFO ] [REMOTE ] PBT: Full fetch complete (24746 records). [2025-10-16T20:50:57.436683] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-16T20:50:57.437167] [FATAL] [VALIDATOR ] PBT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:50:57.437258] [FATAL] [MAIN ] PBT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:50:57.437303] [WARN ] [MAIN ] PBT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:50:57.437342] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-16T20:50:57.437398] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-16T20:50:57.437435] [INFO ] [LOCAL ] PBT: Starting deletion of derivative data. [2025-10-16T20:50:57.437474] [DEBUG] [LOCAL ] PBT: No derivative data file found to delete. [2025-10-16T20:50:57.437527] [INFO ] [MAIN ] Update Progress: 1640/2369 symbols completed. PBT took 38.5s. Estimated remaining: 1h 42m 38s. Rate: 7.1 symbols/min [2025-10-16T20:50:58.069046] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:50:58.107314] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:50:58.109342] [DEBUG] [LOCAL ] PCN: No existing data file found in primary storage. [2025-10-16T20:50:58.180818] [DEBUG] [LOCAL ] PCOR: No existing data file found in primary storage. [2025-10-16T20:50:58.179808] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:50:58.180700] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:50:58.176406] [WARN ] [MAIN ] PCN: No existing data found, performing full refresh instead. [2025-10-16T20:50:58.181158] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-10-16T20:50:58.181957] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-10-16T20:50:58.181498] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-16T20:50:58.181332] [WARN ] [MAIN ] PCOR: No existing data found, performing full refresh instead. [2025-10-16T20:50:58.182088] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-16T20:50:58.182239] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-16T20:50:58.182483] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-10-16T20:50:58.182607] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-16T20:50:58.182532] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-16T20:50:58.182808] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-16T20:50:58.182916] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-16T20:50:58.183037] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-16T20:50:58.183144] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-16T20:50:58.205001] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-16T20:50:58.220348] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-16T20:50:58.367015] [DEBUG] [LOCAL ] PCM: Loaded 6810 existing records from primary storage. [2025-10-16T20:50:58.454476] [INFO ] [MAIN ] PCM: Loaded 6810 existing records. [2025-10-16T20:50:59.221734] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:50:59.293725] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-16T20:50:59.365595] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-16T20:50:59.379994] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-10-16T20:50:59.434394] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:50:59.452406] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-10-16T20:50:59.451214] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-16T20:50:59.483685] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:50:59.540059] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-10-16T20:50:59.595295] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:50:59.607312] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-10-16T20:50:59.905460] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:50:59.942909] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-10-16T20:51:00.859802] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T20:51:00.862065] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-16T20:51:00.882239] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T20:51:01.542867] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-16T20:51:01.584174] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-16T20:51:01.702209] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-16T20:51:01.843604] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T20:51:02.342821] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-16T20:51:02.818911] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T20:51:03.142878] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-16T20:51:03.942814] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-16T20:51:04.403726] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-16T20:51:04.487684] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T20:51:04.742819] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-16T20:51:05.092704] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T20:51:05.542817] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-16T20:51:06.259731] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T20:51:06.342825] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-16T20:51:07.142835] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-16T20:51:07.585050] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-16T20:51:07.942856] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-16T20:51:08.192004] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T20:51:08.234616] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T20:51:08.495989] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T20:51:08.743034] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-16T20:51:09.542868] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-16T20:51:10.342866] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-16T20:51:10.649446] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-16T20:51:11.142903] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-16T20:51:11.500058] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-16T20:51:11.584024] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-16T20:51:11.707694] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T20:51:11.942782] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-16T20:51:12.742920] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-16T20:51:13.158720] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T20:51:13.542845] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-16T20:51:14.342849] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-16T20:51:14.453286] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T20:51:14.562072] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T20:51:15.142844] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-16T20:51:15.860038] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T20:51:15.942808] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-16T20:51:16.316203] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-16T20:51:16.742872] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-16T20:51:17.436959] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T20:51:17.532159] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T20:51:17.542775] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-16T20:51:18.342871] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-16T20:51:19.142852] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-16T20:51:19.225486] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T20:51:19.290283] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T20:51:19.942819] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-16T20:51:20.004845] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-16T20:51:20.742910] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-16T20:51:21.483429] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-16T20:51:21.542784] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-16T20:51:21.689432] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T20:51:22.342866] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-16T20:51:23.067226] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-16T20:51:23.142809] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-16T20:51:23.399426] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-16T20:51:23.942818] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-16T20:51:24.012087] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T20:51:24.742901] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-16T20:51:25.198162] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T20:51:25.542810] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-16T20:51:26.342846] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-16T20:51:26.801458] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-16T20:51:27.142843] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-16T20:51:27.223418] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T20:51:27.224807] [INFO ] [REMOTE ] PCM: Full fetch complete (10424 records). [2025-10-16T20:51:27.224894] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-16T20:51:27.514383] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T20:51:27.621509] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-16T20:51:27.621577] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-16T20:51:27.621837] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-16T20:51:27.621897] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-16T20:51:27.622308] [DEBUG] [LOCAL ] PCM: Trimmed 10424 records to 6846 (keeping 200 days of data) [2025-10-16T20:51:27.660228] [DEBUG] [LOCAL ] PCM: Primary data saved (6846 records). [2025-10-16T20:51:27.660307] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-16T20:51:27.660377] [INFO ] [MAIN ] Update Progress: 1641/2369 symbols completed. PCM took 30.2s. Estimated remaining: 1h 42m 39s. Rate: 7.1 symbols/min [2025-10-16T20:51:27.828168] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:51:27.843246] [DEBUG] [LOCAL ] PCQ: Loaded 12168 existing records from primary storage. [2025-10-16T20:51:27.843453] [INFO ] [MAIN ] PCQ: Loaded 12168 existing records. [2025-10-16T20:51:27.948008] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-16T20:51:28.018816] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:51:28.019121] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-16T20:51:28.019192] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-16T20:51:28.019724] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-10-16T20:51:28.019794] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-16T20:51:28.387433] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:51:28.742848] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-16T20:51:28.783435] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T20:51:28.788939] [INFO ] [REMOTE ] PCOR: Full fetch complete (69099 records). [2025-10-16T20:51:28.789039] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-16T20:51:28.789820] [FATAL] [VALIDATOR ] PCOR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:51:28.789910] [FATAL] [MAIN ] PCOR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:51:28.789952] [WARN ] [MAIN ] PCOR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:51:28.789990] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-16T20:51:28.790048] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-16T20:51:28.790082] [INFO ] [LOCAL ] PCOR: Starting deletion of derivative data. [2025-10-16T20:51:28.790121] [DEBUG] [LOCAL ] PCOR: No derivative data file found to delete. [2025-10-16T20:51:28.790173] [INFO ] [MAIN ] Update Progress: 1642/2369 symbols completed. PCOR took 31.4s. Estimated remaining: 1h 42m 28s. Rate: 7.1 symbols/min [2025-10-16T20:51:28.955273] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:51:28.955515] [DEBUG] [LOCAL ] PD: No existing data file found in primary storage. [2025-10-16T20:51:28.955559] [WARN ] [MAIN ] PD: No existing data found, performing full refresh instead. [2025-10-16T20:51:28.955700] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-16T20:51:28.955751] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-16T20:51:28.955793] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-16T20:51:28.955882] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-16T20:51:29.310113] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:51:29.445477] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-16T20:51:29.542826] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-10-16T20:51:30.119153] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T20:51:30.342834] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-16T20:51:31.042791] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T20:51:31.046954] [INFO ] [REMOTE ] PCN: Full fetch complete (34236 records). [2025-10-16T20:51:31.047186] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-16T20:51:31.047878] [FATAL] [VALIDATOR ] PCN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:51:31.048139] [FATAL] [MAIN ] PCN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:51:31.048260] [WARN ] [MAIN ] PCN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:51:31.048355] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-16T20:51:31.048455] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-10-16T20:51:31.048509] [INFO ] [LOCAL ] PCN: Starting deletion of derivative data. [2025-10-16T20:51:31.048565] [DEBUG] [LOCAL ] PCN: No derivative data file found to delete. [2025-10-16T20:51:31.048671] [INFO ] [MAIN ] Update Progress: 1643/2369 symbols completed. PCN took 33.6s. Estimated remaining: 1h 42m 16s. Rate: 7.1 symbols/min [2025-10-16T20:51:31.143857] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-16T20:51:31.245591] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:51:31.245805] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-16T20:51:31.245854] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-16T20:51:31.246089] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-16T20:51:31.246144] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-16T20:51:31.246193] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-16T20:51:31.246233] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-16T20:51:31.370975] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T20:51:31.631912] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:51:31.942841] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-16T20:51:32.742797] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-10-16T20:51:33.117574] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-16T20:51:33.220424] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-16T20:51:33.257043] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T20:51:33.542929] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-10-16T20:51:34.342858] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-16T20:51:34.571363] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T20:51:34.716235] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-16T20:51:35.142889] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-16T20:51:35.942800] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-16T20:51:36.742828] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-16T20:51:37.542867] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-16T20:51:37.580172] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T20:51:37.752837] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T20:51:38.043544] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-16T20:51:38.142398] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (3.00 seconds). [2025-10-16T20:51:38.342869] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-16T20:51:39.142790] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-16T20:51:39.942821] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-16T20:51:39.971112] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T20:51:39.977747] [INFO ] [REMOTE ] PCG: Full fetch complete (77508 records). [2025-10-16T20:51:39.977898] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-16T20:51:39.978777] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:51:39.978871] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:51:39.978916] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:51:39.978957] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-16T20:51:39.979016] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-16T20:51:39.979053] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-10-16T20:51:39.979095] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-10-16T20:51:39.979155] [INFO ] [MAIN ] Update Progress: 1644/2369 symbols completed. PCG took 42.5s. Estimated remaining: 1h 42m 8s. Rate: 7.1 symbols/min [2025-10-16T20:51:40.150427] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:51:40.150675] [DEBUG] [LOCAL ] PDI: No existing data file found in primary storage. [2025-10-16T20:51:40.150809] [WARN ] [MAIN ] PDI: No existing data found, performing full refresh instead. [2025-10-16T20:51:40.150988] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-16T20:51:40.151075] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-16T20:51:40.151149] [DEBUG] [LOCAL ] PDI: No primary data file found to delete. [2025-10-16T20:51:40.151190] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-16T20:51:40.288135] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T20:51:40.535010] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:51:40.742838] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-10-16T20:51:40.802074] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-16T20:51:41.542900] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-16T20:51:42.342825] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-16T20:51:42.494497] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T20:51:42.852827] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-16T20:51:42.865611] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-16T20:51:43.142843] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-16T20:51:43.738004] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-16T20:51:43.942824] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-16T20:51:44.742838] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-16T20:51:45.542784] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-16T20:51:45.811388] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T20:51:45.921815] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-16T20:51:46.342827] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-16T20:51:47.142855] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-16T20:51:47.321304] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T20:51:47.332218] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T20:51:47.538327] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-16T20:51:47.942864] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-16T20:51:48.386154] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T20:51:48.742824] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-16T20:51:49.542863] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-16T20:51:49.945754] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-16T20:51:50.342775] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-16T20:51:50.554165] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T20:51:50.670339] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-16T20:51:51.142825] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-16T20:51:51.942872] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-16T20:51:52.008506] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T20:51:52.742955] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-16T20:51:53.542826] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-16T20:51:53.680869] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T20:51:53.972518] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-16T20:51:54.342793] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-16T20:51:54.709618] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-16T20:51:54.739448] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-16T20:51:54.740089] [INFO ] [REMOTE ] PDCC: Full fetch complete (1349 records). [2025-10-16T20:51:54.740155] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-16T20:51:54.913665] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-16T20:51:54.913837] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:51:54.913884] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:51:54.913969] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-16T20:51:54.914029] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-16T20:51:54.914064] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-16T20:51:54.914102] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-16T20:51:54.914153] [INFO ] [MAIN ] Update Progress: 1645/2369 symbols completed. PDCC took 23.9s. Estimated remaining: 1h 42m 3s. Rate: 7.1 symbols/min [2025-10-16T20:51:55.077619] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:51:55.077804] [DEBUG] [LOCAL ] PDM: No existing data file found in primary storage. [2025-10-16T20:51:55.077862] [WARN ] [MAIN ] PDM: No existing data found, performing full refresh instead. [2025-10-16T20:51:55.077933] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-16T20:51:55.077968] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-16T20:51:55.078007] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-16T20:51:55.078038] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-16T20:51:55.148038] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-16T20:51:55.424688] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:51:55.942778] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-16T20:51:56.099445] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T20:51:56.742866] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-16T20:51:57.542780] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-10-16T20:51:57.729371] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T20:51:57.762966] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-16T20:51:58.342858] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-16T20:51:58.961184] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T20:51:59.142825] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-16T20:51:59.909223] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T20:51:59.942793] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-16T20:52:00.406175] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T20:52:00.742836] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-16T20:52:01.530892] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T20:52:01.546587] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-16T20:52:02.342815] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-16T20:52:02.629743] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T20:52:02.792341] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-16T20:52:03.142800] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-16T20:52:03.820802] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T20:52:03.941442] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T20:52:03.943499] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-16T20:52:03.943730] [INFO ] [REMOTE ] PCQ: Full fetch complete (16993 records). [2025-10-16T20:52:03.944493] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-16T20:52:04.310083] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-16T20:52:04.310155] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-16T20:52:04.310518] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-16T20:52:04.310555] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-16T20:52:04.311073] [DEBUG] [LOCAL ] PCQ: Trimmed 16993 records to 12281 (keeping 200 days of data) [2025-10-16T20:52:04.383403] [DEBUG] [LOCAL ] PCQ: Primary data saved (12281 records). [2025-10-16T20:52:04.383529] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-16T20:52:04.383605] [INFO ] [MAIN ] Update Progress: 1646/2369 symbols completed. PCQ took 36.7s. Estimated remaining: 1h 41m 55s. Rate: 7.1 symbols/min [2025-10-16T20:52:04.556218] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:52:04.556389] [DEBUG] [LOCAL ] PDO: No existing data file found in primary storage. [2025-10-16T20:52:04.556461] [WARN ] [MAIN ] PDO: No existing data found, performing full refresh instead. [2025-10-16T20:52:04.556632] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-16T20:52:04.556720] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-16T20:52:04.556771] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-16T20:52:04.556804] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-16T20:52:04.747996] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-16T20:52:04.915423] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:52:05.542823] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-10-16T20:52:06.029875] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-16T20:52:06.342873] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-16T20:52:06.435200] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T20:52:07.115631] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T20:52:07.142775] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-16T20:52:07.942817] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-16T20:52:08.250775] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-16T20:52:08.632468] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T20:52:08.742893] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-16T20:52:09.542854] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-16T20:52:09.609270] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T20:52:10.328006] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T20:52:10.342778] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-16T20:52:11.142819] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-16T20:52:11.304144] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T20:52:11.311263] [INFO ] [REMOTE ] PD: Full fetch complete (67895 records). [2025-10-16T20:52:11.311416] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-16T20:52:11.312291] [FATAL] [VALIDATOR ] PD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:52:11.312465] [FATAL] [MAIN ] PD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:52:11.312534] [WARN ] [MAIN ] PD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:52:11.312607] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-16T20:52:11.312704] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-16T20:52:11.312757] [INFO ] [LOCAL ] PD: Starting deletion of derivative data. [2025-10-16T20:52:11.312800] [DEBUG] [LOCAL ] PD: No derivative data file found to delete. [2025-10-16T20:52:11.312857] [INFO ] [MAIN ] Update Progress: 1647/2369 symbols completed. PD took 42.5s. Estimated remaining: 1h 41m 45s. Rate: 7.1 symbols/min [2025-10-16T20:52:11.496947] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:52:11.528043] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-16T20:52:11.551672] [DEBUG] [LOCAL ] PDS: Loaded 17227 existing records from primary storage. [2025-10-16T20:52:11.551927] [INFO ] [MAIN ] PDS: Loaded 17227 existing records. [2025-10-16T20:52:11.725881] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:52:11.726133] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-16T20:52:11.726218] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-16T20:52:11.726425] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-10-16T20:52:11.726481] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-16T20:52:11.954858] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-16T20:52:12.077178] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:52:12.534036] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-16T20:52:12.742870] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-10-16T20:52:13.441146] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T20:52:13.542860] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-16T20:52:13.719598] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T20:52:14.342862] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-16T20:52:15.025319] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T20:52:15.142794] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-16T20:52:15.310536] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T20:52:15.942850] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-16T20:52:16.721580] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T20:52:16.742766] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-16T20:52:17.023190] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T20:52:17.542822] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-16T20:52:18.212162] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T20:52:18.342800] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-16T20:52:18.813475] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-16T20:52:19.142822] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-16T20:52:19.887025] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T20:52:19.942769] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-16T20:52:20.648976] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T20:52:20.742811] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-16T20:52:21.474121] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T20:52:21.542786] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-16T20:52:21.837928] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T20:52:22.342829] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-16T20:52:23.055710] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T20:52:23.142816] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-16T20:52:23.942805] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-16T20:52:24.281884] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-16T20:52:24.694938] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T20:52:24.742774] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-16T20:52:25.542822] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-16T20:52:25.548978] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T20:52:25.554133] [INFO ] [REMOTE ] PDO: Full fetch complete (46766 records). [2025-10-16T20:52:25.566820] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-16T20:52:25.575944] [FATAL] [VALIDATOR ] PDO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:52:25.577441] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T20:52:25.577539] [FATAL] [MAIN ] PDO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:52:25.589098] [WARN ] [MAIN ] PDO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:52:25.589532] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-16T20:52:25.589664] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-16T20:52:25.590061] [INFO ] [LOCAL ] PDO: Starting deletion of derivative data. [2025-10-16T20:52:25.590126] [DEBUG] [LOCAL ] PDO: No derivative data file found to delete. [2025-10-16T20:52:25.590189] [INFO ] [MAIN ] Update Progress: 1648/2369 symbols completed. PDO took 21.2s. Estimated remaining: 1h 41m 40s. Rate: 7.1 symbols/min [2025-10-16T20:52:25.761932] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:52:25.782453] [DEBUG] [LOCAL ] PDT: Loaded 17557 existing records from primary storage. [2025-10-16T20:52:25.782737] [INFO ] [MAIN ] PDT: Loaded 17557 existing records. [2025-10-16T20:52:25.964411] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:52:25.964634] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-16T20:52:25.964714] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-16T20:52:25.964906] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-10-16T20:52:25.964963] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-16T20:52:26.351224] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:52:26.347229] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-16T20:52:26.471474] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T20:52:27.142810] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-16T20:52:27.903909] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T20:52:27.942813] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-16T20:52:28.742844] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-10-16T20:52:29.223997] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-16T20:52:29.542828] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-16T20:52:29.592505] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T20:52:29.915225] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T20:52:30.342818] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-16T20:52:30.623703] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T20:52:31.142818] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-16T20:52:31.359472] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T20:52:31.812187] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T20:52:31.819525] [INFO ] [REMOTE ] PDI: Full fetch complete (72739 records). [2025-10-16T20:52:31.819749] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-16T20:52:31.820728] [FATAL] [VALIDATOR ] PDI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:52:31.820838] [FATAL] [MAIN ] PDI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:52:31.820947] [WARN ] [MAIN ] PDI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:52:31.821036] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-16T20:52:31.821114] [DEBUG] [LOCAL ] PDI: No primary data file found to delete. [2025-10-16T20:52:31.821164] [INFO ] [LOCAL ] PDI: Starting deletion of derivative data. [2025-10-16T20:52:31.821265] [DEBUG] [LOCAL ] PDI: No derivative data file found to delete. [2025-10-16T20:52:31.821344] [INFO ] [MAIN ] Update Progress: 1649/2369 symbols completed. PDI took 51.8s. Estimated remaining: 1h 41m 30s. Rate: 7.1 symbols/min [2025-10-16T20:52:31.947926] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-16T20:52:32.000319] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:52:32.000541] [DEBUG] [LOCAL ] PDX: No existing data file found in primary storage. [2025-10-16T20:52:32.000585] [WARN ] [MAIN ] PDX: No existing data found, performing full refresh instead. [2025-10-16T20:52:32.000726] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-16T20:52:32.000774] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-16T20:52:32.000815] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-16T20:52:32.000846] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-16T20:52:32.357075] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:52:32.742844] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-16T20:52:33.542785] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-16T20:52:33.674786] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T20:52:33.692765] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T20:52:34.342768] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-16T20:52:34.423917] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T20:52:34.974196] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-16T20:52:35.142815] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-16T20:52:35.942885] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-10-16T20:52:36.165378] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T20:52:36.167838] [INFO ] [REMOTE ] PDS: Full fetch complete (25685 records). [2025-10-16T20:52:36.167933] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-16T20:52:36.543969] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-10-16T20:52:36.544058] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-10-16T20:52:36.544608] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-10-16T20:52:36.544760] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-10-16T20:52:36.545576] [DEBUG] [LOCAL ] PDS: Trimmed 25685 records to 17319 (keeping 200 days of data) [2025-10-16T20:52:36.643698] [DEBUG] [LOCAL ] PDS: Primary data saved (17319 records). [2025-10-16T20:52:36.643837] [INFO ] [MAIN ] PDS: Full history saved. [2025-10-16T20:52:36.643916] [INFO ] [MAIN ] Update Progress: 1650/2369 symbols completed. PDS took 25.3s. Estimated remaining: 1h 41m 20s. Rate: 7.1 symbols/min [2025-10-16T20:52:36.744209] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-16T20:52:36.818704] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:52:36.818967] [DEBUG] [LOCAL ] PEB: No existing data file found in primary storage. [2025-10-16T20:52:36.819016] [WARN ] [MAIN ] PEB: No existing data found, performing full refresh instead. [2025-10-16T20:52:36.819146] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-16T20:52:36.819188] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-16T20:52:36.819231] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-16T20:52:36.819264] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-16T20:52:37.144885] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T20:52:37.200725] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:52:37.542853] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-10-16T20:52:37.903358] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-16T20:52:38.342828] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-16T20:52:39.104754] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T20:52:39.109806] [INFO ] [REMOTE ] PDM: Full fetch complete (57031 records). [2025-10-16T20:52:39.109947] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-16T20:52:39.110715] [FATAL] [VALIDATOR ] PDM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:52:39.110805] [FATAL] [MAIN ] PDM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:52:39.110848] [WARN ] [MAIN ] PDM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:52:39.110887] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-16T20:52:39.110942] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-16T20:52:39.110978] [INFO ] [LOCAL ] PDM: Starting deletion of derivative data. [2025-10-16T20:52:39.111017] [DEBUG] [LOCAL ] PDM: No derivative data file found to delete. [2025-10-16T20:52:39.111070] [INFO ] [MAIN ] Update Progress: 1651/2369 symbols completed. PDM took 44.2s. Estimated remaining: 1h 41m 9s. Rate: 7.1 symbols/min [2025-10-16T20:52:39.142843] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-16T20:52:39.290617] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:52:39.290898] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-10-16T20:52:39.290951] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-10-16T20:52:39.291187] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-16T20:52:39.291290] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-16T20:52:39.291444] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-16T20:52:39.291506] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-16T20:52:39.437365] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-16T20:52:39.729480] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:52:39.942807] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-16T20:52:40.328186] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T20:52:40.742809] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-16T20:52:41.542806] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-10-16T20:52:41.675446] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T20:52:42.213196] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T20:52:42.342790] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-16T20:52:43.142813] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-16T20:52:43.194141] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T20:52:43.220182] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T20:52:43.942817] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-16T20:52:44.742805] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-16T20:52:44.967558] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-16T20:52:45.418253] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T20:52:45.542778] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-16T20:52:45.979085] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-16T20:52:46.342820] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-16T20:52:47.084590] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T20:52:47.142792] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-16T20:52:47.401310] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T20:52:47.942817] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-16T20:52:48.742781] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-16T20:52:48.965208] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T20:52:49.168477] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-16T20:52:49.542863] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-16T20:52:50.342844] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-16T20:52:50.596571] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T20:52:50.628209] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T20:52:51.142812] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-16T20:52:51.650605] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-16T20:52:51.942806] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-16T20:52:52.742789] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-16T20:52:52.940340] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T20:52:53.551761] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-16T20:52:53.564550] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T20:52:53.847081] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-16T20:52:54.342872] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-16T20:52:55.142920] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-16T20:52:55.451491] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T20:52:55.532684] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-16T20:52:55.942834] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-16T20:52:56.742818] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-16T20:52:56.958462] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T20:52:57.542851] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-16T20:52:57.648445] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T20:52:57.750146] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-16T20:52:57.753046] [INFO ] [REMOTE ] PDT: Full fetch complete (25351 records). [2025-10-16T20:52:57.753118] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-16T20:52:58.116112] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-16T20:52:58.116213] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-16T20:52:58.116816] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-16T20:52:58.116888] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-16T20:52:58.117605] [DEBUG] [LOCAL ] PDT: Trimmed 25351 records to 17679 (keeping 200 days of data) [2025-10-16T20:52:58.224632] [DEBUG] [LOCAL ] PDT: Primary data saved (17679 records). [2025-10-16T20:52:58.224797] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-16T20:52:58.224877] [INFO ] [MAIN ] Update Progress: 1652/2369 symbols completed. PDT took 32.6s. Estimated remaining: 1h 41m 5s. Rate: 7.1 symbols/min [2025-10-16T20:52:58.348001] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-16T20:52:58.395079] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:52:58.395287] [DEBUG] [LOCAL ] PEN: No existing data file found in primary storage. [2025-10-16T20:52:58.395345] [WARN ] [MAIN ] PEN: No existing data found, performing full refresh instead. [2025-10-16T20:52:58.395454] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-16T20:52:58.395497] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-16T20:52:58.395539] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-16T20:52:58.395572] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-16T20:52:58.743154] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:52:59.142801] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-10-16T20:52:59.422803] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T20:52:59.942782] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-16T20:53:00.298933] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-16T20:53:00.357408] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-16T20:53:00.742794] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-16T20:53:01.542879] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-16T20:53:02.020775] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-16T20:53:02.268206] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T20:53:02.284312] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T20:53:02.342781] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-16T20:53:03.142827] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-16T20:53:03.391009] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T20:53:03.942847] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-16T20:53:04.650833] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T20:53:04.742823] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-16T20:53:05.542808] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-16T20:53:05.689952] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T20:53:06.269405] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-16T20:53:06.342827] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-16T20:53:07.142822] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-16T20:53:07.405894] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-16T20:53:07.942804] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-16T20:53:08.197229] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T20:53:08.290471] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T20:53:08.742872] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-16T20:53:09.430788] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T20:53:09.437586] [INFO ] [REMOTE ] PEB: Full fetch complete (72831 records). [2025-10-16T20:53:09.437805] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-16T20:53:09.438945] [FATAL] [VALIDATOR ] PEB: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:53:09.439041] [FATAL] [MAIN ] PEB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:53:09.439086] [WARN ] [MAIN ] PEB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:53:09.439128] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-16T20:53:09.439196] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-16T20:53:09.439233] [INFO ] [LOCAL ] PEB: Starting deletion of derivative data. [2025-10-16T20:53:09.439274] [DEBUG] [LOCAL ] PEB: No derivative data file found to delete. [2025-10-16T20:53:09.439343] [INFO ] [MAIN ] Update Progress: 1653/2369 symbols completed. PEB took 32.8s. Estimated remaining: 1h 40m 58s. Rate: 7.1 symbols/min [2025-10-16T20:53:09.545485] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-16T20:53:09.629430] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:53:09.642005] [DEBUG] [LOCAL ] PEO: Loaded 11154 existing records from primary storage. [2025-10-16T20:53:09.642224] [INFO ] [MAIN ] PEO: Loaded 11154 existing records. [2025-10-16T20:53:09.826697] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:53:09.827127] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-16T20:53:09.827349] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-16T20:53:09.827621] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-10-16T20:53:09.827859] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-16T20:53:10.190325] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-16T20:53:10.284677] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:53:10.342801] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-16T20:53:10.475935] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T20:53:11.142804] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-10-16T20:53:11.871831] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T20:53:11.942820] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-16T20:53:12.089074] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T20:53:12.742863] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-16T20:53:13.441162] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T20:53:13.519817] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T20:53:13.526174] [INFO ] [REMOTE ] PEG: Full fetch complete (76562 records). [2025-10-16T20:53:13.526316] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-16T20:53:13.527112] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:53:13.527202] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:53:13.527245] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:53:13.527332] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-16T20:53:13.527408] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-16T20:53:13.527445] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-10-16T20:53:13.527484] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-10-16T20:53:13.527538] [INFO ] [MAIN ] Update Progress: 1654/2369 symbols completed. PEG took 34.4s. Estimated remaining: 1h 40m 48s. Rate: 7.1 symbols/min [2025-10-16T20:53:13.542784] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-16T20:53:13.696743] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:53:13.712383] [DEBUG] [LOCAL ] PERF: Loaded 14391 existing records from primary storage. [2025-10-16T20:53:13.712614] [INFO ] [MAIN ] PERF: Loaded 14391 existing records. [2025-10-16T20:53:13.885680] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:53:13.885922] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-16T20:53:13.885975] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-16T20:53:13.886196] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-10-16T20:53:13.886271] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-16T20:53:14.236231] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:53:14.342802] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-16T20:53:14.971578] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T20:53:15.142860] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-10-16T20:53:15.273697] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T20:53:15.942782] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-16T20:53:16.309776] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T20:53:16.742890] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-16T20:53:17.381354] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T20:53:17.542861] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-16T20:53:17.742010] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T20:53:18.342882] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-16T20:53:18.442910] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T20:53:19.142844] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-16T20:53:19.251889] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T20:53:19.942815] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-16T20:53:20.485883] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T20:53:20.538085] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T20:53:20.742843] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-16T20:53:21.542833] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-16T20:53:22.062040] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T20:53:22.342898] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-16T20:53:22.628542] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T20:53:23.142826] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-16T20:53:23.186752] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T20:53:23.188783] [INFO ] [REMOTE ] PDX: Full fetch complete (23670 records). [2025-10-16T20:53:23.188877] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-16T20:53:23.189370] [FATAL] [VALIDATOR ] PDX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:53:23.189453] [FATAL] [MAIN ] PDX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:53:23.189496] [WARN ] [MAIN ] PDX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:53:23.189569] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-16T20:53:23.189667] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-16T20:53:23.189751] [INFO ] [LOCAL ] PDX: Starting deletion of derivative data. [2025-10-16T20:53:23.189831] [DEBUG] [LOCAL ] PDX: No derivative data file found to delete. [2025-10-16T20:53:23.189906] [INFO ] [MAIN ] Update Progress: 1655/2369 symbols completed. PDX took 51.4s. Estimated remaining: 1h 40m 40s. Rate: 7.1 symbols/min [2025-10-16T20:53:23.357254] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:53:23.357417] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-16T20:53:23.357453] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-16T20:53:23.357569] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-16T20:53:23.357609] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-16T20:53:23.357700] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-16T20:53:23.357764] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-16T20:53:23.727561] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:53:23.723876] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T20:53:23.731484] [INFO ] [REMOTE ] PEN: Full fetch complete (44045 records). [2025-10-16T20:53:23.731562] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-16T20:53:23.732091] [FATAL] [VALIDATOR ] PEN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:53:23.732173] [FATAL] [MAIN ] PEN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:53:23.732216] [WARN ] [MAIN ] PEN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:53:23.732281] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-16T20:53:23.732366] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-16T20:53:23.732421] [INFO ] [LOCAL ] PEN: Starting deletion of derivative data. [2025-10-16T20:53:23.732463] [DEBUG] [LOCAL ] PEN: No derivative data file found to delete. [2025-10-16T20:53:23.732514] [INFO ] [MAIN ] Update Progress: 1656/2369 symbols completed. PEN took 25.5s. Estimated remaining: 1h 40m 28s. Rate: 7.1 symbols/min [2025-10-16T20:53:23.899684] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:53:23.907271] [DEBUG] [LOCAL ] PFD: Loaded 5425 existing records from primary storage. [2025-10-16T20:53:23.907458] [INFO ] [MAIN ] PFD: Loaded 5425 existing records. [2025-10-16T20:53:23.947954] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-16T20:53:24.081694] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:53:24.081919] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-16T20:53:24.081965] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-16T20:53:24.082116] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-10-16T20:53:24.082196] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-16T20:53:24.426406] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:53:24.742788] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-10-16T20:53:24.957787] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T20:53:25.542847] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-10-16T20:53:25.711922] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-16T20:53:25.917564] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:53:25.917915] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-10-16T20:53:25.918003] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:53:25.918050] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-16T20:53:25.918109] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:53:25.918179] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-16T20:53:25.918277] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-16T20:53:25.918329] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-16T20:53:25.918371] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-16T20:53:25.918434] [INFO ] [MAIN ] Update Progress: 1657/2369 symbols completed. PEW took 2.7s. Estimated remaining: 1h 40m 17s. Rate: 7.1 symbols/min [2025-10-16T20:53:26.082551] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:53:26.082739] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-10-16T20:53:26.082785] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-10-16T20:53:26.082902] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-16T20:53:26.082942] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-16T20:53:26.082984] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-16T20:53:26.083015] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-16T20:53:26.349151] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-16T20:53:26.431564] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:53:27.142848] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-10-16T20:53:27.391390] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T20:53:27.942816] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-16T20:53:28.742851] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-16T20:53:29.049170] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T20:53:29.542796] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-10-16T20:53:29.947519] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T20:53:30.130731] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.99 seconds). [2025-10-16T20:53:30.326550] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T20:53:30.342762] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-10-16T20:53:31.142786] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-16T20:53:31.218996] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T20:53:31.883057] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T20:53:31.942796] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-16T20:53:32.742804] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-10. [2025-10-16T20:53:32.921861] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T20:53:33.517918] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T20:53:33.519861] [INFO ] [REMOTE ] PEO: Full fetch complete (16263 records). [2025-10-16T20:53:33.519939] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-10-16T20:53:33.549420] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-16T20:53:33.881637] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-10-16T20:53:33.881738] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-10-16T20:53:33.882094] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-10-16T20:53:33.882132] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-10-16T20:53:33.882802] [DEBUG] [LOCAL ] PEO: Trimmed 16263 records to 11228 (keeping 200 days of data) [2025-10-16T20:53:33.953679] [DEBUG] [LOCAL ] PEO: Primary data saved (11228 records). [2025-10-16T20:53:33.953813] [INFO ] [MAIN ] PEO: Full history saved. [2025-10-16T20:53:33.953938] [INFO ] [MAIN ] Update Progress: 1658/2369 symbols completed. PEO took 24.5s. Estimated remaining: 1h 40m 8s. Rate: 7.1 symbols/min [2025-10-16T20:53:34.117508] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:53:34.117684] [DEBUG] [LOCAL ] PFGC: No existing data file found in primary storage. [2025-10-16T20:53:34.117738] [WARN ] [MAIN ] PFGC: No existing data found, performing full refresh instead. [2025-10-16T20:53:34.117848] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-16T20:53:34.117902] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-16T20:53:34.117943] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-16T20:53:34.117975] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-16T20:53:34.350948] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-16T20:53:34.470460] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:53:34.524681] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T20:53:34.928568] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T20:53:35.142828] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-10-16T20:53:35.942804] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-16T20:53:36.695410] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-16T20:53:36.742781] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-16T20:53:36.767024] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T20:53:37.434741] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-16T20:53:37.542796] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-16T20:53:38.185153] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-16T20:53:38.342813] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-16T20:53:39.142802] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-16T20:53:39.298863] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-16T20:53:39.942876] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-16T20:53:40.598353] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-16T20:53:40.742840] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-16T20:53:40.851785] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T20:53:41.542847] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-16T20:53:41.618028] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T20:53:42.342842] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-16T20:53:43.142821] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-16T20:53:43.493157] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T20:53:43.942828] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-16T20:53:44.279663] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-10-16T20:53:44.749141] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-16T20:53:44.750407] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T20:53:44.869519] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T20:53:45.542809] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-16T20:53:46.282604] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-16T20:53:46.342824] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-16T20:53:47.047166] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-16T20:53:47.072538] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T20:53:47.073981] [INFO ] [REMOTE ] PFD: Full fetch complete (7484 records). [2025-10-16T20:53:47.074054] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-16T20:53:47.148026] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-16T20:53:47.466558] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-10-16T20:53:47.466659] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-10-16T20:53:47.466915] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-10-16T20:53:47.466957] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-10-16T20:53:47.467345] [DEBUG] [LOCAL ] PFD: Trimmed 7484 records to 5434 (keeping 200 days of data) [2025-10-16T20:53:47.500304] [DEBUG] [LOCAL ] PFD: Primary data saved (5434 records). [2025-10-16T20:53:47.500435] [INFO ] [MAIN ] PFD: Full history saved. [2025-10-16T20:53:47.500512] [INFO ] [MAIN ] Update Progress: 1659/2369 symbols completed. PFD took 23.8s. Estimated remaining: 1h 40m 2s. Rate: 7.1 symbols/min [2025-10-16T20:53:47.676339] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:53:47.685727] [DEBUG] [LOCAL ] PFH: Loaded 6595 existing records from primary storage. [2025-10-16T20:53:47.685959] [INFO ] [MAIN ] PFH: Loaded 6595 existing records. [2025-10-16T20:53:47.859675] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:53:47.859882] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-16T20:53:47.859928] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-16T20:53:47.860094] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-10-16T20:53:47.860163] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-16T20:53:47.948781] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-16T20:53:48.216264] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:53:48.458362] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-16T20:53:48.742832] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-16T20:53:49.542890] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-10-16T20:53:49.965961] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T20:53:50.342846] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-16T20:53:50.525924] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T20:53:50.802555] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-10-16T20:53:51.142786] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-16T20:53:51.297470] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T20:53:51.942816] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-16T20:53:52.742847] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-16T20:53:53.028188] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T20:53:53.030551] [INFO ] [REMOTE ] PERF: Full fetch complete (22123 records). [2025-10-16T20:53:53.030619] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-16T20:53:53.388618] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-10-16T20:53:53.388747] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-10-16T20:53:53.389217] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-10-16T20:53:53.389259] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-10-16T20:53:53.389861] [DEBUG] [LOCAL ] PERF: Trimmed 22123 records to 14465 (keeping 200 days of data) [2025-10-16T20:53:53.469521] [DEBUG] [LOCAL ] PERF: Primary data saved (14465 records). [2025-10-16T20:53:53.469738] [INFO ] [MAIN ] PERF: Full history saved. [2025-10-16T20:53:53.469901] [INFO ] [MAIN ] Update Progress: 1660/2369 symbols completed. PERF took 39.9s. Estimated remaining: 1h 39m 52s. Rate: 7.1 symbols/min [2025-10-16T20:53:53.568742] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-16T20:53:53.648018] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:53:53.649400] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T20:53:53.665382] [DEBUG] [LOCAL ] PFL: Loaded 14344 existing records from primary storage. [2025-10-16T20:53:53.665618] [INFO ] [MAIN ] PFL: Loaded 14344 existing records. [2025-10-16T20:53:53.841166] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:53:53.841500] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-16T20:53:53.841623] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-16T20:53:53.841892] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-10-16T20:53:53.841959] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-16T20:53:54.152606] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (3.01 seconds). [2025-10-16T20:53:54.242051] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:53:54.342815] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-10-16T20:53:55.142788] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-16T20:53:55.255811] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T20:53:55.365419] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T20:53:55.942826] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-16T20:53:56.742834] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-16T20:53:56.999936] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-16T20:53:57.542886] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-16T20:53:58.047330] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.90 seconds). [2025-10-16T20:53:58.342800] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-16T20:53:58.513694] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-16T20:53:58.515514] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T20:53:59.142832] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-16T20:53:59.407048] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T20:53:59.942815] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-16T20:54:00.741251] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-16T20:54:00.744617] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-16T20:54:00.852494] [DEBUG] [REMOTE ] PFH: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-16T20:54:00.852924] [WARN ] [REMOTE ] PFH: No data returned for month 2025-04 [2025-10-16T20:54:00.853029] [FATAL] [REMOTE ] PFH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:54:00.853124] [FATAL] [MAIN ] PFH: Failed to fetch primary data. [2025-10-16T20:54:00.853198] [WARN ] [MAIN ] PFH: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:54:00.853284] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-16T20:54:00.853368] [DEBUG] [LOCAL ] PFH: No primary data file found to delete. [2025-10-16T20:54:00.853434] [INFO ] [LOCAL ] PFH: Starting deletion of derivative data. [2025-10-16T20:54:00.853673] [DEBUG] [LOCAL ] PFH: Deleted derivative data file. [2025-10-16T20:54:00.853775] [INFO ] [MAIN ] Update Progress: 1661/2369 symbols completed. PFH took 13.4s. Estimated remaining: 1h 39m 43s. Rate: 7.1 symbols/min [2025-10-16T20:54:01.037787] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:54:01.037953] [DEBUG] [LOCAL ] PFLT: No existing data file found in primary storage. [2025-10-16T20:54:01.037990] [WARN ] [MAIN ] PFLT: No existing data found, performing full refresh instead. [2025-10-16T20:54:01.038098] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-16T20:54:01.038141] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-16T20:54:01.038181] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-16T20:54:01.038235] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-16T20:54:01.381226] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:54:01.542804] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-10-16T20:54:01.983993] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-10-16T20:54:02.342827] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-16T20:54:03.142866] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-16T20:54:03.227805] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T20:54:03.880849] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T20:54:03.942808] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-16T20:54:04.742807] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-16T20:54:05.252634] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-10-16T20:54:05.297134] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T20:54:05.542843] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-16T20:54:05.576522] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T20:54:06.342899] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-16T20:54:07.142832] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-16T20:54:07.255480] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T20:54:07.333217] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T20:54:07.942858] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-16T20:54:08.742843] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-16T20:54:08.834618] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-16T20:54:09.542832] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-16T20:54:09.964320] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-10-16T20:54:10.342808] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-16T20:54:10.376832] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-16T20:54:10.507670] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T20:54:11.142837] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-16T20:54:11.942844] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-16T20:54:11.994395] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T20:54:12.312007] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T20:54:12.742874] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-16T20:54:13.542865] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-16T20:54:14.342853] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-16T20:54:14.685400] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-16T20:54:14.804572] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-10-16T20:54:15.035079] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-16T20:54:15.142757] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-16T20:54:15.171795] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T20:54:15.942875] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-16T20:54:16.742803] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-16T20:54:17.037854] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T20:54:17.542784] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-16T20:54:17.661083] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T20:54:17.667883] [INFO ] [REMOTE ] PFE: Full fetch complete (77603 records). [2025-10-16T20:54:17.668068] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-16T20:54:17.668961] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:54:17.669062] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:54:17.669107] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:54:17.669160] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-16T20:54:17.669253] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-16T20:54:17.669303] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-10-16T20:54:17.669357] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-10-16T20:54:17.669434] [INFO ] [MAIN ] Update Progress: 1662/2369 symbols completed. PFE took 51.8s. Estimated remaining: 1h 39m 38s. Rate: 7.1 symbols/min [2025-10-16T20:54:17.849545] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:54:17.876930] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T20:54:17.905781] [DEBUG] [LOCAL ] PFN: Loaded 22372 existing records from primary storage. [2025-10-16T20:54:17.906058] [INFO ] [MAIN ] PFN: Loaded 22372 existing records. [2025-10-16T20:54:18.087704] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:54:18.087910] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-16T20:54:18.087955] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-16T20:54:18.088296] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-10-16T20:54:18.088354] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-16T20:54:18.348040] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-16T20:54:18.446168] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:54:19.146686] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-16T20:54:19.157152] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T20:54:19.174868] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T20:54:19.178302] [INFO ] [REMOTE ] PFL: Full fetch complete (20628 records). [2025-10-16T20:54:19.178377] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-16T20:54:19.550491] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-16T20:54:19.550594] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-16T20:54:19.551122] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-16T20:54:19.551185] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-16T20:54:19.551775] [DEBUG] [LOCAL ] PFL: Trimmed 20628 records to 14464 (keeping 200 days of data) [2025-10-16T20:54:19.636445] [DEBUG] [LOCAL ] PFL: Primary data saved (14464 records). [2025-10-16T20:54:19.636584] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-16T20:54:19.636685] [INFO ] [MAIN ] Update Progress: 1663/2369 symbols completed. PFL took 26.2s. Estimated remaining: 1h 39m 27s. Rate: 7.1 symbols/min [2025-10-16T20:54:19.822813] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:54:19.830462] [DEBUG] [LOCAL ] PFO: Loaded 6104 existing records from primary storage. [2025-10-16T20:54:19.830675] [INFO ] [MAIN ] PFO: Loaded 6104 existing records. [2025-10-16T20:54:19.947988] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-10-16T20:54:20.005481] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:54:20.005777] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-16T20:54:20.005828] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-16T20:54:20.005974] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-10-16T20:54:20.006011] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-16T20:54:20.355247] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:54:20.742788] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-16T20:54:20.927942] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T20:54:21.165796] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-16T20:54:21.542831] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-10-16T20:54:22.342783] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-16T20:54:22.499008] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-16T20:54:22.523684] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T20:54:23.142870] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-16T20:54:23.942801] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-16T20:54:24.014969] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T20:54:24.661910] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-16T20:54:24.742792] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-16T20:54:24.961107] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T20:54:25.444971] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-16T20:54:25.542844] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-16T20:54:26.014455] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-16T20:54:26.342828] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-16T20:54:27.051187] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-16T20:54:27.057594] [INFO ] [REMOTE ] PFGC: Full fetch complete (67469 records). [2025-10-16T20:54:27.057749] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-16T20:54:27.058488] [FATAL] [VALIDATOR ] PFGC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:54:27.058790] [FATAL] [MAIN ] PFGC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:54:27.058833] [WARN ] [MAIN ] PFGC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:54:27.058897] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-16T20:54:27.058961] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-16T20:54:27.058996] [INFO ] [LOCAL ] PFGC: Starting deletion of derivative data. [2025-10-16T20:54:27.059033] [DEBUG] [LOCAL ] PFGC: No derivative data file found to delete. [2025-10-16T20:54:27.059090] [INFO ] [MAIN ] Update Progress: 1664/2369 symbols completed. PFGC took 53.1s. Estimated remaining: 1h 39m 18s. Rate: 7.1 symbols/min [2025-10-16T20:54:27.148011] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-16T20:54:27.232622] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:54:27.232794] [DEBUG] [LOCAL ] PFS: No existing data file found in primary storage. [2025-10-16T20:54:27.232834] [WARN ] [MAIN ] PFS: No existing data found, performing full refresh instead. [2025-10-16T20:54:27.232942] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-16T20:54:27.232982] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-16T20:54:27.233021] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-16T20:54:27.233053] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-16T20:54:27.587590] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:54:27.942807] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-16T20:54:27.970452] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-16T20:54:28.742835] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-16T20:54:29.051907] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T20:54:29.440843] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T20:54:29.542931] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-10-16T20:54:30.342885] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-16T20:54:31.018411] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T20:54:31.142788] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-16T20:54:31.456443] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T20:54:31.942828] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-16T20:54:32.742819] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-16T20:54:32.896550] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T20:54:33.413431] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T20:54:33.542791] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-16T20:54:33.614432] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T20:54:34.342847] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-16T20:54:35.110231] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T20:54:35.142821] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-16T20:54:35.942904] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-16T20:54:36.046587] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-16T20:54:36.742802] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-16T20:54:37.138565] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T20:54:37.519064] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T20:54:37.525271] [INFO ] [REMOTE ] PFLT: Full fetch complete (63953 records). [2025-10-16T20:54:37.525439] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-16T20:54:37.526239] [FATAL] [VALIDATOR ] PFLT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:54:37.526330] [FATAL] [MAIN ] PFLT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:54:37.526373] [WARN ] [MAIN ] PFLT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:54:37.526421] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-16T20:54:37.526524] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-16T20:54:37.526586] [INFO ] [LOCAL ] PFLT: Starting deletion of derivative data. [2025-10-16T20:54:37.526691] [DEBUG] [LOCAL ] PFLT: No derivative data file found to delete. [2025-10-16T20:54:37.526787] [INFO ] [MAIN ] Update Progress: 1665/2369 symbols completed. PFLT took 36.7s. Estimated remaining: 1h 39m 11s. Rate: 7.1 symbols/min [2025-10-16T20:54:37.548265] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-16T20:54:37.706417] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:54:37.706614] [DEBUG] [LOCAL ] PFSI: No existing data file found in primary storage. [2025-10-16T20:54:37.706680] [WARN ] [MAIN ] PFSI: No existing data found, performing full refresh instead. [2025-10-16T20:54:37.706797] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-16T20:54:37.706838] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-16T20:54:37.706903] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-16T20:54:37.706967] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-16T20:54:38.095834] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:54:38.342801] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-16T20:54:38.507343] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T20:54:38.619243] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (5.08 seconds). [2025-10-16T20:54:39.142823] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-16T20:54:39.660204] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T20:54:39.708996] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T20:54:39.710154] [INFO ] [REMOTE ] PFO: Full fetch complete (7888 records). [2025-10-16T20:54:39.710225] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-16T20:54:39.948438] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-16T20:54:40.065937] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-16T20:54:40.066010] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-16T20:54:40.066211] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-16T20:54:40.066249] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-16T20:54:40.066682] [DEBUG] [LOCAL ] PFO: Trimmed 7888 records to 6121 (keeping 200 days of data) [2025-10-16T20:54:40.102196] [DEBUG] [LOCAL ] PFO: Primary data saved (6121 records). [2025-10-16T20:54:40.102297] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-16T20:54:40.102378] [INFO ] [MAIN ] Update Progress: 1666/2369 symbols completed. PFO took 20.5s. Estimated remaining: 1h 38m 60s. Rate: 7.1 symbols/min [2025-10-16T20:54:40.273109] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:54:40.273319] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-16T20:54:40.273362] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-16T20:54:40.273474] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-16T20:54:40.273514] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-16T20:54:40.273554] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-16T20:54:40.273585] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-16T20:54:40.622528] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:54:40.742785] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-16T20:54:41.542786] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-10-16T20:54:41.575896] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T20:54:41.838473] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T20:54:42.342819] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-10-16T20:54:42.843318] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T20:54:43.142818] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-16T20:54:43.942816] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-16T20:54:44.353099] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-16T20:54:44.515169] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T20:54:44.742782] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-16T20:54:45.090223] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T20:54:45.542821] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-16T20:54:46.342820] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-16T20:54:46.920201] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T20:54:47.050086] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-16T20:54:47.142792] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-16T20:54:47.194579] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T20:54:47.942806] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-16T20:54:48.742802] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-16T20:54:49.215498] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-16T20:54:49.542791] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-16T20:54:49.655757] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T20:54:49.943052] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T20:54:50.342822] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-16T20:54:50.557233] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T20:54:51.142812] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-16T20:54:51.942828] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-16T20:54:52.710372] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-16T20:54:52.744130] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-16T20:54:52.746768] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-16T20:54:53.270144] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T20:54:53.542859] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-16T20:54:53.921435] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T20:54:54.343038] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-16T20:54:54.754420] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T20:54:55.142827] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-16T20:54:55.558788] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-16T20:54:55.562569] [INFO ] [REMOTE ] PFN: Full fetch complete (31253 records). [2025-10-16T20:54:55.562685] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-16T20:54:55.929619] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-16T20:54:55.929728] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-16T20:54:55.930451] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-16T20:54:55.930492] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-16T20:54:55.931255] [DEBUG] [LOCAL ] PFN: Trimmed 31253 records to 22569 (keeping 200 days of data) [2025-10-16T20:54:55.978673] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-16T20:54:56.067588] [DEBUG] [LOCAL ] PFN: Primary data saved (22569 records). [2025-10-16T20:54:56.067754] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-16T20:54:56.067854] [INFO ] [MAIN ] Update Progress: 1667/2369 symbols completed. PFN took 38.4s. Estimated remaining: 1h 38m 55s. Rate: 7.1 symbols/min [2025-10-16T20:54:56.231446] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:54:56.239331] [DEBUG] [LOCAL ] PGP: Loaded 5700 existing records from primary storage. [2025-10-16T20:54:56.239532] [INFO ] [MAIN ] PGP: Loaded 5700 existing records. [2025-10-16T20:54:56.411077] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:54:56.411290] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-16T20:54:56.411335] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-16T20:54:56.411497] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-10-16T20:54:56.411552] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-16T20:54:56.754015] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-16T20:54:56.759435] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:54:57.173045] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T20:54:57.542829] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-16T20:54:57.604248] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-16T20:54:57.760687] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T20:54:58.342825] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-10-16T20:54:59.058971] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T20:54:59.096174] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T20:54:59.142766] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-16T20:54:59.832830] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T20:54:59.942793] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-16T20:55:00.742862] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-16T20:55:01.405910] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T20:55:01.542938] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-16T20:55:02.342826] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-16T20:55:02.974513] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T20:55:03.040993] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-16T20:55:03.151886] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-16T20:55:03.157259] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-16T20:55:03.895811] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T20:55:03.942768] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-16T20:55:04.742843] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-16T20:55:05.414853] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T20:55:05.542798] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-16T20:55:05.614136] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-16T20:55:06.342831] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-16T20:55:07.102088] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T20:55:07.142788] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-16T20:55:07.174556] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T20:55:07.872725] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-16T20:55:07.942847] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-16T20:55:08.742852] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-16T20:55:09.520170] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-16T20:55:09.542776] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-16T20:55:10.301526] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T20:55:10.306333] [INFO ] [REMOTE ] PFS: Full fetch complete (51804 records). [2025-10-16T20:55:10.306473] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-16T20:55:10.307440] [FATAL] [VALIDATOR ] PFS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:55:10.307531] [FATAL] [MAIN ] PFS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:55:10.307573] [WARN ] [MAIN ] PFS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:55:10.307640] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-16T20:55:10.307741] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-16T20:55:10.307793] [INFO ] [LOCAL ] PFS: Starting deletion of derivative data. [2025-10-16T20:55:10.307835] [DEBUG] [LOCAL ] PFS: No derivative data file found to delete. [2025-10-16T20:55:10.307892] [INFO ] [MAIN ] Update Progress: 1668/2369 symbols completed. PFS took 43.2s. Estimated remaining: 1h 38m 49s. Rate: 7.1 symbols/min [2025-10-16T20:55:10.352143] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-16T20:55:10.490924] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:55:10.491091] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-10-16T20:55:10.491127] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-10-16T20:55:10.491239] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-16T20:55:10.491304] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-16T20:55:10.491370] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-16T20:55:10.491420] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-16T20:55:10.865206] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:55:11.001890] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-16T20:55:11.137116] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T20:55:11.141213] [INFO ] [REMOTE ] PFSI: Full fetch complete (41238 records). [2025-10-16T20:55:11.141357] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-16T20:55:11.142075] [FATAL] [VALIDATOR ] PFSI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:55:11.142164] [FATAL] [MAIN ] PFSI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:55:11.142213] [WARN ] [MAIN ] PFSI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:55:11.142303] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-16T20:55:11.142399] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-16T20:55:11.142469] [INFO ] [LOCAL ] PFSI: Starting deletion of derivative data. [2025-10-16T20:55:11.142538] [DEBUG] [LOCAL ] PFSI: No derivative data file found to delete. [2025-10-16T20:55:11.142634] [INFO ] [MAIN ] Update Progress: 1669/2369 symbols completed. PFSI took 33.6s. Estimated remaining: 1h 38m 37s. Rate: 7.1 symbols/min [2025-10-16T20:55:11.142835] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-16T20:55:11.315286] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:55:11.359105] [DEBUG] [LOCAL ] PGRE: Loaded 47027 existing records from primary storage. [2025-10-16T20:55:11.359443] [INFO ] [MAIN ] PGRE: Loaded 47027 existing records. [2025-10-16T20:55:11.530787] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:55:11.531016] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-16T20:55:11.531064] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-16T20:55:11.531243] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-10-16T20:55:11.531281] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-16T20:55:11.870181] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:55:11.942798] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-10-16T20:55:12.742914] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-10-16T20:55:13.533317] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T20:55:13.542766] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-16T20:55:13.685351] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-16T20:55:14.342839] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-16T20:55:14.833208] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-16T20:55:15.102488] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T20:55:15.142820] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-16T20:55:15.942845] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-16T20:55:16.656382] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-16T20:55:16.718088] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-16T20:55:16.752826] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-16T20:55:16.755772] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T20:55:17.542817] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-16T20:55:18.342820] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-16T20:55:19.144739] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-16T20:55:19.140277] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-16T20:55:19.153852] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T20:55:19.509501] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-16T20:55:19.942805] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-16T20:55:20.718003] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T20:55:20.742780] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-16T20:55:20.797509] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T20:55:20.805760] [INFO ] [REMOTE ] PG: Full fetch complete (77537 records). [2025-10-16T20:55:20.805928] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-16T20:55:20.806943] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:55:20.807058] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:55:20.807139] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:55:20.807217] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-16T20:55:20.807287] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-16T20:55:20.807369] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-10-16T20:55:20.807426] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-10-16T20:55:20.807510] [INFO ] [MAIN ] Update Progress: 1670/2369 symbols completed. PG took 40.7s. Estimated remaining: 1h 38m 29s. Rate: 7.1 symbols/min [2025-10-16T20:55:21.035543] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:55:21.044116] [DEBUG] [LOCAL ] PGZ: Loaded 5522 existing records from primary storage. [2025-10-16T20:55:21.044325] [INFO ] [MAIN ] PGZ: Loaded 5522 existing records. [2025-10-16T20:55:21.267296] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:55:21.267560] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-16T20:55:21.267624] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-16T20:55:21.267825] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-10-16T20:55:21.267882] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-16T20:55:21.549002] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-16T20:55:21.638910] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:55:22.342798] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-16T20:55:22.531449] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T20:55:23.142878] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-10-16T20:55:23.206604] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-16T20:55:23.548436] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-16T20:55:23.783324] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-16T20:55:23.942859] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-16T20:55:24.691922] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T20:55:24.693324] [INFO ] [REMOTE ] PGP: Full fetch complete (7911 records). [2025-10-16T20:55:24.693397] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-16T20:55:24.747992] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-16T20:55:25.064596] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-16T20:55:25.064690] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-16T20:55:25.064908] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-16T20:55:25.064948] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-16T20:55:25.065331] [DEBUG] [LOCAL ] PGP: Trimmed 7911 records to 5735 (keeping 200 days of data) [2025-10-16T20:55:25.097360] [DEBUG] [LOCAL ] PGP: Primary data saved (5735 records). [2025-10-16T20:55:25.097434] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-16T20:55:25.097504] [INFO ] [MAIN ] Update Progress: 1671/2369 symbols completed. PGP took 29.0s. Estimated remaining: 1h 38m 19s. Rate: 7.1 symbols/min [2025-10-16T20:55:25.260238] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:55:25.260365] [DEBUG] [LOCAL ] PH: No existing data file found in primary storage. [2025-10-16T20:55:25.260400] [WARN ] [MAIN ] PH: No existing data found, performing full refresh instead. [2025-10-16T20:55:25.260506] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-16T20:55:25.260546] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-16T20:55:25.260585] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-16T20:55:25.260621] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-16T20:55:25.547964] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-16T20:55:25.605186] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:55:26.342808] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-10-16T20:55:26.485181] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T20:55:26.513359] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T20:55:27.142809] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-16T20:55:27.920842] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T20:55:27.942791] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-16T20:55:28.718019] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T20:55:28.742780] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-16T20:55:29.275837] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T20:55:29.542822] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-16T20:55:30.342812] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-16T20:55:30.507894] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-16T20:55:31.130849] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T20:55:31.142782] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-16T20:55:31.942833] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-16T20:55:32.059392] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T20:55:32.593846] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-16T20:55:32.742810] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-16T20:55:33.542865] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-16T20:55:33.801139] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-16T20:55:34.342791] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-16T20:55:34.393801] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T20:55:35.142882] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-16T20:55:35.490457] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T20:55:35.933397] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T20:55:35.945485] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-16T20:55:36.697522] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-16T20:55:36.710593] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T20:55:36.710423] [INFO ] [REMOTE ] PGRE: Full fetch complete (64441 records). [2025-10-16T20:55:36.712494] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-16T20:55:36.747883] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-16T20:55:37.102989] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-10-16T20:55:37.103125] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-10-16T20:55:37.104113] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-10-16T20:55:37.104175] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-10-16T20:55:37.105435] [DEBUG] [LOCAL ] PGRE: Trimmed 64441 records to 47344 (keeping 200 days of data) [2025-10-16T20:55:37.360170] [DEBUG] [LOCAL ] PGRE: Primary data saved (47344 records). [2025-10-16T20:55:37.360297] [INFO ] [MAIN ] PGRE: Full history saved. [2025-10-16T20:55:37.360940] [INFO ] [MAIN ] Update Progress: 1672/2369 symbols completed. PGRE took 26.2s. Estimated remaining: 1h 38m 12s. Rate: 7.1 symbols/min [2025-10-16T20:55:37.527930] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:55:37.528064] [DEBUG] [LOCAL ] PHG: No existing data file found in primary storage. [2025-10-16T20:55:37.528123] [WARN ] [MAIN ] PHG: No existing data found, performing full refresh instead. [2025-10-16T20:55:37.528292] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-16T20:55:37.528363] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-16T20:55:37.528455] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-16T20:55:37.528533] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-16T20:55:37.547964] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-16T20:55:37.887574] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:55:38.342791] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-10-16T20:55:38.815544] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-16T20:55:39.142797] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-16T20:55:39.297730] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T20:55:39.762390] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T20:55:39.942829] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-16T20:55:40.030267] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-16T20:55:40.742817] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-16T20:55:41.542825] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-16T20:55:41.616244] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T20:55:42.051015] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-16T20:55:42.342806] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-16T20:55:42.379730] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T20:55:43.074618] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T20:55:43.142804] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-16T20:55:43.813177] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-16T20:55:43.942803] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-16T20:55:44.633486] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-16T20:55:44.742851] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-16T20:55:45.542833] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-16T20:55:46.342872] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-16T20:55:46.476549] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T20:55:46.524917] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T20:55:47.142831] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-16T20:55:47.762968] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T20:55:47.896523] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T20:55:47.942781] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-16T20:55:48.610936] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T20:55:48.612162] [INFO ] [REMOTE ] PGZ: Full fetch complete (8417 records). [2025-10-16T20:55:48.612235] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-16T20:55:48.752291] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-16T20:55:48.973676] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-16T20:55:48.973759] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-16T20:55:48.973988] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-16T20:55:48.974031] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-16T20:55:48.974458] [DEBUG] [LOCAL ] PGZ: Trimmed 8417 records to 5570 (keeping 200 days of data) [2025-10-16T20:55:49.008178] [DEBUG] [LOCAL ] PGZ: Primary data saved (5570 records). [2025-10-16T20:55:49.008354] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-16T20:55:49.008449] [INFO ] [MAIN ] Update Progress: 1673/2369 symbols completed. PGZ took 28.2s. Estimated remaining: 1h 38m 5s. Rate: 7.1 symbols/min [2025-10-16T20:55:49.178495] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:55:49.178698] [DEBUG] [LOCAL ] PHI: No existing data file found in primary storage. [2025-10-16T20:55:49.178751] [WARN ] [MAIN ] PHI: No existing data found, performing full refresh instead. [2025-10-16T20:55:49.178873] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-16T20:55:49.178937] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-16T20:55:49.178981] [DEBUG] [LOCAL ] PHI: No primary data file found to delete. [2025-10-16T20:55:49.179014] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-16T20:55:49.528920] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:55:49.542772] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-10-16T20:55:50.342786] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-16T20:55:50.607207] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T20:55:50.782422] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-16T20:55:51.142946] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-16T20:55:51.817164] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T20:55:51.942828] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-10-16T20:55:52.742787] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-16T20:55:52.839794] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T20:55:53.389832] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-16T20:55:53.467488] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T20:55:53.542812] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-16T20:55:54.342800] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-16T20:55:54.456483] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T20:55:55.142848] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-16T20:55:55.942860] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-16T20:55:56.139471] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T20:55:56.742868] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-10. [2025-10-16T20:55:57.079332] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T20:55:57.332877] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-16T20:55:57.502238] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T20:55:57.506593] [INFO ] [REMOTE ] PH: Full fetch complete (55584 records). [2025-10-16T20:55:57.506773] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-10-16T20:55:57.508491] [FATAL] [VALIDATOR ] PH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:55:57.508867] [FATAL] [MAIN ] PH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:55:57.508973] [WARN ] [MAIN ] PH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:55:57.509052] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-16T20:55:57.509127] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-16T20:55:57.509178] [INFO ] [LOCAL ] PH: Starting deletion of derivative data. [2025-10-16T20:55:57.509247] [DEBUG] [LOCAL ] PH: No derivative data file found to delete. [2025-10-16T20:55:57.509327] [INFO ] [MAIN ] Update Progress: 1674/2369 symbols completed. PH took 32.4s. Estimated remaining: 1h 37m 56s. Rate: 7.1 symbols/min [2025-10-16T20:55:57.547947] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-16T20:55:57.706820] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:55:57.706999] [DEBUG] [LOCAL ] PHIN: No existing data file found in primary storage. [2025-10-16T20:55:57.707035] [WARN ] [MAIN ] PHIN: No existing data found, performing full refresh instead. [2025-10-16T20:55:57.707180] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-16T20:55:57.707228] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-16T20:55:57.707268] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-16T20:55:57.707299] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-16T20:55:58.052281] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:55:58.342863] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-16T20:55:59.142906] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-16T20:55:59.357243] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T20:55:59.408379] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-16T20:55:59.942818] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-16T20:56:00.742872] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-10-16T20:56:01.199752] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T20:56:01.542824] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-16T20:56:01.718457] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-10-16T20:56:02.328131] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T20:56:02.342778] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-16T20:56:02.567097] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T20:56:03.142843] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-16T20:56:03.657893] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T20:56:03.942813] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-16T20:56:04.742794] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-16T20:56:05.167601] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-16T20:56:05.542782] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-16T20:56:05.721882] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T20:56:05.751237] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T20:56:05.979676] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-16T20:56:05.985986] [INFO ] [REMOTE ] PGR: Full fetch complete (76364 records). [2025-10-16T20:56:05.986119] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-16T20:56:05.986973] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:56:05.987065] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:56:05.987112] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:56:05.987204] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-16T20:56:05.987284] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-16T20:56:05.987334] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-10-16T20:56:05.987391] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-10-16T20:56:05.987465] [INFO ] [MAIN ] Update Progress: 1675/2369 symbols completed. PGR took 55.7s. Estimated remaining: 1h 37m 48s. Rate: 7.1 symbols/min [2025-10-16T20:56:06.157420] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:56:06.182588] [DEBUG] [LOCAL ] PHK: Loaded 26718 existing records from primary storage. [2025-10-16T20:56:06.182879] [INFO ] [MAIN ] PHK: Loaded 26718 existing records. [2025-10-16T20:56:06.346069] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-16T20:56:06.369383] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:56:06.370338] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-16T20:56:06.370400] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-16T20:56:06.370605] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-10-16T20:56:06.370703] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-16T20:56:06.722122] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:56:07.142818] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-16T20:56:07.942836] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-10-16T20:56:08.151073] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T20:56:08.304564] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-16T20:56:08.742863] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-16T20:56:09.320733] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T20:56:09.542841] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-16T20:56:10.342808] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-16T20:56:10.436703] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T20:56:10.868316] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T20:56:11.142796] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-16T20:56:11.250214] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T20:56:11.942779] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-16T20:56:12.338059] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T20:56:12.742823] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-16T20:56:13.542881] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-10-16T20:56:13.698076] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-16T20:56:14.342885] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-16T20:56:14.502461] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T20:56:14.687182] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-16T20:56:15.142825] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-16T20:56:15.581353] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-16T20:56:15.942819] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-10. [2025-10-16T20:56:16.448894] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T20:56:16.742869] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-16T20:56:16.926553] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T20:56:16.929273] [INFO ] [REMOTE ] PHI: Full fetch complete (21087 records). [2025-10-16T20:56:16.929363] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-10-16T20:56:17.318894] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-10-16T20:56:17.318976] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-10-16T20:56:17.319476] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-10-16T20:56:17.319538] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-10-16T20:56:17.320132] [DEBUG] [LOCAL ] PHI: Trimmed 21087 records to 15302 (keeping 200 days of data) [2025-10-16T20:56:17.413830] [DEBUG] [LOCAL ] PHI: Primary data saved (15302 records). [2025-10-16T20:56:17.413999] [INFO ] [MAIN ] PHI: Full history saved. [2025-10-16T20:56:17.414087] [INFO ] [MAIN ] Update Progress: 1676/2369 symbols completed. PHI took 28.4s. Estimated remaining: 1h 37m 41s. Rate: 7.1 symbols/min [2025-10-16T20:56:17.554380] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-16T20:56:17.590192] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:56:17.591293] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-10-16T20:56:17.591341] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-10-16T20:56:17.591462] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-16T20:56:17.591504] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-16T20:56:17.591545] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-16T20:56:17.591602] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-16T20:56:17.958990] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:56:18.007386] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T20:56:18.342856] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-10-16T20:56:19.142851] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-16T20:56:19.514909] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-16T20:56:19.942839] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-16T20:56:20.193457] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T20:56:20.335552] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T20:56:20.742880] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-16T20:56:21.354863] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T20:56:21.488470] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T20:56:21.493388] [INFO ] [REMOTE ] PHG: Full fetch complete (65335 records). [2025-10-16T20:56:21.493494] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-16T20:56:21.494467] [FATAL] [VALIDATOR ] PHG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:56:21.494569] [FATAL] [MAIN ] PHG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:56:21.494612] [WARN ] [MAIN ] PHG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:56:21.494679] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-16T20:56:21.494757] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-16T20:56:21.494795] [INFO ] [LOCAL ] PHG: Starting deletion of derivative data. [2025-10-16T20:56:21.494835] [DEBUG] [LOCAL ] PHG: No derivative data file found to delete. [2025-10-16T20:56:21.494892] [INFO ] [MAIN ] Update Progress: 1677/2369 symbols completed. PHG took 44.1s. Estimated remaining: 1h 37m 30s. Rate: 7.1 symbols/min [2025-10-16T20:56:21.542837] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-16T20:56:22.342892] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-16T20:56:22.793889] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-16T20:56:23.142864] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-16T20:56:23.942829] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-16T20:56:24.197406] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T20:56:24.318787] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-16T20:56:24.742798] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-16T20:56:25.373181] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-16T20:56:25.542816] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-16T20:56:25.770774] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T20:56:25.903000] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-16T20:56:25.906899] [INFO ] [REMOTE ] PHIN: Full fetch complete (47416 records). [2025-10-16T20:56:25.907035] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-16T20:56:25.907696] [FATAL] [VALIDATOR ] PHIN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:56:25.907785] [FATAL] [MAIN ] PHIN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:56:25.907827] [WARN ] [MAIN ] PHIN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:56:25.907893] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-16T20:56:25.907955] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-16T20:56:25.907989] [INFO ] [LOCAL ] PHIN: Starting deletion of derivative data. [2025-10-16T20:56:25.908028] [DEBUG] [LOCAL ] PHIN: No derivative data file found to delete. [2025-10-16T20:56:25.908081] [INFO ] [MAIN ] Update Progress: 1678/2369 symbols completed. PHIN took 28.4s. Estimated remaining: 1h 37m 20s. Rate: 7.1 symbols/min [2025-10-16T20:56:26.342863] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-16T20:56:27.142834] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-16T20:56:27.514848] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T20:56:27.942925] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-16T20:56:28.962864] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-16T20:56:28.973438] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-16T20:56:29.018532] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-16T20:56:29.542851] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-10-16T20:56:30.922321] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T20:56:30.928835] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-10. [2025-10-16T20:56:30.982913] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T20:56:31.142790] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-16T20:56:32.142886] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T20:56:32.148706] [INFO ] [REMOTE ] PHK: Full fetch complete (39338 records). [2025-10-16T20:56:32.148921] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-10-16T20:56:32.540115] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-10-16T20:56:32.540193] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-10-16T20:56:32.540990] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-10-16T20:56:32.541051] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-10-16T20:56:32.541957] [DEBUG] [LOCAL ] PHK: Trimmed 39338 records to 26928 (keeping 200 days of data) [2025-10-16T20:56:32.699286] [DEBUG] [LOCAL ] PHK: Primary data saved (26928 records). [2025-10-16T20:56:32.699457] [INFO ] [MAIN ] PHK: Full history saved. [2025-10-16T20:56:32.699545] [INFO ] [MAIN ] Update Progress: 1679/2369 symbols completed. PHK took 26.7s. Estimated remaining: 1h 37m 11s. Rate: 7.1 symbols/min [2025-10-16T20:56:33.139502] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T20:56:33.150521] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-16T20:56:34.840033] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T20:56:34.851836] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-16T20:56:36.564296] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T20:56:36.574548] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-16T20:56:38.674752] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-16T20:56:38.686178] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-16T20:56:40.570173] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T20:56:40.582161] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-16T20:56:42.435083] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T20:56:42.446073] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-16T20:56:43.288982] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T20:56:43.295154] [INFO ] [REMOTE ] PHM: Full fetch complete (74774 records). [2025-10-16T20:56:43.295280] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-16T20:56:43.296086] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:56:43.296173] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:56:43.296216] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:56:43.296255] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-16T20:56:43.296310] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-16T20:56:43.296345] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-10-16T20:56:43.296384] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-10-16T20:56:43.296441] [INFO ] [MAIN ] Update Progress: 1680/2369 symbols completed. PHM took 25.9s. Estimated remaining: 1h 37m 4s. Rate: 7.1 symbols/min [2025-10-16T20:56:43.954169] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:56:43.983412] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:56:44.009836] [DEBUG] [LOCAL ] PII: No existing data file found in primary storage. [2025-10-16T20:56:44.041280] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:56:44.042412] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:56:44.042635] [DEBUG] [LOCAL ] PHR: No existing data file found in primary storage. [2025-10-16T20:56:44.041548] [WARN ] [MAIN ] PII: No existing data found, performing full refresh instead. [2025-10-16T20:56:44.042898] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-16T20:56:44.043115] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-16T20:56:44.042748] [WARN ] [MAIN ] PHR: No existing data found, performing full refresh instead. [2025-10-16T20:56:44.043224] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-16T20:56:44.043368] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-16T20:56:44.060984] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-16T20:56:44.087722] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-16T20:56:44.118183] [DEBUG] [LOCAL ] PIM: Loaded 4822 existing records from primary storage. [2025-10-16T20:56:44.111475] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-16T20:56:44.123621] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-16T20:56:44.139933] [INFO ] [MAIN ] PIM: Loaded 4822 existing records. [2025-10-16T20:56:44.211573] [DEBUG] [LOCAL ] PINE: Loaded 14395 existing records from primary storage. [2025-10-16T20:56:44.252756] [INFO ] [MAIN ] PINE: Loaded 14395 existing records. [2025-10-16T20:56:44.989470] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:56:45.021746] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:56:45.049792] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-16T20:56:45.055114] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-16T20:56:45.071243] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-16T20:56:45.095344] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-16T20:56:45.130341] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-10-16T20:56:45.174363] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-10-16T20:56:45.174523] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-16T20:56:45.152444] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-16T20:56:45.183259] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:56:45.273216] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-10-16T20:56:45.281702] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:56:45.297995] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-10-16T20:56:45.939981] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:56:45.962783] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-10-16T20:56:45.962390] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:56:45.963962] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-10-16T20:56:46.735886] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T20:56:46.736794] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T20:56:46.744227] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-16T20:56:46.746395] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-16T20:56:47.179775] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-16T20:56:47.183393] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-16T20:56:47.292115] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-16T20:56:47.301318] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-16T20:56:47.613091] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T20:56:47.614484] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-16T20:56:48.381805] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T20:56:48.383734] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-16T20:56:48.386047] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T20:56:48.394773] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-16T20:56:48.408528] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-16T20:56:48.412995] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-16T20:56:49.173545] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T20:56:49.175083] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-16T20:56:49.477911] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-16T20:56:49.489124] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-16T20:56:49.562082] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T20:56:49.565833] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-16T20:56:49.639031] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-16T20:56:49.640909] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-16T20:56:49.658691] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T20:56:49.665757] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-16T20:56:50.406501] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T20:56:50.408275] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-16T20:56:50.589669] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T20:56:50.945862] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T20:56:51.134828] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-16T20:56:51.142786] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-16T20:56:51.204343] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T20:56:51.872586] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-16T20:56:51.942786] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-16T20:56:52.660668] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-16T20:56:52.742814] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-16T20:56:53.542825] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-16T20:56:53.915940] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T20:56:54.103690] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-16T20:56:54.342871] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-16T20:56:54.925615] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T20:56:54.926717] [INFO ] [REMOTE ] PIM: Full fetch complete (6485 records). [2025-10-16T20:56:54.926791] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-16T20:56:55.148005] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-16T20:56:55.290634] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-16T20:56:55.290742] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-16T20:56:55.290961] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-16T20:56:55.291002] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-16T20:56:55.291403] [DEBUG] [LOCAL ] PIM: Trimmed 6485 records to 4868 (keeping 200 days of data) [2025-10-16T20:56:55.318843] [DEBUG] [LOCAL ] PIM: Primary data saved (4868 records). [2025-10-16T20:56:55.318939] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-16T20:56:55.319018] [INFO ] [MAIN ] Update Progress: 1681/2369 symbols completed. PIM took 12.0s. Estimated remaining: 1h 36m 57s. Rate: 7.1 symbols/min [2025-10-16T20:56:55.488158] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:56:55.488336] [DEBUG] [LOCAL ] PINS: No existing data file found in primary storage. [2025-10-16T20:56:55.488381] [WARN ] [MAIN ] PINS: No existing data found, performing full refresh instead. [2025-10-16T20:56:55.488495] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-16T20:56:55.488538] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-16T20:56:55.488603] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-16T20:56:55.488638] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-16T20:56:55.850957] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:56:55.942782] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-10-16T20:56:56.276008] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-16T20:56:56.742906] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-16T20:56:57.542866] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-16T20:56:57.670953] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T20:56:58.041505] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-16T20:56:58.342843] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-16T20:56:59.142796] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-16T20:56:59.415829] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T20:56:59.942856] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-16T20:57:00.108365] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T20:57:00.225296] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T20:57:00.742854] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-16T20:57:01.542873] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-16T20:57:02.188258] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-16T20:57:02.241708] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T20:57:02.342786] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-16T20:57:02.449835] [DEBUG] [REMOTE ] PHR: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-16T20:57:02.450177] [WARN ] [REMOTE ] PHR: No data returned for month 2025-06 [2025-10-16T20:57:02.450300] [FATAL] [REMOTE ] PHR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:57:02.450431] [FATAL] [MAIN ] PHR: Failed to fetch primary data. [2025-10-16T20:57:02.450516] [WARN ] [MAIN ] PHR: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:57:02.450606] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-16T20:57:02.450727] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-16T20:57:02.450789] [INFO ] [LOCAL ] PHR: Starting deletion of derivative data. [2025-10-16T20:57:02.450848] [DEBUG] [LOCAL ] PHR: No derivative data file found to delete. [2025-10-16T20:57:02.450916] [INFO ] [MAIN ] Update Progress: 1682/2369 symbols completed. PHR took 19.2s. Estimated remaining: 1h 36m 48s. Rate: 7.1 symbols/min [2025-10-16T20:57:02.625835] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:57:02.625998] [DEBUG] [LOCAL ] PIPR: No existing data file found in primary storage. [2025-10-16T20:57:02.626081] [WARN ] [MAIN ] PIPR: No existing data found, performing full refresh instead. [2025-10-16T20:57:02.626161] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-16T20:57:02.626197] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-16T20:57:02.626237] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-16T20:57:02.626267] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-16T20:57:02.996911] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:57:03.142859] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-10-16T20:57:03.418813] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T20:57:03.942851] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-16T20:57:04.036719] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-16T20:57:04.742795] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-16T20:57:04.906148] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-16T20:57:05.542874] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-16T20:57:06.342795] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-16T20:57:06.673520] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-16T20:57:07.046108] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T20:57:07.142837] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-16T20:57:07.262782] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T20:57:07.942833] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-16T20:57:08.742806] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-16T20:57:09.125592] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-16T20:57:09.542820] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-16T20:57:09.731931] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T20:57:09.734318] [INFO ] [REMOTE ] PINE: Full fetch complete (21109 records). [2025-10-16T20:57:09.734387] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-16T20:57:10.123183] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-10-16T20:57:10.123339] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-10-16T20:57:10.123908] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-10-16T20:57:10.124019] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-10-16T20:57:10.124886] [DEBUG] [LOCAL ] PINE: Trimmed 21109 records to 14493 (keeping 200 days of data) [2025-10-16T20:57:10.226073] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-16T20:57:10.263052] [DEBUG] [LOCAL ] PINE: Primary data saved (14493 records). [2025-10-16T20:57:10.263190] [INFO ] [MAIN ] PINE: Full history saved. [2025-10-16T20:57:10.263296] [INFO ] [MAIN ] Update Progress: 1683/2369 symbols completed. PINE took 26.9s. Estimated remaining: 1h 36m 39s. Rate: 7.1 symbols/min [2025-10-16T20:57:10.351349] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-16T20:57:10.449970] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:57:10.450159] [DEBUG] [LOCAL ] PJT: No existing data file found in primary storage. [2025-10-16T20:57:10.450203] [WARN ] [MAIN ] PJT: No existing data found, performing full refresh instead. [2025-10-16T20:57:10.450325] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-16T20:57:10.450367] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-16T20:57:10.450408] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-16T20:57:10.450439] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-16T20:57:10.815634] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:57:11.142804] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-10-16T20:57:11.451791] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-16T20:57:11.942877] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-16T20:57:12.322534] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T20:57:12.510941] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-16T20:57:12.623070] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T20:57:12.742923] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-16T20:57:13.542809] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-16T20:57:14.068705] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T20:57:14.342835] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-16T20:57:14.483155] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T20:57:15.142890] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-16T20:57:15.942929] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-16T20:57:16.662933] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-16T20:57:16.742787] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-16T20:57:17.093263] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-16T20:57:17.147062] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T20:57:17.542926] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-16T20:57:18.342855] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-16T20:57:18.819226] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-16T20:57:18.881240] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T20:57:19.142890] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-16T20:57:19.461092] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T20:57:19.942877] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-16T20:57:20.560242] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T20:57:20.742851] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-16T20:57:21.542906] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-16T20:57:21.732370] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T20:57:21.792840] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T20:57:22.342838] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-16T20:57:22.504575] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-16T20:57:23.142929] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-16T20:57:23.942832] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-16T20:57:24.265953] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T20:57:24.466630] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-16T20:57:24.742819] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-16T20:57:24.834604] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T20:57:24.843186] [INFO ] [REMOTE ] PII: Full fetch complete (71045 records). [2025-10-16T20:57:24.843373] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-16T20:57:24.844366] [FATAL] [VALIDATOR ] PII: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:57:24.844477] [FATAL] [MAIN ] PII: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:57:24.844561] [WARN ] [MAIN ] PII: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:57:24.844676] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-16T20:57:24.844777] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-16T20:57:24.844852] [INFO ] [LOCAL ] PII: Starting deletion of derivative data. [2025-10-16T20:57:24.844919] [DEBUG] [LOCAL ] PII: No derivative data file found to delete. [2025-10-16T20:57:24.845000] [INFO ] [MAIN ] Update Progress: 1684/2369 symbols completed. PII took 41.5s. Estimated remaining: 1h 36m 33s. Rate: 7.1 symbols/min [2025-10-16T20:57:25.016686] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:57:25.016850] [DEBUG] [LOCAL ] PK: No existing data file found in primary storage. [2025-10-16T20:57:25.016887] [WARN ] [MAIN ] PK: No existing data found, performing full refresh instead. [2025-10-16T20:57:25.017026] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-16T20:57:25.017102] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-16T20:57:25.017167] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-16T20:57:25.017203] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-16T20:57:25.365494] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:57:25.542802] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-10-16T20:57:26.342825] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-16T20:57:26.985818] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-16T20:57:27.142818] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-16T20:57:27.426374] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T20:57:27.584449] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T20:57:27.942871] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-16T20:57:28.742819] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-16T20:57:29.037161] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-16T20:57:29.107840] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T20:57:29.542872] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-16T20:57:29.841282] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T20:57:30.343002] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-16T20:57:31.142922] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-16T20:57:31.298845] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-16T20:57:31.448759] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T20:57:31.942868] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-16T20:57:32.359674] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T20:57:32.396019] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-16T20:57:32.399134] [INFO ] [REMOTE ] PJT: Full fetch complete (32100 records). [2025-10-16T20:57:32.399225] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-16T20:57:32.399824] [FATAL] [VALIDATOR ] PJT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:57:32.399937] [FATAL] [MAIN ] PJT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:57:32.400014] [WARN ] [MAIN ] PJT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:57:32.400109] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-16T20:57:32.400204] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-16T20:57:32.400258] [INFO ] [LOCAL ] PJT: Starting deletion of derivative data. [2025-10-16T20:57:32.400302] [DEBUG] [LOCAL ] PJT: No derivative data file found to delete. [2025-10-16T20:57:32.400373] [INFO ] [MAIN ] Update Progress: 1685/2369 symbols completed. PJT took 22.1s. Estimated remaining: 1h 36m 24s. Rate: 7.1 symbols/min [2025-10-16T20:57:32.571667] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:57:32.587482] [DEBUG] [LOCAL ] PKE: Loaded 14099 existing records from primary storage. [2025-10-16T20:57:32.587776] [INFO ] [MAIN ] PKE: Loaded 14099 existing records. [2025-10-16T20:57:32.754249] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-16T20:57:32.767901] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:57:32.768809] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-16T20:57:32.768860] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-16T20:57:32.769047] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-10-16T20:57:32.769103] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-16T20:57:33.122156] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:57:33.542839] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-16T20:57:33.738240] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T20:57:33.745517] [INFO ] [REMOTE ] PINS: Full fetch complete (77481 records). [2025-10-16T20:57:33.745747] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-16T20:57:33.746551] [FATAL] [VALIDATOR ] PINS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:57:33.746677] [FATAL] [MAIN ] PINS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:57:33.746735] [WARN ] [MAIN ] PINS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:57:33.746814] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-16T20:57:33.746923] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-16T20:57:33.746996] [INFO ] [LOCAL ] PINS: Starting deletion of derivative data. [2025-10-16T20:57:33.747062] [DEBUG] [LOCAL ] PINS: No derivative data file found to delete. [2025-10-16T20:57:33.747133] [INFO ] [MAIN ] Update Progress: 1686/2369 symbols completed. PINS took 38.4s. Estimated remaining: 1h 36m 13s. Rate: 7.1 symbols/min [2025-10-16T20:57:33.941533] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:57:33.941753] [DEBUG] [LOCAL ] PKG: No existing data file found in primary storage. [2025-10-16T20:57:33.941798] [WARN ] [MAIN ] PKG: No existing data found, performing full refresh instead. [2025-10-16T20:57:33.941912] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-16T20:57:33.941956] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-16T20:57:33.941996] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-16T20:57:33.942027] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-16T20:57:34.298902] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:57:34.342793] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-10-16T20:57:35.142873] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-10-16T20:57:35.283841] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T20:57:35.947400] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-16T20:57:35.952861] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T20:57:36.135124] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T20:57:36.742804] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-16T20:57:37.117735] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T20:57:37.542855] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-16T20:57:37.761863] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T20:57:38.275262] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T20:57:38.342796] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-16T20:57:39.142811] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-16T20:57:39.221094] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T20:57:39.942836] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-16T20:57:39.997431] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-16T20:57:40.742815] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-16T20:57:41.542817] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-16T20:57:41.550820] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T20:57:41.553435] [INFO ] [REMOTE ] PIPR: Full fetch complete (20757 records). [2025-10-16T20:57:41.553595] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-16T20:57:41.554226] [FATAL] [VALIDATOR ] PIPR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:57:41.554317] [FATAL] [MAIN ] PIPR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:57:41.554462] [WARN ] [MAIN ] PIPR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:57:41.554546] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-16T20:57:41.554900] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-16T20:57:41.570064] [INFO ] [LOCAL ] PIPR: Starting deletion of derivative data. [2025-10-16T20:57:41.579803] [DEBUG] [LOCAL ] PIPR: No derivative data file found to delete. [2025-10-16T20:57:41.579948] [INFO ] [MAIN ] Update Progress: 1687/2369 symbols completed. PIPR took 39.1s. Estimated remaining: 1h 36m 4s. Rate: 7.1 symbols/min [2025-10-16T20:57:41.587388] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T20:57:41.773847] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:57:41.774109] [DEBUG] [LOCAL ] PKST: No existing data file found in primary storage. [2025-10-16T20:57:41.774151] [WARN ] [MAIN ] PKST: No existing data found, performing full refresh instead. [2025-10-16T20:57:41.774281] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-16T20:57:41.774323] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-16T20:57:41.774364] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-16T20:57:41.774400] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-16T20:57:42.200851] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:57:42.342805] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-16T20:57:42.446199] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-16T20:57:43.142819] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-16T20:57:43.942856] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-16T20:57:43.970086] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T20:57:44.083227] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T20:57:44.742866] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-10-16T20:57:45.542851] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-16T20:57:45.920792] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T20:57:45.964704] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-16T20:57:46.163403] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T20:57:46.342853] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-16T20:57:47.142805] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-16T20:57:47.942816] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-16T20:57:48.246572] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-16T20:57:48.742883] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-16T20:57:49.059921] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T20:57:49.123631] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-16T20:57:49.542914] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-16T20:57:50.209085] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T20:57:50.342785] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-16T20:57:50.651817] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T20:57:51.142824] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-16T20:57:51.942851] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-16T20:57:52.168579] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T20:57:52.742861] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-16T20:57:52.787728] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T20:57:52.924587] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T20:57:53.416832] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-16T20:57:53.542791] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-16T20:57:54.342826] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-16T20:57:54.894529] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T20:57:55.142818] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-16T20:57:55.942797] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-16T20:57:56.341270] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-16T20:57:56.395039] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-16T20:57:56.656858] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T20:57:56.742799] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-16T20:57:57.542812] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-16T20:57:57.906565] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T20:57:58.342816] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-16T20:57:58.834755] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T20:57:59.017582] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-16T20:57:59.142825] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-16T20:57:59.942828] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-16T20:58:00.742849] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-16T20:58:01.054928] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-16T20:58:01.116751] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T20:58:01.119889] [INFO ] [REMOTE ] PKE: Full fetch complete (18211 records). [2025-10-16T20:58:01.119986] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-16T20:58:01.548688] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-16T20:58:01.550621] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-10-16T20:58:01.550754] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-10-16T20:58:01.551284] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-10-16T20:58:01.551330] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-10-16T20:58:01.552324] [DEBUG] [LOCAL ] PKE: Trimmed 18211 records to 14192 (keeping 200 days of data) [2025-10-16T20:58:01.640042] [DEBUG] [LOCAL ] PKE: Primary data saved (14192 records). [2025-10-16T20:58:01.640204] [INFO ] [MAIN ] PKE: Full history saved. [2025-10-16T20:58:01.640288] [INFO ] [MAIN ] Update Progress: 1688/2369 symbols completed. PKE took 29.2s. Estimated remaining: 1h 36m 0s. Rate: 7.1 symbols/min [2025-10-16T20:58:01.810256] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:58:01.810420] [DEBUG] [LOCAL ] PKX: No existing data file found in primary storage. [2025-10-16T20:58:01.810457] [WARN ] [MAIN ] PKX: No existing data found, performing full refresh instead. [2025-10-16T20:58:01.810570] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-16T20:58:01.810610] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-16T20:58:01.810678] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-16T20:58:01.810730] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-16T20:58:02.160103] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:58:02.342855] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-10-16T20:58:02.471950] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T20:58:03.142826] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-16T20:58:03.916979] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-16T20:58:03.942821] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-16T20:58:04.066825] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T20:58:04.376130] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T20:58:04.742813] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-16T20:58:05.542821] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-16T20:58:06.249772] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-16T20:58:06.342830] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-16T20:58:06.420219] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T20:58:06.863345] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T20:58:07.113736] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-16T20:58:07.122741] [INFO ] [REMOTE ] PK: Full fetch complete (76186 records). [2025-10-16T20:58:07.122913] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-16T20:58:07.123931] [FATAL] [VALIDATOR ] PK: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:58:07.124044] [FATAL] [MAIN ] PK: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:58:07.124100] [WARN ] [MAIN ] PK: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:58:07.124182] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-16T20:58:07.124287] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-16T20:58:07.124348] [INFO ] [LOCAL ] PK: Starting deletion of derivative data. [2025-10-16T20:58:07.124431] [DEBUG] [LOCAL ] PK: No derivative data file found to delete. [2025-10-16T20:58:07.124512] [INFO ] [MAIN ] Update Progress: 1689/2369 symbols completed. PK took 42.3s. Estimated remaining: 1h 35m 51s. Rate: 7.1 symbols/min [2025-10-16T20:58:07.150170] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-16T20:58:07.300612] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:58:07.300799] [DEBUG] [LOCAL ] PL: No existing data file found in primary storage. [2025-10-16T20:58:07.300840] [WARN ] [MAIN ] PL: No existing data found, performing full refresh instead. [2025-10-16T20:58:07.300948] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-16T20:58:07.300988] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-16T20:58:07.301028] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-16T20:58:07.301061] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-16T20:58:07.677530] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:58:07.942778] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-16T20:58:08.263149] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T20:58:08.682746] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T20:58:08.687310] [INFO ] [REMOTE ] PKG: Full fetch complete (57350 records). [2025-10-16T20:58:08.687410] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-16T20:58:08.688037] [FATAL] [VALIDATOR ] PKG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:58:08.688127] [FATAL] [MAIN ] PKG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:58:08.688171] [WARN ] [MAIN ] PKG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:58:08.688232] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-16T20:58:08.688311] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-16T20:58:08.688348] [INFO ] [LOCAL ] PKG: Starting deletion of derivative data. [2025-10-16T20:58:08.688387] [DEBUG] [LOCAL ] PKG: No derivative data file found to delete. [2025-10-16T20:58:08.688440] [INFO ] [MAIN ] Update Progress: 1690/2369 symbols completed. PKG took 34.9s. Estimated remaining: 1h 35m 39s. Rate: 7.1 symbols/min [2025-10-16T20:58:08.748201] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-16T20:58:08.869331] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:58:08.869523] [DEBUG] [LOCAL ] PLD: No existing data file found in primary storage. [2025-10-16T20:58:08.869578] [WARN ] [MAIN ] PLD: No existing data found, performing full refresh instead. [2025-10-16T20:58:08.869716] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-16T20:58:08.869765] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-16T20:58:08.869809] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-16T20:58:08.869841] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-16T20:58:09.235982] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:58:09.542823] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-10-16T20:58:10.274703] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T20:58:10.342847] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-10-16T20:58:11.142790] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-16T20:58:11.471263] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-16T20:58:11.942821] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-16T20:58:12.625441] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T20:58:12.742821] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-16T20:58:12.794940] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-16T20:58:13.542846] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-16T20:58:13.700879] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-16T20:58:14.245770] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T20:58:14.262628] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-16T20:58:14.342811] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-16T20:58:15.142859] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-16T20:58:15.942880] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-16T20:58:16.275308] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T20:58:16.627364] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-16T20:58:16.742797] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-16T20:58:17.542779] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-16T20:58:17.891290] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-16T20:58:18.342781] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-16T20:58:18.701845] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-16T20:58:18.724248] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-16T20:58:19.142842] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-16T20:58:19.360060] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T20:58:19.780055] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T20:58:19.782947] [INFO ] [REMOTE ] PKST: Full fetch complete (28908 records). [2025-10-16T20:58:19.783052] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-16T20:58:19.783561] [FATAL] [VALIDATOR ] PKST: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:58:19.783670] [FATAL] [MAIN ] PKST: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:58:19.783732] [WARN ] [MAIN ] PKST: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:58:19.783802] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-16T20:58:19.783865] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-16T20:58:19.783901] [INFO ] [LOCAL ] PKST: Starting deletion of derivative data. [2025-10-16T20:58:19.783941] [DEBUG] [LOCAL ] PKST: No derivative data file found to delete. [2025-10-16T20:58:19.783994] [INFO ] [MAIN ] Update Progress: 1691/2369 symbols completed. PKST took 38.2s. Estimated remaining: 1h 35m 32s. Rate: 7.1 symbols/min [2025-10-16T20:58:19.955380] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-16T20:58:19.959498] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:58:19.960388] [DEBUG] [LOCAL ] PLNT: No existing data file found in primary storage. [2025-10-16T20:58:19.960434] [WARN ] [MAIN ] PLNT: No existing data found, performing full refresh instead. [2025-10-16T20:58:19.960547] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-16T20:58:19.960608] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-16T20:58:19.960680] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-16T20:58:19.960735] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-16T20:58:20.320530] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:58:20.742845] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-16T20:58:21.542923] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-10-16T20:58:21.930026] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T20:58:21.965341] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T20:58:22.342842] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-16T20:58:23.102515] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T20:58:23.142848] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-16T20:58:23.616886] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-16T20:58:23.942871] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-16T20:58:24.742864] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-16T20:58:24.989396] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T20:58:25.187574] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T20:58:25.542893] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-16T20:58:26.342799] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-16T20:58:26.750216] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-16T20:58:27.142846] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-16T20:58:27.253482] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T20:58:27.619396] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T20:58:27.942879] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-16T20:58:28.515065] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T20:58:28.517994] [INFO ] [REMOTE ] PKX: Full fetch complete (36183 records). [2025-10-16T20:58:28.518089] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-16T20:58:28.518614] [FATAL] [VALIDATOR ] PKX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:58:28.518719] [FATAL] [MAIN ] PKX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:58:28.518762] [WARN ] [MAIN ] PKX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:58:28.518800] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-16T20:58:28.518856] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-16T20:58:28.518891] [INFO ] [LOCAL ] PKX: Starting deletion of derivative data. [2025-10-16T20:58:28.518935] [DEBUG] [LOCAL ] PKX: No derivative data file found to delete. [2025-10-16T20:58:28.518989] [INFO ] [MAIN ] Update Progress: 1692/2369 symbols completed. PKX took 26.9s. Estimated remaining: 1h 35m 24s. Rate: 7.1 symbols/min [2025-10-16T20:58:28.689906] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:58:28.690079] [DEBUG] [LOCAL ] PLOW: No existing data file found in primary storage. [2025-10-16T20:58:28.690126] [WARN ] [MAIN ] PLOW: No existing data found, performing full refresh instead. [2025-10-16T20:58:28.690236] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-16T20:58:28.690279] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-16T20:58:28.690359] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-16T20:58:28.690416] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-16T20:58:28.752427] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-16T20:58:29.044866] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:58:29.321162] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-16T20:58:29.542802] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-16T20:58:30.342792] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-10-16T20:58:30.627792] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T20:58:31.142831] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-16T20:58:31.580617] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T20:58:31.587087] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-16T20:58:31.942816] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-16T20:58:32.742827] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-16T20:58:32.939008] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T20:58:33.118670] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-16T20:58:33.542816] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-16T20:58:34.302343] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T20:58:34.342816] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-16T20:58:35.142815] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-16T20:58:35.386557] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T20:58:35.519545] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-16T20:58:35.942811] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-16T20:58:36.742796] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-16T20:58:37.108362] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-16T20:58:37.542805] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-16T20:58:38.225678] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-16T20:58:38.342836] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-16T20:58:38.652835] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-16T20:58:39.142855] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-16T20:58:39.631625] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-16T20:58:39.942880] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-16T20:58:40.315123] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T20:58:40.507625] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-16T20:58:40.742844] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-16T20:58:41.542828] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-16T20:58:41.599346] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T20:58:42.342804] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-16T20:58:42.514960] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T20:58:43.142804] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-16T20:58:43.629744] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T20:58:43.884507] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-16T20:58:43.942778] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-16T20:58:44.742797] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-16T20:58:44.849951] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T20:58:45.542821] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-16T20:58:46.290505] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-16T20:58:46.347901] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-16T20:58:46.357486] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T20:58:46.893202] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-16T20:58:47.142789] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-16T20:58:47.213538] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T20:58:47.219973] [INFO ] [REMOTE ] PL: Full fetch complete (76712 records). [2025-10-16T20:58:47.220103] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-16T20:58:47.221031] [FATAL] [VALIDATOR ] PL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:58:47.221121] [FATAL] [MAIN ] PL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:58:47.221163] [WARN ] [MAIN ] PL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:58:47.221230] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-16T20:58:47.221306] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-16T20:58:47.221371] [INFO ] [LOCAL ] PL: Starting deletion of derivative data. [2025-10-16T20:58:47.221440] [DEBUG] [LOCAL ] PL: No derivative data file found to delete. [2025-10-16T20:58:47.221499] [INFO ] [MAIN ] Update Progress: 1693/2369 symbols completed. PL took 40.1s. Estimated remaining: 1h 35m 19s. Rate: 7.1 symbols/min [2025-10-16T20:58:47.397631] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:58:47.397818] [DEBUG] [LOCAL ] PLYM: No existing data file found in primary storage. [2025-10-16T20:58:47.397857] [WARN ] [MAIN ] PLYM: No existing data found, performing full refresh instead. [2025-10-16T20:58:47.397977] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-16T20:58:47.398044] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-16T20:58:47.398112] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-16T20:58:47.398175] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-16T20:58:47.756175] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:58:47.910471] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-16T20:58:47.942775] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-16T20:58:48.742856] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-16T20:58:48.889539] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-16T20:58:48.895798] [INFO ] [REMOTE ] PLD: Full fetch complete (77123 records). [2025-10-16T20:58:48.895923] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-16T20:58:48.896577] [FATAL] [VALIDATOR ] PLD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:58:48.896685] [FATAL] [MAIN ] PLD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:58:48.896736] [WARN ] [MAIN ] PLD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:58:48.896796] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-16T20:58:48.896852] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-16T20:58:48.896888] [INFO ] [LOCAL ] PLD: Starting deletion of derivative data. [2025-10-16T20:58:48.896927] [DEBUG] [LOCAL ] PLD: No derivative data file found to delete. [2025-10-16T20:58:48.896981] [INFO ] [MAIN ] Update Progress: 1694/2369 symbols completed. PLD took 40.2s. Estimated remaining: 1h 35m 8s. Rate: 7.1 symbols/min [2025-10-16T20:58:49.064243] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:58:49.064419] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-10-16T20:58:49.064473] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-10-16T20:58:49.064580] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-16T20:58:49.064621] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-16T20:58:49.064704] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-16T20:58:49.064772] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-16T20:58:49.405990] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:58:49.542802] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-10-16T20:58:50.342800] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-16T20:58:50.427110] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T20:58:51.142882] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-10-16T20:58:51.670765] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-16T20:58:51.767155] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T20:58:51.942807] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-10-16T20:58:52.593039] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T20:58:52.742812] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-16T20:58:53.031883] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T20:58:53.542887] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-16T20:58:54.167726] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T20:58:54.342825] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-16T20:58:55.045792] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T20:58:55.142834] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-16T20:58:55.952610] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-16T20:58:55.954071] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T20:58:55.961213] [INFO ] [REMOTE ] PLNT: Full fetch complete (70367 records). [2025-10-16T20:58:55.961356] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-16T20:58:55.962053] [FATAL] [VALIDATOR ] PLNT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:58:55.962152] [FATAL] [MAIN ] PLNT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:58:55.962243] [WARN ] [MAIN ] PLNT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:58:55.962336] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-16T20:58:55.962547] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-16T20:58:55.962697] [INFO ] [LOCAL ] PLNT: Starting deletion of derivative data. [2025-10-16T20:58:55.962772] [DEBUG] [LOCAL ] PLNT: No derivative data file found to delete. [2025-10-16T20:58:55.962868] [INFO ] [MAIN ] Update Progress: 1695/2369 symbols completed. PLNT took 36.2s. Estimated remaining: 1h 34m 59s. Rate: 7.1 symbols/min [2025-10-16T20:58:56.144250] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:58:56.165286] [DEBUG] [LOCAL ] PML: Loaded 21800 existing records from primary storage. [2025-10-16T20:58:56.165547] [INFO ] [MAIN ] PML: Loaded 21800 existing records. [2025-10-16T20:58:56.352492] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:58:56.352724] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-16T20:58:56.352859] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-16T20:58:56.353156] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-10-16T20:58:56.353257] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-16T20:58:56.526144] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-16T20:58:56.739365] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:58:56.742763] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-10-16T20:58:57.197447] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T20:58:57.542867] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-16T20:58:58.007134] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T20:58:58.342855] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-16T20:58:59.142817] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-10-16T20:58:59.515481] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-16T20:58:59.803386] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T20:58:59.851177] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-16T20:58:59.942776] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-10. [2025-10-16T20:59:00.649678] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-16T20:59:00.651744] [INFO ] [REMOTE ] PLOW: Full fetch complete (28347 records). [2025-10-16T20:59:00.651813] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-10-16T20:59:00.652340] [FATAL] [VALIDATOR ] PLOW: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:59:00.652431] [FATAL] [MAIN ] PLOW: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:59:00.652497] [WARN ] [MAIN ] PLOW: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:59:00.652568] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-16T20:59:00.652629] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-16T20:59:00.652699] [INFO ] [LOCAL ] PLOW: Starting deletion of derivative data. [2025-10-16T20:59:00.652752] [DEBUG] [LOCAL ] PLOW: No derivative data file found to delete. [2025-10-16T20:59:00.652804] [INFO ] [MAIN ] Update Progress: 1696/2369 symbols completed. PLOW took 32.1s. Estimated remaining: 1h 34m 49s. Rate: 7.1 symbols/min [2025-10-16T20:59:00.750025] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-16T20:59:00.821341] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:59:00.832663] [DEBUG] [LOCAL ] PMM: Loaded 10233 existing records from primary storage. [2025-10-16T20:59:00.832867] [INFO ] [MAIN ] PMM: Loaded 10233 existing records. [2025-10-16T20:59:01.004898] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:59:01.005085] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-16T20:59:01.005131] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-16T20:59:01.005303] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-10-16T20:59:01.005370] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-16T20:59:01.349097] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:59:01.542767] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-10-16T20:59:02.342867] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-16T20:59:02.896877] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T20:59:03.077966] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-16T20:59:03.142765] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-16T20:59:03.243614] [DEBUG] [REMOTE ] PM: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-16T20:59:03.243847] [WARN ] [REMOTE ] PM: No data returned for month 2025-04 [2025-10-16T20:59:03.243942] [FATAL] [REMOTE ] PM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:59:03.244014] [FATAL] [MAIN ] PM: Failed to fetch primary data. [2025-10-16T20:59:03.244049] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:59:03.244086] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-16T20:59:03.244134] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-16T20:59:03.244169] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-10-16T20:59:03.244215] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-10-16T20:59:03.244259] [INFO ] [MAIN ] Update Progress: 1697/2369 symbols completed. PM took 14.3s. Estimated remaining: 1h 34m 38s. Rate: 7.1 symbols/min [2025-10-16T20:59:03.412204] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:59:03.425226] [DEBUG] [LOCAL ] PMO: Loaded 9887 existing records from primary storage. [2025-10-16T20:59:03.425539] [INFO ] [MAIN ] PMO: Loaded 9887 existing records. [2025-10-16T20:59:03.603872] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:59:03.604152] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-16T20:59:03.604205] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-16T20:59:03.604394] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-10-16T20:59:03.604457] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-16T20:59:03.772203] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T20:59:03.950120] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-16T20:59:03.971679] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:59:04.742773] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-16T20:59:04.775160] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-16T20:59:05.542865] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-16T20:59:06.031429] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T20:59:06.342782] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-10-16T20:59:07.058388] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T20:59:07.142833] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-16T20:59:07.435503] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T20:59:07.942782] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-16T20:59:08.318769] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T20:59:08.728400] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T20:59:08.742766] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-16T20:59:09.542855] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-16T20:59:09.923325] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-16T20:59:10.303001] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T20:59:10.342777] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-16T20:59:11.142825] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-16T20:59:11.306116] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T20:59:11.942790] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-16T20:59:12.360199] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T20:59:12.643001] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T20:59:12.742794] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-16T20:59:13.542818] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-16T20:59:13.801738] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-16T20:59:14.342815] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-16T20:59:14.963381] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T20:59:15.142797] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-16T20:59:15.377004] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T20:59:15.942879] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-16T20:59:16.384028] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T20:59:16.742796] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-16T20:59:16.984136] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T20:59:17.542874] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-16T20:59:17.888229] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T20:59:18.342828] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-16T20:59:19.142893] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-16T20:59:19.207994] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T20:59:19.261545] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T20:59:19.804427] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-16T20:59:19.942833] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-16T20:59:20.742815] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-16T20:59:21.168437] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-16T20:59:21.542832] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-16T20:59:21.624633] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T20:59:22.342840] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-16T20:59:23.148013] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-16T20:59:23.183772] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T20:59:23.184436] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T20:59:23.942839] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-16T20:59:24.013760] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T20:59:24.742840] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-16T20:59:24.819284] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T20:59:25.414208] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T20:59:25.419400] [INFO ] [REMOTE ] PLYM: Full fetch complete (47535 records). [2025-10-16T20:59:25.419550] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-16T20:59:25.420264] [FATAL] [VALIDATOR ] PLYM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T20:59:25.420357] [FATAL] [MAIN ] PLYM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T20:59:25.420403] [WARN ] [MAIN ] PLYM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T20:59:25.420444] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-16T20:59:25.420503] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-16T20:59:25.420544] [INFO ] [LOCAL ] PLYM: Starting deletion of derivative data. [2025-10-16T20:59:25.420587] [DEBUG] [LOCAL ] PLYM: No derivative data file found to delete. [2025-10-16T20:59:25.420678] [INFO ] [MAIN ] Update Progress: 1698/2369 symbols completed. PLYM took 38.2s. Estimated remaining: 1h 34m 35s. Rate: 7.1 symbols/min [2025-10-16T20:59:25.547974] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-16T20:59:25.602342] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:59:25.602565] [DEBUG] [LOCAL ] PMT: No existing data file found in primary storage. [2025-10-16T20:59:25.602615] [WARN ] [MAIN ] PMT: No existing data found, performing full refresh instead. [2025-10-16T20:59:25.602764] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-16T20:59:25.602808] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-16T20:59:25.602852] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-16T20:59:25.602886] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-16T20:59:25.966406] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:59:26.342850] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-16T20:59:26.904757] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T20:59:26.994496] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-16T20:59:27.142852] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-16T20:59:27.942823] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-16T20:59:28.095773] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T20:59:28.742816] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-10-16T20:59:29.322453] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T20:59:29.542800] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-16T20:59:29.902912] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T20:59:30.342789] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-16T20:59:30.653688] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T20:59:30.656983] [INFO ] [REMOTE ] PML: Full fetch complete (29770 records). [2025-10-16T20:59:30.657063] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-16T20:59:31.029811] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-16T20:59:31.029975] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-16T20:59:31.030770] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-16T20:59:31.037383] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-16T20:59:31.038463] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-16T20:59:31.041950] [DEBUG] [LOCAL ] PML: Trimmed 29770 records to 22039 (keeping 200 days of data) [2025-10-16T20:59:31.147899] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-16T20:59:31.172261] [DEBUG] [LOCAL ] PML: Primary data saved (22039 records). [2025-10-16T20:59:31.172381] [INFO ] [MAIN ] PML: Full history saved. [2025-10-16T20:59:31.172460] [INFO ] [MAIN ] Update Progress: 1699/2369 symbols completed. PML took 35.2s. Estimated remaining: 1h 34m 26s. Rate: 7.1 symbols/min [2025-10-16T20:59:31.356471] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:59:31.356681] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-16T20:59:31.356737] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-16T20:59:31.356867] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-16T20:59:31.356911] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-16T20:59:31.356952] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-16T20:59:31.356985] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-16T20:59:31.888410] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:59:31.942850] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-16T20:59:32.742783] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-16T20:59:32.895861] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T20:59:32.896590] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T20:59:33.542783] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-16T20:59:33.553438] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T20:59:33.555536] [INFO ] [REMOTE ] PMM: Full fetch complete (17835 records). [2025-10-16T20:59:33.555738] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-16T20:59:33.924668] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-16T20:59:33.924777] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-16T20:59:33.925192] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-16T20:59:33.925253] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-16T20:59:33.925850] [DEBUG] [LOCAL ] PMM: Trimmed 17835 records to 10272 (keeping 200 days of data) [2025-10-16T20:59:33.984173] [DEBUG] [LOCAL ] PMM: Primary data saved (10272 records). [2025-10-16T20:59:33.984303] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-16T20:59:33.984383] [INFO ] [MAIN ] Update Progress: 1700/2369 symbols completed. PMM took 33.3s. Estimated remaining: 1h 34m 15s. Rate: 7.1 symbols/min [2025-10-16T20:59:34.148698] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:59:34.148898] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-16T20:59:34.148936] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-16T20:59:34.149049] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-16T20:59:34.149089] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-16T20:59:34.149130] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-16T20:59:34.149162] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-16T20:59:34.348067] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-10-16T20:59:34.513046] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:59:34.921745] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T20:59:35.134961] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T20:59:35.142706] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-16T20:59:35.942825] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-10-16T20:59:36.240228] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:59:36.240520] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-10-16T20:59:36.240620] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:59:36.240710] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-16T20:59:36.240776] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:59:36.240846] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-16T20:59:36.240908] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-16T20:59:36.240942] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-16T20:59:36.240981] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-16T20:59:36.241027] [INFO ] [MAIN ] Update Progress: 1701/2369 symbols completed. PMTV took 2.3s. Estimated remaining: 1h 34m 4s. Rate: 7.1 symbols/min [2025-10-16T20:59:36.410629] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:59:36.410832] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-16T20:59:36.410882] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-16T20:59:36.410994] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-16T20:59:36.411034] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-16T20:59:36.411075] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-16T20:59:36.411107] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-16T20:59:36.756429] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:59:36.751257] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-16T20:59:36.840107] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T20:59:37.542794] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-16T20:59:37.592665] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T20:59:38.342899] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-16T20:59:39.086775] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T20:59:39.088176] [INFO ] [REMOTE ] PMO: Full fetch complete (16276 records). [2025-10-16T20:59:39.088280] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-16T20:59:39.150689] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-10-16T20:59:39.460740] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-16T20:59:39.460948] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-16T20:59:39.461395] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-16T20:59:39.461531] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-16T20:59:39.462528] [DEBUG] [LOCAL ] PMO: Trimmed 16276 records to 9927 (keeping 200 days of data) [2025-10-16T20:59:39.486209] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T20:59:39.489576] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-10-16T20:59:39.489837] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T20:59:39.489939] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-16T20:59:39.489990] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T20:59:39.514364] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-16T20:59:39.515424] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T20:59:39.544165] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-16T20:59:39.545755] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-16T20:59:39.554286] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-16T20:59:39.555370] [INFO ] [MAIN ] Update Progress: 1702/2369 symbols completed. PMTW took 3.3s. Estimated remaining: 1h 33m 54s. Rate: 7.1 symbols/min [2025-10-16T20:59:39.565122] [DEBUG] [LOCAL ] PMO: Primary data saved (9927 records). [2025-10-16T20:59:39.609227] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-16T20:59:39.646265] [INFO ] [MAIN ] Update Progress: 1703/2369 symbols completed. PMO took 36.4s. Estimated remaining: 1h 33m 42s. Rate: 7.1 symbols/min [2025-10-16T20:59:39.880988] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:59:39.915853] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-10-16T20:59:39.916980] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-10-16T20:59:39.934088] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-16T20:59:39.935112] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T20:59:39.935291] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-16T20:59:39.935759] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-16T20:59:39.935824] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-16T20:59:39.947979] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-16T20:59:40.043827] [DEBUG] [LOCAL ] PNI: Loaded 6782 existing records from primary storage. [2025-10-16T20:59:40.049900] [INFO ] [MAIN ] PNI: Loaded 6782 existing records. [2025-10-16T20:59:40.432660] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T20:59:40.435015] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-16T20:59:40.440634] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-16T20:59:40.487280] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-16T20:59:40.478721] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-10-16T20:59:40.495787] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-16T20:59:40.581154] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:59:40.750812] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-16T20:59:40.866612] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T20:59:41.285679] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-16T20:59:41.542832] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-10-16T20:59:42.342796] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-10-16T20:59:42.423250] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-16T20:59:43.142920] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-16T20:59:43.583979] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-16T20:59:43.942818] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-16T20:59:44.067240] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T20:59:44.287390] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-16T20:59:44.742808] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-16T20:59:45.542847] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-16T20:59:46.015048] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-16T20:59:46.342803] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-16T20:59:46.433280] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T20:59:47.108546] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-16T20:59:47.142827] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-16T20:59:47.924833] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T20:59:47.942777] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-16T20:59:48.742815] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-16T20:59:48.767539] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T20:59:49.542856] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-16T20:59:49.985228] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T20:59:50.286514] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T20:59:50.342798] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-16T20:59:50.755197] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-16T20:59:51.142899] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-16T20:59:51.670814] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-16T20:59:51.942833] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-16T20:59:52.742842] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-16T20:59:53.542766] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-16T20:59:53.839740] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-16T20:59:54.342834] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-16T20:59:54.595593] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T20:59:54.633989] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T20:59:55.142817] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-16T20:59:55.548837] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-16T20:59:55.942803] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-16T20:59:56.134767] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T20:59:56.742859] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-16T20:59:57.261395] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-16T20:59:57.542840] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-16T20:59:58.280538] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T20:59:58.342795] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-16T20:59:58.701400] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-16T20:59:59.142878] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-16T20:59:59.878679] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T20:59:59.905167] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T20:59:59.942776] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-16T21:00:00.728577] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T21:00:00.734230] [INFO ] [REMOTE ] PMT: Full fetch complete (58434 records). [2025-10-16T21:00:00.734345] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-16T21:00:00.735070] [FATAL] [VALIDATOR ] PMT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:00:00.735156] [FATAL] [MAIN ] PMT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:00:00.735219] [WARN ] [MAIN ] PMT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:00:00.735291] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-16T21:00:00.735355] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-16T21:00:00.735390] [INFO ] [LOCAL ] PMT: Starting deletion of derivative data. [2025-10-16T21:00:00.735428] [DEBUG] [LOCAL ] PMT: No derivative data file found to delete. [2025-10-16T21:00:00.735482] [INFO ] [MAIN ] Update Progress: 1704/2369 symbols completed. PMT took 35.3s. Estimated remaining: 1h 33m 39s. Rate: 7.1 symbols/min [2025-10-16T21:00:00.747952] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-16T21:00:00.914128] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:00:00.946690] [DEBUG] [LOCAL ] PNNT: Loaded 33478 existing records from primary storage. [2025-10-16T21:00:00.947035] [INFO ] [MAIN ] PNNT: Loaded 33478 existing records. [2025-10-16T21:00:01.129821] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:00:01.130054] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-16T21:00:01.130107] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-16T21:00:01.130335] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-10-16T21:00:01.130391] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-16T21:00:01.481356] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:00:01.542785] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-10-16T21:00:02.196423] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T21:00:02.197172] [INFO ] [REMOTE ] PMTU: Full fetch complete (1198 records). [2025-10-16T21:00:02.197244] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-16T21:00:02.350017] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-16T21:00:02.405625] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-16T21:00:02.405884] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:00:02.405978] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:00:02.406078] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-16T21:00:02.406193] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-16T21:00:02.406273] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-16T21:00:02.406375] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-16T21:00:02.406488] [INFO ] [MAIN ] Update Progress: 1705/2369 symbols completed. PMTU took 31.2s. Estimated remaining: 1h 33m 27s. Rate: 7.1 symbols/min [2025-10-16T21:00:02.628606] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:00:02.628807] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-10-16T21:00:02.628852] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-10-16T21:00:02.628989] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-16T21:00:02.629045] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-16T21:00:02.629090] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-16T21:00:02.629123] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-16T21:00:03.030533] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:00:03.142820] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-16T21:00:03.325549] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T21:00:03.612803] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-16T21:00:03.942803] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-16T21:00:04.587828] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-16T21:00:04.742848] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-10-16T21:00:05.407596] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-16T21:00:05.542812] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-16T21:00:06.342802] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-16T21:00:06.828430] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-16T21:00:07.142840] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-16T21:00:07.546314] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T21:00:07.866693] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-16T21:00:07.877068] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T21:00:07.942767] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-16T21:00:08.742795] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-16T21:00:09.542841] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-16T21:00:09.668100] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T21:00:09.669245] [INFO ] [REMOTE ] PNI: Full fetch complete (9688 records). [2025-10-16T21:00:09.669312] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-16T21:00:10.017182] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-10-16T21:00:10.017260] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-10-16T21:00:10.017448] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-10-16T21:00:10.017486] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-10-16T21:00:10.017922] [DEBUG] [LOCAL ] PNI: Trimmed 9688 records to 6853 (keeping 200 days of data) [2025-10-16T21:00:10.056241] [DEBUG] [LOCAL ] PNI: Primary data saved (6853 records). [2025-10-16T21:00:10.056323] [INFO ] [MAIN ] PNI: Full history saved. [2025-10-16T21:00:10.056394] [INFO ] [MAIN ] Update Progress: 1706/2369 symbols completed. PNI took 30.4s. Estimated remaining: 1h 33m 19s. Rate: 7.1 symbols/min [2025-10-16T21:00:10.220354] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:00:10.220488] [DEBUG] [LOCAL ] PNW: No existing data file found in primary storage. [2025-10-16T21:00:10.220524] [WARN ] [MAIN ] PNW: No existing data found, performing full refresh instead. [2025-10-16T21:00:10.220629] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-16T21:00:10.220719] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-16T21:00:10.220771] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-16T21:00:10.220819] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-16T21:00:10.353621] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-16T21:00:10.565006] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:00:11.142797] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-10-16T21:00:11.316786] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (3.37 seconds). [2025-10-16T21:00:11.749998] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-16T21:00:11.942845] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-16T21:00:12.356247] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-16T21:00:12.742797] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-16T21:00:12.801530] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T21:00:13.397772] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T21:00:13.542778] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-16T21:00:14.342755] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T21:00:14.342819] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-16T21:00:15.142837] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-16T21:00:15.447019] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-16T21:00:15.942838] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-16T21:00:16.260910] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-16T21:00:16.742791] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-16T21:00:16.941903] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T21:00:17.542831] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-16T21:00:17.910023] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T21:00:18.342838] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-16T21:00:18.637412] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T21:00:19.142801] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-16T21:00:19.188135] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T21:00:19.942837] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-16T21:00:20.214195] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T21:00:20.742783] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-16T21:00:20.774444] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T21:00:21.413854] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T21:00:21.542786] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-16T21:00:22.237140] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T21:00:22.342818] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-16T21:00:23.142843] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-16T21:00:23.184339] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T21:00:23.942855] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-16T21:00:24.359883] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T21:00:24.706048] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T21:00:24.742828] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-16T21:00:25.525711] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T21:00:25.542765] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-16T21:00:26.154849] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T21:00:26.342810] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-16T21:00:27.142789] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-16T21:00:27.165164] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T21:00:27.942831] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-16T21:00:28.324434] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T21:00:28.742859] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-16T21:00:28.926178] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T21:00:29.109997] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T21:00:29.115701] [INFO ] [REMOTE ] PNNT: Full fetch complete (47947 records). [2025-10-16T21:00:29.115886] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-16T21:00:29.359219] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-16T21:00:29.434740] [INFO ] [REMOTE ] PNC: Full fetch complete (75304 records). [2025-10-16T21:00:29.434948] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-16T21:00:29.462481] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:00:29.488912] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:00:29.496334] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:00:29.512193] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-16T21:00:29.527474] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-16T21:00:29.530328] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-10-16T21:00:29.530438] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-10-16T21:00:29.530505] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-10-16T21:00:29.531677] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-10-16T21:00:29.530692] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-10-16T21:00:29.531810] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-10-16T21:00:29.531946] [INFO ] [MAIN ] Update Progress: 1707/2369 symbols completed. PNC took 50.0s. Estimated remaining: 1h 33m 15s. Rate: 7.1 symbols/min [2025-10-16T21:00:29.543801] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-16T21:00:29.639957] [DEBUG] [LOCAL ] PNNT: Trimmed 47947 records to 33703 (keeping 200 days of data) [2025-10-16T21:00:29.771825] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:00:29.772108] [DEBUG] [LOCAL ] POR: No existing data file found in primary storage. [2025-10-16T21:00:29.772171] [WARN ] [MAIN ] POR: No existing data found, performing full refresh instead. [2025-10-16T21:00:29.797499] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-16T21:00:29.797575] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-16T21:00:29.797970] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-16T21:00:29.798562] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-16T21:00:30.263777] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:00:30.282417] [DEBUG] [LOCAL ] PNNT: Primary data saved (33703 records). [2025-10-16T21:00:30.282505] [INFO ] [MAIN ] PNNT: Full history saved. [2025-10-16T21:00:30.282572] [INFO ] [MAIN ] Update Progress: 1708/2369 symbols completed. PNNT took 29.5s. Estimated remaining: 1h 33m 3s. Rate: 7.1 symbols/min [2025-10-16T21:00:30.344837] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-16T21:00:30.451865] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:00:30.452064] [DEBUG] [LOCAL ] POST: No existing data file found in primary storage. [2025-10-16T21:00:30.452136] [WARN ] [MAIN ] POST: No existing data found, performing full refresh instead. [2025-10-16T21:00:30.452337] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-16T21:00:30.452474] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-16T21:00:30.452603] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-16T21:00:30.452789] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-16T21:00:30.597051] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T21:00:30.638101] [INFO ] [REMOTE ] PNR: Full fetch complete (69235 records). [2025-10-16T21:00:30.653760] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-16T21:00:30.689389] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:00:30.726693] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:00:30.732152] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:00:30.737355] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-16T21:00:30.755505] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-16T21:00:30.757742] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-10-16T21:00:30.763372] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-10-16T21:00:30.768597] [INFO ] [MAIN ] Update Progress: 1709/2369 symbols completed. PNR took 28.4s. Estimated remaining: 1h 32m 52s. Rate: 7.1 symbols/min [2025-10-16T21:00:30.963315] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:00:31.026224] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:00:31.026396] [DEBUG] [LOCAL ] PPG: No existing data file found in primary storage. [2025-10-16T21:00:31.026433] [WARN ] [MAIN ] PPG: No existing data found, performing full refresh instead. [2025-10-16T21:00:31.026571] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-16T21:00:31.026626] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-16T21:00:31.026709] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-16T21:00:31.026750] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-16T21:00:31.147890] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-10-16T21:00:31.371227] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:00:31.942808] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-10-16T21:00:32.310093] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-16T21:00:32.490527] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T21:00:32.742788] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-10-16T21:00:33.099814] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T21:00:33.542795] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-16T21:00:34.342792] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-16T21:00:34.544947] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-16T21:00:34.839415] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-16T21:00:34.952400] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T21:00:35.142807] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-16T21:00:35.942811] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-16T21:00:36.742854] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-16T21:00:36.910126] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T21:00:36.946974] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T21:00:37.542856] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-16T21:00:38.288315] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T21:00:38.342775] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-16T21:00:39.142837] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-16T21:00:39.228322] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T21:00:39.942791] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-16T21:00:40.046753] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T21:00:40.742781] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-16T21:00:40.827165] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T21:00:41.115394] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T21:00:41.542826] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-16T21:00:42.279744] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T21:00:42.342781] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-16T21:00:42.447698] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T21:00:43.142828] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-16T21:00:43.942860] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-16T21:00:44.127215] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T21:00:44.742886] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-16T21:00:44.827606] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T21:00:45.542794] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-16T21:00:45.879396] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T21:00:46.293962] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T21:00:46.342818] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-16T21:00:47.142827] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-16T21:00:47.267570] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T21:00:47.328840] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T21:00:47.942814] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-16T21:00:48.742840] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-16T21:00:48.795422] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T21:00:48.900589] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T21:00:49.542868] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-16T21:00:50.289328] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T21:00:50.342783] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-16T21:00:51.142788] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-16T21:00:51.631818] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-16T21:00:51.942851] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-16T21:00:52.147701] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-16T21:00:52.742798] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-16T21:00:52.919549] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-16T21:00:52.991108] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T21:00:53.542908] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-16T21:00:54.344211] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-16T21:00:54.350017] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T21:00:55.142823] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-16T21:00:55.185967] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T21:00:55.193610] [INFO ] [REMOTE ] PNW: Full fetch complete (65762 records). [2025-10-16T21:00:55.193826] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-16T21:00:55.194701] [FATAL] [VALIDATOR ] PNW: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:00:55.194805] [FATAL] [MAIN ] PNW: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:00:55.194884] [WARN ] [MAIN ] PNW: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:00:55.194970] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-16T21:00:55.195050] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-16T21:00:55.195099] [INFO ] [LOCAL ] PNW: Starting deletion of derivative data. [2025-10-16T21:00:55.195154] [DEBUG] [LOCAL ] PNW: No derivative data file found to delete. [2025-10-16T21:00:55.195229] [INFO ] [MAIN ] Update Progress: 1710/2369 symbols completed. PNW took 45.1s. Estimated remaining: 1h 32m 49s. Rate: 7.1 symbols/min [2025-10-16T21:00:55.380068] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:00:55.380279] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-10-16T21:00:55.380348] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-10-16T21:00:55.380565] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-16T21:00:55.380635] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-16T21:00:55.380777] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-16T21:00:55.380832] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-16T21:00:55.674380] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-16T21:00:55.787333] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:00:55.942841] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-10-16T21:00:56.680298] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T21:00:56.742829] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-16T21:00:57.550047] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-16T21:00:57.572313] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-16T21:00:57.876962] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-16T21:00:58.342830] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-16T21:00:59.142847] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-16T21:00:59.344358] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T21:00:59.929468] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T21:00:59.942770] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-16T21:01:00.367927] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T21:01:00.742788] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-16T21:01:01.542786] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-16T21:01:01.639943] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T21:01:01.750227] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-16T21:01:01.754571] [INFO ] [REMOTE ] POST: Full fetch complete (55326 records). [2025-10-16T21:01:01.754710] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-16T21:01:01.755347] [FATAL] [VALIDATOR ] POST: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:01:01.755446] [FATAL] [MAIN ] POST: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:01:01.755521] [WARN ] [MAIN ] POST: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:01:01.755611] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-16T21:01:01.755718] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-16T21:01:01.755764] [INFO ] [LOCAL ] POST: Starting deletion of derivative data. [2025-10-16T21:01:01.755805] [DEBUG] [LOCAL ] POST: No derivative data file found to delete. [2025-10-16T21:01:01.755859] [INFO ] [MAIN ] Update Progress: 1711/2369 symbols completed. POST took 31.5s. Estimated remaining: 1h 32m 40s. Rate: 7.1 symbols/min [2025-10-16T21:01:01.926659] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:01:01.945278] [DEBUG] [LOCAL ] PPT: Loaded 19872 existing records from primary storage. [2025-10-16T21:01:01.945521] [INFO ] [MAIN ] PPT: Loaded 19872 existing records. [2025-10-16T21:01:02.116699] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:01:02.116923] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-16T21:01:02.116981] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-16T21:01:02.117163] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-10-16T21:01:02.117221] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-16T21:01:02.349790] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-16T21:01:02.464659] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:01:03.142801] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-10-16T21:01:03.471603] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T21:01:03.942872] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-16T21:01:04.446985] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T21:01:04.531466] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-16T21:01:04.742887] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-16T21:01:04.749444] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T21:01:04.756217] [INFO ] [REMOTE ] PPG: Full fetch complete (73655 records). [2025-10-16T21:01:04.756381] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-16T21:01:04.757219] [FATAL] [VALIDATOR ] PPG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:01:04.757320] [FATAL] [MAIN ] PPG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:01:04.757471] [WARN ] [MAIN ] PPG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:01:04.757562] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-16T21:01:04.757639] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-16T21:01:04.757734] [INFO ] [LOCAL ] PPG: Starting deletion of derivative data. [2025-10-16T21:01:04.757782] [DEBUG] [LOCAL ] PPG: No derivative data file found to delete. [2025-10-16T21:01:04.757839] [INFO ] [MAIN ] Update Progress: 1712/2369 symbols completed. PPG took 34.0s. Estimated remaining: 1h 32m 30s. Rate: 7.1 symbols/min [2025-10-16T21:01:04.937348] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:01:04.937566] [DEBUG] [LOCAL ] PR: No existing data file found in primary storage. [2025-10-16T21:01:04.937610] [WARN ] [MAIN ] PR: No existing data found, performing full refresh instead. [2025-10-16T21:01:04.937785] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-16T21:01:04.937858] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-16T21:01:04.937918] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-16T21:01:04.937953] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-16T21:01:05.300061] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:01:05.542823] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-10-16T21:01:06.342845] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-16T21:01:06.839762] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-16T21:01:07.142882] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-16T21:01:07.514430] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-16T21:01:07.942890] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-16T21:01:08.250627] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T21:01:08.270289] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T21:01:08.742825] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-16T21:01:09.546005] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-16T21:01:09.553675] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T21:01:10.342804] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-16T21:01:10.494149] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T21:01:11.142826] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-16T21:01:11.656459] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-16T21:01:11.951163] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-16T21:01:11.953561] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T21:01:11.959632] [INFO ] [REMOTE ] POR: Full fetch complete (68126 records). [2025-10-16T21:01:11.959814] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-16T21:01:11.960571] [FATAL] [VALIDATOR ] POR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:01:11.960694] [FATAL] [MAIN ] POR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:01:11.960792] [WARN ] [MAIN ] POR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:01:11.960878] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-16T21:01:11.960958] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-16T21:01:11.961010] [INFO ] [LOCAL ] POR: Starting deletion of derivative data. [2025-10-16T21:01:11.961064] [DEBUG] [LOCAL ] POR: No derivative data file found to delete. [2025-10-16T21:01:11.961140] [INFO ] [MAIN ] Update Progress: 1713/2369 symbols completed. POR took 42.4s. Estimated remaining: 1h 32m 21s. Rate: 7.1 symbols/min [2025-10-16T21:01:12.136803] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:01:12.136995] [DEBUG] [LOCAL ] PRA: No existing data file found in primary storage. [2025-10-16T21:01:12.137038] [WARN ] [MAIN ] PRA: No existing data found, performing full refresh instead. [2025-10-16T21:01:12.137145] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-16T21:01:12.137186] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-16T21:01:12.137228] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-16T21:01:12.137259] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-16T21:01:12.475402] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-16T21:01:12.540900] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:01:12.742808] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-10-16T21:01:13.542828] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-16T21:01:13.849666] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-16T21:01:13.899869] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T21:01:14.342824] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-16T21:01:14.649187] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T21:01:15.142826] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-16T21:01:15.478156] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T21:01:15.942813] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-16T21:01:16.093381] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T21:01:16.742876] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-16T21:01:17.542906] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-16T21:01:18.236247] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-16T21:01:18.342845] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-16T21:01:18.546760] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T21:01:18.968585] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-16T21:01:19.142843] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-16T21:01:19.942884] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-16T21:01:20.279454] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-16T21:01:20.742837] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-16T21:01:21.083471] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-16T21:01:21.244476] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-16T21:01:21.542878] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-16T21:01:22.342852] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-16T21:01:22.387018] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T21:01:22.762873] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T21:01:23.142818] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-16T21:01:23.932777] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T21:01:23.939681] [INFO ] [REMOTE ] PPL: Full fetch complete (77214 records). [2025-10-16T21:01:23.939817] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-16T21:01:23.940566] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:01:23.940680] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:01:23.940735] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:01:23.940804] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-16T21:01:23.940869] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-16T21:01:23.940905] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-10-16T21:01:23.940944] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-10-16T21:01:23.941001] [INFO ] [MAIN ] Update Progress: 1714/2369 symbols completed. PPL took 28.7s. Estimated remaining: 1h 32m 14s. Rate: 7.1 symbols/min [2025-10-16T21:01:23.952448] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-16T21:01:24.126364] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:01:24.133138] [DEBUG] [LOCAL ] PRCS: Loaded 2781 existing records from primary storage. [2025-10-16T21:01:24.133494] [INFO ] [MAIN ] PRCS: Loaded 2781 existing records. [2025-10-16T21:01:24.378790] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:01:24.379232] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-16T21:01:24.379303] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-16T21:01:24.379583] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-10-16T21:01:24.379699] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-16T21:01:24.698130] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-16T21:01:24.748257] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-16T21:01:24.829378] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:01:25.270404] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T21:01:25.542782] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-10-16T21:01:25.777748] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T21:01:26.094050] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-16T21:01:26.342865] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-16T21:01:26.978454] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-16T21:01:27.142824] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-16T21:01:27.942813] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-16T21:01:28.609053] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T21:01:28.742808] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-16T21:01:28.849858] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T21:01:29.542834] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-16T21:01:30.342817] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-16T21:01:30.577775] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T21:01:30.600101] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T21:01:31.142826] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-16T21:01:31.942830] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-16T21:01:32.111173] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T21:01:32.113588] [INFO ] [REMOTE ] PPT: Full fetch complete (28505 records). [2025-10-16T21:01:32.113701] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-16T21:01:32.523920] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-16T21:01:32.579295] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-16T21:01:32.579797] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-16T21:01:32.581308] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-16T21:01:32.581393] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-16T21:01:32.582457] [DEBUG] [LOCAL ] PPT: Trimmed 28505 records to 19948 (keeping 200 days of data) [2025-10-16T21:01:32.701141] [DEBUG] [LOCAL ] PPT: Primary data saved (19948 records). [2025-10-16T21:01:32.701297] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-16T21:01:32.701391] [INFO ] [MAIN ] Update Progress: 1715/2369 symbols completed. PPT took 30.9s. Estimated remaining: 1h 32m 5s. Rate: 7.1 symbols/min [2025-10-16T21:01:32.747988] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-16T21:01:32.874160] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:01:32.874359] [DEBUG] [LOCAL ] PRG: No existing data file found in primary storage. [2025-10-16T21:01:32.874396] [WARN ] [MAIN ] PRG: No existing data found, performing full refresh instead. [2025-10-16T21:01:32.874508] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-16T21:01:32.874549] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-16T21:01:32.874588] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-16T21:01:32.874620] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-16T21:01:33.251499] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:01:33.350368] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T21:01:33.542872] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-16T21:01:33.582431] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T21:01:34.295462] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-16T21:01:34.342831] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-16T21:01:35.006673] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-16T21:01:35.142908] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-10-16T21:01:35.942837] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-16T21:01:36.553725] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T21:01:36.742855] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-16T21:01:37.542841] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-16T21:01:38.029147] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-16T21:01:38.080582] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T21:01:38.342812] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-16T21:01:38.982942] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T21:01:39.142821] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-16T21:01:39.546435] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T21:01:39.789708] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-16T21:01:39.942790] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-16T21:01:40.742809] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-16T21:01:41.481928] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T21:01:41.542792] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-16T21:01:42.342787] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-16T21:01:42.895740] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-16T21:01:43.096188] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T21:01:43.142844] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-16T21:01:43.607783] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-16T21:01:43.942819] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-16T21:01:44.701730] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T21:01:44.742829] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-16T21:01:45.542832] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-16T21:01:46.088283] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T21:01:46.151083] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-16T21:01:46.342810] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-16T21:01:46.624135] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-16T21:01:46.837480] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-16T21:01:47.142819] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-16T21:01:47.581170] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-16T21:01:47.587798] [INFO ] [REMOTE ] PR: Full fetch complete (77373 records). [2025-10-16T21:01:47.587921] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-16T21:01:47.588765] [FATAL] [VALIDATOR ] PR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:01:47.588864] [FATAL] [MAIN ] PR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:01:47.588923] [WARN ] [MAIN ] PR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:01:47.588966] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-16T21:01:47.589025] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-16T21:01:47.589082] [INFO ] [LOCAL ] PR: Starting deletion of derivative data. [2025-10-16T21:01:47.589149] [DEBUG] [LOCAL ] PR: No derivative data file found to delete. [2025-10-16T21:01:47.589208] [INFO ] [MAIN ] Update Progress: 1716/2369 symbols completed. PR took 42.8s. Estimated remaining: 1h 31m 59s. Rate: 7.1 symbols/min [2025-10-16T21:01:47.759851] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:01:47.760008] [DEBUG] [LOCAL ] PRGO: No existing data file found in primary storage. [2025-10-16T21:01:47.760044] [WARN ] [MAIN ] PRGO: No existing data found, performing full refresh instead. [2025-10-16T21:01:47.760152] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-16T21:01:47.760192] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-16T21:01:47.760232] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-16T21:01:47.760262] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-16T21:01:47.951973] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-16T21:01:48.119349] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:01:48.657039] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-16T21:01:48.742878] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-10-16T21:01:49.542811] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-16T21:01:50.342789] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-16T21:01:50.450845] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T21:01:50.537617] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T21:01:50.797367] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T21:01:51.142888] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-16T21:01:51.691466] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-16T21:01:51.942885] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-16T21:01:52.563415] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-16T21:01:52.564381] [INFO ] [REMOTE ] PRCS: Full fetch complete (3895 records). [2025-10-16T21:01:52.564453] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-16T21:01:52.748396] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-16T21:01:52.926034] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-16T21:01:52.926149] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-16T21:01:52.926293] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-16T21:01:52.926334] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-16T21:01:52.926704] [DEBUG] [LOCAL ] PRCS: Trimmed 3895 records to 2807 (keeping 200 days of data) [2025-10-16T21:01:52.942921] [DEBUG] [LOCAL ] PRCS: Primary data saved (2807 records). [2025-10-16T21:01:52.942985] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-16T21:01:52.943050] [INFO ] [MAIN ] Update Progress: 1717/2369 symbols completed. PRCS took 29.0s. Estimated remaining: 1h 31m 50s. Rate: 7.1 symbols/min [2025-10-16T21:01:53.542831] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-16T21:01:54.104447] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T21:01:54.342849] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-16T21:01:55.051555] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T21:01:55.142790] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-16T21:01:55.175365] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T21:01:55.179664] [INFO ] [REMOTE ] PRA: Full fetch complete (44664 records). [2025-10-16T21:01:55.179750] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-16T21:01:55.180318] [FATAL] [VALIDATOR ] PRA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:01:55.180440] [FATAL] [MAIN ] PRA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:01:55.180518] [WARN ] [MAIN ] PRA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:01:55.180615] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-16T21:01:55.180724] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-16T21:01:55.180775] [INFO ] [LOCAL ] PRA: Starting deletion of derivative data. [2025-10-16T21:01:55.180816] [DEBUG] [LOCAL ] PRA: No derivative data file found to delete. [2025-10-16T21:01:55.180873] [INFO ] [MAIN ] Update Progress: 1718/2369 symbols completed. PRA took 43.2s. Estimated remaining: 1h 31m 39s. Rate: 7.1 symbols/min [2025-10-16T21:01:55.942825] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-16T21:01:56.501915] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T21:01:56.742821] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-16T21:01:57.572964] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T21:01:57.577426] [INFO ] [REMOTE ] PRG: Full fetch complete (44119 records). [2025-10-16T21:01:57.577564] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-16T21:01:57.593035] [FATAL] [VALIDATOR ] PRG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:01:57.603156] [FATAL] [MAIN ] PRG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:01:57.603391] [WARN ] [MAIN ] PRG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:01:57.604830] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T21:01:57.603837] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-16T21:01:57.613712] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-16T21:01:57.613913] [INFO ] [LOCAL ] PRG: Starting deletion of derivative data. [2025-10-16T21:01:57.614528] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-16T21:01:57.614591] [DEBUG] [LOCAL ] PRG: No derivative data file found to delete. [2025-10-16T21:01:57.615405] [INFO ] [MAIN ] Update Progress: 1719/2369 symbols completed. PRG took 24.9s. Estimated remaining: 1h 31m 28s. Rate: 7.1 symbols/min [2025-10-16T21:01:59.314114] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T21:01:59.323239] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-16T21:02:01.317242] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-16T21:02:01.329618] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-16T21:02:03.236006] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-16T21:02:03.247146] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-16T21:02:04.657126] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T21:02:04.667493] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-16T21:02:06.183997] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T21:02:06.194498] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-16T21:02:07.928065] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T21:02:07.938349] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-16T21:02:09.874425] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-16T21:02:09.884511] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-16T21:02:11.721966] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T21:02:11.732841] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-16T21:02:12.674490] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T21:02:12.680541] [INFO ] [REMOTE ] PRGO: Full fetch complete (68474 records). [2025-10-16T21:02:12.680681] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-16T21:02:12.681435] [FATAL] [VALIDATOR ] PRGO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:02:12.681525] [FATAL] [MAIN ] PRGO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:02:12.681624] [WARN ] [MAIN ] PRGO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:02:12.681725] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-16T21:02:12.681802] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-16T21:02:12.681850] [INFO ] [LOCAL ] PRGO: Starting deletion of derivative data. [2025-10-16T21:02:12.681906] [DEBUG] [LOCAL ] PRGO: No derivative data file found to delete. [2025-10-16T21:02:12.681977] [INFO ] [MAIN ] Update Progress: 1720/2369 symbols completed. PRGO took 25.1s. Estimated remaining: 1h 31m 22s. Rate: 7.1 symbols/min [2025-10-16T21:02:13.304133] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:02:13.334255] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:02:13.351516] [DEBUG] [LOCAL ] PRKS: No existing data file found in primary storage. [2025-10-16T21:02:13.356890] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:02:13.357328] [DEBUG] [LOCAL ] PRI: No existing data file found in primary storage. [2025-10-16T21:02:13.375019] [WARN ] [MAIN ] PRI: No existing data found, performing full refresh instead. [2025-10-16T21:02:13.380782] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-16T21:02:13.380837] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-16T21:02:13.380886] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-16T21:02:13.380920] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-16T21:02:13.406866] [DEBUG] [LOCAL ] PRH: Loaded 4757 existing records from primary storage. [2025-10-16T21:02:13.368221] [WARN ] [MAIN ] PRKS: No existing data found, performing full refresh instead. [2025-10-16T21:02:13.426846] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-16T21:02:13.438844] [INFO ] [MAIN ] PRH: Loaded 4757 existing records. [2025-10-16T21:02:13.533192] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:02:13.462751] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-16T21:02:13.548038] [DEBUG] [LOCAL ] PRIM: No existing data file found in primary storage. [2025-10-16T21:02:13.563726] [WARN ] [MAIN ] PRIM: No existing data found, performing full refresh instead. [2025-10-16T21:02:13.574349] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-16T21:02:13.620197] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-16T21:02:13.630581] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-16T21:02:13.630873] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-16T21:02:13.647701] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-16T21:02:13.698135] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-16T21:02:14.157068] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:02:14.178115] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-16T21:02:14.209482] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-16T21:02:14.279085] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-10-16T21:02:14.385332] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-16T21:02:14.635910] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:02:14.683296] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-10-16T21:02:14.861710] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:02:14.896386] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-10-16T21:02:15.096942] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:02:15.121260] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-10-16T21:02:15.213159] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:02:15.213476] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-10-16T21:02:15.931320] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-16T21:02:15.935134] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-16T21:02:15.993189] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-16T21:02:15.995151] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-16T21:02:16.240444] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T21:02:16.248173] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-16T21:02:16.816900] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T21:02:16.819519] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-16T21:02:16.846934] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T21:02:16.855547] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-16T21:02:17.051399] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T21:02:17.055688] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-16T21:02:17.770539] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T21:02:17.772714] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-16T21:02:17.830606] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T21:02:17.841608] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-16T21:02:18.087769] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-16T21:02:18.097936] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-16T21:02:18.279184] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T21:02:18.283297] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-16T21:02:18.371724] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T21:02:18.373493] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-16T21:02:19.229069] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T21:02:19.231337] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-16T21:02:19.552859] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T21:02:19.563000] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-16T21:02:19.599635] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T21:02:19.601166] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T21:02:19.614819] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-16T21:02:19.615700] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-16T21:02:20.037201] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T21:02:20.039523] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-16T21:02:20.824143] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T21:02:20.825857] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-16T21:02:20.900214] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T21:02:21.209075] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T21:02:21.255073] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-16T21:02:21.451299] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T21:02:21.542859] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-16T21:02:22.342846] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-16T21:02:22.615402] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-16T21:02:23.142016] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-16T21:02:23.143538] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-16T21:02:23.942813] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-16T21:02:24.742854] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-16T21:02:25.066918] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T21:02:25.410941] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-16T21:02:25.542833] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-16T21:02:25.844370] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T21:02:26.342822] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-16T21:02:26.672278] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T21:02:27.142813] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-16T21:02:27.942825] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-16T21:02:28.131737] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T21:02:28.132838] [INFO ] [REMOTE ] PRH: Full fetch complete (7474 records). [2025-10-16T21:02:28.132912] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-16T21:02:28.398444] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-16T21:02:28.632574] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-10-16T21:02:28.632685] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-10-16T21:02:28.632911] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-10-16T21:02:28.632952] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-10-16T21:02:28.633351] [DEBUG] [LOCAL ] PRH: Trimmed 7474 records to 4774 (keeping 200 days of data) [2025-10-16T21:02:28.662134] [DEBUG] [LOCAL ] PRH: Primary data saved (4774 records). [2025-10-16T21:02:28.662242] [INFO ] [MAIN ] PRH: Full history saved. [2025-10-16T21:02:28.662319] [INFO ] [MAIN ] Update Progress: 1721/2369 symbols completed. PRH took 16.0s. Estimated remaining: 1h 31m 17s. Rate: 7.1 symbols/min [2025-10-16T21:02:28.747950] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-16T21:02:28.836782] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:02:28.836932] [DEBUG] [LOCAL ] PRLB: No existing data file found in primary storage. [2025-10-16T21:02:28.836989] [WARN ] [MAIN ] PRLB: No existing data found, performing full refresh instead. [2025-10-16T21:02:28.837129] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-16T21:02:28.837189] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-16T21:02:28.837253] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-16T21:02:28.837304] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-16T21:02:29.211811] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:02:29.538006] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T21:02:29.546923] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-10-16T21:02:30.082047] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T21:02:30.342894] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-16T21:02:30.908594] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T21:02:31.142870] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-16T21:02:31.943071] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-16T21:02:32.024320] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T21:02:32.723026] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T21:02:32.742795] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-16T21:02:32.778814] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T21:02:33.542816] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-16T21:02:34.342831] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-16T21:02:34.373879] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T21:02:34.562739] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-16T21:02:35.142872] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-16T21:02:35.636757] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T21:02:35.942804] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-16T21:02:36.261590] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T21:02:36.742840] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-16T21:02:37.397609] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-16T21:02:37.401220] [INFO ] [REMOTE ] PRI: Full fetch complete (25410 records). [2025-10-16T21:02:37.401348] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-16T21:02:37.401996] [FATAL] [VALIDATOR ] PRI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:02:37.402096] [FATAL] [MAIN ] PRI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:02:37.402177] [WARN ] [MAIN ] PRI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:02:37.402263] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-16T21:02:37.402349] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-16T21:02:37.402420] [INFO ] [LOCAL ] PRI: Starting deletion of derivative data. [2025-10-16T21:02:37.402479] [DEBUG] [LOCAL ] PRI: No derivative data file found to delete. [2025-10-16T21:02:37.402556] [INFO ] [MAIN ] Update Progress: 1722/2369 symbols completed. PRI took 24.7s. Estimated remaining: 1h 31m 8s. Rate: 7.1 symbols/min [2025-10-16T21:02:37.556546] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-16T21:02:37.591721] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:02:37.591979] [DEBUG] [LOCAL ] PRM: No existing data file found in primary storage. [2025-10-16T21:02:37.592076] [WARN ] [MAIN ] PRM: No existing data found, performing full refresh instead. [2025-10-16T21:02:37.592203] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-16T21:02:37.592246] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-16T21:02:37.592289] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-16T21:02:37.592321] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-16T21:02:37.936899] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-16T21:02:38.021183] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:02:38.342834] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-16T21:02:39.142878] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-10-16T21:02:39.289367] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T21:02:39.942833] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-16T21:02:40.030445] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T21:02:40.651887] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T21:02:40.742814] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-16T21:02:41.542781] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-16T21:02:41.825709] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T21:02:42.228907] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T21:02:42.234983] [INFO ] [REMOTE ] PRKS: Full fetch complete (61545 records). [2025-10-16T21:02:42.235131] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-16T21:02:42.235937] [FATAL] [VALIDATOR ] PRKS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:02:42.236029] [FATAL] [MAIN ] PRKS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:02:42.236072] [WARN ] [MAIN ] PRKS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:02:42.236111] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-16T21:02:42.236166] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-16T21:02:42.236202] [INFO ] [LOCAL ] PRKS: Starting deletion of derivative data. [2025-10-16T21:02:42.236241] [DEBUG] [LOCAL ] PRKS: No derivative data file found to delete. [2025-10-16T21:02:42.236297] [INFO ] [MAIN ] Update Progress: 1723/2369 symbols completed. PRKS took 29.6s. Estimated remaining: 1h 30m 58s. Rate: 7.1 symbols/min [2025-10-16T21:02:42.346836] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-16T21:02:42.421469] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:02:42.421849] [DEBUG] [LOCAL ] PRMB: No existing data file found in primary storage. [2025-10-16T21:02:42.421997] [WARN ] [MAIN ] PRMB: No existing data found, performing full refresh instead. [2025-10-16T21:02:42.422125] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-16T21:02:42.422282] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-16T21:02:42.422394] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-16T21:02:42.422462] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-16T21:02:42.604039] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T21:02:42.808099] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:02:43.142825] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-10-16T21:02:43.531377] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T21:02:43.942847] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-16T21:02:44.742899] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-16T21:02:44.937244] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T21:02:45.542925] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-16T21:02:45.664474] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T21:02:45.956007] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T21:02:46.342821] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-16T21:02:47.142837] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-16T21:02:47.504122] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-16T21:02:47.527560] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T21:02:47.942813] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-16T21:02:48.742831] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-16T21:02:48.937008] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T21:02:49.035624] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T21:02:49.542825] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-16T21:02:50.342862] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-16T21:02:50.504979] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-16T21:02:51.142855] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-16T21:02:51.442472] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T21:02:51.621621] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-16T21:02:51.942872] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-16T21:02:52.666118] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T21:02:52.742778] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-16T21:02:53.469284] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T21:02:53.542792] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-16T21:02:54.301366] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T21:02:54.342791] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-16T21:02:54.380160] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T21:02:54.385571] [INFO ] [REMOTE ] PRIM: Full fetch complete (63509 records). [2025-10-16T21:02:54.385741] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-16T21:02:54.386594] [FATAL] [VALIDATOR ] PRIM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:02:54.386712] [FATAL] [MAIN ] PRIM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:02:54.386758] [WARN ] [MAIN ] PRIM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:02:54.386826] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-16T21:02:54.386890] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-16T21:02:54.386928] [INFO ] [LOCAL ] PRIM: Starting deletion of derivative data. [2025-10-16T21:02:54.386968] [DEBUG] [LOCAL ] PRIM: No derivative data file found to delete. [2025-10-16T21:02:54.387024] [INFO ] [MAIN ] Update Progress: 1724/2369 symbols completed. PRIM took 41.7s. Estimated remaining: 1h 30m 51s. Rate: 7.1 symbols/min [2025-10-16T21:02:54.566118] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:02:54.566281] [DEBUG] [LOCAL ] PRO: No existing data file found in primary storage. [2025-10-16T21:02:54.566318] [WARN ] [MAIN ] PRO: No existing data found, performing full refresh instead. [2025-10-16T21:02:54.566433] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-16T21:02:54.566475] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-16T21:02:54.566516] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-16T21:02:54.566548] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-16T21:02:54.930384] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:02:55.142799] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-10-16T21:02:55.942772] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-16T21:02:56.226542] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T21:02:56.545116] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T21:02:56.742837] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-16T21:02:57.542830] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-16T21:02:57.592614] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T21:02:57.666635] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T21:02:58.342865] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-16T21:02:58.805433] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T21:02:59.142823] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-16T21:02:59.845115] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T21:02:59.942851] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-16T21:03:00.331449] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-16T21:03:00.742854] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-16T21:03:01.542879] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-16T21:03:01.846806] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T21:03:02.140210] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T21:03:02.342891] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-16T21:03:03.014735] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T21:03:03.142845] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-16T21:03:03.942793] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-16T21:03:03.990081] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T21:03:03.992733] [INFO ] [REMOTE ] PRLB: Full fetch complete (30141 records). [2025-10-16T21:03:03.992868] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-16T21:03:03.993395] [FATAL] [VALIDATOR ] PRLB: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:03:03.993500] [FATAL] [MAIN ] PRLB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:03:03.993563] [WARN ] [MAIN ] PRLB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:03:03.993633] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-16T21:03:03.993738] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-16T21:03:03.993781] [INFO ] [LOCAL ] PRLB: Starting deletion of derivative data. [2025-10-16T21:03:03.993822] [DEBUG] [LOCAL ] PRLB: No derivative data file found to delete. [2025-10-16T21:03:03.993879] [INFO ] [MAIN ] Update Progress: 1725/2369 symbols completed. PRLB took 35.3s. Estimated remaining: 1h 30m 43s. Rate: 7.1 symbols/min [2025-10-16T21:03:04.196306] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:03:04.196490] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-10-16T21:03:04.196600] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-10-16T21:03:04.196816] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-16T21:03:04.196907] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-16T21:03:04.196976] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-16T21:03:04.197012] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-16T21:03:04.512808] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-16T21:03:04.600134] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:03:04.742788] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-10-16T21:03:05.231974] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:03:05.232283] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-10-16T21:03:05.232374] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:03:05.232421] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-10-16T21:03:05.232481] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:03:05.232552] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-16T21:03:05.232613] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-16T21:03:05.232677] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-10-16T21:03:05.232739] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-10-16T21:03:05.232786] [INFO ] [MAIN ] Update Progress: 1726/2369 symbols completed. PRSU took 1.2s. Estimated remaining: 1h 30m 32s. Rate: 7.1 symbols/min [2025-10-16T21:03:05.423371] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T21:03:05.425708] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:03:05.439400] [DEBUG] [LOCAL ] PRT: Loaded 5170 existing records from primary storage. [2025-10-16T21:03:05.439603] [INFO ] [MAIN ] PRT: Loaded 5170 existing records. [2025-10-16T21:03:05.547900] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-16T21:03:05.621682] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:03:05.621913] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-16T21:03:05.621963] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-16T21:03:05.622096] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-10-16T21:03:05.622135] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-16T21:03:05.985751] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:03:06.342815] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-16T21:03:07.142820] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-16T21:03:07.724402] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-16T21:03:07.942793] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-16T21:03:08.137969] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T21:03:08.747877] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-16T21:03:08.760294] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T21:03:09.542776] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-16T21:03:10.002416] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-16T21:03:10.342813] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-16T21:03:10.642830] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-16T21:03:11.142791] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-10-16T21:03:11.183109] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T21:03:11.947883] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-16T21:03:11.966190] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T21:03:12.169527] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T21:03:12.511948] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-16T21:03:12.517725] [INFO ] [REMOTE ] PRM: Full fetch complete (64268 records). [2025-10-16T21:03:12.517898] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-16T21:03:12.518776] [FATAL] [VALIDATOR ] PRM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:03:12.518890] [FATAL] [MAIN ] PRM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:03:12.518937] [WARN ] [MAIN ] PRM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:03:12.518998] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-16T21:03:12.519109] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-16T21:03:12.519172] [INFO ] [LOCAL ] PRM: Starting deletion of derivative data. [2025-10-16T21:03:12.519232] [DEBUG] [LOCAL ] PRM: No derivative data file found to delete. [2025-10-16T21:03:12.519309] [INFO ] [MAIN ] Update Progress: 1727/2369 symbols completed. PRM took 35.1s. Estimated remaining: 1h 30m 23s. Rate: 7.1 symbols/min [2025-10-16T21:03:12.687519] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:03:12.687717] [DEBUG] [LOCAL ] PRU: No existing data file found in primary storage. [2025-10-16T21:03:12.687765] [WARN ] [MAIN ] PRU: No existing data found, performing full refresh instead. [2025-10-16T21:03:12.687875] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-16T21:03:12.687917] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-16T21:03:12.687957] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-16T21:03:12.687989] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-16T21:03:12.747955] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-16T21:03:13.037660] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:03:13.542828] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-16T21:03:13.838241] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T21:03:14.342819] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-10-16T21:03:14.424977] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T21:03:14.431207] [INFO ] [REMOTE ] PRMB: Full fetch complete (75927 records). [2025-10-16T21:03:14.431324] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-16T21:03:14.431972] [FATAL] [VALIDATOR ] PRMB: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:03:14.432058] [FATAL] [MAIN ] PRMB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:03:14.432101] [WARN ] [MAIN ] PRMB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:03:14.432165] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-16T21:03:14.432227] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-16T21:03:14.432262] [INFO ] [LOCAL ] PRMB: Starting deletion of derivative data. [2025-10-16T21:03:14.432318] [DEBUG] [LOCAL ] PRMB: No derivative data file found to delete. [2025-10-16T21:03:14.432374] [INFO ] [MAIN ] Update Progress: 1728/2369 symbols completed. PRMB took 32.2s. Estimated remaining: 1h 30m 12s. Rate: 7.1 symbols/min [2025-10-16T21:03:14.597062] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:03:14.597249] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-16T21:03:14.597287] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-16T21:03:14.597397] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-16T21:03:14.597438] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-16T21:03:14.597478] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-16T21:03:14.597510] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-16T21:03:14.948127] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:03:15.142807] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-16T21:03:15.942800] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-16T21:03:16.280482] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T21:03:16.742792] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-10-16T21:03:16.801631] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-16T21:03:16.841782] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T21:03:17.152744] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-16T21:03:17.542856] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-16T21:03:18.342871] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-16T21:03:18.901925] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T21:03:19.142811] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-16T21:03:19.499829] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-16T21:03:19.513243] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-16T21:03:19.942810] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-16T21:03:20.360949] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-16T21:03:20.742814] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-16T21:03:21.200146] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-16T21:03:21.542883] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-16T21:03:22.342835] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-16T21:03:22.907737] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-16T21:03:23.142793] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-16T21:03:23.239685] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T21:03:23.941616] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-16T21:03:23.945346] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-16T21:03:24.696406] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-16T21:03:24.742791] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-16T21:03:25.190358] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-16T21:03:25.542840] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-16T21:03:26.227061] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-16T21:03:26.342818] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-16T21:03:27.023384] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-16T21:03:27.142806] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-16T21:03:27.942878] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-16T21:03:28.742809] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-16T21:03:28.818247] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T21:03:29.542801] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-16T21:03:29.654859] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-16T21:03:29.761894] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-16T21:03:29.991409] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-16T21:03:29.997965] [INFO ] [REMOTE ] PRO: Full fetch complete (53210 records). [2025-10-16T21:03:29.998126] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-16T21:03:29.998861] [FATAL] [VALIDATOR ] PRO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:03:29.998949] [FATAL] [MAIN ] PRO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:03:29.999024] [WARN ] [MAIN ] PRO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:03:29.999109] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-16T21:03:29.999189] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-16T21:03:29.999239] [INFO ] [LOCAL ] PRO: Starting deletion of derivative data. [2025-10-16T21:03:29.999294] [DEBUG] [LOCAL ] PRO: No derivative data file found to delete. [2025-10-16T21:03:29.999367] [INFO ] [MAIN ] Update Progress: 1729/2369 symbols completed. PRO took 35.6s. Estimated remaining: 1h 30m 7s. Rate: 7.1 symbols/min [2025-10-16T21:03:30.165579] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:03:30.165758] [DEBUG] [LOCAL ] PSA: No existing data file found in primary storage. [2025-10-16T21:03:30.165801] [WARN ] [MAIN ] PSA: No existing data found, performing full refresh instead. [2025-10-16T21:03:30.165912] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-16T21:03:30.165984] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-16T21:03:30.166049] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-16T21:03:30.166094] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-16T21:03:30.347981] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-16T21:03:30.530984] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:03:31.142778] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-10-16T21:03:31.336268] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T21:03:31.942780] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-16T21:03:32.363245] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-16T21:03:32.742922] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-16T21:03:33.010556] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T21:03:33.542875] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-16T21:03:34.342831] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-16T21:03:34.400269] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-16T21:03:34.473693] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T21:03:34.802741] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-16T21:03:35.142872] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-16T21:03:35.925709] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T21:03:35.926871] [INFO ] [REMOTE ] PRT: Full fetch complete (8733 records). [2025-10-16T21:03:35.926961] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-16T21:03:35.948010] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-16T21:03:36.282811] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-10-16T21:03:36.282891] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-10-16T21:03:36.283127] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-10-16T21:03:36.283166] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-10-16T21:03:36.283550] [DEBUG] [LOCAL ] PRT: Trimmed 8733 records to 5190 (keeping 200 days of data) [2025-10-16T21:03:36.312450] [DEBUG] [LOCAL ] PRT: Primary data saved (5190 records). [2025-10-16T21:03:36.312516] [INFO ] [MAIN ] PRT: Full history saved. [2025-10-16T21:03:36.312582] [INFO ] [MAIN ] Update Progress: 1730/2369 symbols completed. PRT took 31.1s. Estimated remaining: 1h 29m 57s. Rate: 7.1 symbols/min [2025-10-16T21:03:36.492270] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:03:36.501965] [DEBUG] [LOCAL ] PSBD: Loaded 7956 existing records from primary storage. [2025-10-16T21:03:36.502145] [INFO ] [MAIN ] PSBD: Loaded 7956 existing records. [2025-10-16T21:03:36.678934] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:03:36.679226] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-16T21:03:36.679286] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-16T21:03:36.679454] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-10-16T21:03:36.679509] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-16T21:03:36.751723] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-16T21:03:37.030059] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:03:37.542916] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-16T21:03:37.739904] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-16T21:03:37.890208] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-16T21:03:38.342791] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-16T21:03:38.743470] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-16T21:03:38.744213] [INFO ] [REMOTE ] PRVS: Full fetch complete (1242 records). [2025-10-16T21:03:38.744281] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-16T21:03:38.935450] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-16T21:03:38.935813] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:03:38.936006] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:03:38.936096] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-16T21:03:38.936199] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-16T21:03:38.936262] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-16T21:03:38.936403] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-16T21:03:38.936492] [INFO ] [MAIN ] Update Progress: 1731/2369 symbols completed. PRVS took 24.5s. Estimated remaining: 1h 29m 47s. Rate: 7.1 symbols/min [2025-10-16T21:03:39.112925] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:03:39.145190] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-10-16T21:03:39.151386] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-16T21:03:39.155136] [DEBUG] [LOCAL ] PSF: Loaded 6982 existing records from primary storage. [2025-10-16T21:03:39.167718] [INFO ] [MAIN ] PSF: Loaded 6982 existing records. [2025-10-16T21:03:39.362711] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:03:39.363017] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-16T21:03:39.363069] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-16T21:03:39.363246] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-10-16T21:03:39.363287] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-16T21:03:39.728912] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:03:39.842384] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-16T21:03:39.942881] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-16T21:03:40.742833] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-10-16T21:03:41.542908] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-16T21:03:41.650231] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-16T21:03:41.935741] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-16T21:03:42.342850] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-16T21:03:42.426461] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T21:03:43.033033] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T21:03:43.142874] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-16T21:03:43.942873] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-16T21:03:44.622346] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-16T21:03:44.742787] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-16T21:03:45.151608] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-16T21:03:45.542852] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-16T21:03:46.306136] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T21:03:46.342799] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-16T21:03:46.376939] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T21:03:47.142838] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-16T21:03:47.942874] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-16T21:03:48.037625] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T21:03:48.548340] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T21:03:48.742791] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-16T21:03:48.856844] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T21:03:49.546227] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-16T21:03:49.548407] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-16T21:03:50.342869] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-16T21:03:51.142912] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-16T21:03:51.190041] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T21:03:51.387476] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T21:03:51.942861] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-16T21:03:52.650584] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T21:03:52.742839] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-16T21:03:53.337352] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-16T21:03:53.542860] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-16T21:03:54.347876] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-16T21:03:54.363897] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T21:03:54.395141] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T21:03:55.057039] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-16T21:03:55.142782] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-16T21:03:55.942876] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-16T21:03:56.742787] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-16T21:03:57.127858] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-16T21:03:57.381757] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T21:03:57.542783] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-16T21:03:57.648661] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T21:03:58.342895] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-16T21:03:59.074526] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T21:03:59.142888] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-16T21:03:59.290097] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-16T21:03:59.942785] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-16T21:04:00.167597] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T21:04:00.640090] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T21:04:00.742812] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-16T21:04:01.542790] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-16T21:04:01.593367] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T21:04:01.594803] [INFO ] [REMOTE ] PSF: Full fetch complete (9780 records). [2025-10-16T21:04:01.594876] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-16T21:04:01.947946] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-16T21:04:01.948034] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-16T21:04:01.948353] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-16T21:04:01.948413] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-16T21:04:01.948889] [DEBUG] [LOCAL ] PSF: Trimmed 9780 records to 7022 (keeping 200 days of data) [2025-10-16T21:04:01.990968] [DEBUG] [LOCAL ] PSF: Primary data saved (7022 records). [2025-10-16T21:04:01.991082] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-16T21:04:01.991158] [INFO ] [MAIN ] Update Progress: 1732/2369 symbols completed. PSF took 23.1s. Estimated remaining: 1h 29m 44s. Rate: 7.1 symbols/min [2025-10-16T21:04:02.155941] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:04:02.156102] [DEBUG] [LOCAL ] PSFE: No existing data file found in primary storage. [2025-10-16T21:04:02.156139] [WARN ] [MAIN ] PSFE: No existing data found, performing full refresh instead. [2025-10-16T21:04:02.156249] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-16T21:04:02.156308] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-16T21:04:02.156349] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-16T21:04:02.156381] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-16T21:04:02.343629] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-16T21:04:02.458738] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T21:04:02.535961] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:04:03.142815] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-16T21:04:03.311915] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T21:04:03.318440] [INFO ] [REMOTE ] PRU: Full fetch complete (74110 records). [2025-10-16T21:04:03.318574] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-16T21:04:03.319372] [FATAL] [VALIDATOR ] PRU: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:04:03.319462] [FATAL] [MAIN ] PRU: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:04:03.319505] [WARN ] [MAIN ] PRU: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:04:03.319544] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-16T21:04:03.319630] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-16T21:04:03.319724] [INFO ] [LOCAL ] PRU: Starting deletion of derivative data. [2025-10-16T21:04:03.319774] [DEBUG] [LOCAL ] PRU: No derivative data file found to delete. [2025-10-16T21:04:03.319832] [INFO ] [MAIN ] Update Progress: 1733/2369 symbols completed. PRU took 50.8s. Estimated remaining: 1h 29m 33s. Rate: 7.1 symbols/min [2025-10-16T21:04:03.488838] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:04:03.489015] [DEBUG] [LOCAL ] PSN: No existing data file found in primary storage. [2025-10-16T21:04:03.489055] [WARN ] [MAIN ] PSN: No existing data found, performing full refresh instead. [2025-10-16T21:04:03.489175] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-16T21:04:03.489219] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-16T21:04:03.489263] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-16T21:04:03.489301] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-16T21:04:03.845893] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:04:03.942798] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-16T21:04:03.985547] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-16T21:04:04.742848] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-16T21:04:05.542790] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-10-16T21:04:05.681898] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-16T21:04:05.707931] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T21:04:06.342861] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-10-16T21:04:06.447862] [DEBUG] [REMOTE ] PSFE: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-16T21:04:06.448190] [WARN ] [REMOTE ] PSFE: No data returned for month 2024-12 [2025-10-16T21:04:06.448309] [FATAL] [REMOTE ] PSFE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:04:06.448362] [FATAL] [MAIN ] PSFE: Failed to fetch primary data. [2025-10-16T21:04:06.448422] [WARN ] [MAIN ] PSFE: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:04:06.448489] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-16T21:04:06.448545] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-16T21:04:06.448579] [INFO ] [LOCAL ] PSFE: Starting deletion of derivative data. [2025-10-16T21:04:06.448617] [DEBUG] [LOCAL ] PSFE: No derivative data file found to delete. [2025-10-16T21:04:06.448697] [INFO ] [MAIN ] Update Progress: 1734/2369 symbols completed. PSFE took 4.5s. Estimated remaining: 1h 29m 22s. Rate: 7.1 symbols/min [2025-10-16T21:04:06.620441] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:04:06.620607] [DEBUG] [LOCAL ] PSO: No existing data file found in primary storage. [2025-10-16T21:04:06.620671] [WARN ] [MAIN ] PSO: No existing data found, performing full refresh instead. [2025-10-16T21:04:06.620787] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-16T21:04:06.620829] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-16T21:04:06.620871] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-16T21:04:06.620903] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-16T21:04:06.976112] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:04:07.142794] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-10-16T21:04:07.262556] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T21:04:07.942822] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-16T21:04:08.244612] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T21:04:08.742822] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-16T21:04:09.548061] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-16T21:04:09.570018] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T21:04:09.649118] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-16T21:04:10.342884] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-16T21:04:11.142834] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-16T21:04:11.403372] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T21:04:11.891032] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T21:04:11.942805] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-16T21:04:11.996790] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T21:04:11.999635] [INFO ] [REMOTE ] PSBD: Full fetch complete (10685 records). [2025-10-16T21:04:11.999741] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-16T21:04:12.370632] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-10-16T21:04:12.370742] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-10-16T21:04:12.371011] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-10-16T21:04:12.371051] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-10-16T21:04:12.371557] [DEBUG] [LOCAL ] PSBD: Trimmed 10685 records to 8195 (keeping 200 days of data) [2025-10-16T21:04:12.421914] [DEBUG] [LOCAL ] PSBD: Primary data saved (8195 records). [2025-10-16T21:04:12.422062] [INFO ] [MAIN ] PSBD: Full history saved. [2025-10-16T21:04:12.422191] [INFO ] [MAIN ] Update Progress: 1735/2369 symbols completed. PSBD took 36.1s. Estimated remaining: 1h 29m 13s. Rate: 7.1 symbols/min [2025-10-16T21:04:12.628147] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:04:12.666674] [DEBUG] [LOCAL ] PSQH: Loaded 35505 existing records from primary storage. [2025-10-16T21:04:12.667004] [INFO ] [MAIN ] PSQH: Loaded 35505 existing records. [2025-10-16T21:04:12.748102] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-16T21:04:12.851287] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:04:12.851548] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-16T21:04:12.851602] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-16T21:04:12.851801] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-10-16T21:04:12.851856] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-16T21:04:13.234402] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:04:13.386095] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T21:04:13.542790] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-16T21:04:13.678303] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T21:04:13.683318] [INFO ] [REMOTE ] PSA: Full fetch complete (59231 records). [2025-10-16T21:04:13.683423] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-16T21:04:13.684150] [FATAL] [VALIDATOR ] PSA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:04:13.684241] [FATAL] [MAIN ] PSA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:04:13.684284] [WARN ] [MAIN ] PSA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:04:13.684324] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-16T21:04:13.684411] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-16T21:04:13.684473] [INFO ] [LOCAL ] PSA: Starting deletion of derivative data. [2025-10-16T21:04:13.684530] [DEBUG] [LOCAL ] PSA: No derivative data file found to delete. [2025-10-16T21:04:13.684602] [INFO ] [MAIN ] Update Progress: 1736/2369 symbols completed. PSA took 43.7s. Estimated remaining: 1h 29m 2s. Rate: 7.1 symbols/min [2025-10-16T21:04:13.855434] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:04:13.855576] [DEBUG] [LOCAL ] PSTG: No existing data file found in primary storage. [2025-10-16T21:04:13.855612] [WARN ] [MAIN ] PSTG: No existing data found, performing full refresh instead. [2025-10-16T21:04:13.855751] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-16T21:04:13.855819] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-16T21:04:13.855878] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-16T21:04:13.855923] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-16T21:04:14.231194] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:04:14.342793] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-10-16T21:04:15.010806] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T21:04:15.142776] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-16T21:04:15.942816] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-16T21:04:16.686830] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-16T21:04:16.738951] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-16T21:04:16.747561] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-10-16T21:04:17.542794] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-16T21:04:17.656768] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T21:04:18.342820] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-16T21:04:19.008430] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-16T21:04:19.142828] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-16T21:04:19.514545] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-16T21:04:19.942833] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-16T21:04:20.245085] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-16T21:04:20.753319] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-16T21:04:20.755677] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T21:04:21.542808] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-16T21:04:21.839720] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-16T21:04:22.342877] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-10-16T21:04:22.611570] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T21:04:23.041044] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T21:04:23.142810] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-16T21:04:23.954548] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-16T21:04:23.956079] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T21:04:24.742783] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-16T21:04:24.786581] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T21:04:25.542814] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-16T21:04:26.010404] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-16T21:04:26.342835] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-10-16T21:04:26.430892] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T21:04:26.870325] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T21:04:27.142814] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-16T21:04:27.942826] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-16T21:04:27.970330] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T21:04:28.742817] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-16T21:04:29.077428] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-16T21:04:29.471395] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T21:04:29.542855] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-16T21:04:30.342829] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-16T21:04:30.491333] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T21:04:31.142890] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-16T21:04:31.561239] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-16T21:04:31.942883] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-16T21:04:32.117030] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-16T21:04:32.742773] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-16T21:04:33.075675] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-16T21:04:33.542837] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-16T21:04:33.858477] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T21:04:34.220598] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T21:04:34.342872] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-16T21:04:35.101666] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T21:04:35.142771] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-16T21:04:35.942899] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-16T21:04:36.035160] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T21:04:36.705081] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T21:04:36.742776] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-16T21:04:37.542951] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-10-16T21:04:37.952616] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T21:04:38.342891] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-16T21:04:38.773947] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-16T21:04:39.142821] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-16T21:04:39.334327] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T21:04:39.938702] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T21:04:39.943556] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-16T21:04:39.945214] [INFO ] [REMOTE ] PSN: Full fetch complete (66733 records). [2025-10-16T21:04:39.945395] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-16T21:04:39.946466] [FATAL] [VALIDATOR ] PSN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:04:39.946583] [FATAL] [MAIN ] PSN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:04:39.946689] [WARN ] [MAIN ] PSN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:04:39.946788] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-16T21:04:39.946884] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-16T21:04:39.946944] [INFO ] [LOCAL ] PSN: Starting deletion of derivative data. [2025-10-16T21:04:39.947023] [DEBUG] [LOCAL ] PSN: No derivative data file found to delete. [2025-10-16T21:04:39.947118] [INFO ] [MAIN ] Update Progress: 1737/2369 symbols completed. PSN took 36.6s. Estimated remaining: 1h 28m 60s. Rate: 7.1 symbols/min [2025-10-16T21:04:40.137299] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:04:40.137571] [DEBUG] [LOCAL ] PSTL: No existing data file found in primary storage. [2025-10-16T21:04:40.137618] [WARN ] [MAIN ] PSTL: No existing data found, performing full refresh instead. [2025-10-16T21:04:40.137758] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-16T21:04:40.137799] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-16T21:04:40.137839] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-16T21:04:40.137871] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-16T21:04:40.488711] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:04:40.520562] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-16T21:04:40.742841] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-10-16T21:04:41.542817] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-10-16T21:04:41.991448] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-16T21:04:42.229130] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T21:04:42.342835] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-16T21:04:42.747090] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T21:04:43.142831] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-16T21:04:43.942893] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-16T21:04:44.494760] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-16T21:04:44.742799] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-10. [2025-10-16T21:04:44.915198] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-16T21:04:44.920587] [INFO ] [REMOTE ] PSQH: Full fetch complete (53469 records). [2025-10-16T21:04:44.920708] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-16T21:04:45.214758] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T21:04:45.342136] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-10-16T21:04:45.342214] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-10-16T21:04:45.343150] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-10-16T21:04:45.343211] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-10-16T21:04:45.344253] [DEBUG] [LOCAL ] PSQH: Trimmed 53469 records to 35783 (keeping 200 days of data) [2025-10-16T21:04:45.557396] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-16T21:04:45.540323] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T21:04:45.560989] [DEBUG] [LOCAL ] PSQH: Primary data saved (35783 records). [2025-10-16T21:04:45.566064] [INFO ] [MAIN ] PSQH: Full history saved. [2025-10-16T21:04:45.566636] [INFO ] [MAIN ] Update Progress: 1738/2369 symbols completed. PSQH took 33.1s. Estimated remaining: 1h 28m 50s. Rate: 7.1 symbols/min [2025-10-16T21:04:45.572077] [INFO ] [REMOTE ] PSO: Full fetch complete (52272 records). [2025-10-16T21:04:45.608572] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-10-16T21:04:45.651985] [FATAL] [VALIDATOR ] PSO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:04:45.677611] [FATAL] [MAIN ] PSO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:04:45.677808] [WARN ] [MAIN ] PSO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:04:45.683635] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-16T21:04:45.694103] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-16T21:04:45.699306] [INFO ] [LOCAL ] PSO: Starting deletion of derivative data. [2025-10-16T21:04:45.716523] [DEBUG] [LOCAL ] PSO: No derivative data file found to delete. [2025-10-16T21:04:45.722996] [INFO ] [MAIN ] Update Progress: 1739/2369 symbols completed. PSO took 39.3s. Estimated remaining: 1h 28m 39s. Rate: 7.1 symbols/min [2025-10-16T21:04:45.753432] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:04:45.781396] [DEBUG] [LOCAL ] PSX: No existing data file found in primary storage. [2025-10-16T21:04:45.781471] [WARN ] [MAIN ] PSX: No existing data found, performing full refresh instead. [2025-10-16T21:04:45.815101] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-16T21:04:45.826289] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-16T21:04:45.831527] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-16T21:04:45.842913] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-16T21:04:46.054036] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:04:46.098355] [DEBUG] [LOCAL ] PTA: No existing data file found in primary storage. [2025-10-16T21:04:46.115464] [WARN ] [MAIN ] PTA: No existing data found, performing full refresh instead. [2025-10-16T21:04:46.153789] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-16T21:04:46.160577] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-16T21:04:46.191739] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-16T21:04:46.215141] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-16T21:04:46.369346] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-16T21:04:46.409223] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:04:46.607162] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T21:04:46.631582] [INFO ] [REMOTE ] PSTG: Full fetch complete (76317 records). [2025-10-16T21:04:46.653777] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-16T21:04:46.671169] [FATAL] [VALIDATOR ] PSTG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:04:46.689552] [FATAL] [MAIN ] PSTG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:04:46.694086] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:04:46.690672] [WARN ] [MAIN ] PSTG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:04:46.694193] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-16T21:04:46.694494] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-16T21:04:46.694547] [INFO ] [LOCAL ] PSTG: Starting deletion of derivative data. [2025-10-16T21:04:46.694589] [DEBUG] [LOCAL ] PSTG: No derivative data file found to delete. [2025-10-16T21:04:46.694671] [INFO ] [MAIN ] Update Progress: 1740/2369 symbols completed. PSTG took 33.0s. Estimated remaining: 1h 28m 28s. Rate: 7.1 symbols/min [2025-10-16T21:04:46.860286] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:04:46.860424] [DEBUG] [LOCAL ] PTY: No existing data file found in primary storage. [2025-10-16T21:04:46.860460] [WARN ] [MAIN ] PTY: No existing data found, performing full refresh instead. [2025-10-16T21:04:46.860568] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-16T21:04:46.860610] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-16T21:04:46.860703] [DEBUG] [LOCAL ] PTY: No primary data file found to delete. [2025-10-16T21:04:46.860771] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-16T21:04:47.148010] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-10-16T21:04:47.202255] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:04:47.543969] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T21:04:47.942881] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-10-16T21:04:48.742869] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-16T21:04:49.254794] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-16T21:04:49.549207] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-16T21:04:49.572799] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T21:04:49.909835] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T21:04:50.342812] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-16T21:04:51.142804] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-10-16T21:04:51.441552] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-16T21:04:51.501014] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T21:04:51.942843] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-16T21:04:52.637175] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T21:04:52.742812] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-16T21:04:53.465520] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T21:04:53.542782] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-16T21:04:53.898675] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T21:04:54.342821] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-16T21:04:55.142863] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-16T21:04:55.207218] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T21:04:55.942845] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-16T21:04:56.261299] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-16T21:04:56.300184] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-16T21:04:56.742850] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-16T21:04:57.542860] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-16T21:04:57.709675] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-16T21:04:57.830832] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-16T21:04:58.342813] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-16T21:04:59.142883] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-16T21:04:59.458128] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T21:04:59.825310] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-16T21:04:59.918231] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T21:04:59.942777] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-16T21:05:00.742845] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-16T21:05:01.553318] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-16T21:05:01.555984] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T21:05:02.342887] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-16T21:05:02.820810] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-16T21:05:02.850906] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T21:05:03.142843] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-16T21:05:03.948093] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-16T21:05:03.960423] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T21:05:04.142289] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T21:05:04.742818] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-16T21:05:05.542819] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-16T21:05:06.174466] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-16T21:05:06.342784] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-16T21:05:06.524990] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T21:05:06.729155] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T21:05:07.142845] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-16T21:05:07.942794] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-16T21:05:08.144407] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-16T21:05:08.742790] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-16T21:05:08.910847] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T21:05:09.046092] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-16T21:05:09.542816] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-16T21:05:10.342822] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-16T21:05:10.767370] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T21:05:10.805844] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T21:05:11.142833] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-16T21:05:11.179744] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-16T21:05:11.942846] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-16T21:05:12.249701] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T21:05:12.742855] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-16T21:05:13.039893] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-16T21:05:13.542779] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-16T21:05:13.870883] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T21:05:14.342863] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-16T21:05:15.142819] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-16T21:05:15.224178] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T21:05:15.229028] [INFO ] [REMOTE ] PTY: Full fetch complete (53878 records). [2025-10-16T21:05:15.229129] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-16T21:05:15.229770] [FATAL] [VALIDATOR ] PTY: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:05:15.229858] [FATAL] [MAIN ] PTY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:05:15.229899] [WARN ] [MAIN ] PTY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:05:15.229968] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-16T21:05:15.230030] [DEBUG] [LOCAL ] PTY: No primary data file found to delete. [2025-10-16T21:05:15.230065] [INFO ] [LOCAL ] PTY: Starting deletion of derivative data. [2025-10-16T21:05:15.230103] [DEBUG] [LOCAL ] PTY: No derivative data file found to delete. [2025-10-16T21:05:15.230156] [INFO ] [MAIN ] Update Progress: 1741/2369 symbols completed. PTY took 28.5s. Estimated remaining: 1h 28m 27s. Rate: 7.1 symbols/min [2025-10-16T21:05:15.400906] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:05:15.401067] [DEBUG] [LOCAL ] PUK: No existing data file found in primary storage. [2025-10-16T21:05:15.401104] [WARN ] [MAIN ] PUK: No existing data found, performing full refresh instead. [2025-10-16T21:05:15.401219] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-16T21:05:15.401262] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-16T21:05:15.401301] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-16T21:05:15.401333] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-16T21:05:15.765623] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:05:15.795386] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-16T21:05:15.942775] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-16T21:05:16.404380] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T21:05:16.742841] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-10-16T21:05:17.542845] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-16T21:05:18.021262] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-16T21:05:18.097965] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T21:05:18.284931] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-16T21:05:18.342781] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-16T21:05:18.998947] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T21:05:19.001772] [INFO ] [REMOTE ] PTA: Full fetch complete (22505 records). [2025-10-16T21:05:19.001916] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-16T21:05:19.002545] [FATAL] [VALIDATOR ] PTA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:05:19.002674] [FATAL] [MAIN ] PTA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:05:19.002752] [WARN ] [MAIN ] PTA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:05:19.002835] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-16T21:05:19.002918] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-16T21:05:19.002962] [INFO ] [LOCAL ] PTA: Starting deletion of derivative data. [2025-10-16T21:05:19.003010] [DEBUG] [LOCAL ] PTA: No derivative data file found to delete. [2025-10-16T21:05:19.003079] [INFO ] [MAIN ] Update Progress: 1742/2369 symbols completed. PTA took 33.3s. Estimated remaining: 1h 28m 17s. Rate: 7.1 symbols/min [2025-10-16T21:05:19.150315] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-16T21:05:19.178893] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:05:19.179735] [DEBUG] [LOCAL ] PUMP: No existing data file found in primary storage. [2025-10-16T21:05:19.179798] [WARN ] [MAIN ] PUMP: No existing data found, performing full refresh instead. [2025-10-16T21:05:19.179931] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-16T21:05:19.179982] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-16T21:05:19.180035] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-16T21:05:19.180082] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-16T21:05:19.533328] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:05:19.942815] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-16T21:05:20.742795] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-16T21:05:20.801224] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T21:05:20.807892] [INFO ] [REMOTE ] PSX: Full fetch complete (76766 records). [2025-10-16T21:05:20.808030] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-16T21:05:20.808802] [FATAL] [VALIDATOR ] PSX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:05:20.808891] [FATAL] [MAIN ] PSX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:05:20.808934] [WARN ] [MAIN ] PSX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:05:20.808979] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-16T21:05:20.809035] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-16T21:05:20.809070] [INFO ] [LOCAL ] PSX: Starting deletion of derivative data. [2025-10-16T21:05:20.809125] [DEBUG] [LOCAL ] PSX: No derivative data file found to delete. [2025-10-16T21:05:20.809183] [INFO ] [MAIN ] Update Progress: 1743/2369 symbols completed. PSX took 35.2s. Estimated remaining: 1h 28m 6s. Rate: 7.1 symbols/min [2025-10-16T21:05:20.978268] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:05:20.978514] [DEBUG] [LOCAL ] PVH: No existing data file found in primary storage. [2025-10-16T21:05:20.978579] [WARN ] [MAIN ] PVH: No existing data found, performing full refresh instead. [2025-10-16T21:05:20.978742] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-16T21:05:20.978831] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-16T21:05:20.979132] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-16T21:05:20.979317] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-16T21:05:21.203224] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-16T21:05:21.193192] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-16T21:05:21.304783] [INFO ] [REMOTE ] PSTL: Full fetch complete (29467 records). [2025-10-16T21:05:21.315722] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-16T21:05:21.326947] [FATAL] [VALIDATOR ] PSTL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:05:21.337261] [FATAL] [MAIN ] PSTL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:05:21.342438] [WARN ] [MAIN ] PSTL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:05:21.360605] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-16T21:05:21.368856] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-16T21:05:21.375175] [INFO ] [LOCAL ] PSTL: Starting deletion of derivative data. [2025-10-16T21:05:21.377198] [DEBUG] [LOCAL ] PSTL: No derivative data file found to delete. [2025-10-16T21:05:21.384126] [INFO ] [MAIN ] Update Progress: 1744/2369 symbols completed. PSTL took 41.4s. Estimated remaining: 1h 27m 54s. Rate: 7.1 symbols/min [2025-10-16T21:05:21.409024] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:05:21.553866] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-10-16T21:05:21.587212] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:05:21.596412] [DEBUG] [LOCAL ] PVL: Loaded 4725 existing records from primary storage. [2025-10-16T21:05:21.596740] [INFO ] [MAIN ] PVL: Loaded 4725 existing records. [2025-10-16T21:05:21.782253] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:05:21.782495] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-16T21:05:21.782566] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-16T21:05:21.782892] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-10-16T21:05:21.782968] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-16T21:05:22.144600] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:05:22.342813] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-10-16T21:05:23.142846] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-16T21:05:23.381945] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T21:05:23.942826] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-10-16T21:05:24.146275] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-16T21:05:24.742820] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-16T21:05:24.838161] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T21:05:24.862554] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T21:05:25.542830] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-16T21:05:26.150585] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T21:05:26.342863] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-16T21:05:27.142781] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-16T21:05:27.218880] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T21:05:27.512521] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-16T21:05:27.942841] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-16T21:05:28.742869] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-16T21:05:28.752926] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T21:05:28.789127] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T21:05:29.542903] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-16T21:05:30.342791] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-16T21:05:30.738571] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-16T21:05:30.947305] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T21:05:31.101747] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-16T21:05:31.142766] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-16T21:05:31.942838] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-16T21:05:31.950857] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-16T21:05:32.742854] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-16T21:05:33.542862] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-16T21:05:33.641296] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T21:05:34.342908] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-16T21:05:34.565998] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-16T21:05:35.133286] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-16T21:05:35.142769] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-16T21:05:35.177123] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T21:05:35.788482] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-16T21:05:35.942815] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-16T21:05:36.742846] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-16T21:05:37.465901] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-16T21:05:37.542797] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-16T21:05:37.830830] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-16T21:05:38.342857] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-16T21:05:39.142803] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-16T21:05:39.318539] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T21:05:39.906800] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-16T21:05:39.942793] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-16T21:05:40.041625] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T21:05:40.631685] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-16T21:05:40.742874] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-16T21:05:41.542883] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-16T21:05:42.342793] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-16T21:05:42.637475] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T21:05:42.984444] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T21:05:42.985555] [INFO ] [REMOTE ] PVL: Full fetch complete (7143 records). [2025-10-16T21:05:42.985787] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-16T21:05:43.168603] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-16T21:05:43.363186] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-10-16T21:05:43.363281] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-10-16T21:05:43.363481] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-10-16T21:05:43.363614] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-10-16T21:05:43.378946] [DEBUG] [LOCAL ] PVL: Trimmed 7143 records to 4738 (keeping 200 days of data) [2025-10-16T21:05:43.401075] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-16T21:05:43.426543] [DEBUG] [LOCAL ] PVL: Primary data saved (4738 records). [2025-10-16T21:05:43.426976] [INFO ] [MAIN ] PVL: Full history saved. [2025-10-16T21:05:43.427056] [INFO ] [MAIN ] Update Progress: 1745/2369 symbols completed. PVL took 22.0s. Estimated remaining: 1h 27m 51s. Rate: 7.1 symbols/min [2025-10-16T21:05:43.598509] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:05:43.598741] [DEBUG] [LOCAL ] PWR: No existing data file found in primary storage. [2025-10-16T21:05:43.598791] [WARN ] [MAIN ] PWR: No existing data found, performing full refresh instead. [2025-10-16T21:05:43.598932] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-16T21:05:43.598995] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-16T21:05:43.599044] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-16T21:05:43.599082] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-16T21:05:43.950351] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-16T21:05:43.955046] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:05:44.742873] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-10-16T21:05:45.184630] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-16T21:05:45.542864] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-16T21:05:46.059553] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-16T21:05:46.342874] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-16T21:05:46.715892] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-16T21:05:47.142911] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-16T21:05:47.411525] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T21:05:47.942785] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-16T21:05:48.146376] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-16T21:05:48.611162] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T21:05:48.742776] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-16T21:05:49.542851] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-16T21:05:49.822519] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-16T21:05:50.342797] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-16T21:05:50.610879] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T21:05:51.142860] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-16T21:05:51.442191] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T21:05:51.526525] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-16T21:05:51.531919] [INFO ] [REMOTE ] PUK: Full fetch complete (64991 records). [2025-10-16T21:05:51.532041] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-16T21:05:51.532908] [FATAL] [VALIDATOR ] PUK: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:05:51.532995] [FATAL] [MAIN ] PUK: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:05:51.533038] [WARN ] [MAIN ] PUK: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:05:51.533076] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-16T21:05:51.533131] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-16T21:05:51.533166] [INFO ] [LOCAL ] PUK: Starting deletion of derivative data. [2025-10-16T21:05:51.533204] [DEBUG] [LOCAL ] PUK: No derivative data file found to delete. [2025-10-16T21:05:51.533258] [INFO ] [MAIN ] Update Progress: 1746/2369 symbols completed. PUK took 36.3s. Estimated remaining: 1h 27m 42s. Rate: 7.1 symbols/min [2025-10-16T21:05:51.706960] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:05:51.707179] [DEBUG] [LOCAL ] PX: No existing data file found in primary storage. [2025-10-16T21:05:51.707234] [WARN ] [MAIN ] PX: No existing data found, performing full refresh instead. [2025-10-16T21:05:51.707354] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-16T21:05:51.707397] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-16T21:05:51.707439] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-16T21:05:51.707472] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-16T21:05:51.946059] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-16T21:05:52.063500] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:05:52.279080] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-16T21:05:52.742879] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-10-16T21:05:53.542854] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-16T21:05:53.899279] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-16T21:05:54.293940] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T21:05:54.342780] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-16T21:05:55.142838] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-10. [2025-10-16T21:05:55.270331] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T21:05:55.915397] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T21:05:55.947381] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-16T21:05:55.949610] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T21:05:55.956120] [INFO ] [REMOTE ] PUMP: Full fetch complete (71362 records). [2025-10-16T21:05:55.956246] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-10-16T21:05:55.956926] [FATAL] [VALIDATOR ] PUMP: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:05:55.957035] [FATAL] [MAIN ] PUMP: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:05:55.957081] [WARN ] [MAIN ] PUMP: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:05:55.957120] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-16T21:05:55.957179] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-16T21:05:55.957214] [INFO ] [LOCAL ] PUMP: Starting deletion of derivative data. [2025-10-16T21:05:55.957253] [DEBUG] [LOCAL ] PUMP: No derivative data file found to delete. [2025-10-16T21:05:55.957317] [INFO ] [MAIN ] Update Progress: 1747/2369 symbols completed. PUMP took 37.0s. Estimated remaining: 1h 27m 32s. Rate: 7.1 symbols/min [2025-10-16T21:05:56.129247] [INFO ] [MAIN ] PXED: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:05:56.129463] [DEBUG] [LOCAL ] PXED: No existing data file found in primary storage. [2025-10-16T21:05:56.129520] [WARN ] [MAIN ] PXED: No existing data found, performing full refresh instead. [2025-10-16T21:05:56.129635] [INFO ] [MAIN ] PXED: Wiping existing primary data before full refresh. [2025-10-16T21:05:56.129713] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-16T21:05:56.129763] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-16T21:05:56.129796] [INFO ] [MAIN ] PXED: Starting full primary refresh. [2025-10-16T21:05:56.475007] [INFO ] [REMOTE ] PXED: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:05:56.742810] [INFO ] [REMOTE ] PXED: Fetching primary data for 2024-12. [2025-10-16T21:05:57.060003] [DEBUG] [REMOTE ] PXED: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:05:57.060302] [WARN ] [REMOTE ] PXED: No data returned for month 2024-12 [2025-10-16T21:05:57.060404] [FATAL] [REMOTE ] PXED: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:05:57.060461] [FATAL] [MAIN ] PXED: Failed to fetch primary data. [2025-10-16T21:05:57.060500] [WARN ] [MAIN ] PXED: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:05:57.060535] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-16T21:05:57.060590] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-16T21:05:57.060625] [INFO ] [LOCAL ] PXED: Starting deletion of derivative data. [2025-10-16T21:05:57.060717] [DEBUG] [LOCAL ] PXED: No derivative data file found to delete. [2025-10-16T21:05:57.060779] [INFO ] [MAIN ] Update Progress: 1748/2369 symbols completed. PXED took 1.1s. Estimated remaining: 1h 27m 21s. Rate: 7.1 symbols/min [2025-10-16T21:05:57.232847] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:05:57.233041] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-16T21:05:57.233078] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-16T21:05:57.233189] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-16T21:05:57.233228] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-16T21:05:57.233268] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-16T21:05:57.233299] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-16T21:05:57.545547] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-16T21:05:57.621823] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:05:57.643096] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T21:05:58.342813] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-16T21:05:59.142845] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-10-16T21:05:59.625281] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-16T21:05:59.666973] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T21:05:59.942830] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-16T21:06:00.742823] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-16T21:06:01.542948] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-16T21:06:01.752399] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T21:06:01.939978] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.80 seconds). [2025-10-16T21:06:02.342823] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-16T21:06:02.459512] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T21:06:03.142850] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-16T21:06:03.437786] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T21:06:03.913591] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T21:06:03.942771] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-16T21:06:04.742844] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-16T21:06:05.073729] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T21:06:05.131878] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T21:06:05.542860] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-16T21:06:06.342896] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-16T21:06:07.142930] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-16T21:06:07.509552] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T21:06:07.604693] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.86 seconds). [2025-10-16T21:06:07.942832] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-16T21:06:07.988155] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T21:06:08.742808] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-16T21:06:09.109374] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-16T21:06:09.542792] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-16T21:06:09.777584] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T21:06:09.862551] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-16T21:06:10.342828] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-16T21:06:11.142859] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-16T21:06:11.889051] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T21:06:11.942816] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-16T21:06:12.029816] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T21:06:12.035901] [INFO ] [REMOTE ] PVH: Full fetch complete (70795 records). [2025-10-16T21:06:12.036285] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-16T21:06:12.037188] [FATAL] [VALIDATOR ] PVH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:06:12.037305] [FATAL] [MAIN ] PVH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:06:12.037369] [WARN ] [MAIN ] PVH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:06:12.037482] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-16T21:06:12.037581] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-16T21:06:12.037680] [INFO ] [LOCAL ] PVH: Starting deletion of derivative data. [2025-10-16T21:06:12.037762] [DEBUG] [LOCAL ] PVH: No derivative data file found to delete. [2025-10-16T21:06:12.038034] [INFO ] [MAIN ] Update Progress: 1749/2369 symbols completed. PVH took 51.2s. Estimated remaining: 1h 27m 15s. Rate: 7.1 symbols/min [2025-10-16T21:06:12.242282] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:06:12.269026] [DEBUG] [LOCAL ] QD: Loaded 27493 existing records from primary storage. [2025-10-16T21:06:12.269334] [INFO ] [MAIN ] QD: Loaded 27493 existing records. [2025-10-16T21:06:12.471259] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:06:12.471525] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-16T21:06:12.471712] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-16T21:06:12.481665] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-10-16T21:06:12.499146] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-16T21:06:12.533378] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.99 seconds). [2025-10-16T21:06:12.636000] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T21:06:12.684502] [INFO ] [REMOTE ] PX: Full fetch complete (50008 records). [2025-10-16T21:06:12.688622] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-16T21:06:12.747966] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-16T21:06:12.741588] [FATAL] [VALIDATOR ] PX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:06:12.753396] [FATAL] [MAIN ] PX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:06:12.754304] [WARN ] [MAIN ] PX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:06:12.798792] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-16T21:06:12.813360] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-16T21:06:12.817193] [INFO ] [LOCAL ] PX: Starting deletion of derivative data. [2025-10-16T21:06:12.823098] [DEBUG] [LOCAL ] PX: No derivative data file found to delete. [2025-10-16T21:06:12.828401] [INFO ] [MAIN ] Update Progress: 1750/2369 symbols completed. PX took 21.3s. Estimated remaining: 1h 27m 4s. Rate: 7.1 symbols/min [2025-10-16T21:06:12.945169] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:06:13.081087] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:06:13.081255] [DEBUG] [LOCAL ] QGEN: No existing data file found in primary storage. [2025-10-16T21:06:13.081291] [WARN ] [MAIN ] QGEN: No existing data found, performing full refresh instead. [2025-10-16T21:06:13.081412] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-16T21:06:13.081455] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-16T21:06:13.081496] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-16T21:06:13.081528] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-16T21:06:13.439235] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:06:13.542785] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-10-16T21:06:14.342822] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-10-16T21:06:15.142787] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-16T21:06:15.478286] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T21:06:15.531554] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-10-16T21:06:15.683354] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T21:06:15.942842] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-16T21:06:16.742799] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-16T21:06:17.182382] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-16T21:06:17.542869] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-16T21:06:18.342863] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-16T21:06:18.529404] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-16T21:06:18.621562] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-16T21:06:18.782912] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-16T21:06:19.142813] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-16T21:06:19.942831] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-16T21:06:20.309611] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T21:06:20.742860] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-16T21:06:20.898564] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T21:06:20.959242] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T21:06:21.542781] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-16T21:06:22.342828] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-16T21:06:22.871118] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T21:06:23.142876] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-16T21:06:23.658277] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.92 seconds). [2025-10-16T21:06:23.942788] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-16T21:06:24.216019] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T21:06:24.682885] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T21:06:24.742783] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-16T21:06:25.459756] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T21:06:25.465594] [INFO ] [REMOTE ] PWR: Full fetch complete (68854 records). [2025-10-16T21:06:25.465787] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-16T21:06:25.466596] [FATAL] [VALIDATOR ] PWR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:06:25.466713] [FATAL] [MAIN ] PWR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:06:25.466759] [WARN ] [MAIN ] PWR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:06:25.466799] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-16T21:06:25.466861] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-16T21:06:25.466922] [INFO ] [LOCAL ] PWR: Starting deletion of derivative data. [2025-10-16T21:06:25.467003] [DEBUG] [LOCAL ] PWR: No derivative data file found to delete. [2025-10-16T21:06:25.467085] [INFO ] [MAIN ] Update Progress: 1751/2369 symbols completed. PWR took 42.0s. Estimated remaining: 1h 26m 57s. Rate: 7.1 symbols/min [2025-10-16T21:06:25.547965] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-16T21:06:25.677137] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:06:25.677335] [DEBUG] [LOCAL ] QS: No existing data file found in primary storage. [2025-10-16T21:06:25.677385] [WARN ] [MAIN ] QS: No existing data found, performing full refresh instead. [2025-10-16T21:06:25.677526] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-16T21:06:25.677583] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-16T21:06:25.677637] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-16T21:06:25.677725] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-16T21:06:26.089161] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:06:26.342830] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-10-16T21:06:26.483359] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-16T21:06:26.567585] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-16T21:06:27.142883] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-16T21:06:27.942859] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-16T21:06:28.388057] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-16T21:06:28.742801] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-16T21:06:28.839352] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-10-16T21:06:29.542784] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-16T21:06:29.801323] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T21:06:30.073472] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T21:06:30.342807] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-16T21:06:31.142834] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-16T21:06:31.704161] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T21:06:31.925531] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-16T21:06:31.942776] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-16T21:06:32.742873] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-16T21:06:33.362835] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T21:06:33.542852] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-16T21:06:34.345338] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-16T21:06:34.351250] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (3.21 seconds). [2025-10-16T21:06:34.619617] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-16T21:06:35.142894] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-16T21:06:35.258425] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-16T21:06:35.871335] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-16T21:06:35.942820] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-16T21:06:36.742824] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-16T21:06:36.860938] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T21:06:37.542867] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-16T21:06:38.279824] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-16T21:06:38.342901] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-16T21:06:38.757004] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T21:06:38.760787] [INFO ] [REMOTE ] QD: Full fetch complete (39952 records). [2025-10-16T21:06:38.760944] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-16T21:06:39.133199] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-10-16T21:06:39.133286] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-10-16T21:06:39.134088] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-10-16T21:06:39.134151] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-10-16T21:06:39.135115] [DEBUG] [LOCAL ] QD: Trimmed 39952 records to 27656 (keeping 200 days of data) [2025-10-16T21:06:39.179139] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-16T21:06:39.294020] [DEBUG] [LOCAL ] QD: Primary data saved (27656 records). [2025-10-16T21:06:39.294318] [INFO ] [MAIN ] QD: Full history saved. [2025-10-16T21:06:39.294442] [INFO ] [MAIN ] Update Progress: 1752/2369 symbols completed. QD took 27.3s. Estimated remaining: 1h 26m 51s. Rate: 7.1 symbols/min [2025-10-16T21:06:39.463120] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:06:39.463363] [DEBUG] [LOCAL ] QSR: No existing data file found in primary storage. [2025-10-16T21:06:39.463408] [WARN ] [MAIN ] QSR: No existing data found, performing full refresh instead. [2025-10-16T21:06:39.487880] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-16T21:06:39.490746] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-16T21:06:39.490878] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-16T21:06:39.490931] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-16T21:06:39.555554] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-10-16T21:06:39.854637] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:06:39.942766] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-10-16T21:06:40.328080] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T21:06:40.742828] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-16T21:06:41.071995] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T21:06:41.497428] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T21:06:41.542780] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-16T21:06:42.342824] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-16T21:06:42.745094] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-16T21:06:42.912714] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T21:06:43.142852] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-16T21:06:43.785633] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T21:06:43.942831] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-16T21:06:44.742885] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-16T21:06:45.399077] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-16T21:06:45.542851] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-16T21:06:46.256151] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T21:06:46.342787] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-16T21:06:46.922571] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.98 seconds). [2025-10-16T21:06:47.142817] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-16T21:06:47.165813] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-16T21:06:47.171611] [INFO ] [REMOTE ] QGEN: Full fetch complete (70109 records). [2025-10-16T21:06:47.171766] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-16T21:06:47.172545] [FATAL] [VALIDATOR ] QGEN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:06:47.172633] [FATAL] [MAIN ] QGEN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:06:47.172720] [WARN ] [MAIN ] QGEN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:06:47.172768] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-16T21:06:47.172825] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-16T21:06:47.172865] [INFO ] [LOCAL ] QGEN: Starting deletion of derivative data. [2025-10-16T21:06:47.172906] [DEBUG] [LOCAL ] QGEN: No derivative data file found to delete. [2025-10-16T21:06:47.172962] [INFO ] [MAIN ] Update Progress: 1753/2369 symbols completed. QGEN took 34.3s. Estimated remaining: 1h 26m 42s. Rate: 7.1 symbols/min [2025-10-16T21:06:47.354479] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:06:47.354668] [DEBUG] [LOCAL ] QTWO: No existing data file found in primary storage. [2025-10-16T21:06:47.354725] [WARN ] [MAIN ] QTWO: No existing data found, performing full refresh instead. [2025-10-16T21:06:47.354836] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-16T21:06:47.354879] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-16T21:06:47.354921] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-16T21:06:47.354954] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-16T21:06:47.698636] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:06:47.942788] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-10-16T21:06:48.263061] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-16T21:06:48.283104] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-10-16T21:06:48.304107] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-16T21:06:48.308884] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-16T21:06:48.309780] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:06:48.322998] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:06:48.323230] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:06:48.323897] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-16T21:06:48.323972] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-16T21:06:48.324009] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-16T21:06:48.324047] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-10-16T21:06:48.324125] [INFO ] [MAIN ] Update Progress: 1754/2369 symbols completed. QBTS took 51.3s. Estimated remaining: 1h 26m 31s. Rate: 7.1 symbols/min [2025-10-16T21:06:48.491674] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:06:48.513737] [DEBUG] [LOCAL ] QUAD: Loaded 23361 existing records from primary storage. [2025-10-16T21:06:48.513996] [INFO ] [MAIN ] QUAD: Loaded 23361 existing records. [2025-10-16T21:06:48.693088] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:06:48.693432] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-16T21:06:48.693487] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-16T21:06:48.693830] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-10-16T21:06:48.693921] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-16T21:06:48.755217] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-16T21:06:49.038382] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:06:49.385936] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T21:06:49.542823] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-16T21:06:50.342902] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-16T21:06:51.142820] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-10-16T21:06:51.316081] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T21:06:51.454149] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-16T21:06:51.942836] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-16T21:06:52.546685] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-16T21:06:52.649943] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T21:06:52.742862] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-16T21:06:53.542877] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-16T21:06:54.342831] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-16T21:06:54.674854] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-16T21:06:54.713123] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T21:06:54.759330] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-10-16T21:06:55.142831] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-16T21:06:55.571105] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T21:06:55.942872] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-16T21:06:56.742815] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-16T21:06:57.159926] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-16T21:06:57.192769] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T21:06:57.542820] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-16T21:06:57.642504] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T21:06:57.650144] [INFO ] [REMOTE ] QS: Full fetch complete (77530 records). [2025-10-16T21:06:57.650379] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-16T21:06:57.651612] [FATAL] [VALIDATOR ] QS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:06:57.651750] [FATAL] [MAIN ] QS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:06:57.651796] [WARN ] [MAIN ] QS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:06:57.651842] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-16T21:06:57.651911] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-16T21:06:57.651961] [INFO ] [LOCAL ] QS: Starting deletion of derivative data. [2025-10-16T21:06:57.652028] [DEBUG] [LOCAL ] QS: No derivative data file found to delete. [2025-10-16T21:06:57.652134] [INFO ] [MAIN ] Update Progress: 1755/2369 symbols completed. QS took 32.2s. Estimated remaining: 1h 26m 23s. Rate: 7.1 symbols/min [2025-10-16T21:06:57.828390] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:06:57.828637] [DEBUG] [LOCAL ] QVCC: No existing data file found in primary storage. [2025-10-16T21:06:57.828718] [WARN ] [MAIN ] QVCC: No existing data found, performing full refresh instead. [2025-10-16T21:06:57.828933] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-16T21:06:57.828985] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-16T21:06:57.829041] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-16T21:06:57.829113] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-16T21:06:58.207351] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:06:58.342883] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-16T21:06:59.142829] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-16T21:06:59.279884] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T21:06:59.942776] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-16T21:07:00.332806] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-16T21:07:00.405263] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-16T21:07:00.742822] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-16T21:07:01.542827] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-10-16T21:07:01.656580] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T21:07:02.232406] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T21:07:02.342813] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-16T21:07:02.408903] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T21:07:03.142817] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-16T21:07:03.744708] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T21:07:03.942894] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-16T21:07:04.742825] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-16T21:07:04.783321] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T21:07:05.135180] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T21:07:05.542832] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-16T21:07:06.342847] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-16T21:07:06.732280] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-16T21:07:07.097362] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T21:07:07.142772] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-16T21:07:07.366601] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-16T21:07:07.942872] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-16T21:07:08.619333] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T21:07:08.742854] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-16T21:07:08.851942] [DEBUG] [REMOTE ] QVCC: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-16T21:07:08.852573] [WARN ] [REMOTE ] QVCC: No data returned for month 2025-01 [2025-10-16T21:07:08.852687] [FATAL] [REMOTE ] QVCC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:07:08.852807] [FATAL] [MAIN ] QVCC: Failed to fetch primary data. [2025-10-16T21:07:08.852879] [WARN ] [MAIN ] QVCC: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:07:08.852963] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-16T21:07:08.853042] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-16T21:07:08.853080] [INFO ] [LOCAL ] QVCC: Starting deletion of derivative data. [2025-10-16T21:07:08.853143] [DEBUG] [LOCAL ] QVCC: No derivative data file found to delete. [2025-10-16T21:07:08.853198] [INFO ] [MAIN ] Update Progress: 1756/2369 symbols completed. QVCC took 11.2s. Estimated remaining: 1h 26m 15s. Rate: 7.1 symbols/min [2025-10-16T21:07:09.039297] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:07:09.046832] [DEBUG] [LOCAL ] QVCD: Loaded 4697 existing records from primary storage. [2025-10-16T21:07:09.047055] [INFO ] [MAIN ] QVCD: Loaded 4697 existing records. [2025-10-16T21:07:09.252837] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:07:09.255445] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T21:07:09.255936] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-16T21:07:09.264933] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-16T21:07:09.265340] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-10-16T21:07:09.265898] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-16T21:07:09.544956] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-16T21:07:09.624792] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:07:10.342831] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-16T21:07:10.818584] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T21:07:11.142860] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-16T21:07:11.949856] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-16T21:07:11.956812] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T21:07:12.742837] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-16T21:07:13.036016] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T21:07:13.038959] [INFO ] [REMOTE ] QUAD: Full fetch complete (34040 records). [2025-10-16T21:07:13.039032] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-16T21:07:13.415523] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-10-16T21:07:13.415718] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-10-16T21:07:13.416561] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-10-16T21:07:13.416636] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-10-16T21:07:13.445493] [DEBUG] [LOCAL ] QUAD: Trimmed 34040 records to 23460 (keeping 200 days of data) [2025-10-16T21:07:13.448969] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-16T21:07:13.542828] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-10-16T21:07:13.597578] [DEBUG] [LOCAL ] QUAD: Primary data saved (23460 records). [2025-10-16T21:07:13.597888] [INFO ] [MAIN ] QUAD: Full history saved. [2025-10-16T21:07:13.597981] [INFO ] [MAIN ] Update Progress: 1757/2369 symbols completed. QUAD took 25.3s. Estimated remaining: 1h 26m 6s. Rate: 7.1 symbols/min [2025-10-16T21:07:14.342785] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-16T21:07:14.466928] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T21:07:14.529561] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T21:07:15.142808] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-16T21:07:15.942800] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-16T21:07:15.968833] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T21:07:15.974428] [INFO ] [REMOTE ] QTWO: Full fetch complete (57756 records). [2025-10-16T21:07:15.974570] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-16T21:07:15.975277] [FATAL] [VALIDATOR ] QTWO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:07:15.975374] [FATAL] [MAIN ] QTWO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:07:15.975447] [WARN ] [MAIN ] QTWO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:07:15.975533] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-16T21:07:15.975611] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-16T21:07:15.975685] [INFO ] [LOCAL ] QTWO: Starting deletion of derivative data. [2025-10-16T21:07:15.975753] [DEBUG] [LOCAL ] QTWO: No derivative data file found to delete. [2025-10-16T21:07:15.975838] [INFO ] [MAIN ] Update Progress: 1758/2369 symbols completed. QTWO took 28.8s. Estimated remaining: 1h 25m 55s. Rate: 7.1 symbols/min [2025-10-16T21:07:16.318786] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-16T21:07:16.676441] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-16T21:07:16.742787] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-16T21:07:17.400443] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-16T21:07:17.542813] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-16T21:07:18.240768] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-16T21:07:18.342821] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-16T21:07:19.070724] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T21:07:19.142870] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-16T21:07:19.942806] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-16T21:07:20.018581] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T21:07:20.742819] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-16T21:07:21.542448] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-16T21:07:21.544481] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-16T21:07:21.968494] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-16T21:07:22.024452] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-16T21:07:22.342813] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-16T21:07:23.143163] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-16T21:07:23.143095] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T21:07:23.150633] [INFO ] [REMOTE ] QSR: Full fetch complete (75635 records). [2025-10-16T21:07:23.150807] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-16T21:07:23.151772] [FATAL] [VALIDATOR ] QSR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:07:23.151887] [FATAL] [MAIN ] QSR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:07:23.151953] [WARN ] [MAIN ] QSR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:07:23.152026] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-16T21:07:23.152098] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-16T21:07:23.152160] [INFO ] [LOCAL ] QSR: Starting deletion of derivative data. [2025-10-16T21:07:23.152215] [DEBUG] [LOCAL ] QSR: No derivative data file found to delete. [2025-10-16T21:07:23.152275] [INFO ] [MAIN ] Update Progress: 1759/2369 symbols completed. QSR took 43.9s. Estimated remaining: 1h 25m 46s. Rate: 7.1 symbols/min [2025-10-16T21:07:23.944130] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-16T21:07:23.945936] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-16T21:07:24.734305] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-16T21:07:24.742756] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-16T21:07:25.446749] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T21:07:25.448071] [INFO ] [REMOTE ] QVCD: Full fetch complete (6275 records). [2025-10-16T21:07:25.448140] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-16T21:07:25.821719] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-10-16T21:07:25.821856] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-10-16T21:07:25.822059] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-10-16T21:07:25.822101] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-10-16T21:07:25.822471] [DEBUG] [LOCAL ] QVCD: Trimmed 6275 records to 4721 (keeping 200 days of data) [2025-10-16T21:07:25.850044] [DEBUG] [LOCAL ] QVCD: Primary data saved (4721 records). [2025-10-16T21:07:25.850155] [INFO ] [MAIN ] QVCD: Full history saved. [2025-10-16T21:07:25.850229] [INFO ] [MAIN ] Update Progress: 1760/2369 symbols completed. QVCD took 17.0s. Estimated remaining: 1h 25m 36s. Rate: 7.1 symbols/min [2025-10-16T21:07:26.503789] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:07:26.537965] [DEBUG] [LOCAL ] RA: No existing data file found in primary storage. [2025-10-16T21:07:26.524103] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:07:26.544457] [WARN ] [MAIN ] RA: No existing data found, performing full refresh instead. [2025-10-16T21:07:26.512528] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:07:26.550897] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-16T21:07:26.551222] [DEBUG] [LOCAL ] QXO: No existing data file found in primary storage. [2025-10-16T21:07:26.550370] [DEBUG] [LOCAL ] R: No existing data file found in primary storage. [2025-10-16T21:07:26.551337] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-16T21:07:26.551602] [WARN ] [MAIN ] R: No existing data found, performing full refresh instead. [2025-10-16T21:07:26.573150] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-16T21:07:26.568444] [WARN ] [MAIN ] QXO: No existing data found, performing full refresh instead. [2025-10-16T21:07:26.551527] [DEBUG] [LOCAL ] RA: No primary data file found to delete. [2025-10-16T21:07:26.572867] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:07:26.573663] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-16T21:07:26.573443] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-16T21:07:26.573801] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-16T21:07:26.593980] [DEBUG] [LOCAL ] RACE: No existing data file found in primary storage. [2025-10-16T21:07:26.602700] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-16T21:07:26.602763] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-16T21:07:26.636375] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-16T21:07:26.636625] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-16T21:07:26.636479] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-16T21:07:26.626768] [WARN ] [MAIN ] RACE: No existing data found, performing full refresh instead. [2025-10-16T21:07:26.762316] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-16T21:07:26.838756] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-16T21:07:26.913369] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-16T21:07:27.003395] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-16T21:07:27.760384] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:07:27.852054] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-10-16T21:07:27.845917] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:07:27.904969] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:07:27.913362] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-10-16T21:07:27.905703] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-10-16T21:07:28.128416] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:07:28.128869] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-10-16T21:07:29.274725] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T21:07:29.279898] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-16T21:07:29.305564] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T21:07:29.425279] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T21:07:29.542798] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-16T21:07:29.666860] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T21:07:30.342912] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-16T21:07:30.773772] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T21:07:31.069244] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T21:07:31.142828] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-16T21:07:31.942839] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-16T21:07:32.113938] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T21:07:32.491544] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T21:07:32.742912] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-16T21:07:33.012165] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T21:07:33.542847] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-16T21:07:33.688217] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T21:07:34.342822] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-16T21:07:35.141001] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T21:07:35.148071] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-16T21:07:35.688879] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T21:07:35.942840] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-16T21:07:36.391012] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-16T21:07:36.742812] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-16T21:07:37.542830] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-16T21:07:37.702121] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T21:07:38.342836] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-16T21:07:38.370685] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T21:07:38.531982] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T21:07:39.142862] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-16T21:07:39.942847] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-16T21:07:39.978860] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T21:07:40.207351] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T21:07:40.742885] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-16T21:07:41.542851] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-16T21:07:41.764154] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T21:07:41.824904] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T21:07:42.342858] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-16T21:07:43.147926] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-16T21:07:43.160567] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T21:07:43.942837] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-16T21:07:44.239776] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T21:07:44.315821] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T21:07:44.742873] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-16T21:07:45.528430] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T21:07:45.542768] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-16T21:07:46.217180] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T21:07:46.342803] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-16T21:07:47.148410] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-16T21:07:47.152256] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T21:07:47.499750] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T21:07:47.942848] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-16T21:07:48.261387] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-16T21:07:48.586145] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T21:07:48.589538] [INFO ] [REMOTE ] R: Full fetch complete (42107 records). [2025-10-16T21:07:48.589626] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-16T21:07:48.590269] [FATAL] [VALIDATOR ] R: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:07:48.590420] [FATAL] [MAIN ] R: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:07:48.590464] [WARN ] [MAIN ] R: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:07:48.590504] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-16T21:07:48.590575] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-16T21:07:48.590631] [INFO ] [LOCAL ] R: Starting deletion of derivative data. [2025-10-16T21:07:48.590716] [DEBUG] [LOCAL ] R: No derivative data file found to delete. [2025-10-16T21:07:48.590781] [INFO ] [MAIN ] Update Progress: 1761/2369 symbols completed. R took 22.7s. Estimated remaining: 1h 25m 32s. Rate: 7.1 symbols/min [2025-10-16T21:07:48.743977] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-16T21:07:48.761429] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:07:48.762256] [DEBUG] [LOCAL ] RAMP: No existing data file found in primary storage. [2025-10-16T21:07:48.762301] [WARN ] [MAIN ] RAMP: No existing data found, performing full refresh instead. [2025-10-16T21:07:48.762427] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-16T21:07:48.762469] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-16T21:07:48.762512] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-16T21:07:48.762545] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-16T21:07:49.115779] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:07:49.542806] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-16T21:07:50.342814] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-10-16T21:07:50.916550] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-16T21:07:50.993421] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T21:07:51.142830] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-16T21:07:51.384290] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T21:07:51.942813] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-16T21:07:52.742816] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-16T21:07:53.389484] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-16T21:07:53.521659] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T21:07:53.542767] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-16T21:07:54.342844] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-16T21:07:54.435425] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T21:07:54.989499] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T21:07:55.142833] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-16T21:07:55.823635] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T21:07:55.942884] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-16T21:07:56.742781] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-16T21:07:57.024889] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T21:07:57.139330] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T21:07:57.542832] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-16T21:07:58.347359] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-16T21:07:58.353374] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T21:07:59.142803] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-16T21:07:59.307087] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T21:07:59.662266] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T21:07:59.942808] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-16T21:08:00.677182] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T21:08:00.683511] [INFO ] [REMOTE ] RACE: Full fetch complete (48545 records). [2025-10-16T21:08:00.683724] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-16T21:08:00.684459] [FATAL] [VALIDATOR ] RACE: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:08:00.684554] [FATAL] [MAIN ] RACE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:08:00.684600] [WARN ] [MAIN ] RACE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:08:00.684667] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-16T21:08:00.684790] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-16T21:08:00.684830] [INFO ] [LOCAL ] RACE: Starting deletion of derivative data. [2025-10-16T21:08:00.684873] [DEBUG] [LOCAL ] RACE: No derivative data file found to delete. [2025-10-16T21:08:00.684981] [INFO ] [MAIN ] Update Progress: 1762/2369 symbols completed. RACE took 34.8s. Estimated remaining: 1h 25m 25s. Rate: 7.1 symbols/min [2025-10-16T21:08:00.750358] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-16T21:08:00.889984] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:08:00.890221] [DEBUG] [LOCAL ] RBA: No existing data file found in primary storage. [2025-10-16T21:08:00.890259] [WARN ] [MAIN ] RBA: No existing data found, performing full refresh instead. [2025-10-16T21:08:00.890384] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-16T21:08:00.890425] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-16T21:08:00.890468] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-16T21:08:00.890503] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-16T21:08:01.274084] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:08:01.461483] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-16T21:08:01.465043] [INFO ] [REMOTE ] RA: Full fetch complete (31617 records). [2025-10-16T21:08:01.465140] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-16T21:08:01.465906] [FATAL] [VALIDATOR ] RA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:08:01.466003] [FATAL] [MAIN ] RA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:08:01.466049] [WARN ] [MAIN ] RA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:08:01.466092] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-16T21:08:01.466157] [DEBUG] [LOCAL ] RA: No primary data file found to delete. [2025-10-16T21:08:01.466194] [INFO ] [LOCAL ] RA: Starting deletion of derivative data. [2025-10-16T21:08:01.466233] [DEBUG] [LOCAL ] RA: No derivative data file found to delete. [2025-10-16T21:08:01.466292] [INFO ] [MAIN ] Update Progress: 1763/2369 symbols completed. RA took 35.6s. Estimated remaining: 1h 25m 14s. Rate: 7.1 symbols/min [2025-10-16T21:08:01.545200] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-16T21:08:01.656101] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:08:01.656491] [DEBUG] [LOCAL ] RBC: No existing data file found in primary storage. [2025-10-16T21:08:01.656632] [WARN ] [MAIN ] RBC: No existing data found, performing full refresh instead. [2025-10-16T21:08:01.656820] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-16T21:08:01.656887] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-16T21:08:01.656936] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-16T21:08:01.656973] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-16T21:08:02.057614] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:08:02.095422] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.95 seconds). [2025-10-16T21:08:02.342840] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-10-16T21:08:03.142830] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-16T21:08:03.238675] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T21:08:03.942816] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-16T21:08:04.071001] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T21:08:04.742842] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-16T21:08:05.316601] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-16T21:08:05.542872] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-10-16T21:08:05.727629] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T21:08:06.342867] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-16T21:08:06.486846] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T21:08:06.547051] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-16T21:08:07.142815] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-16T21:08:07.942830] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-16T21:08:07.992203] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T21:08:08.244945] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T21:08:08.742820] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-16T21:08:09.542834] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-16T21:08:09.886669] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-16T21:08:10.002066] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T21:08:10.342836] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-16T21:08:10.366561] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-16T21:08:10.373159] [INFO ] [REMOTE ] QXO: Full fetch complete (75774 records). [2025-10-16T21:08:10.373275] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-16T21:08:10.374046] [FATAL] [VALIDATOR ] QXO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:08:10.374138] [FATAL] [MAIN ] QXO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:08:10.374181] [WARN ] [MAIN ] QXO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:08:10.374221] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-16T21:08:10.374278] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-16T21:08:10.374323] [INFO ] [LOCAL ] QXO: Starting deletion of derivative data. [2025-10-16T21:08:10.374360] [DEBUG] [LOCAL ] QXO: No derivative data file found to delete. [2025-10-16T21:08:10.374415] [INFO ] [MAIN ] Update Progress: 1764/2369 symbols completed. QXO took 44.5s. Estimated remaining: 1h 25m 6s. Rate: 7.1 symbols/min [2025-10-16T21:08:10.540240] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:08:10.540408] [DEBUG] [LOCAL ] RBLX: No existing data file found in primary storage. [2025-10-16T21:08:10.540445] [WARN ] [MAIN ] RBLX: No existing data found, performing full refresh instead. [2025-10-16T21:08:10.540556] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-16T21:08:10.540597] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-16T21:08:10.540637] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-16T21:08:10.540713] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-16T21:08:10.884517] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:08:11.142792] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-16T21:08:11.942888] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-16T21:08:12.360624] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-16T21:08:12.426020] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T21:08:12.742889] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-16T21:08:13.071580] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T21:08:13.542871] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-16T21:08:14.271402] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T21:08:14.342819] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-10-16T21:08:14.381941] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-16T21:08:15.142837] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-16T21:08:15.942800] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-16T21:08:16.646818] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T21:08:16.742784] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-16T21:08:16.834741] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-16T21:08:17.046294] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T21:08:17.542828] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-16T21:08:18.342785] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-16T21:08:18.370043] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T21:08:18.583994] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T21:08:19.142808] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-16T21:08:19.942842] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-16T21:08:19.981535] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T21:08:20.742828] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-10-16T21:08:21.096904] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-16T21:08:21.542861] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-16T21:08:21.596706] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T21:08:22.090154] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T21:08:22.308834] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T21:08:22.342815] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-16T21:08:23.142793] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-16T21:08:23.376453] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T21:08:23.891272] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T21:08:23.896452] [INFO ] [REMOTE ] RAMP: Full fetch complete (54177 records). [2025-10-16T21:08:23.896557] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-16T21:08:23.897212] [FATAL] [VALIDATOR ] RAMP: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:08:23.897316] [FATAL] [MAIN ] RAMP: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:08:23.897389] [WARN ] [MAIN ] RAMP: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:08:23.897487] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-16T21:08:23.897566] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-16T21:08:23.897603] [INFO ] [LOCAL ] RAMP: Starting deletion of derivative data. [2025-10-16T21:08:23.897670] [DEBUG] [LOCAL ] RAMP: No derivative data file found to delete. [2025-10-16T21:08:23.897749] [INFO ] [MAIN ] Update Progress: 1765/2369 symbols completed. RAMP took 35.3s. Estimated remaining: 1h 24m 59s. Rate: 7.1 symbols/min [2025-10-16T21:08:23.950070] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-16T21:08:24.067774] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:08:24.074518] [DEBUG] [LOCAL ] RBOT: Loaded 6064 existing records from primary storage. [2025-10-16T21:08:24.074741] [INFO ] [MAIN ] RBOT: Loaded 6064 existing records. [2025-10-16T21:08:24.253995] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:08:24.254250] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-16T21:08:24.254320] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-16T21:08:24.254691] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-10-16T21:08:24.254752] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-16T21:08:24.629706] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:08:24.742805] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-10-16T21:08:25.176524] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T21:08:25.542880] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-16T21:08:25.585988] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T21:08:26.342856] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-10-16T21:08:26.412137] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T21:08:26.414732] [INFO ] [REMOTE ] RBC: Full fetch complete (21598 records). [2025-10-16T21:08:26.414828] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-16T21:08:26.415311] [FATAL] [VALIDATOR ] RBC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:08:26.415408] [FATAL] [MAIN ] RBC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:08:26.415452] [WARN ] [MAIN ] RBC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:08:26.415492] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-16T21:08:26.415550] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-16T21:08:26.415587] [INFO ] [LOCAL ] RBC: Starting deletion of derivative data. [2025-10-16T21:08:26.415627] [DEBUG] [LOCAL ] RBC: No derivative data file found to delete. [2025-10-16T21:08:26.415728] [INFO ] [MAIN ] Update Progress: 1766/2369 symbols completed. RBC took 24.9s. Estimated remaining: 1h 24m 49s. Rate: 7.1 symbols/min [2025-10-16T21:08:26.584328] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:08:26.584511] [DEBUG] [LOCAL ] RBRK: No existing data file found in primary storage. [2025-10-16T21:08:26.584548] [WARN ] [MAIN ] RBRK: No existing data found, performing full refresh instead. [2025-10-16T21:08:26.584686] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-16T21:08:26.584743] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-16T21:08:26.584786] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-16T21:08:26.584820] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-16T21:08:26.932587] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:08:27.142807] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-10-16T21:08:27.942843] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-16T21:08:28.087902] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-16T21:08:28.742849] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-16T21:08:29.360333] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-16T21:08:29.542785] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-16T21:08:29.687275] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T21:08:30.249472] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-16T21:08:30.342872] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-16T21:08:31.142882] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-10-16T21:08:31.312362] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-16T21:08:31.592020] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-16T21:08:31.942862] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-16T21:08:32.742814] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-16T21:08:32.930838] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T21:08:33.522403] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-16T21:08:33.542777] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-16T21:08:33.868372] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-16T21:08:34.342867] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-16T21:08:35.067317] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T21:08:35.142810] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-16T21:08:35.767125] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T21:08:35.858200] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-16T21:08:35.942787] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-16T21:08:36.742832] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-16T21:08:37.542841] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-16T21:08:38.126516] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T21:08:38.293823] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-16T21:08:38.342797] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-16T21:08:38.919168] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-16T21:08:39.142844] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-10-16T21:08:39.942817] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-16T21:08:40.742832] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-16T21:08:40.785310] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-16T21:08:40.802772] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T21:08:40.835078] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T21:08:41.542829] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-16T21:08:42.190936] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-16T21:08:42.342810] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-16T21:08:42.780411] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-16T21:08:43.142799] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-16T21:08:43.942879] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-16T21:08:44.742794] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-10. [2025-10-16T21:08:44.912929] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T21:08:44.915517] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-16T21:08:45.319622] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-16T21:08:45.474853] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T21:08:45.480564] [INFO ] [REMOTE ] RBA: Full fetch complete (65902 records). [2025-10-16T21:08:45.480705] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-10-16T21:08:45.481514] [FATAL] [VALIDATOR ] RBA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:08:45.481605] [FATAL] [MAIN ] RBA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:08:45.481687] [WARN ] [MAIN ] RBA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:08:45.481773] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-16T21:08:45.481849] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-16T21:08:45.481886] [INFO ] [LOCAL ] RBA: Starting deletion of derivative data. [2025-10-16T21:08:45.481926] [DEBUG] [LOCAL ] RBA: No derivative data file found to delete. [2025-10-16T21:08:45.481983] [INFO ] [MAIN ] Update Progress: 1767/2369 symbols completed. RBA took 44.8s. Estimated remaining: 1h 24m 44s. Rate: 7.1 symbols/min [2025-10-16T21:08:45.547993] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-16T21:08:45.652759] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:08:45.694692] [DEBUG] [LOCAL ] RC: Loaded 48911 existing records from primary storage. [2025-10-16T21:08:45.695035] [INFO ] [MAIN ] RC: Loaded 48911 existing records. [2025-10-16T21:08:45.878122] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:08:45.878330] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-16T21:08:45.878377] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-16T21:08:45.879251] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-10-16T21:08:45.879308] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-16T21:08:46.242026] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:08:46.342798] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-16T21:08:46.686129] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T21:08:46.688614] [INFO ] [REMOTE ] RBOT: Full fetch complete (9267 records). [2025-10-16T21:08:46.688712] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-16T21:08:47.068420] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-10-16T21:08:47.068509] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-10-16T21:08:47.068805] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-10-16T21:08:47.068872] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-10-16T21:08:47.069429] [DEBUG] [LOCAL ] RBOT: Trimmed 9267 records to 6150 (keeping 200 days of data) [2025-10-16T21:08:47.103884] [DEBUG] [LOCAL ] RBOT: Primary data saved (6150 records). [2025-10-16T21:08:47.104015] [INFO ] [MAIN ] RBOT: Full history saved. [2025-10-16T21:08:47.104091] [INFO ] [MAIN ] Update Progress: 1768/2369 symbols completed. RBOT took 23.2s. Estimated remaining: 1h 24m 33s. Rate: 7.1 symbols/min [2025-10-16T21:08:47.148873] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-10-16T21:08:47.305418] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:08:47.305585] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-16T21:08:47.305661] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-16T21:08:47.305812] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-16T21:08:47.305885] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-16T21:08:47.305948] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-16T21:08:47.305981] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-16T21:08:47.680949] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:08:47.942821] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-16T21:08:48.433167] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-16T21:08:48.589449] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T21:08:48.742866] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-10-16T21:08:49.296050] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-16T21:08:49.542842] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-16T21:08:50.162953] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-16T21:08:50.342781] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-16T21:08:50.526542] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-16T21:08:51.124289] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T21:08:51.142770] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-16T21:08:51.942816] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-16T21:08:52.742789] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-16T21:08:52.887593] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T21:08:53.409002] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-16T21:08:53.542809] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-16T21:08:54.145391] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-16T21:08:54.342846] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-16T21:08:55.142852] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-16T21:08:55.942937] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-16T21:08:56.116192] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T21:08:56.297868] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-10-16T21:08:56.630840] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-16T21:08:56.742838] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-16T21:08:56.893330] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T21:08:57.542819] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-16T21:08:58.342825] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-16T21:08:59.142815] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-16T21:08:59.323741] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-16T21:08:59.558851] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-16T21:08:59.817559] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-16T21:08:59.942791] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-16T21:09:00.221069] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T21:09:00.742890] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-16T21:09:00.828421] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T21:09:00.835945] [INFO ] [REMOTE ] RBLX: Full fetch complete (77495 records). [2025-10-16T21:09:00.836181] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-16T21:09:00.837252] [FATAL] [VALIDATOR ] RBLX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:09:00.837355] [FATAL] [MAIN ] RBLX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:09:00.837400] [WARN ] [MAIN ] RBLX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:09:00.837445] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-16T21:09:00.837514] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-16T21:09:00.837552] [INFO ] [LOCAL ] RBLX: Starting deletion of derivative data. [2025-10-16T21:09:00.837594] [DEBUG] [LOCAL ] RBLX: No derivative data file found to delete. [2025-10-16T21:09:00.837687] [INFO ] [MAIN ] Update Progress: 1769/2369 symbols completed. RBLX took 50.5s. Estimated remaining: 1h 24m 26s. Rate: 7.1 symbols/min [2025-10-16T21:09:01.018979] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:09:01.019213] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-10-16T21:09:01.019255] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-10-16T21:09:01.019383] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-16T21:09:01.019426] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-16T21:09:01.019471] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-16T21:09:01.019505] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-16T21:09:01.407238] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:09:01.542807] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-10-16T21:09:02.342788] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-16T21:09:02.369329] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T21:09:02.674048] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-16T21:09:02.815326] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-16T21:09:02.822945] [INFO ] [REMOTE ] RBRK: Full fetch complete (76315 records). [2025-10-16T21:09:02.823128] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-16T21:09:02.824325] [FATAL] [VALIDATOR ] RBRK: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:09:02.824425] [FATAL] [MAIN ] RBRK: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:09:02.824477] [WARN ] [MAIN ] RBRK: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:09:02.824562] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-16T21:09:02.824683] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-16T21:09:02.824760] [INFO ] [LOCAL ] RBRK: Starting deletion of derivative data. [2025-10-16T21:09:02.824827] [DEBUG] [LOCAL ] RBRK: No derivative data file found to delete. [2025-10-16T21:09:02.824914] [INFO ] [MAIN ] Update Progress: 1770/2369 symbols completed. RBRK took 36.4s. Estimated remaining: 1h 24m 16s. Rate: 7.1 symbols/min [2025-10-16T21:09:03.019414] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:09:03.019669] [DEBUG] [LOCAL ] RCI: No existing data file found in primary storage. [2025-10-16T21:09:03.019738] [WARN ] [MAIN ] RCI: No existing data found, performing full refresh instead. [2025-10-16T21:09:03.019883] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-16T21:09:03.019925] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-16T21:09:03.019966] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-16T21:09:03.019998] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-16T21:09:03.148024] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-16T21:09:03.381935] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:09:03.942786] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-16T21:09:04.035688] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T21:09:04.724839] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T21:09:04.742806] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-16T21:09:05.542822] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-16T21:09:06.046351] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T21:09:06.189997] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-16T21:09:06.342801] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-10-16T21:09:07.142809] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-16T21:09:07.615738] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-16T21:09:07.942867] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-16T21:09:08.230167] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-16T21:09:08.742821] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-16T21:09:08.773114] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-16T21:09:09.542846] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-16T21:09:10.342836] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-16T21:09:10.547739] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-16T21:09:11.091165] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-16T21:09:11.142842] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-16T21:09:11.449341] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-16T21:09:11.841883] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T21:09:11.942858] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-16T21:09:12.476067] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-16T21:09:12.742843] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-16T21:09:13.542847] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-16T21:09:14.332495] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T21:09:14.342762] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-16T21:09:14.470440] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T21:09:15.017074] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-16T21:09:15.142835] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-16T21:09:15.826854] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-16T21:09:15.942807] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-16T21:09:16.742822] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-16T21:09:17.128617] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-16T21:09:17.129532] [INFO ] [REMOTE ] RCB: Full fetch complete (3742 records). [2025-10-16T21:09:17.129613] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-16T21:09:17.130025] [FATAL] [VALIDATOR ] RCB: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:09:17.130109] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:09:17.130173] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:09:17.130245] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-16T21:09:17.130308] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-16T21:09:17.130345] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-16T21:09:17.130384] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-16T21:09:17.130438] [INFO ] [MAIN ] Update Progress: 1771/2369 symbols completed. RCB took 30.0s. Estimated remaining: 1h 24m 9s. Rate: 7.1 symbols/min [2025-10-16T21:09:17.303238] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:09:17.303382] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-16T21:09:17.303417] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-16T21:09:17.303524] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-16T21:09:17.303565] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-16T21:09:17.303605] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-16T21:09:17.303638] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-16T21:09:17.553090] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-16T21:09:17.670792] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:09:17.768553] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T21:09:18.342863] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-16T21:09:19.142829] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-10-16T21:09:19.353010] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T21:09:19.942815] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-16T21:09:20.165470] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T21:09:20.397690] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T21:09:20.742814] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-16T21:09:21.029241] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-16T21:09:21.030068] [INFO ] [REMOTE ] RCD: Full fetch complete (6302 records). [2025-10-16T21:09:21.030140] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-16T21:09:21.030483] [FATAL] [VALIDATOR ] RCD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:09:21.030568] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:09:21.030611] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:09:21.030678] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-16T21:09:21.030753] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-16T21:09:21.030788] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-10-16T21:09:21.030825] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-10-16T21:09:21.030876] [INFO ] [MAIN ] Update Progress: 1772/2369 symbols completed. RCD took 20.2s. Estimated remaining: 1h 23m 59s. Rate: 7.1 symbols/min [2025-10-16T21:09:21.204947] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:09:21.218399] [DEBUG] [LOCAL ] RCS: Loaded 12292 existing records from primary storage. [2025-10-16T21:09:21.218627] [INFO ] [MAIN ] RCS: Loaded 12292 existing records. [2025-10-16T21:09:21.426425] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-16T21:09:21.432147] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:09:21.443295] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-16T21:09:21.443398] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-16T21:09:21.443598] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-10-16T21:09:21.443726] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-16T21:09:21.551310] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-16T21:09:21.820639] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:09:22.342826] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-10-16T21:09:23.142798] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-16T21:09:23.475680] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T21:09:23.723510] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-16T21:09:23.942800] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-16T21:09:24.742788] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-16T21:09:25.139220] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-16T21:09:25.542857] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-16T21:09:25.783553] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T21:09:26.342842] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-16T21:09:26.680938] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-16T21:09:27.142844] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-16T21:09:27.378522] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-16T21:09:27.689723] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T21:09:27.942845] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-16T21:09:28.742819] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-16T21:09:28.980357] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-16T21:09:29.542825] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-16T21:09:29.657785] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-16T21:09:29.664525] [INFO ] [REMOTE ] RC: Full fetch complete (71096 records). [2025-10-16T21:09:29.664706] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-16T21:09:29.827068] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T21:09:30.075824] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-10-16T21:09:30.075968] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-10-16T21:09:30.077903] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-10-16T21:09:30.078000] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-10-16T21:09:30.080333] [DEBUG] [LOCAL ] RC: Trimmed 71096 records to 49268 (keeping 200 days of data) [2025-10-16T21:09:30.351573] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-16T21:09:30.388300] [DEBUG] [LOCAL ] RC: Primary data saved (49268 records). [2025-10-16T21:09:30.388974] [INFO ] [MAIN ] RC: Full history saved. [2025-10-16T21:09:30.389789] [INFO ] [MAIN ] Update Progress: 1773/2369 symbols completed. RC took 44.9s. Estimated remaining: 1h 23m 51s. Rate: 7.1 symbols/min [2025-10-16T21:09:30.563176] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:09:30.563423] [DEBUG] [LOCAL ] RCUS: No existing data file found in primary storage. [2025-10-16T21:09:30.563462] [WARN ] [MAIN ] RCUS: No existing data found, performing full refresh instead. [2025-10-16T21:09:30.563590] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-16T21:09:30.563633] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-16T21:09:30.563722] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-16T21:09:30.563765] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-16T21:09:30.936951] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:09:31.142825] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-16T21:09:31.718285] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-16T21:09:31.763034] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-16T21:09:31.942815] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-16T21:09:32.062714] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T21:09:32.743398] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-10-16T21:09:32.746730] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T21:09:33.542826] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-16T21:09:34.342800] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-16T21:09:34.374701] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T21:09:34.391877] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T21:09:35.142841] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-16T21:09:35.942941] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-16T21:09:36.142477] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-16T21:09:36.143446] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T21:09:36.742875] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-16T21:09:37.139376] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T21:09:37.542803] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-16T21:09:37.807803] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T21:09:38.342833] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-16T21:09:39.039242] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T21:09:39.142803] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-16T21:09:39.942808] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-16T21:09:40.742786] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-16T21:09:40.912377] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-16T21:09:41.227761] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-16T21:09:41.252496] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T21:09:41.542818] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-16T21:09:42.205341] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T21:09:42.342804] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-16T21:09:43.142836] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-16T21:09:43.942840] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-16T21:09:44.043448] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-16T21:09:44.126909] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T21:09:44.742886] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-16T21:09:44.885217] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T21:09:44.929998] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T21:09:45.542870] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-16T21:09:46.342856] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-16T21:09:46.383981] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T21:09:46.390716] [INFO ] [REMOTE ] RCI: Full fetch complete (70326 records). [2025-10-16T21:09:46.390988] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-16T21:09:46.392179] [FATAL] [VALIDATOR ] RCI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:09:46.392278] [FATAL] [MAIN ] RCI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:09:46.392323] [WARN ] [MAIN ] RCI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:09:46.392366] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-16T21:09:46.392434] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-16T21:09:46.392473] [INFO ] [LOCAL ] RCI: Starting deletion of derivative data. [2025-10-16T21:09:46.392512] [DEBUG] [LOCAL ] RCI: No derivative data file found to delete. [2025-10-16T21:09:46.392581] [INFO ] [MAIN ] Update Progress: 1774/2369 symbols completed. RCI took 43.6s. Estimated remaining: 1h 23m 45s. Rate: 7.1 symbols/min [2025-10-16T21:09:46.570797] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:09:46.571022] [DEBUG] [LOCAL ] RDDT: No existing data file found in primary storage. [2025-10-16T21:09:46.571065] [WARN ] [MAIN ] RDDT: No existing data found, performing full refresh instead. [2025-10-16T21:09:46.571187] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-16T21:09:46.571274] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-16T21:09:46.571327] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-16T21:09:46.571362] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-16T21:09:46.969607] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:09:47.000380] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-16T21:09:47.142803] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-16T21:09:47.942859] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-16T21:09:48.015471] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T21:09:48.742879] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-16T21:09:49.031734] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T21:09:49.034855] [INFO ] [REMOTE ] RCS: Full fetch complete (19329 records). [2025-10-16T21:09:49.035001] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-16T21:09:49.434693] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-16T21:09:49.434894] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-16T21:09:49.435995] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-16T21:09:49.436226] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-16T21:09:49.437034] [DEBUG] [LOCAL ] RCS: Trimmed 19329 records to 12406 (keeping 200 days of data) [2025-10-16T21:09:49.516742] [DEBUG] [LOCAL ] RCS: Primary data saved (12406 records). [2025-10-16T21:09:49.517044] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-16T21:09:49.517171] [INFO ] [MAIN ] Update Progress: 1775/2369 symbols completed. RCS took 28.5s. Estimated remaining: 1h 23m 35s. Rate: 7.1 symbols/min [2025-10-16T21:09:49.549175] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-10-16T21:09:49.672960] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-16T21:09:49.762496] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:09:49.763145] [DEBUG] [LOCAL ] RDN: No existing data file found in primary storage. [2025-10-16T21:09:49.763191] [WARN ] [MAIN ] RDN: No existing data found, performing full refresh instead. [2025-10-16T21:09:49.763305] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-16T21:09:49.763347] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-16T21:09:49.763388] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-16T21:09:49.763420] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-16T21:09:50.111128] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:09:50.342835] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-10-16T21:09:50.382043] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T21:09:51.142854] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-16T21:09:51.942789] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-16T21:09:52.019636] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T21:09:52.201519] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-16T21:09:52.742787] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-16T21:09:53.380488] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-16T21:09:53.530998] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T21:09:53.542770] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-16T21:09:54.017327] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T21:09:54.342831] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-16T21:09:55.142844] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-16T21:09:55.313286] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T21:09:55.942802] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-16T21:09:56.742909] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-16T21:09:56.859557] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-16T21:09:56.912880] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T21:09:57.537003] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T21:09:57.545729] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-16T21:09:57.721234] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T21:09:58.342862] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-16T21:09:59.142820] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-16T21:09:59.346292] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-16T21:09:59.942842] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-16T21:10:00.005913] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T21:10:00.012486] [INFO ] [REMOTE ] RCL: Full fetch complete (75077 records). [2025-10-16T21:10:00.012672] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-16T21:10:00.013554] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:10:00.013668] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:10:00.013728] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:10:00.013773] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-16T21:10:00.013867] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-16T21:10:00.013954] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-16T21:10:00.014024] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-10-16T21:10:00.014085] [INFO ] [MAIN ] Update Progress: 1776/2369 symbols completed. RCL took 42.9s. Estimated remaining: 1h 23m 27s. Rate: 7.1 symbols/min [2025-10-16T21:10:00.194231] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:10:00.194405] [DEBUG] [LOCAL ] RDW: No existing data file found in primary storage. [2025-10-16T21:10:00.194476] [WARN ] [MAIN ] RDW: No existing data found, performing full refresh instead. [2025-10-16T21:10:00.194595] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-16T21:10:00.194639] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-16T21:10:00.194730] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-16T21:10:00.194768] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-16T21:10:00.559885] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:10:00.575051] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-16T21:10:00.582393] [INFO ] [REMOTE ] RCUS: Full fetch complete (60453 records). [2025-10-16T21:10:00.582524] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-16T21:10:00.583311] [FATAL] [VALIDATOR ] RCUS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:10:00.583401] [FATAL] [MAIN ] RCUS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:10:00.583477] [WARN ] [MAIN ] RCUS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:10:00.583565] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-16T21:10:00.583738] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-16T21:10:00.583967] [INFO ] [LOCAL ] RCUS: Starting deletion of derivative data. [2025-10-16T21:10:00.584097] [DEBUG] [LOCAL ] RCUS: No derivative data file found to delete. [2025-10-16T21:10:00.584187] [INFO ] [MAIN ] Update Progress: 1777/2369 symbols completed. RCUS took 30.2s. Estimated remaining: 1h 23m 16s. Rate: 7.1 symbols/min [2025-10-16T21:10:00.761669] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-10-16T21:10:00.791795] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-16T21:10:00.790216] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:10:00.791986] [DEBUG] [LOCAL ] RDY: No existing data file found in primary storage. [2025-10-16T21:10:00.792059] [WARN ] [MAIN ] RDY: No existing data found, performing full refresh instead. [2025-10-16T21:10:00.802042] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-16T21:10:00.802254] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-16T21:10:00.802686] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-16T21:10:00.802996] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-16T21:10:01.153481] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:10:01.542817] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-16T21:10:02.342851] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-10-16T21:10:03.123862] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-16T21:10:03.142793] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-16T21:10:03.805754] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-16T21:10:03.942838] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-16T21:10:04.154990] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T21:10:04.742837] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-16T21:10:05.398325] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-16T21:10:05.542875] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-16T21:10:05.845738] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T21:10:06.265718] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T21:10:06.342795] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-16T21:10:07.142930] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-16T21:10:07.676475] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-16T21:10:07.759605] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T21:10:07.942808] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-16T21:10:08.742812] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-16T21:10:09.104509] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-16T21:10:09.542852] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-16T21:10:09.946880] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-16T21:10:10.342852] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-16T21:10:10.992355] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-16T21:10:11.142796] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-16T21:10:11.302746] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T21:10:11.942807] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-16T21:10:12.742813] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-16T21:10:12.796731] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-16T21:10:13.207625] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-16T21:10:13.542744] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-16T21:10:13.642041] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T21:10:14.139386] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T21:10:14.342861] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-16T21:10:15.142828] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-16T21:10:15.942819] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-16T21:10:16.147322] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T21:10:16.382287] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-10-16T21:10:16.742797] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-16T21:10:16.918547] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T21:10:17.542824] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-16T21:10:18.142422] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-16T21:10:18.342868] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-16T21:10:18.845613] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T21:10:19.142788] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-16T21:10:19.344894] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-16T21:10:19.942817] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-16T21:10:19.962293] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-16T21:10:19.967975] [INFO ] [REMOTE ] RDN: Full fetch complete (65712 records). [2025-10-16T21:10:19.968153] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-16T21:10:19.969335] [FATAL] [VALIDATOR ] RDN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:10:19.969438] [FATAL] [MAIN ] RDN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:10:19.969575] [WARN ] [MAIN ] RDN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:10:19.969617] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-16T21:10:19.969706] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-16T21:10:19.969768] [INFO ] [LOCAL ] RDN: Starting deletion of derivative data. [2025-10-16T21:10:19.969860] [DEBUG] [LOCAL ] RDN: No derivative data file found to delete. [2025-10-16T21:10:19.970293] [INFO ] [MAIN ] Update Progress: 1778/2369 symbols completed. RDN took 30.5s. Estimated remaining: 1h 23m 11s. Rate: 7.1 symbols/min [2025-10-16T21:10:20.140192] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:10:20.140369] [DEBUG] [LOCAL ] RELX: No existing data file found in primary storage. [2025-10-16T21:10:20.140408] [WARN ] [MAIN ] RELX: No existing data found, performing full refresh instead. [2025-10-16T21:10:20.140543] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-16T21:10:20.140596] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-16T21:10:20.140670] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-16T21:10:20.140726] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-16T21:10:20.501559] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:10:20.534539] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-16T21:10:20.742778] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-10-16T21:10:21.542844] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-16T21:10:22.310717] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T21:10:22.342803] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-16T21:10:22.730355] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-10-16T21:10:23.142925] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-16T21:10:23.900330] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-16T21:10:23.942829] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-16T21:10:24.047205] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T21:10:24.742913] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-16T21:10:25.542874] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-16T21:10:25.760042] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-16T21:10:25.939943] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T21:10:26.342783] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-16T21:10:26.455926] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-16T21:10:27.142877] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-16T21:10:27.430435] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-16T21:10:27.942844] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-16T21:10:28.742842] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-16T21:10:29.127848] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-10-16T21:10:29.542851] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-16T21:10:29.661410] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-16T21:10:29.827435] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T21:10:29.904668] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-16T21:10:29.911163] [INFO ] [REMOTE ] RDDT: Full fetch complete (77540 records). [2025-10-16T21:10:29.911297] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-16T21:10:29.912038] [FATAL] [VALIDATOR ] RDDT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:10:29.912131] [FATAL] [MAIN ] RDDT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:10:29.912178] [WARN ] [MAIN ] RDDT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:10:29.912256] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-16T21:10:29.912364] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-16T21:10:29.912429] [INFO ] [LOCAL ] RDDT: Starting deletion of derivative data. [2025-10-16T21:10:29.912488] [DEBUG] [LOCAL ] RDDT: No derivative data file found to delete. [2025-10-16T21:10:29.912562] [INFO ] [MAIN ] Update Progress: 1779/2369 symbols completed. RDDT took 43.5s. Estimated remaining: 1h 23m 3s. Rate: 7.1 symbols/min [2025-10-16T21:10:30.084929] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:10:30.125024] [DEBUG] [LOCAL ] RERE: Loaded 41543 existing records from primary storage. [2025-10-16T21:10:30.125325] [INFO ] [MAIN ] RERE: Loaded 41543 existing records. [2025-10-16T21:10:30.298951] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:10:30.299158] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-16T21:10:30.299206] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-16T21:10:30.299711] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-10-16T21:10:30.299769] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-16T21:10:30.352133] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-16T21:10:30.682447] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:10:30.713594] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-16T21:10:31.142830] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-10-16T21:10:31.279375] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T21:10:31.285680] [INFO ] [REMOTE ] RDW: Full fetch complete (75050 records). [2025-10-16T21:10:31.285815] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-16T21:10:31.286522] [FATAL] [VALIDATOR ] RDW: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:10:31.286612] [FATAL] [MAIN ] RDW: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:10:31.286686] [WARN ] [MAIN ] RDW: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:10:31.286742] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-16T21:10:31.286802] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-16T21:10:31.286836] [INFO ] [LOCAL ] RDW: Starting deletion of derivative data. [2025-10-16T21:10:31.286875] [DEBUG] [LOCAL ] RDW: No derivative data file found to delete. [2025-10-16T21:10:31.286929] [INFO ] [MAIN ] Update Progress: 1780/2369 symbols completed. RDW took 31.3s. Estimated remaining: 1h 22m 53s. Rate: 7.1 symbols/min [2025-10-16T21:10:31.457718] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:10:31.512422] [DEBUG] [LOCAL ] RES: Loaded 46957 existing records from primary storage. [2025-10-16T21:10:31.512740] [INFO ] [MAIN ] RES: Loaded 46957 existing records. [2025-10-16T21:10:31.687326] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:10:31.687543] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-16T21:10:31.687603] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-16T21:10:31.687860] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-10-16T21:10:31.687923] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-16T21:10:31.947897] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-16T21:10:32.053438] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:10:32.742814] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-10-16T21:10:32.909897] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T21:10:33.542840] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-16T21:10:33.684031] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T21:10:34.342887] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-16T21:10:34.467202] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T21:10:35.142823] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-16T21:10:35.425972] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T21:10:35.622848] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T21:10:35.942844] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-16T21:10:36.742807] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-16T21:10:36.783341] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T21:10:37.512449] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T21:10:37.542774] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-16T21:10:38.260296] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T21:10:38.342777] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-16T21:10:39.093506] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T21:10:39.099253] [INFO ] [REMOTE ] RDY: Full fetch complete (68536 records). [2025-10-16T21:10:39.099368] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-16T21:10:39.100050] [FATAL] [VALIDATOR ] RDY: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:10:39.100181] [FATAL] [MAIN ] RDY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:10:39.100242] [WARN ] [MAIN ] RDY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:10:39.100308] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-16T21:10:39.100370] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-16T21:10:39.100406] [INFO ] [LOCAL ] RDY: Starting deletion of derivative data. [2025-10-16T21:10:39.100444] [DEBUG] [LOCAL ] RDY: No derivative data file found to delete. [2025-10-16T21:10:39.100499] [INFO ] [MAIN ] Update Progress: 1781/2369 symbols completed. RDY took 38.5s. Estimated remaining: 1h 22m 44s. Rate: 7.1 symbols/min [2025-10-16T21:10:39.154841] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-16T21:10:39.280823] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:10:39.281102] [DEBUG] [LOCAL ] REVG: No existing data file found in primary storage. [2025-10-16T21:10:39.281205] [WARN ] [MAIN ] REVG: No existing data found, performing full refresh instead. [2025-10-16T21:10:39.281395] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-16T21:10:39.281509] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-16T21:10:39.281628] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-16T21:10:39.281755] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-16T21:10:39.463832] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T21:10:39.680599] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:10:39.942799] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-10-16T21:10:40.742820] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-16T21:10:40.963682] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T21:10:41.136078] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T21:10:41.542790] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-16T21:10:42.346030] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-16T21:10:42.348621] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T21:10:43.142804] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-16T21:10:43.277094] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T21:10:43.895057] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T21:10:43.942769] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-16T21:10:44.742783] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-16T21:10:45.123149] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T21:10:45.412776] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T21:10:45.542845] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-16T21:10:46.342858] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-16T21:10:46.542288] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-16T21:10:47.142782] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-16T21:10:47.593699] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-16T21:10:47.942819] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-16T21:10:48.119828] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T21:10:48.742838] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-16T21:10:49.249803] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-16T21:10:49.500420] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T21:10:49.542848] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-16T21:10:50.342835] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-16T21:10:51.004839] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-16T21:10:51.142852] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-16T21:10:51.457005] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-16T21:10:51.710970] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T21:10:51.895108] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T21:10:51.904874] [INFO ] [REMOTE ] RELX: Full fetch complete (67868 records). [2025-10-16T21:10:51.905089] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-16T21:10:51.906215] [FATAL] [VALIDATOR ] RELX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:10:51.906365] [FATAL] [MAIN ] RELX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:10:51.906422] [WARN ] [MAIN ] RELX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:10:51.906505] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-16T21:10:51.906589] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-16T21:10:51.906636] [INFO ] [LOCAL ] RELX: Starting deletion of derivative data. [2025-10-16T21:10:51.906746] [DEBUG] [LOCAL ] RELX: No derivative data file found to delete. [2025-10-16T21:10:51.906831] [INFO ] [MAIN ] Update Progress: 1782/2369 symbols completed. RELX took 31.9s. Estimated remaining: 1h 22m 37s. Rate: 7.1 symbols/min [2025-10-16T21:10:51.947991] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-16T21:10:52.138741] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:10:52.138946] [DEBUG] [LOCAL ] REX: No existing data file found in primary storage. [2025-10-16T21:10:52.138999] [WARN ] [MAIN ] REX: No existing data found, performing full refresh instead. [2025-10-16T21:10:52.139139] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-16T21:10:52.139205] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-16T21:10:52.139260] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-16T21:10:52.139294] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-16T21:10:52.513986] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:10:52.742824] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-16T21:10:53.542840] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-16T21:10:53.606062] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-16T21:10:54.342871] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-10-16T21:10:54.585260] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-16T21:10:55.142800] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-16T21:10:55.174033] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T21:10:55.379344] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T21:10:55.942882] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-16T21:10:56.742797] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-16T21:10:57.003679] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-16T21:10:57.359978] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T21:10:57.542877] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-16T21:10:58.342909] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-16T21:10:58.469710] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T21:10:58.618905] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T21:10:59.142816] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-16T21:10:59.942894] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-16T21:11:00.133103] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T21:11:00.173699] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T21:11:00.742848] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-16T21:11:01.542918] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-16T21:11:02.342913] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-16T21:11:03.364097] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T21:11:03.375881] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-16T21:11:04.032404] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T21:11:04.043799] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-16T21:11:05.035540] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (5.09 seconds). [2025-10-16T21:11:05.046132] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-16T21:11:05.118127] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T21:11:05.542839] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-16T21:11:05.764766] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (5.02 seconds). [2025-10-16T21:11:06.342820] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-16T21:11:07.529640] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T21:11:07.533971] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-16T21:11:07.751150] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (3.71 seconds). [2025-10-16T21:11:07.942793] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-16T21:11:08.807124] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (3.76 seconds). [2025-10-16T21:11:08.816790] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-16T21:11:09.264952] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (3.72 seconds). [2025-10-16T21:11:09.270703] [INFO ] [REMOTE ] RERE: Full fetch complete (57788 records). [2025-10-16T21:11:09.270826] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-16T21:11:09.582097] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-16T21:11:09.627533] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-16T21:11:09.686601] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-10-16T21:11:09.695248] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-10-16T21:11:09.696232] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-10-16T21:11:09.696845] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-10-16T21:11:09.697355] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T21:11:09.705239] [DEBUG] [LOCAL ] RERE: Trimmed 57788 records to 41810 (keeping 200 days of data) [2025-10-16T21:11:09.705143] [INFO ] [REMOTE ] RES: Full fetch complete (68776 records). [2025-10-16T21:11:09.705765] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-16T21:11:10.313092] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-10-16T21:11:10.313766] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-10-16T21:11:10.318241] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-10-16T21:11:10.320429] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-10-16T21:11:10.334586] [DEBUG] [LOCAL ] RES: Trimmed 68776 records to 47297 (keeping 200 days of data) [2025-10-16T21:11:10.337886] [DEBUG] [LOCAL ] RERE: Primary data saved (41810 records). [2025-10-16T21:11:10.337956] [INFO ] [MAIN ] RERE: Full history saved. [2025-10-16T21:11:10.338037] [INFO ] [MAIN ] Update Progress: 1783/2369 symbols completed. RERE took 40.4s. Estimated remaining: 1h 22m 32s. Rate: 7.1 symbols/min [2025-10-16T21:11:10.688588] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:11:10.719214] [DEBUG] [LOCAL ] REXR: No existing data file found in primary storage. [2025-10-16T21:11:10.722725] [WARN ] [MAIN ] REXR: No existing data found, performing full refresh instead. [2025-10-16T21:11:10.736329] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-16T21:11:10.738207] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T21:11:10.738370] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-16T21:11:10.750568] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-16T21:11:10.745495] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-16T21:11:10.763880] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-16T21:11:10.885727] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-16T21:11:11.132156] [DEBUG] [LOCAL ] RES: Primary data saved (47297 records). [2025-10-16T21:11:11.143127] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-16T21:11:11.143966] [INFO ] [MAIN ] RES: Full history saved. [2025-10-16T21:11:11.166805] [INFO ] [MAIN ] Update Progress: 1784/2369 symbols completed. RES took 39.9s. Estimated remaining: 1h 22m 21s. Rate: 7.1 symbols/min [2025-10-16T21:11:11.358514] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:11:11.414293] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:11:11.414417] [DEBUG] [LOCAL ] REZI: No existing data file found in primary storage. [2025-10-16T21:11:11.414453] [WARN ] [MAIN ] REZI: No existing data found, performing full refresh instead. [2025-10-16T21:11:11.414564] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-16T21:11:11.414604] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-16T21:11:11.414668] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-16T21:11:11.414723] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-16T21:11:11.765769] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:11:11.773839] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-16T21:11:11.887851] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T21:11:11.892756] [INFO ] [REMOTE ] REVG: Full fetch complete (57808 records). [2025-10-16T21:11:11.892851] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-16T21:11:11.893675] [FATAL] [VALIDATOR ] REVG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:11:11.893770] [FATAL] [MAIN ] REVG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:11:11.893869] [WARN ] [MAIN ] REVG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:11:11.893966] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-16T21:11:11.894050] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-16T21:11:11.894087] [INFO ] [LOCAL ] REVG: Starting deletion of derivative data. [2025-10-16T21:11:11.894126] [DEBUG] [LOCAL ] REVG: No derivative data file found to delete. [2025-10-16T21:11:11.894179] [INFO ] [MAIN ] Update Progress: 1785/2369 symbols completed. REVG took 32.8s. Estimated remaining: 1h 22m 10s. Rate: 7.1 symbols/min [2025-10-16T21:11:11.947905] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-10-16T21:11:12.067382] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:11:12.067534] [DEBUG] [LOCAL ] RF: No existing data file found in primary storage. [2025-10-16T21:11:12.067571] [WARN ] [MAIN ] RF: No existing data found, performing full refresh instead. [2025-10-16T21:11:12.067733] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-16T21:11:12.067791] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-16T21:11:12.067836] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-16T21:11:12.067869] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-16T21:11:12.413905] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:11:12.742805] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-16T21:11:13.542776] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-10-16T21:11:13.784851] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-16T21:11:13.909670] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-16T21:11:14.342896] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-10-16T21:11:15.142864] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-16T21:11:15.378891] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-16T21:11:15.942808] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-16T21:11:16.112499] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T21:11:16.300187] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T21:11:16.742863] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-16T21:11:17.542922] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-16T21:11:17.831717] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-16T21:11:18.342857] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-16T21:11:19.062316] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T21:11:19.074880] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-16T21:11:19.142785] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-16T21:11:19.942787] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-16T21:11:20.124635] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T21:11:20.742789] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-16T21:11:20.945152] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T21:11:21.542818] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-16T21:11:21.720263] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T21:11:22.216081] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T21:11:22.218942] [INFO ] [REMOTE ] REX: Full fetch complete (20988 records). [2025-10-16T21:11:22.219055] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-16T21:11:22.219555] [FATAL] [VALIDATOR ] REX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:11:22.219660] [FATAL] [MAIN ] REX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:11:22.219720] [WARN ] [MAIN ] REX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:11:22.219762] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-16T21:11:22.219817] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-16T21:11:22.219851] [INFO ] [LOCAL ] REX: Starting deletion of derivative data. [2025-10-16T21:11:22.219889] [DEBUG] [LOCAL ] REX: No derivative data file found to delete. [2025-10-16T21:11:22.219942] [INFO ] [MAIN ] Update Progress: 1786/2369 symbols completed. REX took 30.3s. Estimated remaining: 1h 22m 2s. Rate: 7.1 symbols/min [2025-10-16T21:11:22.345246] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-16T21:11:22.397117] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:11:22.409749] [DEBUG] [LOCAL ] RFI: Loaded 10434 existing records from primary storage. [2025-10-16T21:11:22.410001] [INFO ] [MAIN ] RFI: Loaded 10434 existing records. [2025-10-16T21:11:22.587292] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:11:22.587803] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-16T21:11:22.587906] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-16T21:11:22.588337] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-10-16T21:11:22.588475] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-16T21:11:22.984813] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-16T21:11:22.990363] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:11:23.142851] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-16T21:11:23.737126] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T21:11:23.942804] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-16T21:11:24.742791] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-16T21:11:25.135951] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T21:11:25.542882] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-10-16T21:11:25.855340] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-16T21:11:26.251431] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T21:11:26.342780] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-16T21:11:26.528760] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T21:11:27.142828] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-16T21:11:27.942838] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-16T21:11:28.284681] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-16T21:11:28.742880] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-16T21:11:29.120875] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-16T21:11:29.164702] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T21:11:29.542820] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-16T21:11:29.688085] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T21:11:30.342852] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-16T21:11:31.006984] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T21:11:31.142845] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-16T21:11:31.942836] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-16T21:11:32.162547] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T21:11:32.742835] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-16T21:11:32.822315] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T21:11:32.896699] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-16T21:11:33.542873] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-16T21:11:34.345024] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-16T21:11:34.351134] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T21:11:34.392401] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-16T21:11:35.142890] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-16T21:11:35.942780] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-16T21:11:36.162610] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-16T21:11:36.203023] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-16T21:11:36.742920] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-16T21:11:37.542876] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-16T21:11:37.634290] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-16T21:11:37.887434] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-16T21:11:38.342822] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-16T21:11:39.142875] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-16T21:11:39.240516] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-16T21:11:39.314988] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T21:11:39.942884] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-16T21:11:40.584863] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T21:11:40.591160] [INFO ] [REMOTE ] REZI: Full fetch complete (65784 records). [2025-10-16T21:11:40.591330] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-16T21:11:40.592451] [FATAL] [VALIDATOR ] REZI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:11:40.592554] [FATAL] [MAIN ] REZI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:11:40.592598] [WARN ] [MAIN ] REZI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:11:40.592638] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-16T21:11:40.592751] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-16T21:11:40.592798] [INFO ] [LOCAL ] REZI: Starting deletion of derivative data. [2025-10-16T21:11:40.592840] [DEBUG] [LOCAL ] REZI: No derivative data file found to delete. [2025-10-16T21:11:40.592898] [INFO ] [MAIN ] Update Progress: 1787/2369 symbols completed. REZI took 29.4s. Estimated remaining: 1h 21m 57s. Rate: 7.1 symbols/min [2025-10-16T21:11:40.764259] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-16T21:11:40.768364] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:11:40.816403] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T21:11:40.831796] [DEBUG] [LOCAL ] RFL: Loaded 11445 existing records from primary storage. [2025-10-16T21:11:40.832460] [INFO ] [MAIN ] RFL: Loaded 11445 existing records. [2025-10-16T21:11:41.010747] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:11:41.010956] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-16T21:11:41.011002] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-16T21:11:41.011182] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-10-16T21:11:41.011237] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-16T21:11:41.374681] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:11:41.542811] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-10-16T21:11:42.283629] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T21:11:42.342825] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-16T21:11:42.614861] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-16T21:11:43.015945] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T21:11:43.142819] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-16T21:11:43.942871] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-16T21:11:44.742788] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-16T21:11:45.200903] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-16T21:11:45.434482] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-16T21:11:45.542812] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-16T21:11:46.273016] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T21:11:46.342838] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-16T21:11:46.946614] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (3.00 seconds). [2025-10-16T21:11:47.142828] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-16T21:11:47.195502] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T21:11:47.202041] [INFO ] [REMOTE ] RF: Full fetch complete (77406 records). [2025-10-16T21:11:47.202205] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-16T21:11:47.203061] [FATAL] [VALIDATOR ] RF: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:11:47.203165] [FATAL] [MAIN ] RF: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:11:47.203241] [WARN ] [MAIN ] RF: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:11:47.203334] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-16T21:11:47.203429] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-16T21:11:47.203497] [INFO ] [LOCAL ] RF: Starting deletion of derivative data. [2025-10-16T21:11:47.203547] [DEBUG] [LOCAL ] RF: No derivative data file found to delete. [2025-10-16T21:11:47.203604] [INFO ] [MAIN ] Update Progress: 1788/2369 symbols completed. RF took 35.3s. Estimated remaining: 1h 21m 48s. Rate: 7.1 symbols/min [2025-10-16T21:11:47.375478] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:11:47.382507] [DEBUG] [LOCAL ] RFM: Loaded 4156 existing records from primary storage. [2025-10-16T21:11:47.382747] [INFO ] [MAIN ] RFM: Loaded 4156 existing records. [2025-10-16T21:11:47.556410] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:11:47.556667] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-16T21:11:47.556728] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-16T21:11:47.556868] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-10-16T21:11:47.556906] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-16T21:11:47.919015] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:11:47.942787] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-16T21:11:48.049807] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T21:11:48.742866] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-10-16T21:11:49.542783] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-16T21:11:49.607414] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-16T21:11:49.957399] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T21:11:50.342870] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-16T21:11:50.471210] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T21:11:51.057231] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-16T21:11:51.142811] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-16T21:11:51.942809] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-16T21:11:52.742790] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-16T21:11:53.135494] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-16T21:11:53.174484] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T21:11:53.497457] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T21:11:53.542832] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-16T21:11:54.342868] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-16T21:11:55.040887] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T21:11:55.099196] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T21:11:55.101612] [INFO ] [REMOTE ] RFI: Full fetch complete (15385 records). [2025-10-16T21:11:55.101744] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-16T21:11:55.149551] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-16T21:11:55.512826] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-16T21:11:55.512933] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-16T21:11:55.513269] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-16T21:11:55.513305] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-16T21:11:55.513812] [DEBUG] [LOCAL ] RFI: Trimmed 15385 records to 10479 (keeping 200 days of data) [2025-10-16T21:11:55.576063] [DEBUG] [LOCAL ] RFI: Primary data saved (10479 records). [2025-10-16T21:11:55.576195] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-16T21:11:55.576278] [INFO ] [MAIN ] Update Progress: 1789/2369 symbols completed. RFI took 33.4s. Estimated remaining: 1h 21m 39s. Rate: 7.1 symbols/min [2025-10-16T21:11:55.746066] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:11:55.756379] [DEBUG] [LOCAL ] RFMZ: Loaded 8716 existing records from primary storage. [2025-10-16T21:11:55.756580] [INFO ] [MAIN ] RFMZ: Loaded 8716 existing records. [2025-10-16T21:11:55.936211] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:11:55.936412] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-16T21:11:55.936482] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-16T21:11:55.936690] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-10-16T21:11:55.936747] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-16T21:11:55.948050] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-16T21:11:56.295494] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:11:56.656220] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-16T21:11:56.742814] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-16T21:11:57.542903] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-10-16T21:11:57.756285] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T21:11:58.140379] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (2.99 seconds). [2025-10-16T21:11:58.342895] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-16T21:11:59.142846] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-16T21:11:59.221551] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T21:11:59.332299] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T21:11:59.942808] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-16T21:12:00.035915] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T21:12:00.042512] [INFO ] [REMOTE ] REXR: Full fetch complete (74941 records). [2025-10-16T21:12:00.042721] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-16T21:12:00.043582] [FATAL] [VALIDATOR ] REXR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:12:00.043735] [FATAL] [MAIN ] REXR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:12:00.043802] [WARN ] [MAIN ] REXR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:12:00.043874] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-16T21:12:00.043940] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-16T21:12:00.043976] [INFO ] [LOCAL ] REXR: Starting deletion of derivative data. [2025-10-16T21:12:00.044016] [DEBUG] [LOCAL ] REXR: No derivative data file found to delete. [2025-10-16T21:12:00.044074] [INFO ] [MAIN ] Update Progress: 1790/2369 symbols completed. REXR took 49.7s. Estimated remaining: 1h 21m 30s. Rate: 7.1 symbols/min [2025-10-16T21:12:00.219542] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:12:00.219734] [DEBUG] [LOCAL ] RGA: No existing data file found in primary storage. [2025-10-16T21:12:00.219781] [WARN ] [MAIN ] RGA: No existing data found, performing full refresh instead. [2025-10-16T21:12:00.219893] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-16T21:12:00.219934] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-16T21:12:00.219974] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-16T21:12:00.220006] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-16T21:12:00.582169] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:12:00.742841] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-16T21:12:01.090281] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T21:12:01.281072] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-16T21:12:01.542918] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-16T21:12:02.342826] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-10-16T21:12:02.387372] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T21:12:02.393484] [INFO ] [REMOTE ] RFL: Full fetch complete (13208 records). [2025-10-16T21:12:02.393769] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-16T21:12:02.756833] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-10-16T21:12:02.756914] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-10-16T21:12:02.757268] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-10-16T21:12:02.757330] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-10-16T21:12:02.757843] [DEBUG] [LOCAL ] RFL: Trimmed 13208 records to 11494 (keeping 200 days of data) [2025-10-16T21:12:02.827149] [DEBUG] [LOCAL ] RFL: Primary data saved (11494 records). [2025-10-16T21:12:02.827338] [INFO ] [MAIN ] RFL: Full history saved. [2025-10-16T21:12:02.827424] [INFO ] [MAIN ] Update Progress: 1791/2369 symbols completed. RFL took 22.2s. Estimated remaining: 1h 21m 19s. Rate: 7.1 symbols/min [2025-10-16T21:12:02.994905] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:12:02.995072] [DEBUG] [LOCAL ] RGR: No existing data file found in primary storage. [2025-10-16T21:12:02.995107] [WARN ] [MAIN ] RGR: No existing data found, performing full refresh instead. [2025-10-16T21:12:02.995218] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-16T21:12:02.995258] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-16T21:12:02.995299] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-16T21:12:02.995330] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-16T21:12:03.153420] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-16T21:12:03.366821] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:12:03.943058] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-16T21:12:03.947350] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T21:12:03.983323] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T21:12:04.742853] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-10-16T21:12:04.800746] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T21:12:05.542928] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-16T21:12:05.983112] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T21:12:06.092771] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T21:12:06.342826] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-16T21:12:07.142826] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-16T21:12:07.895169] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T21:12:07.942768] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-16T21:12:08.383964] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-16T21:12:08.742810] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-16T21:12:09.542784] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-16T21:12:09.566553] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T21:12:09.616503] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T21:12:10.257027] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T21:12:10.342789] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-16T21:12:11.142777] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-16T21:12:11.518551] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T21:12:11.865099] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T21:12:11.942782] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-16T21:12:12.742787] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-16T21:12:12.811355] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-16T21:12:13.211902] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T21:12:13.542814] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-16T21:12:14.342823] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-16T21:12:14.704943] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-16T21:12:15.049411] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T21:12:15.142793] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-16T21:12:15.942810] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-16T21:12:16.373764] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T21:12:16.742809] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-16T21:12:17.306332] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-16T21:12:17.542829] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-16T21:12:17.663218] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-16T21:12:18.342816] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-16T21:12:19.032225] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T21:12:19.142781] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-16T21:12:19.198588] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T21:12:19.942839] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-16T21:12:20.605408] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T21:12:20.618708] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-16T21:12:20.742776] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-16T21:12:21.542813] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-16T21:12:22.076831] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T21:12:22.342781] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-16T21:12:22.730041] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T21:12:23.103225] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T21:12:23.142777] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-16T21:12:23.942841] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-16T21:12:24.333965] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-16T21:12:24.520581] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T21:12:24.521609] [INFO ] [REMOTE ] RFM: Full fetch complete (5801 records). [2025-10-16T21:12:24.521703] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-16T21:12:24.751972] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-16T21:12:24.893462] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-10-16T21:12:24.893537] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-10-16T21:12:24.893763] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-10-16T21:12:24.893829] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-10-16T21:12:24.894244] [DEBUG] [LOCAL ] RFM: Trimmed 5801 records to 4179 (keeping 200 days of data) [2025-10-16T21:12:24.919671] [DEBUG] [LOCAL ] RFM: Primary data saved (4179 records). [2025-10-16T21:12:24.919787] [INFO ] [MAIN ] RFM: Full history saved. [2025-10-16T21:12:24.919869] [INFO ] [MAIN ] Update Progress: 1792/2369 symbols completed. RFM took 37.7s. Estimated remaining: 1h 21m 15s. Rate: 7.1 symbols/min [2025-10-16T21:12:25.086425] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:12:25.091624] [DEBUG] [LOCAL ] RGT: Loaded 2747 existing records from primary storage. [2025-10-16T21:12:25.091814] [INFO ] [MAIN ] RGT: Loaded 2747 existing records. [2025-10-16T21:12:25.273860] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:12:25.274076] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-16T21:12:25.274135] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-16T21:12:25.274267] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-10-16T21:12:25.274335] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-16T21:12:25.547970] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-16T21:12:25.652934] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:12:26.048622] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-16T21:12:26.342798] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-10-16T21:12:27.020084] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-16T21:12:27.040199] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T21:12:27.142818] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-16T21:12:27.752991] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T21:12:27.942809] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-16T21:12:28.502838] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-16T21:12:28.742820] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-16T21:12:29.542869] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-16T21:12:30.021970] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-16T21:12:30.332318] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T21:12:30.342760] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-16T21:12:31.142818] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-16T21:12:31.164581] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T21:12:31.942820] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-16T21:12:32.550935] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T21:12:32.742829] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-16T21:12:33.353275] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T21:12:33.409273] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-16T21:12:33.542819] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-16T21:12:34.221693] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T21:12:34.224689] [INFO ] [REMOTE ] RGR: Full fetch complete (28798 records). [2025-10-16T21:12:34.224770] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-16T21:12:34.225304] [FATAL] [VALIDATOR ] RGR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:12:34.225410] [FATAL] [MAIN ] RGR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:12:34.225454] [WARN ] [MAIN ] RGR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:12:34.225522] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-16T21:12:34.225584] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-16T21:12:34.225632] [INFO ] [LOCAL ] RGR: Starting deletion of derivative data. [2025-10-16T21:12:34.225724] [DEBUG] [LOCAL ] RGR: No derivative data file found to delete. [2025-10-16T21:12:34.225804] [INFO ] [MAIN ] Update Progress: 1793/2369 symbols completed. RGR took 31.4s. Estimated remaining: 1h 21m 7s. Rate: 7.1 symbols/min [2025-10-16T21:12:34.347909] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-16T21:12:34.398514] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:12:34.398707] [DEBUG] [LOCAL ] RH: No existing data file found in primary storage. [2025-10-16T21:12:34.398756] [WARN ] [MAIN ] RH: No existing data found, performing full refresh instead. [2025-10-16T21:12:34.398867] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-16T21:12:34.398970] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-16T21:12:34.399022] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-16T21:12:34.399055] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-16T21:12:34.747786] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:12:35.103940] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T21:12:35.142765] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-16T21:12:35.767805] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-16T21:12:35.942878] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-10-16T21:12:36.742863] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-16T21:12:37.482056] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T21:12:37.542787] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-16T21:12:37.812726] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T21:12:37.921369] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-16T21:12:37.925038] [INFO ] [REMOTE ] RGA: Full fetch complete (45012 records). [2025-10-16T21:12:37.925129] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-16T21:12:37.925732] [FATAL] [VALIDATOR ] RGA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:12:37.925832] [FATAL] [MAIN ] RGA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:12:37.925878] [WARN ] [MAIN ] RGA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:12:37.925945] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-16T21:12:37.926012] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-16T21:12:37.926050] [INFO ] [LOCAL ] RGA: Starting deletion of derivative data. [2025-10-16T21:12:37.926092] [DEBUG] [LOCAL ] RGA: No derivative data file found to delete. [2025-10-16T21:12:37.926147] [INFO ] [MAIN ] Update Progress: 1794/2369 symbols completed. RGA took 37.9s. Estimated remaining: 1h 20m 57s. Rate: 7.1 symbols/min [2025-10-16T21:12:38.102855] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:12:38.103029] [DEBUG] [LOCAL ] RHI: No existing data file found in primary storage. [2025-10-16T21:12:38.103068] [WARN ] [MAIN ] RHI: No existing data found, performing full refresh instead. [2025-10-16T21:12:38.103229] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-16T21:12:38.103276] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-16T21:12:38.103317] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-16T21:12:38.103349] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-16T21:12:38.350021] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-16T21:12:38.468722] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:12:39.142862] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-16T21:12:39.786458] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-16T21:12:39.942877] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-16T21:12:40.064142] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T21:12:40.742914] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-16T21:12:40.805503] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-16T21:12:41.542861] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-16T21:12:42.126800] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T21:12:42.342789] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-16T21:12:42.354548] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T21:12:42.356321] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12277 records). [2025-10-16T21:12:42.356392] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-16T21:12:42.704851] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-10-16T21:12:42.704926] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-10-16T21:12:42.705198] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-10-16T21:12:42.705237] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-10-16T21:12:42.705731] [DEBUG] [LOCAL ] RFMZ: Trimmed 12277 records to 8815 (keeping 200 days of data) [2025-10-16T21:12:42.758555] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8815 records). [2025-10-16T21:12:42.758715] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-10-16T21:12:42.758811] [INFO ] [MAIN ] Update Progress: 1795/2369 symbols completed. RFMZ took 47.2s. Estimated remaining: 1h 20m 48s. Rate: 7.1 symbols/min [2025-10-16T21:12:42.927171] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:12:42.927343] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-16T21:12:42.927382] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-16T21:12:42.927498] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-16T21:12:42.927541] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-16T21:12:42.927583] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-16T21:12:42.927616] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-16T21:12:43.147998] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-10-16T21:12:43.290622] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:12:43.942847] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-10-16T21:12:44.166023] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T21:12:44.302785] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:12:44.303294] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-10-16T21:12:44.303424] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:12:44.303625] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-16T21:12:44.303979] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:12:44.304062] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-16T21:12:44.304145] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-16T21:12:44.304185] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-16T21:12:44.304224] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-16T21:12:44.304280] [INFO ] [MAIN ] Update Progress: 1796/2369 symbols completed. RHLD took 1.5s. Estimated remaining: 1h 20m 37s. Rate: 7.1 symbols/min [2025-10-16T21:12:44.493455] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:12:44.493624] [DEBUG] [LOCAL ] RHP: No existing data file found in primary storage. [2025-10-16T21:12:44.493692] [WARN ] [MAIN ] RHP: No existing data found, performing full refresh instead. [2025-10-16T21:12:44.493808] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-16T21:12:44.493848] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-16T21:12:44.493891] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-16T21:12:44.493925] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-16T21:12:44.743001] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-16T21:12:44.849444] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:12:44.995741] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T21:12:45.410335] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-16T21:12:45.542814] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-10-16T21:12:46.342823] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-16T21:12:47.142851] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-16T21:12:47.233176] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T21:12:47.942783] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-16T21:12:48.045353] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T21:12:48.742810] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-16T21:12:49.275847] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-16T21:12:49.387187] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T21:12:49.542821] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-16T21:12:50.201576] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-16T21:12:50.347889] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-16T21:12:50.360536] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T21:12:51.142818] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-16T21:12:51.736814] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T21:12:51.737720] [INFO ] [REMOTE ] RGT: Full fetch complete (3970 records). [2025-10-16T21:12:51.737789] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-16T21:12:51.948046] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-16T21:12:52.112430] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-16T21:12:52.112584] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-16T21:12:52.112787] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-16T21:12:52.112883] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-16T21:12:52.113354] [DEBUG] [LOCAL ] RGT: Trimmed 3970 records to 2778 (keeping 200 days of data) [2025-10-16T21:12:52.131089] [DEBUG] [LOCAL ] RGT: Primary data saved (2778 records). [2025-10-16T21:12:52.131452] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-16T21:12:52.131683] [INFO ] [MAIN ] Update Progress: 1797/2369 symbols completed. RGT took 27.2s. Estimated remaining: 1h 20m 28s. Rate: 7.1 symbols/min [2025-10-16T21:12:52.242940] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T21:12:52.742912] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-16T21:12:53.329406] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T21:12:53.542835] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-16T21:12:54.342852] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-16T21:12:54.519347] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T21:12:55.142875] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-16T21:12:55.353537] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T21:12:55.942798] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-16T21:12:56.086287] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T21:12:56.742793] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-16T21:12:57.040272] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-16T21:12:57.542829] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-16T21:12:57.744455] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T21:12:58.313203] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T21:12:58.342773] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-16T21:12:59.142792] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-16T21:12:59.249986] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T21:12:59.942839] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-16T21:13:00.196856] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-16T21:13:00.742857] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-16T21:13:01.455140] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-16T21:13:01.542824] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-16T21:13:01.827938] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-16T21:13:02.342925] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-16T21:13:03.071538] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T21:13:03.078230] [INFO ] [REMOTE ] RH: Full fetch complete (65753 records). [2025-10-16T21:13:03.078404] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-16T21:13:03.079217] [FATAL] [VALIDATOR ] RH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:13:03.079305] [FATAL] [MAIN ] RH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:13:03.079372] [WARN ] [MAIN ] RH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:13:03.079444] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-16T21:13:03.079509] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-16T21:13:03.079569] [INFO ] [LOCAL ] RH: Starting deletion of derivative data. [2025-10-16T21:13:03.079636] [DEBUG] [LOCAL ] RH: No derivative data file found to delete. [2025-10-16T21:13:03.079750] [INFO ] [MAIN ] Update Progress: 1798/2369 symbols completed. RH took 28.9s. Estimated remaining: 1h 20m 21s. Rate: 7.1 symbols/min [2025-10-16T21:13:03.112523] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-16T21:13:03.142781] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-16T21:13:03.198914] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T21:13:03.942819] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-16T21:13:05.073083] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T21:13:05.084299] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-16T21:13:05.462429] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T21:13:05.542807] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-16T21:13:06.901380] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T21:13:06.912475] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-16T21:13:07.323389] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T21:13:07.336456] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-16T21:13:08.864964] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-16T21:13:08.875982] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-16T21:13:08.931973] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T21:13:08.940470] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-16T21:13:09.803434] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T21:13:09.814772] [INFO ] [REMOTE ] RHI: Full fetch complete (70274 records). [2025-10-16T21:13:09.815508] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-16T21:13:09.816384] [FATAL] [VALIDATOR ] RHI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:13:09.816512] [FATAL] [MAIN ] RHI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:13:09.816555] [WARN ] [MAIN ] RHI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:13:09.816595] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-16T21:13:09.816683] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-16T21:13:09.816736] [INFO ] [LOCAL ] RHI: Starting deletion of derivative data. [2025-10-16T21:13:09.816780] [DEBUG] [LOCAL ] RHI: No derivative data file found to delete. [2025-10-16T21:13:09.816836] [INFO ] [MAIN ] Update Progress: 1799/2369 symbols completed. RHI took 31.9s. Estimated remaining: 1h 20m 12s. Rate: 7.1 symbols/min [2025-10-16T21:13:09.899311] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T21:13:09.904266] [INFO ] [REMOTE ] RHP: Full fetch complete (58085 records). [2025-10-16T21:13:09.904360] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-16T21:13:09.905062] [FATAL] [VALIDATOR ] RHP: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:13:09.905147] [FATAL] [MAIN ] RHP: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:13:09.905205] [WARN ] [MAIN ] RHP: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:13:09.905289] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-16T21:13:09.905365] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-16T21:13:09.905414] [INFO ] [LOCAL ] RHP: Starting deletion of derivative data. [2025-10-16T21:13:09.905508] [DEBUG] [LOCAL ] RHP: No derivative data file found to delete. [2025-10-16T21:13:09.905611] [INFO ] [MAIN ] Update Progress: 1800/2369 symbols completed. RHP took 25.6s. Estimated remaining: 1h 20m 1s. Rate: 7.1 symbols/min [2025-10-16T21:13:10.575732] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:13:10.546198] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:13:10.614802] [DEBUG] [LOCAL ] RITM: No existing data file found in primary storage. [2025-10-16T21:13:10.601767] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:13:10.614953] [WARN ] [MAIN ] RITM: No existing data found, performing full refresh instead. [2025-10-16T21:13:10.615188] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-16T21:13:10.615246] [DEBUG] [LOCAL ] RIV: No existing data file found in primary storage. [2025-10-16T21:13:10.615639] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-16T21:13:10.641987] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:13:10.642091] [WARN ] [MAIN ] RIV: No existing data found, performing full refresh instead. [2025-10-16T21:13:10.642377] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-16T21:13:10.642756] [DEBUG] [LOCAL ] RIO: No existing data file found in primary storage. [2025-10-16T21:13:10.642493] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-16T21:13:10.642911] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-16T21:13:10.642952] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-16T21:13:10.643146] [WARN ] [MAIN ] RIO: No existing data found, performing full refresh instead. [2025-10-16T21:13:10.643086] [DEBUG] [LOCAL ] RIV: No primary data file found to delete. [2025-10-16T21:13:10.643359] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-16T21:13:10.643443] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-16T21:13:10.648789] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-16T21:13:10.658285] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-16T21:13:10.679016] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-16T21:13:11.429376] [DEBUG] [LOCAL ] RIG: Loaded 53675 existing records from primary storage. [2025-10-16T21:13:11.483763] [INFO ] [MAIN ] RIG: Loaded 53675 existing records. [2025-10-16T21:13:11.808397] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:13:11.869505] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-10-16T21:13:11.838119] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:13:11.881126] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:13:11.892187] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-10-16T21:13:11.891949] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-10-16T21:13:11.950953] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:13:11.951414] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-16T21:13:11.951463] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-16T21:13:11.951934] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-10-16T21:13:11.951989] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-16T21:13:12.048845] [DEBUG] [REMOTE ] RITM: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-16T21:13:12.059739] [WARN ] [REMOTE ] RITM: No data returned for month 2024-12 [2025-10-16T21:13:12.075199] [FATAL] [REMOTE ] RITM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:13:12.087176] [FATAL] [MAIN ] RITM: Failed to fetch primary data. [2025-10-16T21:13:12.097191] [WARN ] [MAIN ] RITM: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:13:12.106149] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-16T21:13:12.122561] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-16T21:13:12.167367] [INFO ] [LOCAL ] RITM: Starting deletion of derivative data. [2025-10-16T21:13:12.198593] [DEBUG] [LOCAL ] RITM: No derivative data file found to delete. [2025-10-16T21:13:12.203797] [INFO ] [MAIN ] Update Progress: 1801/2369 symbols completed. RITM took 2.3s. Estimated remaining: 1h 19m 50s. Rate: 7.1 symbols/min [2025-10-16T21:13:12.422168] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:13:12.439778] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-10-16T21:13:12.470062] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:13:12.470169] [DEBUG] [LOCAL ] RJF: No existing data file found in primary storage. [2025-10-16T21:13:12.470204] [WARN ] [MAIN ] RJF: No existing data found, performing full refresh instead. [2025-10-16T21:13:12.470309] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-16T21:13:12.470350] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-16T21:13:12.470389] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-16T21:13:12.470420] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-16T21:13:12.815008] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:13:12.815286] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-10-16T21:13:13.008783] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-16T21:13:13.542831] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-16T21:13:14.127678] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-16T21:13:14.342828] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-16T21:13:14.497745] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-16T21:13:14.537174] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T21:13:14.645162] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T21:13:15.142882] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-16T21:13:15.942831] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-16T21:13:16.657530] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-16T21:13:16.742770] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-16T21:13:17.214204] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-16T21:13:17.398578] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T21:13:17.542844] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-16T21:13:18.342883] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-16T21:13:18.885307] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-16T21:13:19.142799] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-16T21:13:19.179910] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T21:13:19.483542] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-16T21:13:19.942827] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-16T21:13:20.742842] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-16T21:13:21.163464] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-16T21:13:21.542837] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-16T21:13:21.699302] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-16T21:13:21.746678] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-16T21:13:22.342856] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-16T21:13:23.142819] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-16T21:13:23.265010] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-16T21:13:23.859795] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-16T21:13:23.942824] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-16T21:13:24.742778] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-16T21:13:24.765422] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T21:13:25.215376] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-16T21:13:25.542810] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-16T21:13:26.342793] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-16T21:13:26.466439] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T21:13:26.842709] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-16T21:13:27.142842] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-16T21:13:27.942806] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-16T21:13:28.291178] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T21:13:28.742800] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-16T21:13:29.076588] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-16T21:13:29.542810] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-16T21:13:30.172822] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-16T21:13:30.342785] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-16T21:13:30.654613] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-16T21:13:30.940383] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T21:13:31.142799] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-16T21:13:31.942811] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-16T21:13:32.180879] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-16T21:13:32.661059] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-16T21:13:32.742805] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-16T21:13:32.822311] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T21:13:33.542810] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-16T21:13:34.342844] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-16T21:13:35.026872] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-16T21:13:35.142802] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-16T21:13:35.422332] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-16T21:13:35.552612] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-16T21:13:35.942809] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-16T21:13:36.742824] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-16T21:13:37.263389] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-16T21:13:37.542764] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-16T21:13:38.063565] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-16T21:13:38.342876] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-16T21:13:38.558523] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T21:13:39.142836] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-16T21:13:39.666238] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-16T21:13:39.942779] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-16T21:13:40.158719] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T21:13:40.742850] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-16T21:13:40.840188] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T21:13:40.846473] [INFO ] [REMOTE ] RIO: Full fetch complete (77122 records). [2025-10-16T21:13:40.846590] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-16T21:13:40.847563] [FATAL] [VALIDATOR ] RIO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:13:40.847747] [FATAL] [MAIN ] RIO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:13:40.847874] [WARN ] [MAIN ] RIO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:13:40.848099] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-16T21:13:40.848357] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-16T21:13:40.848425] [INFO ] [LOCAL ] RIO: Starting deletion of derivative data. [2025-10-16T21:13:40.848614] [DEBUG] [LOCAL ] RIO: No derivative data file found to delete. [2025-10-16T21:13:40.848858] [INFO ] [MAIN ] Update Progress: 1802/2369 symbols completed. RIO took 30.9s. Estimated remaining: 1h 19m 48s. Rate: 7.1 symbols/min [2025-10-16T21:13:41.021029] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:13:41.021406] [DEBUG] [LOCAL ] RKT: No existing data file found in primary storage. [2025-10-16T21:13:41.021488] [WARN ] [MAIN ] RKT: No existing data found, performing full refresh instead. [2025-10-16T21:13:41.021624] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-16T21:13:41.021932] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-16T21:13:41.022009] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-16T21:13:41.022045] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-16T21:13:41.150814] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T21:13:41.411846] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:13:41.542792] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-10-16T21:13:42.342860] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-16T21:13:42.841357] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-16T21:13:43.142844] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-16T21:13:43.546201] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-16T21:13:43.710424] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-16T21:13:43.942902] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-16T21:13:44.742958] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-16T21:13:45.264810] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-16T21:13:45.272082] [INFO ] [REMOTE ] RIG: Full fetch complete (77846 records). [2025-10-16T21:13:45.272202] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-16T21:13:45.547571] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-16T21:13:45.727946] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-10-16T21:13:45.728256] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-10-16T21:13:45.730015] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-10-16T21:13:45.730830] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T21:13:45.732960] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-10-16T21:13:45.749897] [INFO ] [REMOTE ] RJF: Full fetch complete (68272 records). [2025-10-16T21:13:45.771860] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-16T21:13:45.773137] [FATAL] [VALIDATOR ] RJF: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:13:45.773324] [DEBUG] [LOCAL ] RIG: Trimmed 77846 records to 54065 (keeping 200 days of data) [2025-10-16T21:13:45.773398] [FATAL] [MAIN ] RJF: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:13:45.774377] [WARN ] [MAIN ] RJF: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:13:45.777237] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-16T21:13:45.777092] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T21:13:45.777756] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-16T21:13:45.777874] [INFO ] [LOCAL ] RJF: Starting deletion of derivative data. [2025-10-16T21:13:45.831874] [DEBUG] [LOCAL ] RJF: No derivative data file found to delete. [2025-10-16T21:13:45.832940] [INFO ] [MAIN ] Update Progress: 1803/2369 symbols completed. RJF took 33.6s. Estimated remaining: 1h 19m 39s. Rate: 7.1 symbols/min [2025-10-16T21:13:46.184331] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:13:46.197579] [DEBUG] [LOCAL ] RL: No existing data file found in primary storage. [2025-10-16T21:13:46.204940] [WARN ] [MAIN ] RL: No existing data found, performing full refresh instead. [2025-10-16T21:13:46.208225] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-16T21:13:46.208327] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-16T21:13:46.208424] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-16T21:13:46.208465] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-16T21:13:46.345039] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-16T21:13:46.460013] [DEBUG] [LOCAL ] RIG: Primary data saved (54065 records). [2025-10-16T21:13:46.468616] [INFO ] [MAIN ] RIG: Full history saved. [2025-10-16T21:13:46.514392] [INFO ] [MAIN ] Update Progress: 1804/2369 symbols completed. RIG took 36.6s. Estimated remaining: 1h 19m 28s. Rate: 7.1 symbols/min [2025-10-16T21:13:46.799984] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:13:46.833084] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:13:46.833306] [DEBUG] [LOCAL ] RLI: No existing data file found in primary storage. [2025-10-16T21:13:46.833377] [WARN ] [MAIN ] RLI: No existing data found, performing full refresh instead. [2025-10-16T21:13:46.833763] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-16T21:13:46.839001] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-16T21:13:46.846235] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-16T21:13:46.846400] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-16T21:13:46.879437] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T21:13:47.145618] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-16T21:13:47.224018] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:13:47.770292] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-16T21:13:47.772921] [INFO ] [REMOTE ] RIV: Full fetch complete (17711 records). [2025-10-16T21:13:47.773001] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-16T21:13:47.773676] [FATAL] [VALIDATOR ] RIV: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:13:47.773766] [FATAL] [MAIN ] RIV: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:13:47.773808] [WARN ] [MAIN ] RIV: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:13:47.773849] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-16T21:13:47.773912] [DEBUG] [LOCAL ] RIV: No primary data file found to delete. [2025-10-16T21:13:47.773948] [INFO ] [LOCAL ] RIV: Starting deletion of derivative data. [2025-10-16T21:13:47.773987] [DEBUG] [LOCAL ] RIV: No derivative data file found to delete. [2025-10-16T21:13:47.774043] [INFO ] [MAIN ] Update Progress: 1805/2369 symbols completed. RIV took 37.9s. Estimated remaining: 1h 19m 17s. Rate: 7.1 symbols/min [2025-10-16T21:13:47.944203] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-10-16T21:13:47.944107] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:13:47.945501] [DEBUG] [LOCAL ] RLJ: No existing data file found in primary storage. [2025-10-16T21:13:47.945672] [WARN ] [MAIN ] RLJ: No existing data found, performing full refresh instead. [2025-10-16T21:13:47.945794] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-16T21:13:47.945836] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-16T21:13:47.945877] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-16T21:13:47.945909] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-16T21:13:48.314415] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:13:48.342600] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-16T21:13:48.742833] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-10-16T21:13:49.542791] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-16T21:13:50.011755] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-16T21:13:50.342803] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-10-16T21:13:50.529186] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T21:13:51.142819] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-16T21:13:51.355601] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T21:13:51.601544] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T21:13:51.942822] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-16T21:13:52.742850] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-16T21:13:52.961328] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T21:13:53.027142] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T21:13:53.542850] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-16T21:13:54.342860] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-16T21:13:54.503327] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-16T21:13:55.142829] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-16T21:13:55.789599] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-16T21:13:55.834325] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T21:13:55.942782] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-16T21:13:56.663790] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T21:13:56.742786] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-16T21:13:57.542892] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-16T21:13:58.137409] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-16T21:13:58.342784] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-16T21:13:58.675338] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-16T21:13:58.823727] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T21:13:59.142819] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-16T21:13:59.942861] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-16T21:14:00.278294] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-16T21:14:00.638756] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T21:14:00.742794] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-16T21:14:01.542840] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-16T21:14:01.861125] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T21:14:02.174131] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T21:14:02.342866] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-16T21:14:03.142844] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-16T21:14:03.667426] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T21:14:03.942818] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-16T21:14:04.007494] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-16T21:14:04.742828] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-16T21:14:04.837129] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T21:14:05.062843] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T21:14:05.542842] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-16T21:14:06.342807] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-16T21:14:06.683435] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-16T21:14:07.142845] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-16T21:14:07.476725] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T21:14:07.942800] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-16T21:14:08.110013] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T21:14:08.742827] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-16T21:14:09.542790] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-16T21:14:09.672198] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-16T21:14:10.027786] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-16T21:14:10.342761] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-16T21:14:10.392420] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T21:14:10.772990] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T21:14:11.142804] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-16T21:14:11.942805] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-16T21:14:12.747905] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-16T21:14:12.750817] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-16T21:14:12.858016] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T21:14:13.122968] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-16T21:14:13.542867] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-16T21:14:14.342855] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-16T21:14:14.422523] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T21:14:14.429037] [INFO ] [REMOTE ] RKT: Full fetch complete (77186 records). [2025-10-16T21:14:14.429192] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-16T21:14:14.432538] [FATAL] [VALIDATOR ] RKT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:14:14.432663] [FATAL] [MAIN ] RKT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:14:14.432721] [WARN ] [MAIN ] RKT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:14:14.432764] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-16T21:14:14.432833] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-16T21:14:14.432889] [INFO ] [LOCAL ] RKT: Starting deletion of derivative data. [2025-10-16T21:14:14.432931] [DEBUG] [LOCAL ] RKT: No derivative data file found to delete. [2025-10-16T21:14:14.432989] [INFO ] [MAIN ] Update Progress: 1806/2369 symbols completed. RKT took 33.6s. Estimated remaining: 1h 19m 14s. Rate: 7.1 symbols/min [2025-10-16T21:14:14.603107] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:14:14.633420] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T21:14:14.651097] [DEBUG] [LOCAL ] RLTY: Loaded 11163 existing records from primary storage. [2025-10-16T21:14:14.651298] [INFO ] [MAIN ] RLTY: Loaded 11163 existing records. [2025-10-16T21:14:14.823195] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:14:14.823424] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-16T21:14:14.823470] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-16T21:14:14.823621] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-10-16T21:14:14.823695] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-16T21:14:15.156241] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-16T21:14:15.200911] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:14:15.364127] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T21:14:15.369062] [INFO ] [REMOTE ] RLI: Full fetch complete (48369 records). [2025-10-16T21:14:15.369182] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-16T21:14:15.369755] [FATAL] [VALIDATOR ] RLI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:14:15.369841] [FATAL] [MAIN ] RLI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:14:15.369904] [WARN ] [MAIN ] RLI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:14:15.370012] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-16T21:14:15.370091] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-16T21:14:15.370157] [INFO ] [LOCAL ] RLI: Starting deletion of derivative data. [2025-10-16T21:14:15.370243] [DEBUG] [LOCAL ] RLI: No derivative data file found to delete. [2025-10-16T21:14:15.370341] [INFO ] [MAIN ] Update Progress: 1807/2369 symbols completed. RLI took 28.8s. Estimated remaining: 1h 19m 3s. Rate: 7.1 symbols/min [2025-10-16T21:14:15.536151] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:14:15.578050] [DEBUG] [LOCAL ] RLX: Loaded 48146 existing records from primary storage. [2025-10-16T21:14:15.578370] [INFO ] [MAIN ] RLX: Loaded 48146 existing records. [2025-10-16T21:14:15.753425] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:14:15.753629] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-16T21:14:15.753711] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-16T21:14:15.753904] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-10-16T21:14:15.753944] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-16T21:14:15.947983] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-16T21:14:16.110977] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:14:16.742810] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-10-16T21:14:16.874347] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T21:14:17.379026] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-16T21:14:17.542786] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-10-16T21:14:18.342834] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-16T21:14:18.557704] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T21:14:18.603958] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T21:14:19.143684] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-16T21:14:19.145929] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T21:14:19.151020] [INFO ] [REMOTE ] RL: Full fetch complete (59448 records). [2025-10-16T21:14:19.151152] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-16T21:14:19.151877] [FATAL] [VALIDATOR ] RL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:14:19.151968] [FATAL] [MAIN ] RL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:14:19.152035] [WARN ] [MAIN ] RL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:14:19.152122] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-16T21:14:19.152258] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-16T21:14:19.152321] [INFO ] [LOCAL ] RL: Starting deletion of derivative data. [2025-10-16T21:14:19.152395] [DEBUG] [LOCAL ] RL: No derivative data file found to delete. [2025-10-16T21:14:19.152508] [INFO ] [MAIN ] Update Progress: 1808/2369 symbols completed. RL took 33.3s. Estimated remaining: 1h 18m 54s. Rate: 7.1 symbols/min [2025-10-16T21:14:19.326756] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:14:19.335859] [DEBUG] [LOCAL ] RM: Loaded 7558 existing records from primary storage. [2025-10-16T21:14:19.336078] [INFO ] [MAIN ] RM: Loaded 7558 existing records. [2025-10-16T21:14:19.514870] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:14:19.515132] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-16T21:14:19.515181] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-16T21:14:19.515319] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-10-16T21:14:19.515356] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-16T21:14:19.872940] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:14:19.942768] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-10-16T21:14:20.140117] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T21:14:20.742786] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-16T21:14:20.752483] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-16T21:14:21.542866] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-16T21:14:22.342798] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-16T21:14:22.523316] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T21:14:22.852878] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T21:14:23.142783] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-16T21:14:23.434899] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T21:14:23.942822] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-16T21:14:24.051448] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T21:14:24.742790] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-16T21:14:24.896253] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T21:14:25.542811] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-16T21:14:26.342790] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-16T21:14:26.500826] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T21:14:26.519013] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T21:14:27.142824] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-16T21:14:27.942790] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-16T21:14:28.044771] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T21:14:28.742790] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-16T21:14:28.888084] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T21:14:28.929027] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T21:14:29.542802] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-16T21:14:30.342791] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-16T21:14:30.438467] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-16T21:14:30.571402] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T21:14:30.991903] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T21:14:31.142806] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-16T21:14:31.942855] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-16T21:14:32.074808] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T21:14:32.742814] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-16T21:14:32.817809] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-16T21:14:33.542788] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-16T21:14:33.641083] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-16T21:14:34.342818] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-16T21:14:35.142779] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-16T21:14:35.222984] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T21:14:35.335057] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T21:14:35.942829] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-16T21:14:36.041537] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T21:14:36.742887] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-16T21:14:37.542844] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-16T21:14:37.635170] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T21:14:37.679595] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T21:14:38.232967] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T21:14:38.234815] [INFO ] [REMOTE ] RLTY: Full fetch complete (17387 records). [2025-10-16T21:14:38.234905] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-16T21:14:38.347985] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-16T21:14:38.605470] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-10-16T21:14:38.605557] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-10-16T21:14:38.606001] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-10-16T21:14:38.606062] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-10-16T21:14:38.606584] [DEBUG] [LOCAL ] RLTY: Trimmed 17387 records to 11237 (keeping 200 days of data) [2025-10-16T21:14:38.675335] [DEBUG] [LOCAL ] RLTY: Primary data saved (11237 records). [2025-10-16T21:14:38.675465] [INFO ] [MAIN ] RLTY: Full history saved. [2025-10-16T21:14:38.675542] [INFO ] [MAIN ] Update Progress: 1809/2369 symbols completed. RLTY took 24.2s. Estimated remaining: 1h 18m 49s. Rate: 7.1 symbols/min [2025-10-16T21:14:38.842694] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:14:38.842865] [DEBUG] [LOCAL ] RMAX: No existing data file found in primary storage. [2025-10-16T21:14:38.842902] [WARN ] [MAIN ] RMAX: No existing data found, performing full refresh instead. [2025-10-16T21:14:38.843014] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-16T21:14:38.843054] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-16T21:14:38.843094] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-16T21:14:38.843127] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-16T21:14:39.148017] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-16T21:14:39.222315] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:14:39.942853] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-16T21:14:40.019890] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T21:14:40.153160] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T21:14:40.678677] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T21:14:40.685377] [INFO ] [REMOTE ] RLJ: Full fetch complete (69083 records). [2025-10-16T21:14:40.685541] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-16T21:14:40.686514] [FATAL] [VALIDATOR ] RLJ: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:14:40.686633] [FATAL] [MAIN ] RLJ: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:14:40.686745] [WARN ] [MAIN ] RLJ: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:14:40.686823] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-16T21:14:40.686897] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-16T21:14:40.686936] [INFO ] [LOCAL ] RLJ: Starting deletion of derivative data. [2025-10-16T21:14:40.686975] [DEBUG] [LOCAL ] RLJ: No derivative data file found to delete. [2025-10-16T21:14:40.687033] [INFO ] [MAIN ] Update Progress: 1810/2369 symbols completed. RLJ took 52.9s. Estimated remaining: 1h 18m 38s. Rate: 7.1 symbols/min [2025-10-16T21:14:40.748763] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-16T21:14:40.890456] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:14:40.890628] [DEBUG] [LOCAL ] RMD: No existing data file found in primary storage. [2025-10-16T21:14:40.890704] [WARN ] [MAIN ] RMD: No existing data found, performing full refresh instead. [2025-10-16T21:14:40.890822] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-16T21:14:40.890889] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-16T21:14:40.890965] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-16T21:14:40.891004] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-16T21:14:41.341233] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:14:41.542816] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-10-16T21:14:41.618932] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-16T21:14:42.342828] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-16T21:14:43.073461] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T21:14:43.142784] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-16T21:14:43.337859] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T21:14:43.942830] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-16T21:14:44.742850] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-10-16T21:14:44.940532] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-16T21:14:45.542776] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-16T21:14:45.730345] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T21:14:45.786042] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T21:14:46.342833] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-16T21:14:46.393231] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-16T21:14:47.142820] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-16T21:14:47.942850] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-16T21:14:48.055539] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T21:14:48.742845] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-16T21:14:48.936862] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T21:14:49.112575] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T21:14:49.502444] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T21:14:49.503840] [INFO ] [REMOTE ] RM: Full fetch complete (11541 records). [2025-10-16T21:14:49.503909] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-16T21:14:49.547997] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-16T21:14:49.860516] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-10-16T21:14:49.860599] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-10-16T21:14:49.860920] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-10-16T21:14:49.860983] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-10-16T21:14:49.861410] [DEBUG] [LOCAL ] RM: Trimmed 11541 records to 7602 (keeping 200 days of data) [2025-10-16T21:14:49.906465] [DEBUG] [LOCAL ] RM: Primary data saved (7602 records). [2025-10-16T21:14:49.906585] [INFO ] [MAIN ] RM: Full history saved. [2025-10-16T21:14:49.906690] [INFO ] [MAIN ] Update Progress: 1811/2369 symbols completed. RM took 30.8s. Estimated remaining: 1h 18m 30s. Rate: 7.1 symbols/min [2025-10-16T21:14:50.070692] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:14:50.070923] [DEBUG] [LOCAL ] RMI: No existing data file found in primary storage. [2025-10-16T21:14:50.070974] [WARN ] [MAIN ] RMI: No existing data found, performing full refresh instead. [2025-10-16T21:14:50.071087] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-16T21:14:50.071129] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-16T21:14:50.071171] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-16T21:14:50.071204] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-16T21:14:50.347992] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-16T21:14:50.417432] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:14:51.142834] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-16T21:14:51.354418] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T21:14:51.902564] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T21:14:51.939722] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T21:14:51.943217] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-16T21:14:52.742806] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-16T21:14:53.542817] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-10-16T21:14:53.847713] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T21:14:53.990789] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-16T21:14:54.063946] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-16T21:14:54.342801] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-16T21:14:55.142808] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-16T21:14:55.942792] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-16T21:14:56.008594] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T21:14:56.015044] [INFO ] [REMOTE ] RLX: Full fetch complete (70254 records). [2025-10-16T21:14:56.015169] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-16T21:14:56.392167] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-10-16T21:14:56.392285] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-10-16T21:14:56.393322] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-10-16T21:14:56.393390] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-10-16T21:14:56.394761] [DEBUG] [LOCAL ] RLX: Trimmed 70254 records to 48456 (keeping 200 days of data) [2025-10-16T21:14:56.498374] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T21:14:56.682639] [DEBUG] [LOCAL ] RLX: Primary data saved (48456 records). [2025-10-16T21:14:56.682793] [INFO ] [MAIN ] RLX: Full history saved. [2025-10-16T21:14:56.683434] [INFO ] [MAIN ] Update Progress: 1812/2369 symbols completed. RLX took 41.3s. Estimated remaining: 1h 18m 21s. Rate: 7.1 symbols/min [2025-10-16T21:14:56.746226] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-16T21:14:56.855369] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:14:56.855625] [DEBUG] [LOCAL ] RMM: No existing data file found in primary storage. [2025-10-16T21:14:56.855763] [WARN ] [MAIN ] RMM: No existing data found, performing full refresh instead. [2025-10-16T21:14:56.856036] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-16T21:14:56.856106] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-16T21:14:56.856155] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-16T21:14:56.856187] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-16T21:14:57.117668] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T21:14:57.237072] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:14:57.369598] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-16T21:14:57.542827] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-16T21:14:58.211819] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-16T21:14:58.342794] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-16T21:14:59.129402] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T21:14:59.142774] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-16T21:14:59.905681] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T21:14:59.942835] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-16T21:15:00.742795] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-16T21:15:01.075410] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T21:15:01.542815] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-16T21:15:02.342782] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-16T21:15:02.375161] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T21:15:02.722701] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T21:15:03.061746] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T21:15:03.142807] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-16T21:15:03.820817] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-16T21:15:03.942861] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-16T21:15:04.742846] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-16T21:15:05.542847] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-16T21:15:05.608438] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-16T21:15:05.965011] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T21:15:06.342874] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-16T21:15:06.967782] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T21:15:07.142804] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-16T21:15:07.207136] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-16T21:15:07.942855] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-16T21:15:08.475488] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T21:15:08.742810] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-16T21:15:09.542800] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-10-16T21:15:09.888043] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-16T21:15:10.271803] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-16T21:15:10.340771] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-16T21:15:10.346752] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-16T21:15:10.804054] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-16T21:15:10.805223] [INFO ] [REMOTE ] RMI: Full fetch complete (6070 records). [2025-10-16T21:15:10.805292] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-16T21:15:10.805730] [FATAL] [VALIDATOR ] RMI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:15:10.805811] [FATAL] [MAIN ] RMI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:15:10.805853] [WARN ] [MAIN ] RMI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:15:10.805895] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-16T21:15:10.805962] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-16T21:15:10.806026] [INFO ] [LOCAL ] RMI: Starting deletion of derivative data. [2025-10-16T21:15:10.806094] [DEBUG] [LOCAL ] RMI: No derivative data file found to delete. [2025-10-16T21:15:10.806146] [INFO ] [MAIN ] Update Progress: 1813/2369 symbols completed. RMI took 20.9s. Estimated remaining: 1h 18m 14s. Rate: 7.1 symbols/min [2025-10-16T21:15:10.970454] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:15:10.970615] [DEBUG] [LOCAL ] RMMZ: No existing data file found in primary storage. [2025-10-16T21:15:10.970678] [WARN ] [MAIN ] RMMZ: No existing data found, performing full refresh instead. [2025-10-16T21:15:10.970795] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-16T21:15:10.970836] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-16T21:15:10.970877] [DEBUG] [LOCAL ] RMMZ: No primary data file found to delete. [2025-10-16T21:15:10.970911] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-16T21:15:11.148906] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-16T21:15:11.329223] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:15:11.942800] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-16T21:15:12.212718] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T21:15:12.742820] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-16T21:15:12.845837] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T21:15:13.542815] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-10-16T21:15:14.342793] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-16T21:15:14.433124] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T21:15:14.493135] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T21:15:15.142818] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-16T21:15:15.406579] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T21:15:15.942859] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-16T21:15:16.125687] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T21:15:16.368051] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-16T21:15:16.370750] [INFO ] [REMOTE ] RMAX: Full fetch complete (29791 records). [2025-10-16T21:15:16.370912] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-16T21:15:16.371369] [FATAL] [VALIDATOR ] RMAX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:15:16.371478] [FATAL] [MAIN ] RMAX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:15:16.371532] [WARN ] [MAIN ] RMAX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:15:16.371611] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-16T21:15:16.371704] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-16T21:15:16.371753] [INFO ] [LOCAL ] RMAX: Starting deletion of derivative data. [2025-10-16T21:15:16.371820] [DEBUG] [LOCAL ] RMAX: No derivative data file found to delete. [2025-10-16T21:15:16.371895] [INFO ] [MAIN ] Update Progress: 1814/2369 symbols completed. RMAX took 37.7s. Estimated remaining: 1h 18m 5s. Rate: 7.1 symbols/min [2025-10-16T21:15:16.544585] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:15:16.562623] [DEBUG] [LOCAL ] RMT: Loaded 17509 existing records from primary storage. [2025-10-16T21:15:16.562897] [INFO ] [MAIN ] RMT: Loaded 17509 existing records. [2025-10-16T21:15:16.737746] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:15:16.737949] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-16T21:15:16.737995] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-16T21:15:16.738169] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-10-16T21:15:16.738250] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-16T21:15:16.749081] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-16T21:15:17.088505] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:15:17.527023] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T21:15:17.532359] [INFO ] [REMOTE ] RMD: Full fetch complete (61055 records). [2025-10-16T21:15:17.532494] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-16T21:15:17.533246] [FATAL] [VALIDATOR ] RMD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:15:17.533335] [FATAL] [MAIN ] RMD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:15:17.533378] [WARN ] [MAIN ] RMD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:15:17.533418] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-16T21:15:17.533496] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-16T21:15:17.533568] [INFO ] [LOCAL ] RMD: Starting deletion of derivative data. [2025-10-16T21:15:17.533623] [DEBUG] [LOCAL ] RMD: No derivative data file found to delete. [2025-10-16T21:15:17.533734] [INFO ] [MAIN ] Update Progress: 1815/2369 symbols completed. RMD took 36.8s. Estimated remaining: 1h 17m 54s. Rate: 7.1 symbols/min [2025-10-16T21:15:17.547889] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-16T21:15:17.713315] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:15:17.713514] [DEBUG] [LOCAL ] RNG: No existing data file found in primary storage. [2025-10-16T21:15:17.713574] [WARN ] [MAIN ] RNG: No existing data found, performing full refresh instead. [2025-10-16T21:15:17.713731] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-16T21:15:17.713798] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-16T21:15:17.713895] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-16T21:15:17.713954] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-16T21:15:18.063417] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:15:18.226550] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-16T21:15:18.342795] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-16T21:15:19.018414] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-16T21:15:19.142819] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-10-16T21:15:19.942811] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-16T21:15:20.265608] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-16T21:15:20.559882] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-16T21:15:20.742856] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-10-16T21:15:21.542814] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-16T21:15:22.342792] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-16T21:15:22.441588] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T21:15:22.544764] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T21:15:23.142778] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-16T21:15:23.214831] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T21:15:23.672287] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-16T21:15:23.942808] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-16T21:15:24.742812] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-16T21:15:25.542792] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-16T21:15:25.764010] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T21:15:25.803407] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T21:15:26.006723] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-16T21:15:26.342833] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-16T21:15:27.142782] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-16T21:15:27.485482] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T21:15:27.942820] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-16T21:15:28.742804] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-16T21:15:28.895837] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-16T21:15:28.931709] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T21:15:29.542885] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-16T21:15:29.883132] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T21:15:30.137053] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-16T21:15:30.342859] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-16T21:15:30.957721] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T21:15:31.142815] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-16T21:15:31.942847] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-16T21:15:32.101503] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T21:15:32.728296] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T21:15:32.742767] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-16T21:15:33.493402] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T21:15:33.542819] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-16T21:15:34.342867] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-16T21:15:35.142879] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-16T21:15:35.288773] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T21:15:35.396274] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T21:15:35.915636] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T21:15:35.942801] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-16T21:15:36.742869] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-16T21:15:37.074831] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T21:15:37.542866] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-16T21:15:38.342796] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-16T21:15:38.583562] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T21:15:38.781469] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T21:15:39.142779] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-16T21:15:39.429338] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T21:15:39.932961] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T21:15:39.942769] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-16T21:15:40.742793] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-16T21:15:41.030973] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T21:15:41.478579] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-16T21:15:41.542806] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-16T21:15:42.331935] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T21:15:42.333558] [INFO ] [REMOTE ] RMM: Full fetch complete (14779 records). [2025-10-16T21:15:42.333628] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-16T21:15:42.334114] [FATAL] [VALIDATOR ] RMM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:15:42.334199] [FATAL] [MAIN ] RMM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:15:42.334242] [WARN ] [MAIN ] RMM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:15:42.334295] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-16T21:15:42.334374] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-16T21:15:42.334410] [INFO ] [LOCAL ] RMM: Starting deletion of derivative data. [2025-10-16T21:15:42.334450] [DEBUG] [LOCAL ] RMM: No derivative data file found to delete. [2025-10-16T21:15:42.334503] [INFO ] [MAIN ] Update Progress: 1816/2369 symbols completed. RMM took 45.7s. Estimated remaining: 1h 17m 51s. Rate: 7.1 symbols/min [2025-10-16T21:15:42.347869] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-16T21:15:42.509792] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:15:42.509953] [DEBUG] [LOCAL ] RNGR: No existing data file found in primary storage. [2025-10-16T21:15:42.509990] [WARN ] [MAIN ] RNGR: No existing data found, performing full refresh instead. [2025-10-16T21:15:42.510102] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-16T21:15:42.510171] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-16T21:15:42.510279] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-16T21:15:42.510339] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-16T21:15:42.879470] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:15:43.142789] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-16T21:15:43.431820] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-16T21:15:43.434971] [INFO ] [REMOTE ] RMT: Full fetch complete (25603 records). [2025-10-16T21:15:43.435083] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-16T21:15:43.832068] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-16T21:15:43.832148] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-16T21:15:43.832729] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-16T21:15:43.832792] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-16T21:15:43.833739] [DEBUG] [LOCAL ] RMT: Trimmed 25603 records to 17675 (keeping 200 days of data) [2025-10-16T21:15:43.937621] [DEBUG] [LOCAL ] RMT: Primary data saved (17675 records). [2025-10-16T21:15:43.937788] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-16T21:15:43.937884] [INFO ] [MAIN ] Update Progress: 1817/2369 symbols completed. RMT took 27.6s. Estimated remaining: 1h 17m 40s. Rate: 7.1 symbols/min [2025-10-16T21:15:43.949400] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-10-16T21:15:44.106304] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:15:44.123242] [DEBUG] [LOCAL ] RNP: Loaded 16190 existing records from primary storage. [2025-10-16T21:15:44.123480] [INFO ] [MAIN ] RNP: Loaded 16190 existing records. [2025-10-16T21:15:44.293733] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:15:44.293981] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-16T21:15:44.294029] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-16T21:15:44.294187] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-10-16T21:15:44.294225] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-16T21:15:44.643207] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:15:44.742773] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-10-16T21:15:44.904290] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T21:15:45.176696] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T21:15:45.542788] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-16T21:15:45.838440] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T21:15:46.342795] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-16T21:15:46.614967] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T21:15:47.142776] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-16T21:15:47.488073] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T21:15:47.942940] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-16T21:15:48.130847] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T21:15:48.742892] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-16T21:15:49.542800] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-16T21:15:49.849954] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-16T21:15:49.870539] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T21:15:49.969540] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-16T21:15:49.970633] [INFO ] [REMOTE ] RMMZ: Full fetch complete (6793 records). [2025-10-16T21:15:49.970738] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-16T21:15:50.340008] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-10-16T21:15:50.340084] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-10-16T21:15:50.340302] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-10-16T21:15:50.340348] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-10-16T21:15:50.340936] [DEBUG] [LOCAL ] RMMZ: Trimmed 6793 records to 4814 (keeping 200 days of data) [2025-10-16T21:15:50.354183] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-16T21:15:50.372284] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4814 records). [2025-10-16T21:15:50.372358] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-10-16T21:15:50.372421] [INFO ] [MAIN ] Update Progress: 1818/2369 symbols completed. RMMZ took 39.6s. Estimated remaining: 1h 17m 31s. Rate: 7.1 symbols/min [2025-10-16T21:15:50.539972] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:15:50.540100] [DEBUG] [LOCAL ] RNR: No existing data file found in primary storage. [2025-10-16T21:15:50.540135] [WARN ] [MAIN ] RNR: No existing data found, performing full refresh instead. [2025-10-16T21:15:50.540238] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-16T21:15:50.540279] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-16T21:15:50.540320] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-16T21:15:50.540366] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-16T21:15:50.880574] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:15:51.142774] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-10-16T21:15:51.779169] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T21:15:51.942808] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-16T21:15:52.742793] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-16T21:15:52.927317] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T21:15:53.542852] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-16T21:15:53.722147] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T21:15:53.764683] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T21:15:54.342816] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-16T21:15:55.109618] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T21:15:55.142784] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-16T21:15:55.942867] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-16T21:15:55.977292] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T21:15:56.742796] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-16T21:15:56.775586] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T21:15:57.200980] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T21:15:57.542822] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-16T21:15:57.884768] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T21:15:58.342872] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-16T21:15:59.142789] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-16T21:15:59.190376] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T21:15:59.252066] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T21:15:59.942803] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-16T21:16:00.742854] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-16T21:16:01.049290] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-16T21:16:01.296079] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T21:16:01.542776] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-16T21:16:01.926805] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T21:16:02.342782] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-16T21:16:02.742336] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T21:16:03.142830] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-16T21:16:03.467517] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T21:16:03.942812] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-16T21:16:04.040037] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-16T21:16:04.742792] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-16T21:16:05.543977] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-16T21:16:05.546228] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T21:16:05.552920] [INFO ] [REMOTE ] RNG: Full fetch complete (69428 records). [2025-10-16T21:16:05.553036] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-16T21:16:05.553962] [FATAL] [VALIDATOR ] RNG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:16:05.554048] [FATAL] [MAIN ] RNG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:16:05.554094] [WARN ] [MAIN ] RNG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:16:05.554164] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-16T21:16:05.554228] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-16T21:16:05.554264] [INFO ] [LOCAL ] RNG: Starting deletion of derivative data. [2025-10-16T21:16:05.554304] [DEBUG] [LOCAL ] RNG: No derivative data file found to delete. [2025-10-16T21:16:05.554362] [INFO ] [MAIN ] Update Progress: 1819/2369 symbols completed. RNG took 48.0s. Estimated remaining: 1h 17m 25s. Rate: 7.1 symbols/min [2025-10-16T21:16:05.733382] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:16:05.733779] [DEBUG] [LOCAL ] RNST: No existing data file found in primary storage. [2025-10-16T21:16:05.733839] [WARN ] [MAIN ] RNST: No existing data found, performing full refresh instead. [2025-10-16T21:16:05.756062] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-16T21:16:05.756169] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-16T21:16:05.756246] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-16T21:16:05.756922] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-16T21:16:05.757791] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T21:16:06.112947] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:16:06.342824] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-10-16T21:16:06.780188] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T21:16:07.142809] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-16T21:16:07.898255] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T21:16:07.942767] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-16T21:16:08.312500] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T21:16:08.742789] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-16T21:16:09.482689] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T21:16:09.542768] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-16T21:16:10.060851] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T21:16:10.342848] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-16T21:16:10.684255] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T21:16:10.917262] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T21:16:10.920076] [INFO ] [REMOTE ] RNGR: Full fetch complete (28323 records). [2025-10-16T21:16:10.920149] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-16T21:16:10.920564] [FATAL] [VALIDATOR ] RNGR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:16:10.920667] [FATAL] [MAIN ] RNGR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:16:10.920725] [WARN ] [MAIN ] RNGR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:16:10.920793] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-16T21:16:10.920853] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-16T21:16:10.920889] [INFO ] [LOCAL ] RNGR: Starting deletion of derivative data. [2025-10-16T21:16:10.920953] [DEBUG] [LOCAL ] RNGR: No derivative data file found to delete. [2025-10-16T21:16:10.921025] [INFO ] [MAIN ] Update Progress: 1820/2369 symbols completed. RNGR took 28.6s. Estimated remaining: 1h 17m 16s. Rate: 7.1 symbols/min [2025-10-16T21:16:11.088603] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:16:11.088798] [DEBUG] [LOCAL ] ROG: No existing data file found in primary storage. [2025-10-16T21:16:11.088844] [WARN ] [MAIN ] ROG: No existing data found, performing full refresh instead. [2025-10-16T21:16:11.088952] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-16T21:16:11.089012] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-16T21:16:11.089093] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-16T21:16:11.089140] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-16T21:16:11.150431] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-16T21:16:11.452826] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:16:11.942844] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-16T21:16:12.234446] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T21:16:12.742814] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-10-16T21:16:13.481977] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T21:16:13.542785] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-16T21:16:13.903469] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T21:16:14.342815] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-16T21:16:15.142861] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-16T21:16:15.320711] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T21:16:15.416823] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T21:16:15.942818] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-16T21:16:16.354972] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T21:16:16.742784] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-16T21:16:17.004404] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T21:16:17.007786] [INFO ] [REMOTE ] RNP: Full fetch complete (23710 records). [2025-10-16T21:16:17.007882] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-16T21:16:17.394568] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-16T21:16:17.394675] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-16T21:16:17.395374] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-16T21:16:17.395416] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-16T21:16:17.396058] [DEBUG] [LOCAL ] RNP: Trimmed 23710 records to 16282 (keeping 200 days of data) [2025-10-16T21:16:17.493594] [DEBUG] [LOCAL ] RNP: Primary data saved (16282 records). [2025-10-16T21:16:17.493761] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-16T21:16:17.493846] [INFO ] [MAIN ] Update Progress: 1821/2369 symbols completed. RNP took 33.6s. Estimated remaining: 1h 17m 6s. Rate: 7.1 symbols/min [2025-10-16T21:16:17.551162] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-16T21:16:17.668513] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:16:17.668719] [DEBUG] [LOCAL ] ROK: No existing data file found in primary storage. [2025-10-16T21:16:17.668768] [WARN ] [MAIN ] ROK: No existing data found, performing full refresh instead. [2025-10-16T21:16:17.668881] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-16T21:16:17.668930] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-16T21:16:17.668971] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-16T21:16:17.669004] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-16T21:16:18.026052] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:16:18.346172] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-10-16T21:16:18.351915] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T21:16:18.828762] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T21:16:19.142857] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-16T21:16:19.942802] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-16T21:16:20.119493] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T21:16:20.742854] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-16T21:16:21.071294] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-16T21:16:21.482690] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T21:16:21.542879] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-16T21:16:22.342851] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-16T21:16:22.447495] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T21:16:23.142837] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-16T21:16:23.201065] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T21:16:23.834578] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T21:16:23.942792] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-16T21:16:24.742815] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-16T21:16:24.938883] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T21:16:25.000293] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T21:16:25.542814] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-16T21:16:26.310591] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T21:16:26.342823] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-16T21:16:27.142891] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-16T21:16:27.457097] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-16T21:16:27.807380] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T21:16:27.942792] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-16T21:16:28.239975] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T21:16:28.742814] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-16T21:16:29.542818] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-16T21:16:29.600495] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T21:16:30.342791] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-16T21:16:30.605994] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T21:16:30.788156] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T21:16:31.142810] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-16T21:16:31.664200] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-16T21:16:31.942793] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-16T21:16:32.742804] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-16T21:16:33.128038] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-16T21:16:33.418446] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T21:16:33.542807] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-16T21:16:34.034490] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T21:16:34.266365] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T21:16:34.270675] [INFO ] [REMOTE ] RNST: Full fetch complete (52661 records). [2025-10-16T21:16:34.270772] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-16T21:16:34.271349] [FATAL] [VALIDATOR ] RNST: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:16:34.271447] [FATAL] [MAIN ] RNST: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:16:34.271521] [WARN ] [MAIN ] RNST: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:16:34.271616] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-16T21:16:34.271723] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-16T21:16:34.271769] [INFO ] [LOCAL ] RNST: Starting deletion of derivative data. [2025-10-16T21:16:34.271814] [DEBUG] [LOCAL ] RNST: No derivative data file found to delete. [2025-10-16T21:16:34.271873] [INFO ] [MAIN ] Update Progress: 1822/2369 symbols completed. RNST took 28.7s. Estimated remaining: 1h 17m 1s. Rate: 7.1 symbols/min [2025-10-16T21:16:34.347925] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-16T21:16:34.449506] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:16:34.449727] [DEBUG] [LOCAL ] ROL: No existing data file found in primary storage. [2025-10-16T21:16:34.449776] [WARN ] [MAIN ] ROL: No existing data found, performing full refresh instead. [2025-10-16T21:16:34.449943] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-16T21:16:34.450003] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-16T21:16:34.450049] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-16T21:16:34.450082] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-16T21:16:34.794876] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:16:35.142810] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-16T21:16:35.726916] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T21:16:35.942829] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-10-16T21:16:36.742797] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-16T21:16:36.849326] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T21:16:37.542836] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-16T21:16:37.656530] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T21:16:37.862348] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T21:16:38.342881] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-16T21:16:39.142910] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-16T21:16:39.220520] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T21:16:39.782508] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T21:16:39.784914] [INFO ] [REMOTE ] ROG: Full fetch complete (30756 records). [2025-10-16T21:16:39.784991] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-16T21:16:39.785455] [FATAL] [VALIDATOR ] ROG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:16:39.785541] [FATAL] [MAIN ] ROG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:16:39.785585] [WARN ] [MAIN ] ROG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:16:39.785676] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-16T21:16:39.785753] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-16T21:16:39.785790] [INFO ] [LOCAL ] ROG: Starting deletion of derivative data. [2025-10-16T21:16:39.785831] [DEBUG] [LOCAL ] ROG: No derivative data file found to delete. [2025-10-16T21:16:39.785885] [INFO ] [MAIN ] Update Progress: 1823/2369 symbols completed. ROG took 28.9s. Estimated remaining: 1h 16m 51s. Rate: 7.1 symbols/min [2025-10-16T21:16:39.955397] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-16T21:16:39.958523] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:16:39.959438] [DEBUG] [LOCAL ] RPM: No existing data file found in primary storage. [2025-10-16T21:16:39.959513] [WARN ] [MAIN ] RPM: No existing data found, performing full refresh instead. [2025-10-16T21:16:39.959624] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-16T21:16:39.959695] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-16T21:16:39.959754] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-16T21:16:39.959787] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-16T21:16:40.336534] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:16:40.347944] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T21:16:40.742858] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-16T21:16:41.542808] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-10-16T21:16:41.788068] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T21:16:42.160145] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T21:16:42.342823] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-16T21:16:43.121246] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T21:16:43.142767] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-16T21:16:43.862614] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T21:16:43.867461] [INFO ] [REMOTE ] RNR: Full fetch complete (50819 records). [2025-10-16T21:16:43.867588] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-16T21:16:43.869335] [FATAL] [VALIDATOR ] RNR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:16:43.869560] [FATAL] [MAIN ] RNR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:16:43.869629] [WARN ] [MAIN ] RNR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:16:43.869736] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-16T21:16:43.869811] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-16T21:16:43.869849] [INFO ] [LOCAL ] RNR: Starting deletion of derivative data. [2025-10-16T21:16:43.869891] [DEBUG] [LOCAL ] RNR: No derivative data file found to delete. [2025-10-16T21:16:43.869961] [INFO ] [MAIN ] Update Progress: 1824/2369 symbols completed. RNR took 53.5s. Estimated remaining: 1h 16m 41s. Rate: 7.1 symbols/min [2025-10-16T21:16:43.952553] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-16T21:16:44.054743] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:16:44.075251] [DEBUG] [LOCAL ] RPT: Loaded 19093 existing records from primary storage. [2025-10-16T21:16:44.075520] [INFO ] [MAIN ] RPT: Loaded 19093 existing records. [2025-10-16T21:16:44.269479] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:16:44.295486] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-16T21:16:44.295768] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-16T21:16:44.297241] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T21:16:44.297287] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-10-16T21:16:44.297414] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-16T21:16:44.676557] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:16:44.742775] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-10-16T21:16:45.542796] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-16T21:16:45.679855] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T21:16:45.733304] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T21:16:46.342866] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-16T21:16:47.142786] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-16T21:16:47.602576] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-16T21:16:47.942781] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-16T21:16:48.059328] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T21:16:48.105681] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T21:16:48.742857] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-16T21:16:49.542794] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-16T21:16:49.589111] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T21:16:50.342813] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-16T21:16:50.377324] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T21:16:50.382309] [INFO ] [REMOTE ] ROK: Full fetch complete (62498 records). [2025-10-16T21:16:50.382446] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-16T21:16:50.383378] [FATAL] [VALIDATOR ] ROK: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:16:50.383468] [FATAL] [MAIN ] ROK: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:16:50.383519] [WARN ] [MAIN ] ROK: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:16:50.383608] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-16T21:16:50.383720] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-16T21:16:50.383770] [INFO ] [LOCAL ] ROK: Starting deletion of derivative data. [2025-10-16T21:16:50.383812] [DEBUG] [LOCAL ] ROK: No derivative data file found to delete. [2025-10-16T21:16:50.383870] [INFO ] [MAIN ] Update Progress: 1825/2369 symbols completed. ROK took 32.9s. Estimated remaining: 1h 16m 32s. Rate: 7.1 symbols/min [2025-10-16T21:16:50.563888] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:16:50.564098] [DEBUG] [LOCAL ] RQI: No existing data file found in primary storage. [2025-10-16T21:16:50.564169] [WARN ] [MAIN ] RQI: No existing data found, performing full refresh instead. [2025-10-16T21:16:50.564435] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-16T21:16:50.564498] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-16T21:16:50.564547] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-16T21:16:50.564660] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-16T21:16:50.679976] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-16T21:16:50.967788] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:16:51.142794] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-10-16T21:16:51.760728] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T21:16:51.942829] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-16T21:16:52.621196] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T21:16:52.742809] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-16T21:16:53.390093] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-16T21:16:53.542810] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-16T21:16:53.811182] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T21:16:54.342817] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-16T21:16:54.941992] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T21:16:55.142863] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-16T21:16:55.731466] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T21:16:55.942822] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-16T21:16:56.254722] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T21:16:56.742853] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-16T21:16:57.375877] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T21:16:57.542814] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-16T21:16:57.985942] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-16T21:16:58.342808] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-16T21:16:59.019287] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T21:16:59.142794] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-16T21:16:59.180383] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-16T21:16:59.942803] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-16T21:17:00.408458] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-16T21:17:00.742816] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-16T21:17:01.542837] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-16T21:17:01.592147] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T21:17:01.891223] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T21:17:02.342802] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-16T21:17:03.142786] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-16T21:17:03.362341] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T21:17:03.689575] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T21:17:03.942803] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-16T21:17:04.370691] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T21:17:04.742820] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-16T21:17:05.542775] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-16T21:17:05.633028] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T21:17:05.838089] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T21:17:06.342795] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-16T21:17:07.052006] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T21:17:07.142778] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-16T21:17:07.942839] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-16T21:17:08.096972] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T21:17:08.400326] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T21:17:08.742791] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-16T21:17:09.011100] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T21:17:09.542857] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-16T21:17:09.594241] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T21:17:09.600505] [INFO ] [REMOTE ] RPM: Full fetch complete (59448 records). [2025-10-16T21:17:09.600627] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-16T21:17:09.601383] [FATAL] [VALIDATOR ] RPM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:17:09.601495] [FATAL] [MAIN ] RPM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:17:09.601549] [WARN ] [MAIN ] RPM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:17:09.601592] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-16T21:17:09.601669] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-16T21:17:09.601741] [INFO ] [LOCAL ] RPM: Starting deletion of derivative data. [2025-10-16T21:17:09.601786] [DEBUG] [LOCAL ] RPM: No derivative data file found to delete. [2025-10-16T21:17:09.601842] [INFO ] [MAIN ] Update Progress: 1826/2369 symbols completed. RPM took 29.8s. Estimated remaining: 1h 16m 27s. Rate: 7.1 symbols/min [2025-10-16T21:17:09.773277] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:17:09.773470] [DEBUG] [LOCAL ] RRC: No existing data file found in primary storage. [2025-10-16T21:17:09.773508] [WARN ] [MAIN ] RRC: No existing data found, performing full refresh instead. [2025-10-16T21:17:09.773622] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-16T21:17:09.773698] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-16T21:17:09.773754] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-16T21:17:09.773791] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-16T21:17:10.157698] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:17:10.342794] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-10-16T21:17:10.977331] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T21:17:11.142846] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-16T21:17:11.942855] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-16T21:17:12.203734] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-16T21:17:12.742806] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-16T21:17:12.998503] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T21:17:13.056181] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-16T21:17:13.542870] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-16T21:17:14.241970] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T21:17:14.342774] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-16T21:17:14.524705] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T21:17:14.528945] [INFO ] [REMOTE ] RPT: Full fetch complete (28384 records). [2025-10-16T21:17:14.529077] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-16T21:17:14.895968] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-10-16T21:17:14.896046] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-10-16T21:17:14.896609] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-10-16T21:17:14.896688] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-10-16T21:17:14.897414] [DEBUG] [LOCAL ] RPT: Trimmed 28384 records to 19230 (keeping 200 days of data) [2025-10-16T21:17:15.009605] [DEBUG] [LOCAL ] RPT: Primary data saved (19230 records). [2025-10-16T21:17:15.009779] [INFO ] [MAIN ] RPT: Full history saved. [2025-10-16T21:17:15.009869] [INFO ] [MAIN ] Update Progress: 1827/2369 symbols completed. RPT took 31.1s. Estimated remaining: 1h 16m 18s. Rate: 7.1 symbols/min [2025-10-16T21:17:15.120210] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T21:17:15.144954] [INFO ] [REMOTE ] RQI: Full fetch complete (42898 records). [2025-10-16T21:17:15.150292] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-10-16T21:17:15.150155] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-16T21:17:15.191379] [FATAL] [VALIDATOR ] RQI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:17:15.195000] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:17:15.195294] [DEBUG] [LOCAL ] RRX: No existing data file found in primary storage. [2025-10-16T21:17:15.195213] [FATAL] [MAIN ] RQI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:17:15.195409] [WARN ] [MAIN ] RQI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:17:15.195530] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-16T21:17:15.195445] [WARN ] [MAIN ] RRX: No existing data found, performing full refresh instead. [2025-10-16T21:17:15.195717] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-16T21:17:15.195779] [INFO ] [LOCAL ] RQI: Starting deletion of derivative data. [2025-10-16T21:17:15.195930] [DEBUG] [LOCAL ] RQI: No derivative data file found to delete. [2025-10-16T21:17:15.195851] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-16T21:17:15.196062] [INFO ] [MAIN ] Update Progress: 1828/2369 symbols completed. RQI took 24.8s. Estimated remaining: 1h 16m 7s. Rate: 7.1 symbols/min [2025-10-16T21:17:15.207779] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-16T21:17:15.269413] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-16T21:17:15.280483] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-16T21:17:15.481993] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:17:15.493224] [DEBUG] [LOCAL ] RS: No existing data file found in primary storage. [2025-10-16T21:17:15.498437] [WARN ] [MAIN ] RS: No existing data found, performing full refresh instead. [2025-10-16T21:17:15.508857] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-16T21:17:15.514034] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-16T21:17:15.536108] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-16T21:17:15.541704] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-16T21:17:15.957429] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-16T21:17:16.056589] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:17:16.149981] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:17:16.742828] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-10-16T21:17:17.022242] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T21:17:17.542808] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-16T21:17:17.942708] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-16T21:17:18.260754] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T21:17:18.342793] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-10-16T21:17:19.142788] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-16T21:17:19.367136] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T21:17:19.943884] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-16T21:17:19.947719] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T21:17:20.742908] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-16T21:17:20.984411] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-16T21:17:21.541849] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T21:17:21.548327] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-16T21:17:22.342831] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-16T21:17:22.471160] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T21:17:23.099814] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T21:17:23.106326] [INFO ] [REMOTE ] ROL: Full fetch complete (72847 records). [2025-10-16T21:17:23.106483] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-16T21:17:23.107207] [FATAL] [VALIDATOR ] ROL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:17:23.107313] [FATAL] [MAIN ] ROL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:17:23.107358] [WARN ] [MAIN ] ROL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:17:23.107467] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-16T21:17:23.107541] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-16T21:17:23.107578] [INFO ] [LOCAL ] ROL: Starting deletion of derivative data. [2025-10-16T21:17:23.107616] [DEBUG] [LOCAL ] ROL: No derivative data file found to delete. [2025-10-16T21:17:23.107712] [INFO ] [MAIN ] Update Progress: 1829/2369 symbols completed. ROL took 48.8s. Estimated remaining: 1h 15m 58s. Rate: 7.1 symbols/min [2025-10-16T21:17:23.147983] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-16T21:17:23.287763] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:17:23.294602] [DEBUG] [LOCAL ] RSF: Loaded 4330 existing records from primary storage. [2025-10-16T21:17:23.294829] [INFO ] [MAIN ] RSF: Loaded 4330 existing records. [2025-10-16T21:17:23.476409] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:17:23.477240] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-16T21:17:23.477428] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-16T21:17:23.478047] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-10-16T21:17:23.478351] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-16T21:17:23.649446] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-16T21:17:23.892354] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:17:23.942821] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-10-16T21:17:24.556118] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-16T21:17:24.742881] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-16T21:17:24.823814] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T21:17:25.542887] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-16T21:17:26.342818] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-16T21:17:26.395420] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T21:17:27.142848] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-16T21:17:27.667440] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-16T21:17:27.907227] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T21:17:27.942768] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-16T21:17:28.742853] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-16T21:17:29.094829] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T21:17:29.428092] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T21:17:29.508734] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T21:17:29.542810] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-16T21:17:30.342850] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-16T21:17:31.142816] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-16T21:17:31.452163] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-16T21:17:31.942871] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-16T21:17:32.104722] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-16T21:17:32.211811] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T21:17:32.742798] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-16T21:17:33.327444] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T21:17:33.398304] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T21:17:33.542783] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-16T21:17:34.342861] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-16T21:17:35.115042] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T21:17:35.142770] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-16T21:17:35.595448] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T21:17:35.942826] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-16T21:17:36.493154] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T21:17:36.742796] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-16T21:17:37.544217] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-16T21:17:37.547323] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T21:17:38.069792] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T21:17:38.342833] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-16T21:17:38.906104] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T21:17:39.054595] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T21:17:39.142844] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-16T21:17:39.904032] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T21:17:39.942787] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-16T21:17:40.623535] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-16T21:17:40.742832] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-16T21:17:41.542860] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-16T21:17:42.342865] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-16T21:17:42.765846] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T21:17:42.809095] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T21:17:43.142835] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-16T21:17:43.707545] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T21:17:43.864852] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T21:17:43.942819] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-16T21:17:44.742800] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-16T21:17:45.172285] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T21:17:45.516951] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T21:17:45.542788] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-16T21:17:46.342859] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-16T21:17:47.137171] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T21:17:47.140873] [INFO ] [REMOTE ] RS: Full fetch complete (38637 records). [2025-10-16T21:17:47.141051] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-16T21:17:47.141741] [FATAL] [VALIDATOR ] RS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:17:47.141832] [FATAL] [MAIN ] RS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:17:47.141878] [WARN ] [MAIN ] RS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:17:47.141947] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-16T21:17:47.142018] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-16T21:17:47.142056] [INFO ] [LOCAL ] RS: Starting deletion of derivative data. [2025-10-16T21:17:47.142096] [DEBUG] [LOCAL ] RS: No derivative data file found to delete. [2025-10-16T21:17:47.142158] [INFO ] [MAIN ] Update Progress: 1830/2369 symbols completed. RS took 31.9s. Estimated remaining: 1h 15m 55s. Rate: 7.1 symbols/min [2025-10-16T21:17:47.147482] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-16T21:17:47.337210] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:17:47.337481] [DEBUG] [LOCAL ] RSG: No existing data file found in primary storage. [2025-10-16T21:17:47.337681] [WARN ] [MAIN ] RSG: No existing data found, performing full refresh instead. [2025-10-16T21:17:47.337850] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-16T21:17:47.337909] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-16T21:17:47.338038] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-16T21:17:47.338091] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-16T21:17:47.660946] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-16T21:17:47.754720] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:17:47.942836] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-10-16T21:17:48.052246] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T21:17:48.057505] [INFO ] [REMOTE ] RRX: Full fetch complete (58491 records). [2025-10-16T21:17:48.057628] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-16T21:17:48.058303] [FATAL] [VALIDATOR ] RRX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:17:48.058387] [FATAL] [MAIN ] RRX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:17:48.058430] [WARN ] [MAIN ] RRX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:17:48.058468] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-16T21:17:48.058523] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-16T21:17:48.058556] [INFO ] [LOCAL ] RRX: Starting deletion of derivative data. [2025-10-16T21:17:48.058593] [DEBUG] [LOCAL ] RRX: No derivative data file found to delete. [2025-10-16T21:17:48.058666] [INFO ] [MAIN ] Update Progress: 1831/2369 symbols completed. RRX took 33.0s. Estimated remaining: 1h 15m 44s. Rate: 7.1 symbols/min [2025-10-16T21:17:48.235504] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:17:48.235729] [DEBUG] [LOCAL ] RSI: No existing data file found in primary storage. [2025-10-16T21:17:48.235800] [WARN ] [MAIN ] RSI: No existing data found, performing full refresh instead. [2025-10-16T21:17:48.235920] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-16T21:17:48.235965] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-16T21:17:48.236027] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-16T21:17:48.236062] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-16T21:17:48.598355] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:17:48.742842] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-10-16T21:17:49.542823] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-16T21:17:49.668880] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T21:17:50.081711] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T21:17:50.342843] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-16T21:17:51.142853] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-16T21:17:51.566264] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-16T21:17:51.904853] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-16T21:17:51.942787] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-16T21:17:52.178257] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-16T21:17:52.412395] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-16T21:17:52.742817] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-16T21:17:53.542869] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-16T21:17:54.111609] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T21:17:54.112897] [INFO ] [REMOTE ] RSF: Full fetch complete (5685 records). [2025-10-16T21:17:54.112971] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-16T21:17:54.348121] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-16T21:17:54.496605] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-16T21:17:54.496793] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-16T21:17:54.497044] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-16T21:17:54.497120] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-16T21:17:54.497750] [DEBUG] [LOCAL ] RSF: Trimmed 5685 records to 4342 (keeping 200 days of data) [2025-10-16T21:17:54.545559] [DEBUG] [LOCAL ] RSF: Primary data saved (4342 records). [2025-10-16T21:17:54.548152] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-16T21:17:54.548446] [INFO ] [MAIN ] Update Progress: 1832/2369 symbols completed. RSF took 31.4s. Estimated remaining: 1h 15m 35s. Rate: 7.1 symbols/min [2025-10-16T21:17:54.581463] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-16T21:17:54.725127] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:17:54.755965] [DEBUG] [LOCAL ] RSKD: Loaded 33461 existing records from primary storage. [2025-10-16T21:17:54.756239] [INFO ] [MAIN ] RSKD: Loaded 33461 existing records. [2025-10-16T21:17:54.929579] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:17:54.929811] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-16T21:17:54.929861] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-16T21:17:54.930034] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-10-16T21:17:54.930077] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-16T21:17:55.148041] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-16T21:17:55.292426] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:17:55.405276] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T21:17:55.411926] [INFO ] [REMOTE ] RRC: Full fetch complete (76357 records). [2025-10-16T21:17:55.412061] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-16T21:17:55.412909] [FATAL] [VALIDATOR ] RRC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:17:55.413000] [FATAL] [MAIN ] RRC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:17:55.413042] [WARN ] [MAIN ] RRC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:17:55.413082] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-16T21:17:55.413149] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-16T21:17:55.413190] [INFO ] [LOCAL ] RRC: Starting deletion of derivative data. [2025-10-16T21:17:55.413237] [DEBUG] [LOCAL ] RRC: No derivative data file found to delete. [2025-10-16T21:17:55.413302] [INFO ] [MAIN ] Update Progress: 1833/2369 symbols completed. RRC took 45.8s. Estimated remaining: 1h 15m 24s. Rate: 7.1 symbols/min [2025-10-16T21:17:55.582531] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:17:55.582717] [DEBUG] [LOCAL ] RTO: No existing data file found in primary storage. [2025-10-16T21:17:55.582767] [WARN ] [MAIN ] RTO: No existing data found, performing full refresh instead. [2025-10-16T21:17:55.582879] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-16T21:17:55.582920] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-16T21:17:55.582963] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-16T21:17:55.582995] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-16T21:17:55.942420] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:17:55.942777] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-10-16T21:17:56.742834] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-16T21:17:57.047172] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-16T21:17:57.542802] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-10-16T21:17:57.636196] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T21:17:58.342811] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-16T21:17:58.535454] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T21:17:59.066606] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T21:17:59.142905] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-16T21:17:59.837332] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T21:17:59.942826] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-16T21:18:00.444963] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T21:18:00.742812] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-16T21:18:01.520828] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T21:18:01.542813] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-16T21:18:02.342837] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-16T21:18:02.952102] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-16T21:18:03.051175] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T21:18:03.142820] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-16T21:18:03.927499] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T21:18:03.942768] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-16T21:18:04.742839] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-16T21:18:05.008888] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T21:18:05.542836] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-16T21:18:05.723892] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T21:18:05.905934] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-16T21:18:06.342831] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-16T21:18:07.142816] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-16T21:18:07.461405] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-16T21:18:07.942822] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-16T21:18:08.190183] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T21:18:08.651685] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T21:18:08.742803] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-16T21:18:09.495875] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T21:18:09.542776] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-16T21:18:10.200481] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T21:18:10.342800] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-16T21:18:11.142847] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-16T21:18:11.545252] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-16T21:18:11.613161] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T21:18:11.942789] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-16T21:18:12.742808] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-16T21:18:12.804725] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-16T21:18:13.368587] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T21:18:13.542832] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-16T21:18:14.342831] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-16T21:18:14.581582] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T21:18:14.794082] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T21:18:15.142823] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-16T21:18:15.842019] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T21:18:15.942792] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-16T21:18:16.610544] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T21:18:16.742811] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-16T21:18:17.000371] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T21:18:17.272108] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-16T21:18:17.542830] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-16T21:18:18.342823] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-16T21:18:19.042618] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T21:18:19.048786] [INFO ] [REMOTE ] RSG: Full fetch complete (68079 records). [2025-10-16T21:18:19.048938] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-16T21:18:19.050792] [FATAL] [VALIDATOR ] RSG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:18:19.050902] [FATAL] [MAIN ] RSG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:18:19.050969] [WARN ] [MAIN ] RSG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:18:19.051042] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-16T21:18:19.051108] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-16T21:18:19.051157] [INFO ] [LOCAL ] RSG: Starting deletion of derivative data. [2025-10-16T21:18:19.051225] [DEBUG] [LOCAL ] RSG: No derivative data file found to delete. [2025-10-16T21:18:19.051289] [INFO ] [MAIN ] Update Progress: 1834/2369 symbols completed. RSG took 31.9s. Estimated remaining: 1h 15m 20s. Rate: 7.1 symbols/min [2025-10-16T21:18:19.145637] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-16T21:18:19.237045] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T21:18:19.290219] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:18:19.290374] [DEBUG] [LOCAL ] RTX: No existing data file found in primary storage. [2025-10-16T21:18:19.290411] [WARN ] [MAIN ] RTX: No existing data found, performing full refresh instead. [2025-10-16T21:18:19.290518] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-16T21:18:19.290559] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-16T21:18:19.290598] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-16T21:18:19.290630] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-16T21:18:19.641226] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:18:19.942829] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-10-16T21:18:20.742804] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-16T21:18:21.102012] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-16T21:18:21.542802] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-16T21:18:21.681102] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T21:18:22.342843] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-16T21:18:22.422683] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T21:18:23.142847] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-16T21:18:23.408021] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T21:18:23.942832] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-16T21:18:24.543228] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-16T21:18:24.748382] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-16T21:18:24.753490] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T21:18:24.898601] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T21:18:24.903238] [INFO ] [REMOTE ] RSKD: Full fetch complete (48453 records). [2025-10-16T21:18:24.903367] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-16T21:18:25.341521] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-10-16T21:18:25.341599] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-10-16T21:18:25.342494] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-10-16T21:18:25.342557] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-10-16T21:18:25.343553] [DEBUG] [LOCAL ] RSKD: Trimmed 48453 records to 33696 (keeping 200 days of data) [2025-10-16T21:18:25.521678] [DEBUG] [LOCAL ] RSKD: Primary data saved (33696 records). [2025-10-16T21:18:25.521824] [INFO ] [MAIN ] RSKD: Full history saved. [2025-10-16T21:18:25.521913] [INFO ] [MAIN ] Update Progress: 1835/2369 symbols completed. RSKD took 31.0s. Estimated remaining: 1h 15m 11s. Rate: 7.1 symbols/min [2025-10-16T21:18:25.550527] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-16T21:18:25.689709] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:18:25.689896] [DEBUG] [LOCAL ] RVLV: No existing data file found in primary storage. [2025-10-16T21:18:25.689934] [WARN ] [MAIN ] RVLV: No existing data found, performing full refresh instead. [2025-10-16T21:18:25.690051] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-16T21:18:25.690092] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-16T21:18:25.690132] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-16T21:18:25.690163] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-16T21:18:26.043862] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:18:26.342843] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-16T21:18:26.431877] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T21:18:27.142828] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-16T21:18:27.665173] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-16T21:18:27.751971] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T21:18:27.942793] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-16T21:18:28.044669] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T21:18:28.050663] [INFO ] [REMOTE ] RSI: Full fetch complete (69362 records). [2025-10-16T21:18:28.050779] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-16T21:18:28.051391] [FATAL] [VALIDATOR ] RSI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:18:28.051498] [FATAL] [MAIN ] RSI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:18:28.051557] [WARN ] [MAIN ] RSI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:18:28.051598] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-16T21:18:28.051728] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-16T21:18:28.051770] [INFO ] [LOCAL ] RSI: Starting deletion of derivative data. [2025-10-16T21:18:28.051810] [DEBUG] [LOCAL ] RSI: No derivative data file found to delete. [2025-10-16T21:18:28.051869] [INFO ] [MAIN ] Update Progress: 1836/2369 symbols completed. RSI took 40.0s. Estimated remaining: 1h 15m 1s. Rate: 7.1 symbols/min [2025-10-16T21:18:28.217592] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:18:28.217926] [DEBUG] [LOCAL ] RVT: No existing data file found in primary storage. [2025-10-16T21:18:28.217972] [WARN ] [MAIN ] RVT: No existing data found, performing full refresh instead. [2025-10-16T21:18:28.218106] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-16T21:18:28.218165] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-16T21:18:28.218246] [DEBUG] [LOCAL ] RVT: No primary data file found to delete. [2025-10-16T21:18:28.218287] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-16T21:18:28.575945] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:18:28.742826] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-10-16T21:18:29.542816] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-10-16T21:18:30.342790] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-16T21:18:30.467511] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T21:18:30.597100] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-10-16T21:18:30.693254] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T21:18:31.142823] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-16T21:18:31.942827] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-16T21:18:31.983545] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T21:18:32.742831] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-16T21:18:33.374735] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-16T21:18:33.439837] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T21:18:33.466039] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T21:18:33.472058] [INFO ] [REMOTE ] RTO: Full fetch complete (58520 records). [2025-10-16T21:18:33.472319] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-16T21:18:33.473398] [FATAL] [VALIDATOR ] RTO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:18:33.473495] [FATAL] [MAIN ] RTO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:18:33.473538] [WARN ] [MAIN ] RTO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:18:33.473582] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-16T21:18:33.473679] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-16T21:18:33.473739] [INFO ] [LOCAL ] RTO: Starting deletion of derivative data. [2025-10-16T21:18:33.473783] [DEBUG] [LOCAL ] RTO: No derivative data file found to delete. [2025-10-16T21:18:33.473846] [INFO ] [MAIN ] Update Progress: 1837/2369 symbols completed. RTO took 38.1s. Estimated remaining: 1h 14m 52s. Rate: 7.1 symbols/min [2025-10-16T21:18:33.542778] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-16T21:18:34.342835] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-16T21:18:35.142808] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-16T21:18:35.619787] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-16T21:18:35.942807] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-16T21:18:36.120437] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T21:18:36.742864] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-16T21:18:37.584985] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T21:18:37.595417] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-16T21:18:37.649495] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-16T21:18:37.679536] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T21:18:38.342817] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-16T21:18:39.142821] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-16T21:18:39.305769] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T21:18:39.753597] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T21:18:39.942892] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-16T21:18:40.742888] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-16T21:18:41.295394] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-16T21:18:41.542785] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-16T21:18:41.833132] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T21:18:42.097711] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T21:18:42.342824] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-16T21:18:43.142898] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-16T21:18:43.870026] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-16T21:18:43.951413] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-16T21:18:43.957348] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T21:18:44.043865] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T21:18:44.742831] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-16T21:18:45.542857] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-16T21:18:45.952925] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-16T21:18:45.982025] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T21:18:46.342843] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-16T21:18:47.016720] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T21:18:47.142856] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-16T21:18:47.415606] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T21:18:47.942838] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-16T21:18:48.168802] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-16T21:18:48.742846] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-16T21:18:49.546827] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-16T21:18:49.571906] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T21:18:49.580967] [INFO ] [REMOTE ] RTX: Full fetch complete (77484 records). [2025-10-16T21:18:49.581207] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-16T21:18:49.582260] [FATAL] [VALIDATOR ] RTX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:18:49.582362] [FATAL] [MAIN ] RTX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:18:49.582446] [WARN ] [MAIN ] RTX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:18:49.582495] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-16T21:18:49.582564] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-16T21:18:49.582706] [INFO ] [LOCAL ] RTX: Starting deletion of derivative data. [2025-10-16T21:18:49.582764] [DEBUG] [LOCAL ] RTX: No derivative data file found to delete. [2025-10-16T21:18:49.582833] [INFO ] [MAIN ] Update Progress: 1838/2369 symbols completed. RTX took 30.5s. Estimated remaining: 1h 14m 45s. Rate: 7.1 symbols/min [2025-10-16T21:18:49.664562] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T21:18:50.342850] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-16T21:18:50.875752] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T21:18:51.142799] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-16T21:18:52.052484] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T21:18:52.064055] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-16T21:18:52.493777] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T21:18:52.583749] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-16T21:18:52.590331] [INFO ] [REMOTE ] RVLV: Full fetch complete (68716 records). [2025-10-16T21:18:52.590543] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-16T21:18:52.591540] [FATAL] [VALIDATOR ] RVLV: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:18:52.591638] [FATAL] [MAIN ] RVLV: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:18:52.591723] [WARN ] [MAIN ] RVLV: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:18:52.591768] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-16T21:18:52.591833] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-16T21:18:52.591868] [INFO ] [LOCAL ] RVLV: Starting deletion of derivative data. [2025-10-16T21:18:52.591907] [DEBUG] [LOCAL ] RVLV: No derivative data file found to delete. [2025-10-16T21:18:52.591978] [INFO ] [MAIN ] Update Progress: 1839/2369 symbols completed. RVLV took 27.1s. Estimated remaining: 1h 14m 35s. Rate: 7.1 symbols/min [2025-10-16T21:18:52.742842] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-16T21:18:53.453939] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-16T21:18:53.457598] [INFO ] [REMOTE ] RVT: Full fetch complete (39009 records). [2025-10-16T21:18:53.457728] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-16T21:18:53.458334] [FATAL] [VALIDATOR ] RVT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:18:53.458435] [FATAL] [MAIN ] RVT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:18:53.458506] [WARN ] [MAIN ] RVT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:18:53.458590] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-16T21:18:53.458702] [DEBUG] [LOCAL ] RVT: No primary data file found to delete. [2025-10-16T21:18:53.458760] [INFO ] [LOCAL ] RVT: Starting deletion of derivative data. [2025-10-16T21:18:53.458805] [DEBUG] [LOCAL ] RVT: No derivative data file found to delete. [2025-10-16T21:18:53.458864] [INFO ] [MAIN ] Update Progress: 1840/2369 symbols completed. RVT took 25.4s. Estimated remaining: 1h 14m 25s. Rate: 7.1 symbols/min [2025-10-16T21:18:54.136810] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:18:54.164608] [DEBUG] [LOCAL ] RVTY: No existing data file found in primary storage. [2025-10-16T21:18:54.246124] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:18:54.252851] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-16T21:18:54.252595] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:18:54.253620] [WARN ] [MAIN ] RVTY: No existing data found, performing full refresh instead. [2025-10-16T21:18:54.272916] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-16T21:18:54.278561] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-16T21:18:54.278789] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-16T21:18:54.278417] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-16T21:18:54.277888] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:18:54.279208] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-16T21:18:54.279503] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-16T21:18:54.284950] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-16T21:18:54.279706] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-16T21:18:54.285311] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-16T21:18:54.297668] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-16T21:18:54.297501] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-16T21:18:54.344929] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-16T21:18:54.372882] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-16T21:18:54.490919] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-16T21:18:54.528871] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-16T21:18:54.648513] [DEBUG] [LOCAL ] RWT: Loaded 40745 existing records from primary storage. [2025-10-16T21:18:54.693219] [INFO ] [MAIN ] RWT: Loaded 40745 existing records. [2025-10-16T21:18:55.430237] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:18:55.531123] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-16T21:18:55.597388] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-16T21:18:55.675362] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-10-16T21:18:55.664808] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:18:55.723671] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-16T21:18:55.734264] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-10-16T21:18:55.794424] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:18:55.832077] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-10-16T21:18:55.980363] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:18:55.987107] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-10-16T21:18:56.250557] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:18:56.250998] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-10-16T21:18:56.475861] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-16T21:18:56.551836] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-16T21:18:56.742849] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-16T21:18:57.517834] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-16T21:18:57.543691] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-16T21:18:57.546853] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T21:18:57.632608] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T21:18:58.219258] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T21:18:58.342837] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-16T21:18:59.142847] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-16T21:18:59.942822] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-16T21:19:00.010071] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T21:19:00.453211] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-16T21:19:00.742811] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-16T21:19:00.909786] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T21:19:01.321774] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T21:19:01.542853] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-16T21:19:02.342830] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-16T21:19:02.889286] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-16T21:19:03.113106] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T21:19:03.142789] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-16T21:19:03.942837] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-16T21:19:04.742841] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-16T21:19:04.859724] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T21:19:05.323296] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T21:19:05.542839] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-16T21:19:05.605037] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T21:19:06.122169] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T21:19:06.342832] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-16T21:19:07.105323] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-16T21:19:07.142848] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-16T21:19:07.674741] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-16T21:19:07.942822] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-16T21:19:08.691935] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T21:19:08.742834] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-16T21:19:09.425473] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-16T21:19:09.542828] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-16T21:19:10.104868] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-16T21:19:10.106012] [INFO ] [REMOTE ] RWTO: Full fetch complete (4818 records). [2025-10-16T21:19:10.106083] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-16T21:19:10.295000] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-16T21:19:10.295271] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:19:10.295319] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:19:10.295391] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-16T21:19:10.295463] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-16T21:19:10.295502] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-16T21:19:10.295542] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-16T21:19:10.295607] [INFO ] [MAIN ] Update Progress: 1841/2369 symbols completed. RWTO took 16.8s. Estimated remaining: 1h 14m 19s. Rate: 7.1 symbols/min [2025-10-16T21:19:10.353427] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-16T21:19:10.493765] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:19:10.493995] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-16T21:19:10.494033] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-16T21:19:10.494161] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-16T21:19:10.494201] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-16T21:19:10.494242] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-16T21:19:10.494275] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-16T21:19:10.897080] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:19:11.142859] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-10-16T21:19:11.431945] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:19:11.432456] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-10-16T21:19:11.432580] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:19:11.432678] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-10-16T21:19:11.432766] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:19:11.432859] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-16T21:19:11.432966] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-16T21:19:11.433028] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-16T21:19:11.433103] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-16T21:19:11.433186] [INFO ] [MAIN ] Update Progress: 1842/2369 symbols completed. RWTP took 1.1s. Estimated remaining: 1h 14m 8s. Rate: 7.1 symbols/min [2025-10-16T21:19:11.631108] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:19:11.631328] [DEBUG] [LOCAL ] RXO: No existing data file found in primary storage. [2025-10-16T21:19:11.631366] [WARN ] [MAIN ] RXO: No existing data found, performing full refresh instead. [2025-10-16T21:19:11.631494] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-16T21:19:11.631537] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-16T21:19:11.631579] [DEBUG] [LOCAL ] RXO: No primary data file found to delete. [2025-10-16T21:19:11.631613] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-16T21:19:11.947933] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-16T21:19:12.026410] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:19:12.279986] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-16T21:19:12.629681] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-16T21:19:12.742842] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-16T21:19:13.299216] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-16T21:19:13.542851] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-16T21:19:14.342916] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-10-16T21:19:15.142910] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-16T21:19:15.378167] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T21:19:15.680439] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T21:19:15.942832] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-16T21:19:16.748500] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-16T21:19:16.760968] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T21:19:17.272447] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T21:19:17.542847] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-16T21:19:18.342809] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-16T21:19:18.500672] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T21:19:18.688542] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T21:19:19.142890] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-16T21:19:19.816051] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T21:19:19.942891] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-16T21:19:20.480838] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-16T21:19:20.742800] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-16T21:19:20.778674] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T21:19:21.542856] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-16T21:19:22.342857] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-16T21:19:22.434009] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T21:19:22.703017] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T21:19:23.142848] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-16T21:19:23.942851] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-16T21:19:24.240519] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T21:19:24.438687] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-16T21:19:24.742805] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-16T21:19:24.851866] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T21:19:25.542860] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-16T21:19:26.342823] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-16T21:19:26.529376] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T21:19:26.683595] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-16T21:19:27.142866] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-16T21:19:27.363152] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T21:19:27.942836] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-16T21:19:28.579966] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T21:19:28.742856] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-16T21:19:28.995149] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T21:19:29.179828] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T21:19:29.542866] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-16T21:19:30.053108] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-16T21:19:30.054163] [INFO ] [REMOTE ] RWTN: Full fetch complete (3155 records). [2025-10-16T21:19:30.054237] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-16T21:19:30.249201] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-16T21:19:30.249466] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:19:30.249552] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:19:30.249630] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-16T21:19:30.249741] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-16T21:19:30.249787] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-16T21:19:30.249828] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-16T21:19:30.249900] [INFO ] [MAIN ] Update Progress: 1843/2369 symbols completed. RWTN took 36.8s. Estimated remaining: 1h 14m 3s. Rate: 7.1 symbols/min [2025-10-16T21:19:30.348222] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-16T21:19:30.437786] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:19:30.438104] [DEBUG] [LOCAL ] RY: No existing data file found in primary storage. [2025-10-16T21:19:30.438162] [WARN ] [MAIN ] RY: No existing data found, performing full refresh instead. [2025-10-16T21:19:30.438324] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-16T21:19:30.438365] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-16T21:19:30.438408] [DEBUG] [LOCAL ] RY: No primary data file found to delete. [2025-10-16T21:19:30.438442] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-16T21:19:30.805517] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:19:31.142848] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-16T21:19:31.942878] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-16T21:19:32.152018] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T21:19:32.742862] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-10-16T21:19:32.923361] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T21:19:33.259776] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T21:19:33.265799] [INFO ] [REMOTE ] RWT: Full fetch complete (58253 records). [2025-10-16T21:19:33.265947] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-16T21:19:33.550781] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-10-16T21:19:33.690443] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-10-16T21:19:33.690560] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-10-16T21:19:33.692242] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-10-16T21:19:33.692354] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-10-16T21:19:33.694792] [DEBUG] [LOCAL ] RWT: Trimmed 58253 records to 41041 (keeping 200 days of data) [2025-10-16T21:19:33.969762] [DEBUG] [LOCAL ] RWT: Primary data saved (41041 records). [2025-10-16T21:19:33.969939] [INFO ] [MAIN ] RWT: Full history saved. [2025-10-16T21:19:33.970577] [INFO ] [MAIN ] Update Progress: 1844/2369 symbols completed. RWT took 40.5s. Estimated remaining: 1h 13m 53s. Rate: 7.1 symbols/min [2025-10-16T21:19:34.146338] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:19:34.146614] [DEBUG] [LOCAL ] RYAM: No existing data file found in primary storage. [2025-10-16T21:19:34.146768] [WARN ] [MAIN ] RYAM: No existing data found, performing full refresh instead. [2025-10-16T21:19:34.146896] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-16T21:19:34.146938] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-16T21:19:34.146978] [DEBUG] [LOCAL ] RYAM: No primary data file found to delete. [2025-10-16T21:19:34.147011] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-16T21:19:34.347952] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-16T21:19:34.558725] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-16T21:19:34.607705] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:19:35.142903] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-16T21:19:35.379522] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T21:19:35.561660] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T21:19:35.942850] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-10-16T21:19:36.742828] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-16T21:19:36.922473] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T21:19:37.458353] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T21:19:37.542785] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-16T21:19:38.342832] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-16T21:19:38.469504] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T21:19:38.498909] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T21:19:39.142850] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-16T21:19:39.942818] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-10. [2025-10-16T21:19:40.090862] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-16T21:19:40.158350] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T21:19:40.684164] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T21:19:40.690859] [INFO ] [REMOTE ] RVTY: Full fetch complete (67288 records). [2025-10-16T21:19:40.691060] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-16T21:19:40.692165] [FATAL] [VALIDATOR ] RVTY: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:19:40.692259] [FATAL] [MAIN ] RVTY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:19:40.692304] [WARN ] [MAIN ] RVTY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:19:40.692347] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-16T21:19:40.692416] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-16T21:19:40.692456] [INFO ] [LOCAL ] RVTY: Starting deletion of derivative data. [2025-10-16T21:19:40.692495] [DEBUG] [LOCAL ] RVTY: No derivative data file found to delete. [2025-10-16T21:19:40.692560] [INFO ] [MAIN ] Update Progress: 1845/2369 symbols completed. RVTY took 47.2s. Estimated remaining: 1h 13m 44s. Rate: 7.1 symbols/min [2025-10-16T21:19:40.752230] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-16T21:19:40.882604] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:19:40.882874] [DEBUG] [LOCAL ] RYAN: No existing data file found in primary storage. [2025-10-16T21:19:40.882920] [WARN ] [MAIN ] RYAN: No existing data found, performing full refresh instead. [2025-10-16T21:19:40.883046] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-16T21:19:40.883090] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-16T21:19:40.883130] [DEBUG] [LOCAL ] RYAN: No primary data file found to delete. [2025-10-16T21:19:40.883166] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-16T21:19:41.319634] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:19:41.542856] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-16T21:19:42.342853] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-10-16T21:19:42.846146] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-16T21:19:42.914517] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T21:19:43.142856] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-16T21:19:43.934106] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T21:19:43.943017] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-16T21:19:44.742819] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-16T21:19:44.778737] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T21:19:45.542817] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-16T21:19:45.593334] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T21:19:46.342818] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-16T21:19:46.552141] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T21:19:47.085623] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T21:19:47.142886] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-16T21:19:47.879444] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T21:19:47.942859] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-16T21:19:48.213900] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T21:19:48.742846] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-16T21:19:49.542860] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-16T21:19:49.778486] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T21:19:50.242309] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T21:19:50.342829] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-16T21:19:51.142797] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-16T21:19:51.431247] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-16T21:19:51.902231] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T21:19:51.927567] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T21:19:51.934060] [INFO ] [REMOTE ] RXO: Full fetch complete (68446 records). [2025-10-16T21:19:51.934222] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-16T21:19:51.935092] [FATAL] [VALIDATOR ] RXO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:19:51.935197] [FATAL] [MAIN ] RXO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:19:51.935241] [WARN ] [MAIN ] RXO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:19:51.935282] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-16T21:19:51.935361] [DEBUG] [LOCAL ] RXO: No primary data file found to delete. [2025-10-16T21:19:51.935417] [INFO ] [LOCAL ] RXO: Starting deletion of derivative data. [2025-10-16T21:19:51.935459] [DEBUG] [LOCAL ] RXO: No derivative data file found to delete. [2025-10-16T21:19:51.935522] [INFO ] [MAIN ] Update Progress: 1846/2369 symbols completed. RXO took 40.5s. Estimated remaining: 1h 13m 36s. Rate: 7.1 symbols/min [2025-10-16T21:19:51.947963] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-16T21:19:52.109534] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:19:52.109790] [DEBUG] [LOCAL ] RYI: No existing data file found in primary storage. [2025-10-16T21:19:52.109837] [WARN ] [MAIN ] RYI: No existing data found, performing full refresh instead. [2025-10-16T21:19:52.109965] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-16T21:19:52.110008] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-16T21:19:52.110050] [DEBUG] [LOCAL ] RYI: No primary data file found to delete. [2025-10-16T21:19:52.110087] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-16T21:19:52.466980] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:19:52.742894] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-16T21:19:53.542835] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-16T21:19:53.770310] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T21:19:53.885673] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-16T21:19:54.342835] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-16T21:19:55.097114] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T21:19:55.102160] [INFO ] [REMOTE ] RYAM: Full fetch complete (48890 records). [2025-10-16T21:19:55.102385] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-16T21:19:55.103305] [FATAL] [VALIDATOR ] RYAM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:19:55.103398] [FATAL] [MAIN ] RYAM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:19:55.103443] [WARN ] [MAIN ] RYAM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:19:55.103488] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-16T21:19:55.103555] [DEBUG] [LOCAL ] RYAM: No primary data file found to delete. [2025-10-16T21:19:55.103593] [INFO ] [LOCAL ] RYAM: Starting deletion of derivative data. [2025-10-16T21:19:55.103634] [DEBUG] [LOCAL ] RYAM: No derivative data file found to delete. [2025-10-16T21:19:55.103741] [INFO ] [MAIN ] Update Progress: 1847/2369 symbols completed. RYAM took 21.1s. Estimated remaining: 1h 13m 26s. Rate: 7.1 symbols/min [2025-10-16T21:19:55.148069] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-10-16T21:19:55.285967] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:19:55.286331] [DEBUG] [LOCAL ] RYN: No existing data file found in primary storage. [2025-10-16T21:19:55.286492] [WARN ] [MAIN ] RYN: No existing data found, performing full refresh instead. [2025-10-16T21:19:55.286698] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-16T21:19:55.286806] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-16T21:19:55.286940] [DEBUG] [LOCAL ] RYN: No primary data file found to delete. [2025-10-16T21:19:55.287002] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-16T21:19:55.680062] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:19:55.700328] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-16T21:19:55.942832] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-10-16T21:19:56.420308] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T21:19:56.742840] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-16T21:19:57.552038] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-16T21:19:57.558618] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T21:19:57.620294] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T21:19:58.342832] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-16T21:19:59.142878] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-16T21:19:59.363219] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T21:19:59.710408] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T21:19:59.942837] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-16T21:20:00.742828] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-16T21:20:00.857070] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T21:20:01.542816] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-16T21:20:01.664004] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T21:20:02.028009] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T21:20:02.342848] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-16T21:20:03.142877] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-16T21:20:03.499527] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-16T21:20:03.614860] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-16T21:20:03.942801] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-16T21:20:04.742862] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-16T21:20:04.780580] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T21:20:05.170154] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T21:20:05.542828] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-16T21:20:06.342823] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-16T21:20:06.551026] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T21:20:07.054672] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T21:20:07.142877] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-16T21:20:07.177808] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T21:20:07.942903] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-16T21:20:08.680847] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T21:20:08.742862] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-16T21:20:09.542827] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-16T21:20:09.673355] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T21:20:09.924257] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T21:20:10.342847] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-16T21:20:11.142796] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-16T21:20:11.354719] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T21:20:11.942905] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-16T21:20:12.107605] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T21:20:12.447398] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-16T21:20:12.742804] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-16T21:20:13.528288] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T21:20:13.533990] [INFO ] [REMOTE ] RY: Full fetch complete (68921 records). [2025-10-16T21:20:13.534119] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-16T21:20:13.534892] [FATAL] [VALIDATOR ] RY: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:20:13.535004] [FATAL] [MAIN ] RY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:20:13.535074] [WARN ] [MAIN ] RY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:20:13.535167] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-16T21:20:13.535244] [DEBUG] [LOCAL ] RY: No primary data file found to delete. [2025-10-16T21:20:13.535281] [INFO ] [LOCAL ] RY: Starting deletion of derivative data. [2025-10-16T21:20:13.535319] [DEBUG] [LOCAL ] RY: No derivative data file found to delete. [2025-10-16T21:20:13.535392] [INFO ] [MAIN ] Update Progress: 1848/2369 symbols completed. RY took 43.3s. Estimated remaining: 1h 13m 21s. Rate: 7.1 symbols/min [2025-10-16T21:20:13.548580] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-16T21:20:13.716317] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:20:13.716673] [DEBUG] [LOCAL ] RZB: No existing data file found in primary storage. [2025-10-16T21:20:13.716783] [WARN ] [MAIN ] RZB: No existing data found, performing full refresh instead. [2025-10-16T21:20:13.716957] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-16T21:20:13.717172] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-16T21:20:13.717241] [DEBUG] [LOCAL ] RZB: No primary data file found to delete. [2025-10-16T21:20:13.717417] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-16T21:20:13.890242] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-16T21:20:14.112167] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:20:14.342814] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-10-16T21:20:14.776478] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T21:20:14.976899] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-16T21:20:15.142819] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-16T21:20:15.942823] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-16T21:20:16.455164] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T21:20:16.742828] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-16T21:20:17.542791] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-16T21:20:17.696347] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T21:20:17.895685] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-16T21:20:17.898949] [INFO ] [REMOTE ] RYI: Full fetch complete (31846 records). [2025-10-16T21:20:17.899043] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-16T21:20:17.899594] [FATAL] [VALIDATOR ] RYI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:20:17.899722] [FATAL] [MAIN ] RYI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:20:17.899804] [WARN ] [MAIN ] RYI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:20:17.899898] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-16T21:20:17.899981] [DEBUG] [LOCAL ] RYI: No primary data file found to delete. [2025-10-16T21:20:17.900020] [INFO ] [LOCAL ] RYI: Starting deletion of derivative data. [2025-10-16T21:20:17.900059] [DEBUG] [LOCAL ] RYI: No derivative data file found to delete. [2025-10-16T21:20:17.900115] [INFO ] [MAIN ] Update Progress: 1849/2369 symbols completed. RYI took 26.0s. Estimated remaining: 1h 13m 11s. Rate: 7.1 symbols/min [2025-10-16T21:20:18.074387] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:20:18.074589] [DEBUG] [LOCAL ] RZC: No existing data file found in primary storage. [2025-10-16T21:20:18.074666] [WARN ] [MAIN ] RZC: No existing data found, performing full refresh instead. [2025-10-16T21:20:18.074788] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-16T21:20:18.074830] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-16T21:20:18.074870] [DEBUG] [LOCAL ] RZC: No primary data file found to delete. [2025-10-16T21:20:18.074901] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-16T21:20:18.343290] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-16T21:20:18.424280] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:20:18.450897] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T21:20:19.040816] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-16T21:20:19.142832] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-16T21:20:19.942822] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-16T21:20:20.725009] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T21:20:20.742853] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-16T21:20:20.945375] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-16T21:20:21.543631] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-16T21:20:21.546617] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-16T21:20:22.342782] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-16T21:20:22.418768] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T21:20:22.424633] [INFO ] [REMOTE ] RYAN: Full fetch complete (64374 records). [2025-10-16T21:20:22.424760] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-16T21:20:22.425465] [FATAL] [VALIDATOR ] RYAN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:20:22.425551] [FATAL] [MAIN ] RYAN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:20:22.425594] [WARN ] [MAIN ] RYAN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:20:22.425683] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-16T21:20:22.425756] [DEBUG] [LOCAL ] RYAN: No primary data file found to delete. [2025-10-16T21:20:22.425791] [INFO ] [LOCAL ] RYAN: Starting deletion of derivative data. [2025-10-16T21:20:22.425830] [DEBUG] [LOCAL ] RYAN: No derivative data file found to delete. [2025-10-16T21:20:22.425883] [INFO ] [MAIN ] Update Progress: 1850/2369 symbols completed. RYAN took 41.7s. Estimated remaining: 1h 13m 2s. Rate: 7.1 symbols/min [2025-10-16T21:20:22.589763] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:20:22.644305] [DEBUG] [LOCAL ] S: Loaded 53536 existing records from primary storage. [2025-10-16T21:20:22.644624] [INFO ] [MAIN ] S: Loaded 53536 existing records. [2025-10-16T21:20:22.818022] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:20:22.818269] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-16T21:20:22.818322] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-16T21:20:22.818533] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-16T21:20:22.818589] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-16T21:20:23.147108] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-16T21:20:23.171255] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:20:23.175704] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T21:20:23.942865] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-10-16T21:20:24.739241] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-16T21:20:24.742756] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-16T21:20:24.991309] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T21:20:25.490905] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T21:20:25.542977] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-16T21:20:26.342841] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-10-16T21:20:27.142810] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-16T21:20:27.346698] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T21:20:27.909899] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T21:20:27.942792] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-16T21:20:28.730568] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-16T21:20:28.742765] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-16T21:20:29.542863] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-16T21:20:29.660525] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T21:20:30.178169] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-16T21:20:30.342818] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-16T21:20:30.836618] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-16T21:20:31.032368] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T21:20:31.037909] [INFO ] [REMOTE ] RYN: Full fetch complete (65069 records). [2025-10-16T21:20:31.038025] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-16T21:20:31.039001] [FATAL] [VALIDATOR ] RYN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:20:31.039093] [FATAL] [MAIN ] RYN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:20:31.039137] [WARN ] [MAIN ] RYN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:20:31.039206] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-16T21:20:31.039273] [DEBUG] [LOCAL ] RYN: No primary data file found to delete. [2025-10-16T21:20:31.039310] [INFO ] [LOCAL ] RYN: Starting deletion of derivative data. [2025-10-16T21:20:31.039350] [DEBUG] [LOCAL ] RYN: No derivative data file found to delete. [2025-10-16T21:20:31.039407] [INFO ] [MAIN ] Update Progress: 1851/2369 symbols completed. RYN took 35.9s. Estimated remaining: 1h 12m 53s. Rate: 7.1 symbols/min [2025-10-16T21:20:31.148032] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-16T21:20:31.211850] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:20:31.262108] [DEBUG] [LOCAL ] SA: Loaded 44342 existing records from primary storage. [2025-10-16T21:20:31.262491] [INFO ] [MAIN ] SA: Loaded 44342 existing records. [2025-10-16T21:20:31.439274] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:20:31.439489] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-16T21:20:31.439539] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-16T21:20:31.439774] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-16T21:20:31.439833] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-16T21:20:31.836893] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:20:31.942879] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-16T21:20:32.349905] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T21:20:32.671541] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T21:20:32.742823] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-16T21:20:33.474124] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-16T21:20:33.542786] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-10-16T21:20:34.342914] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-16T21:20:35.142888] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-16T21:20:35.176443] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T21:20:35.942811] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-16T21:20:36.077466] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-16T21:20:36.347094] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-16T21:20:36.632853] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-16T21:20:36.742858] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-16T21:20:37.460049] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T21:20:37.542835] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-16T21:20:38.342498] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T21:20:38.344253] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-16T21:20:38.817009] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-16T21:20:38.818236] [INFO ] [REMOTE ] RZB: Full fetch complete (8391 records). [2025-10-16T21:20:38.818344] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-16T21:20:38.818924] [FATAL] [VALIDATOR ] RZB: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T21:20:38.819012] [FATAL] [MAIN ] RZB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:20:38.819056] [WARN ] [MAIN ] RZB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:20:38.819096] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-16T21:20:38.819157] [DEBUG] [LOCAL ] RZB: No primary data file found to delete. [2025-10-16T21:20:38.819207] [INFO ] [LOCAL ] RZB: Starting deletion of derivative data. [2025-10-16T21:20:38.819275] [DEBUG] [LOCAL ] RZB: No derivative data file found to delete. [2025-10-16T21:20:38.819346] [INFO ] [MAIN ] Update Progress: 1852/2369 symbols completed. RZB took 25.3s. Estimated remaining: 1h 12m 45s. Rate: 7.1 symbols/min [2025-10-16T21:20:38.999092] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:20:39.011245] [DEBUG] [LOCAL ] SABA: Loaded 9309 existing records from primary storage. [2025-10-16T21:20:39.011487] [INFO ] [MAIN ] SABA: Loaded 9309 existing records. [2025-10-16T21:20:39.154593] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-16T21:20:39.195842] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:20:39.196027] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-16T21:20:39.196076] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-16T21:20:39.196246] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-16T21:20:39.196302] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-16T21:20:39.554938] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:20:39.944415] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-10-16T21:20:39.948713] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T21:20:40.742892] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-16T21:20:41.076433] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T21:20:41.542855] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-16T21:20:42.342809] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-16T21:20:43.122595] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-16T21:20:43.142766] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-16T21:20:43.308986] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T21:20:43.442928] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-16T21:20:43.942809] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-16T21:20:43.962005] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T21:20:44.742811] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-16T21:20:45.542782] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-16T21:20:45.703976] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T21:20:45.948114] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-16T21:20:46.342865] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-16T21:20:47.107614] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T21:20:47.130248] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-16T21:20:47.142770] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-16T21:20:47.913100] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T21:20:47.942770] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-16T21:20:48.742878] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-16T21:20:48.809572] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-16T21:20:49.542868] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-16T21:20:50.179016] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T21:20:50.304822] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T21:20:50.342772] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-16T21:20:51.142820] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-16T21:20:51.942836] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-16T21:20:52.071109] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T21:20:52.520435] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T21:20:52.742818] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-16T21:20:53.191970] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-16T21:20:53.542782] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-16T21:20:53.656351] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-16T21:20:54.342809] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-16T21:20:55.089103] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-16T21:20:55.142793] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-16T21:20:55.352373] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T21:20:55.559930] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-16T21:20:55.942823] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-16T21:20:56.742818] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-16T21:20:57.544173] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-16T21:20:57.546610] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T21:20:58.057059] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-16T21:20:58.058362] [INFO ] [REMOTE ] RZC: Full fetch complete (9701 records). [2025-10-16T21:20:58.058434] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-16T21:20:58.345678] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-16T21:20:58.436875] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-16T21:20:58.437019] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-16T21:20:58.437276] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-16T21:20:58.437317] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-16T21:20:58.437799] [DEBUG] [LOCAL ] RZC: Trimmed 9701 records to 6691 (keeping 200 days of data) [2025-10-16T21:20:58.477011] [DEBUG] [LOCAL ] RZC: Primary data saved (6691 records). [2025-10-16T21:20:58.477124] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-16T21:20:58.477193] [INFO ] [MAIN ] Update Progress: 1853/2369 symbols completed. RZC took 40.6s. Estimated remaining: 1h 12m 39s. Rate: 7.1 symbols/min [2025-10-16T21:20:58.644743] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:20:58.676127] [DEBUG] [LOCAL ] SAFE: Loaded 30428 existing records from primary storage. [2025-10-16T21:20:58.676386] [INFO ] [MAIN ] SAFE: Loaded 30428 existing records. [2025-10-16T21:20:58.854501] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:20:58.854750] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-16T21:20:58.854802] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-16T21:20:58.854999] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-10-16T21:20:58.855054] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-16T21:20:59.004407] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-16T21:20:59.148075] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-16T21:20:59.258149] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:20:59.298099] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T21:20:59.942811] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-16T21:21:00.634569] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T21:21:00.636258] [INFO ] [REMOTE ] SABA: Full fetch complete (15258 records). [2025-10-16T21:21:00.636327] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-16T21:21:00.747953] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-10-16T21:21:01.005393] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-16T21:21:01.005470] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-16T21:21:01.005876] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-16T21:21:01.005952] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-16T21:21:01.006463] [DEBUG] [LOCAL ] SABA: Trimmed 15258 records to 9369 (keeping 200 days of data) [2025-10-16T21:21:01.063469] [DEBUG] [LOCAL ] SABA: Primary data saved (9369 records). [2025-10-16T21:21:01.063600] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-16T21:21:01.063709] [INFO ] [MAIN ] Update Progress: 1854/2369 symbols completed. SABA took 22.2s. Estimated remaining: 1h 12m 29s. Rate: 7.1 symbols/min [2025-10-16T21:21:01.234442] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:21:01.257568] [DEBUG] [LOCAL ] SAH: Loaded 21266 existing records from primary storage. [2025-10-16T21:21:01.257885] [INFO ] [MAIN ] SAH: Loaded 21266 existing records. [2025-10-16T21:21:01.440923] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:21:01.441181] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-16T21:21:01.441257] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-16T21:21:01.441478] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-10-16T21:21:01.441546] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-16T21:21:01.542922] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-16T21:21:01.769248] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-16T21:21:01.864304] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:21:02.099866] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T21:21:02.342815] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-10-16T21:21:03.142784] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-16T21:21:03.226499] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T21:21:03.258480] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T21:21:03.942816] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-16T21:21:04.742803] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-16T21:21:04.974985] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T21:21:05.260202] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-16T21:21:05.542852] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-16T21:21:06.156518] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T21:21:06.342837] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-16T21:21:06.864947] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T21:21:07.142812] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-16T21:21:07.429722] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T21:21:07.942823] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-16T21:21:08.749484] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-16T21:21:08.755457] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T21:21:09.542866] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-16T21:21:09.928372] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T21:21:10.184513] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-16T21:21:10.192186] [INFO ] [REMOTE ] S: Full fetch complete (77659 records). [2025-10-16T21:21:10.192327] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-16T21:21:10.363193] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-16T21:21:10.582622] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-16T21:21:10.582724] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-16T21:21:10.583832] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-16T21:21:10.583894] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-16T21:21:10.585269] [DEBUG] [LOCAL ] S: Trimmed 77659 records to 53926 (keeping 200 days of data) [2025-10-16T21:21:10.902213] [DEBUG] [LOCAL ] S: Primary data saved (53926 records). [2025-10-16T21:21:10.902470] [INFO ] [MAIN ] S: Full history saved. [2025-10-16T21:21:10.903080] [INFO ] [MAIN ] Update Progress: 1855/2369 symbols completed. S took 48.5s. Estimated remaining: 1h 12m 21s. Rate: 7.1 symbols/min [2025-10-16T21:21:11.068299] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:21:11.068457] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-16T21:21:11.068494] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-16T21:21:11.068630] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-16T21:21:11.068705] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-16T21:21:11.068755] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-16T21:21:11.068807] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-16T21:21:11.156667] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-16T21:21:11.421611] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:21:11.817935] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T21:21:11.942801] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-16T21:21:12.018964] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-16T21:21:12.206740] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T21:21:12.742820] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-10-16T21:21:13.314616] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T21:21:13.331835] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T21:21:13.542823] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-16T21:21:13.862232] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-16T21:21:14.342828] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-16T21:21:15.142845] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-16T21:21:15.785511] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T21:21:15.942890] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-16T21:21:16.742786] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-16T21:21:16.774871] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T21:21:16.781388] [INFO ] [REMOTE ] SA: Full fetch complete (63293 records). [2025-10-16T21:21:16.781486] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-16T21:21:17.175708] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-16T21:21:17.182190] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-16T21:21:17.183719] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-16T21:21:17.184274] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-16T21:21:17.190278] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-16T21:21:17.191945] [DEBUG] [LOCAL ] SA: Trimmed 63293 records to 44726 (keeping 200 days of data) [2025-10-16T21:21:17.449572] [DEBUG] [LOCAL ] SA: Primary data saved (44726 records). [2025-10-16T21:21:17.449722] [INFO ] [MAIN ] SA: Full history saved. [2025-10-16T21:21:17.450329] [INFO ] [MAIN ] Update Progress: 1856/2369 symbols completed. SA took 46.4s. Estimated remaining: 1h 12m 12s. Rate: 7.1 symbols/min [2025-10-16T21:21:17.548022] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-16T21:21:17.621516] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:21:17.635464] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-16T21:21:17.657480] [DEBUG] [LOCAL ] SAM: Loaded 21391 existing records from primary storage. [2025-10-16T21:21:17.657736] [INFO ] [MAIN ] SAM: Loaded 21391 existing records. [2025-10-16T21:21:17.828878] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:21:17.829085] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-16T21:21:17.829136] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-16T21:21:17.829336] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-10-16T21:21:17.829391] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-16T21:21:18.203025] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:21:18.342798] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-10-16T21:21:18.400301] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T21:21:19.142800] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-16T21:21:19.336686] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T21:21:19.942819] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-16T21:21:20.545426] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T21:21:20.742856] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-16T21:21:20.958571] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T21:21:21.154090] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-16T21:21:21.542815] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-16T21:21:21.862703] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-16T21:21:22.342837] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-16T21:21:23.142892] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-16T21:21:23.821968] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T21:21:23.942803] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-16T21:21:24.257869] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T21:21:24.742834] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-16T21:21:25.051064] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T21:21:25.542873] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-16T21:21:25.800019] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T21:21:26.342872] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-16T21:21:26.920219] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T21:21:27.142841] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-16T21:21:27.480280] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-16T21:21:27.567866] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T21:21:27.942838] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-16T21:21:28.742855] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-16T21:21:29.081079] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T21:21:29.147802] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-16T21:21:29.542814] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-16T21:21:29.856097] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-16T21:21:30.342865] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-16T21:21:30.670425] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-16T21:21:31.142833] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-16T21:21:31.476999] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-16T21:21:31.942864] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-16T21:21:32.742806] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-16T21:21:32.978872] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-16T21:21:33.542908] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-16T21:21:33.864020] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-16T21:21:33.868234] [INFO ] [REMOTE ] SAFE: Full fetch complete (44467 records). [2025-10-16T21:21:33.868389] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-16T21:21:33.940670] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-16T21:21:34.271317] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-16T21:21:34.271626] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-16T21:21:34.273098] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-16T21:21:34.273198] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-16T21:21:34.275076] [DEBUG] [LOCAL ] SAFE: Trimmed 44467 records to 30601 (keeping 200 days of data) [2025-10-16T21:21:34.369144] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-16T21:21:34.491902] [DEBUG] [LOCAL ] SAFE: Primary data saved (30601 records). [2025-10-16T21:21:34.492197] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-16T21:21:34.492315] [INFO ] [MAIN ] Update Progress: 1857/2369 symbols completed. SAFE took 36.0s. Estimated remaining: 1h 12m 6s. Rate: 7.1 symbols/min [2025-10-16T21:21:34.679610] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-16T21:21:34.679407] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:21:34.680937] [INFO ] [REMOTE ] SAJ: Full fetch complete (924 records). [2025-10-16T21:21:34.681048] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-16T21:21:34.867106] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-16T21:21:34.867441] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:21:34.867521] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:21:34.867595] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-16T21:21:34.867687] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-16T21:21:34.867742] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-16T21:21:34.867784] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-16T21:21:34.867840] [INFO ] [MAIN ] Update Progress: 1858/2369 symbols completed. SAJ took 24.0s. Estimated remaining: 1h 11m 55s. Rate: 7.1 symbols/min [2025-10-16T21:21:35.075514] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:21:35.077587] [DEBUG] [LOCAL ] SAN: Loaded 52965 existing records from primary storage. [2025-10-16T21:21:35.078236] [INFO ] [MAIN ] SAN: Loaded 52965 existing records. [2025-10-16T21:21:35.152031] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-16T21:21:35.275147] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:21:35.288830] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-16T21:21:35.288914] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-16T21:21:35.289346] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-16T21:21:35.289405] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-16T21:21:35.405804] [DEBUG] [LOCAL ] SAND: Loaded 51858 existing records from primary storage. [2025-10-16T21:21:35.422131] [INFO ] [MAIN ] SAND: Loaded 51858 existing records. [2025-10-16T21:21:35.803843] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:21:35.814424] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-10-16T21:21:35.824109] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-10-16T21:21:35.844898] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-10-16T21:21:35.845026] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-10-16T21:21:35.844294] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:21:35.943310] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-10-16T21:21:36.201183] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:21:36.243264] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T21:21:36.742811] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-10-16T21:21:37.542792] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-16T21:21:37.700481] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T21:21:38.342798] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-16T21:21:38.367542] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-16T21:21:38.420062] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T21:21:39.142889] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-16T21:21:39.762547] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T21:21:39.865931] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T21:21:39.942788] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-16T21:21:40.742797] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-16T21:21:40.847298] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T21:21:40.849986] [INFO ] [REMOTE ] SAH: Full fetch complete (30823 records). [2025-10-16T21:21:40.850064] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-16T21:21:41.270957] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-16T21:21:41.271042] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-16T21:21:41.271874] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-16T21:21:41.271945] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-16T21:21:41.272864] [DEBUG] [LOCAL ] SAH: Trimmed 30823 records to 21345 (keeping 200 days of data) [2025-10-16T21:21:41.416511] [DEBUG] [LOCAL ] SAH: Primary data saved (21345 records). [2025-10-16T21:21:41.416676] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-16T21:21:41.416774] [INFO ] [MAIN ] Update Progress: 1859/2369 symbols completed. SAH took 40.4s. Estimated remaining: 1h 11m 47s. Rate: 7.1 symbols/min [2025-10-16T21:21:41.547943] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-16T21:21:41.613194] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:21:41.663739] [DEBUG] [LOCAL ] SAP: Loaded 49879 existing records from primary storage. [2025-10-16T21:21:41.664058] [INFO ] [MAIN ] SAP: Loaded 49879 existing records. [2025-10-16T21:21:41.881780] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:21:41.882063] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-16T21:21:41.882161] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-16T21:21:41.882387] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-16T21:21:41.882450] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-16T21:21:42.291711] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:21:42.342769] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-10-16T21:21:42.835858] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-16T21:21:42.943374] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T21:21:43.142816] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-16T21:21:43.615716] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T21:21:43.942818] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-10-16T21:21:44.288718] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-16T21:21:44.742822] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-16T21:21:45.548706] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-16T21:21:45.553710] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T21:21:46.342815] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-10-16T21:21:46.700734] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-16T21:21:46.745293] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-16T21:21:47.142838] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-16T21:21:47.902103] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T21:21:47.942859] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-16T21:21:48.109346] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T21:21:48.112351] [INFO ] [REMOTE ] SAM: Full fetch complete (31125 records). [2025-10-16T21:21:48.112427] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-16T21:21:48.487424] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-16T21:21:48.487505] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-16T21:21:48.488155] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-16T21:21:48.488232] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-16T21:21:48.488971] [DEBUG] [LOCAL ] SAM: Trimmed 31125 records to 21519 (keeping 200 days of data) [2025-10-16T21:21:48.617627] [DEBUG] [LOCAL ] SAM: Primary data saved (21519 records). [2025-10-16T21:21:48.617781] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-16T21:21:48.617863] [INFO ] [MAIN ] Update Progress: 1860/2369 symbols completed. SAM took 31.2s. Estimated remaining: 1h 11m 38s. Rate: 7.1 symbols/min [2025-10-16T21:21:48.748021] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-10-16T21:21:48.852437] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:21:48.872115] [DEBUG] [LOCAL ] SAR: Loaded 17223 existing records from primary storage. [2025-10-16T21:21:48.872374] [INFO ] [MAIN ] SAR: Loaded 17223 existing records. [2025-10-16T21:21:49.084658] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:21:49.084934] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-16T21:21:49.084995] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-16T21:21:49.085221] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-10-16T21:21:49.085277] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-16T21:21:49.451221] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:21:49.542788] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-10-16T21:21:49.575131] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T21:21:50.342843] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-16T21:21:50.434844] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-16T21:21:50.615517] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T21:21:51.142848] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-10-16T21:21:51.942899] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-16T21:21:52.153273] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T21:21:52.547562] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T21:21:52.745212] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-10-16T21:21:52.747004] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T21:21:53.542825] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-16T21:21:54.342845] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-16T21:21:54.470714] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T21:21:54.967840] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-16T21:21:55.142787] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-16T21:21:55.325722] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T21:21:55.942825] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-16T21:21:56.742829] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-16T21:21:57.006187] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T21:21:57.542891] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-10-16T21:21:57.735003] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T21:21:57.770250] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T21:21:58.342867] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-16T21:21:58.781590] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T21:21:59.037411] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-16T21:21:59.142810] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-10-16T21:21:59.942866] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-16T21:22:00.742890] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-16T21:22:00.929196] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T21:22:01.542848] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-16T21:22:01.743984] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T21:22:02.342804] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-16T21:22:02.641971] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T21:22:02.691338] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T21:22:03.142797] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-16T21:22:03.942794] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-16T21:22:04.116955] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-16T21:22:04.720307] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-16T21:22:04.742775] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-16T21:22:05.542900] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-16T21:22:05.915172] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T21:22:06.342835] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-16T21:22:06.429755] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T21:22:06.618273] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T21:22:07.142842] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-16T21:22:07.942927] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-16T21:22:08.253791] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-16T21:22:08.262995] [INFO ] [REMOTE ] SAN: Full fetch complete (76534 records). [2025-10-16T21:22:08.263192] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-16T21:22:08.724113] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-16T21:22:08.724325] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-16T21:22:08.725834] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-16T21:22:08.725958] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-16T21:22:08.728002] [DEBUG] [LOCAL ] SAN: Trimmed 76534 records to 53355 (keeping 200 days of data) [2025-10-16T21:22:08.780753] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-10-16T21:22:09.006291] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T21:22:09.015332] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T21:22:09.138809] [DEBUG] [LOCAL ] SAN: Primary data saved (53355 records). [2025-10-16T21:22:09.138983] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-16T21:22:09.139083] [INFO ] [MAIN ] Update Progress: 1861/2369 symbols completed. SAN took 34.6s. Estimated remaining: 1h 11m 33s. Rate: 7.1 symbols/min [2025-10-16T21:22:09.315441] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:22:09.357753] [DEBUG] [LOCAL ] SARO: Loaded 48340 existing records from primary storage. [2025-10-16T21:22:09.358060] [INFO ] [MAIN ] SARO: Loaded 48340 existing records. [2025-10-16T21:22:09.532447] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:22:09.532718] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-16T21:22:09.532774] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-16T21:22:09.532956] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-16T21:22:09.532994] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-16T21:22:09.552872] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-16T21:22:09.878457] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:22:10.342792] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-16T21:22:10.609802] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T21:22:11.068046] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T21:22:11.142830] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-10-16T21:22:11.401324] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-16T21:22:11.942822] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-10-16T21:22:12.742813] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-16T21:22:12.949550] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T21:22:13.117386] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T21:22:13.542801] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-10. [2025-10-16T21:22:13.812237] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T21:22:13.815978] [INFO ] [REMOTE ] SAR: Full fetch complete (23919 records). [2025-10-16T21:22:13.816077] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-16T21:22:14.177163] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-16T21:22:14.177240] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-16T21:22:14.177782] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-16T21:22:14.177847] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-16T21:22:14.178545] [DEBUG] [LOCAL ] SAR: Trimmed 23919 records to 17353 (keeping 200 days of data) [2025-10-16T21:22:14.284737] [DEBUG] [LOCAL ] SAR: Primary data saved (17353 records). [2025-10-16T21:22:14.284874] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-16T21:22:14.284951] [INFO ] [MAIN ] Update Progress: 1862/2369 symbols completed. SAR took 25.7s. Estimated remaining: 1h 11m 23s. Rate: 7.1 symbols/min [2025-10-16T21:22:14.348045] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-16T21:22:14.462157] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:22:14.462376] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-16T21:22:14.462418] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-16T21:22:14.462554] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-16T21:22:14.462628] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-16T21:22:14.462729] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-16T21:22:14.462775] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-16T21:22:14.810404] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:22:15.142821] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-10-16T21:22:15.262035] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T21:22:15.269600] [INFO ] [REMOTE ] SAND: Full fetch complete (74756 records). [2025-10-16T21:22:15.269813] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-10-16T21:22:15.665624] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-16T21:22:15.670985] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-10-16T21:22:15.671099] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-10-16T21:22:15.672393] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-10-16T21:22:15.672462] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-10-16T21:22:15.674019] [DEBUG] [LOCAL ] SAND: Trimmed 74756 records to 52246 (keeping 200 days of data) [2025-10-16T21:22:15.942894] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-16T21:22:15.987550] [DEBUG] [LOCAL ] SAND: Primary data saved (52246 records). [2025-10-16T21:22:15.987746] [INFO ] [MAIN ] SAND: Full history saved. [2025-10-16T21:22:15.987848] [INFO ] [MAIN ] Update Progress: 1863/2369 symbols completed. SAND took 41.1s. Estimated remaining: 1h 11m 13s. Rate: 7.1 symbols/min [2025-10-16T21:22:16.156469] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:22:16.156741] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-16T21:22:16.156898] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-16T21:22:16.157016] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-16T21:22:16.157057] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-16T21:22:16.157152] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-16T21:22:16.157201] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-16T21:22:16.540336] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:22:16.570926] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-16T21:22:16.742789] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-10-16T21:22:17.210984] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-16T21:22:17.478959] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T21:22:17.542851] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-16T21:22:18.342889] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-16T21:22:19.142888] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-16T21:22:19.504156] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-16T21:22:19.505820] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-16T21:22:19.743497] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T21:22:19.942841] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-16T21:22:20.742841] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-16T21:22:21.073741] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-16T21:22:21.542866] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-16T21:22:21.803260] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-16T21:22:21.863478] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-16T21:22:22.342875] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-16T21:22:23.142924] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-16T21:22:23.543925] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T21:22:23.942803] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-16T21:22:24.236889] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-16T21:22:24.243503] [INFO ] [REMOTE ] SAP: Full fetch complete (72142 records). [2025-10-16T21:22:24.243682] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-16T21:22:24.504492] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T21:22:24.635700] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-16T21:22:24.635798] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-16T21:22:24.636892] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-16T21:22:24.636956] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-16T21:22:24.638508] [DEBUG] [LOCAL ] SAP: Trimmed 72142 records to 50240 (keeping 200 days of data) [2025-10-16T21:22:24.742796] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-16T21:22:24.951683] [DEBUG] [LOCAL ] SAP: Primary data saved (50240 records). [2025-10-16T21:22:24.951884] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-16T21:22:24.952584] [INFO ] [MAIN ] Update Progress: 1864/2369 symbols completed. SAP took 43.5s. Estimated remaining: 1h 11m 5s. Rate: 7.1 symbols/min [2025-10-16T21:22:25.128541] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:22:25.128931] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-16T21:22:25.128978] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-16T21:22:25.129090] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-16T21:22:25.129151] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-16T21:22:25.129193] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-16T21:22:25.129224] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-16T21:22:25.214223] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-16T21:22:25.497283] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:22:25.542807] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-10-16T21:22:25.878580] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-16T21:22:26.342821] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-16T21:22:26.697218] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-16T21:22:27.142820] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-16T21:22:27.484498] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-16T21:22:27.942829] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-16T21:22:28.310356] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-16T21:22:28.742818] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-16T21:22:29.173578] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-16T21:22:29.542837] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-16T21:22:29.960440] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-16T21:22:30.342876] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-16T21:22:31.142807] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-16T21:22:31.650360] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-16T21:22:31.942795] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-16T21:22:32.086777] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T21:22:32.203003] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-16T21:22:32.742893] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-16T21:22:33.084703] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-16T21:22:33.542814] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-16T21:22:33.853089] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-16T21:22:34.342812] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-16T21:22:34.683862] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-16T21:22:35.142801] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-16T21:22:35.498524] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-16T21:22:35.942846] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-16T21:22:36.742863] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-16T21:22:37.095255] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-16T21:22:37.542794] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-16T21:22:37.778141] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T21:22:37.983221] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-16T21:22:38.342830] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-16T21:22:38.674696] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-16T21:22:38.675600] [INFO ] [REMOTE ] SAY: Full fetch complete (1376 records). [2025-10-16T21:22:38.675708] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-16T21:22:38.900404] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-16T21:22:38.900607] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:22:38.900687] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:22:38.900764] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-16T21:22:38.900829] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-16T21:22:38.900866] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-16T21:22:38.900905] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-16T21:22:38.900961] [INFO ] [MAIN ] Update Progress: 1865/2369 symbols completed. SAY took 22.9s. Estimated remaining: 1h 10m 58s. Rate: 7.1 symbols/min [2025-10-16T21:22:39.078828] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:22:39.110914] [DEBUG] [LOCAL ] SB: Loaded 32932 existing records from primary storage. [2025-10-16T21:22:39.111187] [INFO ] [MAIN ] SB: Loaded 32932 existing records. [2025-10-16T21:22:39.149143] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-16T21:22:39.290787] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:22:39.291016] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-16T21:22:39.291063] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-16T21:22:39.291346] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-16T21:22:39.291406] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-16T21:22:39.647115] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:22:39.656492] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-16T21:22:39.942818] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-16T21:22:40.281238] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-16T21:22:40.742837] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-16T21:22:41.166073] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-16T21:22:41.542808] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-16T21:22:42.342815] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-16T21:22:42.678013] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-16T21:22:43.142803] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-10-16T21:22:43.628786] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-16T21:22:43.942796] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-16T21:22:44.283535] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-16T21:22:44.672997] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T21:22:44.742775] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-16T21:22:45.542814] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-16T21:22:45.875714] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-16T21:22:45.876420] [INFO ] [REMOTE ] SAT: Full fetch complete (1508 records). [2025-10-16T21:22:45.876487] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-16T21:22:46.053790] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-16T21:22:46.053986] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:22:46.054218] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:22:46.054333] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-16T21:22:46.054462] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-16T21:22:46.054529] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-16T21:22:46.054637] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-16T21:22:46.054827] [INFO ] [MAIN ] Update Progress: 1866/2369 symbols completed. SAT took 31.8s. Estimated remaining: 1h 10m 49s. Rate: 7.1 symbols/min [2025-10-16T21:22:46.225796] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:22:46.225977] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-16T21:22:46.226043] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-16T21:22:46.226268] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-16T21:22:46.226418] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-16T21:22:46.226479] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-16T21:22:46.241689] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-16T21:22:46.323760] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T21:22:46.353785] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-16T21:22:46.625319] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:22:46.719212] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-16T21:22:47.142826] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-16T21:22:47.942834] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-16T21:22:48.570807] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T21:22:48.594513] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T21:22:48.742817] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-16T21:22:49.542819] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-16T21:22:49.909872] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-16T21:22:50.342819] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-10-16T21:22:50.380016] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T21:22:50.547762] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:22:50.548070] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-10-16T21:22:50.548158] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:22:50.548245] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-16T21:22:50.548321] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:22:50.548391] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-16T21:22:50.548457] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-16T21:22:50.548494] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-16T21:22:50.548535] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-16T21:22:50.548583] [INFO ] [MAIN ] Update Progress: 1867/2369 symbols completed. SBDS took 4.5s. Estimated remaining: 1h 10m 39s. Rate: 7.1 symbols/min [2025-10-16T21:22:50.745241] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:22:50.797457] [DEBUG] [LOCAL ] SBH: Loaded 49860 existing records from primary storage. [2025-10-16T21:22:50.797865] [INFO ] [MAIN ] SBH: Loaded 49860 existing records. [2025-10-16T21:22:51.002729] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:22:51.002957] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-16T21:22:51.003017] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-16T21:22:51.003485] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-10-16T21:22:51.003559] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-16T21:22:51.147892] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-16T21:22:51.434612] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:22:51.942819] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-10-16T21:22:52.702917] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T21:22:52.742779] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-16T21:22:53.542866] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-16T21:22:54.342865] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-16T21:23:05.386410] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (11.84 seconds). [2025-10-16T21:23:05.387788] [INFO ] [REMOTE ] SAZ: Full fetch complete (1848 records). [2025-10-16T21:23:05.387897] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-16T21:23:05.609291] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T21:23:05.609467] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:23:05.609535] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:23:05.609607] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-16T21:23:05.609698] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-16T21:23:05.609759] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-16T21:23:05.609827] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-16T21:23:05.609885] [INFO ] [MAIN ] Update Progress: 1868/2369 symbols completed. SAZ took 40.7s. Estimated remaining: 1h 10m 33s. Rate: 7.1 symbols/min [2025-10-16T21:23:05.778722] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:23:05.788069] [DEBUG] [LOCAL ] SBI: Loaded 7530 existing records from primary storage. [2025-10-16T21:23:05.788319] [INFO ] [MAIN ] SBI: Loaded 7530 existing records. [2025-10-16T21:23:05.968406] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:23:05.968607] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-16T21:23:05.968687] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-16T21:23:05.968909] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-16T21:23:05.968965] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-16T21:23:06.320504] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:23:06.321054] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-10-16T21:23:06.735193] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (13.99 seconds). [2025-10-16T21:23:06.743836] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-16T21:23:07.006661] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (12.66 seconds). [2025-10-16T21:23:07.017829] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-16T21:23:07.048471] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (15.11 seconds). [2025-10-16T21:23:07.059250] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-16T21:23:08.217108] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T21:23:08.229613] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-16T21:23:08.232028] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-16T21:23:08.233084] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-16T21:23:08.685156] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T21:23:08.695294] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-16T21:23:08.938930] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T21:23:08.940897] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-16T21:23:09.273145] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T21:23:09.280147] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-16T21:23:09.444845] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-16T21:23:09.455078] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-16T21:23:09.554135] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-16T21:23:09.556232] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-16T21:23:09.974856] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T21:23:09.984995] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-16T21:23:10.277852] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T21:23:10.280119] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-16T21:23:10.508529] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-16T21:23:10.517320] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-16T21:23:11.034894] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T21:23:11.046168] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-16T21:23:11.135037] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-16T21:23:11.137948] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-16T21:23:11.222704] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-16T21:23:11.229337] [INFO ] [REMOTE ] SARO: Full fetch complete (68952 records). [2025-10-16T21:23:11.229519] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-16T21:23:11.637390] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-16T21:23:11.637494] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-16T21:23:11.638978] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-16T21:23:11.639078] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-16T21:23:11.640539] [DEBUG] [LOCAL ] SARO: Trimmed 68952 records to 48715 (keeping 200 days of data) [2025-10-16T21:23:11.854519] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-16T21:23:11.857779] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-16T21:23:11.884172] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T21:23:11.894544] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-16T21:23:11.969949] [DEBUG] [LOCAL ] SARO: Primary data saved (48715 records). [2025-10-16T21:23:11.970084] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-16T21:23:11.970161] [INFO ] [MAIN ] Update Progress: 1869/2369 symbols completed. SARO took 1m 3s. Estimated remaining: 1h 10m 24s. Rate: 7.1 symbols/min [2025-10-16T21:23:12.146837] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:23:12.157531] [DEBUG] [LOCAL ] SBR: Loaded 7811 existing records from primary storage. [2025-10-16T21:23:12.157784] [INFO ] [MAIN ] SBR: Loaded 7811 existing records. [2025-10-16T21:23:12.337485] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:23:12.337717] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-16T21:23:12.337777] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-16T21:23:12.337959] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-16T21:23:12.338017] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-16T21:23:12.707603] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T21:23:12.711182] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:23:12.715044] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-10-16T21:23:12.714622] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-16T21:23:12.839430] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T21:23:12.850916] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-16T21:23:13.181113] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T21:23:13.191196] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-16T21:23:13.471896] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-16T21:23:13.474354] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-16T21:23:13.537544] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-16T21:23:13.542756] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-16T21:23:14.072460] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-16T21:23:14.227752] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T21:23:14.314238] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T21:23:14.343330] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-16T21:23:14.348406] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-16T21:23:14.354042] [INFO ] [REMOTE ] SB: Full fetch complete (49692 records). [2025-10-16T21:23:14.354206] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-16T21:23:14.756448] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-16T21:23:14.756529] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-16T21:23:14.757455] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-16T21:23:14.757519] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-16T21:23:14.758563] [DEBUG] [LOCAL ] SB: Trimmed 49692 records to 33128 (keeping 200 days of data) [2025-10-16T21:23:14.952427] [DEBUG] [LOCAL ] SB: Primary data saved (33128 records). [2025-10-16T21:23:14.952569] [INFO ] [MAIN ] SB: Full history saved. [2025-10-16T21:23:14.952672] [INFO ] [MAIN ] Update Progress: 1870/2369 symbols completed. SB took 36.1s. Estimated remaining: 1h 10m 14s. Rate: 7.1 symbols/min [2025-10-16T21:23:15.033871] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-16T21:23:15.139439] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:23:15.142840] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-16T21:23:15.189013] [DEBUG] [LOCAL ] SBS: Loaded 49319 existing records from primary storage. [2025-10-16T21:23:15.189351] [INFO ] [MAIN ] SBS: Loaded 49319 existing records. [2025-10-16T21:23:15.364485] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:23:15.364777] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-16T21:23:15.364826] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-16T21:23:15.365498] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-16T21:23:15.365567] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-16T21:23:15.719313] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:23:15.942842] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-10-16T21:23:16.694707] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T21:23:16.742835] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-16T21:23:17.197901] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T21:23:17.542857] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-16T21:23:18.342838] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-16T21:23:18.400987] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T21:23:18.835701] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T21:23:19.010961] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T21:23:19.012380] [INFO ] [REMOTE ] SBI: Full fetch complete (10556 records). [2025-10-16T21:23:19.012453] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-16T21:23:19.151894] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-16T21:23:19.381145] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-16T21:23:19.381227] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-16T21:23:19.381520] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-16T21:23:19.381562] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-16T21:23:19.382129] [DEBUG] [LOCAL ] SBI: Trimmed 10556 records to 7626 (keeping 200 days of data) [2025-10-16T21:23:19.426749] [DEBUG] [LOCAL ] SBI: Primary data saved (7626 records). [2025-10-16T21:23:19.426894] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-16T21:23:19.426995] [INFO ] [MAIN ] Update Progress: 1871/2369 symbols completed. SBI took 13.8s. Estimated remaining: 1h 10m 4s. Rate: 7.1 symbols/min [2025-10-16T21:23:19.598481] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:23:19.614442] [DEBUG] [LOCAL ] SBSI: Loaded 14905 existing records from primary storage. [2025-10-16T21:23:19.614689] [INFO ] [MAIN ] SBSI: Loaded 14905 existing records. [2025-10-16T21:23:19.791504] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:23:19.791716] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-16T21:23:19.791770] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-16T21:23:19.792102] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-10-16T21:23:19.792171] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-16T21:23:19.944674] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-16T21:23:20.073799] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T21:23:20.162709] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:23:20.742816] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-16T21:23:21.483515] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T21:23:21.542785] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-16T21:23:21.572466] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T21:23:22.342825] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-10-16T21:23:22.406496] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T21:23:23.061377] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-16T21:23:23.142789] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-16T21:23:23.942895] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-16T21:23:24.193492] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T21:23:24.524114] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T21:23:24.742818] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-16T21:23:25.543759] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-16T21:23:25.544625] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-16T21:23:26.342795] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-16T21:23:26.999146] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-16T21:23:27.142843] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-16T21:23:27.410730] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T21:23:27.942854] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-16T21:23:28.742859] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-16T21:23:28.796295] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T21:23:29.542789] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-16T21:23:29.599625] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-16T21:23:29.680699] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T21:23:30.342808] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-16T21:23:31.142797] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-16T21:23:31.222871] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T21:23:31.350345] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T21:23:31.942810] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-16T21:23:32.577046] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T21:23:32.583733] [INFO ] [REMOTE ] SBH: Full fetch complete (73098 records). [2025-10-16T21:23:32.583858] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-16T21:23:32.749032] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-16T21:23:32.769943] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-16T21:23:33.013882] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-16T21:23:33.013960] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-16T21:23:33.015035] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-16T21:23:33.015100] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-16T21:23:33.016501] [DEBUG] [LOCAL ] SBH: Trimmed 73098 records to 50242 (keeping 200 days of data) [2025-10-16T21:23:33.310825] [DEBUG] [LOCAL ] SBH: Primary data saved (50242 records). [2025-10-16T21:23:33.310968] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-16T21:23:33.311899] [INFO ] [MAIN ] Update Progress: 1872/2369 symbols completed. SBH took 42.8s. Estimated remaining: 1h 9m 57s. Rate: 7.1 symbols/min [2025-10-16T21:23:33.482565] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:23:33.535817] [DEBUG] [LOCAL ] SBSW: Loaded 53172 existing records from primary storage. [2025-10-16T21:23:33.536127] [INFO ] [MAIN ] SBSW: Loaded 53172 existing records. [2025-10-16T21:23:33.549276] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-16T21:23:33.717376] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:23:33.717672] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-16T21:23:33.717731] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-16T21:23:33.718271] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-16T21:23:33.718327] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-16T21:23:33.976903] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T21:23:34.086828] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:23:34.342812] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-10-16T21:23:35.133082] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T21:23:35.143229] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-16T21:23:35.942803] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-16T21:23:36.035765] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T21:23:36.207108] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-16T21:23:36.564362] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T21:23:36.742863] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-16T21:23:37.543506] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-16T21:23:37.545028] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T21:23:37.547225] [INFO ] [REMOTE ] SBR: Full fetch complete (11315 records). [2025-10-16T21:23:37.547301] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-16T21:23:37.908471] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-16T21:23:37.908549] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-16T21:23:37.908832] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-16T21:23:37.908893] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-16T21:23:37.909371] [DEBUG] [LOCAL ] SBR: Trimmed 11315 records to 7854 (keeping 200 days of data) [2025-10-16T21:23:37.957515] [DEBUG] [LOCAL ] SBR: Primary data saved (7854 records). [2025-10-16T21:23:37.957625] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-16T21:23:37.957734] [INFO ] [MAIN ] Update Progress: 1873/2369 symbols completed. SBR took 26.0s. Estimated remaining: 1h 9m 48s. Rate: 7.1 symbols/min [2025-10-16T21:23:38.124624] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:23:38.124797] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-16T21:23:38.124839] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-16T21:23:38.124979] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-16T21:23:38.125042] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-16T21:23:38.125089] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-16T21:23:38.125122] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-16T21:23:38.347891] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-16T21:23:38.496744] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:23:39.142798] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-16T21:23:39.366110] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T21:23:39.430319] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-16T21:23:39.942951] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-16T21:23:40.747923] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-16T21:23:40.763677] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T21:23:41.542843] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-16T21:23:41.814151] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-16T21:23:41.860023] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T21:23:42.342843] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-10-16T21:23:42.604023] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-10-16T21:23:42.970856] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T21:23:43.142786] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-16T21:23:43.942823] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-16T21:23:44.742839] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-16T21:23:44.802946] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T21:23:44.865839] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-16T21:23:45.542859] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-16T21:23:46.342845] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-16T21:23:46.739600] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-16T21:23:46.752753] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-16T21:23:47.147800] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-16T21:23:47.153785] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T21:23:47.550097] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T21:23:47.942813] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-16T21:23:48.742866] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-16T21:23:49.542842] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-16T21:23:49.758580] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T21:23:49.778293] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-16T21:23:50.342864] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-16T21:23:51.142835] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-16T21:23:51.223563] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T21:23:51.226279] [INFO ] [REMOTE ] SBSI: Full fetch complete (21249 records). [2025-10-16T21:23:51.226349] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-16T21:23:51.591189] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-16T21:23:51.591356] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-16T21:23:51.591914] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-16T21:23:51.591998] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-16T21:23:51.592699] [DEBUG] [LOCAL ] SBSI: Trimmed 21249 records to 15054 (keeping 200 days of data) [2025-10-16T21:23:51.703030] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-16T21:23:51.723891] [DEBUG] [LOCAL ] SBSI: Primary data saved (15054 records). [2025-10-16T21:23:51.724023] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-16T21:23:51.724111] [INFO ] [MAIN ] Update Progress: 1874/2369 symbols completed. SBSI took 32.3s. Estimated remaining: 1h 9m 41s. Rate: 7.1 symbols/min [2025-10-16T21:23:51.912130] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:23:51.942858] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-16T21:23:51.962369] [DEBUG] [LOCAL ] SCCO: Loaded 49593 existing records from primary storage. [2025-10-16T21:23:51.962696] [INFO ] [MAIN ] SCCO: Loaded 49593 existing records. [2025-10-16T21:23:52.139967] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:23:52.140199] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-16T21:23:52.140253] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-16T21:23:52.140629] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-16T21:23:52.140722] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-16T21:23:52.539107] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:23:52.742930] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-10-16T21:23:53.542829] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-16T21:23:53.765792] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-16T21:23:53.942368] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-16T21:23:54.342823] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-16T21:23:54.410247] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T21:23:54.575659] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-16T21:23:55.142820] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-16T21:23:55.392363] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-16T21:23:55.942798] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-16T21:23:56.236989] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (5.09 seconds). [2025-10-16T21:23:56.244433] [INFO ] [REMOTE ] SBS: Full fetch complete (70398 records). [2025-10-16T21:23:56.244602] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-16T21:23:56.656134] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-16T21:23:56.656254] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-16T21:23:56.658607] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-16T21:23:56.658697] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-16T21:23:56.660619] [DEBUG] [LOCAL ] SBS: Trimmed 70398 records to 49699 (keeping 200 days of data) [2025-10-16T21:23:56.751016] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-16T21:23:56.776828] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T21:23:56.998408] [DEBUG] [LOCAL ] SBS: Primary data saved (49699 records). [2025-10-16T21:23:56.998613] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-16T21:23:56.999270] [INFO ] [MAIN ] Update Progress: 1875/2369 symbols completed. SBS took 42.0s. Estimated remaining: 1h 9m 32s. Rate: 7.1 symbols/min [2025-10-16T21:23:57.178962] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:23:57.198578] [DEBUG] [LOCAL ] SCD: Loaded 13297 existing records from primary storage. [2025-10-16T21:23:57.198922] [INFO ] [MAIN ] SCD: Loaded 13297 existing records. [2025-10-16T21:23:57.385683] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:23:57.386088] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-16T21:23:57.386154] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-16T21:23:57.386529] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-16T21:23:57.386590] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-16T21:23:57.546822] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-16T21:23:57.751805] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:23:58.342832] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-10-16T21:23:58.502777] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T21:23:59.061682] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-16T21:23:59.142835] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-16T21:23:59.310680] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T21:23:59.695981] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T21:23:59.942818] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-16T21:24:00.742881] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-16T21:24:01.225199] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-16T21:24:01.542827] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-16T21:24:01.963337] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T21:24:02.342832] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-16T21:24:03.101321] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T21:24:03.142811] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-16T21:24:03.232722] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T21:24:03.871931] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T21:24:03.942781] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-16T21:24:04.661826] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T21:24:04.742780] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-16T21:24:05.542779] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-16T21:24:05.867119] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-16T21:24:06.342864] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-16T21:24:06.718901] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-16T21:24:07.142824] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-16T21:24:07.942853] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-16T21:24:08.054012] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T21:24:08.742139] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T21:24:08.745285] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-16T21:24:09.017348] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T21:24:09.521172] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T21:24:09.542815] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-16T21:24:09.891237] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-16T21:24:09.891982] [INFO ] [REMOTE ] SBXD: Full fetch complete (3120 records). [2025-10-16T21:24:09.892053] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-16T21:24:10.070244] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 176 unique days, need 200 days [2025-10-16T21:24:10.070478] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:24:10.070549] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:24:10.070623] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-16T21:24:10.070720] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-16T21:24:10.070765] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-16T21:24:10.070811] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-16T21:24:10.070912] [INFO ] [MAIN ] Update Progress: 1876/2369 symbols completed. SBXD took 32.1s. Estimated remaining: 1h 9m 24s. Rate: 7.1 symbols/min [2025-10-16T21:24:10.235697] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:24:10.293015] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-16T21:24:10.293423] [INFO ] [MAIN ] SCHW: Loaded 53685 existing records. [2025-10-16T21:24:10.348002] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-16T21:24:10.473981] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:24:10.474218] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-16T21:24:10.474267] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-16T21:24:10.474998] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-10-16T21:24:10.475058] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-16T21:24:10.875019] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:24:11.142831] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-10-16T21:24:11.942964] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-16T21:24:12.479687] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-16T21:24:12.486794] [INFO ] [REMOTE ] SBSW: Full fetch complete (76732 records). [2025-10-16T21:24:12.486916] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-16T21:24:12.769030] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-16T21:24:12.898340] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-16T21:24:12.898440] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-16T21:24:12.899610] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-16T21:24:12.899708] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-16T21:24:12.901343] [DEBUG] [LOCAL ] SBSW: Trimmed 76732 records to 53562 (keeping 200 days of data) [2025-10-16T21:24:13.135469] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-16T21:24:13.267234] [DEBUG] [LOCAL ] SBSW: Primary data saved (53562 records). [2025-10-16T21:24:13.267400] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-16T21:24:13.268018] [INFO ] [MAIN ] Update Progress: 1877/2369 symbols completed. SBSW took 40.0s. Estimated remaining: 1h 9m 14s. Rate: 7.1 symbols/min [2025-10-16T21:24:13.542964] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-16T21:24:13.669267] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T21:24:13.725418] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T21:24:14.342817] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-16T21:24:15.142812] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-16T21:24:15.303849] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-16T21:24:15.942807] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-16T21:24:15.975340] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T21:24:16.133450] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T21:24:16.742867] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-16T21:24:17.542792] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-16T21:24:17.709379] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T21:24:18.121822] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T21:24:18.342900] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-16T21:24:18.449204] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T21:24:19.142806] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-16T21:24:19.942829] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-16T21:24:20.015883] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T21:24:20.266098] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T21:24:20.742809] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-16T21:24:21.542857] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-16T21:24:21.844735] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-16T21:24:22.342892] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-16T21:24:22.356622] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T21:24:22.360015] [INFO ] [REMOTE ] SCD: Full fetch complete (16952 records). [2025-10-16T21:24:22.360184] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-16T21:24:22.724598] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-16T21:24:22.791566] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-16T21:24:22.791675] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-16T21:24:22.792069] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-16T21:24:22.792111] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-16T21:24:22.792608] [DEBUG] [LOCAL ] SCD: Trimmed 16952 records to 13499 (keeping 200 days of data) [2025-10-16T21:24:22.880114] [DEBUG] [LOCAL ] SCD: Primary data saved (13499 records). [2025-10-16T21:24:22.880253] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-16T21:24:22.880332] [INFO ] [MAIN ] Update Progress: 1878/2369 symbols completed. SCD took 25.9s. Estimated remaining: 1h 9m 6s. Rate: 7.1 symbols/min [2025-10-16T21:24:23.142926] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-16T21:24:24.503182] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-16T21:24:24.514439] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-16T21:24:24.577198] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-16T21:24:24.742812] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-16T21:24:26.361844] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-16T21:24:26.373334] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-16T21:24:26.602512] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-16T21:24:26.609864] [INFO ] [REMOTE ] SCCO: Full fetch complete (71806 records). [2025-10-16T21:24:26.609988] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-16T21:24:26.996785] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-16T21:24:26.996883] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-16T21:24:26.998007] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-16T21:24:26.998070] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-16T21:24:26.999525] [DEBUG] [LOCAL ] SCCO: Trimmed 71806 records to 49968 (keeping 200 days of data) [2025-10-16T21:24:27.306313] [DEBUG] [LOCAL ] SCCO: Primary data saved (49968 records). [2025-10-16T21:24:27.306512] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-16T21:24:27.307128] [INFO ] [MAIN ] Update Progress: 1879/2369 symbols completed. SCCO took 35.6s. Estimated remaining: 1h 8m 57s. Rate: 7.1 symbols/min [2025-10-16T21:24:28.153125] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T21:24:28.163944] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-16T21:24:30.361854] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-16T21:24:30.373465] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-16T21:24:32.426256] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-16T21:24:32.437802] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-16T21:24:34.430618] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-16T21:24:34.442175] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-16T21:24:36.382280] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-16T21:24:36.390059] [INFO ] [REMOTE ] SCHW: Full fetch complete (77865 records). [2025-10-16T21:24:36.390240] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-16T21:24:36.804959] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-16T21:24:36.805048] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-16T21:24:36.806179] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-16T21:24:36.806246] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-16T21:24:36.807763] [DEBUG] [LOCAL ] SCHW: Trimmed 77865 records to 54075 (keeping 200 days of data) [2025-10-16T21:24:37.149220] [DEBUG] [LOCAL ] SCHW: Primary data saved (54075 records). [2025-10-16T21:24:37.149472] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-16T21:24:37.149571] [INFO ] [MAIN ] Update Progress: 1880/2369 symbols completed. SCHW took 27.1s. Estimated remaining: 1h 8m 49s. Rate: 7.1 symbols/min [2025-10-16T21:24:37.794095] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:24:37.841578] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:24:37.865756] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:24:37.868640] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:24:37.889961] [DEBUG] [LOCAL ] SCL: Loaded 14940 existing records from primary storage. [2025-10-16T21:24:37.890362] [INFO ] [MAIN ] SCL: Loaded 14940 existing records. [2025-10-16T21:24:38.024054] [DEBUG] [LOCAL ] SCM: Loaded 20187 existing records from primary storage. [2025-10-16T21:24:38.040110] [INFO ] [MAIN ] SCM: Loaded 20187 existing records. [2025-10-16T21:24:38.220803] [DEBUG] [LOCAL ] SCI: Loaded 46535 existing records from primary storage. [2025-10-16T21:24:38.198218] [DEBUG] [LOCAL ] SCS: Loaded 43524 existing records from primary storage. [2025-10-16T21:24:38.231782] [INFO ] [MAIN ] SCS: Loaded 43524 existing records. [2025-10-16T21:24:38.231930] [INFO ] [MAIN ] SCI: Loaded 46535 existing records. [2025-10-16T21:24:38.225050] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:24:38.291213] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-16T21:24:38.315705] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-16T21:24:38.448750] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-10-16T21:24:38.457672] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-16T21:24:38.649448] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:24:38.705487] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-16T21:24:38.740661] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:24:38.746044] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-16T21:24:38.777845] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-16T21:24:38.767354] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-16T21:24:38.783267] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-16T21:24:38.788530] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-16T21:24:38.938467] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-10-16T21:24:38.962041] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:24:38.998385] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-16T21:24:39.068366] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-16T21:24:39.078079] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-16T21:24:39.180441] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-16T21:24:39.255529] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-16T21:24:39.464279] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:24:39.518455] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-10-16T21:24:40.048503] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:24:40.067947] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-10-16T21:24:40.196409] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:24:40.237882] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:24:40.238342] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-10-16T21:24:40.239566] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-10-16T21:24:40.559573] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T21:24:40.562545] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-16T21:24:41.247178] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T21:24:41.251667] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-16T21:24:41.558586] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T21:24:41.562632] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-16T21:24:41.679990] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T21:24:41.687958] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-16T21:24:41.742228] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T21:24:41.750589] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-16T21:24:42.303538] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T21:24:42.307503] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-16T21:24:42.358533] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T21:24:42.362052] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-16T21:24:42.800305] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T21:24:42.807860] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-16T21:24:43.194980] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T21:24:43.204631] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-16T21:24:43.342271] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T21:24:43.346697] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-16T21:24:43.420519] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-16T21:24:43.424174] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-16T21:24:44.159588] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T21:24:44.167478] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-16T21:24:44.478405] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T21:24:44.483019] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-16T21:24:44.562386] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T21:24:44.567998] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-16T21:24:44.694269] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T21:24:44.704453] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-16T21:24:45.460234] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T21:24:45.464502] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-16T21:24:45.628236] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T21:24:45.637340] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-16T21:24:45.697975] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T21:24:45.968059] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-16T21:24:46.351035] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-16T21:24:46.370377] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T21:24:47.142847] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-16T21:24:47.253575] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T21:24:47.401922] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T21:24:47.942827] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-16T21:24:48.742861] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-16T21:24:49.015098] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-16T21:24:49.026826] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T21:24:49.542833] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-16T21:24:50.261960] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T21:24:50.342784] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-16T21:24:51.143515] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-16T21:24:51.146277] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T21:24:51.925205] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T21:24:51.945214] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-16T21:24:51.947239] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T21:24:52.742864] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-16T21:24:53.540785] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T21:24:53.549422] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-16T21:24:53.748948] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T21:24:54.342829] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-16T21:24:54.673924] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T21:24:55.142832] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-16T21:24:55.942781] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-16T21:24:55.991909] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T21:24:56.178160] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-16T21:24:56.742839] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-16T21:24:56.952944] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T21:24:57.542886] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-16T21:24:58.090632] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T21:24:58.342840] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-16T21:24:58.707431] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T21:24:59.142840] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-16T21:24:59.910142] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T21:24:59.942772] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-16T21:25:00.029162] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T21:25:00.031568] [INFO ] [REMOTE ] SCL: Full fetch complete (21531 records). [2025-10-16T21:25:00.031663] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-16T21:25:00.385031] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-16T21:25:00.385112] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-16T21:25:00.385600] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-16T21:25:00.385659] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-16T21:25:00.386240] [DEBUG] [LOCAL ] SCL: Trimmed 21531 records to 15067 (keeping 200 days of data) [2025-10-16T21:25:00.476362] [DEBUG] [LOCAL ] SCL: Primary data saved (15067 records). [2025-10-16T21:25:00.476495] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-16T21:25:00.476574] [INFO ] [MAIN ] Update Progress: 1881/2369 symbols completed. SCL took 23.3s. Estimated remaining: 1h 8m 44s. Rate: 7.1 symbols/min [2025-10-16T21:25:00.645737] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:25:00.674219] [DEBUG] [LOCAL ] SD: Loaded 28737 existing records from primary storage. [2025-10-16T21:25:00.674483] [INFO ] [MAIN ] SD: Loaded 28737 existing records. [2025-10-16T21:25:00.748769] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-16T21:25:00.857975] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:25:00.858249] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-16T21:25:00.858307] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-16T21:25:00.858499] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-16T21:25:00.858556] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-16T21:25:01.213724] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:25:01.393027] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T21:25:01.400203] [INFO ] [REMOTE ] SCS: Full fetch complete (61136 records). [2025-10-16T21:25:01.400419] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-16T21:25:01.548098] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-10-16T21:25:01.970984] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-16T21:25:01.971106] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-16T21:25:01.973344] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-16T21:25:01.973454] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-16T21:25:01.975330] [DEBUG] [LOCAL ] SCS: Trimmed 61136 records to 43846 (keeping 200 days of data) [2025-10-16T21:25:02.343442] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-16T21:25:02.386141] [DEBUG] [LOCAL ] SCS: Primary data saved (43846 records). [2025-10-16T21:25:02.386936] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-16T21:25:02.387562] [INFO ] [MAIN ] Update Progress: 1882/2369 symbols completed. SCS took 25.2s. Estimated remaining: 1h 8m 34s. Rate: 7.1 symbols/min [2025-10-16T21:25:02.636545] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:25:02.639818] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T21:25:02.660716] [DEBUG] [LOCAL ] SDHC: Loaded 10340 existing records from primary storage. [2025-10-16T21:25:02.660960] [INFO ] [MAIN ] SDHC: Loaded 10340 existing records. [2025-10-16T21:25:02.857572] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:25:02.857768] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-16T21:25:02.857820] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-16T21:25:02.857983] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-16T21:25:02.858040] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-16T21:25:03.147906] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-16T21:25:03.210605] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T21:25:03.259153] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:25:03.325700] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T21:25:03.329526] [INFO ] [REMOTE ] SCM: Full fetch complete (29163 records). [2025-10-16T21:25:03.329608] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-16T21:25:03.687432] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-16T21:25:03.687509] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-16T21:25:03.688122] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-16T21:25:03.688211] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-16T21:25:03.689025] [DEBUG] [LOCAL ] SCM: Trimmed 29163 records to 20377 (keeping 200 days of data) [2025-10-16T21:25:03.815825] [DEBUG] [LOCAL ] SCM: Primary data saved (20377 records). [2025-10-16T21:25:03.815954] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-16T21:25:03.816042] [INFO ] [MAIN ] Update Progress: 1883/2369 symbols completed. SCM took 26.7s. Estimated remaining: 1h 8m 24s. Rate: 7.1 symbols/min [2025-10-16T21:25:03.950689] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-10-16T21:25:03.982153] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:25:03.995034] [DEBUG] [LOCAL ] SDHY: Loaded 11036 existing records from primary storage. [2025-10-16T21:25:03.995255] [INFO ] [MAIN ] SDHY: Loaded 11036 existing records. [2025-10-16T21:25:04.167259] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:25:04.167530] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-16T21:25:04.167584] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-16T21:25:04.167760] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-16T21:25:04.167815] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-16T21:25:04.512692] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:25:04.742824] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-10-16T21:25:04.880309] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T21:25:04.923824] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-16T21:25:05.542862] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-16T21:25:05.745324] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-16T21:25:06.342793] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-16T21:25:06.493182] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T21:25:07.142824] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-16T21:25:07.935433] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T21:25:07.944105] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-16T21:25:07.988060] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-16T21:25:08.742908] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-16T21:25:09.166548] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-16T21:25:09.234779] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-16T21:25:09.542837] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-16T21:25:10.342821] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-16T21:25:10.444950] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-16T21:25:11.142811] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-16T21:25:11.839445] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T21:25:11.845446] [INFO ] [REMOTE ] SCI: Full fetch complete (67689 records). [2025-10-16T21:25:11.845580] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-16T21:25:11.946397] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-16T21:25:12.049819] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T21:25:12.271361] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-16T21:25:12.271441] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-16T21:25:12.272598] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-16T21:25:12.272695] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-16T21:25:12.274002] [DEBUG] [LOCAL ] SCI: Trimmed 67689 records to 46821 (keeping 200 days of data) [2025-10-16T21:25:12.562432] [DEBUG] [LOCAL ] SCI: Primary data saved (46821 records). [2025-10-16T21:25:12.562561] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-16T21:25:12.562639] [INFO ] [MAIN ] Update Progress: 1884/2369 symbols completed. SCI took 35.4s. Estimated remaining: 1h 8m 15s. Rate: 7.1 symbols/min [2025-10-16T21:25:12.737736] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T21:25:12.737424] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:25:12.742768] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-16T21:25:12.779669] [DEBUG] [LOCAL ] SDRL: Loaded 41576 existing records from primary storage. [2025-10-16T21:25:12.779958] [INFO ] [MAIN ] SDRL: Loaded 41576 existing records. [2025-10-16T21:25:12.954300] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:25:12.954537] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-16T21:25:12.954585] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-16T21:25:12.954791] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-16T21:25:12.954847] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-16T21:25:13.301585] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:25:13.542783] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-10-16T21:25:13.858247] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T21:25:14.342818] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-16T21:25:15.148537] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-16T21:25:15.165709] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T21:25:15.169937] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T21:25:15.930057] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-16T21:25:15.942777] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-16T21:25:16.742813] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-16T21:25:16.874974] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-16T21:25:17.542813] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-16T21:25:17.615112] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T21:25:18.342827] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-16T21:25:18.699379] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-16T21:25:19.142900] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-16T21:25:19.165831] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-16T21:25:19.928362] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-16T21:25:19.942774] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-16T21:25:20.713225] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-16T21:25:20.742845] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-16T21:25:21.542785] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-16T21:25:21.546915] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-16T21:25:22.342865] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-16T21:25:22.372487] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-16T21:25:23.142849] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-16T21:25:23.512712] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T21:25:23.580976] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-16T21:25:23.942848] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-16T21:25:24.742815] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-16T21:25:25.242106] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-16T21:25:25.542787] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-16T21:25:25.642149] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T21:25:26.342817] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-16T21:25:26.682022] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T21:25:26.834775] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T21:25:26.836860] [INFO ] [REMOTE ] SDHY: Full fetch complete (15754 records). [2025-10-16T21:25:26.836935] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-16T21:25:27.148891] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-16T21:25:27.191976] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-16T21:25:27.192054] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-16T21:25:27.192396] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-16T21:25:27.192456] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-16T21:25:27.192978] [DEBUG] [LOCAL ] SDHY: Trimmed 15754 records to 11120 (keeping 200 days of data) [2025-10-16T21:25:27.263753] [DEBUG] [LOCAL ] SDHY: Primary data saved (11120 records). [2025-10-16T21:25:27.263892] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-16T21:25:27.264035] [INFO ] [MAIN ] Update Progress: 1885/2369 symbols completed. SDHY took 23.4s. Estimated remaining: 1h 8m 9s. Rate: 7.1 symbols/min [2025-10-16T21:25:27.428258] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:25:27.479324] [DEBUG] [LOCAL ] SE: Loaded 53302 existing records from primary storage. [2025-10-16T21:25:27.479619] [INFO ] [MAIN ] SE: Loaded 53302 existing records. [2025-10-16T21:25:27.650251] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:25:27.650436] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-16T21:25:27.650483] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-16T21:25:27.650698] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-10-16T21:25:27.650764] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-16T21:25:27.943610] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-16T21:25:28.003869] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:25:28.012761] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-16T21:25:28.742868] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-16T21:25:29.025617] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T21:25:29.253567] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-16T21:25:29.255691] [INFO ] [REMOTE ] SDHC: Full fetch complete (16987 records). [2025-10-16T21:25:29.255789] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-16T21:25:29.547974] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-16T21:25:29.625216] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-16T21:25:29.625355] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-16T21:25:29.625799] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-16T21:25:29.625863] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-16T21:25:29.626375] [DEBUG] [LOCAL ] SDHC: Trimmed 16987 records to 10427 (keeping 200 days of data) [2025-10-16T21:25:29.686076] [DEBUG] [LOCAL ] SDHC: Primary data saved (10427 records). [2025-10-16T21:25:29.686196] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-16T21:25:29.686274] [INFO ] [MAIN ] Update Progress: 1886/2369 symbols completed. SDHC took 27.3s. Estimated remaining: 1h 7m 59s. Rate: 7.1 symbols/min [2025-10-16T21:25:29.873056] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:25:29.922104] [DEBUG] [LOCAL ] SEE: Loaded 48189 existing records from primary storage. [2025-10-16T21:25:29.922410] [INFO ] [MAIN ] SEE: Loaded 48189 existing records. [2025-10-16T21:25:30.095514] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:25:30.095720] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-16T21:25:30.095774] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-16T21:25:30.096013] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-10-16T21:25:30.096068] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-16T21:25:30.353012] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-10-16T21:25:30.439453] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:25:31.025733] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T21:25:31.142857] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-16T21:25:31.942835] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-10-16T21:25:32.462294] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-16T21:25:32.742798] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-16T21:25:32.795733] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T21:25:33.542839] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-16T21:25:33.636559] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T21:25:34.342786] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-16T21:25:34.435096] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T21:25:34.475410] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T21:25:35.142821] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-16T21:25:35.919735] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T21:25:35.942773] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-16T21:25:36.746537] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-16T21:25:36.751910] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T21:25:37.524589] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T21:25:37.542770] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-16T21:25:38.130146] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T21:25:38.342875] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-16T21:25:38.857747] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T21:25:39.142833] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-16T21:25:39.453845] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T21:25:39.457805] [INFO ] [REMOTE ] SD: Full fetch complete (40964 records). [2025-10-16T21:25:39.457921] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-16T21:25:39.820098] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-16T21:25:39.820171] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-16T21:25:39.820910] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-16T21:25:39.820973] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-16T21:25:39.821851] [DEBUG] [LOCAL ] SD: Trimmed 40964 records to 28900 (keeping 200 days of data) [2025-10-16T21:25:39.962616] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-16T21:25:39.995038] [DEBUG] [LOCAL ] SD: Primary data saved (28900 records). [2025-10-16T21:25:39.995152] [INFO ] [MAIN ] SD: Full history saved. [2025-10-16T21:25:39.995228] [INFO ] [MAIN ] Update Progress: 1887/2369 symbols completed. SD took 39.5s. Estimated remaining: 1h 7m 51s. Rate: 7.1 symbols/min [2025-10-16T21:25:40.164597] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:25:40.179909] [DEBUG] [LOCAL ] SEG: Loaded 12834 existing records from primary storage. [2025-10-16T21:25:40.180131] [INFO ] [MAIN ] SEG: Loaded 12834 existing records. [2025-10-16T21:25:40.360103] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:25:40.360462] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-16T21:25:40.360522] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-16T21:25:40.361147] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-16T21:25:40.361207] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-16T21:25:40.741830] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:25:40.742769] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-10-16T21:25:40.768858] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T21:25:41.542840] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-16T21:25:41.577990] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T21:25:42.045537] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-16T21:25:42.342825] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-16T21:25:42.655254] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-16T21:25:43.142850] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-16T21:25:43.332409] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T21:25:43.942863] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-16T21:25:44.568579] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T21:25:44.742836] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-16T21:25:44.833345] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T21:25:45.542868] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-16T21:25:46.227450] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T21:25:46.342783] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-16T21:25:46.539171] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-16T21:25:47.142823] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-16T21:25:47.843260] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T21:25:47.942859] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-16T21:25:48.044314] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T21:25:48.742815] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-16T21:25:49.542800] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-16T21:25:49.617522] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T21:25:49.844879] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T21:25:50.342804] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-16T21:25:50.955416] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T21:25:51.142794] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-16T21:25:51.942772] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-16T21:25:52.143527] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T21:25:52.733303] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T21:25:52.742764] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-16T21:25:53.245919] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-16T21:25:53.542791] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-16T21:25:53.599569] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T21:25:54.342849] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-16T21:25:55.142782] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-16T21:25:55.195257] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T21:25:55.229051] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T21:25:55.942879] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-16T21:25:56.742820] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-16T21:25:57.129912] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-16T21:25:57.536019] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T21:25:57.544403] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-16T21:25:57.940326] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-16T21:25:58.021745] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-16T21:25:58.342805] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-16T21:25:59.142879] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-16T21:25:59.942830] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-16T21:26:00.606059] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-16T21:26:00.648233] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T21:26:00.742817] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-16T21:26:01.233911] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-16T21:26:01.239361] [INFO ] [REMOTE ] SDRL: Full fetch complete (61613 records). [2025-10-16T21:26:01.239512] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-16T21:26:01.551382] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-16T21:26:01.652495] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-16T21:26:01.652590] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-16T21:26:01.653586] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-16T21:26:01.653676] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-16T21:26:01.655000] [DEBUG] [LOCAL ] SDRL: Trimmed 61613 records to 41849 (keeping 200 days of data) [2025-10-16T21:26:01.897852] [DEBUG] [LOCAL ] SDRL: Primary data saved (41849 records). [2025-10-16T21:26:01.897977] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-16T21:26:01.898584] [INFO ] [MAIN ] Update Progress: 1888/2369 symbols completed. SDRL took 49.3s. Estimated remaining: 1h 7m 46s. Rate: 7.1 symbols/min [2025-10-16T21:26:02.067953] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:26:02.114685] [DEBUG] [LOCAL ] SEI: Loaded 49935 existing records from primary storage. [2025-10-16T21:26:02.114986] [INFO ] [MAIN ] SEI: Loaded 49935 existing records. [2025-10-16T21:26:02.296582] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:26:02.319300] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-16T21:26:02.319109] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-16T21:26:02.334758] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-16T21:26:02.334889] [INFO ] [REMOTE ] SEG: Full fetch complete (19809 records). [2025-10-16T21:26:02.335255] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-16T21:26:02.337414] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-16T21:26:02.337302] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T21:26:02.348892] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-16T21:26:02.348808] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-16T21:26:03.171059] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-16T21:26:03.176983] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:26:03.186464] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-16T21:26:03.186604] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-16T21:26:03.187573] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-16T21:26:03.187813] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-16T21:26:03.188562] [DEBUG] [LOCAL ] SEG: Trimmed 19809 records to 12910 (keeping 200 days of data) [2025-10-16T21:26:03.269410] [DEBUG] [LOCAL ] SEG: Primary data saved (12910 records). [2025-10-16T21:26:03.269578] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-16T21:26:03.269690] [INFO ] [MAIN ] Update Progress: 1889/2369 symbols completed. SEG took 23.3s. Estimated remaining: 1h 7m 35s. Rate: 7.1 symbols/min [2025-10-16T21:26:03.441848] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:26:03.482629] [DEBUG] [LOCAL ] SEM: Loaded 43203 existing records from primary storage. [2025-10-16T21:26:03.482946] [INFO ] [MAIN ] SEM: Loaded 43203 existing records. [2025-10-16T21:26:03.668756] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:26:03.668961] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-16T21:26:03.669009] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-16T21:26:03.669189] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-10-16T21:26:03.669228] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-16T21:26:03.947954] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-10-16T21:26:04.035793] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:26:04.706264] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-16T21:26:04.749833] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-16T21:26:04.755267] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-16T21:26:05.311578] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T21:26:05.542821] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-10-16T21:26:06.342851] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-16T21:26:06.503922] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T21:26:06.931429] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T21:26:07.142829] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-16T21:26:07.582735] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-16T21:26:07.589267] [INFO ] [REMOTE ] SEE: Full fetch complete (70082 records). [2025-10-16T21:26:07.589413] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-16T21:26:07.951851] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-16T21:26:07.977284] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-16T21:26:07.977352] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-16T21:26:07.978773] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-16T21:26:07.978942] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-16T21:26:07.980368] [DEBUG] [LOCAL ] SEE: Trimmed 70082 records to 48569 (keeping 200 days of data) [2025-10-16T21:26:08.270591] [DEBUG] [LOCAL ] SEE: Primary data saved (48569 records). [2025-10-16T21:26:08.270758] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-16T21:26:08.270844] [INFO ] [MAIN ] Update Progress: 1890/2369 symbols completed. SEE took 38.6s. Estimated remaining: 1h 7m 26s. Rate: 7.1 symbols/min [2025-10-16T21:26:08.439799] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:26:08.462577] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T21:26:08.504374] [DEBUG] [LOCAL ] SEMR: Loaded 42055 existing records from primary storage. [2025-10-16T21:26:08.504684] [INFO ] [MAIN ] SEMR: Loaded 42055 existing records. [2025-10-16T21:26:08.677939] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:26:08.678142] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-16T21:26:08.678250] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-16T21:26:08.678448] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-16T21:26:08.678489] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-16T21:26:08.748054] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-16T21:26:09.030135] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:26:09.542862] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-10-16T21:26:10.021035] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-16T21:26:10.027828] [INFO ] [REMOTE ] SE: Full fetch complete (77238 records). [2025-10-16T21:26:10.027959] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-16T21:26:10.342918] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-16T21:26:10.347393] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T21:26:10.452163] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-10-16T21:26:10.452277] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-10-16T21:26:10.453429] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-10-16T21:26:10.453514] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-10-16T21:26:10.455155] [DEBUG] [LOCAL ] SE: Trimmed 77238 records to 53692 (keeping 200 days of data) [2025-10-16T21:26:10.569535] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T21:26:10.802617] [DEBUG] [LOCAL ] SE: Primary data saved (53692 records). [2025-10-16T21:26:10.802783] [INFO ] [MAIN ] SE: Full history saved. [2025-10-16T21:26:10.803235] [INFO ] [MAIN ] Update Progress: 1891/2369 symbols completed. SE took 43.5s. Estimated remaining: 1h 7m 16s. Rate: 7.1 symbols/min [2025-10-16T21:26:10.967429] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:26:11.017376] [DEBUG] [LOCAL ] SES: Loaded 51578 existing records from primary storage. [2025-10-16T21:26:11.017713] [INFO ] [MAIN ] SES: Loaded 51578 existing records. [2025-10-16T21:26:11.153334] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-16T21:26:11.193585] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:26:11.194304] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-16T21:26:11.194359] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-16T21:26:11.195051] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-16T21:26:11.195108] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-16T21:26:11.545742] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:26:11.745482] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T21:26:11.942865] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-10-16T21:26:12.742829] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-16T21:26:12.776903] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T21:26:13.542868] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-16T21:26:13.954532] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-16T21:26:14.029101] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T21:26:14.342817] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-16T21:26:15.081442] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T21:26:15.142789] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-16T21:26:15.802201] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T21:26:15.942813] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-16T21:26:16.545065] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T21:26:16.742834] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-16T21:26:17.493627] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T21:26:17.542767] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-16T21:26:18.342793] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-16T21:26:18.393903] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T21:26:19.069555] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T21:26:19.142777] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-16T21:26:19.926451] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T21:26:19.942768] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-16T21:26:20.742825] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-16T21:26:21.509951] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T21:26:21.542792] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-16T21:26:21.699146] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-16T21:26:22.134316] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T21:26:22.342805] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-16T21:26:22.760311] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T21:26:23.142818] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-16T21:26:23.783282] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T21:26:23.942845] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-16T21:26:24.742884] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-16T21:26:25.320137] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-16T21:26:25.542857] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-16T21:26:25.709289] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T21:26:26.321113] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T21:26:26.342796] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-16T21:26:27.142829] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-16T21:26:27.884072] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T21:26:27.942811] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-16T21:26:28.015859] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-16T21:26:28.742835] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-16T21:26:28.801058] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-16T21:26:29.318014] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T21:26:29.542860] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-16T21:26:30.342824] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-16T21:26:31.125068] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-16T21:26:31.142774] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-16T21:26:31.171387] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T21:26:31.913399] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T21:26:31.942773] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-16T21:26:32.742856] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-16T21:26:33.542824] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-16T21:26:33.669126] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-16T21:26:33.777253] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T21:26:34.157383] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T21:26:34.163599] [INFO ] [REMOTE ] SEMR: Full fetch complete (60291 records). [2025-10-16T21:26:34.163772] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-16T21:26:34.357207] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-16T21:26:34.580495] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-16T21:26:34.580602] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-16T21:26:34.581832] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-16T21:26:34.581916] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-16T21:26:34.583402] [DEBUG] [LOCAL ] SEMR: Trimmed 60291 records to 42385 (keeping 200 days of data) [2025-10-16T21:26:34.833139] [DEBUG] [LOCAL ] SEMR: Primary data saved (42385 records). [2025-10-16T21:26:34.833265] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-16T21:26:34.833340] [INFO ] [MAIN ] Update Progress: 1892/2369 symbols completed. SEMR took 26.6s. Estimated remaining: 1h 7m 12s. Rate: 7.1 symbols/min [2025-10-16T21:26:35.002270] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:26:35.037418] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T21:26:35.084134] [DEBUG] [LOCAL ] SF: Loaded 41554 existing records from primary storage. [2025-10-16T21:26:35.084417] [INFO ] [MAIN ] SF: Loaded 41554 existing records. [2025-10-16T21:26:35.148056] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-16T21:26:35.262319] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:26:35.262590] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-16T21:26:35.262639] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-16T21:26:35.263186] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-10-16T21:26:35.263246] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-16T21:26:35.612613] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:26:35.942808] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-16T21:26:36.229333] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T21:26:36.742806] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-16T21:26:37.358925] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T21:26:37.364779] [INFO ] [REMOTE ] SEM: Full fetch complete (61637 records). [2025-10-16T21:26:37.364891] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-16T21:26:37.550364] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-10-16T21:26:37.791556] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-16T21:26:37.791741] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-16T21:26:37.792743] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-16T21:26:37.792906] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-16T21:26:37.795273] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-10-16T21:26:37.806192] [DEBUG] [LOCAL ] SEM: Trimmed 61637 records to 43497 (keeping 200 days of data) [2025-10-16T21:26:38.068001] [DEBUG] [LOCAL ] SEM: Primary data saved (43497 records). [2025-10-16T21:26:38.068120] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-16T21:26:38.068848] [INFO ] [MAIN ] Update Progress: 1893/2369 symbols completed. SEM took 34.8s. Estimated remaining: 1h 7m 2s. Rate: 7.1 symbols/min [2025-10-16T21:26:38.248044] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:26:38.257211] [DEBUG] [LOCAL ] SFB: Loaded 3827 existing records from primary storage. [2025-10-16T21:26:38.257609] [INFO ] [MAIN ] SFB: Loaded 3827 existing records. [2025-10-16T21:26:38.347050] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-16T21:26:38.413595] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T21:26:38.514905] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:26:38.515119] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-16T21:26:38.515236] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-16T21:26:38.515396] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-16T21:26:38.515436] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-16T21:26:38.964149] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:26:39.142829] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-10-16T21:26:39.175930] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T21:26:39.732132] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-16T21:26:39.942836] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-16T21:26:40.642758] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-16T21:26:40.742809] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-16T21:26:41.395978] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-16T21:26:41.552341] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-16T21:26:41.554230] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T21:26:42.342810] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-16T21:26:43.142872] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-16T21:26:43.511271] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-16T21:26:43.841159] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T21:26:43.942777] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-16T21:26:44.742795] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-16T21:26:44.979919] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T21:26:44.987183] [INFO ] [REMOTE ] SEI: Full fetch complete (70917 records). [2025-10-16T21:26:44.987313] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-16T21:26:45.398007] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-16T21:26:45.398176] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-16T21:26:45.399499] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-16T21:26:45.399686] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-16T21:26:45.401123] [DEBUG] [LOCAL ] SEI: Trimmed 70917 records to 50322 (keeping 200 days of data) [2025-10-16T21:26:45.580278] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-16T21:26:45.658551] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T21:26:45.749422] [DEBUG] [LOCAL ] SEI: Primary data saved (50322 records). [2025-10-16T21:26:45.749527] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-16T21:26:45.750118] [INFO ] [MAIN ] Update Progress: 1894/2369 symbols completed. SEI took 43.9s. Estimated remaining: 1h 6m 53s. Rate: 7.1 symbols/min [2025-10-16T21:26:45.920739] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:26:45.944997] [DEBUG] [LOCAL ] SFBS: Loaded 21196 existing records from primary storage. [2025-10-16T21:26:45.945238] [INFO ] [MAIN ] SFBS: Loaded 21196 existing records. [2025-10-16T21:26:46.105388] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-16T21:26:46.126710] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:26:46.126873] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-16T21:26:46.126920] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-16T21:26:46.127134] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-10-16T21:26:46.127192] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-16T21:26:46.349826] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-16T21:26:46.504523] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:26:46.957294] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-16T21:26:47.087337] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T21:26:47.142871] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-16T21:26:47.773998] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-16T21:26:47.942820] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-16T21:26:48.534963] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T21:26:48.742781] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-10-16T21:26:49.542802] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-16T21:26:49.889542] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T21:26:50.342824] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-16T21:26:51.142782] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-16T21:26:51.338755] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T21:26:51.699759] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-16T21:26:51.942821] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-16T21:26:52.531602] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-16T21:26:52.742828] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-16T21:26:53.463578] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-16T21:26:53.470620] [INFO ] [REMOTE ] SES: Full fetch complete (75648 records). [2025-10-16T21:26:53.470782] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-16T21:26:53.547907] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-16T21:26:53.865151] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-16T21:26:53.865272] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-16T21:26:53.866455] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-16T21:26:53.866535] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-16T21:26:53.878032] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T21:26:53.882412] [DEBUG] [LOCAL ] SES: Trimmed 75648 records to 51968 (keeping 200 days of data) [2025-10-16T21:26:53.972410] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-16T21:26:54.194248] [DEBUG] [LOCAL ] SES: Primary data saved (51968 records). [2025-10-16T21:26:54.194396] [INFO ] [MAIN ] SES: Full history saved. [2025-10-16T21:26:54.195033] [INFO ] [MAIN ] Update Progress: 1895/2369 symbols completed. SES took 43.4s. Estimated remaining: 1h 6m 45s. Rate: 7.1 symbols/min [2025-10-16T21:26:54.366267] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:26:54.345928] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-16T21:26:54.407841] [DEBUG] [LOCAL ] SFL: Loaded 45346 existing records from primary storage. [2025-10-16T21:26:54.408129] [INFO ] [MAIN ] SFL: Loaded 45346 existing records. [2025-10-16T21:26:54.581034] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:26:54.581195] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-16T21:26:54.581242] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-16T21:26:54.581476] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-16T21:26:54.581533] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-16T21:26:54.877197] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-16T21:26:54.954825] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:26:55.142867] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-16T21:26:55.708153] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T21:26:55.942832] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-10-16T21:26:56.742823] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-16T21:26:57.214179] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-16T21:26:57.215196] [INFO ] [REMOTE ] SFB: Full fetch complete (5799 records). [2025-10-16T21:26:57.215359] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-16T21:26:57.546417] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-16T21:26:57.574694] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-16T21:26:57.574888] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-16T21:26:57.575075] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-16T21:26:57.575314] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-16T21:26:57.598260] [DEBUG] [LOCAL ] SFB: Trimmed 5799 records to 3845 (keeping 200 days of data) [2025-10-16T21:26:57.610021] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T21:26:57.632349] [DEBUG] [LOCAL ] SFB: Primary data saved (3845 records). [2025-10-16T21:26:57.632432] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-16T21:26:57.632499] [INFO ] [MAIN ] Update Progress: 1896/2369 symbols completed. SFB took 19.6s. Estimated remaining: 1h 6m 35s. Rate: 7.1 symbols/min [2025-10-16T21:26:57.797842] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:26:57.855574] [DEBUG] [LOCAL ] SG: Loaded 53494 existing records from primary storage. [2025-10-16T21:26:57.856030] [INFO ] [MAIN ] SG: Loaded 53494 existing records. [2025-10-16T21:26:58.030804] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:26:58.030997] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-16T21:26:58.031042] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-16T21:26:58.031624] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-10-16T21:26:58.031711] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-16T21:26:58.380222] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:26:58.350733] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-16T21:26:58.719135] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T21:26:59.142857] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-10-16T21:26:59.877353] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T21:26:59.942818] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-16T21:27:00.742871] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-16T21:27:01.225395] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T21:27:01.296958] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-16T21:27:01.542887] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-16T21:27:02.342777] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-16T21:27:02.374847] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T21:27:02.558158] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T21:27:03.142844] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-16T21:27:03.942867] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-16T21:27:03.977824] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T21:27:04.537057] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T21:27:04.742831] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-16T21:27:05.542835] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-16T21:27:05.747336] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-16T21:27:05.951557] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T21:27:06.342824] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-16T21:27:06.687846] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T21:27:07.142834] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-16T21:27:07.917532] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T21:27:07.942802] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-16T21:27:08.674567] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T21:27:08.742802] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-16T21:27:09.542788] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-10-16T21:27:09.818717] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-16T21:27:10.344482] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-16T21:27:10.349192] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T21:27:11.112814] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T21:27:11.142769] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-16T21:27:11.435857] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-16T21:27:11.942820] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-10-16T21:27:12.609548] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T21:27:12.742854] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-16T21:27:13.542894] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-16T21:27:13.647119] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T21:27:14.332548] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T21:27:14.342757] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-16T21:27:14.629675] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T21:27:15.142788] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-10-16T21:27:15.481477] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-16T21:27:15.942786] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-16T21:27:16.742777] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-16T21:27:16.778399] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T21:27:16.821283] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T21:27:16.824297] [INFO ] [REMOTE ] SFBS: Full fetch complete (30315 records). [2025-10-16T21:27:16.824401] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-16T21:27:17.186934] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-16T21:27:17.187007] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-16T21:27:17.187636] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-16T21:27:17.187720] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-16T21:27:17.188442] [DEBUG] [LOCAL ] SFBS: Trimmed 30315 records to 21365 (keeping 200 days of data) [2025-10-16T21:27:17.317824] [DEBUG] [LOCAL ] SFBS: Primary data saved (21365 records). [2025-10-16T21:27:17.317949] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-16T21:27:17.318023] [INFO ] [MAIN ] Update Progress: 1897/2369 symbols completed. SFBS took 31.6s. Estimated remaining: 1h 6m 29s. Rate: 7.1 symbols/min [2025-10-16T21:27:17.492600] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:27:17.542983] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-16T21:27:17.543910] [DEBUG] [LOCAL ] SGHC: Loaded 47022 existing records from primary storage. [2025-10-16T21:27:17.544872] [INFO ] [MAIN ] SGHC: Loaded 47022 existing records. [2025-10-16T21:27:17.729630] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:27:17.729972] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-16T21:27:17.730020] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-16T21:27:17.730253] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-16T21:27:17.730322] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-16T21:27:18.072747] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:27:18.342771] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-10-16T21:27:18.603263] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T21:27:19.036278] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T21:27:19.142783] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-16T21:27:19.313978] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-16T21:27:19.942824] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-10-16T21:27:20.565165] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T21:27:20.570698] [INFO ] [REMOTE ] SF: Full fetch complete (60251 records). [2025-10-16T21:27:20.570817] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-16T21:27:20.745934] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-16T21:27:20.964484] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-16T21:27:20.964596] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-16T21:27:20.965598] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-16T21:27:20.965685] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-16T21:27:20.966979] [DEBUG] [LOCAL ] SF: Trimmed 60251 records to 41866 (keeping 200 days of data) [2025-10-16T21:27:21.223761] [DEBUG] [LOCAL ] SF: Primary data saved (41866 records). [2025-10-16T21:27:21.223886] [INFO ] [MAIN ] SF: Full history saved. [2025-10-16T21:27:21.223962] [INFO ] [MAIN ] Update Progress: 1898/2369 symbols completed. SF took 46.4s. Estimated remaining: 1h 6m 20s. Rate: 7.1 symbols/min [2025-10-16T21:27:21.398678] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:27:21.398828] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-16T21:27:21.398866] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-16T21:27:21.398993] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-16T21:27:21.399034] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-16T21:27:21.399095] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-16T21:27:21.399165] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-16T21:27:21.549266] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-16T21:27:21.745093] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-16T21:27:21.812701] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:27:22.270947] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T21:27:22.342766] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-16T21:27:23.142769] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-10-16T21:27:23.267181] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T21:27:23.355552] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:27:23.355899] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-10-16T21:27:23.356006] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:27:23.356056] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-16T21:27:23.356118] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:27:23.356202] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-16T21:27:23.356280] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-16T21:27:23.356340] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-16T21:27:23.356397] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-16T21:27:23.356465] [INFO ] [MAIN ] Update Progress: 1899/2369 symbols completed. SGI took 2.1s. Estimated remaining: 1h 6m 10s. Rate: 7.1 symbols/min [2025-10-16T21:27:23.526920] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:27:23.535668] [DEBUG] [LOCAL ] SGU: Loaded 6594 existing records from primary storage. [2025-10-16T21:27:23.535863] [INFO ] [MAIN ] SGU: Loaded 6594 existing records. [2025-10-16T21:27:23.713513] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:27:23.713918] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-16T21:27:23.713982] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-16T21:27:23.714143] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-16T21:27:23.714198] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-16T21:27:23.948931] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-16T21:27:24.029916] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T21:27:24.115631] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:27:24.742781] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-10. [2025-10-16T21:27:25.542870] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-10-16T21:27:26.268232] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T21:27:26.274483] [INFO ] [REMOTE ] SFL: Full fetch complete (65917 records). [2025-10-16T21:27:26.274606] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-16T21:27:26.347201] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-16T21:27:26.388964] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T21:27:26.605717] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-10-16T21:27:26.732984] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-16T21:27:26.733070] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-16T21:27:26.734164] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-16T21:27:26.734226] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-16T21:27:26.735577] [DEBUG] [LOCAL ] SFL: Trimmed 65917 records to 45689 (keeping 200 days of data) [2025-10-16T21:27:26.997208] [DEBUG] [LOCAL ] SFL: Primary data saved (45689 records). [2025-10-16T21:27:26.997343] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-16T21:27:26.997950] [INFO ] [MAIN ] Update Progress: 1900/2369 symbols completed. SFL took 32.8s. Estimated remaining: 1h 6m 0s. Rate: 7.1 symbols/min [2025-10-16T21:27:27.150314] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-16T21:27:27.171534] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:27:27.226148] [DEBUG] [LOCAL ] SHAK: Loaded 48835 existing records from primary storage. [2025-10-16T21:27:27.226496] [INFO ] [MAIN ] SHAK: Loaded 48835 existing records. [2025-10-16T21:27:27.399136] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:27:27.399367] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-16T21:27:27.399417] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-16T21:27:27.399977] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-10-16T21:27:27.400036] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-16T21:27:27.781385] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:27:27.897698] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T21:27:27.942777] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-16T21:27:28.742840] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-16T21:27:28.843758] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T21:27:29.479967] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T21:27:29.511907] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T21:27:29.542800] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-16T21:27:30.155195] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-16T21:27:30.342887] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-16T21:27:31.089839] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-16T21:27:31.142795] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-16T21:27:31.909726] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T21:27:31.942767] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-16T21:27:32.566392] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T21:27:32.742854] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-16T21:27:33.542810] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-16T21:27:34.228418] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T21:27:34.342792] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-16T21:27:34.713700] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T21:27:35.142860] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-16T21:27:35.907961] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T21:27:35.942769] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-16T21:27:36.742811] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-10-16T21:27:37.135904] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-16T21:27:37.199274] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T21:27:37.542816] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-16T21:27:37.875761] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T21:27:38.342857] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-16T21:27:39.142880] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-16T21:27:39.357297] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T21:27:39.361449] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T21:27:39.942822] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-16T21:27:40.742866] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-16T21:27:40.782600] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T21:27:41.033382] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-16T21:27:41.040476] [INFO ] [REMOTE ] SG: Full fetch complete (77462 records). [2025-10-16T21:27:41.040699] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-16T21:27:41.432459] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-16T21:27:41.432543] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-16T21:27:41.433671] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-16T21:27:41.433735] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-16T21:27:41.435288] [DEBUG] [LOCAL ] SG: Trimmed 77462 records to 53883 (keeping 200 days of data) [2025-10-16T21:27:41.542885] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-16T21:27:41.748878] [DEBUG] [LOCAL ] SG: Primary data saved (53883 records). [2025-10-16T21:27:41.749051] [INFO ] [MAIN ] SG: Full history saved. [2025-10-16T21:27:41.749755] [INFO ] [MAIN ] Update Progress: 1901/2369 symbols completed. SG took 44.1s. Estimated remaining: 1h 5m 53s. Rate: 7.1 symbols/min [2025-10-16T21:27:41.914734] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:27:41.941610] [DEBUG] [LOCAL ] SHCO: Loaded 25461 existing records from primary storage. [2025-10-16T21:27:41.941895] [INFO ] [MAIN ] SHCO: Loaded 25461 existing records. [2025-10-16T21:27:42.119859] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:27:42.120261] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-16T21:27:42.120317] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-16T21:27:42.120846] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-16T21:27:42.120911] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-16T21:27:42.343578] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-16T21:27:42.415771] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T21:27:42.526354] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:27:42.564622] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T21:27:43.142811] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-10-16T21:27:43.942834] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-16T21:27:44.160140] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T21:27:44.275709] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T21:27:44.627730] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T21:27:44.629131] [INFO ] [REMOTE ] SGU: Full fetch complete (9028 records). [2025-10-16T21:27:44.629209] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-16T21:27:44.747956] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-16T21:27:45.002269] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-16T21:27:45.002373] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-16T21:27:45.002833] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-16T21:27:45.002899] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-16T21:27:45.003465] [DEBUG] [LOCAL ] SGU: Trimmed 9028 records to 6613 (keeping 200 days of data) [2025-10-16T21:27:45.045328] [DEBUG] [LOCAL ] SGU: Primary data saved (6613 records). [2025-10-16T21:27:45.045496] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-16T21:27:45.045597] [INFO ] [MAIN ] Update Progress: 1902/2369 symbols completed. SGU took 21.7s. Estimated remaining: 1h 5m 44s. Rate: 7.1 symbols/min [2025-10-16T21:27:45.226282] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:27:45.286464] [DEBUG] [LOCAL ] SHEL: Loaded 53673 existing records from primary storage. [2025-10-16T21:27:45.286949] [INFO ] [MAIN ] SHEL: Loaded 53673 existing records. [2025-10-16T21:27:45.480023] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:27:45.480295] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-16T21:27:45.480346] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-16T21:27:45.481036] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-16T21:27:45.481096] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-16T21:27:45.551778] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-16T21:27:45.864037] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:27:46.342827] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-10-16T21:27:46.556691] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T21:27:46.602464] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T21:27:47.142842] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-16T21:27:47.942782] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-16T21:27:47.968371] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T21:27:48.147194] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-16T21:27:48.742800] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-16T21:27:49.482900] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T21:27:49.542803] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-16T21:27:50.342825] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-16T21:27:50.842250] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-16T21:27:50.899350] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T21:27:50.906283] [INFO ] [REMOTE ] SGHC: Full fetch complete (65141 records). [2025-10-16T21:27:50.906451] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-16T21:27:51.150254] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-16T21:27:51.292552] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-16T21:27:51.292629] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-16T21:27:51.293686] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-16T21:27:51.293749] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-16T21:27:51.295025] [DEBUG] [LOCAL ] SGHC: Trimmed 65141 records to 47394 (keeping 200 days of data) [2025-10-16T21:27:51.602100] [DEBUG] [LOCAL ] SGHC: Primary data saved (47394 records). [2025-10-16T21:27:51.602268] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-16T21:27:51.602990] [INFO ] [MAIN ] Update Progress: 1903/2369 symbols completed. SGHC took 34.3s. Estimated remaining: 1h 5m 35s. Rate: 7.1 symbols/min [2025-10-16T21:27:51.779818] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:27:51.808851] [DEBUG] [LOCAL ] SHG: Loaded 26500 existing records from primary storage. [2025-10-16T21:27:51.809120] [INFO ] [MAIN ] SHG: Loaded 26500 existing records. [2025-10-16T21:27:51.954272] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-16T21:27:51.969516] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T21:27:52.053324] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:27:52.054471] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-16T21:27:52.054562] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-16T21:27:52.054973] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-16T21:27:52.055036] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-16T21:27:52.432482] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:27:52.742821] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-16T21:27:52.807917] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T21:27:53.542788] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-16T21:27:53.818718] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-16T21:27:54.128686] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T21:27:54.342824] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-16T21:27:55.142809] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-16T21:27:55.765626] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-16T21:27:55.788404] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-16T21:27:55.942829] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-16T21:27:56.174541] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T21:27:56.742895] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-16T21:27:57.542816] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-10-16T21:27:58.083999] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-16T21:27:58.342809] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-16T21:27:58.709626] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T21:27:58.773334] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T21:27:58.949482] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T21:27:59.142827] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-16T21:27:59.942834] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-16T21:28:00.347969] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-16T21:28:00.742843] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-16T21:28:01.542815] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-16T21:28:01.864189] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T21:28:02.096765] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T21:28:02.342873] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-16T21:28:02.492335] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T21:28:03.142861] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-16T21:28:03.942782] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-16T21:28:04.408687] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-16T21:28:04.424160] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T21:28:04.742841] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-16T21:28:05.318269] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T21:28:05.542773] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-16T21:28:05.906244] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-16T21:28:05.910083] [INFO ] [REMOTE ] SHCO: Full fetch complete (37506 records). [2025-10-16T21:28:05.910163] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-16T21:28:06.289180] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-16T21:28:06.289264] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-16T21:28:06.290042] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-16T21:28:06.290102] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-16T21:28:06.290958] [DEBUG] [LOCAL ] SHCO: Trimmed 37506 records to 25733 (keeping 200 days of data) [2025-10-16T21:28:06.343329] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-16T21:28:06.436022] [DEBUG] [LOCAL ] SHCO: Primary data saved (25733 records). [2025-10-16T21:28:06.436150] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-16T21:28:06.436226] [INFO ] [MAIN ] Update Progress: 1904/2369 symbols completed. SHCO took 24.7s. Estimated remaining: 1h 5m 28s. Rate: 7.1 symbols/min [2025-10-16T21:28:06.602574] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:28:06.644250] [DEBUG] [LOCAL ] SHO: Loaded 49400 existing records from primary storage. [2025-10-16T21:28:06.644579] [INFO ] [MAIN ] SHO: Loaded 49400 existing records. [2025-10-16T21:28:06.822047] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:28:06.822235] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-16T21:28:06.822281] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-16T21:28:06.822471] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-10-16T21:28:06.822526] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-16T21:28:07.164769] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-16T21:28:07.207141] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:28:07.209840] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T21:28:07.942794] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-16T21:28:08.160154] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T21:28:08.742780] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-16T21:28:08.986695] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T21:28:09.217343] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T21:28:09.542867] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-16T21:28:10.342773] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-16T21:28:10.450984] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T21:28:10.745192] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-16T21:28:11.142811] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-16T21:28:11.942899] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-10-16T21:28:12.321423] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T21:28:12.557568] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-16T21:28:12.742825] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-16T21:28:13.349935] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T21:28:13.542846] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-16T21:28:14.065885] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T21:28:14.342839] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-16T21:28:15.142794] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-16T21:28:15.633373] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-16T21:28:15.947897] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-16T21:28:15.963701] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T21:28:16.750152] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-16T21:28:16.754434] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T21:28:17.542784] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-16T21:28:17.834146] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-16T21:28:17.917443] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T21:28:18.342869] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-16T21:28:18.757926] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T21:28:19.142796] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-16T21:28:19.942788] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-16T21:28:20.365424] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-16T21:28:20.387130] [INFO ] [REMOTE ] SHEL: Full fetch complete (77835 records). [2025-10-16T21:28:20.388556] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T21:28:20.387875] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-16T21:28:20.744101] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-16T21:28:20.789785] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-16T21:28:20.789861] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-16T21:28:20.791067] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-16T21:28:20.791133] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-16T21:28:20.792710] [DEBUG] [LOCAL ] SHEL: Trimmed 77835 records to 54063 (keeping 200 days of data) [2025-10-16T21:28:21.118411] [DEBUG] [LOCAL ] SHEL: Primary data saved (54063 records). [2025-10-16T21:28:21.118545] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-16T21:28:21.118623] [INFO ] [MAIN ] Update Progress: 1905/2369 symbols completed. SHEL took 36.1s. Estimated remaining: 1h 5m 21s. Rate: 7.1 symbols/min [2025-10-16T21:28:21.292057] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:28:21.297439] [DEBUG] [LOCAL ] SHOC: Loaded 3243 existing records from primary storage. [2025-10-16T21:28:21.297596] [INFO ] [MAIN ] SHOC: Loaded 3243 existing records. [2025-10-16T21:28:21.413857] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T21:28:21.438806] [INFO ] [REMOTE ] SHAK: Full fetch complete (71159 records). [2025-10-16T21:28:21.458834] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-16T21:28:21.548053] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-16T21:28:21.583921] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:28:21.607871] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-16T21:28:21.608237] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-16T21:28:21.613606] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-16T21:28:21.624589] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-16T21:28:22.230203] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T21:28:22.230502] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-16T21:28:22.235741] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-16T21:28:22.246325] [INFO ] [REMOTE ] SHG: Full fetch complete (41191 records). [2025-10-16T21:28:22.247483] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-16T21:28:22.247597] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-16T21:28:22.247687] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-16T21:28:22.327964] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:28:22.355968] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-10-16T21:28:22.407215] [DEBUG] [LOCAL ] SHAK: Trimmed 71159 records to 49173 (keeping 200 days of data) [2025-10-16T21:28:22.925077] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-16T21:28:22.928448] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-16T21:28:22.930122] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-16T21:28:22.930205] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-16T21:28:22.945735] [DEBUG] [LOCAL ] SHG: Trimmed 41191 records to 26746 (keeping 200 days of data) [2025-10-16T21:28:23.136149] [DEBUG] [LOCAL ] SHAK: Primary data saved (49173 records). [2025-10-16T21:28:23.141196] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-16T21:28:23.141875] [INFO ] [MAIN ] Update Progress: 1906/2369 symbols completed. SHAK took 56.1s. Estimated remaining: 1h 5m 11s. Rate: 7.1 symbols/min [2025-10-16T21:28:23.255666] [DEBUG] [LOCAL ] SHG: Primary data saved (26746 records). [2025-10-16T21:28:23.274621] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-16T21:28:23.263578] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-16T21:28:23.298033] [INFO ] [MAIN ] Update Progress: 1907/2369 symbols completed. SHG took 31.7s. Estimated remaining: 1h 5m 0s. Rate: 7.1 symbols/min [2025-10-16T21:28:23.312534] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-16T21:28:23.485021] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:28:23.544910] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:28:23.545132] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-16T21:28:23.545202] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-16T21:28:23.556297] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-16T21:28:23.556520] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-16T21:28:23.569788] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-16T21:28:23.569861] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-16T21:28:23.640682] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-16T21:28:23.898704] [DEBUG] [LOCAL ] SHW: Loaded 50362 existing records from primary storage. [2025-10-16T21:28:23.909717] [INFO ] [MAIN ] SHW: Loaded 50362 existing records. [2025-10-16T21:28:23.950281] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-16T21:28:24.086065] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:28:24.181034] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:28:24.181289] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-16T21:28:24.181337] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-16T21:28:24.181535] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-10-16T21:28:24.181593] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-16T21:28:24.307133] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T21:28:24.561763] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:28:24.742817] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-10-16T21:28:25.542787] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-16T21:28:25.806618] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T21:28:26.145030] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T21:28:26.342801] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-16T21:28:26.707253] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-16T21:28:27.142812] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-16T21:28:27.187697] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T21:28:27.942837] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-10-16T21:28:28.144213] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:28:28.144543] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-10-16T21:28:28.144672] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:28:28.144731] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-16T21:28:28.144792] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:28:28.144864] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-16T21:28:28.144932] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-16T21:28:28.144968] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-16T21:28:28.145006] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-16T21:28:28.145052] [INFO ] [MAIN ] Update Progress: 1908/2369 symbols completed. SI took 4.8s. Estimated remaining: 1h 4m 51s. Rate: 7.1 symbols/min [2025-10-16T21:28:28.312752] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:28:28.352245] [DEBUG] [LOCAL ] SID: Loaded 42687 existing records from primary storage. [2025-10-16T21:28:28.352534] [INFO ] [MAIN ] SID: Loaded 42687 existing records. [2025-10-16T21:28:28.530995] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:28:28.531213] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-16T21:28:28.531270] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-16T21:28:28.531449] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-16T21:28:28.531486] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-16T21:28:28.748022] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-16T21:28:28.891246] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:28:29.007796] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T21:28:29.422752] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-16T21:28:29.542863] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-16T21:28:30.342839] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-16T21:28:30.902118] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-16T21:28:31.142823] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-16T21:28:31.274993] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T21:28:31.656675] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-16T21:28:31.942821] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-10-16T21:28:32.742825] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-16T21:28:33.543707] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-16T21:28:33.546669] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T21:28:34.112231] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T21:28:34.342802] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-16T21:28:35.142833] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-16T21:28:35.283236] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T21:28:35.650433] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-16T21:28:35.942794] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-16T21:28:35.993604] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T21:28:36.742862] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-16T21:28:37.542793] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-16T21:28:37.600532] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T21:28:38.342857] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-16T21:28:38.732332] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T21:28:38.753495] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-16T21:28:39.142814] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-16T21:28:39.252344] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T21:28:39.942815] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-16T21:28:40.742805] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-16T21:28:40.925450] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T21:28:41.224849] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T21:28:41.242082] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-16T21:28:41.542811] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-16T21:28:42.023790] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-16T21:28:42.024841] [INFO ] [REMOTE ] SHOC: Full fetch complete (6969 records). [2025-10-16T21:28:42.024909] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-16T21:28:42.352934] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-16T21:28:42.395601] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-16T21:28:42.395721] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-16T21:28:42.395923] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-16T21:28:42.395963] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-16T21:28:42.396333] [DEBUG] [LOCAL ] SHOC: Trimmed 6969 records to 3264 (keeping 200 days of data) [2025-10-16T21:28:42.416143] [DEBUG] [LOCAL ] SHOC: Primary data saved (3264 records). [2025-10-16T21:28:42.416212] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-16T21:28:42.416282] [INFO ] [MAIN ] Update Progress: 1909/2369 symbols completed. SHOC took 21.3s. Estimated remaining: 1h 4m 44s. Rate: 7.1 symbols/min [2025-10-16T21:28:42.581873] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:28:42.622433] [DEBUG] [LOCAL ] SIG: Loaded 45678 existing records from primary storage. [2025-10-16T21:28:42.622806] [INFO ] [MAIN ] SIG: Loaded 45678 existing records. [2025-10-16T21:28:42.795972] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:28:42.796160] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-16T21:28:42.796206] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-16T21:28:42.796385] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-10-16T21:28:42.796423] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-16T21:28:43.139279] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:28:43.142765] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-10-16T21:28:43.942846] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-16T21:28:44.080003] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T21:28:44.742793] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-16T21:28:44.851589] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T21:28:45.542838] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-16T21:28:45.703034] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T21:28:46.302475] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T21:28:46.342786] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-16T21:28:47.077283] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T21:28:47.142896] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-16T21:28:47.946581] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-16T21:28:47.962736] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T21:28:48.624903] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T21:28:48.742812] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-16T21:28:49.391425] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T21:28:49.542845] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-16T21:28:50.189031] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T21:28:50.342802] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-16T21:28:51.027000] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T21:28:51.142777] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-16T21:28:51.737311] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T21:28:51.942845] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-16T21:28:52.742827] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-16T21:28:52.841154] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T21:28:53.376773] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T21:28:53.386782] [INFO ] [REMOTE ] SHO: Full fetch complete (71004 records). [2025-10-16T21:28:53.386967] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-16T21:28:53.548576] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-16T21:28:53.819444] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-16T21:28:53.819566] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-16T21:28:53.821699] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-16T21:28:53.821786] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-16T21:28:53.824155] [DEBUG] [LOCAL ] SHO: Trimmed 71004 records to 49749 (keeping 200 days of data) [2025-10-16T21:28:54.163812] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T21:28:54.207137] [DEBUG] [LOCAL ] SHO: Primary data saved (49749 records). [2025-10-16T21:28:54.207375] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-16T21:28:54.208389] [INFO ] [MAIN ] Update Progress: 1910/2369 symbols completed. SHO took 47.8s. Estimated remaining: 1h 4m 36s. Rate: 7.1 symbols/min [2025-10-16T21:28:54.347963] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-16T21:28:54.417619] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:28:54.451508] [DEBUG] [LOCAL ] SII: Loaded 23989 existing records from primary storage. [2025-10-16T21:28:54.451910] [INFO ] [MAIN ] SII: Loaded 23989 existing records. [2025-10-16T21:28:54.648088] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:28:54.648455] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-16T21:28:54.648531] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-16T21:28:54.648790] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-16T21:28:54.648845] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-16T21:28:55.007039] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:28:55.142832] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-16T21:28:55.280727] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T21:28:55.942857] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-10-16T21:28:56.143233] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T21:28:56.149820] [INFO ] [REMOTE ] SHW: Full fetch complete (73259 records). [2025-10-16T21:28:56.149932] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-16T21:28:56.550311] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-16T21:28:56.550395] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-16T21:28:56.551660] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-16T21:28:56.551728] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-16T21:28:56.553116] [DEBUG] [LOCAL ] SHW: Trimmed 73259 records to 50744 (keeping 200 days of data) [2025-10-16T21:28:56.696762] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T21:28:56.772092] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-16T21:28:56.835227] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-16T21:28:56.941725] [DEBUG] [LOCAL ] SHW: Primary data saved (50744 records). [2025-10-16T21:28:56.941863] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-16T21:28:56.941943] [INFO ] [MAIN ] Update Progress: 1911/2369 symbols completed. SHW took 33.8s. Estimated remaining: 1h 4m 27s. Rate: 7.1 symbols/min [2025-10-16T21:28:57.114280] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:28:57.144428] [DEBUG] [LOCAL ] SILA: Loaded 30516 existing records from primary storage. [2025-10-16T21:28:57.144722] [INFO ] [MAIN ] SILA: Loaded 30516 existing records. [2025-10-16T21:28:57.332957] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:28:57.333220] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-16T21:28:57.333874] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-16T21:28:57.334282] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-16T21:28:57.334351] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-16T21:28:57.549546] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-16T21:28:57.685551] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:28:58.273191] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T21:28:58.279485] [INFO ] [REMOTE ] SID: Full fetch complete (60918 records). [2025-10-16T21:28:58.279602] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-16T21:28:58.348053] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-10-16T21:28:58.672558] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-16T21:28:58.672672] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-16T21:28:58.673806] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-16T21:28:58.673874] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-16T21:28:58.675321] [DEBUG] [LOCAL ] SID: Trimmed 60918 records to 43016 (keeping 200 days of data) [2025-10-16T21:28:58.913454] [DEBUG] [LOCAL ] SID: Primary data saved (43016 records). [2025-10-16T21:28:58.913586] [INFO ] [MAIN ] SID: Full history saved. [2025-10-16T21:28:58.914169] [INFO ] [MAIN ] Update Progress: 1912/2369 symbols completed. SID took 30.8s. Estimated remaining: 1h 4m 17s. Rate: 7.1 symbols/min [2025-10-16T21:28:59.087170] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:28:59.114158] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T21:28:59.142779] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-16T21:28:59.158012] [DEBUG] [LOCAL ] SITC: Loaded 41805 existing records from primary storage. [2025-10-16T21:28:59.158312] [INFO ] [MAIN ] SITC: Loaded 41805 existing records. [2025-10-16T21:28:59.338262] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:28:59.338502] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-16T21:28:59.338558] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-16T21:28:59.339105] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-10-16T21:28:59.339165] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-16T21:28:59.695395] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:28:59.724729] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T21:28:59.942805] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-10-16T21:29:00.742792] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-16T21:29:00.991902] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T21:29:01.546426] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-16T21:29:01.547994] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-16T21:29:01.683250] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T21:29:02.342863] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-16T21:29:03.142811] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-16T21:29:03.321576] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T21:29:03.365873] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T21:29:03.942840] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-16T21:29:04.399465] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T21:29:04.742800] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-16T21:29:05.215711] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T21:29:05.542789] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-16T21:29:05.846441] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T21:29:06.342868] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-16T21:29:07.142867] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-16T21:29:07.274536] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T21:29:07.696041] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T21:29:07.942830] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-16T21:29:08.105569] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-16T21:29:08.742838] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-16T21:29:09.542821] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-16T21:29:09.685370] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T21:29:09.830566] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T21:29:10.342830] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-16T21:29:10.762485] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T21:29:11.142799] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-16T21:29:11.942794] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-16T21:29:12.034925] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T21:29:12.283049] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T21:29:12.742810] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-16T21:29:12.919327] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T21:29:13.542812] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-16T21:29:14.342831] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-16T21:29:14.376479] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T21:29:14.829622] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T21:29:15.142830] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-16T21:29:15.682385] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T21:29:15.942810] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-16T21:29:16.742792] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-16T21:29:16.821410] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T21:29:17.439333] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T21:29:17.542814] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-16T21:29:17.739989] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T21:29:18.342809] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-16T21:29:18.676299] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T21:29:19.142863] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-16T21:29:19.767972] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T21:29:19.942811] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-16T21:29:20.662353] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T21:29:20.668768] [INFO ] [REMOTE ] SIG: Full fetch complete (67981 records). [2025-10-16T21:29:20.668934] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-16T21:29:20.747930] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-16T21:29:21.069128] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-16T21:29:21.069205] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-16T21:29:21.070389] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-16T21:29:21.070454] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-16T21:29:21.071898] [DEBUG] [LOCAL ] SIG: Trimmed 67981 records to 45983 (keeping 200 days of data) [2025-10-16T21:29:21.288286] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T21:29:21.396357] [DEBUG] [LOCAL ] SIG: Primary data saved (45983 records). [2025-10-16T21:29:21.396534] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-16T21:29:21.396674] [INFO ] [MAIN ] Update Progress: 1913/2369 symbols completed. SIG took 39.0s. Estimated remaining: 1h 4m 11s. Rate: 7.1 symbols/min [2025-10-16T21:29:21.552716] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-16T21:29:21.578101] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:29:21.612529] [DEBUG] [LOCAL ] SITE: Loaded 35608 existing records from primary storage. [2025-10-16T21:29:21.612841] [INFO ] [MAIN ] SITE: Loaded 35608 existing records. [2025-10-16T21:29:21.788659] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:29:21.788889] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-16T21:29:21.788944] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-16T21:29:21.789189] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-16T21:29:21.789246] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-16T21:29:22.148109] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:29:22.173033] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T21:29:22.342920] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-10-16T21:29:22.585267] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T21:29:23.142838] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-16T21:29:23.642024] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T21:29:23.942864] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-16T21:29:24.527818] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T21:29:24.742785] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-16T21:29:25.128166] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-16T21:29:25.542805] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-16T21:29:26.340636] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T21:29:26.349241] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-16T21:29:26.446812] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T21:29:27.142803] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-16T21:29:27.541491] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T21:29:27.545163] [INFO ] [REMOTE ] SII: Full fetch complete (31193 records). [2025-10-16T21:29:27.545276] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-16T21:29:27.923129] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-16T21:29:27.923219] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-16T21:29:27.923970] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-16T21:29:27.924031] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-16T21:29:27.924853] [DEBUG] [LOCAL ] SII: Trimmed 31193 records to 24193 (keeping 200 days of data) [2025-10-16T21:29:27.981629] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-16T21:29:28.077609] [DEBUG] [LOCAL ] SII: Primary data saved (24193 records). [2025-10-16T21:29:28.077754] [INFO ] [MAIN ] SII: Full history saved. [2025-10-16T21:29:28.077837] [INFO ] [MAIN ] Update Progress: 1914/2369 symbols completed. SII took 33.9s. Estimated remaining: 1h 4m 3s. Rate: 7.1 symbols/min [2025-10-16T21:29:28.248420] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:29:28.294617] [DEBUG] [LOCAL ] SJM: Loaded 50137 existing records from primary storage. [2025-10-16T21:29:28.294984] [INFO ] [MAIN ] SJM: Loaded 50137 existing records. [2025-10-16T21:29:28.494149] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:29:28.496360] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-16T21:29:28.497410] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T21:29:28.496789] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-16T21:29:28.503491] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-10-16T21:29:28.503560] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-16T21:29:28.752140] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-16T21:29:28.870032] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:29:29.532741] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T21:29:29.542758] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-16T21:29:29.979880] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T21:29:30.342850] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-10-16T21:29:31.098409] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T21:29:31.142785] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-16T21:29:31.942825] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-16T21:29:31.993906] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T21:29:32.588045] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T21:29:32.593718] [INFO ] [REMOTE ] SITC: Full fetch complete (60738 records). [2025-10-16T21:29:32.593820] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-16T21:29:32.744628] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-16T21:29:32.989497] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-16T21:29:32.989595] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-16T21:29:32.990556] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-16T21:29:32.990625] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-16T21:29:32.991892] [DEBUG] [LOCAL ] SITC: Trimmed 60738 records to 42145 (keeping 200 days of data) [2025-10-16T21:29:33.235776] [DEBUG] [LOCAL ] SITC: Primary data saved (42145 records). [2025-10-16T21:29:33.235944] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-16T21:29:33.236524] [INFO ] [MAIN ] Update Progress: 1915/2369 symbols completed. SITC took 34.3s. Estimated remaining: 1h 3m 53s. Rate: 7.1 symbols/min [2025-10-16T21:29:33.413153] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:29:33.433448] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T21:29:33.456029] [DEBUG] [LOCAL ] SJT: Loaded 22559 existing records from primary storage. [2025-10-16T21:29:33.456270] [INFO ] [MAIN ] SJT: Loaded 22559 existing records. [2025-10-16T21:29:33.548073] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-16T21:29:33.646505] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:29:33.646712] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-16T21:29:33.646805] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-16T21:29:33.647000] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-16T21:29:33.647048] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-16T21:29:34.022269] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:29:34.023422] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T21:29:34.027578] [INFO ] [REMOTE ] SILA: Full fetch complete (44545 records). [2025-10-16T21:29:34.027673] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-16T21:29:34.351263] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-16T21:29:34.401270] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-16T21:29:34.401391] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-16T21:29:34.402254] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-16T21:29:34.402317] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-16T21:29:34.403271] [DEBUG] [LOCAL ] SILA: Trimmed 44545 records to 30693 (keeping 200 days of data) [2025-10-16T21:29:34.586068] [DEBUG] [LOCAL ] SILA: Primary data saved (30693 records). [2025-10-16T21:29:34.586198] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-16T21:29:34.586274] [INFO ] [MAIN ] Update Progress: 1916/2369 symbols completed. SILA took 37.6s. Estimated remaining: 1h 3m 43s. Rate: 7.1 symbols/min [2025-10-16T21:29:34.753998] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:29:34.792135] [DEBUG] [LOCAL ] SKE: Loaded 36903 existing records from primary storage. [2025-10-16T21:29:34.792445] [INFO ] [MAIN ] SKE: Loaded 36903 existing records. [2025-10-16T21:29:34.970368] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:29:34.970673] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-16T21:29:34.970820] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-16T21:29:34.971028] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-16T21:29:34.971082] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-16T21:29:35.143500] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-10-16T21:29:35.258356] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T21:29:35.367327] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:29:35.942862] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-16T21:29:35.980952] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T21:29:36.494171] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T21:29:36.742860] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-10-16T21:29:37.542923] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-16T21:29:37.623510] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T21:29:38.095574] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T21:29:38.342804] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-16T21:29:39.105217] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T21:29:39.142804] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-16T21:29:39.648976] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T21:29:39.942840] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-16T21:29:40.215616] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T21:29:40.742896] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-16T21:29:41.540079] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T21:29:41.549944] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-16T21:29:41.742674] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T21:29:42.242286] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-16T21:29:42.342809] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-16T21:29:43.142789] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-16T21:29:43.382478] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T21:29:43.942817] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-16T21:29:44.458880] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T21:29:44.742824] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-16T21:29:45.244792] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T21:29:45.542811] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-16T21:29:45.793452] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T21:29:46.342823] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-16T21:29:47.036777] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-16T21:29:47.142826] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-16T21:29:47.942821] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-16T21:29:47.990231] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T21:29:48.610841] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T21:29:48.742859] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-16T21:29:49.114126] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T21:29:49.542837] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-16T21:29:50.154343] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T21:29:50.342802] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-16T21:29:50.760388] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T21:29:51.142802] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-16T21:29:51.797963] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T21:29:51.942812] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-16T21:29:52.742782] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-16T21:29:52.826025] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T21:29:52.960778] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T21:29:53.542816] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-16T21:29:53.840899] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T21:29:54.342872] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-16T21:29:54.906880] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T21:29:55.142793] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-16T21:29:55.397282] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-16T21:29:55.942835] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-16T21:29:56.742869] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-16T21:29:56.941263] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-16T21:29:57.326709] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T21:29:57.332024] [INFO ] [REMOTE ] SITE: Full fetch complete (50578 records). [2025-10-16T21:29:57.332129] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-16T21:29:57.547958] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-16T21:29:57.709966] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-16T21:29:57.710070] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-16T21:29:57.710982] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-16T21:29:57.711045] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-16T21:29:57.712252] [DEBUG] [LOCAL ] SITE: Trimmed 50578 records to 35881 (keeping 200 days of data) [2025-10-16T21:29:57.926449] [DEBUG] [LOCAL ] SITE: Primary data saved (35881 records). [2025-10-16T21:29:57.926589] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-16T21:29:57.926693] [INFO ] [MAIN ] Update Progress: 1917/2369 symbols completed. SITE took 36.5s. Estimated remaining: 1h 3m 38s. Rate: 7.1 symbols/min [2025-10-16T21:29:58.199105] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T21:29:58.342830] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-16T21:29:58.754131] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-16T21:29:59.142829] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-16T21:29:59.307960] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T21:29:59.942824] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-16T21:30:00.217212] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T21:30:00.742847] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-16T21:30:01.542803] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-16T21:30:01.748472] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T21:30:01.799475] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T21:30:01.803449] [INFO ] [REMOTE ] SJT: Full fetch complete (31888 records). [2025-10-16T21:30:01.804348] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-16T21:30:02.185590] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-16T21:30:02.185707] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-16T21:30:02.186414] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-16T21:30:02.186476] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-16T21:30:02.187280] [DEBUG] [LOCAL ] SJT: Trimmed 31888 records to 22722 (keeping 200 days of data) [2025-10-16T21:30:02.312005] [DEBUG] [LOCAL ] SJT: Primary data saved (22722 records). [2025-10-16T21:30:02.312137] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-16T21:30:02.312212] [INFO ] [MAIN ] Update Progress: 1918/2369 symbols completed. SJT took 29.1s. Estimated remaining: 1h 3m 29s. Rate: 7.1 symbols/min [2025-10-16T21:30:02.342832] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-16T21:30:03.391995] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T21:30:03.406895] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-16T21:30:03.998840] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T21:30:04.005235] [INFO ] [REMOTE ] SKE: Full fetch complete (52013 records). [2025-10-16T21:30:04.005373] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-16T21:30:04.393822] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-16T21:30:04.393927] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-16T21:30:04.394841] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-16T21:30:04.394906] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-16T21:30:04.396104] [DEBUG] [LOCAL ] SKE: Trimmed 52013 records to 37259 (keeping 200 days of data) [2025-10-16T21:30:04.607210] [DEBUG] [LOCAL ] SKE: Primary data saved (37259 records). [2025-10-16T21:30:04.607335] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-16T21:30:04.607823] [INFO ] [MAIN ] Update Progress: 1919/2369 symbols completed. SKE took 30.0s. Estimated remaining: 1h 3m 19s. Rate: 7.1 symbols/min [2025-10-16T21:30:05.209559] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T21:30:05.220753] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-16T21:30:05.983635] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T21:30:05.994853] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-16T21:30:07.518492] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T21:30:07.524823] [INFO ] [REMOTE ] SJM: Full fetch complete (72338 records). [2025-10-16T21:30:07.524939] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-16T21:30:07.913735] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-16T21:30:07.913818] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-16T21:30:07.914860] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-16T21:30:07.914920] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-16T21:30:07.916213] [DEBUG] [LOCAL ] SJM: Trimmed 72338 records to 50509 (keeping 200 days of data) [2025-10-16T21:30:08.235455] [DEBUG] [LOCAL ] SJM: Primary data saved (50509 records). [2025-10-16T21:30:08.235608] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-16T21:30:08.236168] [INFO ] [MAIN ] Update Progress: 1920/2369 symbols completed. SJM took 40.2s. Estimated remaining: 1h 3m 10s. Rate: 7.1 symbols/min [2025-10-16T21:30:08.960615] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:30:09.010163] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:30:09.012087] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:30:09.038898] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:30:09.050596] [DEBUG] [LOCAL ] SKIL: Loaded 6591 existing records from primary storage. [2025-10-16T21:30:09.051107] [INFO ] [MAIN ] SKIL: Loaded 6591 existing records. [2025-10-16T21:30:09.169544] [DEBUG] [LOCAL ] SKLZ: Loaded 11597 existing records from primary storage. [2025-10-16T21:30:09.179340] [INFO ] [MAIN ] SKLZ: Loaded 11597 existing records. [2025-10-16T21:30:09.357929] [DEBUG] [LOCAL ] SKM: Loaded 35250 existing records from primary storage. [2025-10-16T21:30:09.404755] [INFO ] [MAIN ] SKM: Loaded 35250 existing records. [2025-10-16T21:30:09.403815] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:30:09.404584] [DEBUG] [LOCAL ] SKT: Loaded 42516 existing records from primary storage. [2025-10-16T21:30:09.437400] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-16T21:30:09.451614] [INFO ] [MAIN ] SKT: Loaded 42516 existing records. [2025-10-16T21:30:09.512005] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-16T21:30:09.592154] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-16T21:30:09.637939] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-16T21:30:09.655391] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:30:09.741820] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-16T21:30:09.741987] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-16T21:30:09.791920] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-16T21:30:09.814357] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-16T21:30:10.079399] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:30:10.138489] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:30:10.166741] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-16T21:30:10.170901] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-16T21:30:10.160186] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-16T21:30:10.206831] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-16T21:30:10.217256] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-10-16T21:30:10.222704] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-16T21:30:10.235639] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-10-16T21:30:10.295868] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-16T21:30:10.757889] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:30:10.792300] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-10-16T21:30:11.083287] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:30:11.131047] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-10-16T21:30:11.393349] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:30:11.399014] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-10-16T21:30:11.405492] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:30:11.406674] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-10-16T21:30:11.837797] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-16T21:30:11.840072] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-16T21:30:11.957580] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T21:30:11.962224] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-16T21:30:12.693095] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-16T21:30:12.699167] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-16T21:30:12.729839] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T21:30:12.732365] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-16T21:30:12.780906] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T21:30:12.788599] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-16T21:30:12.984859] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T21:30:12.988867] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-16T21:30:13.446843] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-16T21:30:13.542834] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-16T21:30:13.629772] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T21:30:13.896007] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T21:30:13.923673] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T21:30:14.264991] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T21:30:14.342805] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-16T21:30:15.028684] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-16T21:30:15.142812] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-16T21:30:15.942838] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-16T21:30:16.447590] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T21:30:16.596707] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-16T21:30:16.742795] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-16T21:30:17.542809] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-16T21:30:18.108005] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T21:30:18.112122] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T21:30:18.342814] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-16T21:30:19.142818] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-16T21:30:19.175439] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T21:30:19.942790] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-16T21:30:20.743683] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-16T21:30:20.749158] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T21:30:21.003129] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T21:30:21.384333] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-16T21:30:21.542857] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-16T21:30:22.342835] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-16T21:30:23.115735] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T21:30:23.142776] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-16T21:30:23.481409] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-16T21:30:23.942820] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-16T21:30:24.742816] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-16T21:30:24.760458] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-16T21:30:24.925053] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T21:30:25.228463] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-16T21:30:25.542875] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-16T21:30:26.342824] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-16T21:30:26.973225] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T21:30:27.142819] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-16T21:30:27.817556] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T21:30:27.942820] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-16T21:30:28.666737] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T21:30:28.740865] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T21:30:28.750802] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-16T21:30:29.340752] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-16T21:30:29.542830] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-16T21:30:30.342846] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-16T21:30:30.556872] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T21:30:31.137460] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-16T21:30:31.142777] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-16T21:30:31.942815] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-10-16T21:30:32.742943] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-16T21:30:32.803604] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T21:30:32.952277] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T21:30:33.542791] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-10-16T21:30:33.551246] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T21:30:33.554279] [INFO ] [REMOTE ] SKIL: Full fetch complete (10283 records). [2025-10-16T21:30:33.554437] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-16T21:30:33.912856] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-16T21:30:33.912944] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-16T21:30:33.913230] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-16T21:30:33.913272] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-16T21:30:33.913883] [DEBUG] [LOCAL ] SKIL: Trimmed 10283 records to 6699 (keeping 200 days of data) [2025-10-16T21:30:33.953171] [DEBUG] [LOCAL ] SKIL: Primary data saved (6699 records). [2025-10-16T21:30:33.953304] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-16T21:30:33.953384] [INFO ] [MAIN ] Update Progress: 1921/2369 symbols completed. SKIL took 25.7s. Estimated remaining: 1h 3m 5s. Rate: 7.1 symbols/min [2025-10-16T21:30:34.121846] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:30:34.157268] [DEBUG] [LOCAL ] SKY: Loaded 38486 existing records from primary storage. [2025-10-16T21:30:34.157597] [INFO ] [MAIN ] SKY: Loaded 38486 existing records. [2025-10-16T21:30:34.334031] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:30:34.334225] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-16T21:30:34.334272] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-16T21:30:34.334584] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-10-16T21:30:34.334679] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-16T21:30:34.347883] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-16T21:30:34.691243] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:30:34.949458] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T21:30:35.142814] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-10-16T21:30:35.697471] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T21:30:35.942812] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-16T21:30:36.558958] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T21:30:36.742830] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-10. [2025-10-16T21:30:36.913853] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T21:30:37.542827] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-10-16T21:30:38.034279] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-16T21:30:38.041490] [INFO ] [REMOTE ] SKM: Full fetch complete (49008 records). [2025-10-16T21:30:38.041728] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-16T21:30:38.347927] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-16T21:30:38.432111] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-16T21:30:38.432197] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-16T21:30:38.433176] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-16T21:30:38.433245] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-16T21:30:38.434397] [DEBUG] [LOCAL ] SKM: Trimmed 49008 records to 35553 (keeping 200 days of data) [2025-10-16T21:30:38.654169] [DEBUG] [LOCAL ] SKM: Primary data saved (35553 records). [2025-10-16T21:30:38.654299] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-16T21:30:38.654379] [INFO ] [MAIN ] Update Progress: 1922/2369 symbols completed. SKM took 30.4s. Estimated remaining: 1h 2m 56s. Rate: 7.1 symbols/min [2025-10-16T21:30:38.828220] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:30:38.845373] [DEBUG] [LOCAL ] SKYH: Loaded 16201 existing records from primary storage. [2025-10-16T21:30:38.845620] [INFO ] [MAIN ] SKYH: Loaded 16201 existing records. [2025-10-16T21:30:39.028907] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:30:39.029223] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-16T21:30:39.029336] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-16T21:30:39.029674] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-16T21:30:39.029731] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-16T21:30:39.143067] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-16T21:30:39.419696] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T21:30:39.446661] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:30:39.942857] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-16T21:30:40.252422] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T21:30:40.393038] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-16T21:30:40.742845] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-10-16T21:30:41.090864] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T21:30:41.542805] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-16T21:30:41.746752] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-16T21:30:42.325954] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T21:30:42.327842] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18100 records). [2025-10-16T21:30:42.327943] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-16T21:30:42.349934] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-16T21:30:42.687745] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-16T21:30:42.687838] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-16T21:30:42.688290] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-16T21:30:42.688352] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-16T21:30:42.689162] [DEBUG] [LOCAL ] SKLZ: Trimmed 18100 records to 11665 (keeping 200 days of data) [2025-10-16T21:30:42.756018] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11665 records). [2025-10-16T21:30:42.756154] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-16T21:30:42.756234] [INFO ] [MAIN ] Update Progress: 1923/2369 symbols completed. SKLZ took 34.5s. Estimated remaining: 1h 2m 46s. Rate: 7.1 symbols/min [2025-10-16T21:30:42.930445] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:30:42.979257] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-16T21:30:42.979580] [INFO ] [MAIN ] SLB: Loaded 53697 existing records. [2025-10-16T21:30:43.148022] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-16T21:30:43.178585] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:30:43.178969] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-16T21:30:43.179018] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-16T21:30:43.179215] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-10-16T21:30:43.179271] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-16T21:30:43.432005] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T21:30:43.568211] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:30:43.942900] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-16T21:30:44.631680] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T21:30:44.637712] [INFO ] [REMOTE ] SKT: Full fetch complete (60535 records). [2025-10-16T21:30:44.637880] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-16T21:30:44.747197] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-16T21:30:44.752193] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T21:30:45.040491] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-16T21:30:45.040567] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-16T21:30:45.041528] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-16T21:30:45.041589] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-16T21:30:45.042732] [DEBUG] [LOCAL ] SKT: Trimmed 60535 records to 42837 (keeping 200 days of data) [2025-10-16T21:30:45.300909] [DEBUG] [LOCAL ] SKT: Primary data saved (42837 records). [2025-10-16T21:30:45.301054] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-16T21:30:45.301143] [INFO ] [MAIN ] Update Progress: 1924/2369 symbols completed. SKT took 37.1s. Estimated remaining: 1h 2m 37s. Rate: 7.1 symbols/min [2025-10-16T21:30:45.467325] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:30:45.502668] [DEBUG] [LOCAL ] SLF: Loaded 38743 existing records from primary storage. [2025-10-16T21:30:45.502970] [INFO ] [MAIN ] SLF: Loaded 38743 existing records. [2025-10-16T21:30:45.548170] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-10-16T21:30:45.685763] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:30:45.686022] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-16T21:30:45.686071] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-16T21:30:45.686250] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-16T21:30:45.686289] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-16T21:30:46.046608] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:30:46.154521] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T21:30:46.342829] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-16T21:30:47.142832] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-10-16T21:30:47.505994] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-16T21:30:47.596337] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-16T21:30:47.942861] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-16T21:30:48.272912] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T21:30:48.742781] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-16T21:30:48.980573] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T21:30:49.542857] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-16T21:30:50.271212] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-16T21:30:50.342804] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-16T21:30:51.142852] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-16T21:30:51.933613] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T21:30:51.942762] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-16T21:30:51.971677] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-16T21:30:52.126324] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T21:30:52.742832] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-16T21:30:53.517609] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T21:30:53.542774] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-16T21:30:54.342876] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-16T21:30:54.622602] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-16T21:30:55.069873] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T21:30:55.142789] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-16T21:30:55.296132] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-16T21:30:55.942868] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-16T21:30:56.742839] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-16T21:30:57.268947] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-16T21:30:57.417808] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T21:30:57.542806] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-16T21:30:57.719810] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-16T21:30:58.342865] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-16T21:30:59.129523] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T21:30:59.142758] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-16T21:30:59.261335] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-16T21:30:59.942822] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-16T21:31:00.703759] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T21:31:00.742768] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-16T21:31:00.933509] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T21:31:01.542866] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-16T21:31:02.197443] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T21:31:02.342838] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-16T21:31:02.914419] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T21:31:03.142862] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-16T21:31:03.352790] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T21:31:03.942866] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-16T21:31:04.742844] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-16T21:31:04.835550] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T21:31:05.107176] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T21:31:05.542788] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-16T21:31:05.669155] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T21:31:06.342895] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-16T21:31:07.076691] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T21:31:07.142768] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-16T21:31:07.220534] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T21:31:07.223374] [INFO ] [REMOTE ] SKYH: Full fetch complete (22482 records). [2025-10-16T21:31:07.223449] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-16T21:31:07.583144] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-16T21:31:07.583220] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-16T21:31:07.583714] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-16T21:31:07.583775] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-16T21:31:07.584376] [DEBUG] [LOCAL ] SKYH: Trimmed 22482 records to 16341 (keeping 200 days of data) [2025-10-16T21:31:07.680305] [DEBUG] [LOCAL ] SKYH: Primary data saved (16341 records). [2025-10-16T21:31:07.680464] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-16T21:31:07.680550] [INFO ] [MAIN ] Update Progress: 1925/2369 symbols completed. SKYH took 29.0s. Estimated remaining: 1h 2m 31s. Rate: 7.1 symbols/min [2025-10-16T21:31:07.844952] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:31:07.885130] [DEBUG] [LOCAL ] SLG: Loaded 45584 existing records from primary storage. [2025-10-16T21:31:07.885425] [INFO ] [MAIN ] SLG: Loaded 45584 existing records. [2025-10-16T21:31:07.947945] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-16T21:31:08.062312] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:31:08.062595] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-16T21:31:08.062686] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-16T21:31:08.062914] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-10-16T21:31:08.062970] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-16T21:31:08.416221] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:31:08.685745] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T21:31:08.742809] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-16T21:31:09.502293] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T21:31:09.542780] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-16T21:31:09.769404] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-16T21:31:09.774781] [INFO ] [REMOTE ] SKY: Full fetch complete (54234 records). [2025-10-16T21:31:09.774911] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-16T21:31:10.140943] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-16T21:31:10.141019] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-16T21:31:10.141900] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-16T21:31:10.141961] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-16T21:31:10.143006] [DEBUG] [LOCAL ] SKY: Trimmed 54234 records to 38776 (keeping 200 days of data) [2025-10-16T21:31:10.346682] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-10-16T21:31:10.375729] [DEBUG] [LOCAL ] SKY: Primary data saved (38776 records). [2025-10-16T21:31:10.375866] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-16T21:31:10.375943] [INFO ] [MAIN ] Update Progress: 1926/2369 symbols completed. SKY took 36.4s. Estimated remaining: 1h 2m 22s. Rate: 7.1 symbols/min [2025-10-16T21:31:10.541897] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:31:10.581855] [DEBUG] [LOCAL ] SLGN: Loaded 40857 existing records from primary storage. [2025-10-16T21:31:10.582130] [INFO ] [MAIN ] SLGN: Loaded 40857 existing records. [2025-10-16T21:31:10.764502] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:31:10.764814] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-16T21:31:10.764963] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-16T21:31:10.765794] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-10-16T21:31:10.765852] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-16T21:31:10.906404] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T21:31:11.000167] [INFO ] [REMOTE ] SLF: Full fetch complete (56492 records). [2025-10-16T21:31:11.039017] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-16T21:31:11.160853] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-16T21:31:11.245678] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:31:11.540374] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-16T21:31:11.540457] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-16T21:31:11.541426] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-16T21:31:11.541524] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-16T21:31:11.542841] [DEBUG] [LOCAL ] SLF: Trimmed 56492 records to 39052 (keeping 200 days of data) [2025-10-16T21:31:11.783872] [DEBUG] [LOCAL ] SLF: Primary data saved (39052 records). [2025-10-16T21:31:11.784031] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-16T21:31:11.784112] [INFO ] [MAIN ] Update Progress: 1927/2369 symbols completed. SLF took 26.5s. Estimated remaining: 1h 2m 11s. Rate: 7.1 symbols/min [2025-10-16T21:31:11.956937] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-10-16T21:31:11.959492] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:31:11.960715] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-16T21:31:11.960891] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-16T21:31:11.961115] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-16T21:31:11.961181] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-16T21:31:11.961351] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-16T21:31:11.961511] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-16T21:31:12.129833] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T21:31:12.349366] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:31:12.742830] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-10-16T21:31:13.398263] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-16T21:31:13.457530] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T21:31:13.487115] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T21:31:13.542827] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-16T21:31:14.342857] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-16T21:31:14.680597] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-16T21:31:15.004869] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T21:31:15.142830] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-16T21:31:15.505296] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-16T21:31:15.942873] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-16T21:31:16.277673] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-16T21:31:16.742895] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-16T21:31:17.542801] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-16T21:31:18.342834] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-16T21:31:18.782940] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-16T21:31:18.817515] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T21:31:19.142796] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-16T21:31:19.695087] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T21:31:19.942848] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-16T21:31:20.271186] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-16T21:31:20.742798] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-16T21:31:21.190158] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-16T21:31:21.542889] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-16T21:31:22.270201] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T21:31:22.342836] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-16T21:31:22.696492] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-16T21:31:23.142779] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-16T21:31:23.256237] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T21:31:23.942830] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-16T21:31:24.729673] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T21:31:24.742774] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-16T21:31:25.542857] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-16T21:31:25.893361] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-16T21:31:26.080428] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-16T21:31:26.180938] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T21:31:26.342780] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-16T21:31:27.142853] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-16T21:31:27.843523] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T21:31:27.942800] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-16T21:31:28.295877] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-16T21:31:28.742809] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-16T21:31:28.945106] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-16T21:31:29.542912] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-16T21:31:30.285143] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T21:31:30.342825] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-16T21:31:31.142953] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-16T21:31:31.380808] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T21:31:31.387901] [INFO ] [REMOTE ] SLB: Full fetch complete (77877 records). [2025-10-16T21:31:31.388052] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-16T21:31:31.784759] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-10-16T21:31:31.784936] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-10-16T21:31:31.786189] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-10-16T21:31:31.786295] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-10-16T21:31:31.788120] [DEBUG] [LOCAL ] SLB: Trimmed 77877 records to 54087 (keeping 200 days of data) [2025-10-16T21:31:31.817683] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T21:31:31.942778] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-16T21:31:32.165978] [DEBUG] [LOCAL ] SLB: Primary data saved (54087 records). [2025-10-16T21:31:32.166133] [INFO ] [MAIN ] SLB: Full history saved. [2025-10-16T21:31:32.166737] [INFO ] [MAIN ] Update Progress: 1928/2369 symbols completed. SLB took 49.4s. Estimated remaining: 1h 2m 6s. Rate: 7.1 symbols/min [2025-10-16T21:31:32.268124] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-16T21:31:32.337001] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:31:32.378886] [DEBUG] [LOCAL ] SLQT: Loaded 43522 existing records from primary storage. [2025-10-16T21:31:32.379177] [INFO ] [MAIN ] SLQT: Loaded 43522 existing records. [2025-10-16T21:31:32.559217] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:31:32.559438] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-16T21:31:32.559486] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-16T21:31:32.559955] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-16T21:31:32.560031] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-16T21:31:32.747740] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-16T21:31:32.958404] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:31:32.985915] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T21:31:33.542876] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-10-16T21:31:34.241187] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-16T21:31:34.342821] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-16T21:31:34.615107] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T21:31:35.142861] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-16T21:31:35.826037] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T21:31:35.942837] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-16T21:31:36.267957] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-16T21:31:36.713201] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T21:31:36.742830] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-16T21:31:37.542828] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-16T21:31:38.342831] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-16T21:31:38.413057] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T21:31:38.601440] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-16T21:31:38.602166] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1044 records). [2025-10-16T21:31:38.602234] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-16T21:31:38.781897] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-16T21:31:38.782136] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:31:38.782204] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:31:38.782276] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-16T21:31:38.782336] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-16T21:31:38.782371] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-16T21:31:38.782409] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-16T21:31:38.782463] [INFO ] [MAIN ] Update Progress: 1929/2369 symbols completed. SLNZ took 27.0s. Estimated remaining: 1h 1m 57s. Rate: 7.1 symbols/min [2025-10-16T21:31:38.952125] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:31:38.980953] [DEBUG] [LOCAL ] SLVM: Loaded 27812 existing records from primary storage. [2025-10-16T21:31:38.981207] [INFO ] [MAIN ] SLVM: Loaded 27812 existing records. [2025-10-16T21:31:39.145530] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-16T21:31:39.170771] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:31:39.172193] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-16T21:31:39.172252] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-16T21:31:39.172710] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-10-16T21:31:39.172862] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-16T21:31:39.351852] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T21:31:39.577182] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:31:39.942819] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-16T21:31:40.706183] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T21:31:40.742807] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-16T21:31:41.401041] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T21:31:41.406691] [INFO ] [REMOTE ] SLG: Full fetch complete (65118 records). [2025-10-16T21:31:41.406794] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-16T21:31:41.549384] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-10-16T21:31:41.802315] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-16T21:31:41.802435] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-16T21:31:41.803635] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-16T21:31:41.803932] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-16T21:31:41.812379] [DEBUG] [LOCAL ] SLG: Trimmed 65118 records to 45971 (keeping 200 days of data) [2025-10-16T21:31:41.826301] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T21:31:42.108948] [DEBUG] [LOCAL ] SLG: Primary data saved (45971 records). [2025-10-16T21:31:42.109074] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-16T21:31:42.109685] [INFO ] [MAIN ] Update Progress: 1930/2369 symbols completed. SLG took 34.4s. Estimated remaining: 1h 1m 47s. Rate: 7.1 symbols/min [2025-10-16T21:31:42.275413] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:31:42.330557] [DEBUG] [LOCAL ] SM: Loaded 52378 existing records from primary storage. [2025-10-16T21:31:42.330879] [INFO ] [MAIN ] SM: Loaded 52378 existing records. [2025-10-16T21:31:42.351794] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-16T21:31:42.514935] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:31:42.515137] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-16T21:31:42.515188] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-16T21:31:42.515805] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-10-16T21:31:42.515863] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-16T21:31:42.868393] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:31:42.882385] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T21:31:43.142850] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-10-16T21:31:43.942843] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-16T21:31:44.080679] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T21:31:44.467201] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T21:31:44.742801] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-16T21:31:45.487978] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T21:31:45.542799] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-16T21:31:46.342800] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-16T21:31:46.431436] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T21:31:47.052802] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T21:31:47.142819] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-16T21:31:47.915746] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T21:31:47.942776] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-16T21:31:48.676606] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T21:31:48.742812] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-16T21:31:49.387180] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T21:31:49.542801] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-16T21:31:50.340304] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T21:31:50.345946] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-16T21:31:50.347611] [INFO ] [REMOTE ] SLGN: Full fetch complete (59214 records). [2025-10-16T21:31:50.347809] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-16T21:31:50.764330] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-16T21:31:50.764430] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-16T21:31:50.765424] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-16T21:31:50.765486] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-16T21:31:50.766798] [DEBUG] [LOCAL ] SLGN: Trimmed 59214 records to 41193 (keeping 200 days of data) [2025-10-16T21:31:51.018241] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T21:31:51.040839] [DEBUG] [LOCAL ] SLGN: Primary data saved (41193 records). [2025-10-16T21:31:51.040971] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-16T21:31:51.041047] [INFO ] [MAIN ] Update Progress: 1931/2369 symbols completed. SLGN took 40.7s. Estimated remaining: 1h 1m 39s. Rate: 7.1 symbols/min [2025-10-16T21:31:51.147983] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-16T21:31:51.209718] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:31:51.209853] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-16T21:31:51.209889] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-16T21:31:51.210006] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-16T21:31:51.210046] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-16T21:31:51.210086] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-16T21:31:51.210118] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-16T21:31:51.562977] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:31:51.784611] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T21:31:51.942839] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-16T21:31:52.661202] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T21:31:52.742799] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-16T21:31:53.089115] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T21:31:53.542807] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-16T21:31:54.342873] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-10-16T21:31:54.514280] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T21:31:54.564076] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:31:54.564340] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-10-16T21:31:54.564426] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:31:54.564473] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-16T21:31:54.564506] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:31:54.564583] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-16T21:31:54.564685] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-16T21:31:54.564739] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-16T21:31:54.564781] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-16T21:31:54.564826] [INFO ] [MAIN ] Update Progress: 1932/2369 symbols completed. SMA took 3.5s. Estimated remaining: 1h 1m 29s. Rate: 7.1 symbols/min [2025-10-16T21:31:54.739354] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:31:54.749582] [DEBUG] [LOCAL ] SMBK: Loaded 8201 existing records from primary storage. [2025-10-16T21:31:54.749842] [INFO ] [MAIN ] SMBK: Loaded 8201 existing records. [2025-10-16T21:31:54.948335] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:31:54.950194] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-16T21:31:54.949999] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T21:31:54.950293] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-16T21:31:54.958614] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-16T21:31:54.958711] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-16T21:31:55.152543] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-16T21:31:55.310588] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:31:55.942882] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-16T21:31:56.742798] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-16T21:31:56.786283] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T21:31:57.542817] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-16T21:31:57.806594] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T21:31:58.047291] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T21:31:58.342808] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-16T21:31:59.142885] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-10-16T21:31:59.199807] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T21:31:59.926439] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-16T21:31:59.942769] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-16T21:32:00.240778] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T21:32:00.742821] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-16T21:32:01.039979] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T21:32:01.228913] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-16T21:32:01.542822] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-16T21:32:02.342826] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-16T21:32:02.834764] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T21:32:03.142800] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-16T21:32:03.933946] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T21:32:03.944228] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-16T21:32:04.536844] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T21:32:04.542421] [INFO ] [REMOTE ] SLQT: Full fetch complete (63904 records). [2025-10-16T21:32:04.542538] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-16T21:32:04.767835] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-16T21:32:04.800928] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-16T21:32:04.942670] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-16T21:32:04.942756] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-16T21:32:04.943751] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-16T21:32:04.943812] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-16T21:32:04.945022] [DEBUG] [LOCAL ] SLQT: Trimmed 63904 records to 43838 (keeping 200 days of data) [2025-10-16T21:32:05.185822] [DEBUG] [LOCAL ] SLQT: Primary data saved (43838 records). [2025-10-16T21:32:05.185944] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-16T21:32:05.186019] [INFO ] [MAIN ] Update Progress: 1933/2369 symbols completed. SLQT took 33.0s. Estimated remaining: 1h 1m 21s. Rate: 7.1 symbols/min [2025-10-16T21:32:05.351065] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:32:05.363203] [DEBUG] [LOCAL ] SMC: Loaded 11266 existing records from primary storage. [2025-10-16T21:32:05.363399] [INFO ] [MAIN ] SMC: Loaded 11266 existing records. [2025-10-16T21:32:05.537001] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:32:05.537202] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-16T21:32:05.537248] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-16T21:32:05.537432] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-16T21:32:05.537472] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-16T21:32:05.548506] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-16T21:32:05.891696] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:32:06.342789] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-10-16T21:32:06.672729] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-16T21:32:06.813515] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T21:32:06.879535] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-16T21:32:07.142807] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-16T21:32:07.913764] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T21:32:07.942779] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-16T21:32:08.742838] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-16T21:32:08.778345] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-16T21:32:09.542819] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-16T21:32:09.984364] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T21:32:10.269086] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T21:32:10.342844] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-16T21:32:11.142794] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-16T21:32:11.214028] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T21:32:11.691930] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-16T21:32:11.942842] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-16T21:32:12.739233] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T21:32:12.742755] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-16T21:32:13.542837] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-16T21:32:13.559847] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T21:32:14.342823] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-16T21:32:15.145885] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-16T21:32:15.146560] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T21:32:15.291016] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T21:32:15.942783] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-16T21:32:16.029798] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T21:32:16.602884] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T21:32:16.604552] [INFO ] [REMOTE ] SMBK: Full fetch complete (11842 records). [2025-10-16T21:32:16.604624] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-16T21:32:16.752529] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-16T21:32:16.962353] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-16T21:32:16.962423] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-16T21:32:16.962708] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-16T21:32:16.962768] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-16T21:32:16.963198] [DEBUG] [LOCAL ] SMBK: Trimmed 11842 records to 8308 (keeping 200 days of data) [2025-10-16T21:32:17.011169] [DEBUG] [LOCAL ] SMBK: Primary data saved (8308 records). [2025-10-16T21:32:17.011285] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-16T21:32:17.011363] [INFO ] [MAIN ] Update Progress: 1934/2369 symbols completed. SMBK took 22.4s. Estimated remaining: 1h 1m 14s. Rate: 7.1 symbols/min [2025-10-16T21:32:17.180483] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:32:17.225705] [DEBUG] [LOCAL ] SMFG: Loaded 48360 existing records from primary storage. [2025-10-16T21:32:17.226021] [INFO ] [MAIN ] SMFG: Loaded 48360 existing records. [2025-10-16T21:32:17.399218] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:32:17.399418] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-16T21:32:17.399464] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-16T21:32:17.399966] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-16T21:32:17.400023] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-16T21:32:17.553611] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-16T21:32:17.749698] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:32:18.342856] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-16T21:32:18.439020] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-16T21:32:18.615010] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-16T21:32:19.142812] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-16T21:32:19.689339] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T21:32:19.942794] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-16T21:32:20.071693] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-16T21:32:20.742816] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-16T21:32:21.542794] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-16T21:32:21.624200] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T21:32:21.634694] [INFO ] [REMOTE ] SM: Full fetch complete (75827 records). [2025-10-16T21:32:21.634862] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-16T21:32:22.030389] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-16T21:32:22.030537] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-16T21:32:22.031687] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-16T21:32:22.031778] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-16T21:32:22.033276] [DEBUG] [LOCAL ] SM: Trimmed 75827 records to 52766 (keeping 200 days of data) [2025-10-16T21:32:22.262928] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T21:32:22.352854] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-16T21:32:22.377155] [DEBUG] [LOCAL ] SM: Primary data saved (52766 records). [2025-10-16T21:32:22.377293] [INFO ] [MAIN ] SM: Full history saved. [2025-10-16T21:32:22.377772] [INFO ] [MAIN ] Update Progress: 1935/2369 symbols completed. SM took 40.3s. Estimated remaining: 1h 1m 5s. Rate: 7.1 symbols/min [2025-10-16T21:32:22.562214] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:32:22.607468] [DEBUG] [LOCAL ] SMG: Loaded 43369 existing records from primary storage. [2025-10-16T21:32:22.607868] [INFO ] [MAIN ] SMG: Loaded 43369 existing records. [2025-10-16T21:32:22.821909] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:32:22.822169] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-16T21:32:22.822218] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-16T21:32:22.822434] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-10-16T21:32:22.822509] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-16T21:32:23.027681] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T21:32:23.148297] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-16T21:32:23.239534] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:32:23.520398] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T21:32:23.524536] [INFO ] [REMOTE ] SLVM: Full fetch complete (40213 records). [2025-10-16T21:32:23.524617] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-16T21:32:23.915604] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-16T21:32:23.915783] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-16T21:32:23.916678] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-16T21:32:23.916741] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-16T21:32:23.917794] [DEBUG] [LOCAL ] SLVM: Trimmed 40213 records to 28003 (keeping 200 days of data) [2025-10-16T21:32:23.971202] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-10-16T21:32:24.015506] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T21:32:24.100740] [DEBUG] [LOCAL ] SLVM: Primary data saved (28003 records). [2025-10-16T21:32:24.100838] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-16T21:32:24.100916] [INFO ] [MAIN ] Update Progress: 1936/2369 symbols completed. SLVM took 45.3s. Estimated remaining: 1h 0m 55s. Rate: 7.1 symbols/min [2025-10-16T21:32:24.265661] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:32:24.280028] [DEBUG] [LOCAL ] SMHI: Loaded 13111 existing records from primary storage. [2025-10-16T21:32:24.280301] [INFO ] [MAIN ] SMHI: Loaded 13111 existing records. [2025-10-16T21:32:24.452780] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:32:24.452968] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-16T21:32:24.453014] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-16T21:32:24.453216] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-16T21:32:24.453272] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-16T21:32:24.747951] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-10-16T21:32:24.800400] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:32:25.542840] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-10-16T21:32:25.721972] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T21:32:26.263237] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T21:32:26.342771] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-16T21:32:26.772689] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T21:32:27.142805] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-16T21:32:27.846903] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T21:32:27.942860] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-16T21:32:28.124066] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T21:32:28.742867] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-16T21:32:29.539497] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T21:32:29.547529] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-16T21:32:30.283526] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T21:32:30.342767] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-16T21:32:30.527369] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T21:32:31.142817] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-16T21:32:31.947933] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-16T21:32:31.966086] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T21:32:32.128071] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-16T21:32:32.743068] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-16T21:32:33.542848] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-16T21:32:33.577757] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T21:32:33.609257] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-16T21:32:34.342870] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-16T21:32:35.142795] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-16T21:32:35.374266] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T21:32:35.907618] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-16T21:32:35.942776] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-16T21:32:36.062000] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T21:32:36.742806] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-16T21:32:36.792790] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-16T21:32:37.542812] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-16T21:32:38.342852] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-16T21:32:38.563441] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T21:32:39.142870] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-16T21:32:39.179282] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T21:32:39.197083] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-16T21:32:39.942888] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-16T21:32:40.742815] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-16T21:32:40.840037] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T21:32:41.486091] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T21:32:41.488308] [INFO ] [REMOTE ] SMC: Full fetch complete (16580 records). [2025-10-16T21:32:41.488423] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-16T21:32:41.549823] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-16T21:32:41.625998] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T21:32:41.892544] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-16T21:32:41.892619] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-16T21:32:41.893010] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-16T21:32:41.893070] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-16T21:32:41.893561] [DEBUG] [LOCAL ] SMC: Trimmed 16580 records to 11307 (keeping 200 days of data) [2025-10-16T21:32:41.958450] [DEBUG] [LOCAL ] SMC: Primary data saved (11307 records). [2025-10-16T21:32:41.958578] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-16T21:32:41.958684] [INFO ] [MAIN ] Update Progress: 1937/2369 symbols completed. SMC took 36.8s. Estimated remaining: 1h 0m 48s. Rate: 7.1 symbols/min [2025-10-16T21:32:42.140568] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:32:42.159615] [DEBUG] [LOCAL ] SMP: Loaded 18828 existing records from primary storage. [2025-10-16T21:32:42.159875] [INFO ] [MAIN ] SMP: Loaded 18828 existing records. [2025-10-16T21:32:42.344318] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-16T21:32:42.349790] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:32:42.350881] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-16T21:32:42.350952] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-16T21:32:42.351303] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-10-16T21:32:42.351370] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-16T21:32:42.621019] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-16T21:32:42.719970] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:32:43.142807] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-10-16T21:32:43.942795] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-16T21:32:44.012354] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T21:32:44.150714] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T21:32:44.742821] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-16T21:32:45.542808] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-16T21:32:45.658340] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T21:32:45.676255] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-16T21:32:46.342823] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-16T21:32:46.465141] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T21:32:47.142796] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-16T21:32:47.317281] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-16T21:32:47.942785] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-16T21:32:48.193503] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-16T21:32:48.742812] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-16T21:32:49.542033] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-16T21:32:49.551100] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-16T21:32:49.868616] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T21:32:50.342787] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-16T21:32:50.412685] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-16T21:32:51.142830] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-16T21:32:51.921727] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-16T21:32:51.942813] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-16T21:32:52.085070] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T21:32:52.598564] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T21:32:52.600246] [INFO ] [REMOTE ] SMHI: Full fetch complete (21777 records). [2025-10-16T21:32:52.600323] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-16T21:32:52.747996] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-16T21:32:52.980875] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-16T21:32:52.980953] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-16T21:32:52.981410] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-16T21:32:52.981451] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-16T21:32:52.982085] [DEBUG] [LOCAL ] SMHI: Trimmed 21777 records to 13165 (keeping 200 days of data) [2025-10-16T21:32:53.054932] [DEBUG] [LOCAL ] SMHI: Primary data saved (13165 records). [2025-10-16T21:32:53.055090] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-16T21:32:53.055182] [INFO ] [MAIN ] Update Progress: 1938/2369 symbols completed. SMHI took 29.0s. Estimated remaining: 1h 0m 40s. Rate: 7.1 symbols/min [2025-10-16T21:32:53.223338] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:32:53.273806] [DEBUG] [LOCAL ] SMR: Loaded 53799 existing records from primary storage. [2025-10-16T21:32:53.274120] [INFO ] [MAIN ] SMR: Loaded 53799 existing records. [2025-10-16T21:32:53.448305] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:32:53.448535] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-16T21:32:53.448587] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-16T21:32:53.449107] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-10-16T21:32:53.449171] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-16T21:32:53.547968] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-16T21:32:53.806782] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:32:54.342792] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-10-16T21:32:54.533722] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T21:32:54.772261] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T21:32:55.142840] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-16T21:32:55.942835] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-16T21:32:56.167161] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T21:32:56.742795] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-16T21:32:56.999869] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-16T21:32:57.130966] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T21:32:57.136399] [INFO ] [REMOTE ] SMG: Full fetch complete (63049 records). [2025-10-16T21:32:57.136507] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-16T21:32:57.515297] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-16T21:32:57.515381] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-16T21:32:57.516481] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-16T21:32:57.516554] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-16T21:32:57.518255] [DEBUG] [LOCAL ] SMG: Trimmed 63049 records to 43649 (keeping 200 days of data) [2025-10-16T21:32:57.570854] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-16T21:32:57.785442] [DEBUG] [LOCAL ] SMG: Primary data saved (43649 records). [2025-10-16T21:32:57.785573] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-16T21:32:57.786059] [INFO ] [MAIN ] Update Progress: 1939/2369 symbols completed. SMG took 35.4s. Estimated remaining: 1h 0m 31s. Rate: 7.1 symbols/min [2025-10-16T21:32:57.952589] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:32:57.996119] [DEBUG] [LOCAL ] SMRT: Loaded 43964 existing records from primary storage. [2025-10-16T21:32:57.996468] [INFO ] [MAIN ] SMRT: Loaded 43964 existing records. [2025-10-16T21:32:58.174604] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:32:58.174841] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-16T21:32:58.174888] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-16T21:32:58.175235] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-16T21:32:58.175292] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-16T21:32:58.354528] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-16T21:32:58.572987] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:32:58.588252] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T21:32:59.142793] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-16T21:32:59.465350] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T21:32:59.942799] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-10-16T21:33:00.071896] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-10-16T21:33:00.348235] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T21:33:00.742807] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-16T21:33:01.463473] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T21:33:01.542817] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-16T21:33:02.342849] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-16T21:33:02.713209] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T21:33:03.142782] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-16T21:33:03.359428] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-10-16T21:33:03.872201] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T21:33:03.878696] [INFO ] [REMOTE ] SMFG: Full fetch complete (69402 records). [2025-10-16T21:33:03.878825] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-16T21:33:03.951420] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-16T21:33:04.259347] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-16T21:33:04.259428] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-16T21:33:04.260455] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-16T21:33:04.260518] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-16T21:33:04.261860] [DEBUG] [LOCAL ] SMFG: Trimmed 69402 records to 48740 (keeping 200 days of data) [2025-10-16T21:33:04.551297] [DEBUG] [LOCAL ] SMFG: Primary data saved (48740 records). [2025-10-16T21:33:04.551431] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-16T21:33:04.551516] [INFO ] [MAIN ] Update Progress: 1940/2369 symbols completed. SMFG took 47.5s. Estimated remaining: 1h 0m 22s. Rate: 7.1 symbols/min [2025-10-16T21:33:04.712475] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T21:33:04.750113] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-16T21:33:04.752750] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:33:04.784046] [DEBUG] [LOCAL ] SMWB: Loaded 32187 existing records from primary storage. [2025-10-16T21:33:04.784316] [INFO ] [MAIN ] SMWB: Loaded 32187 existing records. [2025-10-16T21:33:04.955393] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:33:04.955596] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-16T21:33:04.955665] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-16T21:33:04.956144] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-16T21:33:04.956211] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-16T21:33:05.297874] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:33:05.542820] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-10-16T21:33:05.826433] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T21:33:06.342854] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-16T21:33:06.631424] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-16T21:33:06.980428] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T21:33:07.142811] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-16T21:33:07.942802] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-16T21:33:08.004578] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T21:33:08.742841] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-16T21:33:09.022548] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-16T21:33:09.465499] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-16T21:33:09.542798] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-16T21:33:10.037923] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T21:33:10.342816] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-16T21:33:11.142878] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-16T21:33:11.870198] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T21:33:11.942771] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-16T21:33:12.742809] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-16T21:33:13.336800] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-16T21:33:13.365674] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T21:33:13.542812] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-16T21:33:13.709907] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T21:33:14.342852] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-16T21:33:14.805833] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (5.26 seconds). [2025-10-16T21:33:14.945705] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T21:33:15.142797] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-16T21:33:15.236246] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T21:33:15.241800] [INFO ] [REMOTE ] SMP: Full fetch complete (26357 records). [2025-10-16T21:33:15.241929] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-16T21:33:15.618503] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-16T21:33:15.618575] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-16T21:33:15.619243] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-16T21:33:15.619305] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-16T21:33:15.619995] [DEBUG] [LOCAL ] SMP: Trimmed 26357 records to 18960 (keeping 200 days of data) [2025-10-16T21:33:15.732713] [DEBUG] [LOCAL ] SMP: Primary data saved (18960 records). [2025-10-16T21:33:15.732848] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-16T21:33:15.732925] [INFO ] [MAIN ] Update Progress: 1941/2369 symbols completed. SMP took 33.8s. Estimated remaining: 1h 0m 15s. Rate: 7.1 symbols/min [2025-10-16T21:33:15.897372] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:33:15.943304] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-16T21:33:15.945214] [DEBUG] [LOCAL ] SN: Loaded 49983 existing records from primary storage. [2025-10-16T21:33:15.945549] [INFO ] [MAIN ] SN: Loaded 49983 existing records. [2025-10-16T21:33:16.122898] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:33:16.123121] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-16T21:33:16.123169] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-16T21:33:16.123766] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-16T21:33:16.123824] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-16T21:33:16.466535] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:33:16.742813] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-10-16T21:33:17.542894] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-16T21:33:17.608918] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T21:33:17.904874] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-10-16T21:33:18.040284] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T21:33:18.342796] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-16T21:33:18.490258] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-16T21:33:19.142882] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-16T21:33:19.942848] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-16T21:33:20.701770] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T21:33:20.742771] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-16T21:33:20.941107] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-16T21:33:21.335117] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T21:33:21.542775] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-16T21:33:21.999079] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T21:33:22.342864] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-16T21:33:23.085634] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T21:33:23.142793] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-16T21:33:23.644568] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-16T21:33:23.942814] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-16T21:33:24.548116] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T21:33:24.742780] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-16T21:33:25.542878] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-16T21:33:25.628851] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T21:33:26.127934] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T21:33:26.136518] [INFO ] [REMOTE ] SMRT: Full fetch complete (62232 records). [2025-10-16T21:33:26.136769] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-16T21:33:26.355093] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-16T21:33:26.621160] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-16T21:33:26.621427] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-16T21:33:26.622627] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-16T21:33:26.622726] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-16T21:33:26.624313] [DEBUG] [LOCAL ] SMRT: Trimmed 62232 records to 44269 (keeping 200 days of data) [2025-10-16T21:33:26.744334] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T21:33:26.901811] [DEBUG] [LOCAL ] SMRT: Primary data saved (44269 records). [2025-10-16T21:33:26.901943] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-16T21:33:26.902449] [INFO ] [MAIN ] Update Progress: 1942/2369 symbols completed. SMRT took 29.1s. Estimated remaining: 1h 0m 7s. Rate: 7.1 symbols/min [2025-10-16T21:33:27.067221] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:33:27.094751] [DEBUG] [LOCAL ] SNA: Loaded 25783 existing records from primary storage. [2025-10-16T21:33:27.095053] [INFO ] [MAIN ] SNA: Loaded 25783 existing records. [2025-10-16T21:33:27.150128] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-16T21:33:27.278675] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:33:27.278918] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-16T21:33:27.278986] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-16T21:33:27.279377] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-10-16T21:33:27.279434] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-16T21:33:27.641109] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:33:27.942811] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-10-16T21:33:28.742795] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-16T21:33:28.984294] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T21:33:29.075996] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-16T21:33:29.151208] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-16T21:33:29.542776] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-16T21:33:29.560683] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T21:33:30.342855] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-16T21:33:31.142805] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-16T21:33:31.623338] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-16T21:33:31.688029] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T21:33:31.942882] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-16T21:33:32.742860] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-16T21:33:33.542809] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-16T21:33:33.691726] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T21:33:33.816974] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-10-16T21:33:33.898032] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-16T21:33:33.901943] [INFO ] [REMOTE ] SMWB: Full fetch complete (49098 records). [2025-10-16T21:33:33.902039] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-16T21:33:34.268092] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-16T21:33:34.268166] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-16T21:33:34.269066] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-16T21:33:34.269129] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-16T21:33:34.270144] [DEBUG] [LOCAL ] SMWB: Trimmed 49098 records to 32395 (keeping 200 days of data) [2025-10-16T21:33:34.348788] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-16T21:33:34.453661] [DEBUG] [LOCAL ] SMWB: Primary data saved (32395 records). [2025-10-16T21:33:34.453798] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-16T21:33:34.453874] [INFO ] [MAIN ] Update Progress: 1943/2369 symbols completed. SMWB took 29.9s. Estimated remaining: 59m 58s. Rate: 7.1 symbols/min [2025-10-16T21:33:34.628408] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:33:34.679396] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-16T21:33:34.679724] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-10-16T21:33:34.861634] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:33:34.861967] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-16T21:33:34.862072] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-16T21:33:34.862391] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-16T21:33:34.862475] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-16T21:33:34.981529] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T21:33:35.152254] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-16T21:33:35.242240] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:33:35.942817] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-10-16T21:33:36.742790] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-16T21:33:36.906792] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T21:33:37.210992] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-10-16T21:33:37.542815] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-16T21:33:37.757124] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T21:33:38.096838] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-16T21:33:38.342854] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-16T21:33:39.142875] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-16T21:33:39.942801] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-16T21:33:40.071032] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (2.53 seconds). [2025-10-16T21:33:40.077904] [INFO ] [REMOTE ] SMR: Full fetch complete (77977 records). [2025-10-16T21:33:40.078025] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-16T21:33:40.461883] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-10-16T21:33:40.462157] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-10-16T21:33:40.463312] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-10-16T21:33:40.463390] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-10-16T21:33:40.464915] [DEBUG] [LOCAL ] SMR: Trimmed 77977 records to 54189 (keeping 200 days of data) [2025-10-16T21:33:40.734620] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-16T21:33:40.810024] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-16T21:33:40.833239] [DEBUG] [LOCAL ] SMR: Primary data saved (54189 records). [2025-10-16T21:33:40.833357] [INFO ] [MAIN ] SMR: Full history saved. [2025-10-16T21:33:40.834135] [INFO ] [MAIN ] Update Progress: 1944/2369 symbols completed. SMR took 47.8s. Estimated remaining: 59m 49s. Rate: 7.1 symbols/min [2025-10-16T21:33:41.006090] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:33:41.040690] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-16T21:33:41.040883] [DEBUG] [LOCAL ] SNDA: Loaded 4464 existing records from primary storage. [2025-10-16T21:33:41.041162] [INFO ] [MAIN ] SNDA: Loaded 4464 existing records. [2025-10-16T21:33:41.236488] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:33:41.236823] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-16T21:33:41.236992] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-16T21:33:41.237230] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-16T21:33:41.237312] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-16T21:33:41.545200] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-16T21:33:41.549973] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T21:33:41.636667] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:33:42.342857] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-16T21:33:42.886347] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-16T21:33:43.142833] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-16T21:33:43.361458] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T21:33:43.425614] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T21:33:43.942832] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-16T21:33:44.742879] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-16T21:33:45.238266] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T21:33:45.361844] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-16T21:33:45.542789] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-16T21:33:46.342818] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-16T21:33:46.402611] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T21:33:47.142813] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-16T21:33:47.634630] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T21:33:47.751588] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-16T21:33:47.942803] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-16T21:33:48.507315] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T21:33:48.513911] [INFO ] [REMOTE ] SN: Full fetch complete (71642 records). [2025-10-16T21:33:48.514103] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-16T21:33:48.751191] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-10-16T21:33:48.900818] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-16T21:33:48.900901] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-16T21:33:48.901983] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-16T21:33:48.902047] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-16T21:33:48.903406] [DEBUG] [LOCAL ] SN: Trimmed 71642 records to 50370 (keeping 200 days of data) [2025-10-16T21:33:49.212483] [DEBUG] [LOCAL ] SN: Primary data saved (50370 records). [2025-10-16T21:33:49.212668] [INFO ] [MAIN ] SN: Full history saved. [2025-10-16T21:33:49.213330] [INFO ] [MAIN ] Update Progress: 1945/2369 symbols completed. SN took 33.5s. Estimated remaining: 59m 41s. Rate: 7.1 symbols/min [2025-10-16T21:33:49.384169] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:33:49.425665] [DEBUG] [LOCAL ] SNDR: Loaded 41524 existing records from primary storage. [2025-10-16T21:33:49.425957] [INFO ] [MAIN ] SNDR: Loaded 41524 existing records. [2025-10-16T21:33:49.551090] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-16T21:33:49.551214] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-16T21:33:49.618016] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:33:49.618503] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-16T21:33:49.618581] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-16T21:33:49.618869] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-10-16T21:33:49.619012] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-16T21:33:50.002187] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:33:50.008027] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-16T21:33:50.342878] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-16T21:33:50.712979] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T21:33:51.142814] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-16T21:33:51.944530] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-16T21:33:51.950039] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T21:33:52.572523] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-16T21:33:52.729409] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T21:33:52.742785] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-16T21:33:53.430510] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-16T21:33:53.542840] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-16T21:33:54.342862] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-16T21:33:54.674054] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-16T21:33:54.677927] [INFO ] [REMOTE ] SNA: Full fetch complete (39093 records). [2025-10-16T21:33:54.678017] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-16T21:33:55.064591] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-16T21:33:55.064839] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-16T21:33:55.065687] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-16T21:33:55.065751] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-16T21:33:55.066754] [DEBUG] [LOCAL ] SNA: Trimmed 39093 records to 26111 (keeping 200 days of data) [2025-10-16T21:33:55.156219] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-16T21:33:55.229127] [DEBUG] [LOCAL ] SNA: Primary data saved (26111 records). [2025-10-16T21:33:55.229269] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-16T21:33:55.229351] [INFO ] [MAIN ] Update Progress: 1946/2369 symbols completed. SNA took 28.3s. Estimated remaining: 59m 32s. Rate: 7.1 symbols/min [2025-10-16T21:33:55.396244] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:33:55.435446] [DEBUG] [LOCAL ] SNN: Loaded 44365 existing records from primary storage. [2025-10-16T21:33:55.435836] [INFO ] [MAIN ] SNN: Loaded 44365 existing records. [2025-10-16T21:33:55.616729] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:33:55.617024] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-16T21:33:55.617108] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-16T21:33:55.617353] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-16T21:33:55.617410] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-16T21:33:55.875839] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T21:33:55.947877] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-10-16T21:33:55.978185] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:33:56.561520] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-16T21:33:56.742816] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-16T21:33:57.492944] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T21:33:57.542774] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-16T21:33:58.342839] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-10-16T21:33:59.010415] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-16T21:33:59.060954] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T21:33:59.142776] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-16T21:33:59.942840] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-16T21:34:00.074812] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T21:34:00.582937] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T21:34:00.742818] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-16T21:34:01.542862] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-16T21:34:02.218622] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-16T21:34:02.306036] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T21:34:02.342774] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-16T21:34:02.543960] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-16T21:34:03.142805] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-16T21:34:03.894473] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T21:34:03.942855] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-16T21:34:04.742810] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-16T21:34:05.488142] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-16T21:34:05.541480] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T21:34:05.549671] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-16T21:34:05.615179] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-16T21:34:05.623762] [INFO ] [REMOTE ] SNAP: Full fetch complete (77975 records). [2025-10-16T21:34:05.623920] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-16T21:34:06.072480] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-16T21:34:06.072607] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-16T21:34:06.074006] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-16T21:34:06.074074] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-16T21:34:06.075608] [DEBUG] [LOCAL ] SNAP: Trimmed 77975 records to 54186 (keeping 200 days of data) [2025-10-16T21:34:06.175386] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T21:34:06.372929] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-16T21:34:06.426725] [DEBUG] [LOCAL ] SNAP: Primary data saved (54186 records). [2025-10-16T21:34:06.426848] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-16T21:34:06.426933] [INFO ] [MAIN ] Update Progress: 1947/2369 symbols completed. SNAP took 32.0s. Estimated remaining: 59m 24s. Rate: 7.1 symbols/min [2025-10-16T21:34:06.597446] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:34:06.647104] [DEBUG] [LOCAL ] SNOW: Loaded 53594 existing records from primary storage. [2025-10-16T21:34:06.647383] [INFO ] [MAIN ] SNOW: Loaded 53594 existing records. [2025-10-16T21:34:06.823470] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:34:06.823615] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-16T21:34:06.823691] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-16T21:34:06.823888] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-10-16T21:34:06.823943] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-16T21:34:07.145435] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-16T21:34:07.173035] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:34:07.757724] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T21:34:07.942793] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-16T21:34:07.976787] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T21:34:08.742860] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-10-16T21:34:09.433023] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T21:34:09.542789] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-16T21:34:10.342826] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-16T21:34:10.977805] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-16T21:34:11.062877] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-16T21:34:11.091865] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T21:34:11.142774] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-16T21:34:11.725309] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T21:34:11.942821] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-16T21:34:12.742803] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-16T21:34:13.433091] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T21:34:13.542863] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-16T21:34:14.112823] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T21:34:14.114089] [INFO ] [REMOTE ] SNDA: Full fetch complete (7591 records). [2025-10-16T21:34:14.114252] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-16T21:34:14.351936] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-16T21:34:14.427580] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T21:34:14.513833] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-16T21:34:14.513908] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-16T21:34:14.514096] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-16T21:34:14.514134] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-16T21:34:14.514517] [DEBUG] [LOCAL ] SNDA: Trimmed 7591 records to 4504 (keeping 200 days of data) [2025-10-16T21:34:14.540443] [DEBUG] [LOCAL ] SNDA: Primary data saved (4504 records). [2025-10-16T21:34:14.540575] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-16T21:34:14.540675] [INFO ] [MAIN ] Update Progress: 1948/2369 symbols completed. SNDA took 33.7s. Estimated remaining: 59m 15s. Rate: 7.1 symbols/min [2025-10-16T21:34:14.713716] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:34:14.778102] [DEBUG] [LOCAL ] SNV: Loaded 49036 existing records from primary storage. [2025-10-16T21:34:14.778505] [INFO ] [MAIN ] SNV: Loaded 49036 existing records. [2025-10-16T21:34:14.959976] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:34:14.960413] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-16T21:34:14.960462] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-16T21:34:14.960690] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-10-16T21:34:14.960746] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-16T21:34:15.148041] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-16T21:34:15.346726] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:34:15.942802] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-10-16T21:34:16.742783] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-16T21:34:16.859559] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-16T21:34:16.896835] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T21:34:17.542811] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-16T21:34:17.591760] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T21:34:18.146219] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T21:34:18.342899] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-16T21:34:19.142847] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-16T21:34:19.224129] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T21:34:19.942806] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-16T21:34:20.635082] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-16T21:34:20.742802] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-16T21:34:20.848274] [DEBUG] [REMOTE ] SNOW: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-16T21:34:20.848724] [WARN ] [REMOTE ] SNOW: No data returned for month 2025-03 [2025-10-16T21:34:20.848815] [FATAL] [REMOTE ] SNOW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:34:20.848897] [FATAL] [MAIN ] SNOW: Failed to fetch primary data. [2025-10-16T21:34:20.848960] [WARN ] [MAIN ] SNOW: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:34:20.849049] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-16T21:34:20.849118] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-10-16T21:34:20.849154] [INFO ] [LOCAL ] SNOW: Starting deletion of derivative data. [2025-10-16T21:34:20.849308] [DEBUG] [LOCAL ] SNOW: Deleted derivative data file. [2025-10-16T21:34:20.849391] [INFO ] [MAIN ] Update Progress: 1949/2369 symbols completed. SNOW took 14.4s. Estimated remaining: 59m 6s. Rate: 7.1 symbols/min [2025-10-16T21:34:20.987348] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-16T21:34:21.055518] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:34:21.092197] [DEBUG] [LOCAL ] SNX: Loaded 39434 existing records from primary storage. [2025-10-16T21:34:21.092474] [INFO ] [MAIN ] SNX: Loaded 39434 existing records. [2025-10-16T21:34:21.271592] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:34:21.271807] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-16T21:34:21.271856] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-16T21:34:21.272039] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-10-16T21:34:21.272093] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-16T21:34:21.544974] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-16T21:34:21.635433] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:34:21.659491] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T21:34:22.342871] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-10-16T21:34:23.142854] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-16T21:34:23.279572] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T21:34:23.851675] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T21:34:23.942784] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-16T21:34:24.436138] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-16T21:34:24.442365] [INFO ] [REMOTE ] SNDR: Full fetch complete (60089 records). [2025-10-16T21:34:24.442472] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-16T21:34:24.747954] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-16T21:34:24.826309] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-16T21:34:24.826382] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-16T21:34:24.827348] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-16T21:34:24.827411] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-16T21:34:24.828635] [DEBUG] [LOCAL ] SNDR: Trimmed 60089 records to 41893 (keeping 200 days of data) [2025-10-16T21:34:25.098236] [DEBUG] [LOCAL ] SNDR: Primary data saved (41893 records). [2025-10-16T21:34:25.098386] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-16T21:34:25.099115] [INFO ] [MAIN ] Update Progress: 1950/2369 symbols completed. SNDR took 35.9s. Estimated remaining: 58m 57s. Rate: 7.1 symbols/min [2025-10-16T21:34:25.291961] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:34:25.342381] [DEBUG] [LOCAL ] SO: Loaded 53614 existing records from primary storage. [2025-10-16T21:34:25.342708] [INFO ] [MAIN ] SO: Loaded 53614 existing records. [2025-10-16T21:34:25.520631] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:34:25.520946] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-16T21:34:25.521083] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-16T21:34:25.521332] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-10-16T21:34:25.521511] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-16T21:34:25.553361] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-16T21:34:25.621481] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T21:34:25.910192] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:34:26.342839] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-10-16T21:34:26.527170] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T21:34:27.047155] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T21:34:27.142788] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-16T21:34:27.942795] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-16T21:34:28.264904] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T21:34:28.581050] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T21:34:28.742788] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-16T21:34:29.432614] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T21:34:29.542788] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-16T21:34:30.342800] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-16T21:34:30.393461] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T21:34:31.142793] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-16T21:34:31.270239] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T21:34:31.942978] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-16T21:34:32.165974] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T21:34:32.423706] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-16T21:34:32.742866] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-16T21:34:33.291809] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T21:34:33.542815] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-16T21:34:34.342818] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-16T21:34:34.391023] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T21:34:35.025146] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T21:34:35.142789] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-16T21:34:35.928467] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T21:34:35.942773] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-16T21:34:36.246261] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T21:34:36.742822] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-16T21:34:37.548843] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-16T21:34:37.562132] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T21:34:38.342796] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-16T21:34:38.399261] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T21:34:39.142842] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-16T21:34:39.377599] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-16T21:34:39.942852] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-16T21:34:40.144349] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T21:34:40.577159] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T21:34:40.582625] [INFO ] [REMOTE ] SNN: Full fetch complete (63129 records). [2025-10-16T21:34:40.582766] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-16T21:34:40.745726] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-16T21:34:40.986353] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-16T21:34:40.986470] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-16T21:34:40.987572] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-16T21:34:40.987638] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-16T21:34:40.989009] [DEBUG] [LOCAL ] SNN: Trimmed 63129 records to 44635 (keeping 200 days of data) [2025-10-16T21:34:41.249368] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-16T21:34:41.297470] [DEBUG] [LOCAL ] SNN: Primary data saved (44635 records). [2025-10-16T21:34:41.297617] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-16T21:34:41.298247] [INFO ] [MAIN ] Update Progress: 1951/2369 symbols completed. SNN took 46.1s. Estimated remaining: 58m 50s. Rate: 7.1 symbols/min [2025-10-16T21:34:41.468753] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:34:41.511541] [DEBUG] [LOCAL ] SOBO: Loaded 39401 existing records from primary storage. [2025-10-16T21:34:41.511869] [INFO ] [MAIN ] SOBO: Loaded 39401 existing records. [2025-10-16T21:34:41.547967] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-16T21:34:41.696767] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:34:41.697011] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-16T21:34:41.697061] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-16T21:34:41.697273] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-16T21:34:41.697331] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-16T21:34:42.061464] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:34:42.342791] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-16T21:34:42.571226] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T21:34:43.142787] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-10-16T21:34:43.517087] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-16T21:34:43.804619] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T21:34:43.942816] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-16T21:34:44.718616] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T21:34:44.742768] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-16T21:34:45.542806] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-16T21:34:45.828418] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-16T21:34:46.301221] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T21:34:46.342768] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-16T21:34:46.858473] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T21:34:47.142867] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-16T21:34:47.363220] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T21:34:47.942814] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-16T21:34:48.742821] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-16T21:34:49.146977] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-16T21:34:49.514918] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T21:34:49.542770] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-16T21:34:50.233285] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T21:34:50.240262] [INFO ] [REMOTE ] SNX: Full fetch complete (57371 records). [2025-10-16T21:34:50.240406] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-16T21:34:50.347949] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-16T21:34:50.633232] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-16T21:34:50.633306] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-16T21:34:50.634222] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-16T21:34:50.634283] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-16T21:34:50.635350] [DEBUG] [LOCAL ] SNX: Trimmed 57371 records to 39754 (keeping 200 days of data) [2025-10-16T21:34:50.873998] [DEBUG] [LOCAL ] SNX: Primary data saved (39754 records). [2025-10-16T21:34:50.874130] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-16T21:34:50.874207] [INFO ] [MAIN ] Update Progress: 1952/2369 symbols completed. SNX took 30.0s. Estimated remaining: 58m 42s. Rate: 7.1 symbols/min [2025-10-16T21:34:51.047298] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:34:51.096298] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T21:34:51.119731] [DEBUG] [LOCAL ] SOC: Loaded 50966 existing records from primary storage. [2025-10-16T21:34:51.120008] [INFO ] [MAIN ] SOC: Loaded 50966 existing records. [2025-10-16T21:34:51.150100] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-16T21:34:51.297730] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:34:51.297972] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-16T21:34:51.298032] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-16T21:34:51.298252] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-16T21:34:51.298315] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-16T21:34:51.659886] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:34:51.676905] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T21:34:51.683470] [INFO ] [REMOTE ] SNV: Full fetch complete (71708 records). [2025-10-16T21:34:51.683584] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-16T21:34:51.947936] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-10-16T21:34:52.076939] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-16T21:34:52.077023] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-16T21:34:52.078118] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-16T21:34:52.078185] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-16T21:34:52.079552] [DEBUG] [LOCAL ] SNV: Trimmed 71708 records to 49426 (keeping 200 days of data) [2025-10-16T21:34:52.373767] [DEBUG] [LOCAL ] SNV: Primary data saved (49426 records). [2025-10-16T21:34:52.373932] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-16T21:34:52.374748] [INFO ] [MAIN ] Update Progress: 1953/2369 symbols completed. SNV took 37.8s. Estimated remaining: 58m 32s. Rate: 7.1 symbols/min [2025-10-16T21:34:52.549131] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:34:52.575211] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T21:34:52.589638] [DEBUG] [LOCAL ] SOJC: Loaded 4812 existing records from primary storage. [2025-10-16T21:34:52.589914] [INFO ] [MAIN ] SOJC: Loaded 4812 existing records. [2025-10-16T21:34:52.759469] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-16T21:34:52.764111] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:34:52.765252] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-16T21:34:52.765304] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-16T21:34:52.765440] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-16T21:34:52.765479] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-16T21:34:53.109878] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:34:53.542821] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-16T21:34:53.606916] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T21:34:54.059902] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T21:34:54.342829] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-10-16T21:34:55.117186] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T21:34:55.142816] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-16T21:34:55.368070] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-16T21:34:55.521910] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-16T21:34:55.942822] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-16T21:34:56.512930] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T21:34:56.742886] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-16T21:34:57.542883] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-16T21:34:58.132144] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T21:34:58.342855] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-16T21:34:58.873819] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T21:34:59.142839] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-16T21:34:59.947492] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-16T21:34:59.954344] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T21:35:00.672345] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T21:35:00.717895] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T21:35:00.742766] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-16T21:35:01.542891] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-16T21:35:02.342844] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-16T21:35:02.523535] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T21:35:03.000589] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T21:35:03.142833] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-16T21:35:03.942829] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-16T21:35:04.139483] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T21:35:04.742882] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-16T21:35:04.932251] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T21:35:05.027302] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T21:35:05.184798] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-16T21:35:05.542846] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-16T21:35:06.342860] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-16T21:35:06.908342] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T21:35:06.913892] [INFO ] [REMOTE ] SOBO: Full fetch complete (58411 records). [2025-10-16T21:35:06.914009] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-16T21:35:07.149165] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-16T21:35:07.304543] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-16T21:35:07.304619] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-16T21:35:07.305628] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-16T21:35:07.305711] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-16T21:35:07.306814] [DEBUG] [LOCAL ] SOBO: Trimmed 58411 records to 39708 (keeping 200 days of data) [2025-10-16T21:35:07.543910] [DEBUG] [LOCAL ] SOBO: Primary data saved (39708 records). [2025-10-16T21:35:07.544053] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-16T21:35:07.544574] [INFO ] [MAIN ] Update Progress: 1954/2369 symbols completed. SOBO took 26.2s. Estimated remaining: 58m 25s. Rate: 7.1 symbols/min [2025-10-16T21:35:07.717195] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:35:07.732855] [DEBUG] [LOCAL ] SOJD: Loaded 12977 existing records from primary storage. [2025-10-16T21:35:07.733091] [INFO ] [MAIN ] SOJD: Loaded 12977 existing records. [2025-10-16T21:35:07.908188] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:35:07.908467] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-16T21:35:07.908523] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-16T21:35:07.908709] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-16T21:35:07.908777] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-16T21:35:07.963288] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-16T21:35:08.268529] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:35:08.298965] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-16T21:35:08.646317] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-16T21:35:08.742836] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-16T21:35:09.094392] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-16T21:35:09.373241] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T21:35:09.542820] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-16T21:35:10.138894] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T21:35:10.342826] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-10-16T21:35:11.142863] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-16T21:35:11.511965] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T21:35:11.942826] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-16T21:35:12.737283] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-16T21:35:12.742770] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-16T21:35:12.966042] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T21:35:13.542827] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-16T21:35:13.741690] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T21:35:14.342823] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-16T21:35:15.142799] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-16T21:35:15.331509] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T21:35:15.338519] [INFO ] [REMOTE ] SO: Full fetch complete (77771 records). [2025-10-16T21:35:15.338707] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-16T21:35:15.735605] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-16T21:35:15.735792] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-16T21:35:15.735953] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-16T21:35:15.737154] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-16T21:35:15.738980] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-16T21:35:15.740374] [DEBUG] [LOCAL ] SO: Trimmed 77771 records to 54004 (keeping 200 days of data) [2025-10-16T21:35:15.954563] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-16T21:35:16.079096] [DEBUG] [LOCAL ] SO: Primary data saved (54004 records). [2025-10-16T21:35:16.079252] [INFO ] [MAIN ] SO: Full history saved. [2025-10-16T21:35:16.079981] [INFO ] [MAIN ] Update Progress: 1955/2369 symbols completed. SO took 51.0s. Estimated remaining: 58m 17s. Rate: 7.1 symbols/min [2025-10-16T21:35:16.284884] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:35:16.324225] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T21:35:16.341613] [DEBUG] [LOCAL ] SOJE: Loaded 8875 existing records from primary storage. [2025-10-16T21:35:16.342251] [INFO ] [MAIN ] SOJE: Loaded 8875 existing records. [2025-10-16T21:35:16.459549] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-16T21:35:16.536693] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:35:16.536972] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-16T21:35:16.537021] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-16T21:35:16.537208] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-16T21:35:16.537264] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-16T21:35:16.750174] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-16T21:35:16.915703] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:35:17.542897] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-10-16T21:35:18.342801] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-16T21:35:18.547090] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T21:35:18.635147] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T21:35:18.938075] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T21:35:19.142803] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-16T21:35:19.942787] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-16T21:35:20.085242] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T21:35:20.742836] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-16T21:35:21.238111] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-16T21:35:21.239603] [INFO ] [REMOTE ] SOJC: Full fetch complete (7420 records). [2025-10-16T21:35:21.239717] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-16T21:35:21.547950] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-16T21:35:21.657134] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-16T21:35:21.657226] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-16T21:35:21.657549] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-16T21:35:21.657628] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-16T21:35:21.658116] [DEBUG] [LOCAL ] SOJC: Trimmed 7420 records to 4835 (keeping 200 days of data) [2025-10-16T21:35:21.692823] [DEBUG] [LOCAL ] SOJC: Primary data saved (4835 records). [2025-10-16T21:35:21.692964] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-16T21:35:21.693049] [INFO ] [MAIN ] Update Progress: 1956/2369 symbols completed. SOJC took 29.3s. Estimated remaining: 58m 8s. Rate: 7.1 symbols/min [2025-10-16T21:35:21.871519] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:35:21.871745] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-16T21:35:21.871813] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-16T21:35:21.871949] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-16T21:35:21.872063] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-16T21:35:21.872172] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-16T21:35:21.872218] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-16T21:35:22.154865] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-16T21:35:22.235805] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T21:35:22.317012] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:35:22.342777] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-10-16T21:35:22.543876] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:35:22.544187] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-10-16T21:35:22.544278] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:35:22.544351] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-10-16T21:35:22.544418] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:35:22.544488] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-16T21:35:22.544552] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-16T21:35:22.544590] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-16T21:35:22.544631] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-16T21:35:22.544722] [INFO ] [MAIN ] Update Progress: 1957/2369 symbols completed. SOJF took 0.9s. Estimated remaining: 57m 58s. Rate: 7.1 symbols/min [2025-10-16T21:35:23.142824] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-16T21:35:23.942835] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-16T21:35:24.043130] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T21:35:24.445683] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-16T21:35:24.742832] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-16T21:35:25.542816] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-16T21:35:25.612801] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T21:35:26.342816] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-16T21:35:26.414067] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-16T21:35:27.142813] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-16T21:35:27.942787] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-16T21:35:28.085322] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T21:35:28.126340] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-16T21:35:28.133532] [INFO ] [REMOTE ] SOC: Full fetch complete (72081 records). [2025-10-16T21:35:28.133709] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-16T21:35:28.532218] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-16T21:35:28.532301] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-16T21:35:28.533357] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-16T21:35:28.533419] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-16T21:35:28.534778] [DEBUG] [LOCAL ] SOC: Trimmed 72081 records to 51356 (keeping 200 days of data) [2025-10-16T21:35:28.744192] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-16T21:35:28.821281] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-16T21:35:28.843091] [DEBUG] [LOCAL ] SOC: Primary data saved (51356 records). [2025-10-16T21:35:28.843248] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-16T21:35:28.843336] [INFO ] [MAIN ] Update Progress: 1958/2369 symbols completed. SOC took 38.0s. Estimated remaining: 57m 49s. Rate: 7.1 symbols/min [2025-10-16T21:35:29.542823] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-16T21:35:29.586449] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T21:35:30.319846] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T21:35:30.342797] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-16T21:35:31.067074] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T21:35:31.142863] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-16T21:35:31.812946] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-16T21:35:31.942791] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-16T21:35:32.742867] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-16T21:35:32.781321] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T21:35:33.475203] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T21:35:33.542886] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-16T21:35:34.347181] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-16T21:35:34.349032] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T21:35:34.351516] [INFO ] [REMOTE ] SOJD: Full fetch complete (19263 records). [2025-10-16T21:35:34.351629] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-16T21:35:34.732767] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-16T21:35:34.732849] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-16T21:35:34.733299] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-16T21:35:34.733389] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-16T21:35:34.734089] [DEBUG] [LOCAL ] SOJD: Trimmed 19263 records to 13066 (keeping 200 days of data) [2025-10-16T21:35:34.816101] [DEBUG] [LOCAL ] SOJD: Primary data saved (13066 records). [2025-10-16T21:35:34.816245] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-16T21:35:34.816333] [INFO ] [MAIN ] Update Progress: 1959/2369 symbols completed. SOJD took 27.3s. Estimated remaining: 57m 40s. Rate: 7.1 symbols/min [2025-10-16T21:35:35.140478] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-16T21:35:35.143007] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-16T21:35:35.754331] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-16T21:35:35.755828] [INFO ] [REMOTE ] SOJE: Full fetch complete (13686 records). [2025-10-16T21:35:35.755903] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-16T21:35:36.113218] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-16T21:35:36.113300] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-16T21:35:36.113636] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-16T21:35:36.113716] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-16T21:35:36.114222] [DEBUG] [LOCAL ] SOJE: Trimmed 13686 records to 8935 (keeping 200 days of data) [2025-10-16T21:35:36.167572] [DEBUG] [LOCAL ] SOJE: Primary data saved (8935 records). [2025-10-16T21:35:36.167722] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-16T21:35:36.167820] [INFO ] [MAIN ] Update Progress: 1960/2369 symbols completed. SOJE took 20.1s. Estimated remaining: 57m 30s. Rate: 7.1 symbols/min [2025-10-16T21:35:36.823761] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:35:36.809705] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:35:36.862990] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:35:36.882139] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:35:36.911702] [DEBUG] [LOCAL ] SOL: Loaded 13195 existing records from primary storage. [2025-10-16T21:35:36.912080] [INFO ] [MAIN ] SOL: Loaded 13195 existing records. [2025-10-16T21:35:37.050505] [DEBUG] [LOCAL ] SOLV: Loaded 43745 existing records from primary storage. [2025-10-16T21:35:37.102348] [INFO ] [MAIN ] SOLV: Loaded 43745 existing records. [2025-10-16T21:35:37.123979] [DEBUG] [LOCAL ] SON: Loaded 43365 existing records from primary storage. [2025-10-16T21:35:37.157907] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:35:37.178952] [INFO ] [MAIN ] SON: Loaded 43365 existing records. [2025-10-16T21:35:37.199533] [DEBUG] [LOCAL ] SONY: Loaded 53380 existing records from primary storage. [2025-10-16T21:35:37.222745] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-16T21:35:37.228276] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-16T21:35:37.228177] [INFO ] [MAIN ] SONY: Loaded 53380 existing records. [2025-10-16T21:35:37.309589] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-16T21:35:37.393220] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-16T21:35:37.715775] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:35:37.809752] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:35:37.829156] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-16T21:35:37.849217] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:35:37.835876] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-16T21:35:37.859794] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-16T21:35:37.859899] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-16T21:35:37.872807] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-16T21:35:37.872954] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-16T21:35:37.891734] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-10-16T21:35:37.891842] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-16T21:35:37.891931] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-16T21:35:37.891879] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-10-16T21:35:37.930072] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-16T21:35:37.929998] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-16T21:35:38.735249] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:35:38.840507] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-10-16T21:35:39.062537] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:35:39.086826] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-10-16T21:35:39.197505] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:35:39.207344] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-10-16T21:35:39.227218] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:35:39.227511] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-10-16T21:35:40.091567] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-16T21:35:40.096384] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-16T21:35:40.469975] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T21:35:40.478991] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-16T21:35:40.610862] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T21:35:40.742856] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-16T21:35:40.832588] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T21:35:41.387878] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-16T21:35:41.542766] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-16T21:35:41.940192] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T21:35:42.036444] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T21:35:42.342875] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-16T21:35:43.142876] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-16T21:35:43.437244] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-16T21:35:43.777414] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T21:35:43.942820] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-16T21:35:44.303142] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T21:35:44.742839] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-16T21:35:44.796067] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-16T21:35:45.542861] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-16T21:35:46.342800] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-16T21:35:46.374441] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T21:35:46.607818] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-16T21:35:47.142822] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-16T21:35:47.942791] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-16T21:35:48.285162] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-16T21:35:48.729261] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T21:35:48.742780] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-16T21:35:48.841827] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T21:35:49.542791] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-16T21:35:50.183402] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T21:35:50.342829] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-16T21:35:50.363042] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T21:35:51.142855] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-16T21:35:51.942789] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-16T21:35:52.000195] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T21:35:52.249304] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T21:35:52.742823] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-16T21:35:53.357758] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T21:35:53.376477] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-16T21:35:53.542826] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-16T21:35:54.342813] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-16T21:35:55.003574] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T21:35:55.142800] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-16T21:35:55.929008] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T21:35:55.942776] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-16T21:35:56.018409] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T21:35:56.742835] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-16T21:35:57.542823] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-16T21:35:57.892291] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T21:35:57.969677] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-16T21:35:58.342795] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-16T21:35:58.392681] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-16T21:35:59.142837] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-16T21:35:59.942820] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-16T21:36:00.382766] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-16T21:36:00.421337] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T21:36:00.742834] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-16T21:36:00.932123] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T21:36:00.934890] [INFO ] [REMOTE ] SOL: Full fetch complete (21195 records). [2025-10-16T21:36:00.934989] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-16T21:36:01.332402] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-16T21:36:01.332480] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-16T21:36:01.332974] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-16T21:36:01.333036] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-16T21:36:01.333630] [DEBUG] [LOCAL ] SOL: Trimmed 21195 records to 13297 (keeping 200 days of data) [2025-10-16T21:36:01.408497] [DEBUG] [LOCAL ] SOL: Primary data saved (13297 records). [2025-10-16T21:36:01.408627] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-16T21:36:01.408807] [INFO ] [MAIN ] Update Progress: 1961/2369 symbols completed. SOL took 25.2s. Estimated remaining: 57m 25s. Rate: 7.1 symbols/min [2025-10-16T21:36:01.558454] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-16T21:36:01.593465] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:36:01.599043] [DEBUG] [LOCAL ] SOR: Loaded 2893 existing records from primary storage. [2025-10-16T21:36:01.599280] [INFO ] [MAIN ] SOR: Loaded 2893 existing records. [2025-10-16T21:36:01.787697] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:36:01.787947] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-16T21:36:01.787997] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-16T21:36:01.788143] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-16T21:36:01.788241] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-16T21:36:02.156884] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:36:02.342803] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-16T21:36:02.441513] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T21:36:03.142867] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-16T21:36:03.424624] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T21:36:03.949629] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-16T21:36:03.967007] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T21:36:04.270155] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T21:36:04.742859] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-16T21:36:05.313476] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T21:36:05.425259] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T21:36:05.542788] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-16T21:36:06.342803] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-10-16T21:36:06.861906] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-16T21:36:07.016273] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T21:36:07.021841] [INFO ] [REMOTE ] SOLV: Full fetch complete (63562 records). [2025-10-16T21:36:07.021967] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-16T21:36:07.147903] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-16T21:36:07.416566] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-16T21:36:07.416713] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-16T21:36:07.417720] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-16T21:36:07.417783] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-16T21:36:07.419067] [DEBUG] [LOCAL ] SOLV: Trimmed 63562 records to 44087 (keeping 200 days of data) [2025-10-16T21:36:07.672359] [DEBUG] [LOCAL ] SOLV: Primary data saved (44087 records). [2025-10-16T21:36:07.672453] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-16T21:36:07.672534] [INFO ] [MAIN ] Update Progress: 1962/2369 symbols completed. SOLV took 31.5s. Estimated remaining: 57m 16s. Rate: 7.1 symbols/min [2025-10-16T21:36:07.845016] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:36:07.855958] [DEBUG] [LOCAL ] SOS: Loaded 9468 existing records from primary storage. [2025-10-16T21:36:07.856171] [INFO ] [MAIN ] SOS: Loaded 9468 existing records. [2025-10-16T21:36:07.950948] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-16T21:36:08.031225] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:36:08.031433] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-16T21:36:08.031480] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-16T21:36:08.031672] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-16T21:36:08.031730] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-16T21:36:08.382076] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:36:08.613671] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-16T21:36:08.742882] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-10-16T21:36:09.274737] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-16T21:36:09.542891] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-16T21:36:09.890073] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T21:36:10.342840] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-16T21:36:11.142823] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-16T21:36:11.217282] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T21:36:11.614225] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-16T21:36:11.942803] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-16T21:36:12.338511] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-16T21:36:12.742834] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-16T21:36:13.542786] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-16T21:36:13.612922] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T21:36:13.618985] [INFO ] [REMOTE ] SON: Full fetch complete (62772 records). [2025-10-16T21:36:13.619082] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-16T21:36:13.999234] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-16T21:36:13.999321] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-16T21:36:14.000448] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-16T21:36:14.000524] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-16T21:36:14.001844] [DEBUG] [LOCAL ] SON: Trimmed 62772 records to 43716 (keeping 200 days of data) [2025-10-16T21:36:14.102023] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T21:36:14.270204] [DEBUG] [LOCAL ] SON: Primary data saved (43716 records). [2025-10-16T21:36:14.270354] [INFO ] [MAIN ] SON: Full history saved. [2025-10-16T21:36:14.270437] [INFO ] [MAIN ] Update Progress: 1963/2369 symbols completed. SON took 38.1s. Estimated remaining: 57m 7s. Rate: 7.1 symbols/min [2025-10-16T21:36:14.347508] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-16T21:36:14.455281] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:36:14.486995] [DEBUG] [LOCAL ] SPB: Loaded 34181 existing records from primary storage. [2025-10-16T21:36:14.487299] [INFO ] [MAIN ] SPB: Loaded 34181 existing records. [2025-10-16T21:36:14.692957] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:36:14.693253] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-16T21:36:14.693321] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-16T21:36:14.693606] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-16T21:36:14.693737] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-16T21:36:14.937129] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-16T21:36:15.097709] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:36:15.102307] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T21:36:15.142790] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-10-16T21:36:15.942807] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-16T21:36:16.471493] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T21:36:16.524579] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-16T21:36:16.742791] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-16T21:36:17.231816] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-16T21:36:17.542809] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-16T21:36:18.342863] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-16T21:36:19.142833] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-16T21:36:19.395247] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-16T21:36:19.406516] [INFO ] [REMOTE ] SONY: Full fetch complete (77397 records). [2025-10-16T21:36:19.406751] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-16T21:36:19.755133] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T21:36:19.819672] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T21:36:19.889033] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-16T21:36:19.889124] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-16T21:36:19.890401] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-16T21:36:19.890470] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-16T21:36:19.892054] [DEBUG] [LOCAL ] SONY: Trimmed 77397 records to 53769 (keeping 200 days of data) [2025-10-16T21:36:19.946026] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-16T21:36:20.238533] [DEBUG] [LOCAL ] SONY: Primary data saved (53769 records). [2025-10-16T21:36:20.238699] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-16T21:36:20.239658] [INFO ] [MAIN ] Update Progress: 1964/2369 symbols completed. SONY took 44.1s. Estimated remaining: 56m 58s. Rate: 7.1 symbols/min [2025-10-16T21:36:20.439868] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:36:20.489345] [DEBUG] [LOCAL ] SPCE: Loaded 49975 existing records from primary storage. [2025-10-16T21:36:20.489797] [INFO ] [MAIN ] SPCE: Loaded 49975 existing records. [2025-10-16T21:36:20.590122] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T21:36:20.669131] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:36:20.669349] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-16T21:36:20.669398] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-16T21:36:20.669592] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-16T21:36:20.669701] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-16T21:36:20.748005] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-16T21:36:21.022704] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:36:21.270287] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-16T21:36:21.542821] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-10-16T21:36:22.342815] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-16T21:36:23.142910] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-16T21:36:23.681399] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-16T21:36:23.721289] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-16T21:36:23.723020] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-16T21:36:23.942814] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-16T21:36:24.742820] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-16T21:36:25.300723] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-16T21:36:25.542815] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-16T21:36:26.342787] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-16T21:36:26.470035] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T21:36:26.818863] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-16T21:36:27.000489] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T21:36:27.142837] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-16T21:36:27.942817] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-16T21:36:28.566376] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T21:36:28.742787] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-16T21:36:29.134105] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-16T21:36:29.284501] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-16T21:36:29.542818] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-16T21:36:30.342784] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-16T21:36:30.721136] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-16T21:36:30.813516] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-16T21:36:31.142818] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-16T21:36:31.627469] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-16T21:36:31.942806] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-16T21:36:32.405818] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-16T21:36:32.406732] [INFO ] [REMOTE ] SOR: Full fetch complete (4406 records). [2025-10-16T21:36:32.406823] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-16T21:36:32.749684] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-16T21:36:32.750084] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-16T21:36:32.750159] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-16T21:36:32.750915] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-16T21:36:32.750979] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-16T21:36:32.751350] [DEBUG] [LOCAL ] SOR: Trimmed 4406 records to 2902 (keeping 200 days of data) [2025-10-16T21:36:32.769446] [DEBUG] [LOCAL ] SOR: Primary data saved (2902 records). [2025-10-16T21:36:32.769565] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-16T21:36:32.769666] [INFO ] [MAIN ] Update Progress: 1965/2369 symbols completed. SOR took 31.4s. Estimated remaining: 56m 51s. Rate: 7.1 symbols/min [2025-10-16T21:36:32.944731] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:36:32.954561] [DEBUG] [LOCAL ] SPE: Loaded 6264 existing records from primary storage. [2025-10-16T21:36:32.954828] [INFO ] [MAIN ] SPE: Loaded 6264 existing records. [2025-10-16T21:36:33.136895] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:36:33.137111] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-16T21:36:33.137160] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-16T21:36:33.137311] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-16T21:36:33.137370] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-16T21:36:33.487839] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:36:33.542799] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-10-16T21:36:34.342816] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-16T21:36:34.364258] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-16T21:36:34.784960] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-16T21:36:35.062428] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-16T21:36:35.142803] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-16T21:36:35.947054] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-16T21:36:35.947928] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-16T21:36:36.742873] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-16T21:36:37.542800] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-16T21:36:37.943264] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T21:36:37.969079] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T21:36:38.302227] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T21:36:38.342774] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-16T21:36:39.002075] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-16T21:36:39.142812] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-16T21:36:39.942807] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-16T21:36:40.734217] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T21:36:40.742762] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-16T21:36:40.991127] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-16T21:36:41.195407] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-16T21:36:41.542808] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-16T21:36:42.250126] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T21:36:42.342828] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-16T21:36:43.044199] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-16T21:36:43.142852] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-16T21:36:43.942849] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-16T21:36:44.742841] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-16T21:36:44.921509] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T21:36:44.923729] [INFO ] [REMOTE ] SOS: Full fetch complete (11243 records). [2025-10-16T21:36:44.923813] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-16T21:36:45.286904] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-16T21:36:45.287106] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-16T21:36:45.287392] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-16T21:36:45.287461] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-16T21:36:45.312985] [DEBUG] [LOCAL ] SOS: Trimmed 11243 records to 9535 (keeping 200 days of data) [2025-10-16T21:36:45.314881] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-16T21:36:45.377095] [DEBUG] [LOCAL ] SOS: Primary data saved (9535 records). [2025-10-16T21:36:45.377230] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-16T21:36:45.377312] [INFO ] [MAIN ] Update Progress: 1966/2369 symbols completed. SOS took 37.7s. Estimated remaining: 56m 43s. Rate: 7.1 symbols/min [2025-10-16T21:36:45.541186] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:36:45.542890] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-16T21:36:45.588699] [DEBUG] [LOCAL ] SPG: Loaded 50225 existing records from primary storage. [2025-10-16T21:36:45.588998] [INFO ] [MAIN ] SPG: Loaded 50225 existing records. [2025-10-16T21:36:45.762794] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:36:45.762980] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-16T21:36:45.763026] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-16T21:36:45.763209] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-10-16T21:36:45.763265] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-16T21:36:46.121768] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:36:46.238112] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T21:36:46.342768] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-16T21:36:47.142860] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-10-16T21:36:47.666227] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-16T21:36:47.716092] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T21:36:47.942806] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-16T21:36:48.742812] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-16T21:36:48.945940] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-16T21:36:49.355125] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T21:36:49.542844] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-16T21:36:50.342878] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-16T21:36:50.790732] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-16T21:36:51.053359] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T21:36:51.082828] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T21:36:51.142804] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-16T21:36:51.942886] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-16T21:36:52.545928] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T21:36:52.670342] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T21:36:52.742826] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-16T21:36:53.542873] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-16T21:36:54.342913] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-16T21:36:54.396130] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T21:36:54.685516] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T21:36:54.689665] [INFO ] [REMOTE ] SPB: Full fetch complete (47703 records). [2025-10-16T21:36:54.689795] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-16T21:36:55.058449] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-16T21:36:55.058532] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-16T21:36:55.059421] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-16T21:36:55.059483] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-16T21:36:55.060480] [DEBUG] [LOCAL ] SPB: Trimmed 47703 records to 34352 (keeping 200 days of data) [2025-10-16T21:36:55.146843] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-16T21:36:55.267873] [DEBUG] [LOCAL ] SPB: Primary data saved (34352 records). [2025-10-16T21:36:55.268014] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-16T21:36:55.268555] [INFO ] [MAIN ] Update Progress: 1967/2369 symbols completed. SPB took 41.0s. Estimated remaining: 56m 35s. Rate: 7.1 symbols/min [2025-10-16T21:36:55.437381] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:36:55.481285] [DEBUG] [LOCAL ] SPGI: Loaded 45865 existing records from primary storage. [2025-10-16T21:36:55.481578] [INFO ] [MAIN ] SPGI: Loaded 45865 existing records. [2025-10-16T21:36:55.659481] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:36:55.659717] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-16T21:36:55.659774] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-16T21:36:55.660249] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-10-16T21:36:55.660306] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-16T21:36:55.773371] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-16T21:36:55.785986] [INFO ] [REMOTE ] SPE: Full fetch complete (9863 records). [2025-10-16T21:36:55.796339] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-16T21:36:55.943927] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-16T21:36:56.347514] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:36:56.434398] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-16T21:36:56.434556] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-16T21:36:56.434969] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-16T21:36:56.435068] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-16T21:36:56.436045] [DEBUG] [LOCAL ] SPE: Trimmed 9863 records to 6288 (keeping 200 days of data) [2025-10-16T21:36:56.501168] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-16T21:36:56.519416] [DEBUG] [LOCAL ] SPE: Primary data saved (6288 records). [2025-10-16T21:36:56.519533] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-16T21:36:56.519610] [INFO ] [MAIN ] Update Progress: 1968/2369 symbols completed. SPE took 23.7s. Estimated remaining: 56m 25s. Rate: 7.1 symbols/min [2025-10-16T21:36:56.683792] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:36:56.702511] [DEBUG] [LOCAL ] SPH: Loaded 16693 existing records from primary storage. [2025-10-16T21:36:56.702805] [INFO ] [MAIN ] SPH: Loaded 16693 existing records. [2025-10-16T21:36:56.748060] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-10-16T21:36:56.880760] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:36:56.881035] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-16T21:36:56.881085] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-16T21:36:56.881275] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-16T21:36:56.881313] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-16T21:36:57.229213] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:36:57.542844] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-16T21:36:57.686180] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T21:36:58.342800] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-10-16T21:36:58.484193] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T21:36:58.995256] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-16T21:36:59.142820] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-16T21:36:59.652043] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-16T21:36:59.658867] [INFO ] [REMOTE ] SPCE: Full fetch complete (72620 records). [2025-10-16T21:36:59.658993] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-16T21:36:59.946566] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-16T21:37:00.053197] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-16T21:37:00.053281] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-16T21:37:00.054492] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-16T21:37:00.054558] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-16T21:37:00.056027] [DEBUG] [LOCAL ] SPCE: Trimmed 72620 records to 50365 (keeping 200 days of data) [2025-10-16T21:37:00.355390] [DEBUG] [LOCAL ] SPCE: Primary data saved (50365 records). [2025-10-16T21:37:00.355307] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T21:37:00.360590] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-16T21:37:00.361812] [INFO ] [MAIN ] Update Progress: 1969/2369 symbols completed. SPCE took 40.1s. Estimated remaining: 56m 16s. Rate: 7.1 symbols/min [2025-10-16T21:37:00.531121] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:37:00.570426] [DEBUG] [LOCAL ] SPHR: Loaded 40567 existing records from primary storage. [2025-10-16T21:37:00.570723] [INFO ] [MAIN ] SPHR: Loaded 40567 existing records. [2025-10-16T21:37:00.748012] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-16T21:37:00.751936] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:37:00.752906] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-16T21:37:00.752986] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-16T21:37:00.753227] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-16T21:37:00.753269] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-16T21:37:01.106927] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:37:01.542888] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-10-16T21:37:02.105857] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-16T21:37:02.342798] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-16T21:37:02.694090] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T21:37:02.965131] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T21:37:03.142816] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-16T21:37:03.497061] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T21:37:03.942829] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-16T21:37:04.560167] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T21:37:04.742884] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-16T21:37:05.542843] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-16T21:37:05.868356] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-16T21:37:06.029925] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T21:37:06.342800] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-16T21:37:06.783992] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T21:37:07.142824] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-16T21:37:07.942782] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-16T21:37:08.086086] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T21:37:08.123962] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T21:37:08.742801] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-16T21:37:09.542901] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-16T21:37:09.605673] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T21:37:10.342800] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-16T21:37:10.396963] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T21:37:11.142798] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-16T21:37:11.303253] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T21:37:11.942817] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-16T21:37:12.215416] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T21:37:12.742797] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-16T21:37:12.825215] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T21:37:13.542901] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-16T21:37:13.681138] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T21:37:14.342885] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-16T21:37:14.763902] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-16T21:37:14.795146] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-16T21:37:15.142807] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-16T21:37:15.948396] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-16T21:37:15.954536] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T21:37:16.215267] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T21:37:16.742859] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-16T21:37:17.269634] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T21:37:17.542869] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-16T21:37:17.710856] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T21:37:18.342826] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-16T21:37:19.142823] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-16T21:37:19.299783] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T21:37:19.674633] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T21:37:19.942797] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-16T21:37:20.243332] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-16T21:37:20.742868] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-16T21:37:21.542783] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-16T21:37:21.661002] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T21:37:21.681049] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T21:37:21.687730] [INFO ] [REMOTE ] SPG: Full fetch complete (72195 records). [2025-10-16T21:37:21.687868] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-16T21:37:22.078975] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-16T21:37:22.079052] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-16T21:37:22.080168] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-16T21:37:22.080232] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-16T21:37:22.081557] [DEBUG] [LOCAL ] SPG: Trimmed 72195 records to 50579 (keeping 200 days of data) [2025-10-16T21:37:22.357275] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-16T21:37:22.398037] [DEBUG] [LOCAL ] SPG: Primary data saved (50579 records). [2025-10-16T21:37:22.398180] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-16T21:37:22.398331] [INFO ] [MAIN ] Update Progress: 1970/2369 symbols completed. SPG took 37.0s. Estimated remaining: 56m 10s. Rate: 7.1 symbols/min [2025-10-16T21:37:22.577054] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:37:22.612411] [DEBUG] [LOCAL ] SPIR: Loaded 37593 existing records from primary storage. [2025-10-16T21:37:22.612752] [INFO ] [MAIN ] SPIR: Loaded 37593 existing records. [2025-10-16T21:37:22.787797] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:37:22.788106] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-16T21:37:22.788193] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-16T21:37:22.788819] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-16T21:37:22.788901] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-16T21:37:23.080352] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T21:37:23.083356] [INFO ] [REMOTE ] SPH: Full fetch complete (27854 records). [2025-10-16T21:37:23.104124] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-16T21:37:23.154628] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-16T21:37:23.187453] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T21:37:23.274880] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:37:23.564797] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-16T21:37:23.564879] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-16T21:37:23.565443] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-16T21:37:23.565508] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-16T21:37:23.566235] [DEBUG] [LOCAL ] SPH: Trimmed 27854 records to 16775 (keeping 200 days of data) [2025-10-16T21:37:23.672286] [DEBUG] [LOCAL ] SPH: Primary data saved (16775 records). [2025-10-16T21:37:23.672479] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-16T21:37:23.672608] [INFO ] [MAIN ] Update Progress: 1971/2369 symbols completed. SPH took 27.2s. Estimated remaining: 56m 0s. Rate: 7.1 symbols/min [2025-10-16T21:37:23.843266] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:37:23.851365] [DEBUG] [LOCAL ] SPMC: Loaded 5228 existing records from primary storage. [2025-10-16T21:37:23.851594] [INFO ] [MAIN ] SPMC: Loaded 5228 existing records. [2025-10-16T21:37:23.948812] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-10-16T21:37:24.059252] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:37:24.059498] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-16T21:37:24.059558] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-16T21:37:24.059716] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-16T21:37:24.059773] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-16T21:37:24.411168] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:37:24.742802] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-16T21:37:24.993220] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-16T21:37:25.209292] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T21:37:25.542813] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-16T21:37:26.022101] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-16T21:37:26.342814] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-16T21:37:26.504618] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T21:37:27.142858] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-16T21:37:27.942855] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-10-16T21:37:28.071531] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T21:37:28.377431] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-16T21:37:28.681949] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T21:37:28.742848] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-16T21:37:29.542812] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-16T21:37:30.127585] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T21:37:30.342836] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-16T21:37:30.477092] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T21:37:31.142828] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-16T21:37:31.942816] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-16T21:37:32.028391] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T21:37:32.034568] [INFO ] [REMOTE ] SPHR: Full fetch complete (58699 records). [2025-10-16T21:37:32.034699] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-16T21:37:32.431259] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-16T21:37:32.431387] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-16T21:37:32.432370] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-16T21:37:32.432432] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-16T21:37:32.433606] [DEBUG] [LOCAL ] SPHR: Trimmed 58699 records to 40893 (keeping 200 days of data) [2025-10-16T21:37:32.665212] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-16T21:37:32.678073] [DEBUG] [LOCAL ] SPHR: Primary data saved (40893 records). [2025-10-16T21:37:32.678172] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-16T21:37:32.678837] [INFO ] [MAIN ] Update Progress: 1972/2369 symbols completed. SPHR took 32.3s. Estimated remaining: 55m 52s. Rate: 7.1 symbols/min [2025-10-16T21:37:32.752420] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-16T21:37:32.855953] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:37:32.856171] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-16T21:37:32.856323] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-16T21:37:32.856493] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-16T21:37:32.856597] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-16T21:37:32.856746] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-16T21:37:32.856809] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-16T21:37:33.195827] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-16T21:37:33.292741] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:37:33.542796] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-10-16T21:37:33.588945] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T21:37:33.743941] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:37:33.744232] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-10-16T21:37:33.744325] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:37:33.744371] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-16T21:37:33.744428] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:37:33.744497] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-16T21:37:33.744558] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-16T21:37:33.744594] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-16T21:37:33.744633] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-16T21:37:33.744734] [INFO ] [MAIN ] Update Progress: 1973/2369 symbols completed. SPME took 1.1s. Estimated remaining: 55m 42s. Rate: 7.1 symbols/min [2025-10-16T21:37:33.917760] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:37:33.954769] [DEBUG] [LOCAL ] SPNT: Loaded 34702 existing records from primary storage. [2025-10-16T21:37:33.955036] [INFO ] [MAIN ] SPNT: Loaded 34702 existing records. [2025-10-16T21:37:34.159511] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:37:34.159779] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-16T21:37:34.159841] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-16T21:37:34.160073] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-10-16T21:37:34.160129] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-16T21:37:34.347975] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-16T21:37:34.510995] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:37:35.142840] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-16T21:37:35.847395] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-16T21:37:35.942786] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-16T21:37:36.059260] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T21:37:36.742848] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-16T21:37:37.360147] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T21:37:37.530915] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T21:37:37.542771] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-16T21:37:38.342797] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-16T21:37:39.115432] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-16T21:37:39.142623] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-16T21:37:39.142866] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-16T21:37:39.759231] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T21:37:39.942854] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-16T21:37:40.742821] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-16T21:37:41.316765] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-16T21:37:41.542809] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-10-16T21:37:41.603263] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T21:37:42.342829] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-16T21:37:42.875754] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T21:37:43.049567] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-16T21:37:43.056115] [INFO ] [REMOTE ] SPGI: Full fetch complete (67574 records). [2025-10-16T21:37:43.056240] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-16T21:37:43.148052] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-16T21:37:43.459177] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-16T21:37:43.459253] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-16T21:37:43.460294] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-16T21:37:43.460356] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-16T21:37:43.461615] [DEBUG] [LOCAL ] SPGI: Trimmed 67574 records to 46239 (keeping 200 days of data) [2025-10-16T21:37:43.746076] [DEBUG] [LOCAL ] SPGI: Primary data saved (46239 records). [2025-10-16T21:37:43.746202] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-16T21:37:43.746835] [INFO ] [MAIN ] Update Progress: 1974/2369 symbols completed. SPGI took 48.5s. Estimated remaining: 55m 34s. Rate: 7.1 symbols/min [2025-10-16T21:37:43.916141] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:37:43.942807] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-16T21:37:43.963894] [DEBUG] [LOCAL ] SPOT: Loaded 50317 existing records from primary storage. [2025-10-16T21:37:43.964202] [INFO ] [MAIN ] SPOT: Loaded 50317 existing records. [2025-10-16T21:37:44.141105] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:37:44.141392] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-16T21:37:44.141447] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-16T21:37:44.141782] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-10-16T21:37:44.141840] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-16T21:37:44.482218] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T21:37:44.516170] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:37:44.742820] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-10-16T21:37:45.123259] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T21:37:45.542823] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-16T21:37:46.342792] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-16T21:37:46.917420] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-16T21:37:46.955132] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T21:37:47.142790] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-16T21:37:47.521941] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T21:37:47.942807] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-16T21:37:48.356979] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-16T21:37:48.742823] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-16T21:37:49.149667] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T21:37:49.256709] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-16T21:37:49.257973] [INFO ] [REMOTE ] SPMC: Full fetch complete (8176 records). [2025-10-16T21:37:49.258043] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-16T21:37:49.547925] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-16T21:37:49.609569] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-16T21:37:49.609678] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-16T21:37:49.609948] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-16T21:37:49.610006] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-16T21:37:49.610411] [DEBUG] [LOCAL ] SPMC: Trimmed 8176 records to 5301 (keeping 200 days of data) [2025-10-16T21:37:49.642392] [DEBUG] [LOCAL ] SPMC: Primary data saved (5301 records). [2025-10-16T21:37:49.642506] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-16T21:37:49.642584] [INFO ] [MAIN ] Update Progress: 1975/2369 symbols completed. SPMC took 26.0s. Estimated remaining: 55m 25s. Rate: 7.1 symbols/min [2025-10-16T21:37:49.805563] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:37:49.843863] [DEBUG] [LOCAL ] SPR: Loaded 41138 existing records from primary storage. [2025-10-16T21:37:49.844145] [INFO ] [MAIN ] SPR: Loaded 41138 existing records. [2025-10-16T21:37:50.018869] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:37:50.019074] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-16T21:37:50.019121] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-16T21:37:50.019312] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-16T21:37:50.019351] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-16T21:37:50.347766] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-16T21:37:50.373411] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:37:51.001967] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T21:37:51.142817] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-10-16T21:37:51.942819] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-16T21:37:52.576786] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-16T21:37:52.651830] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T21:37:52.742842] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-16T21:37:53.542801] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-16T21:37:53.629522] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T21:37:54.342834] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-16T21:37:54.402167] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T21:37:55.142901] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-16T21:37:55.805138] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-16T21:37:55.834213] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T21:37:55.942771] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-16T21:37:56.569157] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T21:37:56.742802] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-16T21:37:57.336465] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T21:37:57.542879] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-16T21:37:58.156557] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T21:37:58.342816] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-16T21:37:58.652482] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-16T21:37:59.142894] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-16T21:37:59.780774] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T21:37:59.942823] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-16T21:38:00.519029] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T21:38:00.742827] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-16T21:38:01.542908] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-16T21:38:01.705265] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T21:38:02.324529] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T21:38:02.329979] [INFO ] [REMOTE ] SPIR: Full fetch complete (53812 records). [2025-10-16T21:38:02.330096] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-16T21:38:02.351395] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-16T21:38:02.735174] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-16T21:38:02.735266] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-16T21:38:02.736312] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-16T21:38:02.736381] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-16T21:38:02.737833] [DEBUG] [LOCAL ] SPIR: Trimmed 53812 records to 37864 (keeping 200 days of data) [2025-10-16T21:38:02.974235] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T21:38:03.012942] [DEBUG] [LOCAL ] SPIR: Primary data saved (37864 records). [2025-10-16T21:38:03.013100] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-16T21:38:03.013188] [INFO ] [MAIN ] Update Progress: 1976/2369 symbols completed. SPIR took 40.6s. Estimated remaining: 55m 17s. Rate: 7.1 symbols/min [2025-10-16T21:38:03.148038] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-16T21:38:03.226513] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:38:03.243292] [DEBUG] [LOCAL ] SPRU: Loaded 9767 existing records from primary storage. [2025-10-16T21:38:03.243635] [INFO ] [MAIN ] SPRU: Loaded 9767 existing records. [2025-10-16T21:38:03.522563] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:38:03.523122] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-16T21:38:03.523204] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-16T21:38:03.523755] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-16T21:38:03.523901] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-16T21:38:03.781845] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T21:38:03.949143] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-16T21:38:04.086113] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:38:04.742847] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-10-16T21:38:05.476881] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T21:38:05.493857] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T21:38:05.555504] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-16T21:38:05.558751] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-16T21:38:06.342831] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-16T21:38:07.037447] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T21:38:07.065710] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-16T21:38:07.142817] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-16T21:38:07.717549] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T21:38:07.942858] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-16T21:38:08.742818] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-16T21:38:09.542817] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-16T21:38:10.204042] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T21:38:10.342822] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-16T21:38:10.444134] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-16T21:38:10.659445] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-16T21:38:11.142824] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-16T21:38:11.768276] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-16T21:38:11.942835] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-16T21:38:12.748583] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-16T21:38:12.765353] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T21:38:13.352260] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T21:38:13.542844] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-16T21:38:13.745268] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-16T21:38:14.342888] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-16T21:38:14.841794] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T21:38:14.846178] [INFO ] [REMOTE ] SPNT: Full fetch complete (48776 records). [2025-10-16T21:38:14.846267] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-16T21:38:15.031336] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-16T21:38:15.147963] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-16T21:38:15.244877] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-16T21:38:15.244968] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-16T21:38:15.245908] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-16T21:38:15.245971] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-16T21:38:15.247270] [DEBUG] [LOCAL ] SPNT: Trimmed 48776 records to 34961 (keeping 200 days of data) [2025-10-16T21:38:15.463671] [DEBUG] [LOCAL ] SPNT: Primary data saved (34961 records). [2025-10-16T21:38:15.463825] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-16T21:38:15.463909] [INFO ] [MAIN ] Update Progress: 1977/2369 symbols completed. SPNT took 41.7s. Estimated remaining: 55m 10s. Rate: 7.1 symbols/min [2025-10-16T21:38:15.635307] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:38:15.660484] [DEBUG] [LOCAL ] SPXC: Loaded 23421 existing records from primary storage. [2025-10-16T21:38:15.660759] [INFO ] [MAIN ] SPXC: Loaded 23421 existing records. [2025-10-16T21:38:15.875755] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:38:15.875996] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-16T21:38:15.876045] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-16T21:38:15.876221] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-10-16T21:38:15.876267] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-16T21:38:15.952219] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-16T21:38:16.231159] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:38:16.742797] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-10-16T21:38:16.815962] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T21:38:17.542792] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-16T21:38:17.907457] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T21:38:17.954671] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-10-16T21:38:18.342852] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-16T21:38:18.907254] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T21:38:18.912895] [INFO ] [REMOTE ] SPR: Full fetch complete (60190 records). [2025-10-16T21:38:18.913054] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-16T21:38:19.148072] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-16T21:38:19.309271] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-16T21:38:19.309350] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-16T21:38:19.310394] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-16T21:38:19.310457] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-16T21:38:19.311803] [DEBUG] [LOCAL ] SPR: Trimmed 60190 records to 41421 (keeping 200 days of data) [2025-10-16T21:38:19.550554] [DEBUG] [LOCAL ] SPR: Primary data saved (41421 records). [2025-10-16T21:38:19.550733] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-16T21:38:19.550844] [INFO ] [MAIN ] Update Progress: 1978/2369 symbols completed. SPR took 29.9s. Estimated remaining: 55m 0s. Rate: 7.1 symbols/min [2025-10-16T21:38:19.721984] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:38:19.733077] [DEBUG] [LOCAL ] SPXX: Loaded 9312 existing records from primary storage. [2025-10-16T21:38:19.733340] [INFO ] [MAIN ] SPXX: Loaded 9312 existing records. [2025-10-16T21:38:19.906574] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:38:19.906827] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-16T21:38:19.906888] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-16T21:38:19.907042] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-16T21:38:19.907097] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-16T21:38:19.948800] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-16T21:38:20.261742] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:38:20.376433] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-16T21:38:20.409279] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-16T21:38:20.437112] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-16T21:38:20.742870] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-16T21:38:21.542833] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-10-16T21:38:22.342813] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-16T21:38:22.401183] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T21:38:22.804282] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-16T21:38:23.142843] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-10-16T21:38:23.430345] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T21:38:23.942789] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-10-16T21:38:24.163319] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-16T21:38:24.377683] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-16T21:38:24.742817] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-16T21:38:25.221366] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T21:38:25.542827] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-16T21:38:26.301239] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T21:38:26.342817] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-16T21:38:27.142829] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-10-16T21:38:27.942875] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-16T21:38:27.960243] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T21:38:28.137698] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T21:38:28.144210] [INFO ] [REMOTE ] SPOT: Full fetch complete (73776 records). [2025-10-16T21:38:28.144332] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-16T21:38:28.558949] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-10-16T21:38:28.559054] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-10-16T21:38:28.560230] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-10-16T21:38:28.560293] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-10-16T21:38:28.561754] [DEBUG] [LOCAL ] SPOT: Trimmed 73776 records to 50683 (keeping 200 days of data) [2025-10-16T21:38:28.743434] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-16T21:38:28.872232] [DEBUG] [LOCAL ] SPOT: Primary data saved (50683 records). [2025-10-16T21:38:28.872380] [INFO ] [MAIN ] SPOT: Full history saved. [2025-10-16T21:38:28.872945] [INFO ] [MAIN ] Update Progress: 1979/2369 symbols completed. SPOT took 45.1s. Estimated remaining: 54m 52s. Rate: 7.1 symbols/min [2025-10-16T21:38:29.046851] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:38:29.066723] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T21:38:29.114223] [DEBUG] [LOCAL ] SQM: Loaded 48822 existing records from primary storage. [2025-10-16T21:38:29.114603] [INFO ] [MAIN ] SQM: Loaded 48822 existing records. [2025-10-16T21:38:29.292493] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:38:29.292752] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-16T21:38:29.292805] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-16T21:38:29.293006] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-16T21:38:29.293062] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-16T21:38:29.552228] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-16T21:38:29.584997] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T21:38:29.666795] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:38:30.342882] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-10-16T21:38:30.819439] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T21:38:31.142819] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-16T21:38:31.942806] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-10. [2025-10-16T21:38:32.179424] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-16T21:38:32.742920] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-16T21:38:32.849632] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T21:38:32.852065] [INFO ] [REMOTE ] SPRU: Full fetch complete (11983 records). [2025-10-16T21:38:32.852169] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-16T21:38:33.221600] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-16T21:38:33.221707] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-16T21:38:33.221997] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-16T21:38:33.222038] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-16T21:38:33.222636] [DEBUG] [LOCAL ] SPRU: Trimmed 11983 records to 9836 (keeping 200 days of data) [2025-10-16T21:38:33.296340] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (2.95 seconds). [2025-10-16T21:38:33.319332] [DEBUG] [LOCAL ] SPRU: Primary data saved (9836 records). [2025-10-16T21:38:33.319489] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-16T21:38:33.319631] [INFO ] [MAIN ] Update Progress: 1980/2369 symbols completed. SPRU took 30.3s. Estimated remaining: 54m 43s. Rate: 7.1 symbols/min [2025-10-16T21:38:33.487864] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:38:33.500628] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T21:38:33.527772] [DEBUG] [LOCAL ] SQNS: Loaded 27540 existing records from primary storage. [2025-10-16T21:38:33.528016] [INFO ] [MAIN ] SQNS: Loaded 27540 existing records. [2025-10-16T21:38:33.548058] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-16T21:38:33.706932] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:38:33.707159] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-16T21:38:33.707205] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-16T21:38:33.707364] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-16T21:38:33.707400] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-16T21:38:34.056502] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:38:34.342806] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-16T21:38:34.430365] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-16T21:38:35.142850] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-10-16T21:38:35.508810] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T21:38:35.942790] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-16T21:38:36.096579] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T21:38:36.742815] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-16T21:38:37.527238] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T21:38:37.555012] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-16T21:38:37.557703] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T21:38:38.342782] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-16T21:38:38.578684] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T21:38:39.078599] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T21:38:39.142852] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-16T21:38:39.887707] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T21:38:39.942832] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-16T21:38:40.705426] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-16T21:38:40.742808] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-16T21:38:41.391678] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-16T21:38:41.542824] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-16T21:38:42.342839] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-16T21:38:42.363374] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T21:38:43.142827] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-16T21:38:43.924927] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T21:38:43.942772] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-16T21:38:44.450511] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T21:38:44.742795] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-16T21:38:45.542815] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-16T21:38:45.710389] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T21:38:45.769181] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T21:38:46.342805] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-16T21:38:46.363481] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-16T21:38:46.365593] [INFO ] [REMOTE ] SPXX: Full fetch complete (13410 records). [2025-10-16T21:38:46.365762] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-16T21:38:46.747040] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-16T21:38:46.747120] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-16T21:38:46.747429] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-16T21:38:46.747469] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-16T21:38:46.748078] [DEBUG] [LOCAL ] SPXX: Trimmed 13410 records to 9377 (keeping 200 days of data) [2025-10-16T21:38:46.805932] [DEBUG] [LOCAL ] SPXX: Primary data saved (9377 records). [2025-10-16T21:38:46.806102] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-16T21:38:46.806202] [INFO ] [MAIN ] Update Progress: 1981/2369 symbols completed. SPXX took 27.3s. Estimated remaining: 54m 35s. Rate: 7.1 symbols/min [2025-10-16T21:38:46.980311] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:38:47.013367] [DEBUG] [LOCAL ] SR: Loaded 32516 existing records from primary storage. [2025-10-16T21:38:47.013706] [INFO ] [MAIN ] SR: Loaded 32516 existing records. [2025-10-16T21:38:47.154208] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-16T21:38:47.196929] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:38:47.197289] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-16T21:38:47.203028] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-16T21:38:47.203779] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T21:38:47.204722] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-10-16T21:38:47.206957] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-16T21:38:47.585082] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:38:47.942780] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-10-16T21:38:48.742802] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-16T21:38:48.781932] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T21:38:48.965168] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T21:38:49.497961] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T21:38:49.542816] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-16T21:38:50.342877] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-16T21:38:50.355711] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T21:38:51.142881] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-16T21:38:51.942862] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-16T21:38:52.010614] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T21:38:52.053702] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T21:38:52.058613] [INFO ] [REMOTE ] SPXC: Full fetch complete (34172 records). [2025-10-16T21:38:52.058817] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-16T21:38:52.452771] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-16T21:38:52.452881] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-16T21:38:52.453627] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-16T21:38:52.453714] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-16T21:38:52.454700] [DEBUG] [LOCAL ] SPXC: Trimmed 34172 records to 23611 (keeping 200 days of data) [2025-10-16T21:38:52.599524] [DEBUG] [LOCAL ] SPXC: Primary data saved (23611 records). [2025-10-16T21:38:52.599694] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-16T21:38:52.599791] [INFO ] [MAIN ] Update Progress: 1982/2369 symbols completed. SPXC took 37.1s. Estimated remaining: 54m 26s. Rate: 7.1 symbols/min [2025-10-16T21:38:52.754420] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-16T21:38:52.774534] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:38:52.825113] [DEBUG] [LOCAL ] SRE: Loaded 53420 existing records from primary storage. [2025-10-16T21:38:52.825449] [INFO ] [MAIN ] SRE: Loaded 53420 existing records. [2025-10-16T21:38:52.999553] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:38:52.999792] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-16T21:38:52.999842] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-16T21:38:53.000017] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-10-16T21:38:53.000055] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-16T21:38:53.316926] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T21:38:53.380527] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:38:53.542854] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-10-16T21:38:54.253467] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T21:38:54.342816] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-16T21:38:55.142778] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-16T21:38:55.268668] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T21:38:55.942790] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-16T21:38:56.149866] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T21:38:56.604825] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T21:38:56.742836] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-16T21:38:57.408873] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T21:38:57.542790] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-16T21:38:58.342796] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-16T21:38:58.522675] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T21:38:58.731554] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T21:38:59.142836] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-16T21:38:59.751702] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T21:38:59.942783] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-16T21:39:00.052226] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-16T21:39:00.742860] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-16T21:39:01.229036] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T21:39:01.542841] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-16T21:39:02.342822] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-16T21:39:02.665574] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T21:39:02.704482] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-16T21:39:03.142817] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-16T21:39:03.942847] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-16T21:39:04.742784] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-16T21:39:04.775157] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-16T21:39:04.994514] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T21:39:05.542864] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-16T21:39:05.675681] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T21:39:06.118848] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T21:39:06.342895] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-16T21:39:07.142893] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-16T21:39:07.283930] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T21:39:07.761501] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T21:39:07.942878] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-16T21:39:08.742789] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-16T21:39:08.891502] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T21:39:08.898143] [INFO ] [REMOTE ] SQM: Full fetch complete (69704 records). [2025-10-16T21:39:08.898347] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-16T21:39:09.287341] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-16T21:39:09.287434] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-16T21:39:09.288515] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-16T21:39:09.288577] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-16T21:39:09.289869] [DEBUG] [LOCAL ] SQM: Trimmed 69704 records to 49174 (keeping 200 days of data) [2025-10-16T21:39:09.546351] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-16T21:39:09.588325] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T21:39:09.611758] [DEBUG] [LOCAL ] SQM: Primary data saved (49174 records). [2025-10-16T21:39:09.611885] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-16T21:39:09.612454] [INFO ] [MAIN ] Update Progress: 1983/2369 symbols completed. SQM took 40.7s. Estimated remaining: 54m 20s. Rate: 7.1 symbols/min [2025-10-16T21:39:09.788787] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:39:09.801422] [DEBUG] [LOCAL ] SREA: Loaded 10033 existing records from primary storage. [2025-10-16T21:39:09.801683] [INFO ] [MAIN ] SREA: Loaded 10033 existing records. [2025-10-16T21:39:09.989917] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:39:09.990135] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-16T21:39:09.990182] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-16T21:39:09.990360] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-16T21:39:09.990415] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-16T21:39:10.342992] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-16T21:39:10.365879] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:39:10.368912] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T21:39:11.142839] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-16T21:39:11.417007] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T21:39:11.459846] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-16T21:39:11.463815] [INFO ] [REMOTE ] SQNS: Full fetch complete (33105 records). [2025-10-16T21:39:11.463898] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-16T21:39:11.883411] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-16T21:39:11.883493] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-16T21:39:11.884175] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-16T21:39:11.884239] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-16T21:39:11.885148] [DEBUG] [LOCAL ] SQNS: Trimmed 33105 records to 27732 (keeping 200 days of data) [2025-10-16T21:39:11.964979] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-10-16T21:39:12.041858] [DEBUG] [LOCAL ] SQNS: Primary data saved (27732 records). [2025-10-16T21:39:12.042001] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-16T21:39:12.042080] [INFO ] [MAIN ] Update Progress: 1984/2369 symbols completed. SQNS took 38.7s. Estimated remaining: 54m 10s. Rate: 7.1 symbols/min [2025-10-16T21:39:12.206593] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:39:12.241867] [DEBUG] [LOCAL ] SRFM: Loaded 39060 existing records from primary storage. [2025-10-16T21:39:12.242147] [INFO ] [MAIN ] SRFM: Loaded 39060 existing records. [2025-10-16T21:39:12.413790] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:39:12.414082] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-16T21:39:12.414155] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-16T21:39:12.414513] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-16T21:39:12.414569] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-16T21:39:12.715514] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T21:39:12.744143] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-16T21:39:12.804096] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:39:12.866358] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T21:39:13.542833] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-16T21:39:14.342856] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-10-16T21:39:14.438893] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T21:39:14.488673] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-16T21:39:14.493225] [INFO ] [REMOTE ] SR: Full fetch complete (46265 records). [2025-10-16T21:39:14.493336] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-16T21:39:14.874680] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-16T21:39:14.874757] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-16T21:39:14.875635] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-16T21:39:14.875718] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-16T21:39:14.876823] [DEBUG] [LOCAL ] SR: Trimmed 46265 records to 32722 (keeping 200 days of data) [2025-10-16T21:39:15.076615] [DEBUG] [LOCAL ] SR: Primary data saved (32722 records). [2025-10-16T21:39:15.076808] [INFO ] [MAIN ] SR: Full history saved. [2025-10-16T21:39:15.076908] [INFO ] [MAIN ] Update Progress: 1985/2369 symbols completed. SR took 28.3s. Estimated remaining: 54m 1s. Rate: 7.1 symbols/min [2025-10-16T21:39:15.150454] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-16T21:39:15.248323] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:39:15.263721] [DEBUG] [LOCAL ] SRG: Loaded 15416 existing records from primary storage. [2025-10-16T21:39:15.263950] [INFO ] [MAIN ] SRG: Loaded 15416 existing records. [2025-10-16T21:39:15.447825] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:39:15.448049] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-16T21:39:15.448095] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-16T21:39:15.448273] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-16T21:39:15.448327] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-16T21:39:15.796781] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:39:15.942809] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-10-16T21:39:16.050259] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T21:39:16.742825] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-16T21:39:16.926163] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T21:39:17.213850] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T21:39:17.542836] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-16T21:39:17.560295] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T21:39:18.342820] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-16T21:39:18.542582] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T21:39:19.117837] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T21:39:19.142870] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-16T21:39:19.942866] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-16T21:39:20.416252] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T21:39:20.476120] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-16T21:39:20.742867] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-16T21:39:21.542796] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-16T21:39:21.562403] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-16T21:39:22.342857] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-16T21:39:22.695450] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T21:39:23.142793] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-16T21:39:23.153378] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T21:39:23.942787] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-16T21:39:24.098705] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T21:39:24.742782] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-16T21:39:25.128480] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T21:39:25.542788] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-16T21:39:25.824817] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-16T21:39:26.308043] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-16T21:39:26.342774] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-16T21:39:27.139668] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T21:39:27.142772] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-16T21:39:27.942848] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-16T21:39:28.246388] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T21:39:28.742828] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-16T21:39:29.487172] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-16T21:39:29.542845] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-16T21:39:29.731101] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T21:39:29.983191] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T21:39:30.342853] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-16T21:39:31.142808] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-16T21:39:31.942785] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-16T21:39:32.087205] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T21:39:32.197791] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T21:39:32.742793] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-16T21:39:32.941429] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T21:39:33.542799] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-16T21:39:33.579389] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T21:39:34.201246] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T21:39:34.202749] [INFO ] [REMOTE ] SREA: Full fetch complete (15190 records). [2025-10-16T21:39:34.202820] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-16T21:39:34.347940] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-16T21:39:34.578317] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-16T21:39:34.578415] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-16T21:39:34.578808] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-16T21:39:34.578883] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-16T21:39:34.579675] [DEBUG] [LOCAL ] SREA: Trimmed 15190 records to 10055 (keeping 200 days of data) [2025-10-16T21:39:34.641295] [DEBUG] [LOCAL ] SREA: Primary data saved (10055 records). [2025-10-16T21:39:34.641443] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-16T21:39:34.641527] [INFO ] [MAIN ] Update Progress: 1986/2369 symbols completed. SREA took 25.0s. Estimated remaining: 53m 54s. Rate: 7.1 symbols/min [2025-10-16T21:39:34.837842] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:39:34.863115] [DEBUG] [LOCAL ] SRI: Loaded 26475 existing records from primary storage. [2025-10-16T21:39:34.863420] [INFO ] [MAIN ] SRI: Loaded 26475 existing records. [2025-10-16T21:39:35.038573] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:39:35.038841] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-16T21:39:35.038895] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-16T21:39:35.039057] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-16T21:39:35.039096] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-16T21:39:35.143944] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-16T21:39:35.408610] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T21:39:35.412818] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:39:35.942828] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-16T21:39:36.249405] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-16T21:39:36.742863] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-16T21:39:36.854514] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T21:39:37.411154] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T21:39:37.418094] [INFO ] [REMOTE ] SRE: Full fetch complete (77490 records). [2025-10-16T21:39:37.418267] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-16T21:39:37.554433] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-16T21:39:37.809043] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-16T21:39:37.809133] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-16T21:39:37.810269] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-16T21:39:37.810340] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-16T21:39:37.812087] [DEBUG] [LOCAL ] SRE: Trimmed 77490 records to 53806 (keeping 200 days of data) [2025-10-16T21:39:38.164471] [DEBUG] [LOCAL ] SRE: Primary data saved (53806 records). [2025-10-16T21:39:38.164621] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-16T21:39:38.165242] [INFO ] [MAIN ] Update Progress: 1987/2369 symbols completed. SRE took 45.6s. Estimated remaining: 53m 45s. Rate: 7.1 symbols/min [2025-10-16T21:39:38.331631] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:39:38.331803] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-16T21:39:38.331842] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-16T21:39:38.331950] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-16T21:39:38.331991] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-16T21:39:38.332030] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-16T21:39:38.332061] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-16T21:39:38.360822] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-16T21:39:38.640579] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T21:39:38.715323] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:39:39.142876] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-10-16T21:39:39.657247] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-16T21:39:39.942873] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-16T21:39:40.025579] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T21:39:40.653538] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-16T21:39:40.655532] [INFO ] [REMOTE ] SRG: Full fetch complete (23428 records). [2025-10-16T21:39:40.655602] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-16T21:39:40.752135] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-16T21:39:41.043858] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-16T21:39:41.043933] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-16T21:39:41.044444] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-16T21:39:41.044504] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-16T21:39:41.045090] [DEBUG] [LOCAL ] SRG: Trimmed 23428 records to 15555 (keeping 200 days of data) [2025-10-16T21:39:41.127943] [DEBUG] [LOCAL ] SRG: Primary data saved (15555 records). [2025-10-16T21:39:41.128098] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-16T21:39:41.128202] [INFO ] [MAIN ] Update Progress: 1988/2369 symbols completed. SRG took 26.1s. Estimated remaining: 53m 35s. Rate: 7.1 symbols/min [2025-10-16T21:39:41.300508] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:39:41.303204] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T21:39:41.312247] [DEBUG] [LOCAL ] SRV: Loaded 7403 existing records from primary storage. [2025-10-16T21:39:41.312452] [INFO ] [MAIN ] SRV: Loaded 7403 existing records. [2025-10-16T21:39:41.487984] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:39:41.488245] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-16T21:39:41.488312] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-16T21:39:41.488480] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-16T21:39:41.488535] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-16T21:39:41.549328] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-16T21:39:41.845011] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:39:41.971342] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-16T21:39:42.342811] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-10-16T21:39:43.142815] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-16T21:39:43.183559] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T21:39:43.490426] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-16T21:39:43.942818] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-16T21:39:44.318320] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-16T21:39:44.742825] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-16T21:39:45.106695] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-16T21:39:45.542819] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-16T21:39:46.342786] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-16T21:39:46.369849] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-16T21:39:46.701636] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-16T21:39:47.142863] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-16T21:39:47.828611] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-16T21:39:47.942868] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-16T21:39:48.675266] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T21:39:48.742770] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-16T21:39:49.527868] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T21:39:49.542771] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-16T21:39:50.254414] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T21:39:50.342889] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-16T21:39:51.089549] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-16T21:39:51.142923] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-10-16T21:39:51.942825] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-16T21:39:52.572153] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T21:39:52.674461] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-16T21:39:52.742849] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-16T21:39:53.109489] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-16T21:39:53.542870] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-16T21:39:54.342783] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-16T21:39:54.395773] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-16T21:39:55.142862] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-16T21:39:55.865525] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T21:39:55.942839] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-16T21:39:56.603638] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T21:39:56.605122] [INFO ] [REMOTE ] SRV: Full fetch complete (11385 records). [2025-10-16T21:39:56.605259] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-16T21:39:56.743695] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-16T21:39:56.977920] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-16T21:39:56.978093] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-16T21:39:56.978566] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-16T21:39:56.978662] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-16T21:39:56.990913] [DEBUG] [LOCAL ] SRV: Trimmed 11385 records to 7481 (keeping 200 days of data) [2025-10-16T21:39:57.030066] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-16T21:39:57.069049] [DEBUG] [LOCAL ] SRV: Primary data saved (7481 records). [2025-10-16T21:39:57.069186] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-16T21:39:57.069272] [INFO ] [MAIN ] Update Progress: 1989/2369 symbols completed. SRV took 15.9s. Estimated remaining: 53m 28s. Rate: 7.1 symbols/min [2025-10-16T21:39:57.232047] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:39:57.241335] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-16T21:39:57.273183] [DEBUG] [LOCAL ] SSB: Loaded 42768 existing records from primary storage. [2025-10-16T21:39:57.273477] [INFO ] [MAIN ] SSB: Loaded 42768 existing records. [2025-10-16T21:39:57.447553] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:39:57.447811] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-16T21:39:57.447861] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-16T21:39:57.448101] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-10-16T21:39:57.448170] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-16T21:39:57.547929] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-16T21:39:57.830602] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:39:58.342877] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-16T21:39:59.142842] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-10-16T21:39:59.530089] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T21:39:59.636510] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-16T21:39:59.942802] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-16T21:40:00.348190] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-16T21:40:00.742816] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-16T21:40:01.542809] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-16T21:40:01.597972] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T21:40:02.342833] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-16T21:40:02.485910] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T21:40:03.142843] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-16T21:40:03.435717] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-16T21:40:03.470061] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T21:40:03.504517] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-16T21:40:03.942898] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-16T21:40:04.742903] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-16T21:40:05.542835] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-16T21:40:05.897376] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T21:40:06.092980] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-16T21:40:06.101326] [INFO ] [REMOTE ] SRFM: Full fetch complete (50828 records). [2025-10-16T21:40:06.101559] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-16T21:40:06.347960] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-16T21:40:06.517707] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-16T21:40:06.517882] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-16T21:40:06.519025] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-16T21:40:06.519125] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-16T21:40:06.536627] [DEBUG] [LOCAL ] SRFM: Trimmed 50828 records to 39445 (keeping 200 days of data) [2025-10-16T21:40:06.540778] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T21:40:06.778231] [DEBUG] [LOCAL ] SRFM: Primary data saved (39445 records). [2025-10-16T21:40:06.778684] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-16T21:40:06.778788] [INFO ] [MAIN ] Update Progress: 1990/2369 symbols completed. SRFM took 54.7s. Estimated remaining: 53m 20s. Rate: 7.1 symbols/min [2025-10-16T21:40:06.955985] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:40:06.979759] [DEBUG] [LOCAL ] SSD: Loaded 22608 existing records from primary storage. [2025-10-16T21:40:06.980040] [INFO ] [MAIN ] SSD: Loaded 22608 existing records. [2025-10-16T21:40:07.153630] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-16T21:40:07.159259] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:40:07.160392] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-16T21:40:07.160446] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-16T21:40:07.160967] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-10-16T21:40:07.161025] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-16T21:40:07.509841] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:40:07.608572] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T21:40:07.674506] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-16T21:40:07.675302] [INFO ] [REMOTE ] SRL: Full fetch complete (1908 records). [2025-10-16T21:40:07.675370] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-16T21:40:07.846200] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-16T21:40:07.846442] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:40:07.846519] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:40:07.846566] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-16T21:40:07.846619] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-16T21:40:07.846681] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-16T21:40:07.846741] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-16T21:40:07.846796] [INFO ] [MAIN ] Update Progress: 1991/2369 symbols completed. SRL took 29.7s. Estimated remaining: 53m 10s. Rate: 7.1 symbols/min [2025-10-16T21:40:07.943987] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-16T21:40:08.012949] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:40:08.052870] [DEBUG] [LOCAL ] SSL: Loaded 41512 existing records from primary storage. [2025-10-16T21:40:08.053162] [INFO ] [MAIN ] SSL: Loaded 41512 existing records. [2025-10-16T21:40:08.224170] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:40:08.224421] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-16T21:40:08.224474] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-16T21:40:08.224681] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-16T21:40:08.224736] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-16T21:40:08.568565] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:40:08.742849] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-16T21:40:09.542801] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-10-16T21:40:09.938317] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T21:40:10.342798] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-16T21:40:11.142849] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-10-16T21:40:11.190798] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T21:40:11.754309] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T21:40:11.942814] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-16T21:40:12.253213] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T21:40:12.616661] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (4.67 seconds). [2025-10-16T21:40:12.742851] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-16T21:40:13.087890] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-16T21:40:13.542841] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-16T21:40:13.560823] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T21:40:14.342823] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-16T21:40:14.650343] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T21:40:15.142821] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-16T21:40:15.834235] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T21:40:15.942795] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-16T21:40:16.084338] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T21:40:16.087155] [INFO ] [REMOTE ] SRI: Full fetch complete (40055 records). [2025-10-16T21:40:16.087237] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-16T21:40:16.467277] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-16T21:40:16.467356] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-16T21:40:16.468289] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-16T21:40:16.468352] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-16T21:40:16.469280] [DEBUG] [LOCAL ] SRI: Trimmed 40055 records to 26642 (keeping 200 days of data) [2025-10-16T21:40:16.619738] [DEBUG] [LOCAL ] SRI: Primary data saved (26642 records). [2025-10-16T21:40:16.619874] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-16T21:40:16.619958] [INFO ] [MAIN ] Update Progress: 1992/2369 symbols completed. SRI took 42.0s. Estimated remaining: 53m 2s. Rate: 7.1 symbols/min [2025-10-16T21:40:16.747919] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-16T21:40:16.796754] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:40:16.809891] [DEBUG] [LOCAL ] SST: Loaded 11585 existing records from primary storage. [2025-10-16T21:40:16.810137] [INFO ] [MAIN ] SST: Loaded 11585 existing records. [2025-10-16T21:40:16.994617] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:40:16.994908] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-16T21:40:16.994963] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-16T21:40:16.995118] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-16T21:40:16.995174] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-16T21:40:17.355049] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:40:17.542818] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-10-16T21:40:17.640060] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T21:40:17.843399] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T21:40:18.342795] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-16T21:40:18.360183] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-16T21:40:19.142810] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-16T21:40:19.938693] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T21:40:19.946262] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-16T21:40:20.282907] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T21:40:20.742837] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-16T21:40:21.054564] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T21:40:21.542789] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-16T21:40:21.572526] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T21:40:22.342796] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-16T21:40:22.982268] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T21:40:23.142827] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-16T21:40:23.942797] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-16T21:40:24.075624] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T21:40:24.342525] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-16T21:40:24.742805] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-16T21:40:25.542836] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-16T21:40:25.629787] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T21:40:25.830517] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T21:40:26.342782] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-16T21:40:26.501820] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-16T21:40:27.142813] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-16T21:40:27.923156] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T21:40:27.942769] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-16T21:40:28.368975] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T21:40:28.742807] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-16T21:40:29.307408] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T21:40:29.542818] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-16T21:40:29.869767] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T21:40:30.342834] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-16T21:40:31.142828] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-16T21:40:31.859120] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T21:40:31.907186] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T21:40:31.942837] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-16T21:40:32.563172] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (3.02 seconds). [2025-10-16T21:40:32.742860] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-16T21:40:32.799220] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T21:40:33.542813] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-16T21:40:33.899031] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T21:40:34.342828] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-16T21:40:34.765965] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T21:40:35.142821] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-16T21:40:35.942853] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-16T21:40:35.982027] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-16T21:40:36.742874] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-16T21:40:36.983296] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-16T21:40:37.508768] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T21:40:37.542858] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-16T21:40:37.920698] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T21:40:38.342796] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-16T21:40:38.619252] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T21:40:38.767846] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-16T21:40:39.142822] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-16T21:40:39.942781] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-16T21:40:40.111076] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T21:40:40.114233] [INFO ] [REMOTE ] SSD: Full fetch complete (32366 records). [2025-10-16T21:40:40.114304] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-16T21:40:40.480504] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-16T21:40:40.480589] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-16T21:40:40.481195] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-16T21:40:40.481257] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-16T21:40:40.481980] [DEBUG] [LOCAL ] SSD: Trimmed 32366 records to 22749 (keeping 200 days of data) [2025-10-16T21:40:40.620817] [DEBUG] [LOCAL ] SSD: Primary data saved (22749 records). [2025-10-16T21:40:40.620946] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-16T21:40:40.621023] [INFO ] [MAIN ] Update Progress: 1993/2369 symbols completed. SSD took 33.8s. Estimated remaining: 52m 56s. Rate: 7.1 symbols/min [2025-10-16T21:40:40.757838] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-16T21:40:40.791919] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:40:40.818950] [DEBUG] [LOCAL ] SSTK: Loaded 25292 existing records from primary storage. [2025-10-16T21:40:40.819203] [INFO ] [MAIN ] SSTK: Loaded 25292 existing records. [2025-10-16T21:40:40.996626] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:40:40.996927] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-16T21:40:40.997062] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-16T21:40:40.997280] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-10-16T21:40:40.997337] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-16T21:40:41.352631] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T21:40:41.352502] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:40:41.354412] [INFO ] [REMOTE ] SST: Full fetch complete (18293 records). [2025-10-16T21:40:41.354610] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-16T21:40:41.552237] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-10-16T21:40:41.620408] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T21:40:41.753547] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-16T21:40:41.753620] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-16T21:40:41.754010] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-16T21:40:41.754061] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-16T21:40:41.754546] [DEBUG] [LOCAL ] SST: Trimmed 18293 records to 11622 (keeping 200 days of data) [2025-10-16T21:40:41.818065] [DEBUG] [LOCAL ] SST: Primary data saved (11622 records). [2025-10-16T21:40:41.818187] [INFO ] [MAIN ] SST: Full history saved. [2025-10-16T21:40:41.818286] [INFO ] [MAIN ] Update Progress: 1994/2369 symbols completed. SST took 25.2s. Estimated remaining: 52m 47s. Rate: 7.1 symbols/min [2025-10-16T21:40:41.985191] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:40:42.028701] [DEBUG] [LOCAL ] ST: Loaded 49847 existing records from primary storage. [2025-10-16T21:40:42.028996] [INFO ] [MAIN ] ST: Loaded 49847 existing records. [2025-10-16T21:40:42.203195] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:40:42.203400] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-16T21:40:42.203448] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-16T21:40:42.203693] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-10-16T21:40:42.203750] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-16T21:40:42.349012] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-16T21:40:42.550914] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:40:42.984157] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T21:40:43.142831] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-10-16T21:40:43.942785] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-16T21:40:44.018471] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T21:40:44.533611] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T21:40:44.742786] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-16T21:40:45.542810] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-16T21:40:45.791987] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T21:40:46.275679] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T21:40:46.342768] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-16T21:40:46.985884] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T21:40:46.991300] [INFO ] [REMOTE ] SSL: Full fetch complete (60107 records). [2025-10-16T21:40:46.991401] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-16T21:40:47.151197] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-16T21:40:47.380387] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-16T21:40:47.380467] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-16T21:40:47.381430] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-16T21:40:47.381492] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-16T21:40:47.382593] [DEBUG] [LOCAL ] SSL: Trimmed 60107 records to 41797 (keeping 200 days of data) [2025-10-16T21:40:47.614824] [DEBUG] [LOCAL ] SSL: Primary data saved (41797 records). [2025-10-16T21:40:47.614944] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-16T21:40:47.615556] [INFO ] [MAIN ] Update Progress: 1995/2369 symbols completed. SSL took 39.8s. Estimated remaining: 52m 38s. Rate: 7.1 symbols/min [2025-10-16T21:40:47.791506] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:40:47.842992] [DEBUG] [LOCAL ] STAG: Loaded 50134 existing records from primary storage. [2025-10-16T21:40:47.843288] [INFO ] [MAIN ] STAG: Loaded 50134 existing records. [2025-10-16T21:40:47.949446] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-16T21:40:48.034001] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:40:48.034624] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-16T21:40:48.034840] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-16T21:40:48.035160] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-10-16T21:40:48.035223] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-16T21:40:48.163308] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-16T21:40:48.425138] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:40:48.438638] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-16T21:40:48.444050] [INFO ] [REMOTE ] SSB: Full fetch complete (61645 records). [2025-10-16T21:40:48.444148] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-16T21:40:48.747912] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-10-16T21:40:48.834774] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-16T21:40:48.834847] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-16T21:40:48.835896] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-16T21:40:48.835958] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-16T21:40:48.837181] [DEBUG] [LOCAL ] SSB: Trimmed 61645 records to 43122 (keeping 200 days of data) [2025-10-16T21:40:49.091257] [DEBUG] [LOCAL ] SSB: Primary data saved (43122 records). [2025-10-16T21:40:49.091390] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-16T21:40:49.092036] [INFO ] [MAIN ] Update Progress: 1996/2369 symbols completed. SSB took 52.0s. Estimated remaining: 52m 28s. Rate: 7.1 symbols/min [2025-10-16T21:40:49.261102] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:40:49.279617] [DEBUG] [LOCAL ] STC: Loaded 17323 existing records from primary storage. [2025-10-16T21:40:49.279877] [INFO ] [MAIN ] STC: Loaded 17323 existing records. [2025-10-16T21:40:49.458199] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:40:49.458500] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-16T21:40:49.458551] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-16T21:40:49.458735] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-10-16T21:40:49.458803] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-16T21:40:49.555598] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-16T21:40:49.822809] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:40:49.844735] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-16T21:40:50.342778] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-16T21:40:50.731918] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-16T21:40:51.142865] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-16T21:40:51.320849] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T21:40:51.694927] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T21:40:51.942860] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-10-16T21:40:52.742831] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-16T21:40:52.896013] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T21:40:52.948451] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-16T21:40:53.542814] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-16T21:40:54.183574] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T21:40:54.342813] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-16T21:40:54.554079] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T21:40:55.142833] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-16T21:40:55.422082] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-16T21:40:55.942873] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-16T21:40:56.211433] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T21:40:56.742898] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-16T21:40:57.544237] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-16T21:40:57.549507] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T21:40:58.127985] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T21:40:58.342788] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-16T21:40:58.704126] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-16T21:40:59.142894] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-16T21:40:59.942811] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-16T21:41:00.036635] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T21:41:00.163456] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-16T21:41:00.742828] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-16T21:41:01.172639] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T21:41:01.542852] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-16T21:41:01.816984] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-16T21:41:02.342810] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-16T21:41:03.142803] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-16T21:41:03.322584] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-16T21:41:03.369706] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T21:41:03.942818] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-16T21:41:04.742782] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-16T21:41:04.838198] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T21:41:04.902988] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T21:41:05.542846] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-16T21:41:06.342803] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-16T21:41:06.455845] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T21:41:06.584701] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T21:41:07.142808] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-16T21:41:07.758237] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T21:41:07.942812] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-16T21:41:08.742849] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-16T21:41:08.999923] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-16T21:41:09.284914] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T21:41:09.542875] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-16T21:41:09.733083] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T21:41:10.342818] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-16T21:41:11.142854] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-16T21:41:11.224143] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T21:41:11.283051] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-16T21:41:11.942845] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-16T21:41:12.035725] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T21:41:12.037917] [INFO ] [REMOTE ] STC: Full fetch complete (25610 records). [2025-10-16T21:41:12.037989] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-16T21:41:12.399498] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-16T21:41:12.399601] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-16T21:41:12.400173] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-16T21:41:12.400245] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-16T21:41:12.401143] [DEBUG] [LOCAL ] STC: Trimmed 25610 records to 17452 (keeping 200 days of data) [2025-10-16T21:41:12.510493] [DEBUG] [LOCAL ] STC: Primary data saved (17452 records). [2025-10-16T21:41:12.510627] [INFO ] [MAIN ] STC: Full history saved. [2025-10-16T21:41:12.510744] [INFO ] [MAIN ] Update Progress: 1997/2369 symbols completed. STC took 23.4s. Estimated remaining: 52m 22s. Rate: 7.1 symbols/min [2025-10-16T21:41:12.742916] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-16T21:41:13.262136] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T21:41:13.542814] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-16T21:41:14.062230] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T21:41:14.068861] [INFO ] [REMOTE ] ST: Full fetch complete (72150 records). [2025-10-16T21:41:14.069013] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-16T21:41:14.349949] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-16T21:41:14.471714] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-16T21:41:14.471814] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-16T21:41:14.472907] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-16T21:41:14.472970] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-16T21:41:14.474363] [DEBUG] [LOCAL ] ST: Trimmed 72150 records to 50212 (keeping 200 days of data) [2025-10-16T21:41:14.777255] [DEBUG] [LOCAL ] ST: Primary data saved (50212 records). [2025-10-16T21:41:14.777420] [INFO ] [MAIN ] ST: Full history saved. [2025-10-16T21:41:14.777979] [INFO ] [MAIN ] Update Progress: 1998/2369 symbols completed. ST took 33.0s. Estimated remaining: 52m 13s. Rate: 7.1 symbols/min [2025-10-16T21:41:15.252567] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T21:41:15.262951] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-16T21:41:15.555185] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-16T21:41:15.942834] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-16T21:41:17.056781] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T21:41:17.068935] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-16T21:41:17.103065] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T21:41:17.542898] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-16T21:41:18.630342] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T21:41:18.634046] [INFO ] [REMOTE ] SSTK: Full fetch complete (41647 records). [2025-10-16T21:41:18.634147] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-16T21:41:19.057785] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-16T21:41:19.059854] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-16T21:41:19.060061] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-16T21:41:19.070964] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-16T21:41:19.071056] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-16T21:41:19.071831] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-16T21:41:19.073528] [DEBUG] [LOCAL ] SSTK: Trimmed 41647 records to 25552 (keeping 200 days of data) [2025-10-16T21:41:19.228844] [DEBUG] [LOCAL ] SSTK: Primary data saved (25552 records). [2025-10-16T21:41:19.229010] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-16T21:41:19.229126] [INFO ] [MAIN ] Update Progress: 1999/2369 symbols completed. SSTK took 38.6s. Estimated remaining: 52m 4s. Rate: 7.1 symbols/min [2025-10-16T21:41:20.927385] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-16T21:41:20.938054] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-16T21:41:22.514568] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T21:41:22.521215] [INFO ] [REMOTE ] STAG: Full fetch complete (72550 records). [2025-10-16T21:41:22.521330] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-16T21:41:22.898616] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-16T21:41:22.898723] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-16T21:41:22.899833] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-16T21:41:22.899895] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-16T21:41:22.901227] [DEBUG] [LOCAL ] STAG: Trimmed 72550 records to 50506 (keeping 200 days of data) [2025-10-16T21:41:23.203831] [DEBUG] [LOCAL ] STAG: Primary data saved (50506 records). [2025-10-16T21:41:23.203967] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-16T21:41:23.204556] [INFO ] [MAIN ] Update Progress: 2000/2369 symbols completed. STAG took 35.6s. Estimated remaining: 51m 54s. Rate: 7.1 symbols/min [2025-10-16T21:41:23.771073] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:41:23.858364] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:41:23.898319] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:41:23.933089] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:41:23.985600] [DEBUG] [LOCAL ] STEW: Loaded 15684 existing records from primary storage. [2025-10-16T21:41:23.986838] [INFO ] [MAIN ] STEW: Loaded 15684 existing records. [2025-10-16T21:41:23.986494] [DEBUG] [LOCAL ] STE: Loaded 35387 existing records from primary storage. [2025-10-16T21:41:24.022430] [INFO ] [MAIN ] STE: Loaded 35387 existing records. [2025-10-16T21:41:24.179109] [DEBUG] [LOCAL ] STEL: Loaded 22665 existing records from primary storage. [2025-10-16T21:41:24.164439] [DEBUG] [LOCAL ] STEM: Loaded 38841 existing records from primary storage. [2025-10-16T21:41:24.210821] [INFO ] [MAIN ] STEL: Loaded 22665 existing records. [2025-10-16T21:41:24.238412] [INFO ] [MAIN ] STEM: Loaded 38841 existing records. [2025-10-16T21:41:24.472267] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:41:24.508930] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-16T21:41:24.581197] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-16T21:41:24.624824] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:41:24.625046] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-16T21:41:24.624930] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-16T21:41:24.625208] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-16T21:41:24.680825] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:41:24.710605] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-16T21:41:24.727105] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-16T21:41:24.758191] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-16T21:41:24.756402] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-10-16T21:41:24.777229] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-16T21:41:24.813355] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:41:24.795914] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-16T21:41:24.829713] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-16T21:41:24.840251] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-16T21:41:24.872739] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-16T21:41:24.992940] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-10-16T21:41:24.993119] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-16T21:41:25.971262] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:41:26.027247] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:41:26.078897] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-10-16T21:41:26.037888] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-10-16T21:41:26.166049] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:41:26.171033] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-10-16T21:41:26.253935] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:41:26.254342] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-10-16T21:41:27.099083] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T21:41:27.102921] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-16T21:41:27.340866] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T21:41:27.345098] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-16T21:41:27.729442] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T21:41:27.736683] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-16T21:41:27.752956] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-16T21:41:27.756151] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-16T21:41:28.222801] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-16T21:41:28.233622] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-16T21:41:28.256512] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T21:41:28.260871] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-16T21:41:28.267689] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-16T21:41:28.270713] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-16T21:41:29.179849] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T21:41:29.186952] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-16T21:41:29.327537] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-16T21:41:29.342275] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T21:41:29.542838] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-16T21:41:30.283162] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-16T21:41:30.342805] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-16T21:41:30.482105] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T21:41:30.840817] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T21:41:31.142806] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-16T21:41:31.942832] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-16T21:41:32.314689] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T21:41:32.526232] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-16T21:41:32.742820] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-16T21:41:33.107142] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-16T21:41:33.542851] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-16T21:41:34.046783] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T21:41:34.342798] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-16T21:41:34.553796] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T21:41:35.142825] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-16T21:41:35.369127] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T21:41:35.891261] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-16T21:41:35.942821] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-16T21:41:36.742839] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-16T21:41:37.135072] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-16T21:41:37.542843] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-16T21:41:37.633952] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-16T21:41:38.342847] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-16T21:41:39.142851] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-16T21:41:39.381945] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T21:41:39.480323] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T21:41:39.942829] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-16T21:41:40.191489] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-16T21:41:40.742862] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-16T21:41:41.127411] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T21:41:41.542962] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-16T21:41:42.342802] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-16T21:41:42.516721] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T21:41:42.547381] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T21:41:43.142787] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-16T21:41:43.762534] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T21:41:43.942853] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-16T21:41:44.694559] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T21:41:44.742773] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-16T21:41:45.029776] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T21:41:45.542818] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-16T21:41:46.342832] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-16T21:41:46.557142] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T21:41:46.940334] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T21:41:47.040162] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T21:41:47.043084] [INFO ] [REMOTE ] STEL: Full fetch complete (32005 records). [2025-10-16T21:41:47.043160] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-16T21:41:47.148112] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-16T21:41:47.426725] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-16T21:41:47.426810] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-16T21:41:47.427594] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-16T21:41:47.427687] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-16T21:41:47.428475] [DEBUG] [LOCAL ] STEL: Trimmed 32005 records to 22796 (keeping 200 days of data) [2025-10-16T21:41:47.564232] [DEBUG] [LOCAL ] STEL: Primary data saved (22796 records). [2025-10-16T21:41:47.564359] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-16T21:41:47.564457] [INFO ] [MAIN ] Update Progress: 2001/2369 symbols completed. STEL took 24.4s. Estimated remaining: 51m 49s. Rate: 7.1 symbols/min [2025-10-16T21:41:47.736817] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:41:47.737001] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-16T21:41:47.737041] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-16T21:41:47.737155] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-16T21:41:47.737198] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-16T21:41:47.737239] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-16T21:41:47.737326] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-16T21:41:47.952567] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-16T21:41:48.092528] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:41:48.743057] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-10-16T21:41:48.778144] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T21:41:49.074090] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-16T21:41:49.542831] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-16T21:41:49.722187] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-16T21:41:50.342868] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-16T21:41:50.850374] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T21:41:51.142786] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-16T21:41:51.220956] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T21:41:51.491923] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-16T21:41:51.942823] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-16T21:41:52.742874] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-16T21:41:53.318543] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T21:41:53.542835] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-16T21:41:54.252565] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T21:41:54.344140] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-16T21:41:54.346359] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T21:41:54.349540] [INFO ] [REMOTE ] STEW: Full fetch complete (21733 records). [2025-10-16T21:41:54.349685] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-16T21:41:54.711530] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-16T21:41:54.711607] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-16T21:41:54.712101] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-16T21:41:54.712163] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-16T21:41:54.712948] [DEBUG] [LOCAL ] STEW: Trimmed 21733 records to 15758 (keeping 200 days of data) [2025-10-16T21:41:54.805017] [DEBUG] [LOCAL ] STEW: Primary data saved (15758 records). [2025-10-16T21:41:54.805160] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-16T21:41:54.805239] [INFO ] [MAIN ] Update Progress: 2002/2369 symbols completed. STEW took 31.6s. Estimated remaining: 51m 40s. Rate: 7.1 symbols/min [2025-10-16T21:41:54.975732] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:41:54.987391] [DEBUG] [LOCAL ] STK: Loaded 9726 existing records from primary storage. [2025-10-16T21:41:54.987631] [INFO ] [MAIN ] STK: Loaded 9726 existing records. [2025-10-16T21:41:55.142883] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-16T21:41:55.165376] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:41:55.165698] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-16T21:41:55.165757] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-16T21:41:55.165909] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-16T21:41:55.165947] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-16T21:41:55.550167] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:41:55.772022] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T21:41:55.777179] [INFO ] [REMOTE ] STE: Full fetch complete (50878 records). [2025-10-16T21:41:55.777303] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-16T21:41:55.952422] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-16T21:41:56.209179] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-16T21:41:56.209338] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-16T21:41:56.210470] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-16T21:41:56.210535] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-16T21:41:56.211719] [DEBUG] [LOCAL ] STE: Trimmed 50878 records to 35653 (keeping 200 days of data) [2025-10-16T21:41:56.339171] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-16T21:41:56.440876] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-16T21:41:56.472138] [DEBUG] [LOCAL ] STE: Primary data saved (35653 records). [2025-10-16T21:41:56.472303] [INFO ] [MAIN ] STE: Full history saved. [2025-10-16T21:41:56.472389] [INFO ] [MAIN ] Update Progress: 2003/2369 symbols completed. STE took 33.3s. Estimated remaining: 51m 30s. Rate: 7.1 symbols/min [2025-10-16T21:41:56.646329] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:41:56.695839] [DEBUG] [LOCAL ] STLA: Loaded 53555 existing records from primary storage. [2025-10-16T21:41:56.696154] [INFO ] [MAIN ] STLA: Loaded 53555 existing records. [2025-10-16T21:41:56.747950] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-16T21:41:56.880868] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:41:56.881092] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-16T21:41:56.881148] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-16T21:41:56.881352] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-16T21:41:56.881417] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-16T21:41:57.219672] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:41:57.542860] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-10-16T21:41:58.287330] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-16T21:41:58.292710] [INFO ] [REMOTE ] STEM: Full fetch complete (61354 records). [2025-10-16T21:41:58.292812] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-16T21:41:58.347958] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-10-16T21:41:58.405351] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-16T21:41:58.689528] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-16T21:41:58.689626] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-16T21:41:58.690748] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-16T21:41:58.690821] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-16T21:41:58.692193] [DEBUG] [LOCAL ] STEM: Trimmed 61354 records to 39157 (keeping 200 days of data) [2025-10-16T21:41:58.922337] [DEBUG] [LOCAL ] STEM: Primary data saved (39157 records). [2025-10-16T21:41:58.922577] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-16T21:41:58.922707] [INFO ] [MAIN ] Update Progress: 2004/2369 symbols completed. STEM took 35.7s. Estimated remaining: 51m 21s. Rate: 7.1 symbols/min [2025-10-16T21:41:59.087622] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:41:59.136363] [DEBUG] [LOCAL ] STM: Loaded 53572 existing records from primary storage. [2025-10-16T21:41:59.136684] [INFO ] [MAIN ] STM: Loaded 53572 existing records. [2025-10-16T21:41:59.148062] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-16T21:41:59.316234] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:41:59.316485] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-16T21:41:59.316533] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-16T21:41:59.316798] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-16T21:41:59.316867] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-16T21:41:59.667844] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:41:59.942795] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-16T21:42:00.003523] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T21:42:00.538439] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T21:42:00.596791] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-16T21:42:00.742823] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-16T21:42:01.081422] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-16T21:42:01.542810] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-16T21:42:02.326181] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T21:42:02.342770] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-16T21:42:03.089517] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-16T21:42:03.142831] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-16T21:42:03.401245] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-16T21:42:03.942869] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-16T21:42:04.742844] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-16T21:42:04.801525] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T21:42:05.082155] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-16T21:42:05.542826] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-10-16T21:42:06.342820] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-16T21:42:07.142828] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-16T21:42:07.376292] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T21:42:07.942816] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-16T21:42:07.952692] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T21:42:08.410741] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-16T21:42:08.689123] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-16T21:42:08.742767] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-16T21:42:09.114365] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-16T21:42:09.542795] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-16T21:42:10.223097] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-16T21:42:10.342791] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-16T21:42:11.142830] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-16T21:42:11.884687] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-16T21:42:11.942782] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-16T21:42:12.480516] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-16T21:42:12.711309] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T21:42:12.742780] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-16T21:42:13.542804] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-16T21:42:13.607861] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T21:42:14.342816] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-16T21:42:15.071868] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T21:42:15.073820] [INFO ] [REMOTE ] STK: Full fetch complete (14298 records). [2025-10-16T21:42:15.073890] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-16T21:42:15.147905] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-16T21:42:15.441770] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-16T21:42:15.441849] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-16T21:42:15.442210] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-16T21:42:15.442251] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-16T21:42:15.442791] [DEBUG] [LOCAL ] STK: Trimmed 14298 records to 9817 (keeping 200 days of data) [2025-10-16T21:42:15.505164] [DEBUG] [LOCAL ] STK: Primary data saved (9817 records). [2025-10-16T21:42:15.505292] [INFO ] [MAIN ] STK: Full history saved. [2025-10-16T21:42:15.505372] [INFO ] [MAIN ] Update Progress: 2005/2369 symbols completed. STK took 20.7s. Estimated remaining: 51m 14s. Rate: 7.1 symbols/min [2025-10-16T21:42:15.681833] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:42:15.704791] [DEBUG] [LOCAL ] STN: Loaded 22793 existing records from primary storage. [2025-10-16T21:42:15.705050] [INFO ] [MAIN ] STN: Loaded 22793 existing records. [2025-10-16T21:42:15.739322] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-16T21:42:15.921616] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:42:15.925167] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-16T21:42:15.925440] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-16T21:42:15.927367] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-16T21:42:15.927417] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-16T21:42:15.927544] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-16T21:42:15.949347] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-16T21:42:16.320433] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:42:16.742848] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-16T21:42:17.088000] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-16T21:42:17.088777] [INFO ] [REMOTE ] STG: Full fetch complete (2499 records). [2025-10-16T21:42:17.088870] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-16T21:42:17.264078] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-16T21:42:17.264269] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:42:17.264342] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:42:17.264414] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-16T21:42:17.264476] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-16T21:42:17.264531] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-16T21:42:17.264571] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-16T21:42:17.264625] [INFO ] [MAIN ] Update Progress: 2006/2369 symbols completed. STG took 29.7s. Estimated remaining: 51m 4s. Rate: 7.1 symbols/min [2025-10-16T21:42:17.437284] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:42:17.477512] [DEBUG] [LOCAL ] STNG: Loaded 43606 existing records from primary storage. [2025-10-16T21:42:17.477817] [INFO ] [MAIN ] STNG: Loaded 43606 existing records. [2025-10-16T21:42:17.550778] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-10-16T21:42:17.656350] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:42:17.656673] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-16T21:42:17.656734] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-16T21:42:17.657540] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-16T21:42:17.657598] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-16T21:42:18.019183] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:42:18.125522] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-16T21:42:18.223723] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-16T21:42:18.342822] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-16T21:42:19.142857] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-16T21:42:19.942842] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-16T21:42:20.031806] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T21:42:20.304731] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-16T21:42:20.742870] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-16T21:42:21.542852] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-10-16T21:42:22.294615] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-16T21:42:22.342789] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-16T21:42:22.841787] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-16T21:42:23.106788] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T21:42:23.142771] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-16T21:42:23.355614] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T21:42:23.942812] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-16T21:42:24.742811] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-16T21:42:24.838354] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T21:42:25.542817] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-16T21:42:25.795810] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T21:42:26.342784] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-16T21:42:26.523963] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T21:42:26.737265] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T21:42:27.142881] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-16T21:42:27.942785] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-16T21:42:28.323200] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-16T21:42:28.742837] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-16T21:42:29.198830] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-16T21:42:29.542800] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-16T21:42:29.627185] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T21:42:29.925755] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-16T21:42:30.342801] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-16T21:42:31.142863] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-16T21:42:31.504052] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-16T21:42:31.533536] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-16T21:42:31.942813] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-16T21:42:32.742791] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-16T21:42:32.813501] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T21:42:33.000037] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T21:42:33.542816] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-16T21:42:34.342843] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-16T21:42:34.361357] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-16T21:42:34.681147] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T21:42:35.142821] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-16T21:42:35.942849] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-16T21:42:36.070059] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T21:42:36.742840] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-16T21:42:37.136366] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T21:42:37.312547] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-16T21:42:37.542788] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-16T21:42:38.183505] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T21:42:38.342799] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-16T21:42:39.142821] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-16T21:42:39.435456] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T21:42:39.683555] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-16T21:42:39.942836] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-16T21:42:40.283359] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T21:42:40.742828] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-16T21:42:40.884436] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T21:42:40.887414] [INFO ] [REMOTE ] STN: Full fetch complete (32538 records). [2025-10-16T21:42:40.887505] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-16T21:42:41.377689] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-16T21:42:41.377820] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-16T21:42:41.379130] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-16T21:42:41.379235] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-16T21:42:41.380761] [DEBUG] [LOCAL ] STN: Trimmed 32538 records to 22966 (keeping 200 days of data) [2025-10-16T21:42:41.543149] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-16T21:42:41.612533] [DEBUG] [LOCAL ] STN: Primary data saved (22966 records). [2025-10-16T21:42:41.612762] [INFO ] [MAIN ] STN: Full history saved. [2025-10-16T21:42:41.612902] [INFO ] [MAIN ] Update Progress: 2007/2369 symbols completed. STN took 26.1s. Estimated remaining: 50m 59s. Rate: 7.1 symbols/min [2025-10-16T21:42:41.890478] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:42:41.908386] [DEBUG] [LOCAL ] STRV: Loaded 11163 existing records from primary storage. [2025-10-16T21:42:41.908733] [INFO ] [MAIN ] STRV: Loaded 11163 existing records. [2025-10-16T21:42:42.152299] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:42:42.152743] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-16T21:42:42.152964] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-16T21:42:42.153301] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-16T21:42:42.153374] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-16T21:42:42.355664] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-16T21:42:42.339152] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T21:42:42.551768] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:42:43.142787] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-16T21:42:43.652723] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-16T21:42:43.942800] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-16T21:42:44.335344] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T21:42:44.685507] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T21:42:44.742836] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-16T21:42:45.542834] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-10-16T21:42:45.950013] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-16T21:42:46.342897] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-16T21:42:46.545622] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-16T21:42:46.771722] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-16T21:42:46.778798] [INFO ] [REMOTE ] STM: Full fetch complete (77691 records). [2025-10-16T21:42:46.778935] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-16T21:42:47.156962] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-16T21:42:47.161594] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-16T21:42:47.161695] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-16T21:42:47.162971] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-16T21:42:47.163163] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-16T21:42:47.164744] [DEBUG] [LOCAL ] STM: Trimmed 77691 records to 53962 (keeping 200 days of data) [2025-10-16T21:42:47.489759] [DEBUG] [LOCAL ] STM: Primary data saved (53962 records). [2025-10-16T21:42:47.489891] [INFO ] [MAIN ] STM: Full history saved. [2025-10-16T21:42:47.489975] [INFO ] [MAIN ] Update Progress: 2008/2369 symbols completed. STM took 48.6s. Estimated remaining: 50m 50s. Rate: 7.1 symbols/min [2025-10-16T21:42:47.658690] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:42:47.707683] [DEBUG] [LOCAL ] STT: Loaded 51037 existing records from primary storage. [2025-10-16T21:42:47.707980] [INFO ] [MAIN ] STT: Loaded 51037 existing records. [2025-10-16T21:42:47.891439] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:42:47.891725] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-16T21:42:47.891786] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-16T21:42:47.892316] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-10-16T21:42:47.892373] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-16T21:42:47.947333] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-16T21:42:48.206771] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-16T21:42:48.221543] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-16T21:42:48.221733] [INFO ] [REMOTE ] STLA: Full fetch complete (77653 records). [2025-10-16T21:42:48.232474] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-16T21:42:48.405732] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:42:48.695425] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-16T21:42:48.695522] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-16T21:42:48.696752] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-16T21:42:48.696816] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-16T21:42:48.698473] [DEBUG] [LOCAL ] STLA: Trimmed 77653 records to 53945 (keeping 200 days of data) [2025-10-16T21:42:48.746457] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-10-16T21:42:49.013761] [DEBUG] [LOCAL ] STLA: Primary data saved (53945 records). [2025-10-16T21:42:49.013899] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-16T21:42:49.014708] [INFO ] [MAIN ] Update Progress: 2009/2369 symbols completed. STLA took 52.5s. Estimated remaining: 50m 40s. Rate: 7.1 symbols/min [2025-10-16T21:42:49.193756] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:42:49.194037] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-16T21:42:49.194246] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-16T21:42:49.194419] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-16T21:42:49.194464] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-16T21:42:49.194506] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-16T21:42:49.194538] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-16T21:42:49.553120] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-16T21:42:49.577841] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:42:49.580054] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T21:42:50.295957] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T21:42:50.342828] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-16T21:42:50.454886] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T21:42:51.142823] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-16T21:42:51.843044] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T21:42:51.848605] [INFO ] [REMOTE ] STNG: Full fetch complete (64289 records). [2025-10-16T21:42:51.848765] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-16T21:42:51.952817] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-16T21:42:52.235041] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-16T21:42:52.235122] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-16T21:42:52.236129] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-16T21:42:52.236226] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-16T21:42:52.237493] [DEBUG] [LOCAL ] STNG: Trimmed 64289 records to 43907 (keeping 200 days of data) [2025-10-16T21:42:52.494694] [DEBUG] [LOCAL ] STNG: Primary data saved (43907 records). [2025-10-16T21:42:52.494798] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-16T21:42:52.495267] [INFO ] [MAIN ] Update Progress: 2010/2369 symbols completed. STNG took 35.2s. Estimated remaining: 50m 31s. Rate: 7.1 symbols/min [2025-10-16T21:42:52.664385] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:42:52.693884] [DEBUG] [LOCAL ] STVN: Loaded 26820 existing records from primary storage. [2025-10-16T21:42:52.694476] [INFO ] [MAIN ] STVN: Loaded 26820 existing records. [2025-10-16T21:42:52.747778] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-10-16T21:42:52.871863] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T21:42:52.921146] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:42:52.922037] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-16T21:42:52.922288] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-16T21:42:52.923204] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-16T21:42:52.923289] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-16T21:42:53.014735] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:42:53.036496] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-10-16T21:42:53.037139] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:42:53.050015] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T21:42:53.063575] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-16T21:42:53.118725] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:42:53.156389] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-16T21:42:53.190741] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-16T21:42:53.203113] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-16T21:42:53.208324] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-16T21:42:53.227960] [INFO ] [MAIN ] Update Progress: 2011/2369 symbols completed. STUB took 4.2s. Estimated remaining: 50m 21s. Rate: 7.1 symbols/min [2025-10-16T21:42:53.484379] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:42:53.488186] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:42:53.542804] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-16T21:42:53.546099] [DEBUG] [LOCAL ] STWD: Loaded 51983 existing records from primary storage. [2025-10-16T21:42:53.546569] [INFO ] [MAIN ] STWD: Loaded 51983 existing records. [2025-10-16T21:42:53.720091] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:42:53.720311] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-16T21:42:53.720361] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-16T21:42:53.721043] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-10-16T21:42:53.721100] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-16T21:42:54.060138] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:42:54.342835] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-10-16T21:42:54.602315] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T21:42:55.142809] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-10-16T21:42:55.942849] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-16T21:42:56.019629] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-16T21:42:56.099298] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T21:42:56.742820] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-16T21:42:57.542786] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-16T21:42:57.584792] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T21:42:57.697784] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-16T21:42:58.342866] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-16T21:42:58.762973] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-16T21:42:59.142785] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-16T21:42:59.165875] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-16T21:42:59.942788] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-16T21:43:00.280255] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T21:43:00.742799] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-16T21:43:01.529700] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T21:43:01.542761] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-16T21:43:01.912431] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-16T21:43:02.342902] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-16T21:43:02.394440] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-16T21:43:03.142832] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-16T21:43:03.437519] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T21:43:03.942809] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-16T21:43:04.707423] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T21:43:04.742759] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-16T21:43:05.064768] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T21:43:05.346702] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-16T21:43:05.348559] [INFO ] [REMOTE ] STRV: Full fetch complete (17639 records). [2025-10-16T21:43:05.348631] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-16T21:43:05.548047] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-16T21:43:05.729714] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-16T21:43:05.729797] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-16T21:43:05.730170] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-16T21:43:05.730208] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-16T21:43:05.730749] [DEBUG] [LOCAL ] STRV: Trimmed 17639 records to 11224 (keeping 200 days of data) [2025-10-16T21:43:05.803431] [DEBUG] [LOCAL ] STRV: Primary data saved (11224 records). [2025-10-16T21:43:05.803593] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-16T21:43:05.803713] [INFO ] [MAIN ] Update Progress: 2012/2369 symbols completed. STRV took 24.2s. Estimated remaining: 50m 13s. Rate: 7.1 symbols/min [2025-10-16T21:43:05.968806] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:43:05.972272] [DEBUG] [LOCAL ] STXD: Loaded 1243 existing records from primary storage. [2025-10-16T21:43:05.972407] [INFO ] [MAIN ] STXD: Loaded 1243 existing records. [2025-10-16T21:43:06.148034] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:43:06.148314] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-16T21:43:06.148369] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-16T21:43:06.148503] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-16T21:43:06.148543] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-16T21:43:06.353985] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-16T21:43:06.521772] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:43:07.142825] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-10-16T21:43:07.363571] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T21:43:07.437975] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-10-16T21:43:07.661966] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T21:43:07.942820] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-16T21:43:08.389892] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-16T21:43:08.742822] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-16T21:43:09.542829] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-16T21:43:09.982617] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T21:43:10.340750] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T21:43:10.350274] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-16T21:43:11.142843] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-16T21:43:11.574814] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T21:43:11.586396] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-16T21:43:11.942820] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-16T21:43:12.409135] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-16T21:43:12.742820] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-16T21:43:13.194936] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-16T21:43:13.542873] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-16T21:43:14.342812] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-16T21:43:15.142842] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-16T21:43:15.433872] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-16T21:43:15.436516] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T21:43:15.942814] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-16T21:43:16.237397] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T21:43:16.297979] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-16T21:43:16.742820] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-16T21:43:17.063143] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-16T21:43:17.542869] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-16T21:43:17.893429] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-16T21:43:18.342806] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-16T21:43:19.142860] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-16T21:43:19.942825] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-16T21:43:20.228827] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-16T21:43:20.258342] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-16T21:43:20.259180] [INFO ] [REMOTE ] STXD: Full fetch complete (2049 records). [2025-10-16T21:43:20.259271] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-16T21:43:20.584556] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T21:43:20.654737] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-16T21:43:20.654835] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-16T21:43:20.654962] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-16T21:43:20.655003] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-16T21:43:20.655416] [DEBUG] [LOCAL ] STXD: Trimmed 2049 records to 1253 (keeping 200 days of data) [2025-10-16T21:43:20.663603] [DEBUG] [LOCAL ] STXD: Primary data saved (1253 records). [2025-10-16T21:43:20.663696] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-16T21:43:20.663784] [INFO ] [MAIN ] Update Progress: 2013/2369 symbols completed. STXD took 14.9s. Estimated remaining: 50m 6s. Rate: 7.1 symbols/min [2025-10-16T21:43:20.748122] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-16T21:43:20.834798] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:43:20.839150] [DEBUG] [LOCAL ] STXE: Loaded 2092 existing records from primary storage. [2025-10-16T21:43:20.839297] [INFO ] [MAIN ] STXE: Loaded 2092 existing records. [2025-10-16T21:43:21.013325] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:43:21.013574] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-16T21:43:21.013624] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-16T21:43:21.013814] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-16T21:43:21.013870] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-16T21:43:21.369123] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:43:21.542802] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-10-16T21:43:22.108110] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T21:43:22.342792] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-16T21:43:22.572264] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T21:43:22.819729] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T21:43:23.142860] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-16T21:43:23.942820] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-16T21:43:24.742905] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-16T21:43:24.904281] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T21:43:25.542848] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-16T21:43:25.614255] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T21:43:25.850067] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T21:43:26.342829] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-16T21:43:27.142805] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-16T21:43:27.450280] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-16T21:43:27.942779] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-16T21:43:27.981526] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T21:43:28.235183] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T21:43:28.742805] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-16T21:43:29.542823] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-16T21:43:29.613719] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T21:43:29.999083] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T21:43:30.342811] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-16T21:43:30.742383] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-16T21:43:31.142836] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-16T21:43:31.942785] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-16T21:43:32.124997] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T21:43:32.230930] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T21:43:32.234701] [INFO ] [REMOTE ] STVN: Full fetch complete (39350 records). [2025-10-16T21:43:32.234776] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-16T21:43:32.492529] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T21:43:32.602044] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-16T21:43:32.602109] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-16T21:43:32.602880] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-16T21:43:32.602939] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-16T21:43:32.603729] [DEBUG] [LOCAL ] STVN: Trimmed 39350 records to 26968 (keeping 200 days of data) [2025-10-16T21:43:32.748338] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-16T21:43:32.760496] [DEBUG] [LOCAL ] STVN: Primary data saved (26968 records). [2025-10-16T21:43:32.760581] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-16T21:43:32.760674] [INFO ] [MAIN ] Update Progress: 2014/2369 symbols completed. STVN took 40.3s. Estimated remaining: 49m 58s. Rate: 7.1 symbols/min [2025-10-16T21:43:32.953097] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:43:32.958082] [DEBUG] [LOCAL ] STXG: Loaded 2410 existing records from primary storage. [2025-10-16T21:43:32.958247] [INFO ] [MAIN ] STXG: Loaded 2410 existing records. [2025-10-16T21:43:33.129095] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:43:33.129295] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-16T21:43:33.129342] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-16T21:43:33.129500] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-16T21:43:33.129555] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-16T21:43:33.476538] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:43:33.542807] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-16T21:43:34.116192] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-16T21:43:34.349164] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-16T21:43:34.352500] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T21:43:34.361277] [INFO ] [REMOTE ] STWD: Full fetch complete (75374 records). [2025-10-16T21:43:34.361516] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-16T21:43:34.792277] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-16T21:43:34.814769] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-16T21:43:34.814895] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-16T21:43:34.816605] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-16T21:43:34.816696] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-16T21:43:34.818865] [DEBUG] [LOCAL ] STWD: Trimmed 75374 records to 52371 (keeping 200 days of data) [2025-10-16T21:43:35.146709] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-16T21:43:35.171838] [DEBUG] [LOCAL ] STWD: Primary data saved (52371 records). [2025-10-16T21:43:35.172103] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-16T21:43:35.172218] [INFO ] [MAIN ] Update Progress: 2015/2369 symbols completed. STWD took 41.9s. Estimated remaining: 49m 49s. Rate: 7.1 symbols/min [2025-10-16T21:43:35.360947] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:43:35.365428] [DEBUG] [LOCAL ] STXK: Loaded 1521 existing records from primary storage. [2025-10-16T21:43:35.365584] [INFO ] [MAIN ] STXK: Loaded 1521 existing records. [2025-10-16T21:43:35.555284] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:43:35.555573] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-16T21:43:35.555627] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-16T21:43:35.555844] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-16T21:43:35.555908] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-16T21:43:35.930787] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:43:35.942792] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-10-16T21:43:36.376936] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-16T21:43:36.742795] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-16T21:43:37.024353] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-16T21:43:37.191280] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-16T21:43:37.542829] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-16T21:43:37.988135] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-16T21:43:38.342803] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-16T21:43:38.797220] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-16T21:43:39.142818] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-16T21:43:39.621153] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-16T21:43:39.942884] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-16T21:43:40.742869] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-16T21:43:41.257296] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-16T21:43:41.542812] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-10-16T21:43:41.564723] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-16T21:43:41.572469] [INFO ] [REMOTE ] STT: Full fetch complete (74434 records). [2025-10-16T21:43:41.572743] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-16T21:43:41.972677] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-16T21:43:41.972815] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-16T21:43:41.974348] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-16T21:43:41.974417] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-16T21:43:41.976313] [DEBUG] [LOCAL ] STT: Trimmed 74434 records to 51424 (keeping 200 days of data) [2025-10-16T21:43:42.112057] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T21:43:42.325685] [DEBUG] [LOCAL ] STT: Primary data saved (51424 records). [2025-10-16T21:43:42.325906] [INFO ] [MAIN ] STT: Full history saved. [2025-10-16T21:43:42.326035] [INFO ] [MAIN ] Update Progress: 2016/2369 symbols completed. STT took 54.8s. Estimated remaining: 49m 40s. Rate: 7.1 symbols/min [2025-10-16T21:43:42.348090] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-16T21:43:42.508312] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:43:42.508694] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-16T21:43:42.508749] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-16T21:43:42.508842] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-16T21:43:42.508881] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-16T21:43:42.508929] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-16T21:43:42.508967] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-16T21:43:42.897287] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:43:42.901548] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T21:43:43.142797] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-16T21:43:43.594951] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T21:43:43.942791] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-16T21:43:44.504767] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T21:43:44.742808] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-16T21:43:45.190721] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-16T21:43:45.542879] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-16T21:43:46.108521] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T21:43:46.342873] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-16T21:43:46.740175] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-16T21:43:46.741151] [INFO ] [REMOTE ] STXE: Full fetch complete (3510 records). [2025-10-16T21:43:46.741222] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-16T21:43:47.115253] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-16T21:43:47.115328] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-16T21:43:47.115468] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-16T21:43:47.115542] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-16T21:43:47.115952] [DEBUG] [LOCAL ] STXE: Trimmed 3510 records to 2117 (keeping 200 days of data) [2025-10-16T21:43:47.129212] [DEBUG] [LOCAL ] STXE: Primary data saved (2117 records). [2025-10-16T21:43:47.129272] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-16T21:43:47.129359] [INFO ] [MAIN ] Update Progress: 2017/2369 symbols completed. STXE took 26.5s. Estimated remaining: 49m 31s. Rate: 7.1 symbols/min [2025-10-16T21:43:47.147927] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-16T21:43:47.305204] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:43:47.310691] [DEBUG] [LOCAL ] STXT: Loaded 2491 existing records from primary storage. [2025-10-16T21:43:47.310892] [INFO ] [MAIN ] STXT: Loaded 2491 existing records. [2025-10-16T21:43:47.508097] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:43:47.508372] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-16T21:43:47.508463] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-16T21:43:47.508623] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-16T21:43:47.508729] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-16T21:43:47.810050] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-16T21:43:47.909983] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:43:47.942855] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-16T21:43:48.504550] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T21:43:48.742816] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-16T21:43:49.335379] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-16T21:43:49.542812] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-16T21:43:50.010262] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-16T21:43:50.342903] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-10-16T21:43:50.904365] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-16T21:43:51.142895] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-16T21:43:51.841391] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-16T21:43:51.942776] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-16T21:43:52.410201] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-16T21:43:52.742962] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-16T21:43:53.191344] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-16T21:43:53.543013] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-10-16T21:43:53.893987] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-16T21:43:54.342823] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-16T21:43:54.784482] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T21:43:55.142839] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-16T21:43:55.603722] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-16T21:43:55.942826] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-16T21:43:56.292143] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-16T21:43:56.742809] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-16T21:43:57.158281] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-16T21:43:57.542834] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-16T21:43:57.994383] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-16T21:43:58.342814] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-16T21:43:58.794698] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-16T21:43:59.142806] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-16T21:43:59.592370] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-16T21:43:59.942830] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-16T21:44:00.356378] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-16T21:44:00.742830] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-16T21:44:01.102572] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-16T21:44:01.542821] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-16T21:44:01.892632] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-16T21:44:02.342913] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-16T21:44:02.923587] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-16T21:44:03.142832] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-16T21:44:03.592061] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-16T21:44:03.942844] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-16T21:44:04.454842] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-16T21:44:04.742855] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-16T21:44:05.255775] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-16T21:44:05.542853] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-16T21:44:05.973195] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-16T21:44:06.342880] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-16T21:44:06.775564] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-16T21:44:07.142863] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-16T21:44:07.510950] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-16T21:44:07.942843] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-16T21:44:08.218329] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-16T21:44:08.742889] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-16T21:44:09.192533] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T21:44:09.542844] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-16T21:44:09.911243] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-16T21:44:09.912299] [INFO ] [REMOTE ] STXG: Full fetch complete (4075 records). [2025-10-16T21:44:09.912386] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-16T21:44:10.275726] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-16T21:44:10.275847] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-16T21:44:10.276034] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-16T21:44:10.276094] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-16T21:44:10.276484] [DEBUG] [LOCAL ] STXG: Trimmed 4075 records to 2433 (keeping 200 days of data) [2025-10-16T21:44:10.291726] [DEBUG] [LOCAL ] STXG: Primary data saved (2433 records). [2025-10-16T21:44:10.291835] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-16T21:44:10.291932] [INFO ] [MAIN ] Update Progress: 2018/2369 symbols completed. STXG took 37.5s. Estimated remaining: 49m 25s. Rate: 7.1 symbols/min [2025-10-16T21:44:10.348067] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-16T21:44:10.463679] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:44:10.467566] [DEBUG] [LOCAL ] STXV: Loaded 1517 existing records from primary storage. [2025-10-16T21:44:10.467735] [INFO ] [MAIN ] STXV: Loaded 1517 existing records. [2025-10-16T21:44:10.640182] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:44:10.640438] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-16T21:44:10.640487] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-16T21:44:10.640629] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-16T21:44:10.640722] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-16T21:44:10.794229] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T21:44:10.996745] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:44:11.142844] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-10-16T21:44:11.579401] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-16T21:44:11.942866] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-16T21:44:12.297687] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-16T21:44:12.742877] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-16T21:44:13.159324] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-16T21:44:13.542884] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-16T21:44:13.999829] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-16T21:44:14.342838] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-16T21:44:14.686826] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-16T21:44:14.687542] [INFO ] [REMOTE ] STXM: Full fetch complete (1409 records). [2025-10-16T21:44:14.687609] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-16T21:44:14.866202] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-16T21:44:14.866399] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:44:14.866467] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:44:14.866538] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-16T21:44:14.866604] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-16T21:44:14.866682] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-16T21:44:14.866751] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-16T21:44:14.866811] [INFO ] [MAIN ] Update Progress: 2019/2369 symbols completed. STXM took 32.5s. Estimated remaining: 49m 16s. Rate: 7.1 symbols/min [2025-10-16T21:44:15.033438] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:44:15.084809] [DEBUG] [LOCAL ] STZ: Loaded 52414 existing records from primary storage. [2025-10-16T21:44:15.085141] [INFO ] [MAIN ] STZ: Loaded 52414 existing records. [2025-10-16T21:44:15.148869] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-16T21:44:15.270557] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:44:15.270944] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-16T21:44:15.271008] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-16T21:44:15.272092] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-10-16T21:44:15.272153] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-16T21:44:15.626093] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-16T21:44:15.625886] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:44:15.942882] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-16T21:44:16.333607] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-16T21:44:16.334503] [INFO ] [REMOTE ] STXK: Full fetch complete (2431 records). [2025-10-16T21:44:16.334572] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-16T21:44:16.714770] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-16T21:44:16.714878] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-16T21:44:16.715017] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-16T21:44:16.715068] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-16T21:44:16.715759] [DEBUG] [LOCAL ] STXK: Trimmed 2431 records to 1535 (keeping 200 days of data) [2025-10-16T21:44:16.728580] [DEBUG] [LOCAL ] STXK: Primary data saved (1535 records). [2025-10-16T21:44:16.728787] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-16T21:44:16.728876] [INFO ] [MAIN ] Update Progress: 2020/2369 symbols completed. STXK took 41.6s. Estimated remaining: 49m 6s. Rate: 7.1 symbols/min [2025-10-16T21:44:16.748109] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-16T21:44:16.918426] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:44:16.972217] [DEBUG] [LOCAL ] SU: Loaded 53426 existing records from primary storage. [2025-10-16T21:44:16.972535] [INFO ] [MAIN ] SU: Loaded 53426 existing records. [2025-10-16T21:44:17.144742] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:44:17.144946] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-16T21:44:17.144992] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-16T21:44:17.145540] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-16T21:44:17.145596] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-16T21:44:17.393171] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T21:44:17.501701] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:44:17.542778] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-10-16T21:44:18.342839] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-16T21:44:18.795818] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-16T21:44:18.796781] [INFO ] [REMOTE ] STXT: Full fetch complete (3892 records). [2025-10-16T21:44:18.796850] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-16T21:44:19.144682] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-16T21:44:19.168007] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-16T21:44:19.168117] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-16T21:44:19.168301] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-16T21:44:19.168376] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-16T21:44:19.169052] [DEBUG] [LOCAL ] STXT: Trimmed 3892 records to 2516 (keeping 200 days of data) [2025-10-16T21:44:19.185685] [DEBUG] [LOCAL ] STXT: Primary data saved (2516 records). [2025-10-16T21:44:19.185873] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-16T21:44:19.185964] [INFO ] [MAIN ] Update Progress: 2021/2369 symbols completed. STXT took 32.1s. Estimated remaining: 48m 57s. Rate: 7.1 symbols/min [2025-10-16T21:44:19.356964] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:44:19.388432] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T21:44:19.434304] [DEBUG] [LOCAL ] SUI: Loaded 42096 existing records from primary storage. [2025-10-16T21:44:19.434626] [INFO ] [MAIN ] SUI: Loaded 42096 existing records. [2025-10-16T21:44:19.623483] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:44:19.623758] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-16T21:44:19.623812] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-16T21:44:19.624331] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-16T21:44:19.624389] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-16T21:44:19.696450] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T21:44:19.949835] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-16T21:44:19.979799] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:44:20.742840] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-16T21:44:21.275835] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-16T21:44:21.542790] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-16T21:44:21.637336] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T21:44:21.844191] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-16T21:44:22.342812] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-10-16T21:44:23.142812] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-10-16T21:44:23.941395] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T21:44:23.952277] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-16T21:44:24.742823] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-16T21:44:25.101758] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-16T21:44:25.542840] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-16T21:44:25.639163] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T21:44:26.320200] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T21:44:26.342778] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-16T21:44:27.142814] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-16T21:44:27.352430] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T21:44:27.421699] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-16T21:44:27.942833] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-16T21:44:28.039346] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T21:44:28.300118] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-16T21:44:28.742844] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-16T21:44:29.542813] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-16T21:44:30.342879] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-16T21:44:30.404051] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T21:44:30.799049] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T21:44:31.142845] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-16T21:44:31.306977] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T21:44:31.942879] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-16T21:44:32.748378] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-16T21:44:32.771881] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T21:44:33.542836] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-16T21:44:33.909017] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-16T21:44:34.342822] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-16T21:44:34.707969] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T21:44:34.815062] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-16T21:44:35.142819] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-16T21:44:35.942828] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-16T21:44:36.040835] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T21:44:36.742830] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-16T21:44:36.958800] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T21:44:37.405700] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T21:44:37.542813] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-16T21:44:38.342830] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-16T21:44:38.712587] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T21:44:38.773746] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-16T21:44:39.142788] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-16T21:44:39.209412] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T21:44:39.942811] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-16T21:44:40.393610] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T21:44:40.742795] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-16T21:44:41.293627] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-16T21:44:41.542806] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-16T21:44:42.349205] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-16T21:44:42.363910] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T21:44:43.142842] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-16T21:44:43.316308] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T21:44:43.417831] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-16T21:44:43.420241] [INFO ] [REMOTE ] STXV: Full fetch complete (2528 records). [2025-10-16T21:44:43.420452] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-16T21:44:43.931616] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-16T21:44:43.931831] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-16T21:44:43.932021] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-16T21:44:43.932127] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-16T21:44:43.932796] [DEBUG] [LOCAL ] STXV: Trimmed 2528 records to 1531 (keeping 200 days of data) [2025-10-16T21:44:43.942899] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-16T21:44:43.943403] [DEBUG] [LOCAL ] STXV: Primary data saved (1531 records). [2025-10-16T21:44:43.944817] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-16T21:44:43.944917] [INFO ] [MAIN ] Update Progress: 2022/2369 symbols completed. STXV took 33.7s. Estimated remaining: 48m 51s. Rate: 7.1 symbols/min [2025-10-16T21:44:44.124946] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:44:44.155820] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T21:44:44.198004] [DEBUG] [LOCAL ] SUN: Loaded 38400 existing records from primary storage. [2025-10-16T21:44:44.201567] [INFO ] [MAIN ] SUN: Loaded 38400 existing records. [2025-10-16T21:44:44.378747] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:44:44.379013] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-16T21:44:44.379070] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-16T21:44:44.379268] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-16T21:44:44.379331] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-16T21:44:44.733636] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:44:44.742795] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-16T21:44:45.542804] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-10-16T21:44:45.935948] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-16T21:44:46.342830] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-16T21:44:46.959658] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-16T21:44:47.019400] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T21:44:47.142818] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-16T21:44:47.874711] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T21:44:47.942791] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-16T21:44:48.250277] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T21:44:48.742869] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-16T21:44:49.424699] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T21:44:49.542812] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-16T21:44:50.342794] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-16T21:44:50.776183] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-16T21:44:51.142804] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-16T21:44:51.260877] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T21:44:51.942885] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-16T21:44:51.986028] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T21:44:52.059887] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T21:44:52.742890] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-16T21:44:53.542842] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-16T21:44:53.751014] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-16T21:44:53.757883] [INFO ] [REMOTE ] SU: Full fetch complete (77564 records). [2025-10-16T21:44:53.758002] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-16T21:44:54.148985] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-16T21:44:54.149081] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-16T21:44:54.150276] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-16T21:44:54.150342] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-16T21:44:54.152144] [DEBUG] [LOCAL ] SU: Trimmed 77564 records to 53816 (keeping 200 days of data) [2025-10-16T21:44:54.268370] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T21:44:54.276509] [INFO ] [REMOTE ] SUI: Full fetch complete (61069 records). [2025-10-16T21:44:54.277362] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-16T21:44:54.342916] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-16T21:44:54.841762] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-16T21:44:54.842239] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-16T21:44:54.845022] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-16T21:44:54.845228] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-16T21:44:54.852041] [DEBUG] [LOCAL ] SUI: Trimmed 61069 records to 42398 (keeping 200 days of data) [2025-10-16T21:44:55.096823] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T21:44:55.164431] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-16T21:44:55.177495] [DEBUG] [LOCAL ] SU: Primary data saved (53816 records). [2025-10-16T21:44:55.202784] [INFO ] [MAIN ] SU: Full history saved. [2025-10-16T21:44:55.205435] [INFO ] [MAIN ] Update Progress: 2023/2369 symbols completed. SU took 38.5s. Estimated remaining: 48m 43s. Rate: 7.1 symbols/min [2025-10-16T21:44:55.464118] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:44:55.472467] [DEBUG] [LOCAL ] SUI: Primary data saved (42398 records). [2025-10-16T21:44:55.472600] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-16T21:44:55.473297] [INFO ] [MAIN ] Update Progress: 2024/2369 symbols completed. SUI took 36.3s. Estimated remaining: 48m 33s. Rate: 7.1 symbols/min [2025-10-16T21:44:55.654901] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:44:55.680351] [DEBUG] [LOCAL ] SUPV: Loaded 47878 existing records from primary storage. [2025-10-16T21:44:55.680851] [INFO ] [MAIN ] SUPV: Loaded 47878 existing records. [2025-10-16T21:44:55.941431] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:44:55.941771] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-16T21:44:55.941854] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-16T21:44:55.943936] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-16T21:44:55.944220] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-16T21:44:55.944073] [DEBUG] [LOCAL ] SUZ: Loaded 45702 existing records from primary storage. [2025-10-16T21:44:56.036591] [INFO ] [MAIN ] SUZ: Loaded 45702 existing records. [2025-10-16T21:44:56.581861] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:44:56.577438] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:44:56.582888] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-10-16T21:44:56.583168] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-16T21:44:56.584780] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-16T21:44:56.601629] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-16T21:44:56.604533] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-16T21:44:56.619143] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-16T21:44:56.702313] [INFO ] [REMOTE ] STZ: Full fetch complete (76153 records). [2025-10-16T21:44:56.719446] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-16T21:44:56.951460] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T21:44:57.062632] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-16T21:44:57.351102] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:44:57.427430] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-16T21:44:57.427502] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-16T21:44:57.428758] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-16T21:44:57.428823] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-16T21:44:57.430322] [DEBUG] [LOCAL ] STZ: Trimmed 76153 records to 52801 (keeping 200 days of data) [2025-10-16T21:44:57.546774] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-10-16T21:44:57.758616] [DEBUG] [LOCAL ] STZ: Primary data saved (52801 records). [2025-10-16T21:44:57.758799] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-16T21:44:57.758889] [INFO ] [MAIN ] Update Progress: 2025/2369 symbols completed. STZ took 42.9s. Estimated remaining: 48m 24s. Rate: 7.1 symbols/min [2025-10-16T21:44:57.923412] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:44:57.964435] [DEBUG] [LOCAL ] SVV: Loaded 40205 existing records from primary storage. [2025-10-16T21:44:57.964776] [INFO ] [MAIN ] SVV: Loaded 40205 existing records. [2025-10-16T21:44:58.138077] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:44:58.138328] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-16T21:44:58.138379] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-16T21:44:58.138838] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-16T21:44:58.138895] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-16T21:44:58.534569] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:44:58.535079] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-10-16T21:44:58.562679] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-16T21:44:58.654036] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T21:44:59.142841] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-16T21:44:59.221776] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T21:44:59.920433] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T21:44:59.942809] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-16T21:45:00.580059] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T21:45:00.742805] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-16T21:45:01.542817] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-16T21:45:01.659045] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T21:45:01.899916] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T21:45:02.342847] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-16T21:45:03.142850] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-16T21:45:03.395155] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T21:45:03.654190] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T21:45:03.942819] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-16T21:45:04.604586] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T21:45:04.742809] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-16T21:45:05.456924] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T21:45:05.542783] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-16T21:45:05.957722] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-16T21:45:06.342803] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-16T21:45:07.142795] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-16T21:45:07.205469] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T21:45:07.894282] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T21:45:07.942814] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-16T21:45:08.742844] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-16T21:45:08.945967] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T21:45:09.403275] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T21:45:09.409163] [INFO ] [REMOTE ] SUN: Full fetch complete (55307 records). [2025-10-16T21:45:09.409339] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-16T21:45:09.548158] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-16T21:45:09.790041] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-16T21:45:09.790125] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-16T21:45:09.791031] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-16T21:45:09.791093] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-16T21:45:09.792159] [DEBUG] [LOCAL ] SUN: Trimmed 55307 records to 38717 (keeping 200 days of data) [2025-10-16T21:45:10.018463] [DEBUG] [LOCAL ] SUN: Primary data saved (38717 records). [2025-10-16T21:45:10.018606] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-16T21:45:10.019184] [INFO ] [MAIN ] Update Progress: 2026/2369 symbols completed. SUN took 26.1s. Estimated remaining: 48m 16s. Rate: 7.1 symbols/min [2025-10-16T21:45:10.188393] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:45:10.238262] [DEBUG] [LOCAL ] SW: Loaded 53187 existing records from primary storage. [2025-10-16T21:45:10.238589] [INFO ] [MAIN ] SW: Loaded 53187 existing records. [2025-10-16T21:45:10.347952] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-16T21:45:10.419916] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:45:10.420468] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-16T21:45:10.420605] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-16T21:45:10.420882] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-16T21:45:10.420942] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-16T21:45:10.700693] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T21:45:10.821914] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:45:11.107699] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T21:45:11.142772] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-16T21:45:11.942798] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-10-16T21:45:12.031369] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T21:45:12.742830] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-16T21:45:12.788022] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T21:45:13.542786] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-16T21:45:13.655951] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T21:45:14.342811] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-16T21:45:14.378615] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T21:45:15.142816] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-16T21:45:15.173066] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T21:45:15.942827] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-16T21:45:16.209346] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T21:45:16.694795] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T21:45:16.742770] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-16T21:45:17.308497] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T21:45:17.542825] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-16T21:45:18.071561] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T21:45:18.342833] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-16T21:45:18.964990] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T21:45:19.142843] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-16T21:45:19.916938] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T21:45:19.942783] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-16T21:45:20.465966] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T21:45:20.742806] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-16T21:45:21.542803] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-16T21:45:21.614196] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T21:45:22.123039] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T21:45:22.342805] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-16T21:45:22.990015] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T21:45:23.142802] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-16T21:45:23.875840] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T21:45:23.942791] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-16T21:45:24.314101] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T21:45:24.742836] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-16T21:45:25.542797] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-16T21:45:25.854045] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-16T21:45:26.342815] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-16T21:45:27.061138] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T21:45:27.142792] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-16T21:45:27.942805] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-16T21:45:28.357777] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-16T21:45:28.445670] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (3.70 seconds). [2025-10-16T21:45:28.620199] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T21:45:28.626366] [INFO ] [REMOTE ] SUZ: Full fetch complete (66786 records). [2025-10-16T21:45:28.626482] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-16T21:45:28.747964] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-16T21:45:29.016956] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-16T21:45:29.017032] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-16T21:45:29.018165] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-16T21:45:29.018255] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-16T21:45:29.019550] [DEBUG] [LOCAL ] SUZ: Trimmed 66786 records to 46035 (keeping 200 days of data) [2025-10-16T21:45:29.290868] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T21:45:29.321670] [DEBUG] [LOCAL ] SUZ: Primary data saved (46035 records). [2025-10-16T21:45:29.321787] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-16T21:45:29.322329] [INFO ] [MAIN ] Update Progress: 2027/2369 symbols completed. SUZ took 33.8s. Estimated remaining: 48m 9s. Rate: 7.1 symbols/min [2025-10-16T21:45:29.487558] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:45:29.540054] [DEBUG] [LOCAL ] SWK: Loaded 52481 existing records from primary storage. [2025-10-16T21:45:29.540380] [INFO ] [MAIN ] SWK: Loaded 52481 existing records. [2025-10-16T21:45:29.551484] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-16T21:45:29.716941] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:45:29.717164] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-16T21:45:29.717219] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-16T21:45:29.717692] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-16T21:45:29.717749] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-16T21:45:30.062764] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:45:30.342858] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-10-16T21:45:30.585902] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-16T21:45:31.090761] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-16T21:45:31.099316] [INFO ] [REMOTE ] SVV: Full fetch complete (57218 records). [2025-10-16T21:45:31.099475] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-16T21:45:31.154385] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-16T21:45:31.477487] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-16T21:45:31.477574] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-16T21:45:31.478591] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-16T21:45:31.478680] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-16T21:45:31.479925] [DEBUG] [LOCAL ] SVV: Trimmed 57218 records to 40548 (keeping 200 days of data) [2025-10-16T21:45:31.706292] [DEBUG] [LOCAL ] SVV: Primary data saved (40548 records). [2025-10-16T21:45:31.706420] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-16T21:45:31.706495] [INFO ] [MAIN ] Update Progress: 2028/2369 symbols completed. SVV took 33.9s. Estimated remaining: 48m 0s. Rate: 7.1 symbols/min [2025-10-16T21:45:31.901424] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:45:31.945571] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-16T21:45:31.951593] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T21:45:31.973399] [DEBUG] [LOCAL ] SWX: Loaded 31034 existing records from primary storage. [2025-10-16T21:45:31.973801] [INFO ] [MAIN ] SWX: Loaded 31034 existing records. [2025-10-16T21:45:32.147728] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:45:32.147992] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-16T21:45:32.148040] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-16T21:45:32.148250] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-16T21:45:32.148307] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-16T21:45:32.492755] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:45:32.742815] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-16T21:45:33.542854] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-10-16T21:45:33.713214] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T21:45:34.355408] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-16T21:45:34.381324] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (3.23 seconds). [2025-10-16T21:45:34.421923] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-16T21:45:34.461682] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T21:45:35.142820] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-16T21:45:35.942875] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-16T21:45:36.045906] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T21:45:36.054453] [INFO ] [REMOTE ] SUPV: Full fetch complete (68812 records). [2025-10-16T21:45:36.054750] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-16T21:45:36.602206] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-16T21:45:36.602321] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-16T21:45:36.603559] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-16T21:45:36.603664] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-16T21:45:36.605428] [DEBUG] [LOCAL ] SUPV: Trimmed 68812 records to 48253 (keeping 200 days of data) [2025-10-16T21:45:36.745038] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-16T21:45:36.750012] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T21:45:36.945673] [DEBUG] [LOCAL ] SUPV: Primary data saved (48253 records). [2025-10-16T21:45:36.945854] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-16T21:45:36.946426] [INFO ] [MAIN ] Update Progress: 2029/2369 symbols completed. SUPV took 41.7s. Estimated remaining: 47m 51s. Rate: 7.1 symbols/min [2025-10-16T21:45:37.111456] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:45:37.120139] [DEBUG] [LOCAL ] SWZ: Loaded 6053 existing records from primary storage. [2025-10-16T21:45:37.120371] [INFO ] [MAIN ] SWZ: Loaded 6053 existing records. [2025-10-16T21:45:37.295694] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:45:37.296046] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-16T21:45:37.296197] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-16T21:45:37.296370] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-16T21:45:37.296410] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-16T21:45:37.544776] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-16T21:45:37.651701] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:45:37.681578] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T21:45:37.735562] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T21:45:38.342810] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-16T21:45:39.142860] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-10-16T21:45:39.446796] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T21:45:39.739110] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-16T21:45:39.942848] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-16T21:45:40.156487] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T21:45:40.742816] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-16T21:45:41.542814] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-16T21:45:41.747717] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-16T21:45:41.960018] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T21:45:42.342810] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-16T21:45:43.142841] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-16T21:45:43.451893] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-16T21:45:43.942796] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-16T21:45:44.093755] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T21:45:44.100592] [INFO ] [REMOTE ] SW: Full fetch complete (77075 records). [2025-10-16T21:45:44.100738] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-16T21:45:44.490445] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-16T21:45:44.490622] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-16T21:45:44.491778] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-16T21:45:44.491839] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-16T21:45:44.493262] [DEBUG] [LOCAL ] SW: Trimmed 77075 records to 53577 (keeping 200 days of data) [2025-10-16T21:45:44.763699] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-16T21:45:44.813319] [DEBUG] [LOCAL ] SW: Primary data saved (53577 records). [2025-10-16T21:45:44.813423] [INFO ] [MAIN ] SW: Full history saved. [2025-10-16T21:45:44.813953] [INFO ] [MAIN ] Update Progress: 2030/2369 symbols completed. SW took 34.8s. Estimated remaining: 47m 42s. Rate: 7.1 symbols/min [2025-10-16T21:45:44.989572] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:45:45.007617] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-16T21:45:45.048807] [DEBUG] [LOCAL ] SXC: Loaded 41635 existing records from primary storage. [2025-10-16T21:45:45.049085] [INFO ] [MAIN ] SXC: Loaded 41635 existing records. [2025-10-16T21:45:45.246155] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:45:45.246356] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-16T21:45:45.246413] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-16T21:45:45.246576] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-16T21:45:45.246613] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-16T21:45:45.442691] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T21:45:45.547943] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-16T21:45:45.652543] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:45:45.866624] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-16T21:45:45.992802] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T21:45:46.342796] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-16T21:45:47.142866] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-16T21:45:47.657194] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T21:45:47.780786] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-16T21:45:47.942789] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-16T21:45:48.742836] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-10-16T21:45:49.542798] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-16T21:45:49.817688] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T21:45:50.306871] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T21:45:50.342778] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-16T21:45:50.927772] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T21:45:51.142797] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-16T21:45:51.595738] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T21:45:51.942850] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-16T21:45:51.969215] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T21:45:52.742909] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-16T21:45:53.542887] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-16T21:45:54.016381] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-16T21:45:54.175506] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-16T21:45:54.342872] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-16T21:45:54.748103] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T21:45:55.142838] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-16T21:45:55.760740] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T21:45:55.942825] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-16T21:45:56.530041] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-16T21:45:56.742846] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-16T21:45:56.900978] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T21:45:57.393824] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-16T21:45:57.542838] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-16T21:45:58.342878] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-16T21:45:58.933526] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T21:45:59.127210] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T21:45:59.142772] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-16T21:45:59.761765] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T21:45:59.942836] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-16T21:46:00.682710] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-16T21:46:00.742830] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-16T21:46:01.542823] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-16T21:46:02.084154] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T21:46:02.342822] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-16T21:46:03.142808] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-16T21:46:03.352512] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-16T21:46:03.359385] [INFO ] [REMOTE ] SWK: Full fetch complete (75552 records). [2025-10-16T21:46:03.359549] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-16T21:46:03.754366] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-16T21:46:03.754478] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-16T21:46:03.755684] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-16T21:46:03.755797] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-16T21:46:03.757468] [DEBUG] [LOCAL ] SWK: Trimmed 75552 records to 52860 (keeping 200 days of data) [2025-10-16T21:46:03.946890] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-10. [2025-10-16T21:46:04.017728] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T21:46:04.133077] [DEBUG] [LOCAL ] SWK: Primary data saved (52860 records). [2025-10-16T21:46:04.133231] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-16T21:46:04.133957] [INFO ] [MAIN ] Update Progress: 2031/2369 symbols completed. SWK took 34.8s. Estimated remaining: 47m 36s. Rate: 7.1 symbols/min [2025-10-16T21:46:04.304142] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:46:04.319691] [DEBUG] [LOCAL ] SXI: Loaded 11953 existing records from primary storage. [2025-10-16T21:46:04.319928] [INFO ] [MAIN ] SXI: Loaded 11953 existing records. [2025-10-16T21:46:04.482206] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-16T21:46:04.504907] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:46:04.513057] [INFO ] [REMOTE ] SWZ: Full fetch complete (8281 records). [2025-10-16T21:46:04.524436] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-16T21:46:04.525409] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-16T21:46:04.523775] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-16T21:46:04.525315] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T21:46:04.564049] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-16T21:46:04.598257] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-16T21:46:04.754821] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-16T21:46:05.258755] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:46:05.280880] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-16T21:46:05.280969] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-16T21:46:05.281218] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-16T21:46:05.281259] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-16T21:46:05.281735] [DEBUG] [LOCAL ] SWZ: Trimmed 8281 records to 6131 (keeping 200 days of data) [2025-10-16T21:46:05.314708] [DEBUG] [LOCAL ] SWZ: Primary data saved (6131 records). [2025-10-16T21:46:05.314838] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-16T21:46:05.314915] [INFO ] [MAIN ] Update Progress: 2032/2369 symbols completed. SWZ took 28.4s. Estimated remaining: 47m 26s. Rate: 7.1 symbols/min [2025-10-16T21:46:05.484810] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:46:05.517097] [DEBUG] [LOCAL ] SXT: Loaded 29865 existing records from primary storage. [2025-10-16T21:46:05.517372] [INFO ] [MAIN ] SXT: Loaded 29865 existing records. [2025-10-16T21:46:05.547961] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-16T21:46:05.696006] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:46:05.696225] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-16T21:46:05.696280] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-16T21:46:05.696727] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-16T21:46:05.696785] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-16T21:46:06.052583] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:46:06.342798] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-10-16T21:46:06.614248] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T21:46:06.802334] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T21:46:06.806262] [INFO ] [REMOTE ] SWX: Full fetch complete (44035 records). [2025-10-16T21:46:06.806372] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-16T21:46:07.150943] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-10-16T21:46:07.194102] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-16T21:46:07.194206] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-16T21:46:07.195405] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-16T21:46:07.195493] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-16T21:46:07.197047] [DEBUG] [LOCAL ] SWX: Trimmed 44035 records to 31180 (keeping 200 days of data) [2025-10-16T21:46:07.397582] [DEBUG] [LOCAL ] SWX: Primary data saved (31180 records). [2025-10-16T21:46:07.397745] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-16T21:46:07.397833] [INFO ] [MAIN ] Update Progress: 2033/2369 symbols completed. SWX took 35.7s. Estimated remaining: 47m 17s. Rate: 7.1 symbols/min [2025-10-16T21:46:07.531551] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T21:46:07.584287] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:46:07.634162] [DEBUG] [LOCAL ] SYF: Loaded 53454 existing records from primary storage. [2025-10-16T21:46:07.634493] [INFO ] [MAIN ] SYF: Loaded 53454 existing records. [2025-10-16T21:46:07.809406] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:46:07.809608] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-16T21:46:07.809683] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-16T21:46:07.810200] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-10-16T21:46:07.810257] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-16T21:46:07.949549] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-16T21:46:08.082598] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-16T21:46:08.183806] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:46:08.742858] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-16T21:46:09.077712] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T21:46:09.542889] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-16T21:46:09.610894] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T21:46:10.342852] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-16T21:46:11.026058] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T21:46:11.142851] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-16T21:46:11.414043] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T21:46:11.942860] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-16T21:46:12.027057] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T21:46:12.742815] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-16T21:46:13.293376] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T21:46:13.542800] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-16T21:46:13.611088] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-16T21:46:14.342839] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-16T21:46:15.016991] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T21:46:15.142788] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-10-16T21:46:15.186768] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-16T21:46:15.942809] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-16T21:46:16.742789] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-16T21:46:16.760138] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T21:46:16.935115] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T21:46:17.542814] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-16T21:46:18.249402] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T21:46:18.342795] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-16T21:46:19.054383] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T21:46:19.142835] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-16T21:46:19.187731] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T21:46:19.942781] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-16T21:46:20.337976] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-16T21:46:20.742857] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-16T21:46:21.542805] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-16T21:46:21.655032] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-16T21:46:21.743274] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T21:46:22.342902] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-16T21:46:23.136290] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T21:46:23.145043] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-16T21:46:23.201880] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-16T21:46:23.942854] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-16T21:46:24.113764] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T21:46:24.742819] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-16T21:46:25.518530] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-16T21:46:25.542787] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-16T21:46:26.318579] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T21:46:26.342793] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-16T21:46:26.676881] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T21:46:26.936379] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-16T21:46:27.142848] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-16T21:46:27.250352] [DEBUG] [REMOTE ] SYF: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-16T21:46:27.250699] [WARN ] [REMOTE ] SYF: No data returned for month 2025-03 [2025-10-16T21:46:27.250793] [FATAL] [REMOTE ] SYF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:46:27.250869] [FATAL] [MAIN ] SYF: Failed to fetch primary data. [2025-10-16T21:46:27.250933] [WARN ] [MAIN ] SYF: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:46:27.251007] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-16T21:46:27.251070] [DEBUG] [LOCAL ] SYF: No primary data file found to delete. [2025-10-16T21:46:27.251122] [INFO ] [LOCAL ] SYF: Starting deletion of derivative data. [2025-10-16T21:46:27.251252] [DEBUG] [LOCAL ] SYF: Deleted derivative data file. [2025-10-16T21:46:27.251334] [INFO ] [MAIN ] Update Progress: 2034/2369 symbols completed. SYF took 19.9s. Estimated remaining: 47m 10s. Rate: 7.1 symbols/min [2025-10-16T21:46:27.436800] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:46:27.481152] [DEBUG] [LOCAL ] SYK: Loaded 46942 existing records from primary storage. [2025-10-16T21:46:27.481521] [INFO ] [MAIN ] SYK: Loaded 46942 existing records. [2025-10-16T21:46:27.660941] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:46:27.661151] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-16T21:46:27.661203] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-16T21:46:27.661820] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-16T21:46:27.661883] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-16T21:46:27.949897] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-16T21:46:28.095367] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:46:28.742877] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-16T21:46:29.437191] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T21:46:29.453694] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-16T21:46:29.456255] [INFO ] [REMOTE ] SXI: Full fetch complete (15591 records). [2025-10-16T21:46:29.456331] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-16T21:46:29.548024] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-10-16T21:46:29.832608] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-16T21:46:29.832749] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-16T21:46:29.833322] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-16T21:46:29.833413] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-16T21:46:29.834097] [DEBUG] [LOCAL ] SXI: Trimmed 15591 records to 12057 (keeping 200 days of data) [2025-10-16T21:46:29.916518] [DEBUG] [LOCAL ] SXI: Primary data saved (12057 records). [2025-10-16T21:46:29.916752] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-16T21:46:29.916875] [INFO ] [MAIN ] Update Progress: 2035/2369 symbols completed. SXI took 25.8s. Estimated remaining: 47m 1s. Rate: 7.1 symbols/min [2025-10-16T21:46:30.093175] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:46:30.153733] [DEBUG] [LOCAL ] SYY: Loaded 53219 existing records from primary storage. [2025-10-16T21:46:30.154185] [INFO ] [MAIN ] SYY: Loaded 53219 existing records. [2025-10-16T21:46:30.336035] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:46:30.336294] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-16T21:46:30.336385] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-16T21:46:30.337143] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-16T21:46:30.337203] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-16T21:46:30.348122] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-16T21:46:30.708112] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:46:31.142843] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-10-16T21:46:31.391687] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-16T21:46:31.759903] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T21:46:31.763993] [INFO ] [REMOTE ] SXT: Full fetch complete (39461 records). [2025-10-16T21:46:31.764072] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-16T21:46:31.952484] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-16T21:46:32.169630] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-16T21:46:32.169740] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-16T21:46:32.170552] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-16T21:46:32.170594] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-16T21:46:32.171456] [DEBUG] [LOCAL ] SXT: Trimmed 39461 records to 30053 (keeping 200 days of data) [2025-10-16T21:46:32.359083] [DEBUG] [LOCAL ] SXT: Primary data saved (30053 records). [2025-10-16T21:46:32.359245] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-16T21:46:32.359327] [INFO ] [MAIN ] Update Progress: 2036/2369 symbols completed. SXT took 27.0s. Estimated remaining: 46m 51s. Rate: 7.1 symbols/min [2025-10-16T21:46:32.541697] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:46:32.594480] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-16T21:46:32.594884] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-10-16T21:46:32.744915] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-16T21:46:32.782314] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:46:32.782594] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-16T21:46:32.782760] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-16T21:46:32.783044] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-16T21:46:32.783101] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-16T21:46:33.189452] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:46:33.194149] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-16T21:46:33.510262] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T21:46:33.542786] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-16T21:46:34.342799] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-16T21:46:34.647860] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-16T21:46:35.142808] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-10-16T21:46:35.347839] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T21:46:35.379864] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T21:46:35.385674] [INFO ] [REMOTE ] SXC: Full fetch complete (61045 records). [2025-10-16T21:46:35.385817] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-16T21:46:35.763066] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-16T21:46:35.763146] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-16T21:46:35.764151] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-16T21:46:35.764214] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-16T21:46:35.765447] [DEBUG] [LOCAL ] SXC: Trimmed 61045 records to 41934 (keeping 200 days of data) [2025-10-16T21:46:35.945553] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-16T21:46:36.020419] [DEBUG] [LOCAL ] SXC: Primary data saved (41934 records). [2025-10-16T21:46:36.020572] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-16T21:46:36.021122] [INFO ] [MAIN ] Update Progress: 2037/2369 symbols completed. SXC took 51.2s. Estimated remaining: 46m 42s. Rate: 7.1 symbols/min [2025-10-16T21:46:36.742871] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-16T21:46:37.761300] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-16T21:46:37.775537] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-16T21:46:37.822799] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-16T21:46:38.342856] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-16T21:46:38.438628] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T21:46:39.142816] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-16T21:46:40.327967] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-10-16T21:46:40.344510] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-16T21:46:40.593104] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-16T21:46:40.742939] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-16T21:46:40.960716] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T21:46:41.542829] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-16T21:46:42.706314] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-16T21:46:42.716905] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-16T21:46:42.784269] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-16T21:46:43.142886] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-16T21:46:43.374146] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T21:46:43.942898] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-16T21:46:44.824567] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T21:46:44.834745] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-16T21:46:44.926076] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-16T21:46:45.542785] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-16T21:46:45.727601] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T21:46:46.342867] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-16T21:46:46.485073] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T21:46:47.142829] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-16T21:46:47.776081] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-16T21:46:47.942833] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-16T21:46:48.532615] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T21:46:48.572771] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-16T21:46:48.742835] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-16T21:46:49.542822] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-16T21:46:50.409588] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-16T21:46:50.421188] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-16T21:46:50.456440] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T21:46:51.027743] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T21:46:51.142786] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-16T21:46:51.942887] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-16T21:46:52.448260] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-16T21:46:52.742961] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-16T21:46:53.010816] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T21:46:53.542848] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-16T21:46:53.723132] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T21:46:54.342906] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-16T21:46:54.783400] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-16T21:46:54.789912] [INFO ] [REMOTE ] SYK: Full fetch complete (69190 records). [2025-10-16T21:46:54.790055] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-16T21:46:55.256280] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-16T21:46:55.256567] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-16T21:46:55.268315] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-16T21:46:55.269865] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-16T21:46:55.270340] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-16T21:46:55.270262] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-16T21:46:55.272881] [DEBUG] [LOCAL ] SYK: Trimmed 69190 records to 47294 (keeping 200 days of data) [2025-10-16T21:46:55.525866] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T21:46:55.612716] [DEBUG] [LOCAL ] SYK: Primary data saved (47294 records). [2025-10-16T21:46:55.612855] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-16T21:46:55.612940] [INFO ] [MAIN ] Update Progress: 2038/2369 symbols completed. SYK took 28.4s. Estimated remaining: 46m 35s. Rate: 7.1 symbols/min [2025-10-16T21:46:55.942892] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-16T21:46:56.618889] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T21:46:56.625990] [INFO ] [REMOTE ] SYY: Full fetch complete (77194 records). [2025-10-16T21:46:56.626159] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-16T21:46:57.017796] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-16T21:46:57.017888] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-16T21:46:57.019133] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-16T21:46:57.019195] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-16T21:46:57.020619] [DEBUG] [LOCAL ] SYY: Trimmed 77194 records to 53602 (keeping 200 days of data) [2025-10-16T21:46:57.354852] [DEBUG] [LOCAL ] SYY: Primary data saved (53602 records). [2025-10-16T21:46:57.355003] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-16T21:46:57.355582] [INFO ] [MAIN ] Update Progress: 2039/2369 symbols completed. SYY took 27.4s. Estimated remaining: 46m 26s. Rate: 7.1 symbols/min [2025-10-16T21:46:57.717081] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-16T21:46:57.728411] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-16T21:47:00.105976] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-16T21:47:00.117367] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-16T21:47:00.846775] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T21:47:00.853727] [INFO ] [REMOTE ] T: Full fetch complete (77978 records). [2025-10-16T21:47:00.853898] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-16T21:47:01.276077] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-16T21:47:01.276175] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-16T21:47:01.277329] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-16T21:47:01.277399] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-16T21:47:01.279025] [DEBUG] [LOCAL ] T: Trimmed 77978 records to 54188 (keeping 200 days of data) [2025-10-16T21:47:01.610441] [DEBUG] [LOCAL ] T: Primary data saved (54188 records). [2025-10-16T21:47:01.610694] [INFO ] [MAIN ] T: Full history saved. [2025-10-16T21:47:01.611312] [INFO ] [MAIN ] Update Progress: 2040/2369 symbols completed. T took 29.3s. Estimated remaining: 46m 17s. Rate: 7.1 symbols/min [2025-10-16T21:47:02.312225] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:47:02.334251] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:47:02.377860] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:47:02.404558] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:47:02.500275] [DEBUG] [LOCAL ] TAC: Loaded 43086 existing records from primary storage. [2025-10-16T21:47:02.501331] [DEBUG] [LOCAL ] TALO: Loaded 50983 existing records from primary storage. [2025-10-16T21:47:02.501989] [INFO ] [MAIN ] TAC: Loaded 43086 existing records. [2025-10-16T21:47:02.502164] [INFO ] [MAIN ] TALO: Loaded 50983 existing records. [2025-10-16T21:47:02.736464] [DEBUG] [LOCAL ] TAL: Loaded 51791 existing records from primary storage. [2025-10-16T21:47:02.770134] [INFO ] [MAIN ] TAL: Loaded 51791 existing records. [2025-10-16T21:47:02.725167] [DEBUG] [LOCAL ] TAK: Loaded 50163 existing records from primary storage. [2025-10-16T21:47:02.829139] [INFO ] [MAIN ] TAK: Loaded 50163 existing records. [2025-10-16T21:47:03.051249] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:47:03.065213] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-16T21:47:03.072250] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-16T21:47:03.112124] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:47:03.127577] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-16T21:47:03.182989] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-16T21:47:03.172446] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-16T21:47:03.186846] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-16T21:47:03.226666] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-16T21:47:03.270786] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-16T21:47:03.270698] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:47:03.345838] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-16T21:47:03.400635] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-16T21:47:03.436506] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:47:03.462540] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-16T21:47:03.467908] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-16T21:47:03.467831] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-16T21:47:03.495372] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-16T21:47:03.505262] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-16T21:47:03.531795] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-16T21:47:04.459170] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:47:04.554118] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:47:04.583870] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-10-16T21:47:04.594612] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-10-16T21:47:04.828167] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:47:04.836247] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-10-16T21:47:04.857724] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:47:04.858194] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-10-16T21:47:06.300976] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T21:47:06.311061] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-16T21:47:06.395702] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-16T21:47:06.404919] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-16T21:47:06.469509] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T21:47:06.480113] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-16T21:47:06.524003] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T21:47:06.535054] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-16T21:47:07.451169] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T21:47:07.461853] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-16T21:47:07.907319] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T21:47:07.918407] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-16T21:47:08.062895] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T21:47:08.076401] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-16T21:47:08.351807] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T21:47:08.362944] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-16T21:47:09.046124] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T21:47:09.056086] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-16T21:47:09.212673] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T21:47:09.222571] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-16T21:47:09.487770] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T21:47:09.542786] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-16T21:47:09.927995] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-16T21:47:10.342817] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-16T21:47:10.904066] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T21:47:11.142789] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-16T21:47:11.313250] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T21:47:11.372976] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-16T21:47:11.925701] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T21:47:11.942774] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-16T21:47:12.742797] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-16T21:47:12.853289] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T21:47:13.542821] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-16T21:47:13.568311] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T21:47:14.253086] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T21:47:14.342784] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-16T21:47:15.142849] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-16T21:47:15.537403] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T21:47:15.942859] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-16T21:47:16.110137] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T21:47:16.690841] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T21:47:16.742820] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-16T21:47:17.177472] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T21:47:17.542816] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-16T21:47:18.342878] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-16T21:47:18.413848] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T21:47:19.119310] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T21:47:19.142825] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-16T21:47:19.893726] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T21:47:19.942772] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-16T21:47:20.525823] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T21:47:20.742833] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-16T21:47:21.542852] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-16T21:47:21.701462] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T21:47:22.342852] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-16T21:47:22.504328] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T21:47:22.797126] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T21:47:23.142805] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-16T21:47:23.942853] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-16T21:47:24.136241] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T21:47:24.742833] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-16T21:47:24.775886] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T21:47:25.210677] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-16T21:47:25.542831] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-16T21:47:26.342832] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-16T21:47:26.593674] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T21:47:27.142850] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-16T21:47:27.281841] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T21:47:27.942830] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-16T21:47:28.025816] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T21:47:28.225513] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-16T21:47:28.742856] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-16T21:47:29.348009] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T21:47:29.355265] [INFO ] [REMOTE ] TALO: Full fetch complete (73467 records). [2025-10-16T21:47:29.355489] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-16T21:47:29.543673] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-16T21:47:29.767142] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-16T21:47:29.767252] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-16T21:47:29.768944] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-16T21:47:29.769014] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-16T21:47:29.770944] [DEBUG] [LOCAL ] TALO: Trimmed 73467 records to 51350 (keeping 200 days of data) [2025-10-16T21:47:30.087877] [DEBUG] [LOCAL ] TALO: Primary data saved (51350 records). [2025-10-16T21:47:30.088097] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-16T21:47:30.088266] [INFO ] [MAIN ] Update Progress: 2041/2369 symbols completed. TALO took 28.5s. Estimated remaining: 46m 12s. Rate: 7.1 symbols/min [2025-10-16T21:47:30.263775] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:47:30.327184] [DEBUG] [LOCAL ] TAP: Loaded 52965 existing records from primary storage. [2025-10-16T21:47:30.327621] [INFO ] [MAIN ] TAP: Loaded 52965 existing records. [2025-10-16T21:47:30.349751] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-16T21:47:30.522676] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:47:30.523046] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-16T21:47:30.523109] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-16T21:47:30.523428] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-16T21:47:30.523513] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-16T21:47:30.751446] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-16T21:47:30.979227] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:47:31.142812] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-16T21:47:31.452733] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-16T21:47:31.882572] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T21:47:31.942832] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-16T21:47:32.587727] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T21:47:32.595036] [INFO ] [REMOTE ] TAL: Full fetch complete (75749 records). [2025-10-16T21:47:32.595190] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-16T21:47:32.749395] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-16T21:47:33.002924] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-16T21:47:33.003032] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-16T21:47:33.004902] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-16T21:47:33.004994] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-16T21:47:33.007002] [DEBUG] [LOCAL ] TAL: Trimmed 75749 records to 52161 (keeping 200 days of data) [2025-10-16T21:47:33.344206] [DEBUG] [LOCAL ] TAL: Primary data saved (52161 records). [2025-10-16T21:47:33.344391] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-16T21:47:33.345549] [INFO ] [MAIN ] Update Progress: 2042/2369 symbols completed. TAL took 31.7s. Estimated remaining: 46m 2s. Rate: 7.1 symbols/min [2025-10-16T21:47:33.524091] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:47:33.540666] [DEBUG] [LOCAL ] TBB: Loaded 11523 existing records from primary storage. [2025-10-16T21:47:33.540990] [INFO ] [MAIN ] TBB: Loaded 11523 existing records. [2025-10-16T21:47:33.573773] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-10-16T21:47:33.678884] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T21:47:33.731417] [INFO ] [REMOTE ] TAC: Full fetch complete (64478 records). [2025-10-16T21:47:33.770230] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-16T21:47:33.776408] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:47:33.776760] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-16T21:47:33.776847] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-16T21:47:33.777108] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-16T21:47:33.777164] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-16T21:47:34.526384] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:47:34.532094] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-10-16T21:47:34.635716] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-16T21:47:34.636559] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-16T21:47:34.640306] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-16T21:47:34.638302] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-16T21:47:34.640492] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-16T21:47:34.648476] [INFO ] [REMOTE ] TAK: Full fetch complete (71922 records). [2025-10-16T21:47:34.648858] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-16T21:47:34.649908] [DEBUG] [LOCAL ] TAC: Trimmed 64478 records to 43476 (keeping 200 days of data) [2025-10-16T21:47:35.262456] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-16T21:47:35.291189] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-16T21:47:35.316363] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-16T21:47:35.342545] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-16T21:47:35.359196] [DEBUG] [LOCAL ] TAC: Primary data saved (43476 records). [2025-10-16T21:47:35.359549] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-16T21:47:35.359959] [INFO ] [MAIN ] Update Progress: 2043/2369 symbols completed. TAC took 33.7s. Estimated remaining: 45m 53s. Rate: 7.1 symbols/min [2025-10-16T21:47:35.365480] [DEBUG] [LOCAL ] TAK: Trimmed 71922 records to 50538 (keeping 200 days of data) [2025-10-16T21:47:35.637598] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:47:35.828280] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-16T21:47:35.843204] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-16T21:47:35.842555] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T21:47:35.869638] [DEBUG] [LOCAL ] TBBB: Loaded 35786 existing records from primary storage. [2025-10-16T21:47:35.875377] [INFO ] [MAIN ] TBBB: Loaded 35786 existing records. [2025-10-16T21:47:35.947057] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-16T21:47:36.119577] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:47:36.131751] [DEBUG] [LOCAL ] TAK: Primary data saved (50538 records). [2025-10-16T21:47:36.131862] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-16T21:47:36.131977] [INFO ] [MAIN ] Update Progress: 2044/2369 symbols completed. TAK took 34.5s. Estimated remaining: 45m 43s. Rate: 7.1 symbols/min [2025-10-16T21:47:36.127467] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-16T21:47:36.153577] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-16T21:47:36.228939] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-16T21:47:36.240409] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-16T21:47:36.469037] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:47:36.693009] [DEBUG] [LOCAL ] TBI: Loaded 22558 existing records from primary storage. [2025-10-16T21:47:36.725972] [INFO ] [MAIN ] TBI: Loaded 22558 existing records. [2025-10-16T21:47:37.060768] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:47:37.072455] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-10-16T21:47:37.134980] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T21:47:37.164491] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:47:37.168814] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-16T21:47:37.168870] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-16T21:47:37.169031] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-16T21:47:37.169082] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-16T21:47:37.524255] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:47:37.542789] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-10-16T21:47:37.617552] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T21:47:38.342845] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-16T21:47:38.447563] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T21:47:38.660880] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-16T21:47:39.082896] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T21:47:39.142826] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-16T21:47:39.942890] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-16T21:47:40.244838] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T21:47:40.443195] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-16T21:47:40.742824] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-16T21:47:41.542846] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-16T21:47:41.618555] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-16T21:47:42.342818] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-10-16T21:47:43.080685] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T21:47:43.142785] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-16T21:47:43.249454] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T21:47:43.942837] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-16T21:47:44.742797] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-10-16T21:47:44.858832] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T21:47:44.907671] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T21:47:45.203192] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-16T21:47:45.542829] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-10-16T21:47:46.294676] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-16T21:47:46.342779] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-10-16T21:47:47.113855] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T21:47:47.142781] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-10-16T21:47:47.879167] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-16T21:47:47.942826] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-16T21:47:48.742812] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-16T21:47:49.542857] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-16T21:47:49.916463] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T21:47:50.243721] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T21:47:50.342837] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-10. [2025-10-16T21:47:50.540210] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T21:47:51.026268] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T21:47:51.027912] [INFO ] [REMOTE ] TBB: Full fetch complete (16646 records). [2025-10-16T21:47:51.027985] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-16T21:47:51.147950] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-16T21:47:51.398267] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-16T21:47:51.398396] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-16T21:47:51.398889] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-16T21:47:51.398952] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-16T21:47:51.399455] [DEBUG] [LOCAL ] TBB: Trimmed 16646 records to 11583 (keeping 200 days of data) [2025-10-16T21:47:51.468413] [DEBUG] [LOCAL ] TBB: Primary data saved (11583 records). [2025-10-16T21:47:51.468539] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-16T21:47:51.468710] [INFO ] [MAIN ] Update Progress: 2045/2369 symbols completed. TBB took 18.1s. Estimated remaining: 45m 36s. Rate: 7.1 symbols/min [2025-10-16T21:47:51.639380] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:47:51.639535] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-16T21:47:51.639573] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-16T21:47:51.639709] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-16T21:47:51.639761] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-16T21:47:51.639805] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-16T21:47:51.639838] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-16T21:47:51.949638] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-16T21:47:51.994689] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:47:52.742824] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-16T21:47:53.094386] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-16T21:47:53.121851] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T21:47:53.542842] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-10-16T21:47:53.900286] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-16T21:47:54.342809] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-16T21:47:54.680761] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-16T21:47:55.142800] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-16T21:47:55.484732] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-16T21:47:55.794277] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (3.05 seconds). [2025-10-16T21:47:55.942840] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-16T21:47:56.283258] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-16T21:47:56.742855] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-16T21:47:57.542841] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-16T21:47:58.342844] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-16T21:47:58.549163] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T21:47:58.597436] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T21:47:58.701410] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-16T21:47:59.142835] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-16T21:47:59.942823] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-16T21:48:00.602468] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T21:48:00.742830] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-16T21:48:01.142973] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-16T21:48:01.542824] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-16T21:48:01.748789] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T21:48:02.342814] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-16T21:48:02.925998] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T21:48:03.142845] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-16T21:48:03.503724] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-16T21:48:03.727929] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-16T21:48:03.942828] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-16T21:48:04.273027] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-16T21:48:04.742836] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-16T21:48:05.542816] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-16T21:48:05.914123] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-16T21:48:06.342821] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-16T21:48:06.419335] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T21:48:06.698038] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-16T21:48:07.142851] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-16T21:48:07.899514] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T21:48:07.942789] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-16T21:48:08.742852] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-16T21:48:09.542842] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-16T21:48:09.661741] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T21:48:09.669479] [INFO ] [REMOTE ] TAP: Full fetch complete (76484 records). [2025-10-16T21:48:09.669637] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-16T21:48:09.971586] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-16T21:48:09.995278] [INFO ] [REMOTE ] TBLU: Full fetch complete (1225 records). [2025-10-16T21:48:10.011154] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-16T21:48:10.174504] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-16T21:48:10.236910] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-16T21:48:10.256104] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-16T21:48:10.236748] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T21:48:10.296234] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-16T21:48:10.303055] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-16T21:48:10.303167] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-16T21:48:10.291418] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-16T21:48:10.303972] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-16T21:48:10.304624] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-16T21:48:10.304725] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-16T21:48:10.304874] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-16T21:48:10.305058] [INFO ] [MAIN ] Update Progress: 2046/2369 symbols completed. TBLU took 18.8s. Estimated remaining: 45m 29s. Rate: 7.1 symbols/min [2025-10-16T21:48:10.347457] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-16T21:48:10.367780] [DEBUG] [LOCAL ] TAP: Trimmed 76484 records to 53352 (keeping 200 days of data) [2025-10-16T21:48:10.587871] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:48:10.611547] [DEBUG] [LOCAL ] TBN: Loaded 3962 existing records from primary storage. [2025-10-16T21:48:10.662845] [INFO ] [MAIN ] TBN: Loaded 3962 existing records. [2025-10-16T21:48:10.909413] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:48:10.910598] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-16T21:48:10.914763] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-16T21:48:10.920706] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-16T21:48:10.920783] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-16T21:48:11.148981] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-16T21:48:11.215695] [DEBUG] [LOCAL ] TAP: Primary data saved (53352 records). [2025-10-16T21:48:11.228142] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-16T21:48:11.240513] [INFO ] [MAIN ] Update Progress: 2047/2369 symbols completed. TAP took 41.2s. Estimated remaining: 45m 19s. Rate: 7.1 symbols/min [2025-10-16T21:48:11.523458] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:48:11.541300] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:48:11.541390] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-16T21:48:11.541425] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-16T21:48:11.541533] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-16T21:48:11.541573] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-16T21:48:11.541613] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-16T21:48:11.541665] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-16T21:48:11.895179] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:48:11.939356] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T21:48:11.947150] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-10-16T21:48:12.244703] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T21:48:12.427813] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-16T21:48:12.742808] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-10-16T21:48:12.962256] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:48:12.962558] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-10-16T21:48:12.962671] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:48:12.962746] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-16T21:48:12.962811] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:48:12.962882] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-16T21:48:12.962944] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-16T21:48:12.962979] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-16T21:48:12.963017] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-16T21:48:12.963063] [INFO ] [MAIN ] Update Progress: 2048/2369 symbols completed. TCAI took 1.7s. Estimated remaining: 45m 10s. Rate: 7.1 symbols/min [2025-10-16T21:48:13.141422] [INFO ] [MAIN ] TCBX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:48:13.153882] [DEBUG] [LOCAL ] TCBX: Loaded 10141 existing records from primary storage. [2025-10-16T21:48:13.154115] [INFO ] [MAIN ] TCBX: Loaded 10141 existing records. [2025-10-16T21:48:13.330428] [WARN ] [MAIN ] TCBX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:48:13.330629] [INFO ] [MAIN ] TCBX: Wiping existing primary data before full refresh. [2025-10-16T21:48:13.330709] [INFO ] [LOCAL ] TCBX: Starting deletion of primary data. [2025-10-16T21:48:13.330898] [DEBUG] [LOCAL ] TCBX: Deleted primary data file. [2025-10-16T21:48:13.330953] [INFO ] [MAIN ] TCBX: Starting full primary refresh. [2025-10-16T21:48:13.547992] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-16T21:48:13.679803] [INFO ] [REMOTE ] TCBX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:48:14.203059] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-16T21:48:14.342843] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-16T21:48:15.142833] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2024-12. [2025-10-16T21:48:15.349914] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T21:48:15.942795] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-16T21:48:16.015144] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T21:48:16.567065] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-16T21:48:16.742838] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-16T21:48:17.314507] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-16T21:48:17.542831] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-01. [2025-10-16T21:48:18.342767] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-16T21:48:18.458263] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T21:48:19.142826] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-02. [2025-10-16T21:48:19.336110] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T21:48:19.942865] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-16T21:48:19.958019] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T21:48:20.742837] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-16T21:48:21.048965] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T21:48:21.542839] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-16T21:48:22.151531] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T21:48:22.342792] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-03. [2025-10-16T21:48:22.579578] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T21:48:22.582857] [INFO ] [REMOTE ] TBI: Full fetch complete (31834 records). [2025-10-16T21:48:22.582930] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-16T21:48:22.943984] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-16T21:48:22.944061] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-16T21:48:22.944624] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-16T21:48:22.944694] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-16T21:48:22.945385] [DEBUG] [LOCAL ] TBI: Trimmed 31834 records to 22768 (keeping 200 days of data) [2025-10-16T21:48:23.066544] [DEBUG] [LOCAL ] TBI: Primary data saved (22768 records). [2025-10-16T21:48:23.066692] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-16T21:48:23.066781] [INFO ] [MAIN ] Update Progress: 2049/2369 symbols completed. TBI took 46.9s. Estimated remaining: 45m 2s. Rate: 7.1 symbols/min [2025-10-16T21:48:23.145443] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-16T21:48:23.220751] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-16T21:48:23.271445] [INFO ] [MAIN ] TCPA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:48:23.271851] [DEBUG] [LOCAL ] TCPA: No existing data file found in primary storage. [2025-10-16T21:48:23.271894] [WARN ] [MAIN ] TCPA: No existing data found, performing full refresh instead. [2025-10-16T21:48:23.272000] [INFO ] [MAIN ] TCPA: Wiping existing primary data before full refresh. [2025-10-16T21:48:23.272041] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-16T21:48:23.272098] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-16T21:48:23.272131] [INFO ] [MAIN ] TCPA: Starting full primary refresh. [2025-10-16T21:48:23.558430] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-16T21:48:23.630856] [INFO ] [REMOTE ] TCPA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:48:23.942807] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-16T21:48:24.742792] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-04. [2025-10-16T21:48:25.196118] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T21:48:25.542793] [INFO ] [REMOTE ] TCPA: Fetching primary data for 2024-12. [2025-10-16T21:48:25.646487] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T21:48:25.744358] [DEBUG] [REMOTE ] TCPA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:48:25.744712] [WARN ] [REMOTE ] TCPA: No data returned for month 2024-12 [2025-10-16T21:48:25.744803] [FATAL] [REMOTE ] TCPA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:48:25.744860] [FATAL] [MAIN ] TCPA: Failed to fetch primary data. [2025-10-16T21:48:25.744938] [WARN ] [MAIN ] TCPA: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:48:25.745039] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-16T21:48:25.745130] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-16T21:48:25.745182] [INFO ] [LOCAL ] TCPA: Starting deletion of derivative data. [2025-10-16T21:48:25.745258] [DEBUG] [LOCAL ] TCPA: No derivative data file found to delete. [2025-10-16T21:48:25.745320] [INFO ] [MAIN ] Update Progress: 2050/2369 symbols completed. TCPA took 2.7s. Estimated remaining: 44m 52s. Rate: 7.1 symbols/min [2025-10-16T21:48:25.914448] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:48:25.961452] [DEBUG] [LOCAL ] TD: Loaded 52329 existing records from primary storage. [2025-10-16T21:48:25.961785] [INFO ] [MAIN ] TD: Loaded 52329 existing records. [2025-10-16T21:48:26.138894] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:48:26.139126] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-16T21:48:26.139183] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-16T21:48:26.139362] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-16T21:48:26.139403] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-16T21:48:26.348061] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-16T21:48:26.497712] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:48:26.804587] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-16T21:48:27.142809] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-10-16T21:48:27.942839] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-16T21:48:28.742846] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-16T21:48:28.929051] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T21:48:29.106494] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-16T21:48:29.113244] [INFO ] [REMOTE ] TBBB: Full fetch complete (51995 records). [2025-10-16T21:48:29.113443] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-16T21:48:29.277975] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-16T21:48:29.548019] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-16T21:48:29.712421] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-16T21:48:29.712530] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-16T21:48:29.714008] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-16T21:48:29.714086] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-16T21:48:29.715423] [DEBUG] [LOCAL ] TBBB: Trimmed 51995 records to 36038 (keeping 200 days of data) [2025-10-16T21:48:29.980180] [DEBUG] [LOCAL ] TBBB: Primary data saved (36038 records). [2025-10-16T21:48:29.980331] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-16T21:48:29.980414] [INFO ] [MAIN ] Update Progress: 2051/2369 symbols completed. TBBB took 54.6s. Estimated remaining: 44m 43s. Rate: 7.1 symbols/min [2025-10-16T21:48:30.156633] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:48:30.197511] [DEBUG] [LOCAL ] TDC: Loaded 46556 existing records from primary storage. [2025-10-16T21:48:30.197861] [INFO ] [MAIN ] TDC: Loaded 46556 existing records. [2025-10-16T21:48:30.351431] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-05. [2025-10-16T21:48:30.376631] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:48:30.377061] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-16T21:48:30.377134] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-16T21:48:30.377427] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-16T21:48:30.377484] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-16T21:48:30.723348] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:48:31.141776] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-16T21:48:31.144573] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-16T21:48:31.387414] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-16T21:48:31.784222] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-16T21:48:31.942833] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-16T21:48:32.496631] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-16T21:48:32.742840] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-06. [2025-10-16T21:48:33.505057] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T21:48:33.542778] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-07. [2025-10-16T21:48:34.342815] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-16T21:48:34.387110] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-16T21:48:35.142869] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-16T21:48:35.843002] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-16T21:48:35.942790] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-10-16T21:48:35.979200] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T21:48:36.742820] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-16T21:48:37.473704] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T21:48:37.542783] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-08. [2025-10-16T21:48:38.174551] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T21:48:38.342836] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-16T21:48:38.345261] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T21:48:39.142819] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-16T21:48:39.835615] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T21:48:39.942780] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-16T21:48:40.742842] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-16T21:48:41.024132] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T21:48:41.542837] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-16T21:48:41.586855] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T21:48:41.588791] [INFO ] [REMOTE ] TBN: Full fetch complete (5930 records). [2025-10-16T21:48:41.588958] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-16T21:48:41.961552] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-16T21:48:41.961669] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-16T21:48:41.961867] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-16T21:48:41.961909] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-16T21:48:41.962273] [DEBUG] [LOCAL ] TBN: Trimmed 5930 records to 4014 (keeping 200 days of data) [2025-10-16T21:48:41.985454] [DEBUG] [LOCAL ] TBN: Primary data saved (4014 records). [2025-10-16T21:48:41.985547] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-16T21:48:41.985623] [INFO ] [MAIN ] Update Progress: 2052/2369 symbols completed. TBN took 31.7s. Estimated remaining: 44m 35s. Rate: 7.1 symbols/min [2025-10-16T21:48:42.161124] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:48:42.169109] [DEBUG] [LOCAL ] TDF: Loaded 6346 existing records from primary storage. [2025-10-16T21:48:42.169271] [INFO ] [MAIN ] TDF: Loaded 6346 existing records. [2025-10-16T21:48:42.312097] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-16T21:48:42.348763] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-09. [2025-10-16T21:48:42.386181] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:48:42.386468] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-16T21:48:42.386529] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-16T21:48:42.386715] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-16T21:48:42.386788] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-16T21:48:42.745766] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:48:43.113392] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T21:48:43.142778] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-10. [2025-10-16T21:48:43.445085] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T21:48:43.861167] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T21:48:43.863032] [INFO ] [REMOTE ] TCBX: Full fetch complete (15962 records). [2025-10-16T21:48:43.863101] [DEBUG] [VALIDATOR ] TCBX: Validating primary data. [2025-10-16T21:48:43.948033] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-16T21:48:44.230598] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present. [2025-10-16T21:48:44.230703] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed. [2025-10-16T21:48:44.231062] [INFO ] [MAIN ] TCBX: Fetched primary data is valid. [2025-10-16T21:48:44.231102] [DEBUG] [LOCAL ] TCBX: Saving primary data. [2025-10-16T21:48:44.231578] [DEBUG] [LOCAL ] TCBX: Trimmed 15962 records to 10278 (keeping 200 days of data) [2025-10-16T21:48:44.290410] [DEBUG] [LOCAL ] TCBX: Primary data saved (10278 records). [2025-10-16T21:48:44.290531] [INFO ] [MAIN ] TCBX: Full history saved. [2025-10-16T21:48:44.290846] [INFO ] [MAIN ] Update Progress: 2053/2369 symbols completed. TCBX took 31.3s. Estimated remaining: 44m 26s. Rate: 7.1 symbols/min [2025-10-16T21:48:44.458597] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:48:44.481809] [DEBUG] [LOCAL ] TDG: Loaded 22140 existing records from primary storage. [2025-10-16T21:48:44.482058] [INFO ] [MAIN ] TDG: Loaded 22140 existing records. [2025-10-16T21:48:44.655438] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:48:44.655702] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-16T21:48:44.655762] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-16T21:48:44.655953] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-16T21:48:44.656007] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-16T21:48:44.752038] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-10-16T21:48:45.009049] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:48:45.531435] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T21:48:45.542759] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-16T21:48:45.588423] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T21:48:46.342826] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-16T21:48:47.096874] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T21:48:47.142773] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-16T21:48:47.942838] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-10-16T21:48:48.171530] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-16T21:48:48.660257] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T21:48:48.742777] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-16T21:48:49.082833] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T21:48:49.542795] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-16T21:48:50.213739] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T21:48:50.342855] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-16T21:48:50.623215] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T21:48:51.142877] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-16T21:48:51.943254] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-16T21:48:52.052668] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T21:48:52.348895] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T21:48:52.667030] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-16T21:48:52.742785] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-16T21:48:53.542865] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-16T21:48:54.342860] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-16T21:48:54.405791] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T21:48:54.770026] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-16T21:48:55.142855] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-16T21:48:55.734975] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T21:48:55.942829] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-16T21:48:56.742798] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-16T21:48:56.866462] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T21:48:57.208208] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-16T21:48:57.245211] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T21:48:57.542817] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-16T21:48:58.342788] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-16T21:48:58.726755] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T21:48:59.076359] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T21:48:59.142825] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-16T21:48:59.942899] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-16T21:49:00.659241] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T21:49:00.742820] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-16T21:49:01.343156] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T21:49:01.542853] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-16T21:49:02.321918] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T21:49:02.328954] [INFO ] [REMOTE ] TDC: Full fetch complete (67657 records). [2025-10-16T21:49:02.329173] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-16T21:49:02.351580] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-16T21:49:02.738070] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-16T21:49:02.738166] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-16T21:49:02.739388] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-16T21:49:02.739463] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-16T21:49:02.741072] [DEBUG] [LOCAL ] TDC: Trimmed 67657 records to 46906 (keeping 200 days of data) [2025-10-16T21:49:03.022525] [DEBUG] [LOCAL ] TDC: Primary data saved (46906 records). [2025-10-16T21:49:03.022719] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-16T21:49:03.023332] [INFO ] [MAIN ] Update Progress: 2054/2369 symbols completed. TDC took 33.0s. Estimated remaining: 44m 19s. Rate: 7.1 symbols/min [2025-10-16T21:49:03.152407] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-16T21:49:03.200206] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:49:03.242708] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T21:49:03.302304] [DEBUG] [LOCAL ] TDOC: Loaded 53365 existing records from primary storage. [2025-10-16T21:49:03.302675] [INFO ] [MAIN ] TDOC: Loaded 53365 existing records. [2025-10-16T21:49:03.480493] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:49:03.480863] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-16T21:49:03.481023] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-16T21:49:03.481240] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-16T21:49:03.481280] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-16T21:49:03.763392] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-16T21:49:03.819193] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T21:49:03.877763] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:49:03.942780] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-10-16T21:49:04.742844] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-16T21:49:05.542866] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-16T21:49:06.050741] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-16T21:49:06.265714] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-16T21:49:06.342831] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-16T21:49:06.440553] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-16T21:49:06.447998] [INFO ] [REMOTE ] TD: Full fetch complete (75951 records). [2025-10-16T21:49:06.448180] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-16T21:49:06.862303] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-16T21:49:06.862407] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-16T21:49:06.863755] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-16T21:49:06.863822] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-16T21:49:06.865445] [DEBUG] [LOCAL ] TD: Trimmed 75951 records to 52715 (keeping 200 days of data) [2025-10-16T21:49:07.000350] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-16T21:49:07.171544] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-16T21:49:07.219765] [DEBUG] [LOCAL ] TD: Primary data saved (52715 records). [2025-10-16T21:49:07.220382] [INFO ] [MAIN ] TD: Full history saved. [2025-10-16T21:49:07.220636] [INFO ] [MAIN ] Update Progress: 2055/2369 symbols completed. TD took 41.5s. Estimated remaining: 44m 10s. Rate: 7.1 symbols/min [2025-10-16T21:49:07.397510] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:49:07.440042] [DEBUG] [LOCAL ] TDS: Loaded 42515 existing records from primary storage. [2025-10-16T21:49:07.440420] [INFO ] [MAIN ] TDS: Loaded 42515 existing records. [2025-10-16T21:49:07.618609] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:49:07.618970] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-16T21:49:07.619025] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-16T21:49:07.619303] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-16T21:49:07.619363] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-16T21:49:07.947951] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-16T21:49:07.977126] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:49:08.742790] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-10-16T21:49:09.258443] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-16T21:49:09.319439] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T21:49:09.542868] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-16T21:49:10.153991] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T21:49:10.298209] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T21:49:10.342848] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-16T21:49:10.943381] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-16T21:49:11.142862] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-16T21:49:11.942871] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-16T21:49:12.465568] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T21:49:12.742835] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-16T21:49:12.888385] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T21:49:13.542880] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-16T21:49:14.179706] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T21:49:14.181200] [INFO ] [REMOTE ] TDF: Full fetch complete (10483 records). [2025-10-16T21:49:14.181270] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-16T21:49:14.345817] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-16T21:49:14.548355] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-16T21:49:14.548433] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-16T21:49:14.548767] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-16T21:49:14.548828] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-16T21:49:14.549262] [DEBUG] [LOCAL ] TDF: Trimmed 10483 records to 6394 (keeping 200 days of data) [2025-10-16T21:49:14.589273] [DEBUG] [LOCAL ] TDF: Primary data saved (6394 records). [2025-10-16T21:49:14.589425] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-16T21:49:14.589511] [INFO ] [MAIN ] Update Progress: 2056/2369 symbols completed. TDF took 32.6s. Estimated remaining: 44m 1s. Rate: 7.1 symbols/min [2025-10-16T21:49:14.766486] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:49:14.808794] [DEBUG] [LOCAL ] TDW: Loaded 45036 existing records from primary storage. [2025-10-16T21:49:14.809114] [INFO ] [MAIN ] TDW: Loaded 45036 existing records. [2025-10-16T21:49:15.006318] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T21:49:15.005815] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:49:15.010416] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-16T21:49:15.011133] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-16T21:49:15.011381] [INFO ] [REMOTE ] TDG: Full fetch complete (32112 records). [2025-10-16T21:49:15.011486] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-16T21:49:15.022976] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-16T21:49:15.042620] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-16T21:49:15.158319] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-16T21:49:15.619518] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-10-16T21:49:15.788516] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-16T21:49:15.801591] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-16T21:49:15.839917] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-16T21:49:15.840021] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-16T21:49:15.843789] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:49:15.844985] [DEBUG] [LOCAL ] TDG: Trimmed 32112 records to 22358 (keeping 200 days of data) [2025-10-16T21:49:15.942823] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-10-16T21:49:15.991443] [DEBUG] [LOCAL ] TDG: Primary data saved (22358 records). [2025-10-16T21:49:15.991587] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-16T21:49:15.991690] [INFO ] [MAIN ] Update Progress: 2057/2369 symbols completed. TDG took 31.7s. Estimated remaining: 43m 52s. Rate: 7.1 symbols/min [2025-10-16T21:49:16.154173] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:49:16.175973] [DEBUG] [LOCAL ] TDY: Loaded 22260 existing records from primary storage. [2025-10-16T21:49:16.176230] [INFO ] [MAIN ] TDY: Loaded 22260 existing records. [2025-10-16T21:49:16.350474] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:49:16.350716] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-16T21:49:16.350772] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-16T21:49:16.350962] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-16T21:49:16.351017] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-16T21:49:16.703152] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:49:16.751845] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-16T21:49:16.756635] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T21:49:17.542781] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-10-16T21:49:17.596147] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T21:49:18.342893] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-16T21:49:18.620382] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-16T21:49:18.910840] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-16T21:49:19.142827] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-16T21:49:19.717207] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T21:49:19.831633] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T21:49:19.942816] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-16T21:49:20.742804] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-16T21:49:21.099942] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T21:49:21.542857] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-16T21:49:22.315631] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T21:49:22.342863] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-16T21:49:23.142861] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-16T21:49:23.187115] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T21:49:23.945984] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-16T21:49:23.952843] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T21:49:24.742788] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-16T21:49:25.096097] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T21:49:25.223458] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-16T21:49:25.542796] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-16T21:49:26.342804] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-16T21:49:26.445771] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T21:49:26.777117] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T21:49:27.142862] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-16T21:49:27.942847] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-16T21:49:28.009810] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T21:49:28.298287] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-16T21:49:28.742961] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-16T21:49:29.476361] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T21:49:29.542773] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-16T21:49:30.342878] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-16T21:49:30.586091] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T21:49:31.000429] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T21:49:31.142779] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-16T21:49:31.486464] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T21:49:31.942803] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-16T21:49:32.509379] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T21:49:32.742838] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-16T21:49:33.295385] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T21:49:33.542814] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-16T21:49:34.314905] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T21:49:34.342784] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-16T21:49:34.987705] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T21:49:35.142782] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-16T21:49:35.936321] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T21:49:35.945436] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-16T21:49:36.698635] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T21:49:36.742779] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-16T21:49:36.957345] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T21:49:37.542810] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-16T21:49:38.174379] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T21:49:38.342813] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-16T21:49:39.142818] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-16T21:49:39.433799] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T21:49:39.614982] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-16T21:49:39.942873] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-16T21:49:40.649539] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T21:49:40.742784] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-16T21:49:41.461752] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T21:49:41.542810] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-16T21:49:41.704337] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (0.16 seconds). [2025-10-16T21:49:41.707000] [INFO ] [REMOTE ] TDY: Full fetch complete (31976 records). [2025-10-16T21:49:41.707086] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-16T21:49:42.097926] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-16T21:49:42.098031] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-16T21:49:42.098926] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-16T21:49:42.098990] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-16T21:49:42.099841] [DEBUG] [LOCAL ] TDY: Trimmed 31976 records to 22418 (keeping 200 days of data) [2025-10-16T21:49:42.242249] [DEBUG] [LOCAL ] TDY: Primary data saved (22418 records). [2025-10-16T21:49:42.242389] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-16T21:49:42.242475] [INFO ] [MAIN ] Update Progress: 2058/2369 symbols completed. TDY took 26.3s. Estimated remaining: 43m 46s. Rate: 7.1 symbols/min [2025-10-16T21:49:42.344971] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-16T21:49:42.420119] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:49:42.434745] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-16T21:49:42.437081] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-16T21:49:42.438080] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-16T21:49:42.438837] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-16T21:49:42.438725] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-16T21:49:42.438978] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-16T21:49:42.439165] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-16T21:49:42.516243] [INFO ] [REMOTE ] TDW: Full fetch complete (66915 records). [2025-10-16T21:49:42.548818] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-16T21:49:43.080461] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:49:43.168156] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-10-16T21:49:43.258504] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-16T21:49:43.258590] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-16T21:49:43.259635] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-16T21:49:43.259718] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-16T21:49:43.261077] [DEBUG] [LOCAL ] TDW: Trimmed 66915 records to 45348 (keeping 200 days of data) [2025-10-16T21:49:43.424279] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:49:43.434181] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-10-16T21:49:43.434385] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:49:43.460749] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-16T21:49:43.461363] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:49:43.461728] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-16T21:49:43.464254] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-16T21:49:43.465092] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-16T21:49:43.465456] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-16T21:49:43.467613] [INFO ] [MAIN ] Update Progress: 2059/2369 symbols completed. TE took 1.2s. Estimated remaining: 43m 37s. Rate: 7.1 symbols/min [2025-10-16T21:49:43.667837] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:49:43.705488] [DEBUG] [LOCAL ] TDW: Primary data saved (45348 records). [2025-10-16T21:49:43.705736] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-16T21:49:43.706454] [INFO ] [MAIN ] Update Progress: 2060/2369 symbols completed. TDW took 29.1s. Estimated remaining: 43m 27s. Rate: 7.1 symbols/min [2025-10-16T21:49:43.780010] [DEBUG] [LOCAL ] TEAF: Loaded 7411 existing records from primary storage. [2025-10-16T21:49:43.786064] [INFO ] [MAIN ] TEAF: Loaded 7411 existing records. [2025-10-16T21:49:43.961423] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-16T21:49:44.023099] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:49:44.069062] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T21:49:44.091148] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:49:44.097124] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-16T21:49:44.097181] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-16T21:49:44.097416] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-16T21:49:44.097491] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-16T21:49:44.097358] [INFO ] [REMOTE ] TDS: Full fetch complete (61593 records). [2025-10-16T21:49:44.108780] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-16T21:49:44.610947] [DEBUG] [LOCAL ] TECK: Loaded 53434 existing records from primary storage. [2025-10-16T21:49:44.665117] [INFO ] [MAIN ] TECK: Loaded 53434 existing records. [2025-10-16T21:49:44.966861] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:49:44.999750] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-10-16T21:49:45.016053] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-16T21:49:45.026451] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-16T21:49:45.046900] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-16T21:49:45.057614] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-16T21:49:45.089170] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:49:45.089539] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-16T21:49:45.089675] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-16T21:49:45.090344] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-16T21:49:45.090701] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-16T21:49:45.090550] [DEBUG] [LOCAL ] TDS: Trimmed 61593 records to 42828 (keeping 200 days of data) [2025-10-16T21:49:45.577389] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:49:45.579992] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-10-16T21:49:45.740870] [DEBUG] [LOCAL ] TDS: Primary data saved (42828 records). [2025-10-16T21:49:45.741033] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-16T21:49:45.741167] [INFO ] [MAIN ] Update Progress: 2061/2369 symbols completed. TDS took 38.5s. Estimated remaining: 43m 18s. Rate: 7.1 symbols/min [2025-10-16T21:49:45.831241] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T21:49:45.931003] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:49:45.970390] [DEBUG] [LOCAL ] TEF: Loaded 36958 existing records from primary storage. [2025-10-16T21:49:45.970820] [INFO ] [MAIN ] TEF: Loaded 36958 existing records. [2025-10-16T21:49:46.172088] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:49:46.185608] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-16T21:49:46.185877] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-16T21:49:46.187404] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-16T21:49:46.187362] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-16T21:49:46.187556] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-16T21:49:46.352464] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-16T21:49:46.566243] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:49:47.124836] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-16T21:49:47.128706] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T21:49:47.142760] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-16T21:49:47.942851] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-10-16T21:49:48.742869] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-16T21:49:48.887783] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T21:49:49.382370] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T21:49:49.397311] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T21:49:49.542857] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-16T21:49:50.342817] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-16T21:49:51.142834] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-16T21:49:51.871630] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T21:49:51.942802] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-16T21:49:52.088447] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T21:49:52.094326] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-16T21:49:52.742825] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-16T21:49:53.523079] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T21:49:53.542782] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-16T21:49:53.590312] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-16T21:49:54.342812] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-16T21:49:55.147954] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-16T21:49:55.163283] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T21:49:55.942799] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-16T21:49:56.142820] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T21:49:56.742771] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-16T21:49:57.106445] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-16T21:49:57.177192] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T21:49:57.542818] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-16T21:49:58.342837] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-16T21:49:58.718990] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-16T21:49:59.083126] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T21:49:59.142795] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-16T21:49:59.942823] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-16T21:50:00.453036] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T21:50:00.498917] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-16T21:50:00.742858] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-10. [2025-10-16T21:50:01.542884] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-16T21:50:01.639109] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T21:50:02.342834] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-16T21:50:02.945329] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-16T21:50:02.953034] [INFO ] [REMOTE ] TDOC: Full fetch complete (77432 records). [2025-10-16T21:50:02.953224] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-16T21:50:03.108904] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T21:50:03.154158] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-16T21:50:03.281908] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T21:50:03.396447] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-16T21:50:03.396532] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-16T21:50:03.397692] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-16T21:50:03.397754] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-16T21:50:03.399184] [DEBUG] [LOCAL ] TDOC: Trimmed 77432 records to 53755 (keeping 200 days of data) [2025-10-16T21:50:03.700001] [DEBUG] [LOCAL ] TDOC: Primary data saved (53755 records). [2025-10-16T21:50:03.700131] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-16T21:50:03.700593] [INFO ] [MAIN ] Update Progress: 2062/2369 symbols completed. TDOC took 1m 1s. Estimated remaining: 43m 11s. Rate: 7.1 symbols/min [2025-10-16T21:50:03.866770] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:50:03.887789] [DEBUG] [LOCAL ] TEI: Loaded 21312 existing records from primary storage. [2025-10-16T21:50:03.888032] [INFO ] [MAIN ] TEI: Loaded 21312 existing records. [2025-10-16T21:50:03.953069] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-16T21:50:04.070416] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:50:04.070624] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-16T21:50:04.070719] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-16T21:50:04.071050] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-16T21:50:04.071118] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-16T21:50:04.419621] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:50:04.742846] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-10-16T21:50:04.812843] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-16T21:50:05.466287] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T21:50:05.542775] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-16T21:50:05.744695] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-16T21:50:06.342853] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-16T21:50:06.984690] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-16T21:50:07.142825] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-16T21:50:07.942794] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-16T21:50:08.152025] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T21:50:08.202965] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T21:50:08.207976] [INFO ] [REMOTE ] TEF: Full fetch complete (54685 records). [2025-10-16T21:50:08.208074] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-16T21:50:08.602005] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-16T21:50:08.602090] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-16T21:50:08.603196] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-16T21:50:08.603264] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-16T21:50:08.604465] [DEBUG] [LOCAL ] TEF: Trimmed 54685 records to 37124 (keeping 200 days of data) [2025-10-16T21:50:08.705013] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T21:50:08.768731] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-16T21:50:08.828097] [DEBUG] [LOCAL ] TEF: Primary data saved (37124 records). [2025-10-16T21:50:08.828259] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-16T21:50:08.828355] [INFO ] [MAIN ] Update Progress: 2063/2369 symbols completed. TEF took 23.1s. Estimated remaining: 43m 2s. Rate: 7.1 symbols/min [2025-10-16T21:50:08.993407] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:50:09.045251] [DEBUG] [LOCAL ] TEL: Loaded 51067 existing records from primary storage. [2025-10-16T21:50:09.045592] [INFO ] [MAIN ] TEL: Loaded 51067 existing records. [2025-10-16T21:50:09.223283] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:50:09.223501] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-16T21:50:09.223561] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-16T21:50:09.224143] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-16T21:50:09.224202] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-16T21:50:09.547891] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-16T21:50:09.577865] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:50:09.970307] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T21:50:10.342804] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-16T21:50:10.364707] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-16T21:50:11.142809] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-16T21:50:11.863820] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-16T21:50:11.942797] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-10-16T21:50:12.200940] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-16T21:50:12.742831] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-16T21:50:13.542845] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-16T21:50:13.702941] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T21:50:13.841600] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T21:50:14.342846] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-16T21:50:14.961180] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T21:50:15.142819] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-16T21:50:15.942840] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-16T21:50:16.365094] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-16T21:50:16.742838] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-16T21:50:16.967370] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T21:50:17.002637] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-16T21:50:17.542866] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-16T21:50:18.342804] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-16T21:50:18.505093] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T21:50:19.064151] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T21:50:19.142788] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-16T21:50:19.259324] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T21:50:19.266184] [INFO ] [REMOTE ] TECK: Full fetch complete (77518 records). [2025-10-16T21:50:19.266302] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-16T21:50:19.656315] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-16T21:50:19.656392] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-16T21:50:19.657547] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-16T21:50:19.657609] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-16T21:50:19.659061] [DEBUG] [LOCAL ] TECK: Trimmed 77518 records to 53824 (keeping 200 days of data) [2025-10-16T21:50:19.943139] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-16T21:50:19.994296] [DEBUG] [LOCAL ] TECK: Primary data saved (53824 records). [2025-10-16T21:50:19.994420] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-16T21:50:19.994496] [INFO ] [MAIN ] Update Progress: 2064/2369 symbols completed. TECK took 36.3s. Estimated remaining: 42m 54s. Rate: 7.1 symbols/min [2025-10-16T21:50:20.161275] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:50:20.191636] [DEBUG] [LOCAL ] TEN: Loaded 30592 existing records from primary storage. [2025-10-16T21:50:20.191927] [INFO ] [MAIN ] TEN: Loaded 30592 existing records. [2025-10-16T21:50:20.366402] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:50:20.366601] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-16T21:50:20.366674] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-16T21:50:20.367263] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-16T21:50:20.367331] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-16T21:50:20.671445] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T21:50:20.738927] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:50:20.733094] [INFO ] [REMOTE ] TEAF: Full fetch complete (10106 records). [2025-10-16T21:50:20.739099] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-16T21:50:20.750833] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-10-16T21:50:21.135192] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-16T21:50:21.135321] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-16T21:50:21.135707] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-16T21:50:21.135773] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-16T21:50:21.136225] [DEBUG] [LOCAL ] TEAF: Trimmed 10106 records to 7473 (keeping 200 days of data) [2025-10-16T21:50:21.210132] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-16T21:50:21.228802] [DEBUG] [LOCAL ] TEAF: Primary data saved (7473 records). [2025-10-16T21:50:21.228967] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-16T21:50:21.229056] [INFO ] [MAIN ] Update Progress: 2065/2369 symbols completed. TEAF took 37.8s. Estimated remaining: 42m 44s. Rate: 7.1 symbols/min [2025-10-16T21:50:21.403788] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:50:21.428841] [DEBUG] [LOCAL ] TEO: Loaded 22500 existing records from primary storage. [2025-10-16T21:50:21.429158] [INFO ] [MAIN ] TEO: Loaded 22500 existing records. [2025-10-16T21:50:21.547920] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-16T21:50:21.608099] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:50:21.608477] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-16T21:50:21.608525] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-16T21:50:21.608941] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-16T21:50:21.609002] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-16T21:50:21.967090] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:50:22.177980] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T21:50:22.342823] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-10-16T21:50:22.586260] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T21:50:23.142862] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-16T21:50:23.461623] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-16T21:50:23.942826] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-16T21:50:24.307885] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T21:50:24.742853] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-16T21:50:25.542843] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-16T21:50:25.793817] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T21:50:25.821978] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T21:50:26.342854] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-16T21:50:26.837724] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T21:50:27.142859] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-16T21:50:27.942818] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-16T21:50:28.252603] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-16T21:50:28.297434] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T21:50:28.734701] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T21:50:28.742764] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-16T21:50:29.542823] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-16T21:50:29.877751] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T21:50:30.342858] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-16T21:50:30.605572] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T21:50:31.142784] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-16T21:50:31.375679] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T21:50:31.942786] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-16T21:50:32.178624] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T21:50:32.742846] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-16T21:50:33.542832] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-16T21:50:33.668606] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T21:50:33.822097] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-16T21:50:34.342836] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-16T21:50:34.391949] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-16T21:50:35.142808] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-16T21:50:35.942783] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-16T21:50:36.162155] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T21:50:36.742836] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-16T21:50:36.767015] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T21:50:37.075986] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T21:50:37.542843] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-16T21:50:38.342818] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-16T21:50:38.567575] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T21:50:38.894516] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T21:50:39.142819] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-16T21:50:39.460218] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T21:50:39.942783] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-16T21:50:40.302813] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-16T21:50:40.306338] [INFO ] [REMOTE ] TEI: Full fetch complete (30908 records). [2025-10-16T21:50:40.306422] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-16T21:50:40.675206] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-16T21:50:40.675279] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-16T21:50:40.675909] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-16T21:50:40.675970] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-16T21:50:40.676686] [DEBUG] [LOCAL ] TEI: Trimmed 30908 records to 21475 (keeping 200 days of data) [2025-10-16T21:50:40.758911] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-16T21:50:40.803281] [DEBUG] [LOCAL ] TEI: Primary data saved (21475 records). [2025-10-16T21:50:40.803431] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-16T21:50:40.803521] [INFO ] [MAIN ] Update Progress: 2066/2369 symbols completed. TEI took 37.1s. Estimated remaining: 42m 37s. Rate: 7.1 symbols/min [2025-10-16T21:50:40.978077] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:50:40.991901] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T21:50:41.047462] [DEBUG] [LOCAL ] TEVA: Loaded 53627 existing records from primary storage. [2025-10-16T21:50:41.047798] [INFO ] [MAIN ] TEVA: Loaded 53627 existing records. [2025-10-16T21:50:41.225713] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:50:41.225924] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-16T21:50:41.225972] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-16T21:50:41.226175] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-10-16T21:50:41.226231] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-16T21:50:41.556721] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-16T21:50:41.596579] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:50:42.342845] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-16T21:50:42.437499] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T21:50:42.934338] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T21:50:43.142834] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-16T21:50:43.176182] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-16T21:50:43.942872] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-10-16T21:50:44.520569] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T21:50:44.742812] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-16T21:50:45.030962] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-16T21:50:45.037389] [INFO ] [REMOTE ] TEL: Full fetch complete (73697 records). [2025-10-16T21:50:45.037525] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-16T21:50:45.435395] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-16T21:50:45.435504] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-16T21:50:45.436740] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-16T21:50:45.436853] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-16T21:50:45.438736] [DEBUG] [LOCAL ] TEL: Trimmed 73697 records to 51440 (keeping 200 days of data) [2025-10-16T21:50:45.544909] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-16T21:50:45.700956] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T21:50:45.814293] [DEBUG] [LOCAL ] TEL: Primary data saved (51440 records). [2025-10-16T21:50:45.814444] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-16T21:50:45.814526] [INFO ] [MAIN ] Update Progress: 2067/2369 symbols completed. TEL took 37.0s. Estimated remaining: 42m 28s. Rate: 7.1 symbols/min [2025-10-16T21:50:46.008393] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:50:46.053708] [DEBUG] [LOCAL ] TEX: Loaded 43861 existing records from primary storage. [2025-10-16T21:50:46.054092] [INFO ] [MAIN ] TEX: Loaded 43861 existing records. [2025-10-16T21:50:46.263564] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:50:46.263805] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-16T21:50:46.263899] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-16T21:50:46.264420] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-16T21:50:46.264490] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-16T21:50:46.349209] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-16T21:50:46.642982] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:50:46.874939] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T21:50:47.142875] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-10-16T21:50:47.942836] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-16T21:50:48.645281] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-16T21:50:48.731601] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T21:50:48.742765] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-16T21:50:49.282565] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T21:50:49.542858] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-10-16T21:50:50.307191] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T21:50:50.342794] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-16T21:50:51.142793] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-16T21:50:51.494126] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-16T21:50:51.843171] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-16T21:50:51.942843] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-16T21:50:51.970413] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T21:50:52.742867] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-10-16T21:50:53.280285] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T21:50:53.542833] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-16T21:50:54.342780] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-16T21:50:54.656715] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T21:50:54.660908] [INFO ] [REMOTE ] TEN: Full fetch complete (44187 records). [2025-10-16T21:50:54.661005] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-16T21:50:55.067566] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-16T21:50:55.084197] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-16T21:50:55.084278] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-16T21:50:55.095502] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-16T21:50:55.095605] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-16T21:50:55.097205] [DEBUG] [LOCAL ] TEN: Trimmed 44187 records to 30779 (keeping 200 days of data) [2025-10-16T21:50:55.155062] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-10-16T21:50:55.291075] [DEBUG] [LOCAL ] TEN: Primary data saved (30779 records). [2025-10-16T21:50:55.291215] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-16T21:50:55.291294] [INFO ] [MAIN ] Update Progress: 2068/2369 symbols completed. TEN took 35.3s. Estimated remaining: 42m 20s. Rate: 7.1 symbols/min [2025-10-16T21:50:55.456484] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:50:55.507187] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-16T21:50:55.507534] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-10-16T21:50:55.682275] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:50:55.682527] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-16T21:50:55.682581] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-16T21:50:55.683103] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-16T21:50:55.683163] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-16T21:50:55.945284] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-16T21:50:56.051125] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:50:56.080239] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T21:50:56.742878] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-10-16T21:50:57.198309] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T21:50:57.202078] [INFO ] [REMOTE ] TEO: Full fetch complete (32776 records). [2025-10-16T21:50:57.202240] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-16T21:50:57.330059] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-16T21:50:57.547971] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-16T21:50:57.622472] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-16T21:50:57.622549] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-16T21:50:57.623238] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-16T21:50:57.623299] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-16T21:50:57.624058] [DEBUG] [LOCAL ] TEO: Trimmed 32776 records to 22784 (keeping 200 days of data) [2025-10-16T21:50:57.753599] [DEBUG] [LOCAL ] TEO: Primary data saved (22784 records). [2025-10-16T21:50:57.753788] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-16T21:50:57.753894] [INFO ] [MAIN ] Update Progress: 2069/2369 symbols completed. TEO took 36.5s. Estimated remaining: 42m 11s. Rate: 7.1 symbols/min [2025-10-16T21:50:57.919846] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:50:57.952031] [DEBUG] [LOCAL ] TFII: Loaded 32821 existing records from primary storage. [2025-10-16T21:50:57.952320] [INFO ] [MAIN ] TFII: Loaded 32821 existing records. [2025-10-16T21:50:58.130830] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:50:58.131146] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-16T21:50:58.131304] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-16T21:50:58.131552] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-16T21:50:58.131625] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-16T21:50:58.347979] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-10-16T21:50:58.513876] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:50:58.548061] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T21:50:59.142844] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-16T21:50:59.283285] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T21:50:59.942880] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-10-16T21:51:00.646575] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-16T21:51:00.742794] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-10-16T21:51:00.920204] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T21:51:01.126525] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T21:51:01.542880] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-16T21:51:02.342783] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-16T21:51:02.778346] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-16T21:51:02.838515] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T21:51:03.142893] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-16T21:51:03.948187] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-16T21:51:03.951040] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T21:51:04.127447] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T21:51:04.742894] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-16T21:51:05.547883] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-10-16T21:51:05.567579] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T21:51:06.347925] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-16T21:51:06.365674] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T21:51:07.142886] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-16T21:51:07.391596] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T21:51:07.920922] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T21:51:07.942779] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-16T21:51:08.742795] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-16T21:51:08.878572] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T21:51:09.542791] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-10-16T21:51:09.669180] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T21:51:10.342807] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-16T21:51:10.624078] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T21:51:11.142889] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-16T21:51:11.671005] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T21:51:11.900294] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-16T21:51:11.942773] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-10-16T21:51:12.742847] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-16T21:51:13.055381] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-16T21:51:13.542814] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-16T21:51:14.137393] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-16T21:51:14.167989] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-16T21:51:14.342837] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-10. [2025-10-16T21:51:15.142791] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-16T21:51:15.251638] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-16T21:51:15.942806] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-16T21:51:16.467392] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-16T21:51:16.474611] [INFO ] [REMOTE ] TEVA: Full fetch complete (77791 records). [2025-10-16T21:51:16.474794] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-16T21:51:16.748723] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-16T21:51:16.852040] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T21:51:16.933076] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-16T21:51:16.933154] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-16T21:51:16.934412] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-16T21:51:16.934478] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-16T21:51:16.935928] [DEBUG] [LOCAL ] TEVA: Trimmed 77791 records to 54017 (keeping 200 days of data) [2025-10-16T21:51:17.255925] [DEBUG] [LOCAL ] TEVA: Primary data saved (54017 records). [2025-10-16T21:51:17.256047] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-16T21:51:17.256547] [INFO ] [MAIN ] Update Progress: 2070/2369 symbols completed. TEVA took 36.5s. Estimated remaining: 42m 4s. Rate: 7.1 symbols/min [2025-10-16T21:51:17.426679] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:51:17.452571] [DEBUG] [LOCAL ] TFIN: Loaded 23600 existing records from primary storage. [2025-10-16T21:51:17.453035] [INFO ] [MAIN ] TFIN: Loaded 23600 existing records. [2025-10-16T21:51:17.553058] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-16T21:51:17.634401] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:51:17.634595] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-16T21:51:17.634660] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-16T21:51:17.634878] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-16T21:51:17.634953] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-16T21:51:18.017452] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:51:18.022440] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-16T21:51:18.060616] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T21:51:18.342884] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-10-16T21:51:18.918181] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T21:51:18.925176] [INFO ] [REMOTE ] TEX: Full fetch complete (64478 records). [2025-10-16T21:51:18.925307] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-16T21:51:19.145843] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-16T21:51:19.306577] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-16T21:51:19.326550] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-16T21:51:19.329635] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-16T21:51:19.330731] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-16T21:51:19.330796] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-16T21:51:19.331876] [DEBUG] [LOCAL ] TEX: Trimmed 64478 records to 44119 (keeping 200 days of data) [2025-10-16T21:51:19.591820] [DEBUG] [LOCAL ] TEX: Primary data saved (44119 records). [2025-10-16T21:51:19.591945] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-16T21:51:19.592021] [INFO ] [MAIN ] Update Progress: 2071/2369 symbols completed. TEX took 33.8s. Estimated remaining: 41m 55s. Rate: 7.1 symbols/min [2025-10-16T21:51:19.766145] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:51:19.803239] [DEBUG] [LOCAL ] TFPM: Loaded 39427 existing records from primary storage. [2025-10-16T21:51:19.803516] [INFO ] [MAIN ] TFPM: Loaded 39427 existing records. [2025-10-16T21:51:19.952324] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-16T21:51:19.984459] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:51:19.985412] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-16T21:51:19.985484] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-16T21:51:19.986011] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-16T21:51:19.986098] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-16T21:51:20.337157] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:51:20.649678] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T21:51:20.742828] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-16T21:51:21.542905] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-16T21:51:21.748199] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T21:51:22.013565] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T21:51:22.342843] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-10-16T21:51:22.845317] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-16T21:51:23.142797] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-16T21:51:23.588364] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-16T21:51:23.942861] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-16T21:51:24.742804] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-16T21:51:24.780761] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T21:51:25.018328] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T21:51:25.542830] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-16T21:51:25.891912] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T21:51:26.342857] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-16T21:51:27.142812] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-16T21:51:27.432526] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T21:51:27.492547] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-16T21:51:27.942783] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-10. [2025-10-16T21:51:28.417113] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T21:51:28.621431] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T21:51:28.628803] [INFO ] [REMOTE ] TFC: Full fetch complete (77843 records). [2025-10-16T21:51:28.628970] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-16T21:51:28.748020] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-16T21:51:29.027484] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-16T21:51:29.027568] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-16T21:51:29.028916] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-16T21:51:29.028989] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-16T21:51:29.030611] [DEBUG] [LOCAL ] TFC: Trimmed 77843 records to 54057 (keeping 200 days of data) [2025-10-16T21:51:29.378251] [DEBUG] [LOCAL ] TFC: Primary data saved (54057 records). [2025-10-16T21:51:29.378442] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-16T21:51:29.379095] [INFO ] [MAIN ] Update Progress: 2072/2369 symbols completed. TFC took 34.1s. Estimated remaining: 41m 46s. Rate: 7.1 symbols/min [2025-10-16T21:51:29.549472] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-16T21:51:29.574950] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:51:29.614434] [DEBUG] [LOCAL ] TFX: Loaded 36207 existing records from primary storage. [2025-10-16T21:51:29.614741] [INFO ] [MAIN ] TFX: Loaded 36207 existing records. [2025-10-16T21:51:29.795112] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:51:29.795396] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-16T21:51:29.795446] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-16T21:51:29.795799] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-16T21:51:29.795857] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-16T21:51:30.161601] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:51:30.179840] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T21:51:30.342815] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-16T21:51:30.825948] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T21:51:30.830108] [INFO ] [REMOTE ] TFII: Full fetch complete (48083 records). [2025-10-16T21:51:30.830216] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-16T21:51:31.147899] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-10-16T21:51:31.222233] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-16T21:51:31.222467] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-16T21:51:31.223583] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-16T21:51:31.223730] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-16T21:51:31.224875] [DEBUG] [LOCAL ] TFII: Trimmed 48083 records to 33095 (keeping 200 days of data) [2025-10-16T21:51:31.352717] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T21:51:31.459043] [DEBUG] [LOCAL ] TFII: Primary data saved (33095 records). [2025-10-16T21:51:31.459180] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-16T21:51:31.459264] [INFO ] [MAIN ] Update Progress: 2073/2369 symbols completed. TFII took 33.7s. Estimated remaining: 41m 37s. Rate: 7.1 symbols/min [2025-10-16T21:51:31.627431] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:51:31.639313] [DEBUG] [LOCAL ] TG: Loaded 10520 existing records from primary storage. [2025-10-16T21:51:31.639538] [INFO ] [MAIN ] TG: Loaded 10520 existing records. [2025-10-16T21:51:31.816947] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:51:31.817162] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-16T21:51:31.817212] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-16T21:51:31.817363] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-16T21:51:31.817401] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-16T21:51:31.947944] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-16T21:51:32.233858] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:51:32.661482] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T21:51:32.685023] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T21:51:32.742818] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-16T21:51:33.542848] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-16T21:51:34.259525] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T21:51:34.342835] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-16T21:51:34.597828] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T21:51:35.142868] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-10-16T21:51:35.840054] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T21:51:35.942791] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-16T21:51:36.099370] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-16T21:51:36.742809] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-16T21:51:37.044905] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T21:51:37.541776] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T21:51:37.544104] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-16T21:51:38.342823] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-16T21:51:39.135144] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T21:51:39.142791] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-16T21:51:39.942778] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-16T21:51:40.087139] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T21:51:40.414191] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-16T21:51:40.652572] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-16T21:51:40.742796] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-16T21:51:41.542801] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-16T21:51:41.612930] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-16T21:51:42.342820] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-16T21:51:42.991097] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T21:51:43.142827] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-16T21:51:43.399486] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T21:51:43.942850] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-16T21:51:44.596617] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T21:51:44.742788] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-16T21:51:44.805168] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T21:51:45.542892] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-16T21:51:46.271749] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T21:51:46.341490] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T21:51:46.343745] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-16T21:51:47.142862] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-16T21:51:47.413308] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T21:51:47.942812] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-16T21:51:48.742789] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-16T21:51:48.893444] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T21:51:48.935980] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T21:51:48.939842] [INFO ] [REMOTE ] TFIN: Full fetch complete (32161 records). [2025-10-16T21:51:48.939926] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-16T21:51:49.256724] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-16T21:51:49.338036] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-16T21:51:49.338202] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-16T21:51:49.339417] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-16T21:51:49.339483] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-16T21:51:49.340607] [DEBUG] [LOCAL ] TFIN: Trimmed 32161 records to 23892 (keeping 200 days of data) [2025-10-16T21:51:49.492120] [DEBUG] [LOCAL ] TFIN: Primary data saved (23892 records). [2025-10-16T21:51:49.492304] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-16T21:51:49.492403] [INFO ] [MAIN ] Update Progress: 2074/2369 symbols completed. TFIN took 32.2s. Estimated remaining: 41m 30s. Rate: 7.1 symbols/min [2025-10-16T21:51:49.553078] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-16T21:51:49.685790] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:51:49.686026] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-16T21:51:49.686066] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-16T21:51:49.686214] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-16T21:51:49.686273] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-16T21:51:49.686320] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-16T21:51:49.686356] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-16T21:51:50.069974] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:51:50.342823] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-16T21:51:50.394501] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-16T21:51:51.142858] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-16T21:51:51.882784] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T21:51:51.942805] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-16T21:51:51.978184] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T21:51:52.742875] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-16T21:51:53.523895] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T21:51:53.542785] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-16T21:51:53.750805] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T21:51:54.342822] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-16T21:51:55.149158] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-16T21:51:55.165947] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T21:51:55.191329] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T21:51:55.193454] [INFO ] [REMOTE ] TG: Full fetch complete (15106 records). [2025-10-16T21:51:55.193524] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-16T21:51:55.549713] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-16T21:51:55.549794] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-16T21:51:55.550121] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-16T21:51:55.550165] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-16T21:51:55.550639] [DEBUG] [LOCAL ] TG: Trimmed 15106 records to 10651 (keeping 200 days of data) [2025-10-16T21:51:55.609284] [DEBUG] [LOCAL ] TG: Primary data saved (10651 records). [2025-10-16T21:51:55.609416] [INFO ] [MAIN ] TG: Full history saved. [2025-10-16T21:51:55.609497] [INFO ] [MAIN ] Update Progress: 2075/2369 symbols completed. TG took 24.2s. Estimated remaining: 41m 21s. Rate: 7.1 symbols/min [2025-10-16T21:51:55.776324] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:51:55.805042] [DEBUG] [LOCAL ] TGLS: Loaded 27631 existing records from primary storage. [2025-10-16T21:51:55.805298] [INFO ] [MAIN ] TGLS: Loaded 27631 existing records. [2025-10-16T21:51:55.947972] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-16T21:51:56.000860] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:51:56.001139] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-16T21:51:56.001189] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-16T21:51:56.001739] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-16T21:51:56.001825] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-16T21:51:56.416608] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:51:56.509709] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T21:51:56.742898] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-16T21:51:57.547886] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-10-16T21:51:57.557990] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T21:51:57.565130] [INFO ] [REMOTE ] TFPM: Full fetch complete (52614 records). [2025-10-16T21:51:57.565240] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-16T21:51:57.945615] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-16T21:51:57.945719] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-16T21:51:57.946664] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-16T21:51:57.946726] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-16T21:51:57.947791] [DEBUG] [LOCAL ] TFPM: Trimmed 52614 records to 39778 (keeping 200 days of data) [2025-10-16T21:51:58.196882] [DEBUG] [LOCAL ] TFPM: Primary data saved (39778 records). [2025-10-16T21:51:58.197021] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-16T21:51:58.197100] [INFO ] [MAIN ] Update Progress: 2076/2369 symbols completed. TFPM took 38.6s. Estimated remaining: 41m 12s. Rate: 7.1 symbols/min [2025-10-16T21:51:58.345820] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-10-16T21:51:58.391985] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T21:51:58.393851] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:51:58.445362] [DEBUG] [LOCAL ] TGNA: Loaded 48617 existing records from primary storage. [2025-10-16T21:51:58.445691] [INFO ] [MAIN ] TGNA: Loaded 48617 existing records. [2025-10-16T21:51:58.620394] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:51:58.620215] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:51:58.620925] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-16T21:51:58.621047] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-10-16T21:51:58.621138] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-16T21:51:58.621270] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:51:58.621401] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-16T21:51:58.621536] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:51:58.621609] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-16T21:51:58.621779] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-16T21:51:58.621727] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-16T21:51:58.622011] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-16T21:51:58.622059] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-16T21:51:58.645900] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-16T21:51:58.685678] [INFO ] [MAIN ] Update Progress: 2077/2369 symbols completed. TGE took 9.2s. Estimated remaining: 41m 2s. Rate: 7.1 symbols/min [2025-10-16T21:51:58.845682] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T21:51:58.993913] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:51:59.142873] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-16T21:51:59.942797] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-10-16T21:52:00.622534] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T21:52:00.742817] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-16T21:52:01.542871] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-16T21:52:01.764903] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-16T21:52:02.312262] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T21:52:02.342847] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-16T21:52:02.825800] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T21:52:03.142858] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-16T21:52:03.442782] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T21:52:03.447575] [INFO ] [REMOTE ] TFX: Full fetch complete (54671 records). [2025-10-16T21:52:03.447746] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-16T21:52:03.840746] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-16T21:52:03.840833] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-16T21:52:03.842127] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-16T21:52:03.842192] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-16T21:52:03.843316] [DEBUG] [LOCAL ] TFX: Trimmed 54671 records to 36449 (keeping 200 days of data) [2025-10-16T21:52:03.948449] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-16T21:52:04.070271] [DEBUG] [LOCAL ] TFX: Primary data saved (36449 records). [2025-10-16T21:52:04.070408] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-16T21:52:04.071165] [INFO ] [MAIN ] Update Progress: 2078/2369 symbols completed. TFX took 34.7s. Estimated remaining: 40m 54s. Rate: 7.1 symbols/min [2025-10-16T21:52:04.700824] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T21:52:04.742816] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-16T21:52:05.226560] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T21:52:05.542882] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-16T21:52:06.309435] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T21:52:06.342820] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-16T21:52:06.526017] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T21:52:07.142849] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-16T21:52:07.980091] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T21:52:07.990365] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-16T21:52:08.505126] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T21:52:08.742900] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-16T21:52:09.365306] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T21:52:09.542804] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-16T21:52:10.101082] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-16T21:52:10.342787] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-16T21:52:10.921796] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T21:52:11.142781] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-16T21:52:11.471390] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T21:52:11.942802] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-16T21:52:12.739364] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T21:52:12.748794] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-16T21:52:12.813284] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-16T21:52:13.542889] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-16T21:52:14.436667] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T21:52:14.447572] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-16T21:52:14.528141] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T21:52:15.142867] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-16T21:52:16.317603] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T21:52:16.329253] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-16T21:52:16.416345] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T21:52:16.742874] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-16T21:52:17.849860] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T21:52:17.853341] [INFO ] [REMOTE ] TGLS: Full fetch complete (40593 records). [2025-10-16T21:52:17.853430] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-16T21:52:18.261913] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-16T21:52:18.276933] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-16T21:52:18.281775] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-16T21:52:18.281903] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-16T21:52:18.286189] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-16T21:52:18.286695] [DEBUG] [LOCAL ] TGLS: Trimmed 40593 records to 27778 (keeping 200 days of data) [2025-10-16T21:52:18.301250] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-16T21:52:18.473530] [DEBUG] [LOCAL ] TGLS: Primary data saved (27778 records). [2025-10-16T21:52:18.473712] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-16T21:52:18.473813] [INFO ] [MAIN ] Update Progress: 2079/2369 symbols completed. TGLS took 22.9s. Estimated remaining: 40m 46s. Rate: 7.1 symbols/min [2025-10-16T21:52:19.920070] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-16T21:52:19.927102] [INFO ] [REMOTE ] TGNA: Full fetch complete (70075 records). [2025-10-16T21:52:19.927323] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-16T21:52:20.338289] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-16T21:52:20.338424] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-16T21:52:20.340109] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-16T21:52:20.340186] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-16T21:52:20.342361] [DEBUG] [LOCAL ] TGNA: Trimmed 70075 records to 48978 (keeping 200 days of data) [2025-10-16T21:52:20.674760] [DEBUG] [LOCAL ] TGNA: Primary data saved (48978 records). [2025-10-16T21:52:20.674977] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-16T21:52:20.675088] [INFO ] [MAIN ] Update Progress: 2080/2369 symbols completed. TGNA took 22.5s. Estimated remaining: 40m 37s. Rate: 7.1 symbols/min [2025-10-16T21:52:21.296839] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:52:21.400114] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:52:21.423633] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:52:21.425175] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:52:21.453337] [DEBUG] [LOCAL ] THG: Loaded 21713 existing records from primary storage. [2025-10-16T21:52:21.454008] [INFO ] [MAIN ] THG: Loaded 21713 existing records. [2025-10-16T21:52:21.632042] [DEBUG] [LOCAL ] TGS: Loaded 33583 existing records from primary storage. [2025-10-16T21:52:21.687315] [INFO ] [MAIN ] TGS: Loaded 33583 existing records. [2025-10-16T21:52:21.690495] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-10-16T21:52:21.758057] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:52:21.775673] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-16T21:52:21.793580] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-16T21:52:21.775269] [INFO ] [MAIN ] TGT: Loaded 53778 existing records. [2025-10-16T21:52:21.799578] [DEBUG] [LOCAL ] THC: Loaded 47056 existing records from primary storage. [2025-10-16T21:52:21.828103] [INFO ] [MAIN ] THC: Loaded 47056 existing records. [2025-10-16T21:52:21.838892] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-16T21:52:21.886695] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-16T21:52:22.290010] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:52:22.306813] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:52:22.327250] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-16T21:52:22.343092] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-16T21:52:22.337907] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-16T21:52:22.349180] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-16T21:52:22.373857] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-16T21:52:22.423911] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-16T21:52:22.379038] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-16T21:52:22.466783] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:52:22.461068] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-16T21:52:22.596661] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-16T21:52:22.736424] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-16T21:52:22.857895] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-16T21:52:22.901430] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-16T21:52:23.312875] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:52:23.394248] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-10-16T21:52:23.644371] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:52:23.661080] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-10-16T21:52:23.686666] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:52:23.704170] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-10-16T21:52:23.848720] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:52:23.849081] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-10-16T21:52:24.588792] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T21:52:24.593225] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-16T21:52:25.018820] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T21:52:25.025221] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-16T21:52:25.547534] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T21:52:25.557054] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-16T21:52:25.636365] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-16T21:52:25.647877] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-16T21:52:25.663255] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T21:52:25.668194] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-16T21:52:26.223815] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T21:52:26.231319] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-16T21:52:26.876832] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T21:52:26.882407] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-16T21:52:27.192368] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T21:52:27.201878] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-16T21:52:27.576368] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T21:52:27.694811] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-16T21:52:27.942831] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-16T21:52:28.085741] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T21:52:28.742800] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-16T21:52:28.842809] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T21:52:29.331412] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T21:52:29.542811] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-16T21:52:30.342836] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-16T21:52:30.792595] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-16T21:52:30.969933] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T21:52:31.142846] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-16T21:52:31.278488] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T21:52:31.942802] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-16T21:52:31.967614] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T21:52:32.742828] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-16T21:52:33.542841] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-16T21:52:33.810824] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T21:52:34.064320] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T21:52:34.342808] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-16T21:52:34.347293] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-16T21:52:35.142844] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-16T21:52:35.942843] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-16T21:52:36.742786] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-16T21:52:36.844418] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-16T21:52:37.139069] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T21:52:37.328232] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-16T21:52:37.542855] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-16T21:52:38.295982] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T21:52:38.342764] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-16T21:52:38.575062] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T21:52:39.142797] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-16T21:52:39.688683] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T21:52:39.942871] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-16T21:52:40.150778] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T21:52:40.742831] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-16T21:52:41.519738] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T21:52:41.542778] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-16T21:52:41.752592] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-16T21:52:41.755769] [INFO ] [REMOTE ] THG: Full fetch complete (31339 records). [2025-10-16T21:52:41.755856] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-16T21:52:42.128999] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-16T21:52:42.129093] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-16T21:52:42.129852] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-16T21:52:42.129917] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-16T21:52:42.130719] [DEBUG] [LOCAL ] THG: Trimmed 31339 records to 21941 (keeping 200 days of data) [2025-10-16T21:52:42.270769] [DEBUG] [LOCAL ] THG: Primary data saved (21941 records). [2025-10-16T21:52:42.270901] [INFO ] [MAIN ] THG: Full history saved. [2025-10-16T21:52:42.270978] [INFO ] [MAIN ] Update Progress: 2081/2369 symbols completed. THG took 21.6s. Estimated remaining: 40m 30s. Rate: 7.1 symbols/min [2025-10-16T21:52:42.348038] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-16T21:52:42.439265] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:52:42.444057] [DEBUG] [LOCAL ] THIR: Loaded 2374 existing records from primary storage. [2025-10-16T21:52:42.444214] [INFO ] [MAIN ] THIR: Loaded 2374 existing records. [2025-10-16T21:52:42.619327] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:52:42.619601] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-16T21:52:42.619716] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-16T21:52:42.619858] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-16T21:52:42.619896] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-16T21:52:43.012897] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:52:43.020754] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T21:52:43.142815] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-10-16T21:52:43.412202] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-10-16T21:52:43.942857] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-16T21:52:44.314959] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-16T21:52:44.745473] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-16T21:52:44.751312] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-16T21:52:45.542821] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-16T21:52:46.342803] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-16T21:52:46.483129] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T21:52:47.093282] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T21:52:47.142781] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-16T21:52:47.942865] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-16T21:52:48.306775] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-16T21:52:48.527406] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T21:52:48.532622] [INFO ] [REMOTE ] TGS: Full fetch complete (48660 records). [2025-10-16T21:52:48.532734] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-16T21:52:48.752330] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-16T21:52:48.942132] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-16T21:52:48.942389] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-16T21:52:48.943382] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-16T21:52:48.943455] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-16T21:52:48.975203] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-10-16T21:52:48.975343] [DEBUG] [LOCAL ] TGS: Trimmed 48660 records to 33802 (keeping 200 days of data) [2025-10-16T21:52:49.160591] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-16T21:52:49.183628] [DEBUG] [LOCAL ] TGS: Primary data saved (33802 records). [2025-10-16T21:52:49.183823] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-16T21:52:49.183916] [INFO ] [MAIN ] Update Progress: 2082/2369 symbols completed. TGS took 28.5s. Estimated remaining: 40m 21s. Rate: 7.1 symbols/min [2025-10-16T21:52:49.347573] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:52:49.351380] [DEBUG] [LOCAL ] THLV: Loaded 1510 existing records from primary storage. [2025-10-16T21:52:49.351517] [INFO ] [MAIN ] THLV: Loaded 1510 existing records. [2025-10-16T21:52:49.521041] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:52:49.521263] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-16T21:52:49.521312] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-16T21:52:49.521436] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-16T21:52:49.521473] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-16T21:52:49.549515] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-16T21:52:49.889812] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:52:50.034124] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-16T21:52:50.342841] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-16T21:52:50.860781] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-16T21:52:51.142872] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-16T21:52:51.626921] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-16T21:52:51.942887] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-16T21:52:52.417863] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T21:52:52.742834] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-10-16T21:52:53.174755] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-16T21:52:53.542854] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-16T21:52:53.991792] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-16T21:52:54.342801] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-16T21:52:54.966572] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-16T21:52:55.142823] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-16T21:52:55.942826] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-16T21:52:56.742785] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-16T21:52:56.899090] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T21:52:57.212376] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-16T21:52:57.542818] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-16T21:52:58.068093] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-16T21:52:58.089437] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-16T21:52:58.090422] [INFO ] [REMOTE ] THIR: Full fetch complete (2884 records). [2025-10-16T21:52:58.090495] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-16T21:52:58.348146] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-16T21:52:58.473187] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-16T21:52:58.473289] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-16T21:52:58.473444] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-16T21:52:58.473494] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-16T21:52:58.473983] [DEBUG] [LOCAL ] THIR: Trimmed 2884 records to 2404 (keeping 200 days of data) [2025-10-16T21:52:58.489541] [DEBUG] [LOCAL ] THIR: Primary data saved (2404 records). [2025-10-16T21:52:58.489664] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-16T21:52:58.489780] [INFO ] [MAIN ] Update Progress: 2083/2369 symbols completed. THIR took 16.2s. Estimated remaining: 40m 13s. Rate: 7.1 symbols/min [2025-10-16T21:52:58.685252] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:52:58.726908] [DEBUG] [LOCAL ] THO: Loaded 41458 existing records from primary storage. [2025-10-16T21:52:58.727339] [INFO ] [MAIN ] THO: Loaded 41458 existing records. [2025-10-16T21:52:58.897364] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T21:52:58.943737] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:52:58.943974] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-16T21:52:58.944025] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-16T21:52:58.944218] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-16T21:52:58.944286] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-16T21:52:59.150787] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-16T21:52:59.363482] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:52:59.942824] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-10-16T21:53:00.742797] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-16T21:53:00.834673] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T21:53:01.346015] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T21:53:01.542798] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-16T21:53:01.667859] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T21:53:02.342838] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-16T21:53:03.142830] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-16T21:53:03.299380] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T21:53:03.503085] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-16T21:53:03.942818] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-16T21:53:04.663660] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-16T21:53:04.695340] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-16T21:53:04.742771] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-16T21:53:05.542865] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-16T21:53:05.887998] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-16T21:53:06.342796] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-16T21:53:07.059023] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-16T21:53:07.142830] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-16T21:53:07.693102] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-16T21:53:07.699264] [INFO ] [REMOTE ] THC: Full fetch complete (68871 records). [2025-10-16T21:53:07.699463] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-16T21:53:07.954204] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-16T21:53:08.088076] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-16T21:53:08.088154] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-16T21:53:08.089269] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-16T21:53:08.089344] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-16T21:53:08.090694] [DEBUG] [LOCAL ] THC: Trimmed 68871 records to 47312 (keeping 200 days of data) [2025-10-16T21:53:08.383926] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-16T21:53:08.387853] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T21:53:08.406663] [DEBUG] [LOCAL ] THC: Primary data saved (47312 records). [2025-10-16T21:53:08.406750] [INFO ] [MAIN ] THC: Full history saved. [2025-10-16T21:53:08.406820] [INFO ] [MAIN ] Update Progress: 2084/2369 symbols completed. THC took 47.7s. Estimated remaining: 40m 5s. Rate: 7.1 symbols/min [2025-10-16T21:53:08.580610] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:53:08.610562] [DEBUG] [LOCAL ] THQ: Loaded 25363 existing records from primary storage. [2025-10-16T21:53:08.610904] [INFO ] [MAIN ] THQ: Loaded 25363 existing records. [2025-10-16T21:53:08.747913] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-16T21:53:08.831860] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:53:08.832099] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-16T21:53:08.832152] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-16T21:53:08.832323] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-16T21:53:08.832378] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-16T21:53:09.182021] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:53:09.542862] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-10-16T21:53:10.342817] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-16T21:53:10.681267] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T21:53:10.792712] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T21:53:11.142782] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-16T21:53:11.199188] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-16T21:53:11.942860] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-16T21:53:12.554191] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T21:53:12.623304] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T21:53:12.630390] [INFO ] [REMOTE ] TGT: Full fetch complete (77956 records). [2025-10-16T21:53:12.630569] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-16T21:53:12.747950] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-16T21:53:13.036429] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-16T21:53:13.036525] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-16T21:53:13.037743] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-16T21:53:13.037807] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-16T21:53:13.039249] [DEBUG] [LOCAL ] TGT: Trimmed 77956 records to 54168 (keeping 200 days of data) [2025-10-16T21:53:13.133829] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-16T21:53:13.383976] [DEBUG] [LOCAL ] TGT: Primary data saved (54168 records). [2025-10-16T21:53:13.384130] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-16T21:53:13.384719] [INFO ] [MAIN ] Update Progress: 2085/2369 symbols completed. TGT took 52.7s. Estimated remaining: 39m 56s. Rate: 7.1 symbols/min [2025-10-16T21:53:13.547951] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-16T21:53:13.549871] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:53:13.572389] [DEBUG] [LOCAL ] THR: Loaded 19794 existing records from primary storage. [2025-10-16T21:53:13.572637] [INFO ] [MAIN ] THR: Loaded 19794 existing records. [2025-10-16T21:53:13.763134] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:53:13.763445] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-16T21:53:13.763526] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-16T21:53:13.763763] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-16T21:53:13.763831] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-16T21:53:14.164718] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:53:14.342816] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-16T21:53:14.854723] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-16T21:53:14.855741] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T21:53:14.856656] [INFO ] [REMOTE ] THLV: Full fetch complete (2565 records). [2025-10-16T21:53:14.862725] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-16T21:53:15.147948] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-16T21:53:15.214037] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-16T21:53:15.214112] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-16T21:53:15.214210] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-16T21:53:15.214249] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-16T21:53:15.214562] [DEBUG] [LOCAL ] THLV: Trimmed 2565 records to 1530 (keeping 200 days of data) [2025-10-16T21:53:15.223662] [DEBUG] [LOCAL ] THLV: Primary data saved (1530 records). [2025-10-16T21:53:15.223732] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-16T21:53:15.223800] [INFO ] [MAIN ] Update Progress: 2086/2369 symbols completed. THLV took 26.0s. Estimated remaining: 39m 47s. Rate: 7.1 symbols/min [2025-10-16T21:53:15.387420] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:53:15.423706] [DEBUG] [LOCAL ] THS: Loaded 38627 existing records from primary storage. [2025-10-16T21:53:15.424076] [INFO ] [MAIN ] THS: Loaded 38627 existing records. [2025-10-16T21:53:15.597957] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:53:15.598156] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-16T21:53:15.598202] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-16T21:53:15.598438] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-16T21:53:15.598500] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-16T21:53:15.939798] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:53:15.942772] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-10-16T21:53:16.742807] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-16T21:53:16.928528] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T21:53:17.410709] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T21:53:17.542801] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-16T21:53:17.774690] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T21:53:18.342801] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-16T21:53:18.642620] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T21:53:19.142781] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-16T21:53:19.377161] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T21:53:19.942802] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-16T21:53:20.742846] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-16T21:53:20.820488] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T21:53:20.874247] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-16T21:53:21.542834] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-10-16T21:53:21.790728] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-16T21:53:22.232898] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-16T21:53:22.342805] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-16T21:53:23.142781] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-16T21:53:23.290620] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T21:53:23.942828] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-16T21:53:24.649821] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T21:53:24.742833] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-16T21:53:25.094558] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T21:53:25.542809] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-16T21:53:26.099563] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T21:53:26.342819] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-16T21:53:27.000562] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T21:53:27.142821] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-16T21:53:27.500100] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-16T21:53:27.942877] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-16T21:53:28.670413] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T21:53:28.742815] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-16T21:53:29.069555] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-16T21:53:29.542814] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-16T21:53:30.334978] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T21:53:30.343417] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-16T21:53:31.142849] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-16T21:53:31.310878] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T21:53:31.408461] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-16T21:53:31.942795] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-16T21:53:32.246347] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T21:53:32.742793] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-16T21:53:33.005952] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T21:53:33.542786] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-16T21:53:33.917890] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T21:53:34.342775] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-16T21:53:34.506454] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T21:53:35.142796] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-16T21:53:35.919588] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-16T21:53:35.942774] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-16T21:53:36.418742] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T21:53:36.742868] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-16T21:53:37.356035] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T21:53:37.363243] [INFO ] [REMOTE ] THO: Full fetch complete (60197 records). [2025-10-16T21:53:37.363426] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-16T21:53:37.560937] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-16T21:53:37.755157] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-16T21:53:37.755235] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-16T21:53:37.756255] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-16T21:53:37.756318] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-16T21:53:37.757470] [DEBUG] [LOCAL ] THO: Trimmed 60197 records to 41680 (keeping 200 days of data) [2025-10-16T21:53:38.014072] [DEBUG] [LOCAL ] THO: Primary data saved (41680 records). [2025-10-16T21:53:38.014216] [INFO ] [MAIN ] THO: Full history saved. [2025-10-16T21:53:38.014358] [INFO ] [MAIN ] Update Progress: 2087/2369 symbols completed. THO took 39.5s. Estimated remaining: 39m 40s. Rate: 7.1 symbols/min [2025-10-16T21:53:38.190790] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:53:38.212579] [DEBUG] [LOCAL ] THW: Loaded 19728 existing records from primary storage. [2025-10-16T21:53:38.213053] [INFO ] [MAIN ] THW: Loaded 19728 existing records. [2025-10-16T21:53:38.345499] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-16T21:53:38.423991] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T21:53:38.430735] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:53:38.438948] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-16T21:53:38.439435] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-16T21:53:38.439881] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-16T21:53:38.439945] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-16T21:53:38.791661] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:53:38.812462] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T21:53:39.142863] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-10-16T21:53:39.376535] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-16T21:53:39.942817] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-10-16T21:53:40.321997] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T21:53:40.742813] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-16T21:53:40.947628] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T21:53:41.542846] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-16T21:53:42.263173] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T21:53:42.342827] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-16T21:53:42.688608] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T21:53:43.142878] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-16T21:53:43.585533] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T21:53:43.870346] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T21:53:43.942804] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-16T21:53:44.742870] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-16T21:53:45.357617] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T21:53:45.363435] [INFO ] [REMOTE ] THS: Full fetch complete (54465 records). [2025-10-16T21:53:45.363619] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-16T21:53:45.548630] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-16T21:53:45.805168] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-16T21:53:45.805247] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-16T21:53:45.806350] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-16T21:53:45.806414] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-16T21:53:45.807575] [DEBUG] [LOCAL ] THS: Trimmed 54465 records to 38873 (keeping 200 days of data) [2025-10-16T21:53:46.037637] [DEBUG] [LOCAL ] THS: Primary data saved (38873 records). [2025-10-16T21:53:46.037807] [INFO ] [MAIN ] THS: Full history saved. [2025-10-16T21:53:46.038368] [INFO ] [MAIN ] Update Progress: 2088/2369 symbols completed. THS took 30.8s. Estimated remaining: 39m 32s. Rate: 7.1 symbols/min [2025-10-16T21:53:46.159733] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T21:53:46.244420] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:53:46.244757] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-16T21:53:46.244829] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-16T21:53:46.244992] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-16T21:53:46.245067] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-16T21:53:46.245242] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-16T21:53:46.245324] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-16T21:53:46.344749] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-16T21:53:46.421186] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-16T21:53:46.624412] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:53:47.142879] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-10-16T21:53:47.572612] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T21:53:47.942835] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-16T21:53:48.267998] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T21:53:48.706165] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T21:53:48.742801] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-10. [2025-10-16T21:53:49.542861] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-16T21:53:49.727569] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T21:53:49.735445] [INFO ] [REMOTE ] THR: Full fetch complete (28811 records). [2025-10-16T21:53:49.735613] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-16T21:53:50.126453] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-16T21:53:50.126554] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-16T21:53:50.127626] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-16T21:53:50.127719] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-16T21:53:50.128906] [DEBUG] [LOCAL ] THR: Trimmed 28811 records to 19933 (keeping 200 days of data) [2025-10-16T21:53:50.255233] [DEBUG] [LOCAL ] THR: Primary data saved (19933 records). [2025-10-16T21:53:50.255438] [INFO ] [MAIN ] THR: Full history saved. [2025-10-16T21:53:50.255557] [INFO ] [MAIN ] Update Progress: 2089/2369 symbols completed. THR took 36.9s. Estimated remaining: 39m 23s. Rate: 7.1 symbols/min [2025-10-16T21:53:50.347915] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-16T21:53:50.432978] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:53:50.471836] [DEBUG] [LOCAL ] TIMB: Loaded 35342 existing records from primary storage. [2025-10-16T21:53:50.472370] [INFO ] [MAIN ] TIMB: Loaded 35342 existing records. [2025-10-16T21:53:50.664828] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:53:50.665196] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-16T21:53:50.679834] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-16T21:53:50.681140] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-16T21:53:50.686057] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-16T21:53:50.687063] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-16T21:53:51.056892] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:53:51.142791] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-10-16T21:53:51.413735] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:53:51.414069] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-10-16T21:53:51.414160] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:53:51.414215] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-16T21:53:51.414274] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:53:51.414346] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-16T21:53:51.414409] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-16T21:53:51.414444] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-16T21:53:51.414483] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-16T21:53:51.414528] [INFO ] [MAIN ] Update Progress: 2090/2369 symbols completed. TIC took 5.4s. Estimated remaining: 39m 13s. Rate: 7.1 symbols/min [2025-10-16T21:53:51.527174] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T21:53:51.536780] [INFO ] [REMOTE ] THQ: Full fetch complete (34960 records). [2025-10-16T21:53:51.547744] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-16T21:53:51.706981] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:53:51.762058] [DEBUG] [LOCAL ] TISI: Loaded 3331 existing records from primary storage. [2025-10-16T21:53:51.772599] [INFO ] [MAIN ] TISI: Loaded 3331 existing records. [2025-10-16T21:53:51.945287] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-16T21:53:52.126634] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:53:52.143077] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-16T21:53:52.157126] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-16T21:53:52.157679] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-16T21:53:52.168387] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-16T21:53:52.391606] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-16T21:53:52.411126] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-16T21:53:52.445772] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-16T21:53:52.456804] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-16T21:53:52.564416] [DEBUG] [LOCAL ] THQ: Trimmed 34960 records to 25501 (keeping 200 days of data) [2025-10-16T21:53:52.774750] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-10-16T21:53:52.785399] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:53:52.888047] [DEBUG] [LOCAL ] THQ: Primary data saved (25501 records). [2025-10-16T21:53:52.888286] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-16T21:53:52.888413] [INFO ] [MAIN ] Update Progress: 2091/2369 symbols completed. THQ took 44.5s. Estimated remaining: 39m 4s. Rate: 7.1 symbols/min [2025-10-16T21:53:53.064936] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:53:53.079799] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T21:53:53.118150] [DEBUG] [LOCAL ] TIXT: Loaded 32389 existing records from primary storage. [2025-10-16T21:53:53.118539] [INFO ] [MAIN ] TIXT: Loaded 32389 existing records. [2025-10-16T21:53:53.301365] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:53:53.301595] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-16T21:53:53.301666] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-16T21:53:53.302773] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-16T21:53:53.302834] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-16T21:53:53.547977] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-10-16T21:53:53.662672] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:53:54.166098] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-16T21:53:54.342805] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-16T21:53:54.440114] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T21:53:55.142815] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-16T21:53:55.509201] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T21:53:55.942874] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-16T21:53:56.669277] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T21:53:56.721834] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T21:53:56.742774] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-16T21:53:57.542882] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-16T21:53:57.620849] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T21:53:58.041514] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-16T21:53:58.342804] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-16T21:53:59.142852] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-16T21:53:59.304174] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T21:53:59.308749] [INFO ] [REMOTE ] THW: Full fetch complete (28992 records). [2025-10-16T21:53:59.308913] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-16T21:53:59.759552] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-16T21:53:59.759676] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-16T21:53:59.760381] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-16T21:53:59.760430] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-16T21:53:59.761435] [DEBUG] [LOCAL ] THW: Trimmed 28992 records to 19846 (keeping 200 days of data) [2025-10-16T21:53:59.884363] [DEBUG] [LOCAL ] THW: Primary data saved (19846 records). [2025-10-16T21:53:59.884515] [INFO ] [MAIN ] THW: Full history saved. [2025-10-16T21:53:59.884600] [INFO ] [MAIN ] Update Progress: 2092/2369 symbols completed. THW took 21.9s. Estimated remaining: 38m 55s. Rate: 7.1 symbols/min [2025-10-16T21:53:59.952286] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-10-16T21:54:00.057371] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:54:00.057566] [DEBUG] [LOCAL ] TJX: No existing data file found in primary storage. [2025-10-16T21:54:00.057606] [WARN ] [MAIN ] TJX: No existing data found, performing full refresh instead. [2025-10-16T21:54:00.057738] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-16T21:54:00.057829] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-16T21:54:00.057892] [DEBUG] [LOCAL ] TJX: No primary data file found to delete. [2025-10-16T21:54:00.057927] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-16T21:54:00.406675] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:54:00.429192] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T21:54:00.742839] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-16T21:54:00.942386] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T21:54:01.542908] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-10-16T21:54:02.342836] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-16T21:54:02.787686] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T21:54:03.142814] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-16T21:54:03.808436] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-16T21:54:03.890511] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (3.15 seconds). [2025-10-16T21:54:03.942826] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-16T21:54:04.707344] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T21:54:04.742783] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-16T21:54:05.184020] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (3.64 seconds). [2025-10-16T21:54:05.296080] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-16T21:54:05.542847] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-16T21:54:06.342787] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-16T21:54:06.834521] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T21:54:06.954485] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T21:54:07.142845] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-16T21:54:07.942828] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-16T21:54:08.406607] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T21:54:08.742866] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-16T21:54:08.996455] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T21:54:09.542820] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-16T21:54:10.342840] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-16T21:54:10.364613] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T21:54:11.142825] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-16T21:54:11.942837] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-16T21:54:12.390281] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (2.85 seconds). [2025-10-16T21:54:12.474585] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-16T21:54:12.742847] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-16T21:54:13.050586] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-16T21:54:13.479862] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-16T21:54:13.542796] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-16T21:54:13.879345] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T21:54:14.342878] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-16T21:54:14.821249] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-16T21:54:14.822236] [INFO ] [REMOTE ] TISI: Full fetch complete (4892 records). [2025-10-16T21:54:14.822307] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-16T21:54:15.155731] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-16T21:54:15.199290] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-16T21:54:15.199420] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-16T21:54:15.199597] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-16T21:54:15.199773] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-16T21:54:15.200546] [DEBUG] [LOCAL ] TISI: Trimmed 4892 records to 3349 (keeping 200 days of data) [2025-10-16T21:54:15.221341] [DEBUG] [LOCAL ] TISI: Primary data saved (3349 records). [2025-10-16T21:54:15.221462] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-16T21:54:15.221549] [INFO ] [MAIN ] Update Progress: 2093/2369 symbols completed. TISI took 23.8s. Estimated remaining: 38m 48s. Rate: 7.1 symbols/min [2025-10-16T21:54:15.401925] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:54:15.435156] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T21:54:15.485869] [DEBUG] [LOCAL ] TK: Loaded 39139 existing records from primary storage. [2025-10-16T21:54:15.486203] [INFO ] [MAIN ] TK: Loaded 39139 existing records. [2025-10-16T21:54:15.661940] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:54:15.662169] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-16T21:54:15.662216] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-16T21:54:15.662538] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-16T21:54:15.662594] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-16T21:54:15.947915] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-16T21:54:16.023003] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:54:16.542420] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-16T21:54:16.742793] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-16T21:54:17.092038] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T21:54:17.542814] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-16T21:54:18.233187] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T21:54:18.342812] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-16T21:54:18.691104] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T21:54:19.142836] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-16T21:54:19.942875] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-16T21:54:20.742849] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-10-16T21:54:20.813668] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-16T21:54:21.175506] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-16T21:54:21.287761] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T21:54:21.542811] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-16T21:54:22.291946] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T21:54:22.342769] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-16T21:54:23.142781] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-16T21:54:23.653723] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-16T21:54:23.845523] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T21:54:23.942789] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-16T21:54:24.639133] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T21:54:24.742776] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-16T21:54:24.844061] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T21:54:25.542815] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-16T21:54:26.342774] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-16T21:54:26.473989] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T21:54:26.783432] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T21:54:27.142810] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-10-16T21:54:27.368333] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-16T21:54:27.942802] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-16T21:54:28.742847] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-16T21:54:29.244114] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-16T21:54:29.542795] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-16T21:54:29.863981] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-16T21:54:29.868282] [INFO ] [REMOTE ] TIMB: Full fetch complete (53446 records). [2025-10-16T21:54:29.868380] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-16T21:54:30.255583] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-16T21:54:30.255687] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-16T21:54:30.256685] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-16T21:54:30.256746] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-16T21:54:30.257812] [DEBUG] [LOCAL ] TIMB: Trimmed 53446 records to 35551 (keeping 200 days of data) [2025-10-16T21:54:30.352214] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-16T21:54:30.424366] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (3.28 seconds). [2025-10-16T21:54:30.536122] [DEBUG] [LOCAL ] TIMB: Primary data saved (35551 records). [2025-10-16T21:54:30.536293] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-16T21:54:30.537334] [INFO ] [MAIN ] Update Progress: 2094/2369 symbols completed. TIMB took 40.3s. Estimated remaining: 38m 40s. Rate: 7.1 symbols/min [2025-10-16T21:54:30.707491] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:54:30.746055] [DEBUG] [LOCAL ] TKC: Loaded 39494 existing records from primary storage. [2025-10-16T21:54:30.746338] [INFO ] [MAIN ] TKC: Loaded 39494 existing records. [2025-10-16T21:54:30.925856] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:54:30.926284] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-16T21:54:30.926354] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-16T21:54:30.926708] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-16T21:54:30.926766] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-16T21:54:31.171676] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-10-16T21:54:31.215929] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T21:54:31.340954] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:54:31.948175] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-16T21:54:31.959027] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T21:54:32.742813] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-10-16T21:54:32.846775] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T21:54:33.542793] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-10-16T21:54:33.735187] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T21:54:33.740076] [INFO ] [REMOTE ] TIXT: Full fetch complete (46304 records). [2025-10-16T21:54:33.740165] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-16T21:54:34.120387] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-16T21:54:34.120501] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-16T21:54:34.121712] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-16T21:54:34.121778] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-16T21:54:34.122783] [DEBUG] [LOCAL ] TIXT: Trimmed 46304 records to 32709 (keeping 200 days of data) [2025-10-16T21:54:34.307279] [DEBUG] [LOCAL ] TIXT: Primary data saved (32709 records). [2025-10-16T21:54:34.307412] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-16T21:54:34.307487] [INFO ] [MAIN ] Update Progress: 2095/2369 symbols completed. TIXT took 41.4s. Estimated remaining: 38m 31s. Rate: 7.1 symbols/min [2025-10-16T21:54:34.351194] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-10-16T21:54:34.485369] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:54:34.526694] [DEBUG] [LOCAL ] TKO: Loaded 43742 existing records from primary storage. [2025-10-16T21:54:34.527011] [INFO ] [MAIN ] TKO: Loaded 43742 existing records. [2025-10-16T21:54:34.707856] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:54:34.708060] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-16T21:54:34.708107] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-16T21:54:34.708349] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-10-16T21:54:34.708406] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-16T21:54:35.045494] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-16T21:54:35.101423] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:54:35.142770] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-10-16T21:54:35.786120] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-16T21:54:35.942835] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-10-16T21:54:36.253682] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-16T21:54:36.742844] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-16T21:54:36.806839] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T21:54:37.436681] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T21:54:37.542797] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-10-16T21:54:37.631542] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T21:54:38.342870] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-10. [2025-10-16T21:54:39.057844] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-16T21:54:39.064962] [INFO ] [REMOTE ] TJX: Full fetch complete (77836 records). [2025-10-16T21:54:39.065096] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-16T21:54:39.145886] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-16T21:54:39.252577] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T21:54:39.527906] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-16T21:54:39.528013] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-16T21:54:39.529372] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-16T21:54:39.529437] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-16T21:54:39.530881] [DEBUG] [LOCAL ] TJX: Trimmed 77836 records to 54057 (keeping 200 days of data) [2025-10-16T21:54:39.855435] [DEBUG] [LOCAL ] TJX: Primary data saved (54057 records). [2025-10-16T21:54:39.855568] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-16T21:54:39.855662] [INFO ] [MAIN ] Update Progress: 2096/2369 symbols completed. TJX took 40.0s. Estimated remaining: 38m 22s. Rate: 7.1 symbols/min [2025-10-16T21:54:39.951226] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-16T21:54:40.022383] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:54:40.062157] [DEBUG] [LOCAL ] TKR: Loaded 39727 existing records from primary storage. [2025-10-16T21:54:40.062427] [INFO ] [MAIN ] TKR: Loaded 39727 existing records. [2025-10-16T21:54:40.239828] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:54:40.240047] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-16T21:54:40.240106] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-16T21:54:40.240296] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-16T21:54:40.240351] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-16T21:54:40.607861] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:54:40.610168] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T21:54:40.742779] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-10-16T21:54:41.542864] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-10-16T21:54:41.762371] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T21:54:42.174912] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T21:54:42.342905] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-16T21:54:42.710675] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T21:54:43.142866] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-16T21:54:43.735383] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T21:54:43.942855] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-10-16T21:54:44.249564] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T21:54:44.742837] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-10-16T21:54:45.246169] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-16T21:54:45.542823] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-16T21:54:46.342782] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-16T21:54:46.453248] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T21:54:47.102147] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T21:54:47.142777] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-10-16T21:54:47.772895] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T21:54:47.942780] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-16T21:54:48.742852] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-16T21:54:48.915376] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T21:54:49.499717] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T21:54:49.542776] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-16T21:54:49.951875] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T21:54:50.342841] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-10-16T21:54:51.142794] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-10-16T21:54:51.645794] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-16T21:54:51.813200] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T21:54:51.942779] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-10. [2025-10-16T21:54:52.355763] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T21:54:52.742824] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-10-16T21:54:53.248872] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-16T21:54:53.253757] [INFO ] [REMOTE ] TK: Full fetch complete (56309 records). [2025-10-16T21:54:53.253914] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-16T21:54:53.552813] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-10-16T21:54:53.657025] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-16T21:54:53.657142] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-16T21:54:53.658150] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-16T21:54:53.658212] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-16T21:54:53.659407] [DEBUG] [LOCAL ] TK: Trimmed 56309 records to 39426 (keeping 200 days of data) [2025-10-16T21:54:53.886505] [DEBUG] [LOCAL ] TK: Primary data saved (39426 records). [2025-10-16T21:54:53.886672] [INFO ] [MAIN ] TK: Full history saved. [2025-10-16T21:54:53.887178] [INFO ] [MAIN ] Update Progress: 2097/2369 symbols completed. TK took 38.7s. Estimated remaining: 38m 15s. Rate: 7.1 symbols/min [2025-10-16T21:54:54.062762] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:54:54.103024] [DEBUG] [LOCAL ] TLK: Loaded 38630 existing records from primary storage. [2025-10-16T21:54:54.103436] [INFO ] [MAIN ] TLK: Loaded 38630 existing records. [2025-10-16T21:54:54.282347] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:54:54.282692] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-16T21:54:54.282753] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-16T21:54:54.282933] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-16T21:54:54.282972] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-16T21:54:54.354294] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-16T21:54:54.677547] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:54:55.142848] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-10-16T21:54:55.273419] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T21:54:55.718817] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-10-16T21:54:55.817479] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T21:54:55.942822] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-10-16T21:54:56.280603] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T21:54:56.742849] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-10-16T21:54:57.537735] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T21:54:57.546940] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-16T21:54:58.336475] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T21:54:58.344942] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-10-16T21:54:58.897029] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T21:54:59.142867] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-16T21:54:59.750452] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T21:54:59.942820] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-10-16T21:55:00.742792] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-16T21:55:00.788093] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T21:55:01.542816] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-16T21:55:01.703348] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T21:55:02.342894] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-10-16T21:55:02.622976] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-16T21:55:03.048814] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-16T21:55:03.055050] [INFO ] [REMOTE ] TKC: Full fetch complete (53918 records). [2025-10-16T21:55:03.055209] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-16T21:55:03.151551] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-16T21:55:03.430797] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-16T21:55:03.430876] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-16T21:55:03.431846] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-16T21:55:03.431907] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-16T21:55:03.432992] [DEBUG] [LOCAL ] TKC: Trimmed 53918 records to 39841 (keeping 200 days of data) [2025-10-16T21:55:03.659504] [DEBUG] [LOCAL ] TKC: Primary data saved (39841 records). [2025-10-16T21:55:03.659660] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-16T21:55:03.660202] [INFO ] [MAIN ] Update Progress: 2098/2369 symbols completed. TKC took 33.1s. Estimated remaining: 38m 6s. Rate: 7.1 symbols/min [2025-10-16T21:55:03.836201] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:55:03.854939] [DEBUG] [LOCAL ] TLYS: Loaded 16578 existing records from primary storage. [2025-10-16T21:55:03.855199] [INFO ] [MAIN ] TLYS: Loaded 16578 existing records. [2025-10-16T21:55:03.957789] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-10-16T21:55:04.042881] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:55:04.043173] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-16T21:55:04.043388] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-16T21:55:04.043789] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-16T21:55:04.043889] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-16T21:55:04.147884] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T21:55:04.427938] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:55:04.742775] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-10-16T21:55:05.496929] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T21:55:05.542790] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-10-16T21:55:05.676226] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-10-16T21:55:06.273264] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T21:55:06.342790] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-10-16T21:55:06.919476] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-16T21:55:07.142889] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-16T21:55:07.237399] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T21:55:07.703980] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T21:55:07.942833] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-16T21:55:08.742813] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-10-16T21:55:09.482845] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-16T21:55:09.542781] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-10. [2025-10-16T21:55:09.571214] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T21:55:10.342810] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-10. [2025-10-16T21:55:10.924858] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T21:55:10.930019] [INFO ] [REMOTE ] TKR: Full fetch complete (57991 records). [2025-10-16T21:55:10.930157] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-16T21:55:11.039115] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T21:55:11.077935] [INFO ] [REMOTE ] TKO: Full fetch complete (65317 records). [2025-10-16T21:55:11.098341] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-16T21:55:11.164850] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-16T21:55:11.611111] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-16T21:55:11.620163] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-16T21:55:11.626805] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-16T21:55:11.626889] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-16T21:55:11.660583] [DEBUG] [LOCAL ] TKR: Trimmed 57991 records to 39969 (keeping 200 days of data) [2025-10-16T21:55:11.844435] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-16T21:55:11.845227] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-16T21:55:11.846222] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-16T21:55:11.846309] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-16T21:55:11.850603] [DEBUG] [LOCAL ] TKO: Trimmed 65317 records to 44026 (keeping 200 days of data) [2025-10-16T21:55:11.943279] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-16T21:55:12.081147] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T21:55:12.229674] [DEBUG] [LOCAL ] TKR: Primary data saved (39969 records). [2025-10-16T21:55:12.230785] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-16T21:55:12.232269] [INFO ] [MAIN ] Update Progress: 2099/2369 symbols completed. TKR took 32.4s. Estimated remaining: 37m 58s. Rate: 7.1 symbols/min [2025-10-16T21:55:12.413024] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:55:12.479792] [DEBUG] [LOCAL ] TM: Loaded 36494 existing records from primary storage. [2025-10-16T21:55:12.480287] [DEBUG] [LOCAL ] TKO: Primary data saved (44026 records). [2025-10-16T21:55:12.480547] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-16T21:55:12.481128] [INFO ] [MAIN ] Update Progress: 2100/2369 symbols completed. TKO took 38.2s. Estimated remaining: 37m 48s. Rate: 7.1 symbols/min [2025-10-16T21:55:12.481272] [INFO ] [MAIN ] TM: Loaded 36494 existing records. [2025-10-16T21:55:12.745237] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-16T21:55:12.800601] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:55:12.835107] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:55:12.835636] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-16T21:55:12.835736] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-16T21:55:12.835947] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-16T21:55:12.836005] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-16T21:55:13.180904] [DEBUG] [LOCAL ] TME: Loaded 53194 existing records from primary storage. [2025-10-16T21:55:13.212038] [INFO ] [MAIN ] TME: Loaded 53194 existing records. [2025-10-16T21:55:13.270400] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:55:13.416586] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:55:13.416878] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-16T21:55:13.417008] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-16T21:55:13.417332] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-16T21:55:13.417435] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-16T21:55:13.553677] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-10-16T21:55:13.644535] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T21:55:13.735486] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-16T21:55:13.833120] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:55:14.342834] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-16T21:55:15.142802] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-10-16T21:55:15.209920] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-16T21:55:15.378763] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T21:55:15.942815] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-16T21:55:16.742798] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-16T21:55:16.869529] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T21:55:16.920715] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T21:55:17.542850] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-16T21:55:18.342796] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-16T21:55:18.404146] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T21:55:18.779193] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T21:55:19.142864] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-16T21:55:19.809872] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T21:55:19.942818] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-16T21:55:20.738179] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T21:55:20.744574] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-16T21:55:20.761566] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-16T21:55:21.542850] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-16T21:55:22.263843] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T21:55:22.342814] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-16T21:55:22.388009] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-16T21:55:23.142824] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-16T21:55:23.942803] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-16T21:55:24.528479] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-16T21:55:24.742788] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-16T21:55:24.796984] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T21:55:24.909022] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T21:55:25.542811] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-16T21:55:26.335191] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T21:55:26.343597] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-16T21:55:27.142827] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-16T21:55:27.190074] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T21:55:27.942812] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-16T21:55:28.123856] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T21:55:28.606393] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T21:55:28.742812] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-16T21:55:29.542799] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-16T21:55:30.342858] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-16T21:55:30.626782] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-16T21:55:30.693827] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T21:55:30.796985] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T21:55:30.804968] [INFO ] [REMOTE ] TLK: Full fetch complete (57467 records). [2025-10-16T21:55:30.805148] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-16T21:55:30.913099] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T21:55:30.953738] [INFO ] [REMOTE ] TLYS: Full fetch complete (21390 records). [2025-10-16T21:55:30.974683] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-16T21:55:31.150191] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-16T21:55:31.396630] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-16T21:55:31.470598] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-16T21:55:31.488140] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-16T21:55:31.507669] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-16T21:55:31.564863] [DEBUG] [LOCAL ] TLK: Trimmed 57467 records to 39006 (keeping 200 days of data) [2025-10-16T21:55:31.606272] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-16T21:55:31.606383] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-16T21:55:31.606686] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-16T21:55:31.606754] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-16T21:55:31.662422] [DEBUG] [LOCAL ] TLYS: Trimmed 21390 records to 16632 (keeping 200 days of data) [2025-10-16T21:55:31.821141] [DEBUG] [LOCAL ] TLYS: Primary data saved (16632 records). [2025-10-16T21:55:31.822504] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-16T21:55:31.822986] [INFO ] [MAIN ] Update Progress: 2101/2369 symbols completed. TLYS took 28.2s. Estimated remaining: 37m 41s. Rate: 7.1 symbols/min [2025-10-16T21:55:31.945309] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-16T21:55:32.065305] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:55:32.145405] [DEBUG] [LOCAL ] TLK: Primary data saved (39006 records). [2025-10-16T21:55:32.145562] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-16T21:55:32.145673] [INFO ] [MAIN ] Update Progress: 2102/2369 symbols completed. TLK took 38.3s. Estimated remaining: 37m 32s. Rate: 7.1 symbols/min [2025-10-16T21:55:32.260274] [DEBUG] [LOCAL ] TMHC: Loaded 45461 existing records from primary storage. [2025-10-16T21:55:32.271479] [INFO ] [MAIN ] TMHC: Loaded 45461 existing records. [2025-10-16T21:55:32.434978] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:55:32.514934] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:55:32.515226] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-16T21:55:32.515281] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-16T21:55:32.515465] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-16T21:55:32.515504] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-16T21:55:32.808722] [DEBUG] [LOCAL ] TMO: Loaded 52446 existing records from primary storage. [2025-10-16T21:55:32.825073] [INFO ] [MAIN ] TMO: Loaded 52446 existing records. [2025-10-16T21:55:33.025913] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:55:33.026699] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-10-16T21:55:33.107317] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:55:33.107759] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-16T21:55:33.107834] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-16T21:55:33.108093] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-16T21:55:33.108165] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-16T21:55:33.269671] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-16T21:55:33.511041] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:55:33.542771] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-10-16T21:55:33.630501] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T21:55:34.342804] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-16T21:55:35.142788] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-16T21:55:35.261375] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T21:55:35.375561] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-16T21:55:35.942794] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-16T21:55:36.011090] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T21:55:36.742811] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-16T21:55:36.928153] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T21:55:37.341177] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T21:55:37.542855] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-16T21:55:38.174100] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T21:55:38.342818] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-16T21:55:39.142807] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-16T21:55:39.367318] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T21:55:39.942797] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-16T21:55:40.016986] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T21:55:40.742794] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-16T21:55:40.891079] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-16T21:55:41.542806] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-16T21:55:42.007681] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T21:55:42.227575] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T21:55:42.342816] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-16T21:55:42.835910] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T21:55:43.142820] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-16T21:55:43.613328] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-16T21:55:43.942804] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-16T21:55:44.742805] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-16T21:55:45.133723] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-16T21:55:45.468847] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T21:55:45.542781] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-16T21:55:45.837434] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T21:55:46.342866] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-16T21:55:47.113170] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T21:55:47.142783] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-16T21:55:47.781210] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-16T21:55:47.942787] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-16T21:55:48.675107] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T21:55:48.742797] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-16T21:55:49.542790] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-16T21:55:49.858199] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T21:55:50.253750] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T21:55:50.342830] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-16T21:55:51.115446] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T21:55:51.122381] [INFO ] [REMOTE ] TME: Full fetch complete (77144 records). [2025-10-16T21:55:51.122505] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-16T21:55:51.154008] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-16T21:55:51.516564] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-16T21:55:51.516662] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-16T21:55:51.517863] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-16T21:55:51.517924] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-16T21:55:51.519334] [DEBUG] [LOCAL ] TME: Trimmed 77144 records to 53584 (keeping 200 days of data) [2025-10-16T21:55:51.840636] [DEBUG] [LOCAL ] TME: Primary data saved (53584 records). [2025-10-16T21:55:51.840863] [INFO ] [MAIN ] TME: Full history saved. [2025-10-16T21:55:51.840991] [INFO ] [MAIN ] Update Progress: 2103/2369 symbols completed. TME took 39.4s. Estimated remaining: 37m 25s. Rate: 7.1 symbols/min [2025-10-16T21:55:51.946844] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-16T21:55:52.054129] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:55:52.056363] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T21:55:52.081694] [DEBUG] [LOCAL ] TNC: Loaded 14448 existing records from primary storage. [2025-10-16T21:55:52.081944] [INFO ] [MAIN ] TNC: Loaded 14448 existing records. [2025-10-16T21:55:52.260057] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:55:52.260293] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-16T21:55:52.260342] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-16T21:55:52.260504] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-16T21:55:52.260556] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-16T21:55:52.632629] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:55:52.742833] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-16T21:55:52.892241] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T21:55:52.896715] [INFO ] [REMOTE ] TM: Full fetch complete (52314 records). [2025-10-16T21:55:52.896831] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-16T21:55:53.272383] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-16T21:55:53.272465] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-16T21:55:53.273417] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-16T21:55:53.273479] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-16T21:55:53.274544] [DEBUG] [LOCAL ] TM: Trimmed 52314 records to 36641 (keeping 200 days of data) [2025-10-16T21:55:53.508455] [DEBUG] [LOCAL ] TM: Primary data saved (36641 records). [2025-10-16T21:55:53.508713] [INFO ] [MAIN ] TM: Full history saved. [2025-10-16T21:55:53.508844] [INFO ] [MAIN ] Update Progress: 2104/2369 symbols completed. TM took 41.3s. Estimated remaining: 37m 16s. Rate: 7.1 symbols/min [2025-10-16T21:55:53.551598] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-10-16T21:55:53.712053] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:55:53.714760] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T21:55:53.752250] [DEBUG] [LOCAL ] TNET: Loaded 28305 existing records from primary storage. [2025-10-16T21:55:53.752535] [INFO ] [MAIN ] TNET: Loaded 28305 existing records. [2025-10-16T21:55:53.953919] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:55:53.954179] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-16T21:55:53.954229] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-16T21:55:53.954745] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-16T21:55:53.954814] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-16T21:55:54.354569] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-16T21:55:54.362400] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:55:54.783420] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-16T21:55:54.800836] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-16T21:55:55.142832] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-16T21:55:55.942787] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-10-16T21:55:56.182517] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-16T21:55:56.640386] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-16T21:55:56.742776] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-16T21:55:57.238441] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T21:55:57.542831] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-16T21:55:58.021295] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T21:55:58.028725] [INFO ] [REMOTE ] TMHC: Full fetch complete (66352 records). [2025-10-16T21:55:58.028856] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-16T21:55:58.347901] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-16T21:55:58.422307] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-16T21:55:58.422386] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-16T21:55:58.423578] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-16T21:55:58.423666] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-16T21:55:58.425125] [DEBUG] [LOCAL ] TMHC: Trimmed 66352 records to 45838 (keeping 200 days of data) [2025-10-16T21:55:58.726198] [DEBUG] [LOCAL ] TMHC: Primary data saved (45838 records). [2025-10-16T21:55:58.726400] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-16T21:55:58.726509] [INFO ] [MAIN ] Update Progress: 2105/2369 symbols completed. TMHC took 26.9s. Estimated remaining: 37m 7s. Rate: 7.1 symbols/min [2025-10-16T21:55:58.921688] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:55:58.921931] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-16T21:55:58.921969] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-16T21:55:58.922095] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-16T21:55:58.922136] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-16T21:55:58.922177] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-16T21:55:58.922211] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-16T21:55:59.150484] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-16T21:55:59.389692] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:55:59.411285] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T21:55:59.475311] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-16T21:55:59.942911] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-16T21:56:00.438859] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T21:56:00.742880] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-10-16T21:56:00.965331] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T21:56:00.965634] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-10-16T21:56:00.965764] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T21:56:00.965813] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-16T21:56:00.965872] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T21:56:00.965945] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-16T21:56:00.966010] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-16T21:56:00.966047] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-16T21:56:00.966103] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-16T21:56:00.966148] [INFO ] [MAIN ] Update Progress: 2106/2369 symbols completed. TNGY took 2.2s. Estimated remaining: 36m 58s. Rate: 7.1 symbols/min [2025-10-16T21:56:01.132919] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:56:01.168538] [DEBUG] [LOCAL ] TNK: Loaded 35361 existing records from primary storage. [2025-10-16T21:56:01.168880] [INFO ] [MAIN ] TNK: Loaded 35361 existing records. [2025-10-16T21:56:01.349770] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:56:01.349969] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-16T21:56:01.350019] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-16T21:56:01.350314] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-16T21:56:01.350371] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-16T21:56:01.548065] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-16T21:56:01.705134] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:56:02.082666] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-16T21:56:02.342793] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-10-16T21:56:02.690691] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T21:56:03.142808] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-16T21:56:03.680760] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T21:56:03.942783] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-16T21:56:04.255923] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-16T21:56:04.742865] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-16T21:56:05.480406] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T21:56:05.542800] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-16T21:56:06.342827] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-16T21:56:06.651633] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T21:56:06.961907] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T21:56:07.142841] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-16T21:56:07.663681] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T21:56:07.942786] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-16T21:56:08.742790] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-16T21:56:08.851861] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T21:56:08.929789] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-16T21:56:09.542793] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-16T21:56:09.709950] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T21:56:10.342821] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-16T21:56:10.687334] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T21:56:11.142816] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-16T21:56:11.406846] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-16T21:56:11.942796] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-16T21:56:12.371148] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T21:56:12.742845] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-16T21:56:13.190240] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-16T21:56:13.542834] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-16T21:56:13.928143] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T21:56:14.342878] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-16T21:56:14.798057] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-16T21:56:14.804792] [INFO ] [REMOTE ] TMO: Full fetch complete (75699 records). [2025-10-16T21:56:14.805000] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-16T21:56:15.147918] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-16T21:56:15.223462] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-16T21:56:15.223685] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-16T21:56:15.225208] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-16T21:56:15.225359] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-16T21:56:15.227002] [DEBUG] [LOCAL ] TMO: Trimmed 75699 records to 52826 (keeping 200 days of data) [2025-10-16T21:56:15.485532] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-16T21:56:15.610030] [DEBUG] [LOCAL ] TMO: Primary data saved (52826 records). [2025-10-16T21:56:15.610177] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-16T21:56:15.610260] [INFO ] [MAIN ] Update Progress: 2107/2369 symbols completed. TMO took 43.5s. Estimated remaining: 36m 50s. Rate: 7.1 symbols/min [2025-10-16T21:56:15.773831] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:56:15.813985] [DEBUG] [LOCAL ] TNL: Loaded 41792 existing records from primary storage. [2025-10-16T21:56:15.814269] [INFO ] [MAIN ] TNL: Loaded 41792 existing records. [2025-10-16T21:56:15.950572] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-16T21:56:15.993713] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:56:15.993990] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-16T21:56:15.994039] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-16T21:56:15.994798] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-16T21:56:15.994880] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-16T21:56:16.364981] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:56:16.561564] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T21:56:16.742829] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-16T21:56:17.140081] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T21:56:17.542801] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-10-16T21:56:17.750422] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T21:56:18.342816] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-16T21:56:18.910581] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T21:56:19.142811] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-16T21:56:19.725548] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T21:56:19.942808] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-16T21:56:20.120299] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-16T21:56:20.742816] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-16T21:56:21.411410] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T21:56:21.542805] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-16T21:56:21.961427] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T21:56:22.342806] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-16T21:56:23.028525] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T21:56:23.142803] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-16T21:56:23.717342] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-16T21:56:23.942869] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-16T21:56:24.063690] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-16T21:56:24.742833] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-16T21:56:25.303968] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T21:56:25.542876] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-16T21:56:26.056119] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-16T21:56:26.060527] [INFO ] [REMOTE ] TNK: Full fetch complete (51972 records). [2025-10-16T21:56:26.060606] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-16T21:56:26.347957] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-16T21:56:26.443373] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-16T21:56:26.443496] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-16T21:56:26.444590] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-16T21:56:26.444676] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-16T21:56:26.445775] [DEBUG] [LOCAL ] TNK: Trimmed 51972 records to 35627 (keeping 200 days of data) [2025-10-16T21:56:26.542162] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-16T21:56:26.679721] [DEBUG] [LOCAL ] TNK: Primary data saved (35627 records). [2025-10-16T21:56:26.679896] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-16T21:56:26.680595] [INFO ] [MAIN ] Update Progress: 2108/2369 symbols completed. TNK took 25.7s. Estimated remaining: 36m 42s. Rate: 7.1 symbols/min [2025-10-16T21:56:26.851376] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:56:26.905038] [DEBUG] [LOCAL ] TOL: Loaded 50667 existing records from primary storage. [2025-10-16T21:56:26.905362] [INFO ] [MAIN ] TOL: Loaded 50667 existing records. [2025-10-16T21:56:27.090873] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:56:27.091069] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-16T21:56:27.091116] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-16T21:56:27.091530] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-16T21:56:27.091569] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-16T21:56:27.153236] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-16T21:56:27.455988] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:56:27.517862] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T21:56:27.522586] [INFO ] [REMOTE ] TNET: Full fetch complete (41841 records). [2025-10-16T21:56:27.522754] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-16T21:56:27.896390] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-16T21:56:27.896465] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-16T21:56:27.897637] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-16T21:56:27.897724] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-16T21:56:27.898734] [DEBUG] [LOCAL ] TNET: Trimmed 41841 records to 28518 (keeping 200 days of data) [2025-10-16T21:56:27.951706] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-10-16T21:56:27.995767] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T21:56:28.002096] [INFO ] [REMOTE ] TNC: Full fetch complete (22332 records). [2025-10-16T21:56:28.003399] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-16T21:56:28.428956] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-16T21:56:28.444279] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-16T21:56:28.445137] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-16T21:56:28.445225] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-16T21:56:28.462570] [DEBUG] [LOCAL ] TNET: Primary data saved (28518 records). [2025-10-16T21:56:28.462988] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-16T21:56:28.462904] [DEBUG] [LOCAL ] TNC: Trimmed 22332 records to 14518 (keeping 200 days of data) [2025-10-16T21:56:28.463159] [INFO ] [MAIN ] Update Progress: 2109/2369 symbols completed. TNET took 35.0s. Estimated remaining: 36m 33s. Rate: 7.1 symbols/min [2025-10-16T21:56:28.700465] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:56:28.723627] [DEBUG] [LOCAL ] TNC: Primary data saved (14518 records). [2025-10-16T21:56:28.723857] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-16T21:56:28.723949] [INFO ] [MAIN ] Update Progress: 2110/2369 symbols completed. TNC took 36.9s. Estimated remaining: 36m 23s. Rate: 7.1 symbols/min [2025-10-16T21:56:28.754546] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-16T21:56:28.934884] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:56:28.936127] [DEBUG] [LOCAL ] TOST: Loaded 53690 existing records from primary storage. [2025-10-16T21:56:28.936888] [INFO ] [MAIN ] TOST: Loaded 53690 existing records. [2025-10-16T21:56:29.137226] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:56:29.137751] [DEBUG] [LOCAL ] TPB: Loaded 26115 existing records from primary storage. [2025-10-16T21:56:29.138142] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-16T21:56:29.138324] [INFO ] [MAIN ] TPB: Loaded 26115 existing records. [2025-10-16T21:56:29.138411] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-16T21:56:29.169750] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-16T21:56:29.201698] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-16T21:56:29.459345] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:56:29.459692] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-16T21:56:29.469975] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-16T21:56:29.494507] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-16T21:56:29.510739] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-16T21:56:29.796010] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:56:29.817007] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-10-16T21:56:30.077006] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:56:30.104276] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-16T21:56:30.244871] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T21:56:30.342772] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-16T21:56:31.142861] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-10-16T21:56:31.727691] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-16T21:56:31.851115] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T21:56:31.881675] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T21:56:31.942834] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-16T21:56:32.742789] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-16T21:56:33.080013] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T21:56:33.542812] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-16T21:56:34.342822] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-16T21:56:34.570326] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T21:56:34.626786] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T21:56:35.142793] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-16T21:56:35.942797] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-16T21:56:36.126578] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T21:56:36.621585] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T21:56:36.742804] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-16T21:56:37.542812] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-16T21:56:37.628737] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T21:56:38.342807] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-16T21:56:38.739303] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-16T21:56:38.901600] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-16T21:56:39.142846] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-16T21:56:39.595059] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-16T21:56:39.942865] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-16T21:56:40.669066] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T21:56:40.742819] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-16T21:56:41.542817] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-16T21:56:42.016970] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-16T21:56:42.342779] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-16T21:56:42.604525] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-16T21:56:43.093443] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-16T21:56:43.147923] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-16T21:56:43.163278] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T21:56:43.942872] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-16T21:56:44.314573] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T21:56:44.742820] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-16T21:56:45.325171] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T21:56:45.542847] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-16T21:56:46.342787] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-16T21:56:46.589413] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T21:56:47.142801] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-16T21:56:47.585695] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-16T21:56:47.612515] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T21:56:47.942833] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-16T21:56:48.729976] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T21:56:48.742773] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-16T21:56:49.542824] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-16T21:56:49.781765] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-16T21:56:50.342794] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-16T21:56:50.432535] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T21:56:50.457611] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-16T21:56:51.142811] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-16T21:56:51.814803] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T21:56:51.942849] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-16T21:56:52.506273] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T21:56:52.515089] [INFO ] [REMOTE ] TNL: Full fetch complete (59542 records). [2025-10-16T21:56:52.515302] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-16T21:56:52.747955] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-16T21:56:52.950027] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-16T21:56:52.950117] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-16T21:56:52.951166] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-16T21:56:52.951239] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-16T21:56:52.952777] [DEBUG] [LOCAL ] TNL: Trimmed 59542 records to 42043 (keeping 200 days of data) [2025-10-16T21:56:53.204808] [DEBUG] [LOCAL ] TNL: Primary data saved (42043 records). [2025-10-16T21:56:53.204898] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-16T21:56:53.205414] [INFO ] [MAIN ] Update Progress: 2111/2369 symbols completed. TNL took 37.6s. Estimated remaining: 36m 17s. Rate: 7.1 symbols/min [2025-10-16T21:56:53.376029] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:56:53.395372] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-16T21:56:53.435309] [DEBUG] [LOCAL ] TPC: Loaded 39038 existing records from primary storage. [2025-10-16T21:56:53.435587] [INFO ] [MAIN ] TPC: Loaded 39038 existing records. [2025-10-16T21:56:53.548024] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-16T21:56:53.618014] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:56:53.618194] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-16T21:56:53.618274] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-16T21:56:53.618471] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-16T21:56:53.618526] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-16T21:56:53.967924] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:56:54.342799] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-10-16T21:56:54.729215] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T21:56:55.142800] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-16T21:56:55.812780] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T21:56:55.847079] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-16T21:56:55.942836] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-16T21:56:56.742844] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-16T21:56:57.158162] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-16T21:56:57.542836] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-16T21:56:57.860082] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T21:56:58.112083] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-16T21:56:58.342874] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-16T21:56:59.142797] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-16T21:56:59.184440] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T21:56:59.942792] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-16T21:57:00.392931] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-16T21:57:00.462422] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T21:57:00.742842] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-16T21:57:01.542808] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-16T21:57:01.701712] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-16T21:57:01.708098] [INFO ] [REMOTE ] TOL: Full fetch complete (73779 records). [2025-10-16T21:57:01.708432] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-16T21:57:02.119957] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-16T21:57:02.120214] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-16T21:57:02.137269] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-16T21:57:02.138606] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-16T21:57:02.138484] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T21:57:02.147199] [DEBUG] [LOCAL ] TOL: Trimmed 73779 records to 51005 (keeping 200 days of data) [2025-10-16T21:57:02.344145] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-16T21:57:02.488029] [DEBUG] [LOCAL ] TOL: Primary data saved (51005 records). [2025-10-16T21:57:02.488188] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-16T21:57:02.489039] [INFO ] [MAIN ] Update Progress: 2112/2369 symbols completed. TOL took 35.8s. Estimated remaining: 36m 8s. Rate: 7.1 symbols/min [2025-10-16T21:57:02.653456] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:57:02.699203] [DEBUG] [LOCAL ] TPH: Loaded 44876 existing records from primary storage. [2025-10-16T21:57:02.699495] [INFO ] [MAIN ] TPH: Loaded 44876 existing records. [2025-10-16T21:57:02.877146] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:57:02.877446] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-16T21:57:02.877506] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-16T21:57:02.877734] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-16T21:57:02.877791] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-16T21:57:03.147102] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-16T21:57:03.232259] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:57:03.320583] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T21:57:03.853451] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T21:57:03.942788] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-16T21:57:04.559315] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T21:57:04.564126] [INFO ] [REMOTE ] TPB: Full fetch complete (36030 records). [2025-10-16T21:57:04.564251] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-16T21:57:04.750688] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-16T21:57:04.942720] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-16T21:57:04.942827] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-16T21:57:04.943584] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-16T21:57:04.943702] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-16T21:57:04.944535] [DEBUG] [LOCAL ] TPB: Trimmed 36030 records to 26306 (keeping 200 days of data) [2025-10-16T21:57:05.116168] [DEBUG] [LOCAL ] TPB: Primary data saved (26306 records). [2025-10-16T21:57:05.116302] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-16T21:57:05.116382] [INFO ] [MAIN ] Update Progress: 2113/2369 symbols completed. TPB took 36.4s. Estimated remaining: 35m 59s. Rate: 7.1 symbols/min [2025-10-16T21:57:05.285480] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T21:57:05.327747] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:57:05.341691] [DEBUG] [LOCAL ] TPL: Loaded 12354 existing records from primary storage. [2025-10-16T21:57:05.341944] [INFO ] [MAIN ] TPL: Loaded 12354 existing records. [2025-10-16T21:57:05.516272] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:57:05.516498] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-16T21:57:05.516545] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-16T21:57:05.516739] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-16T21:57:05.516794] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-16T21:57:05.547973] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-16T21:57:05.869585] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:57:06.342824] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-10-16T21:57:06.754031] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-16T21:57:06.761278] [INFO ] [REMOTE ] TOST: Full fetch complete (77852 records). [2025-10-16T21:57:06.761468] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-16T21:57:07.078421] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T21:57:07.152594] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-16T21:57:07.194439] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-16T21:57:07.194554] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-16T21:57:07.195985] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-16T21:57:07.196055] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-16T21:57:07.197837] [DEBUG] [LOCAL ] TOST: Trimmed 77852 records to 54080 (keeping 200 days of data) [2025-10-16T21:57:07.566249] [DEBUG] [LOCAL ] TOST: Primary data saved (54080 records). [2025-10-16T21:57:07.566463] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-16T21:57:07.566576] [INFO ] [MAIN ] Update Progress: 2114/2369 symbols completed. TOST took 39.1s. Estimated remaining: 35m 50s. Rate: 7.1 symbols/min [2025-10-16T21:57:07.699930] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T21:57:07.807985] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:57:07.866594] [DEBUG] [LOCAL ] TPR: Loaded 53434 existing records from primary storage. [2025-10-16T21:57:07.867133] [INFO ] [MAIN ] TPR: Loaded 53434 existing records. [2025-10-16T21:57:07.948053] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-16T21:57:08.059209] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:57:08.059529] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-16T21:57:08.059581] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-16T21:57:08.059876] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-16T21:57:08.059934] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-16T21:57:08.456212] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:57:08.742811] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-10-16T21:57:08.769371] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T21:57:09.073925] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T21:57:09.542844] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-10-16T21:57:10.342792] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-16T21:57:10.646536] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-16T21:57:10.663098] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-16T21:57:11.142868] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-16T21:57:11.849819] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T21:57:11.942778] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-16T21:57:12.121290] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T21:57:12.742820] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-16T21:57:13.523591] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T21:57:13.542799] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-16T21:57:13.659582] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T21:57:14.342806] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-16T21:57:15.149470] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-16T21:57:15.151862] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T21:57:15.942793] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-16T21:57:16.029433] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T21:57:16.135741] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-16T21:57:16.742834] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-16T21:57:17.542802] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-16T21:57:17.742678] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-16T21:57:18.089356] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-16T21:57:18.094285] [INFO ] [REMOTE ] TPC: Full fetch complete (55437 records). [2025-10-16T21:57:18.094453] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-16T21:57:18.347967] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-16T21:57:18.470859] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-16T21:57:18.470972] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-16T21:57:18.471955] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-16T21:57:18.472016] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-16T21:57:18.473174] [DEBUG] [LOCAL ] TPC: Trimmed 55437 records to 39334 (keeping 200 days of data) [2025-10-16T21:57:18.580174] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T21:57:18.710931] [DEBUG] [LOCAL ] TPC: Primary data saved (39334 records). [2025-10-16T21:57:18.711075] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-16T21:57:18.711514] [INFO ] [MAIN ] Update Progress: 2115/2369 symbols completed. TPC took 25.5s. Estimated remaining: 35m 42s. Rate: 7.1 symbols/min [2025-10-16T21:57:18.880407] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:57:18.906182] [DEBUG] [LOCAL ] TPVG: Loaded 27282 existing records from primary storage. [2025-10-16T21:57:18.906460] [INFO ] [MAIN ] TPVG: Loaded 27282 existing records. [2025-10-16T21:57:19.078881] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:57:19.079103] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-16T21:57:19.079160] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-16T21:57:19.079327] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-16T21:57:19.079366] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-16T21:57:19.152771] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-16T21:57:19.428538] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:57:19.932404] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T21:57:19.942906] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-16T21:57:20.087512] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T21:57:20.742826] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-16T21:57:21.253244] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T21:57:21.542810] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-16T21:57:21.799032] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T21:57:22.342817] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-10-16T21:57:23.017427] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T21:57:23.142814] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-16T21:57:23.775635] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T21:57:23.942790] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-16T21:57:24.160409] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-16T21:57:24.742849] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-16T21:57:24.851294] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T21:57:25.542863] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-16T21:57:25.942430] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T21:57:26.342831] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-16T21:57:27.142815] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-16T21:57:27.210096] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-16T21:57:27.347727] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T21:57:27.942786] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-16T21:57:28.284919] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T21:57:28.404920] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-16T21:57:28.742813] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-10. [2025-10-16T21:57:29.206803] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-16T21:57:29.208832] [INFO ] [REMOTE ] TPL: Full fetch complete (17732 records). [2025-10-16T21:57:29.208901] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-16T21:57:29.547886] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-16T21:57:29.589221] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-16T21:57:29.589302] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-16T21:57:29.589739] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-16T21:57:29.589823] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-16T21:57:29.590495] [DEBUG] [LOCAL ] TPL: Trimmed 17732 records to 12470 (keeping 200 days of data) [2025-10-16T21:57:29.674546] [DEBUG] [LOCAL ] TPL: Primary data saved (12470 records). [2025-10-16T21:57:29.674725] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-16T21:57:29.674818] [INFO ] [MAIN ] Update Progress: 2116/2369 symbols completed. TPL took 24.6s. Estimated remaining: 35m 34s. Rate: 7.1 symbols/min [2025-10-16T21:57:29.842190] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:57:29.853082] [DEBUG] [LOCAL ] TPYP: Loaded 7908 existing records from primary storage. [2025-10-16T21:57:29.853280] [INFO ] [MAIN ] TPYP: Loaded 7908 existing records. [2025-10-16T21:57:30.035847] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:57:30.036098] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-16T21:57:30.036153] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-16T21:57:30.036343] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-16T21:57:30.036413] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-16T21:57:30.354377] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-16T21:57:30.397474] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:57:31.142825] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-10-16T21:57:31.380178] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T21:57:31.740463] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T21:57:31.753284] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-16T21:57:31.942817] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-16T21:57:32.742808] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-16T21:57:33.169942] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T21:57:33.542817] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-16T21:57:34.342723] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-16T21:57:34.408296] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T21:57:35.142798] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-16T21:57:35.211066] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T21:57:35.266188] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-16T21:57:35.942829] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-16T21:57:36.742820] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-16T21:57:36.867624] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T21:57:37.544082] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-16T21:57:37.549407] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T21:57:38.044479] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T21:57:38.133675] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-16T21:57:38.342815] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-16T21:57:39.142783] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-16T21:57:39.320626] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-16T21:57:39.869193] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T21:57:39.942880] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-16T21:57:40.742858] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-16T21:57:41.473748] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T21:57:41.529554] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T21:57:41.542760] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-16T21:57:42.347978] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-16T21:57:42.355578] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-16T21:57:43.142853] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-16T21:57:43.783204] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T21:57:43.789416] [INFO ] [REMOTE ] TPH: Full fetch complete (64936 records). [2025-10-16T21:57:43.789545] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-16T21:57:43.951448] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-16T21:57:44.211316] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-16T21:57:44.211510] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-16T21:57:44.212826] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-16T21:57:44.212889] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-16T21:57:44.214417] [DEBUG] [LOCAL ] TPH: Trimmed 64936 records to 45161 (keeping 200 days of data) [2025-10-16T21:57:44.489133] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T21:57:44.582740] [DEBUG] [LOCAL ] TPH: Primary data saved (45161 records). [2025-10-16T21:57:44.582906] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-16T21:57:44.583857] [INFO ] [MAIN ] Update Progress: 2117/2369 symbols completed. TPH took 42.1s. Estimated remaining: 35m 26s. Rate: 7.1 symbols/min [2025-10-16T21:57:44.744959] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-16T21:57:44.746685] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T21:57:45.542892] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-16T21:57:46.296387] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-16T21:57:46.342763] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-16T21:57:46.389407] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T21:57:47.071286] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-16T21:57:47.142845] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-16T21:57:47.942866] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-16T21:57:48.477424] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T21:57:48.742807] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-16T21:57:49.489373] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T21:57:49.542772] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-16T21:57:49.676122] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T21:57:49.680404] [INFO ] [REMOTE ] TPVG: Full fetch complete (39537 records). [2025-10-16T21:57:49.680489] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-16T21:57:50.089916] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-16T21:57:50.090010] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-16T21:57:50.090822] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-16T21:57:50.090882] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-16T21:57:50.091707] [DEBUG] [LOCAL ] TPVG: Trimmed 39537 records to 27498 (keeping 200 days of data) [2025-10-16T21:57:50.251278] [DEBUG] [LOCAL ] TPVG: Primary data saved (27498 records). [2025-10-16T21:57:50.251428] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-16T21:57:50.251512] [INFO ] [MAIN ] Update Progress: 2118/2369 symbols completed. TPVG took 31.5s. Estimated remaining: 35m 17s. Rate: 7.1 symbols/min [2025-10-16T21:57:50.342868] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-16T21:57:51.141828] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-16T21:57:51.144086] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-16T21:57:51.496405] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-16T21:57:51.651982] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-16T21:57:51.942835] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-16T21:57:52.589238] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-16T21:57:52.590731] [INFO ] [REMOTE ] TPYP: Full fetch complete (12503 records). [2025-10-16T21:57:52.590800] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-16T21:57:52.744329] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-16T21:57:52.945505] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-16T21:57:52.945574] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-16T21:57:52.945875] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-16T21:57:52.945934] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-16T21:57:52.946373] [DEBUG] [LOCAL ] TPYP: Trimmed 12503 records to 7970 (keeping 200 days of data) [2025-10-16T21:57:52.993228] [DEBUG] [LOCAL ] TPYP: Primary data saved (7970 records). [2025-10-16T21:57:52.993326] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-16T21:57:52.993445] [INFO ] [MAIN ] Update Progress: 2119/2369 symbols completed. TPYP took 23.3s. Estimated remaining: 35m 8s. Rate: 7.1 symbols/min [2025-10-16T21:57:54.542004] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-16T21:57:54.553334] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-16T21:57:55.266539] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-16T21:57:55.273308] [INFO ] [REMOTE ] TPR: Full fetch complete (77541 records). [2025-10-16T21:57:55.273458] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-16T21:57:55.656855] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-16T21:57:55.656934] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-16T21:57:55.658065] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-16T21:57:55.658130] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-16T21:57:55.659831] [DEBUG] [LOCAL ] TPR: Trimmed 77541 records to 53806 (keeping 200 days of data) [2025-10-16T21:57:56.004549] [DEBUG] [LOCAL ] TPR: Primary data saved (53806 records). [2025-10-16T21:57:56.004727] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-16T21:57:56.004853] [INFO ] [MAIN ] Update Progress: 2120/2369 symbols completed. TPR took 48.4s. Estimated remaining: 34m 59s. Rate: 7.1 symbols/min [2025-10-16T21:57:56.634639] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:57:56.614955] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:57:56.719725] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:57:56.720890] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:57:56.740072] [DEBUG] [LOCAL ] TR: Loaded 18949 existing records from primary storage. [2025-10-16T21:57:56.744743] [INFO ] [MAIN ] TR: Loaded 18949 existing records. [2025-10-16T21:57:56.797078] [DEBUG] [LOCAL ] TRAK: Loaded 9646 existing records from primary storage. [2025-10-16T21:57:56.806729] [INFO ] [MAIN ] TRAK: Loaded 9646 existing records. [2025-10-16T21:57:56.806304] [DEBUG] [LOCAL ] TPZ: Loaded 4686 existing records from primary storage. [2025-10-16T21:57:56.847417] [INFO ] [MAIN ] TPZ: Loaded 4686 existing records. [2025-10-16T21:57:56.890321] [DEBUG] [LOCAL ] TRC: Loaded 15563 existing records from primary storage. [2025-10-16T21:57:56.981526] [INFO ] [MAIN ] TRC: Loaded 15563 existing records. [2025-10-16T21:57:57.228355] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:57:57.297389] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-16T21:57:57.329077] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-16T21:57:57.369671] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-16T21:57:57.414124] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-16T21:57:57.404786] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:57:57.440038] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-16T21:57:57.503538] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-16T21:57:57.579695] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-16T21:57:57.569069] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:57:57.579868] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-16T21:57:57.639530] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-16T21:57:57.664074] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:57:57.707625] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-16T21:57:57.719632] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-16T21:57:57.729948] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-16T21:57:57.739258] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-16T21:57:57.729869] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-16T21:57:57.865357] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-16T21:57:57.910635] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-16T21:57:58.729760] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:57:58.761422] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-10-16T21:57:59.045901] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:57:59.094186] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-10-16T21:57:59.138311] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:57:59.138744] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-10-16T21:57:59.222963] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:57:59.223284] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-10-16T21:57:59.827016] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T21:57:59.830221] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-16T21:57:59.963942] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T21:57:59.966239] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-16T21:58:00.034065] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-16T21:58:00.037589] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-16T21:58:00.045713] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-16T21:58:00.048413] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-16T21:58:00.457187] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-16T21:58:00.575037] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-16T21:58:00.742838] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-16T21:58:00.934922] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T21:58:00.998205] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T21:58:01.491786] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T21:58:01.542830] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-16T21:58:02.342827] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-16T21:58:02.514818] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-16T21:58:02.868455] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-16T21:58:03.142811] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-16T21:58:03.942816] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-16T21:58:03.996178] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-16T21:58:04.539340] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T21:58:04.742829] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-16T21:58:05.542800] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-16T21:58:05.673977] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-16T21:58:06.342822] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-16T21:58:06.516686] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-16T21:58:06.939193] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T21:58:07.142813] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-16T21:58:07.942849] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-16T21:58:08.336399] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T21:58:08.742861] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-16T21:58:08.949536] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T21:58:09.542796] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-16T21:58:09.551578] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-16T21:58:10.319469] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-16T21:58:10.342778] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-16T21:58:10.874078] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-16T21:58:11.142810] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-16T21:58:11.942801] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-16T21:58:12.317446] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T21:58:12.446067] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-16T21:58:12.742820] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-16T21:58:13.461934] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-16T21:58:13.542778] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-16T21:58:14.201702] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-16T21:58:14.342812] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-16T21:58:14.950110] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T21:58:15.142818] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-16T21:58:15.942799] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-16T21:58:15.984299] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-16T21:58:16.588899] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-16T21:58:16.742834] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-16T21:58:17.542816] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-16T21:58:17.712795] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-16T21:58:17.874384] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-16T21:58:18.342792] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-16T21:58:19.142837] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-16T21:58:19.354441] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T21:58:19.728637] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-16T21:58:19.942880] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-16T21:58:20.742814] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-16T21:58:21.075904] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T21:58:21.243810] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-16T21:58:21.245040] [INFO ] [REMOTE ] TPZ: Full fetch complete (8834 records). [2025-10-16T21:58:21.245112] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-16T21:58:21.547944] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-16T21:58:21.612236] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-16T21:58:21.612317] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-16T21:58:21.612596] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-16T21:58:21.612702] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-16T21:58:21.613120] [DEBUG] [LOCAL ] TPZ: Trimmed 8834 records to 4722 (keeping 200 days of data) [2025-10-16T21:58:21.642727] [DEBUG] [LOCAL ] TPZ: Primary data saved (4722 records). [2025-10-16T21:58:21.642873] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-16T21:58:21.642960] [INFO ] [MAIN ] Update Progress: 2121/2369 symbols completed. TPZ took 25.6s. Estimated remaining: 34m 53s. Rate: 7.1 symbols/min [2025-10-16T21:58:21.833821] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:58:21.881237] [DEBUG] [LOCAL ] TREX: Loaded 49839 existing records from primary storage. [2025-10-16T21:58:21.881545] [INFO ] [MAIN ] TREX: Loaded 49839 existing records. [2025-10-16T21:58:22.070982] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:58:22.071592] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-16T21:58:22.071671] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-16T21:58:22.071977] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-16T21:58:22.072053] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-16T21:58:22.351092] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-16T21:58:22.441596] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:58:22.630509] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T21:58:23.142800] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-16T21:58:23.478892] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T21:58:23.942828] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-10-16T21:58:24.113160] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T21:58:24.742834] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-16T21:58:25.536622] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T21:58:25.546267] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-16T21:58:25.620835] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T21:58:26.269521] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T21:58:26.342792] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-16T21:58:27.142802] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-16T21:58:27.303263] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T21:58:27.305430] [INFO ] [REMOTE ] TRC: Full fetch complete (21850 records). [2025-10-16T21:58:27.305766] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-16T21:58:27.698150] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-16T21:58:27.698362] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-16T21:58:27.699010] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-16T21:58:27.699073] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-16T21:58:27.699720] [DEBUG] [LOCAL ] TRC: Trimmed 21850 records to 15667 (keeping 200 days of data) [2025-10-16T21:58:27.791316] [DEBUG] [LOCAL ] TRC: Primary data saved (15667 records). [2025-10-16T21:58:27.791467] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-16T21:58:27.791548] [INFO ] [MAIN ] Update Progress: 2122/2369 symbols completed. TRC took 31.8s. Estimated remaining: 34m 44s. Rate: 7.1 symbols/min [2025-10-16T21:58:27.948535] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-16T21:58:27.981260] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:58:27.997762] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-16T21:58:28.045032] [DEBUG] [LOCAL ] TRGP: Loaded 50840 existing records from primary storage. [2025-10-16T21:58:28.045415] [INFO ] [MAIN ] TRGP: Loaded 50840 existing records. [2025-10-16T21:58:28.218697] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:58:28.218924] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-16T21:58:28.218995] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-16T21:58:28.219494] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-16T21:58:28.219551] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-16T21:58:28.569609] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:58:28.742828] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-16T21:58:28.932374] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T21:58:28.936846] [INFO ] [REMOTE ] TR: Full fetch complete (25446 records). [2025-10-16T21:58:28.937018] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-16T21:58:29.321180] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-16T21:58:29.321334] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-16T21:58:29.321970] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-16T21:58:29.322033] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-16T21:58:29.322745] [DEBUG] [LOCAL ] TR: Trimmed 25446 records to 19082 (keeping 200 days of data) [2025-10-16T21:58:29.444685] [DEBUG] [LOCAL ] TR: Primary data saved (19082 records). [2025-10-16T21:58:29.444832] [INFO ] [MAIN ] TR: Full history saved. [2025-10-16T21:58:29.444914] [INFO ] [MAIN ] Update Progress: 2123/2369 symbols completed. TR took 33.4s. Estimated remaining: 34m 35s. Rate: 7.1 symbols/min [2025-10-16T21:58:29.543755] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-10-16T21:58:29.570402] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T21:58:29.627783] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:58:29.662909] [DEBUG] [LOCAL ] TRN: Loaded 36777 existing records from primary storage. [2025-10-16T21:58:29.663181] [INFO ] [MAIN ] TRN: Loaded 36777 existing records. [2025-10-16T21:58:29.840970] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:58:29.841134] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-16T21:58:29.841181] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-16T21:58:29.841705] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-16T21:58:29.841763] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-16T21:58:30.197013] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:58:30.342772] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-16T21:58:31.142825] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-16T21:58:31.375774] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T21:58:31.950613] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-10-16T21:58:31.952526] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T21:58:31.967726] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-16T21:58:31.970474] [INFO ] [REMOTE ] TRAK: Full fetch complete (13697 records). [2025-10-16T21:58:31.970546] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-16T21:58:32.328755] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-16T21:58:32.328834] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-16T21:58:32.329161] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-16T21:58:32.329206] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-16T21:58:32.329699] [DEBUG] [LOCAL ] TRAK: Trimmed 13697 records to 9724 (keeping 200 days of data) [2025-10-16T21:58:32.388473] [DEBUG] [LOCAL ] TRAK: Primary data saved (9724 records). [2025-10-16T21:58:32.388606] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-16T21:58:32.388709] [INFO ] [MAIN ] Update Progress: 2124/2369 symbols completed. TRAK took 36.4s. Estimated remaining: 34m 26s. Rate: 7.1 symbols/min [2025-10-16T21:58:32.562751] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:58:32.607248] [DEBUG] [LOCAL ] TRNO: Loaded 43960 existing records from primary storage. [2025-10-16T21:58:32.607547] [INFO ] [MAIN ] TRNO: Loaded 43960 existing records. [2025-10-16T21:58:32.747915] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-16T21:58:32.783582] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:58:32.783795] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-16T21:58:32.783843] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-16T21:58:32.784281] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-16T21:58:32.784336] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-16T21:58:33.141558] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:58:33.340308] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T21:58:33.542807] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-10-16T21:58:34.342792] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-16T21:58:34.518693] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T21:58:35.142809] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-16T21:58:35.370718] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T21:58:35.682379] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T21:58:35.942837] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-10-16T21:58:36.642585] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T21:58:36.742796] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-16T21:58:37.542876] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-10-16T21:58:37.626297] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T21:58:38.176268] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T21:58:38.342814] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-16T21:58:39.142801] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-16T21:58:39.372575] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-16T21:58:39.455777] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T21:58:39.942806] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-16T21:58:40.483803] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T21:58:40.742806] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-16T21:58:41.550800] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-16T21:58:41.554813] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T21:58:42.342806] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-16T21:58:42.447216] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T21:58:43.096224] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T21:58:43.142797] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-16T21:58:43.851678] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T21:58:43.942821] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-16T21:58:44.496298] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T21:58:44.742860] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-10-16T21:58:45.487162] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T21:58:45.542784] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-16T21:58:46.342881] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-16T21:58:46.587455] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T21:58:47.149392] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-16T21:58:47.173887] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T21:58:47.320694] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-16T21:58:47.942782] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-16T21:58:48.742835] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-10-16T21:58:48.860923] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T21:58:49.511375] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T21:58:49.542800] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-16T21:58:50.342874] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-16T21:58:50.606144] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T21:58:51.062313] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T21:58:51.142781] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-16T21:58:51.942898] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-10-16T21:58:52.109208] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T21:58:52.535344] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T21:58:52.742896] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-16T21:58:53.542841] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-16T21:58:53.812582] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T21:58:54.342843] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-16T21:58:54.615254] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-16T21:58:54.652837] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T21:58:54.657007] [INFO ] [REMOTE ] TRN: Full fetch complete (52677 records). [2025-10-16T21:58:54.657124] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-16T21:58:55.032709] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-16T21:58:55.032795] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-16T21:58:55.033726] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-16T21:58:55.033788] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-16T21:58:55.034849] [DEBUG] [LOCAL ] TRN: Trimmed 52677 records to 36976 (keeping 200 days of data) [2025-10-16T21:58:55.142946] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-16T21:58:55.269366] [DEBUG] [LOCAL ] TRN: Primary data saved (36976 records). [2025-10-16T21:58:55.269508] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-16T21:58:55.270133] [INFO ] [MAIN ] Update Progress: 2125/2369 symbols completed. TRN took 25.8s. Estimated remaining: 34m 19s. Rate: 7.1 symbols/min [2025-10-16T21:58:55.442906] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:58:55.493128] [DEBUG] [LOCAL ] TROX: Loaded 52169 existing records from primary storage. [2025-10-16T21:58:55.493462] [INFO ] [MAIN ] TROX: Loaded 52169 existing records. [2025-10-16T21:58:55.675996] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:58:55.676226] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-16T21:58:55.676299] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-16T21:58:55.676808] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-16T21:58:55.676870] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-16T21:58:55.948018] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-10-16T21:58:56.056663] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:58:56.081471] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T21:58:56.742846] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-16T21:58:56.990276] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T21:58:57.542802] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-10-16T21:58:57.729862] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T21:58:58.188881] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T21:58:58.342783] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-16T21:58:59.051523] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T21:58:59.142844] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-10-16T21:58:59.925554] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T21:58:59.942810] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-16T21:59:00.742847] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-16T21:59:00.778617] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T21:59:01.145138] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-16T21:59:01.542898] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-16T21:59:02.342834] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-16T21:59:02.463988] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T21:59:02.966948] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T21:59:02.972587] [INFO ] [REMOTE ] TRNO: Full fetch complete (63132 records). [2025-10-16T21:59:02.972799] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-16T21:59:03.156004] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-10-16T21:59:03.400660] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-16T21:59:03.400755] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-16T21:59:03.401923] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-16T21:59:03.401987] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-16T21:59:03.403380] [DEBUG] [LOCAL ] TRNO: Trimmed 63132 records to 44252 (keeping 200 days of data) [2025-10-16T21:59:03.688098] [DEBUG] [LOCAL ] TRNO: Primary data saved (44252 records). [2025-10-16T21:59:03.688262] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-16T21:59:03.689066] [INFO ] [MAIN ] Update Progress: 2126/2369 symbols completed. TRNO took 31.3s. Estimated remaining: 34m 11s. Rate: 7.1 symbols/min [2025-10-16T21:59:03.858866] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:59:03.910160] [DEBUG] [LOCAL ] TRP: Loaded 52141 existing records from primary storage. [2025-10-16T21:59:03.910504] [INFO ] [MAIN ] TRP: Loaded 52141 existing records. [2025-10-16T21:59:03.952494] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-16T21:59:04.095492] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:59:04.095833] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-16T21:59:04.095906] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-16T21:59:04.096190] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-16T21:59:04.096252] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-16T21:59:04.220611] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-16T21:59:04.481043] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:59:04.742774] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-10-16T21:59:05.018025] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-16T21:59:05.542848] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-10-16T21:59:05.622569] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T21:59:05.628936] [INFO ] [REMOTE ] TREX: Full fetch complete (71613 records). [2025-10-16T21:59:05.629044] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-16T21:59:06.005780] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-16T21:59:06.005866] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-16T21:59:06.006958] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-16T21:59:06.007022] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-16T21:59:06.008328] [DEBUG] [LOCAL ] TREX: Trimmed 71613 records to 50214 (keeping 200 days of data) [2025-10-16T21:59:06.264991] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T21:59:06.343918] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-16T21:59:06.343831] [DEBUG] [LOCAL ] TREX: Primary data saved (50214 records). [2025-10-16T21:59:06.344919] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-16T21:59:06.345562] [INFO ] [MAIN ] Update Progress: 2127/2369 symbols completed. TREX took 44.7s. Estimated remaining: 34m 1s. Rate: 7.1 symbols/min [2025-10-16T21:59:06.511781] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:59:06.549526] [DEBUG] [LOCAL ] TRTX: Loaded 37285 existing records from primary storage. [2025-10-16T21:59:06.549830] [INFO ] [MAIN ] TRTX: Loaded 37285 existing records. [2025-10-16T21:59:06.721523] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:59:06.721765] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-16T21:59:06.721815] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-16T21:59:06.722128] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-10-16T21:59:06.722166] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-16T21:59:07.071490] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:59:07.142766] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-10-16T21:59:07.383976] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T21:59:07.942815] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-16T21:59:08.257393] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-16T21:59:08.542962] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T21:59:08.742807] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-16T21:59:09.508465] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T21:59:09.542779] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-16T21:59:10.342772] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-16T21:59:10.592007] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-16T21:59:11.142903] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-16T21:59:11.385839] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T21:59:11.685201] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T21:59:11.942815] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-10-16T21:59:12.742828] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-16T21:59:12.952596] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T21:59:13.273092] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T21:59:13.542831] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-16T21:59:14.250046] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T21:59:14.342794] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-16T21:59:15.142844] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-10-16T21:59:15.243853] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T21:59:15.836160] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T21:59:15.942811] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-10. [2025-10-16T21:59:16.628964] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T21:59:16.635928] [INFO ] [REMOTE ] TRGP: Full fetch complete (73661 records). [2025-10-16T21:59:16.636051] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-16T21:59:16.746455] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-16T21:59:17.005139] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-16T21:59:17.071996] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-16T21:59:17.072076] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-16T21:59:17.073365] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-16T21:59:17.073427] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-16T21:59:17.074818] [DEBUG] [LOCAL ] TRGP: Trimmed 73661 records to 51196 (keeping 200 days of data) [2025-10-16T21:59:17.384237] [DEBUG] [LOCAL ] TRGP: Primary data saved (51196 records). [2025-10-16T21:59:17.384373] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-16T21:59:17.384451] [INFO ] [MAIN ] Update Progress: 2128/2369 symbols completed. TRGP took 49.6s. Estimated remaining: 33m 53s. Rate: 7.1 symbols/min [2025-10-16T21:59:17.547949] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-16T21:59:17.549728] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:59:17.598876] [DEBUG] [LOCAL ] TRU: Loaded 51431 existing records from primary storage. [2025-10-16T21:59:17.599229] [INFO ] [MAIN ] TRU: Loaded 51431 existing records. [2025-10-16T21:59:17.776029] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:59:17.776286] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-16T21:59:17.776333] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-16T21:59:17.776604] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-16T21:59:17.776706] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-16T21:59:18.123931] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:59:18.342771] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-10-16T21:59:18.481565] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T21:59:19.142866] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-16T21:59:19.324570] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T21:59:19.673614] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T21:59:19.942836] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-10-16T21:59:20.742793] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-16T21:59:20.928733] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T21:59:21.527017] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T21:59:21.542769] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-10-16T21:59:22.342842] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-16T21:59:22.408112] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T21:59:22.863958] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T21:59:23.142846] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-10-16T21:59:23.942791] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-16T21:59:24.157378] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T21:59:24.528799] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T21:59:24.742820] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-10-16T21:59:25.538910] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T21:59:25.547750] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-16T21:59:26.232999] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-16T21:59:26.342810] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-10-16T21:59:27.078114] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T21:59:27.142778] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-16T21:59:27.800421] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T21:59:27.942797] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-10-16T21:59:28.742874] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-16T21:59:28.972878] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T21:59:29.499669] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T21:59:29.542768] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-10. [2025-10-16T21:59:30.193408] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T21:59:30.342779] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-16T21:59:30.708891] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T21:59:30.713594] [INFO ] [REMOTE ] TRTX: Full fetch complete (53063 records). [2025-10-16T21:59:30.713738] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-16T21:59:31.082561] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-16T21:59:31.082682] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-16T21:59:31.084132] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-16T21:59:31.084194] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-16T21:59:31.085353] [DEBUG] [LOCAL ] TRTX: Trimmed 53063 records to 37536 (keeping 200 days of data) [2025-10-16T21:59:31.168369] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-16T21:59:31.307980] [DEBUG] [LOCAL ] TRTX: Primary data saved (37536 records). [2025-10-16T21:59:31.308144] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-16T21:59:31.308774] [INFO ] [MAIN ] Update Progress: 2129/2369 symbols completed. TRTX took 25.0s. Estimated remaining: 33m 45s. Rate: 7.1 symbols/min [2025-10-16T21:59:31.475239] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:59:31.521384] [DEBUG] [LOCAL ] TRV: Loaded 47454 existing records from primary storage. [2025-10-16T21:59:31.521723] [INFO ] [MAIN ] TRV: Loaded 47454 existing records. [2025-10-16T21:59:31.693249] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:59:31.693452] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-16T21:59:31.693499] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-16T21:59:31.693745] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-16T21:59:31.693801] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-16T21:59:31.947962] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-16T21:59:32.059344] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:59:32.447638] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-16T21:59:32.742796] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-16T21:59:32.983096] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T21:59:33.542813] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-16T21:59:33.846474] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-16T21:59:34.342864] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-10-16T21:59:34.576525] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T21:59:35.142803] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-16T21:59:35.342826] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-16T21:59:35.942850] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-16T21:59:36.147458] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-16T21:59:36.742868] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-16T21:59:36.765302] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-16T21:59:36.774119] [INFO ] [REMOTE ] TRP: Full fetch complete (75721 records). [2025-10-16T21:59:36.774345] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-16T21:59:37.179928] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-16T21:59:37.180033] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-16T21:59:37.181814] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-16T21:59:37.181896] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-16T21:59:37.183789] [DEBUG] [LOCAL ] TRP: Trimmed 75721 records to 52524 (keeping 200 days of data) [2025-10-16T21:59:37.397178] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T21:59:37.433964] [INFO ] [REMOTE ] TROX: Full fetch complete (73989 records). [2025-10-16T21:59:37.437759] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-16T21:59:37.542782] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-16T21:59:37.857602] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-16T21:59:37.858003] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-16T21:59:37.859462] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-16T21:59:37.859544] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-16T21:59:37.896034] [DEBUG] [LOCAL ] TROX: Trimmed 73989 records to 52556 (keeping 200 days of data) [2025-10-16T21:59:38.042677] [DEBUG] [LOCAL ] TRP: Primary data saved (52524 records). [2025-10-16T21:59:38.044336] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-16T21:59:38.044984] [INFO ] [MAIN ] Update Progress: 2130/2369 symbols completed. TRP took 34.4s. Estimated remaining: 33m 37s. Rate: 7.1 symbols/min [2025-10-16T21:59:38.238131] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:59:38.379533] [DEBUG] [LOCAL ] TS: Loaded 51677 existing records from primary storage. [2025-10-16T21:59:38.380717] [INFO ] [MAIN ] TS: Loaded 51677 existing records. [2025-10-16T21:59:38.565575] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:59:38.570179] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-16T21:59:38.571233] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-16T21:59:38.573566] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-16T21:59:38.573668] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-16T21:59:38.886469] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-16T21:59:38.981023] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-16T21:59:39.085001] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:59:39.097997] [DEBUG] [LOCAL ] TROX: Primary data saved (52556 records). [2025-10-16T21:59:39.098095] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-16T21:59:39.098739] [INFO ] [MAIN ] Update Progress: 2131/2369 symbols completed. TROX took 43.8s. Estimated remaining: 33m 28s. Rate: 7.1 symbols/min [2025-10-16T21:59:39.154668] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-10-16T21:59:39.275405] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:59:39.308043] [DEBUG] [LOCAL ] TSE: Loaded 27772 existing records from primary storage. [2025-10-16T21:59:39.319216] [INFO ] [MAIN ] TSE: Loaded 27772 existing records. [2025-10-16T21:59:39.417278] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-16T21:59:39.539781] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:59:39.540183] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-16T21:59:39.540247] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-16T21:59:39.540479] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-16T21:59:39.540535] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-16T21:59:39.907736] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:59:39.942835] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-10-16T21:59:40.742802] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-16T21:59:40.882549] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-16T21:59:40.919085] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T21:59:41.272024] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T21:59:41.542791] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-16T21:59:42.273240] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T21:59:42.342780] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-16T21:59:42.370380] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-16T21:59:43.142824] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-16T21:59:43.942797] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-16T21:59:44.288830] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T21:59:44.331504] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-16T21:59:44.742869] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-16T21:59:45.542886] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-16T21:59:45.843303] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-16T21:59:46.342884] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-16T21:59:46.533820] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T21:59:47.142817] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-16T21:59:47.321714] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T21:59:47.644820] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T21:59:47.942850] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-16T21:59:48.742810] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-16T21:59:48.850785] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-16T21:59:48.857544] [INFO ] [REMOTE ] TRU: Full fetch complete (74011 records). [2025-10-16T21:59:48.857720] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-16T21:59:49.246963] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-16T21:59:49.247087] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-16T21:59:49.248444] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-16T21:59:49.248512] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-16T21:59:49.250566] [DEBUG] [LOCAL ] TRU: Trimmed 74011 records to 51815 (keeping 200 days of data) [2025-10-16T21:59:49.548234] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-16T21:59:49.602688] [DEBUG] [LOCAL ] TRU: Primary data saved (51815 records). [2025-10-16T21:59:49.603681] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-16T21:59:49.605082] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T21:59:49.605271] [INFO ] [MAIN ] Update Progress: 2132/2369 symbols completed. TRU took 32.2s. Estimated remaining: 33m 19s. Rate: 7.1 symbols/min [2025-10-16T21:59:49.783424] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T21:59:49.792916] [DEBUG] [LOCAL ] TSI: Loaded 8053 existing records from primary storage. [2025-10-16T21:59:49.793125] [INFO ] [MAIN ] TSI: Loaded 8053 existing records. [2025-10-16T21:59:49.969355] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T21:59:49.969636] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-16T21:59:49.969725] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-16T21:59:49.970004] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-10-16T21:59:49.970101] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-16T21:59:50.291573] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T21:59:50.343048] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-16T21:59:50.389124] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T21:59:50.859068] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T21:59:51.142825] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-16T21:59:51.942844] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-16T21:59:52.028848] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T21:59:52.463563] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T21:59:52.742834] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-10-16T21:59:53.535824] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-16T21:59:53.549344] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-16T21:59:53.570225] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T21:59:54.201498] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-16T21:59:54.342871] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-10-16T21:59:55.110486] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T21:59:55.142767] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-10-16T21:59:55.942797] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-16T21:59:56.043168] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-16T21:59:56.742824] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-16T21:59:57.542789] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-10-16T21:59:57.598074] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T21:59:58.342806] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-16T21:59:58.365187] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-16T21:59:58.669458] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-16T21:59:59.142813] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-16T21:59:59.942832] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-10-16T22:00:00.052117] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T22:00:00.525218] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T22:00:00.742798] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-16T22:00:00.969508] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T22:00:01.542845] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-16T22:00:02.342812] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-16T22:00:02.647747] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T22:00:02.822594] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T22:00:03.142853] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-16T22:00:03.942847] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-16T22:00:04.147826] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T22:00:04.742852] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-16T22:00:04.903868] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T22:00:05.374511] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T22:00:05.542868] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-10-16T22:00:06.307468] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T22:00:06.342777] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-10-16T22:00:06.565638] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T22:00:06.799801] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T22:00:07.142842] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-10-16T22:00:07.907985] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T22:00:07.942777] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-16T22:00:08.742865] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-16T22:00:09.421445] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T22:00:09.427358] [INFO ] [REMOTE ] TRV: Full fetch complete (69850 records). [2025-10-16T22:00:09.427479] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-16T22:00:09.564683] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-16T22:00:09.821800] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-16T22:00:09.837445] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-16T22:00:09.850426] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-16T22:00:09.850596] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-16T22:00:09.852407] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T22:00:09.864430] [DEBUG] [LOCAL ] TRV: Trimmed 69850 records to 47824 (keeping 200 days of data) [2025-10-16T22:00:10.164451] [DEBUG] [LOCAL ] TRV: Primary data saved (47824 records). [2025-10-16T22:00:10.164602] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-16T22:00:10.165293] [INFO ] [MAIN ] Update Progress: 2133/2369 symbols completed. TRV took 38.9s. Estimated remaining: 33m 12s. Rate: 7.1 symbols/min [2025-10-16T22:00:10.335568] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:00:10.342870] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-10-16T22:00:10.374355] [DEBUG] [LOCAL ] TSLX: Loaded 35911 existing records from primary storage. [2025-10-16T22:00:10.374700] [INFO ] [MAIN ] TSLX: Loaded 35911 existing records. [2025-10-16T22:00:10.555671] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:00:10.555902] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-16T22:00:10.555951] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-16T22:00:10.556180] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-16T22:00:10.556224] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-16T22:00:10.922877] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:00:11.115585] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-16T22:00:11.142785] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-10. [2025-10-16T22:00:11.191313] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T22:00:11.934104] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T22:00:11.936396] [INFO ] [REMOTE ] TSI: Full fetch complete (13921 records). [2025-10-16T22:00:11.936489] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-16T22:00:11.947905] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-16T22:00:12.294575] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-16T22:00:12.294675] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-16T22:00:12.295010] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-16T22:00:12.295070] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-16T22:00:12.295548] [DEBUG] [LOCAL ] TSI: Trimmed 13921 records to 8147 (keeping 200 days of data) [2025-10-16T22:00:12.341931] [DEBUG] [LOCAL ] TSI: Primary data saved (8147 records). [2025-10-16T22:00:12.342065] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-16T22:00:12.342147] [INFO ] [MAIN ] Update Progress: 2134/2369 symbols completed. TSI took 22.7s. Estimated remaining: 33m 3s. Rate: 7.1 symbols/min [2025-10-16T22:00:12.519357] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:00:12.569460] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-16T22:00:12.569845] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-10-16T22:00:12.744937] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:00:12.745037] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-10-16T22:00:12.746165] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-16T22:00:12.746264] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-16T22:00:12.746670] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-16T22:00:12.746753] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-16T22:00:13.117368] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:00:13.202517] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T22:00:13.542879] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-10-16T22:00:14.127343] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T22:00:14.342845] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-16T22:00:15.142854] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-16T22:00:15.526560] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-16T22:00:15.942824] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-16T22:00:16.346090] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T22:00:16.350161] [INFO ] [REMOTE ] TSE: Full fetch complete (40726 records). [2025-10-16T22:00:16.350307] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-16T22:00:16.458920] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.92 seconds). [2025-10-16T22:00:16.760000] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-16T22:00:16.776774] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-16T22:00:16.776862] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-16T22:00:16.777802] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-16T22:00:16.777866] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-16T22:00:16.778976] [DEBUG] [LOCAL ] TSE: Trimmed 40726 records to 27928 (keeping 200 days of data) [2025-10-16T22:00:16.944231] [DEBUG] [LOCAL ] TSE: Primary data saved (27928 records). [2025-10-16T22:00:16.944471] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-16T22:00:16.944570] [INFO ] [MAIN ] Update Progress: 2135/2369 symbols completed. TSE took 37.8s. Estimated remaining: 32m 54s. Rate: 7.1 symbols/min [2025-10-16T22:00:17.140616] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:00:17.197912] [DEBUG] [LOCAL ] TSN: Loaded 53044 existing records from primary storage. [2025-10-16T22:00:17.198286] [INFO ] [MAIN ] TSN: Loaded 53044 existing records. [2025-10-16T22:00:17.408546] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:00:17.408904] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-16T22:00:17.408998] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-16T22:00:17.409532] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-16T22:00:17.409597] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-16T22:00:17.543955] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-16T22:00:17.801057] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:00:17.830690] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-16T22:00:18.342813] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-10-16T22:00:18.791372] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T22:00:19.142892] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-16T22:00:19.513808] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-16T22:00:19.942878] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-16T22:00:20.096963] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T22:00:20.742848] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-16T22:00:20.775559] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T22:00:20.782475] [INFO ] [REMOTE ] TS: Full fetch complete (74762 records). [2025-10-16T22:00:20.782626] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-16T22:00:21.172453] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-16T22:00:21.172563] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-16T22:00:21.173738] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-16T22:00:21.173822] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-16T22:00:21.183287] [DEBUG] [LOCAL ] TS: Trimmed 74762 records to 52062 (keeping 200 days of data) [2025-10-16T22:00:21.197707] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-16T22:00:21.525269] [DEBUG] [LOCAL ] TS: Primary data saved (52062 records). [2025-10-16T22:00:21.525466] [INFO ] [MAIN ] TS: Full history saved. [2025-10-16T22:00:21.526166] [INFO ] [MAIN ] Update Progress: 2136/2369 symbols completed. TS took 43.5s. Estimated remaining: 32m 45s. Rate: 7.1 symbols/min [2025-10-16T22:00:21.547935] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-16T22:00:21.697388] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:00:21.711331] [DEBUG] [LOCAL ] TSQ: Loaded 11703 existing records from primary storage. [2025-10-16T22:00:21.711609] [INFO ] [MAIN ] TSQ: Loaded 11703 existing records. [2025-10-16T22:00:21.896322] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:00:21.896527] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-16T22:00:21.896590] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-16T22:00:21.896967] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-16T22:00:21.897034] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-16T22:00:22.263205] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:00:22.342799] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-10-16T22:00:22.411510] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T22:00:23.142858] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-16T22:00:23.177698] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T22:00:23.942788] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-16T22:00:24.207292] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-10-16T22:00:24.646701] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T22:00:24.742806] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-16T22:00:24.848077] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T22:00:25.542815] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-16T22:00:26.167742] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-16T22:00:26.342854] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-16T22:00:27.039250] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-16T22:00:27.142803] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-16T22:00:27.401682] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-16T22:00:27.941876] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T22:00:27.944282] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-16T22:00:28.742835] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-16T22:00:29.246397] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-16T22:00:29.542858] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-16T22:00:30.342848] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-16T22:00:31.142802] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-16T22:00:31.174765] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T22:00:31.395875] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-16T22:00:31.436840] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-16T22:00:31.942825] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-16T22:00:32.562727] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T22:00:32.742836] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-16T22:00:33.542801] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-16T22:00:33.831819] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T22:00:34.218423] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T22:00:34.342789] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-16T22:00:34.505330] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T22:00:35.142846] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-16T22:00:35.942801] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-16T22:00:36.258899] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T22:00:36.742799] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-16T22:00:36.756860] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-16T22:00:37.542890] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-16T22:00:37.767410] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-16T22:00:38.219832] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T22:00:38.342831] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-16T22:00:38.935164] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T22:00:39.142785] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-16T22:00:39.217450] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-16T22:00:39.942841] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-16T22:00:40.742800] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-16T22:00:41.026307] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T22:00:41.542824] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-16T22:00:42.205243] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T22:00:42.295020] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-16T22:00:42.342799] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-16T22:00:43.150109] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-16T22:00:43.170444] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T22:00:43.942818] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-16T22:00:44.269672] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-16T22:00:44.275173] [INFO ] [REMOTE ] TSLX: Full fetch complete (50464 records). [2025-10-16T22:00:44.275298] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-16T22:00:44.648504] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-16T22:00:44.648583] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-16T22:00:44.649544] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-16T22:00:44.649606] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-16T22:00:44.650692] [DEBUG] [LOCAL ] TSLX: Trimmed 50464 records to 36199 (keeping 200 days of data) [2025-10-16T22:00:44.744153] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-16T22:00:44.744070] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T22:00:44.886825] [DEBUG] [LOCAL ] TSLX: Primary data saved (36199 records). [2025-10-16T22:00:44.887059] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-16T22:00:44.887800] [INFO ] [MAIN ] Update Progress: 2137/2369 symbols completed. TSLX took 34.7s. Estimated remaining: 32m 39s. Rate: 7.1 symbols/min [2025-10-16T22:00:45.061734] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:00:45.096366] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-16T22:00:45.145638] [DEBUG] [LOCAL ] TT: Loaded 47326 existing records from primary storage. [2025-10-16T22:00:45.145968] [INFO ] [MAIN ] TT: Loaded 47326 existing records. [2025-10-16T22:00:45.317161] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:00:45.317398] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-16T22:00:45.317446] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-16T22:00:45.317793] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-16T22:00:45.317852] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-16T22:00:45.550093] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-16T22:00:45.664771] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:00:46.334755] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T22:00:46.336396] [INFO ] [REMOTE ] TSQ: Full fetch complete (16402 records). [2025-10-16T22:00:46.336466] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-16T22:00:46.347919] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-10-16T22:00:46.702218] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-16T22:00:46.702295] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-16T22:00:46.702662] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-16T22:00:46.702724] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-16T22:00:46.703225] [DEBUG] [LOCAL ] TSQ: Trimmed 16402 records to 11747 (keeping 200 days of data) [2025-10-16T22:00:46.785268] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-16T22:00:46.815825] [DEBUG] [LOCAL ] TSQ: Primary data saved (11747 records). [2025-10-16T22:00:46.815953] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-16T22:00:46.816027] [INFO ] [MAIN ] Update Progress: 2138/2369 symbols completed. TSQ took 25.3s. Estimated remaining: 32m 29s. Rate: 7.1 symbols/min [2025-10-16T22:00:46.980798] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:00:46.980971] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-16T22:00:46.981008] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-16T22:00:46.981116] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-16T22:00:46.981156] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-16T22:00:46.981196] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-16T22:00:46.981229] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-16T22:00:47.151054] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-16T22:00:47.332378] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:00:47.942874] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-10-16T22:00:47.993416] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T22:00:48.151236] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-16T22:00:48.160673] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T22:00:48.161520] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-10-16T22:00:48.161613] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T22:00:48.161704] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-16T22:00:48.161752] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T22:00:48.161793] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-16T22:00:48.161851] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-16T22:00:48.161886] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-16T22:00:48.161925] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-16T22:00:48.161970] [INFO ] [MAIN ] Update Progress: 2139/2369 symbols completed. TTAM took 1.3s. Estimated remaining: 32m 20s. Rate: 7.1 symbols/min [2025-10-16T22:00:48.332506] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:00:48.372675] [DEBUG] [LOCAL ] TTC: Loaded 41993 existing records from primary storage. [2025-10-16T22:00:48.372960] [INFO ] [MAIN ] TTC: Loaded 41993 existing records. [2025-10-16T22:00:48.548201] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:00:48.548446] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-16T22:00:48.548493] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-16T22:00:48.548871] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-16T22:00:48.548929] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-16T22:00:48.751726] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-16T22:00:48.901071] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:00:49.542844] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-16T22:00:50.226942] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T22:00:50.233757] [INFO ] [REMOTE ] TSN: Full fetch complete (76652 records). [2025-10-16T22:00:50.233871] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-16T22:00:50.347916] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-16T22:00:50.632546] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-16T22:00:50.632670] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-16T22:00:50.633934] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-16T22:00:50.633998] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-16T22:00:50.635392] [DEBUG] [LOCAL ] TSN: Trimmed 76652 records to 53431 (keeping 200 days of data) [2025-10-16T22:00:50.953870] [DEBUG] [LOCAL ] TSN: Primary data saved (53431 records). [2025-10-16T22:00:50.953996] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-16T22:00:50.954488] [INFO ] [MAIN ] Update Progress: 2140/2369 symbols completed. TSN took 34.0s. Estimated remaining: 32m 11s. Rate: 7.1 symbols/min [2025-10-16T22:00:51.120210] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:00:51.149388] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-10-16T22:00:51.170451] [DEBUG] [LOCAL ] TTE: Loaded 51582 existing records from primary storage. [2025-10-16T22:00:51.170780] [INFO ] [MAIN ] TTE: Loaded 51582 existing records. [2025-10-16T22:00:51.351047] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:00:51.351356] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-16T22:00:51.351592] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-16T22:00:51.351829] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-16T22:00:51.351880] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-16T22:00:51.705506] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:00:51.737281] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.99 seconds). [2025-10-16T22:00:51.942770] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-10-16T22:00:52.310872] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-16T22:00:52.695535] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T22:00:52.742775] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-16T22:00:53.487383] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T22:00:53.542820] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-16T22:00:54.227714] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T22:00:54.342837] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-16T22:00:55.142857] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-16T22:00:55.416885] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T22:00:55.942813] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-16T22:00:56.699823] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T22:00:56.742772] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-16T22:00:57.115407] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-10-16T22:00:57.542783] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-16T22:00:57.599298] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T22:00:58.224009] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T22:00:58.342817] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-16T22:00:59.142903] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-16T22:00:59.942892] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-16T22:01:00.061768] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T22:01:00.132748] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (2.59 seconds). [2025-10-16T22:01:00.139806] [INFO ] [REMOTE ] TSM: Full fetch complete (77999 records). [2025-10-16T22:01:00.139962] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-16T22:01:00.543302] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-16T22:01:00.543415] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-16T22:01:00.544765] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-16T22:01:00.544879] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-16T22:01:00.546466] [DEBUG] [LOCAL ] TSM: Trimmed 77999 records to 54209 (keeping 200 days of data) [2025-10-16T22:01:00.664148] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T22:01:00.762127] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-16T22:01:00.919250] [DEBUG] [LOCAL ] TSM: Primary data saved (54209 records). [2025-10-16T22:01:00.919379] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-16T22:01:00.919455] [INFO ] [MAIN ] Update Progress: 2141/2369 symbols completed. TSM took 48.6s. Estimated remaining: 32m 3s. Rate: 7.1 symbols/min [2025-10-16T22:01:01.085599] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:01:01.125883] [DEBUG] [LOCAL ] TTI: Loaded 46361 existing records from primary storage. [2025-10-16T22:01:01.126198] [INFO ] [MAIN ] TTI: Loaded 46361 existing records. [2025-10-16T22:01:01.301425] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:01:01.301578] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-16T22:01:01.301626] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-16T22:01:01.301932] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-16T22:01:01.301989] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-16T22:01:01.553298] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-16T22:01:01.658696] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:01:01.750709] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T22:01:02.342866] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-10-16T22:01:02.447265] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T22:01:03.142786] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-16T22:01:03.237120] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T22:01:03.917123] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T22:01:03.942770] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-16T22:01:04.518407] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T22:01:04.742803] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-16T22:01:05.146004] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T22:01:05.542806] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-16T22:01:06.342794] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-16T22:01:06.481747] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T22:01:07.083406] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T22:01:07.142778] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-16T22:01:07.935055] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T22:01:07.943727] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-16T22:01:08.740909] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T22:01:08.749322] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-16T22:01:09.542789] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-16T22:01:09.715177] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T22:01:10.309852] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T22:01:10.342783] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-16T22:01:10.993351] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T22:01:11.142868] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-16T22:01:11.942885] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-16T22:01:12.133335] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T22:01:12.386033] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T22:01:12.742864] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-16T22:01:13.542826] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-16T22:01:13.662761] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T22:01:14.342809] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-16T22:01:14.527890] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T22:01:15.150828] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-16T22:01:15.155615] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T22:01:15.942812] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-16T22:01:16.246593] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-16T22:01:16.742812] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-16T22:01:16.914933] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T22:01:16.975961] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-16T22:01:16.981668] [INFO ] [REMOTE ] TTC: Full fetch complete (62141 records). [2025-10-16T22:01:16.981815] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-16T22:01:17.362322] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-16T22:01:17.362422] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-16T22:01:17.363514] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-16T22:01:17.363581] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-16T22:01:17.364932] [DEBUG] [LOCAL ] TTC: Trimmed 62141 records to 42274 (keeping 200 days of data) [2025-10-16T22:01:17.548919] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-16T22:01:17.625736] [DEBUG] [LOCAL ] TTC: Primary data saved (42274 records). [2025-10-16T22:01:17.625869] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-16T22:01:17.625949] [INFO ] [MAIN ] Update Progress: 2142/2369 symbols completed. TTC took 29.5s. Estimated remaining: 31m 55s. Rate: 7.1 symbols/min [2025-10-16T22:01:17.789637] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:01:17.840844] [DEBUG] [LOCAL ] TU: Loaded 49837 existing records from primary storage. [2025-10-16T22:01:17.841286] [INFO ] [MAIN ] TU: Loaded 49837 existing records. [2025-10-16T22:01:18.020109] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:01:18.020600] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-16T22:01:18.020805] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-16T22:01:18.021131] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-16T22:01:18.021189] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-16T22:01:18.343063] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T22:01:18.348306] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-16T22:01:18.421438] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:01:19.128628] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-16T22:01:19.142779] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-16T22:01:19.839166] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T22:01:19.942857] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-16T22:01:20.742865] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-16T22:01:20.999722] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-16T22:01:21.364881] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-16T22:01:21.370950] [INFO ] [REMOTE ] TT: Full fetch complete (70062 records). [2025-10-16T22:01:21.371129] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-16T22:01:21.559359] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-10-16T22:01:21.802364] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-16T22:01:21.802510] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-16T22:01:21.803799] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-16T22:01:21.804481] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-16T22:01:21.805839] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-16T22:01:21.817298] [DEBUG] [LOCAL ] TT: Trimmed 70062 records to 47661 (keeping 200 days of data) [2025-10-16T22:01:22.119902] [DEBUG] [LOCAL ] TT: Primary data saved (47661 records). [2025-10-16T22:01:22.120081] [INFO ] [MAIN ] TT: Full history saved. [2025-10-16T22:01:22.120724] [INFO ] [MAIN ] Update Progress: 2143/2369 symbols completed. TT took 37.2s. Estimated remaining: 31m 47s. Rate: 7.1 symbols/min [2025-10-16T22:01:22.286372] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:01:22.328873] [DEBUG] [LOCAL ] TUYA: Loaded 45932 existing records from primary storage. [2025-10-16T22:01:22.329165] [INFO ] [MAIN ] TUYA: Loaded 45932 existing records. [2025-10-16T22:01:22.349246] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-16T22:01:22.508103] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:01:22.508344] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-16T22:01:22.508395] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-16T22:01:22.508713] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-16T22:01:22.508770] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-16T22:01:22.857132] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:01:23.142844] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-10-16T22:01:23.441511] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T22:01:23.942812] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-16T22:01:24.251600] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-16T22:01:24.317733] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T22:01:24.742815] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-16T22:01:25.542783] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-16T22:01:25.675994] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T22:01:25.774788] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T22:01:26.342807] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-16T22:01:27.142810] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-16T22:01:27.200201] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T22:01:27.942793] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-16T22:01:28.297943] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-16T22:01:28.502472] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-16T22:01:28.742817] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-16T22:01:29.319977] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T22:01:29.326951] [INFO ] [REMOTE ] TTE: Full fetch complete (75126 records). [2025-10-16T22:01:29.327108] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-16T22:01:29.547966] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-16T22:01:29.845366] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-16T22:01:29.845497] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-16T22:01:29.847946] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-16T22:01:29.848101] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-16T22:01:29.850111] [DEBUG] [LOCAL ] TTE: Trimmed 75126 records to 51968 (keeping 200 days of data) [2025-10-16T22:01:30.230285] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T22:01:30.322383] [DEBUG] [LOCAL ] TTE: Primary data saved (51968 records). [2025-10-16T22:01:30.322551] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-16T22:01:30.323071] [INFO ] [MAIN ] Update Progress: 2144/2369 symbols completed. TTE took 39.4s. Estimated remaining: 31m 38s. Rate: 7.1 symbols/min [2025-10-16T22:01:30.348031] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-16T22:01:30.522588] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:01:30.567291] [DEBUG] [LOCAL ] TV: Loaded 41583 existing records from primary storage. [2025-10-16T22:01:30.567925] [INFO ] [MAIN ] TV: Loaded 41583 existing records. [2025-10-16T22:01:30.796842] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:01:30.797097] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-16T22:01:30.797174] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-16T22:01:30.797411] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-16T22:01:30.797467] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-16T22:01:31.146698] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-16T22:01:31.213552] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:01:31.240262] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T22:01:31.942817] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-16T22:01:32.143281] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T22:01:32.742874] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-16T22:01:32.963456] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T22:01:33.542863] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-16T22:01:33.643614] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T22:01:34.342793] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-16T22:01:34.430233] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T22:01:34.985832] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T22:01:35.142816] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-16T22:01:35.942787] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-16T22:01:36.026733] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T22:01:36.034330] [INFO ] [REMOTE ] TTI: Full fetch complete (66173 records). [2025-10-16T22:01:36.034474] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-16T22:01:36.421239] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-16T22:01:36.421347] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-16T22:01:36.422492] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-16T22:01:36.422558] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-16T22:01:36.424000] [DEBUG] [LOCAL ] TTI: Trimmed 66173 records to 46751 (keeping 200 days of data) [2025-10-16T22:01:36.688875] [DEBUG] [LOCAL ] TTI: Primary data saved (46751 records). [2025-10-16T22:01:36.689018] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-16T22:01:36.689099] [INFO ] [MAIN ] Update Progress: 2145/2369 symbols completed. TTI took 35.8s. Estimated remaining: 31m 29s. Rate: 7.1 symbols/min [2025-10-16T22:01:36.762761] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-10-16T22:01:36.860746] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:01:36.890461] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T22:01:36.893068] [DEBUG] [LOCAL ] TVC: Loaded 3210 existing records from primary storage. [2025-10-16T22:01:36.893451] [INFO ] [MAIN ] TVC: Loaded 3210 existing records. [2025-10-16T22:01:37.084731] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:01:37.085094] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-16T22:01:37.085152] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-16T22:01:37.085375] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-16T22:01:37.085432] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-16T22:01:37.435572] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:01:37.542779] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-10-16T22:01:37.694245] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T22:01:38.277225] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-16T22:01:38.342263] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T22:01:38.350830] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-16T22:01:39.142827] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-16T22:01:39.942828] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-16T22:01:40.162326] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T22:01:40.382171] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T22:01:40.742822] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-16T22:01:41.453092] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T22:01:41.542806] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-16T22:01:42.342863] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-16T22:01:42.380535] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T22:01:42.612788] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T22:01:42.921387] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T22:01:43.142820] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-16T22:01:43.728266] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T22:01:43.942823] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-16T22:01:44.742861] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-16T22:01:45.542845] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-16T22:01:45.583778] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T22:01:46.265229] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T22:01:46.342831] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-16T22:01:46.510382] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T22:01:47.142815] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-16T22:01:47.713805] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T22:01:47.942805] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-16T22:01:48.041137] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T22:01:48.516783] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T22:01:48.742813] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-16T22:01:49.542833] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-16T22:01:50.342826] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-16T22:01:50.421075] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T22:01:51.025042] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T22:01:51.095589] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-16T22:01:51.142805] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-16T22:01:51.653703] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-16T22:01:51.942804] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-16T22:01:52.742845] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-16T22:01:53.510051] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T22:01:53.516119] [INFO ] [REMOTE ] TUYA: Full fetch complete (66496 records). [2025-10-16T22:01:53.516264] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-16T22:01:53.548343] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-16T22:01:53.982489] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-16T22:01:53.982705] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-16T22:01:53.984112] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-16T22:01:53.984257] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-16T22:01:53.986619] [DEBUG] [LOCAL ] TUYA: Trimmed 66496 records to 46284 (keeping 200 days of data) [2025-10-16T22:01:54.123893] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T22:01:54.139946] [INFO ] [REMOTE ] TU: Full fetch complete (72922 records). [2025-10-16T22:01:54.143868] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-16T22:01:54.350374] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-16T22:01:54.688171] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-16T22:01:54.688830] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-16T22:01:54.690147] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-16T22:01:54.690590] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-16T22:01:54.734421] [DEBUG] [LOCAL ] TU: Trimmed 72922 records to 50192 (keeping 200 days of data) [2025-10-16T22:01:54.749046] [DEBUG] [LOCAL ] TUYA: Primary data saved (46284 records). [2025-10-16T22:01:54.837233] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-16T22:01:54.839125] [INFO ] [MAIN ] Update Progress: 2146/2369 symbols completed. TUYA took 32.7s. Estimated remaining: 31m 22s. Rate: 7.1 symbols/min [2025-10-16T22:01:55.133127] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T22:01:55.161362] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-16T22:01:55.244330] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:01:55.281384] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T22:01:55.295664] [DEBUG] [LOCAL ] TU: Primary data saved (50192 records). [2025-10-16T22:01:55.297284] [INFO ] [MAIN ] TU: Full history saved. [2025-10-16T22:01:55.298462] [INFO ] [MAIN ] Update Progress: 2147/2369 symbols completed. TU took 37.7s. Estimated remaining: 31m 13s. Rate: 7.1 symbols/min [2025-10-16T22:01:55.300539] [DEBUG] [LOCAL ] TVE: Loaded 2634 existing records from primary storage. [2025-10-16T22:01:55.332266] [INFO ] [MAIN ] TVE: Loaded 2634 existing records. [2025-10-16T22:01:55.655903] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:01:55.662164] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:01:55.662497] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-16T22:01:55.662559] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-16T22:01:55.662719] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-16T22:01:55.663080] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-16T22:01:55.772208] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-16T22:01:55.949711] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-16T22:01:55.956299] [DEBUG] [LOCAL ] TWI: Loaded 33900 existing records from primary storage. [2025-10-16T22:01:55.980222] [INFO ] [MAIN ] TWI: Loaded 33900 existing records. [2025-10-16T22:01:56.145635] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:01:56.252615] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:01:56.252886] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-16T22:01:56.252936] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-16T22:01:56.253115] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-16T22:01:56.253192] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-16T22:01:56.587311] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T22:01:56.610179] [INFO ] [REMOTE ] TVC: Full fetch complete (5253 records). [2025-10-16T22:01:56.610083] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:01:56.610349] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-16T22:01:56.753633] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-10-16T22:01:56.995012] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-16T22:01:56.995088] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-16T22:01:56.995248] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-16T22:01:56.995286] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-16T22:01:56.995638] [DEBUG] [LOCAL ] TVC: Trimmed 5253 records to 3226 (keeping 200 days of data) [2025-10-16T22:01:57.015721] [DEBUG] [LOCAL ] TVC: Primary data saved (3226 records). [2025-10-16T22:01:57.015817] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-16T22:01:57.015891] [INFO ] [MAIN ] Update Progress: 2148/2369 symbols completed. TVC took 20.3s. Estimated remaining: 31m 4s. Rate: 7.1 symbols/min [2025-10-16T22:01:57.185155] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:01:57.233940] [DEBUG] [LOCAL ] TWLO: Loaded 52830 existing records from primary storage. [2025-10-16T22:01:57.234237] [INFO ] [MAIN ] TWLO: Loaded 52830 existing records. [2025-10-16T22:01:57.407043] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:01:57.407271] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-16T22:01:57.407318] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-16T22:01:57.407503] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-16T22:01:57.407541] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-16T22:01:57.549806] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-16T22:01:57.767906] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:01:58.342844] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-10-16T22:01:58.422884] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T22:01:59.142797] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-10-16T22:01:59.285475] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T22:01:59.503257] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-16T22:01:59.942814] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-16T22:02:00.101856] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T22:02:00.742883] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-16T22:02:01.488998] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T22:02:01.542770] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-16T22:02:02.308486] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T22:02:02.342796] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-10-16T22:02:03.096339] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T22:02:03.142820] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-16T22:02:03.727684] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T22:02:03.807778] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T22:02:03.942850] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-16T22:02:04.742869] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-10-16T22:02:05.361071] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-16T22:02:05.542840] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-16T22:02:05.846493] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-16T22:02:06.342845] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-16T22:02:07.106802] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T22:02:07.142817] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-10-16T22:02:07.942884] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-10-16T22:02:08.087212] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T22:02:08.252506] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T22:02:08.563966] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-16T22:02:08.742837] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-16T22:02:09.542885] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-16T22:02:10.208628] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T22:02:10.342833] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-16T22:02:11.133299] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T22:02:11.143511] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-10-16T22:02:11.720183] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-16T22:02:11.891928] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-16T22:02:11.896433] [INFO ] [REMOTE ] TV: Full fetch complete (61224 records). [2025-10-16T22:02:11.896526] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-16T22:02:11.950853] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-16T22:02:12.283933] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-16T22:02:12.284010] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-16T22:02:12.285055] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-16T22:02:12.285118] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-16T22:02:12.286305] [DEBUG] [LOCAL ] TV: Trimmed 61224 records to 41831 (keeping 200 days of data) [2025-10-16T22:02:12.523368] [DEBUG] [LOCAL ] TV: Primary data saved (41831 records). [2025-10-16T22:02:12.523516] [INFO ] [MAIN ] TV: Full history saved. [2025-10-16T22:02:12.524102] [INFO ] [MAIN ] Update Progress: 2149/2369 symbols completed. TV took 42.2s. Estimated remaining: 30m 56s. Rate: 7.1 symbols/min [2025-10-16T22:02:12.694798] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:02:12.700991] [DEBUG] [LOCAL ] TWN: Loaded 3257 existing records from primary storage. [2025-10-16T22:02:12.701223] [INFO ] [MAIN ] TWN: Loaded 3257 existing records. [2025-10-16T22:02:12.748008] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-10-16T22:02:12.884683] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:02:12.884937] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-16T22:02:12.885016] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-16T22:02:12.885255] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-16T22:02:12.885322] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-16T22:02:13.245032] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:02:13.270747] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-16T22:02:13.542835] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-10-16T22:02:13.825134] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-16T22:02:14.184588] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-16T22:02:14.342790] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-16T22:02:14.925691] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T22:02:15.142918] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-16T22:02:15.753856] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-16T22:02:15.942823] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-10-16T22:02:16.535465] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-16T22:02:16.742816] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-10-16T22:02:17.243144] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-16T22:02:17.542829] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-10-16T22:02:18.009016] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-16T22:02:18.342833] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-16T22:02:19.123751] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-16T22:02:19.142854] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-16T22:02:19.942886] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-16T22:02:20.625131] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-16T22:02:20.742873] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-10-16T22:02:20.964245] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T22:02:21.542875] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-10-16T22:02:22.044465] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-16T22:02:22.342882] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-16T22:02:22.497986] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-16T22:02:22.939985] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T22:02:23.142830] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-16T22:02:23.608472] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-16T22:02:23.942826] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-16T22:02:24.429382] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T22:02:24.742806] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-16T22:02:25.196694] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T22:02:25.542904] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-16T22:02:26.183477] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-16T22:02:26.342826] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-10. [2025-10-16T22:02:26.756680] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-16T22:02:26.757623] [INFO ] [REMOTE ] TVE: Full fetch complete (4272 records). [2025-10-16T22:02:26.757722] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-16T22:02:27.132577] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-16T22:02:27.132683] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-16T22:02:27.132848] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-16T22:02:27.132908] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-16T22:02:27.133247] [DEBUG] [LOCAL ] TVE: Trimmed 4272 records to 2647 (keeping 200 days of data) [2025-10-16T22:02:27.145584] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-10-16T22:02:27.151229] [DEBUG] [LOCAL ] TVE: Primary data saved (2647 records). [2025-10-16T22:02:27.151311] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-16T22:02:27.151415] [INFO ] [MAIN ] Update Progress: 2150/2369 symbols completed. TVE took 32.3s. Estimated remaining: 30m 48s. Rate: 7.1 symbols/min [2025-10-16T22:02:27.321790] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:02:27.375566] [DEBUG] [LOCAL ] TWO: Loaded 48657 existing records from primary storage. [2025-10-16T22:02:27.376143] [INFO ] [MAIN ] TWO: Loaded 48657 existing records. [2025-10-16T22:02:27.585452] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:02:27.585757] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-16T22:02:27.586002] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-16T22:02:27.586388] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-16T22:02:27.586467] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-16T22:02:27.948027] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-16T22:02:28.014745] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:02:28.598940] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-16T22:02:28.600251] [INFO ] [REMOTE ] TWN: Full fetch complete (5209 records). [2025-10-16T22:02:28.600324] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-16T22:02:28.752430] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-10-16T22:02:28.973209] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-16T22:02:28.973403] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-16T22:02:28.973611] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-16T22:02:28.973722] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-16T22:02:28.974227] [DEBUG] [LOCAL ] TWN: Trimmed 5209 records to 3306 (keeping 200 days of data) [2025-10-16T22:02:28.994332] [DEBUG] [LOCAL ] TWN: Primary data saved (3306 records). [2025-10-16T22:02:28.994404] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-16T22:02:28.994479] [INFO ] [MAIN ] Update Progress: 2151/2369 symbols completed. TWN took 16.5s. Estimated remaining: 30m 39s. Rate: 7.1 symbols/min [2025-10-16T22:02:29.163298] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:02:29.163567] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-16T22:02:29.163622] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-16T22:02:29.173247] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-16T22:02:29.186327] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-16T22:02:29.189235] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-16T22:02:29.189301] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-16T22:02:29.222782] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-16T22:02:29.544691] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-10-16T22:02:29.557660] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:02:29.851499] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T22:02:30.342831] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-10-16T22:02:31.142851] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-10-16T22:02:31.492208] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-16T22:02:31.711617] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T22:02:31.942840] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-10-16T22:02:32.189242] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T22:02:32.189560] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-10-16T22:02:32.189673] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T22:02:32.189741] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-16T22:02:32.189809] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T22:02:32.189897] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-16T22:02:32.189984] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-16T22:02:32.190041] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-16T22:02:32.190118] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-16T22:02:32.190182] [INFO ] [MAIN ] Update Progress: 2152/2369 symbols completed. TWOD took 3.2s. Estimated remaining: 30m 30s. Rate: 7.1 symbols/min [2025-10-16T22:02:32.382696] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:02:32.405675] [DEBUG] [LOCAL ] TX: Loaded 23315 existing records from primary storage. [2025-10-16T22:02:32.405955] [INFO ] [MAIN ] TX: Loaded 23315 existing records. [2025-10-16T22:02:32.619699] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:02:32.620225] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-16T22:02:32.620311] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-16T22:02:32.620684] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-16T22:02:32.620745] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-16T22:02:32.745769] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-10-16T22:02:33.008831] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:02:33.011282] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T22:02:33.542840] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-16T22:02:34.342877] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-10-16T22:02:34.449318] [DEBUG] [REMOTE ] TX: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-16T22:02:34.449615] [WARN ] [REMOTE ] TX: No data returned for month 2024-12 [2025-10-16T22:02:34.449734] [FATAL] [REMOTE ] TX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T22:02:34.449781] [FATAL] [MAIN ] TX: Failed to fetch primary data. [2025-10-16T22:02:34.449841] [WARN ] [MAIN ] TX: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T22:02:34.450106] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-16T22:02:34.450172] [DEBUG] [LOCAL ] TX: No primary data file found to delete. [2025-10-16T22:02:34.450207] [INFO ] [LOCAL ] TX: Starting deletion of derivative data. [2025-10-16T22:02:34.450360] [DEBUG] [LOCAL ] TX: Deleted derivative data file. [2025-10-16T22:02:34.450452] [INFO ] [MAIN ] Update Progress: 2153/2369 symbols completed. TX took 2.3s. Estimated remaining: 30m 21s. Rate: 7.1 symbols/min [2025-10-16T22:02:34.630605] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:02:34.675540] [DEBUG] [LOCAL ] TXNM: Loaded 43447 existing records from primary storage. [2025-10-16T22:02:34.675873] [INFO ] [MAIN ] TXNM: Loaded 43447 existing records. [2025-10-16T22:02:34.872151] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:02:34.872437] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-16T22:02:34.872577] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-16T22:02:34.873052] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-10-16T22:02:34.873123] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-16T22:02:35.067184] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-16T22:02:35.150402] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-10-16T22:02:35.285989] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:02:35.314545] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T22:02:35.942829] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-10-16T22:02:36.654675] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T22:02:36.742781] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-10-16T22:02:37.542782] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-16T22:02:37.623166] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T22:02:38.014974] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-16T22:02:38.342850] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-10-16T22:02:39.087762] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T22:02:39.142810] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-16T22:02:39.638261] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T22:02:39.942886] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-10-16T22:02:40.738332] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T22:02:40.747616] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-10. [2025-10-16T22:02:41.406130] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T22:02:41.542835] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-16T22:02:42.342845] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-10. [2025-10-16T22:02:42.618579] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-16T22:02:42.625585] [INFO ] [REMOTE ] TWLO: Full fetch complete (76644 records). [2025-10-16T22:02:42.625843] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-16T22:02:43.016483] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-16T22:02:43.016689] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-16T22:02:43.018303] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-16T22:02:43.018427] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-16T22:02:43.020905] [DEBUG] [LOCAL ] TWLO: Trimmed 76644 records to 53217 (keeping 200 days of data) [2025-10-16T22:02:43.140834] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-16T22:02:43.151834] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-10-16T22:02:43.426791] [DEBUG] [LOCAL ] TWLO: Primary data saved (53217 records). [2025-10-16T22:02:43.427047] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-16T22:02:43.427156] [INFO ] [MAIN ] Update Progress: 2154/2369 symbols completed. TWLO took 46.4s. Estimated remaining: 30m 13s. Rate: 7.1 symbols/min [2025-10-16T22:02:43.620844] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:02:43.642897] [DEBUG] [LOCAL ] TXO: Loaded 19818 existing records from primary storage. [2025-10-16T22:02:43.643464] [INFO ] [MAIN ] TXO: Loaded 19818 existing records. [2025-10-16T22:02:43.806773] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T22:02:43.832728] [INFO ] [REMOTE ] TWI: Full fetch complete (52195 records). [2025-10-16T22:02:43.853587] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:02:43.847769] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-16T22:02:43.854010] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-16T22:02:43.854084] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-16T22:02:43.859511] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-16T22:02:43.897322] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-16T22:02:43.942974] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-16T22:02:44.609637] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-16T22:02:44.609836] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-16T22:02:44.649624] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-16T22:02:44.671579] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-16T22:02:44.693679] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:02:44.695137] [DEBUG] [LOCAL ] TWI: Trimmed 52195 records to 34191 (keeping 200 days of data) [2025-10-16T22:02:44.764272] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-10-16T22:02:44.809114] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T22:02:44.926712] [DEBUG] [LOCAL ] TWI: Primary data saved (34191 records). [2025-10-16T22:02:44.926873] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-16T22:02:44.926956] [INFO ] [MAIN ] Update Progress: 2155/2369 symbols completed. TWI took 49.6s. Estimated remaining: 30m 3s. Rate: 7.1 symbols/min [2025-10-16T22:02:45.090876] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:02:45.137076] [DEBUG] [LOCAL ] TXT: Loaded 49610 existing records from primary storage. [2025-10-16T22:02:45.137441] [INFO ] [MAIN ] TXT: Loaded 49610 existing records. [2025-10-16T22:02:45.308591] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:02:45.308840] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-16T22:02:45.308889] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-16T22:02:45.309189] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-16T22:02:45.309227] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-16T22:02:45.548058] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-10-16T22:02:45.669617] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:02:45.779683] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T22:02:45.833761] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T22:02:46.342848] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-10-16T22:02:46.822555] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T22:02:47.142848] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-16T22:02:47.942866] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-16T22:02:48.054622] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T22:02:48.546698] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T22:02:48.742842] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-16T22:02:48.888244] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T22:02:49.542879] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-16T22:02:50.342855] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-10-16T22:02:50.544690] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T22:02:50.604829] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-16T22:02:51.142816] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-16T22:02:51.783111] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T22:02:51.942877] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-16T22:02:52.528722] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T22:02:52.742850] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-16T22:02:53.542800] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-16T22:02:53.701392] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T22:02:54.144626] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T22:02:54.342830] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-16T22:02:54.458712] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T22:02:55.142846] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-16T22:02:55.880474] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T22:02:55.942817] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-16T22:02:55.955731] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-16T22:02:56.742866] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-10-16T22:02:57.542820] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-16T22:02:57.793312] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T22:02:58.343553] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-16T22:02:58.349979] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T22:02:59.142843] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-16T22:02:59.273738] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T22:02:59.280404] [INFO ] [REMOTE ] TWO: Full fetch complete (69337 records). [2025-10-16T22:02:59.280537] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-16T22:02:59.684967] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-16T22:02:59.685052] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-16T22:02:59.686167] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-16T22:02:59.686230] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-16T22:02:59.687586] [DEBUG] [LOCAL ] TWO: Trimmed 69337 records to 49008 (keeping 200 days of data) [2025-10-16T22:02:59.955164] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-10-16T22:02:59.989276] [DEBUG] [LOCAL ] TWO: Primary data saved (49008 records). [2025-10-16T22:02:59.989426] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-16T22:02:59.990059] [INFO ] [MAIN ] Update Progress: 2156/2369 symbols completed. TWO took 32.8s. Estimated remaining: 29m 56s. Rate: 7.1 symbols/min [2025-10-16T22:03:00.170406] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:03:00.186863] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-16T22:03:00.211056] [DEBUG] [LOCAL ] TY: Loaded 7582 existing records from primary storage. [2025-10-16T22:03:00.228067] [INFO ] [MAIN ] TY: Loaded 7582 existing records. [2025-10-16T22:03:00.337812] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T22:03:00.426117] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:03:00.426332] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-16T22:03:00.426381] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-16T22:03:00.426541] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-16T22:03:00.426597] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-16T22:03:00.749875] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-16T22:03:00.790434] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:03:01.542875] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-10-16T22:03:01.601363] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T22:03:02.027555] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-16T22:03:02.195621] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T22:03:02.342816] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-16T22:03:03.142862] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-16T22:03:03.942856] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-10-16T22:03:04.006680] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T22:03:04.291689] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T22:03:04.742853] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-16T22:03:05.272316] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T22:03:05.542809] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-16T22:03:05.578322] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T22:03:06.342865] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-10-16T22:03:06.552154] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T22:03:07.142860] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-16T22:03:07.942850] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-10-16T22:03:08.009816] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T22:03:08.200744] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T22:03:08.742811] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-16T22:03:09.542807] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-16T22:03:09.769785] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T22:03:09.815852] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T22:03:10.342849] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-10-16T22:03:10.410322] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T22:03:11.142808] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-16T22:03:11.942809] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-16T22:03:12.203021] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T22:03:12.206931] [INFO ] [REMOTE ] TXO: Full fetch complete (27011 records). [2025-10-16T22:03:12.208411] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T22:03:12.208566] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-16T22:03:12.580257] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-16T22:03:12.580343] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-16T22:03:12.580965] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-16T22:03:12.581026] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-16T22:03:12.581713] [DEBUG] [LOCAL ] TXO: Trimmed 27011 records to 19992 (keeping 200 days of data) [2025-10-16T22:03:12.700345] [DEBUG] [LOCAL ] TXO: Primary data saved (19992 records). [2025-10-16T22:03:12.700490] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-16T22:03:12.700568] [INFO ] [MAIN ] Update Progress: 2157/2369 symbols completed. TXO took 29.3s. Estimated remaining: 29m 48s. Rate: 7.1 symbols/min [2025-10-16T22:03:12.716515] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T22:03:12.742779] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-16T22:03:13.538395] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T22:03:13.542788] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-10-16T22:03:14.342850] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-10-16T22:03:14.932139] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T22:03:15.090954] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T22:03:15.142785] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-10. [2025-10-16T22:03:15.503076] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-16T22:03:15.509456] [INFO ] [REMOTE ] TXT: Full fetch complete (72360 records). [2025-10-16T22:03:15.509610] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-16T22:03:15.909003] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-16T22:03:15.909131] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-16T22:03:15.911152] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-16T22:03:15.911221] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-16T22:03:15.913394] [DEBUG] [LOCAL ] TXT: Trimmed 72360 records to 49959 (keeping 200 days of data) [2025-10-16T22:03:15.971068] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-10-16T22:03:16.232086] [DEBUG] [LOCAL ] TXT: Primary data saved (49959 records). [2025-10-16T22:03:16.232248] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-16T22:03:16.232896] [INFO ] [MAIN ] Update Progress: 2158/2369 symbols completed. TXT took 31.3s. Estimated remaining: 29m 39s. Rate: 7.1 symbols/min [2025-10-16T22:03:16.742894] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-16T22:03:17.343761] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-16T22:03:17.460115] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-16T22:03:17.542789] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-16T22:03:18.262192] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T22:03:18.342836] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-10. [2025-10-16T22:03:19.142831] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-10-16T22:03:19.825945] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T22:03:19.831520] [INFO ] [REMOTE ] TXNM: Full fetch complete (63063 records). [2025-10-16T22:03:19.831692] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-16T22:03:19.941636] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T22:03:19.960732] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-10-16T22:03:20.233677] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-16T22:03:20.233796] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-16T22:03:20.234900] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-16T22:03:20.234967] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-16T22:03:20.236322] [DEBUG] [LOCAL ] TXNM: Trimmed 63063 records to 43712 (keeping 200 days of data) [2025-10-16T22:03:20.505343] [DEBUG] [LOCAL ] TXNM: Primary data saved (43712 records). [2025-10-16T22:03:20.505487] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-16T22:03:20.506106] [INFO ] [MAIN ] Update Progress: 2159/2369 symbols completed. TXNM took 46.1s. Estimated remaining: 29m 30s. Rate: 7.1 symbols/min [2025-10-16T22:03:20.784055] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T22:03:20.786244] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-10-16T22:03:21.586874] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T22:03:21.589076] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-10. [2025-10-16T22:03:22.230738] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T22:03:22.232154] [INFO ] [REMOTE ] TY: Full fetch complete (11449 records). [2025-10-16T22:03:22.232225] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-16T22:03:22.585541] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-16T22:03:22.585639] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-16T22:03:22.585947] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-16T22:03:22.585988] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-16T22:03:22.586418] [DEBUG] [LOCAL ] TY: Trimmed 11449 records to 7643 (keeping 200 days of data) [2025-10-16T22:03:22.634168] [DEBUG] [LOCAL ] TY: Primary data saved (7643 records). [2025-10-16T22:03:22.634312] [INFO ] [MAIN ] TY: Full history saved. [2025-10-16T22:03:22.634399] [INFO ] [MAIN ] Update Progress: 2160/2369 symbols completed. TY took 22.6s. Estimated remaining: 29m 21s. Rate: 7.1 symbols/min [2025-10-16T22:03:23.341703] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:03:23.345870] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:03:23.370816] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:03:23.372819] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:03:23.394918] [DEBUG] [LOCAL ] TYG: Loaded 13894 existing records from primary storage. [2025-10-16T22:03:23.396015] [INFO ] [MAIN ] TYG: Loaded 13894 existing records. [2025-10-16T22:03:23.533606] [DEBUG] [LOCAL ] TYL: Loaded 22414 existing records from primary storage. [2025-10-16T22:03:23.547754] [INFO ] [MAIN ] TYL: Loaded 22414 existing records. [2025-10-16T22:03:23.713573] [DEBUG] [LOCAL ] UA: Loaded 50489 existing records from primary storage. [2025-10-16T22:03:23.702857] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-16T22:03:23.712466] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:03:23.732909] [INFO ] [MAIN ] UA: Loaded 50489 existing records. [2025-10-16T22:03:23.738388] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-10-16T22:03:23.789508] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-16T22:03:23.834289] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-16T22:03:23.873923] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-16T22:03:23.978079] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-16T22:03:24.110791] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:03:24.138250] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-16T22:03:24.143717] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-16T22:03:24.176726] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-16T22:03:24.187212] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-16T22:03:24.390989] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:03:24.406279] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:03:24.482385] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-16T22:03:24.482205] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-16T22:03:24.482673] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-16T22:03:24.482910] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-16T22:03:24.513226] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-16T22:03:24.529818] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-16T22:03:24.544724] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-16T22:03:24.544500] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-16T22:03:25.393439] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:03:25.413824] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-10-16T22:03:25.478043] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:03:25.502551] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-10-16T22:03:25.789527] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:03:25.800269] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-10-16T22:03:25.865099] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:03:25.865491] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-10-16T22:03:26.387790] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-16T22:03:26.391461] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-16T22:03:26.690349] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T22:03:26.694987] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-16T22:03:27.341804] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T22:03:27.348023] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-16T22:03:27.443271] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T22:03:27.866682] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T22:03:27.942784] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-16T22:03:28.015472] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T22:03:28.051360] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-16T22:03:28.742925] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-16T22:03:29.028496] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T22:03:29.542906] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-16T22:03:30.269502] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T22:03:30.342816] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-16T22:03:30.532428] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-16T22:03:31.142872] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-16T22:03:31.942815] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-16T22:03:32.143677] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T22:03:32.742883] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-16T22:03:33.174093] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-16T22:03:33.440455] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-16T22:03:33.542798] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-16T22:03:34.094588] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T22:03:34.342825] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-16T22:03:35.142841] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-16T22:03:35.518244] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-16T22:03:35.543951] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-16T22:03:35.942797] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-16T22:03:36.077448] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-16T22:03:36.742817] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-16T22:03:37.542795] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-16T22:03:37.886674] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-16T22:03:38.244840] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-16T22:03:38.342806] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-16T22:03:39.142819] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-16T22:03:39.317116] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-16T22:03:39.353006] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T22:03:39.710529] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T22:03:39.942808] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-16T22:03:40.742887] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-16T22:03:41.542811] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-16T22:03:41.843729] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T22:03:42.008094] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-16T22:03:42.342816] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-16T22:03:43.142864] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-16T22:03:43.756231] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-16T22:03:43.942781] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-16T22:03:44.025934] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T22:03:44.095186] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T22:03:44.742865] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-16T22:03:45.427522] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-16T22:03:45.542833] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-16T22:03:46.065894] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-16T22:03:46.342841] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-16T22:03:46.642550] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T22:03:47.142818] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-16T22:03:47.366978] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-16T22:03:47.942843] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-16T22:03:48.742823] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-16T22:03:48.817246] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-16T22:03:49.032613] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-16T22:03:49.542864] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-16T22:03:50.342793] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-16T22:03:50.533590] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T22:03:50.581927] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-16T22:03:50.882785] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-16T22:03:50.886404] [INFO ] [REMOTE ] TYL: Full fetch complete (31602 records). [2025-10-16T22:03:50.886635] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-16T22:03:51.148002] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-16T22:03:51.282141] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-16T22:03:51.282244] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-16T22:03:51.283166] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-16T22:03:51.283230] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-16T22:03:51.284333] [DEBUG] [LOCAL ] TYL: Trimmed 31602 records to 22523 (keeping 200 days of data) [2025-10-16T22:03:51.438839] [DEBUG] [LOCAL ] TYL: Primary data saved (22523 records). [2025-10-16T22:03:51.439021] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-16T22:03:51.439123] [INFO ] [MAIN ] Update Progress: 2161/2369 symbols completed. TYL took 28.8s. Estimated remaining: 29m 14s. Rate: 7.1 symbols/min [2025-10-16T22:03:51.613551] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:03:51.669778] [DEBUG] [LOCAL ] UAA: Loaded 53502 existing records from primary storage. [2025-10-16T22:03:51.670204] [INFO ] [MAIN ] UAA: Loaded 53502 existing records. [2025-10-16T22:03:51.854738] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:03:51.855026] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-16T22:03:51.855079] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-16T22:03:51.855369] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-16T22:03:51.855428] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-16T22:03:51.947958] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-16T22:03:52.231150] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:03:52.742879] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-16T22:03:53.440024] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T22:03:53.442084] [INFO ] [REMOTE ] TYG: Full fetch complete (22326 records). [2025-10-16T22:03:53.442186] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-16T22:03:53.550131] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-10-16T22:03:53.825761] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-16T22:03:53.826104] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-16T22:03:53.826600] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-16T22:03:53.826902] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-16T22:03:53.828051] [DEBUG] [LOCAL ] TYG: Trimmed 22326 records to 13989 (keeping 200 days of data) [2025-10-16T22:03:53.992677] [DEBUG] [LOCAL ] TYG: Primary data saved (13989 records). [2025-10-16T22:03:53.993683] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-16T22:03:53.995003] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-10-16T22:03:53.995159] [INFO ] [MAIN ] Update Progress: 2162/2369 symbols completed. TYG took 31.4s. Estimated remaining: 29m 5s. Rate: 7.1 symbols/min [2025-10-16T22:03:54.009492] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-16T22:03:54.194202] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:03:54.202281] [DEBUG] [LOCAL ] UAN: Loaded 5430 existing records from primary storage. [2025-10-16T22:03:54.202497] [INFO ] [MAIN ] UAN: Loaded 5430 existing records. [2025-10-16T22:03:54.353041] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-16T22:03:54.383800] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:03:54.384156] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-16T22:03:54.384211] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-16T22:03:54.384424] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-16T22:03:54.384479] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-16T22:03:54.735170] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:03:55.142873] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-10-16T22:03:55.504981] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T22:03:55.858108] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-16T22:03:55.942855] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-16T22:03:56.197502] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T22:03:56.742815] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-16T22:03:56.746251] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T22:03:57.542862] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-16T22:03:58.342830] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-16T22:03:58.600264] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T22:03:58.957862] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-16T22:03:59.142847] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-16T22:03:59.942790] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-16T22:03:59.991404] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-16T22:04:00.008455] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-16T22:04:00.742868] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-16T22:04:01.477532] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T22:04:01.542849] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-16T22:04:01.704583] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-16T22:04:01.712096] [INFO ] [REMOTE ] UA: Full fetch complete (73181 records). [2025-10-16T22:04:01.712334] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-16T22:04:02.117596] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-16T22:04:02.117702] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-16T22:04:02.119071] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-16T22:04:02.119191] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-16T22:04:02.120712] [DEBUG] [LOCAL ] UA: Trimmed 73181 records to 50852 (keeping 200 days of data) [2025-10-16T22:04:02.347110] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-16T22:04:02.408503] [DEBUG] [LOCAL ] UA: Primary data saved (50852 records). [2025-10-16T22:04:02.408668] [INFO ] [MAIN ] UA: Full history saved. [2025-10-16T22:04:02.409440] [INFO ] [MAIN ] Update Progress: 2163/2369 symbols completed. UA took 39.8s. Estimated remaining: 28m 57s. Rate: 7.1 symbols/min [2025-10-16T22:04:02.585234] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:04:02.648549] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-16T22:04:02.649057] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-10-16T22:04:02.845427] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:04:02.845799] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-16T22:04:02.845884] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-16T22:04:02.846138] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-16T22:04:02.846182] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-16T22:04:03.149493] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-16T22:04:03.240898] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:04:03.281530] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T22:04:03.935591] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-16T22:04:03.942766] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-16T22:04:04.540170] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-16T22:04:04.742825] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-16T22:04:04.874574] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-16T22:04:05.332331] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-16T22:04:05.542804] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-10-16T22:04:06.342818] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-16T22:04:07.142808] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-16T22:04:07.936113] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-16T22:04:07.949296] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-16T22:04:08.410220] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-16T22:04:08.742852] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-16T22:04:09.188279] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-16T22:04:09.202140] [INFO ] [REMOTE ] U: Full fetch complete (77975 records). [2025-10-16T22:04:09.202554] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-16T22:04:09.203606] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-16T22:04:09.547991] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-16T22:04:09.631759] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-16T22:04:09.631889] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-16T22:04:09.633854] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-16T22:04:09.633977] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-16T22:04:09.636266] [DEBUG] [LOCAL ] U: Trimmed 77975 records to 54189 (keeping 200 days of data) [2025-10-16T22:04:10.024405] [DEBUG] [LOCAL ] U: Primary data saved (54189 records). [2025-10-16T22:04:10.024638] [INFO ] [MAIN ] U: Full history saved. [2025-10-16T22:04:10.024832] [INFO ] [MAIN ] Update Progress: 2164/2369 symbols completed. U took 47.4s. Estimated remaining: 28m 49s. Rate: 7.1 symbols/min [2025-10-16T22:04:10.207423] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:04:10.247122] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-16T22:04:10.253555] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-16T22:04:10.309195] [DEBUG] [LOCAL ] UBS: Loaded 52312 existing records from primary storage. [2025-10-16T22:04:10.309617] [INFO ] [MAIN ] UBS: Loaded 52312 existing records. [2025-10-16T22:04:10.348017] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-16T22:04:10.505873] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:04:10.506209] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-16T22:04:10.506267] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-16T22:04:10.506591] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-16T22:04:10.506707] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-16T22:04:10.873152] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:04:11.142812] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-16T22:04:11.721309] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T22:04:11.722501] [INFO ] [REMOTE ] UAN: Full fetch complete (7978 records). [2025-10-16T22:04:11.722571] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-16T22:04:11.947969] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-10-16T22:04:12.146616] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-16T22:04:12.146743] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-16T22:04:12.147029] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-16T22:04:12.147107] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-16T22:04:12.147557] [DEBUG] [LOCAL ] UAN: Trimmed 7978 records to 5451 (keeping 200 days of data) [2025-10-16T22:04:12.184844] [DEBUG] [LOCAL ] UAN: Primary data saved (5451 records). [2025-10-16T22:04:12.184977] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-16T22:04:12.185065] [INFO ] [MAIN ] Update Progress: 2165/2369 symbols completed. UAN took 18.2s. Estimated remaining: 28m 39s. Rate: 7.1 symbols/min [2025-10-16T22:04:12.377777] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:04:12.413124] [DEBUG] [LOCAL ] UCB: Loaded 37854 existing records from primary storage. [2025-10-16T22:04:12.413507] [INFO ] [MAIN ] UCB: Loaded 37854 existing records. [2025-10-16T22:04:12.635165] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:04:12.636592] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-16T22:04:12.636705] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-16T22:04:12.640807] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-16T22:04:12.652259] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-10-16T22:04:12.652873] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-16T22:04:12.748099] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-16T22:04:13.029118] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:04:13.542891] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-16T22:04:13.633605] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T22:04:14.342871] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-16T22:04:14.703468] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-16T22:04:15.142820] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-16T22:04:15.942860] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-10-16T22:04:16.000960] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-16T22:04:16.176712] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T22:04:16.742864] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-16T22:04:16.902800] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T22:04:17.353814] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T22:04:17.542818] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-16T22:04:18.342794] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-16T22:04:18.608729] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-16T22:04:18.988308] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T22:04:19.142826] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-16T22:04:19.942850] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-16T22:04:20.099100] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T22:04:20.742789] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-16T22:04:21.120150] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-16T22:04:21.542811] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-16T22:04:22.342799] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-16T22:04:22.451150] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-16T22:04:22.746156] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-16T22:04:23.142787] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-16T22:04:23.364270] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T22:04:23.506246] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T22:04:23.942811] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-16T22:04:24.742872] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-16T22:04:25.469622] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-16T22:04:25.542781] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-16T22:04:25.661612] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-16T22:04:26.342823] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-16T22:04:26.471600] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T22:04:27.142841] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-16T22:04:27.203072] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T22:04:27.942792] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-16T22:04:28.281379] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-16T22:04:28.742798] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-16T22:04:29.072798] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-16T22:04:29.079889] [INFO ] [REMOTE ] UAA: Full fetch complete (77646 records). [2025-10-16T22:04:29.080045] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-16T22:04:29.474639] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-16T22:04:29.474785] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-16T22:04:29.476046] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-16T22:04:29.476123] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-16T22:04:29.477619] [DEBUG] [LOCAL ] UAA: Trimmed 77646 records to 53890 (keeping 200 days of data) [2025-10-16T22:04:29.549084] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-16T22:04:29.803468] [DEBUG] [LOCAL ] UAA: Primary data saved (53890 records). [2025-10-16T22:04:29.803622] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-16T22:04:29.804474] [INFO ] [MAIN ] Update Progress: 2166/2369 symbols completed. UAA took 38.4s. Estimated remaining: 28m 32s. Rate: 7.1 symbols/min [2025-10-16T22:04:29.975043] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:04:30.026417] [DEBUG] [LOCAL ] UDR: Loaded 52059 existing records from primary storage. [2025-10-16T22:04:30.026760] [INFO ] [MAIN ] UDR: Loaded 52059 existing records. [2025-10-16T22:04:30.219057] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:04:30.219363] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-16T22:04:30.219417] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-16T22:04:30.219698] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-16T22:04:30.219771] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-16T22:04:30.591608] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:04:30.592031] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-10-16T22:04:30.626390] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-16T22:04:30.680153] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-16T22:04:30.934385] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-16T22:04:31.142846] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-16T22:04:31.942788] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-16T22:04:32.342193] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T22:04:32.481891] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T22:04:32.742795] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-16T22:04:33.542886] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-16T22:04:34.342804] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-16T22:04:34.406688] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-16T22:04:34.467244] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T22:04:35.142874] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-16T22:04:35.462961] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T22:04:35.662292] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T22:04:35.942843] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-10-16T22:04:36.051668] [DEBUG] [REMOTE ] UCB: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-16T22:04:36.052120] [WARN ] [REMOTE ] UCB: No data returned for month 2025-08 [2025-10-16T22:04:36.052224] [FATAL] [REMOTE ] UCB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T22:04:36.052322] [FATAL] [MAIN ] UCB: Failed to fetch primary data. [2025-10-16T22:04:36.052480] [WARN ] [MAIN ] UCB: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T22:04:36.052564] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-16T22:04:36.052675] [DEBUG] [LOCAL ] UCB: No primary data file found to delete. [2025-10-16T22:04:36.052750] [INFO ] [LOCAL ] UCB: Starting deletion of derivative data. [2025-10-16T22:04:36.053264] [DEBUG] [LOCAL ] UCB: Deleted derivative data file. [2025-10-16T22:04:36.053377] [INFO ] [MAIN ] Update Progress: 2167/2369 symbols completed. UCB took 23.9s. Estimated remaining: 28m 23s. Rate: 7.1 symbols/min [2025-10-16T22:04:36.227879] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:04:36.277032] [DEBUG] [LOCAL ] UE: Loaded 42581 existing records from primary storage. [2025-10-16T22:04:36.277412] [INFO ] [MAIN ] UE: Loaded 42581 existing records. [2025-10-16T22:04:36.471181] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:04:36.471672] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-16T22:04:36.471751] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-16T22:04:36.472067] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-16T22:04:36.472191] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-16T22:04:36.753884] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-16T22:04:36.820310] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T22:04:36.914313] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:04:37.542859] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-16T22:04:38.342800] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-16T22:04:38.736079] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-16T22:04:39.142873] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-10-16T22:04:39.942859] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-16T22:04:40.241500] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-16T22:04:40.259633] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-16T22:04:40.744528] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-16T22:04:40.749987] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T22:04:41.542790] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-16T22:04:41.593996] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T22:04:42.342838] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-16T22:04:43.145137] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-16T22:04:43.155868] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T22:04:43.278237] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-16T22:04:43.942832] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-16T22:04:44.126611] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-16T22:04:44.133979] [INFO ] [REMOTE ] UBS: Full fetch complete (75964 records). [2025-10-16T22:04:44.134105] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-16T22:04:44.539091] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-16T22:04:44.539202] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-16T22:04:44.540833] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-16T22:04:44.540971] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-16T22:04:44.542628] [DEBUG] [LOCAL ] UBS: Trimmed 75964 records to 52699 (keeping 200 days of data) [2025-10-16T22:04:44.663526] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T22:04:44.750835] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-16T22:04:44.885874] [DEBUG] [LOCAL ] UBS: Primary data saved (52699 records). [2025-10-16T22:04:44.886028] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-16T22:04:44.886110] [INFO ] [MAIN ] Update Progress: 2168/2369 symbols completed. UBS took 34.9s. Estimated remaining: 28m 15s. Rate: 7.1 symbols/min [2025-10-16T22:04:45.056885] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:04:45.066711] [DEBUG] [LOCAL ] UFI: Loaded 8151 existing records from primary storage. [2025-10-16T22:04:45.066914] [INFO ] [MAIN ] UFI: Loaded 8151 existing records. [2025-10-16T22:04:45.269095] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:04:45.269456] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-16T22:04:45.269595] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-16T22:04:45.269861] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-16T22:04:45.269922] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-16T22:04:45.552693] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-16T22:04:45.633105] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:04:45.672056] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T22:04:46.079463] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T22:04:46.342833] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-10-16T22:04:47.108857] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T22:04:47.142868] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-16T22:04:47.942866] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-16T22:04:48.033889] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-16T22:04:48.742893] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-16T22:04:48.966359] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T22:04:49.050065] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-16T22:04:49.056912] [INFO ] [REMOTE ] UBER: Full fetch complete (77986 records). [2025-10-16T22:04:49.057040] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-16T22:04:49.464995] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-16T22:04:49.465148] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-16T22:04:49.466425] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-16T22:04:49.466597] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-16T22:04:49.492612] [DEBUG] [LOCAL ] UBER: Trimmed 77986 records to 54196 (keeping 200 days of data) [2025-10-16T22:04:49.492470] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T22:04:49.552715] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-16T22:04:49.823867] [DEBUG] [LOCAL ] UBER: Primary data saved (54196 records). [2025-10-16T22:04:49.824009] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-16T22:04:49.824623] [INFO ] [MAIN ] Update Progress: 2169/2369 symbols completed. UBER took 47.4s. Estimated remaining: 28m 6s. Rate: 7.1 symbols/min [2025-10-16T22:04:49.987364] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:04:50.039583] [DEBUG] [LOCAL ] UGI: Loaded 50621 existing records from primary storage. [2025-10-16T22:04:50.039937] [INFO ] [MAIN ] UGI: Loaded 50621 existing records. [2025-10-16T22:04:50.215092] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:04:50.215323] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-16T22:04:50.215377] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-16T22:04:50.215568] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-16T22:04:50.215605] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-16T22:04:50.349144] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-16T22:04:50.586952] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:04:51.142791] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-16T22:04:51.184508] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T22:04:51.254206] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T22:04:51.942851] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-16T22:04:52.718180] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T22:04:52.751885] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-10-16T22:04:52.775337] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T22:04:53.542811] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-16T22:04:54.342880] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-16T22:04:54.586153] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T22:04:55.082385] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T22:04:55.142817] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-16T22:04:55.251865] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T22:04:55.942791] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-16T22:04:56.006500] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T22:04:56.742789] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-16T22:04:56.831633] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T22:04:57.533189] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-16T22:04:57.542769] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-16T22:04:58.236267] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T22:04:58.342828] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-16T22:04:59.047101] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T22:04:59.054049] [INFO ] [REMOTE ] UDR: Full fetch complete (75066 records). [2025-10-16T22:04:59.054206] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-16T22:04:59.148087] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-10-16T22:04:59.449520] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-16T22:04:59.449604] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-16T22:04:59.450858] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-16T22:04:59.450921] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-16T22:04:59.452466] [DEBUG] [LOCAL ] UDR: Trimmed 75066 records to 52444 (keeping 200 days of data) [2025-10-16T22:04:59.778574] [DEBUG] [LOCAL ] UDR: Primary data saved (52444 records). [2025-10-16T22:04:59.778748] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-16T22:04:59.779359] [INFO ] [MAIN ] Update Progress: 2170/2369 symbols completed. UDR took 30.0s. Estimated remaining: 27m 58s. Rate: 7.1 symbols/min [2025-10-16T22:04:59.945797] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-16T22:04:59.970335] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:05:00.012294] [DEBUG] [LOCAL ] UGP: Loaded 42890 existing records from primary storage. [2025-10-16T22:05:00.012614] [INFO ] [MAIN ] UGP: Loaded 42890 existing records. [2025-10-16T22:05:00.187640] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:05:00.187929] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-16T22:05:00.187979] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-16T22:05:00.188223] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-16T22:05:00.188280] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-16T22:05:00.551663] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:05:00.647294] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-16T22:05:00.713206] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T22:05:00.742769] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-10-16T22:05:01.542811] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-16T22:05:02.220403] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-16T22:05:02.347984] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-16T22:05:02.363163] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T22:05:03.114099] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-16T22:05:03.142825] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-16T22:05:03.942835] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-10. [2025-10-16T22:05:04.742791] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-10-16T22:05:04.970012] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T22:05:04.984918] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T22:05:04.986590] [INFO ] [REMOTE ] UFI: Full fetch complete (12345 records). [2025-10-16T22:05:04.986687] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-16T22:05:05.338031] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-16T22:05:05.338105] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-16T22:05:05.338402] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-16T22:05:05.338461] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-16T22:05:05.338933] [DEBUG] [LOCAL ] UFI: Trimmed 12345 records to 8215 (keeping 200 days of data) [2025-10-16T22:05:05.385215] [DEBUG] [LOCAL ] UFI: Primary data saved (8215 records). [2025-10-16T22:05:05.385361] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-16T22:05:05.385443] [INFO ] [MAIN ] Update Progress: 2171/2369 symbols completed. UFI took 20.5s. Estimated remaining: 27m 49s. Rate: 7.1 symbols/min [2025-10-16T22:05:05.558241] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:05:05.555030] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-10-16T22:05:05.576333] [DEBUG] [LOCAL ] UHAL: Loaded 16844 existing records from primary storage. [2025-10-16T22:05:05.576549] [INFO ] [MAIN ] UHAL: Loaded 16844 existing records. [2025-10-16T22:05:05.752478] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:05:05.752751] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-16T22:05:05.752812] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-16T22:05:05.752990] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-16T22:05:05.753044] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-16T22:05:06.111589] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:05:06.342781] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-10-16T22:05:06.406337] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T22:05:07.120754] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T22:05:07.142770] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-16T22:05:07.335520] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T22:05:07.942814] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-10-16T22:05:08.610099] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T22:05:08.742801] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-16T22:05:09.542850] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-16T22:05:09.601361] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T22:05:09.714473] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T22:05:10.342816] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-16T22:05:11.142820] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-16T22:05:11.220866] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T22:05:11.868995] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T22:05:11.942774] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-16T22:05:12.065573] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T22:05:12.742825] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-16T22:05:13.521825] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T22:05:13.542773] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-16T22:05:14.342860] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-16T22:05:14.541941] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-16T22:05:15.142807] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-16T22:05:15.260451] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T22:05:15.394494] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T22:05:15.942822] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-10-16T22:05:16.742860] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-16T22:05:17.033413] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-16T22:05:17.527716] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-16T22:05:17.542773] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-16T22:05:17.718802] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T22:05:18.342858] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-10. [2025-10-16T22:05:19.142789] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-16T22:05:19.242628] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T22:05:19.720566] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T22:05:19.726572] [INFO ] [REMOTE ] UE: Full fetch complete (61185 records). [2025-10-16T22:05:19.726726] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-16T22:05:19.949594] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-16T22:05:20.125891] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-16T22:05:20.126000] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-16T22:05:20.127180] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-16T22:05:20.127264] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-16T22:05:20.129021] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T22:05:20.134010] [DEBUG] [LOCAL ] UE: Trimmed 61185 records to 42905 (keeping 200 days of data) [2025-10-16T22:05:20.389896] [DEBUG] [LOCAL ] UE: Primary data saved (42905 records). [2025-10-16T22:05:20.390027] [INFO ] [MAIN ] UE: Full history saved. [2025-10-16T22:05:20.390106] [INFO ] [MAIN ] Update Progress: 2172/2369 symbols completed. UE took 44.3s. Estimated remaining: 27m 41s. Rate: 7.1 symbols/min [2025-10-16T22:05:20.557904] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:05:20.596694] [DEBUG] [LOCAL ] UHS: Loaded 40167 existing records from primary storage. [2025-10-16T22:05:20.596999] [INFO ] [MAIN ] UHS: Loaded 40167 existing records. [2025-10-16T22:05:20.746574] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-16T22:05:20.774089] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:05:20.774617] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-16T22:05:20.775348] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-16T22:05:20.775537] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-16T22:05:20.775577] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-16T22:05:21.142521] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:05:21.523759] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T22:05:21.542760] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-16T22:05:21.929439] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T22:05:22.342833] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-10-16T22:05:23.015683] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T22:05:23.142791] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-16T22:05:23.898487] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T22:05:23.942818] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-16T22:05:24.480449] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T22:05:24.742819] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-16T22:05:25.379245] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T22:05:25.542819] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-16T22:05:25.780949] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T22:05:26.342868] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-16T22:05:27.077173] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T22:05:27.142793] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-16T22:05:27.942785] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-16T22:05:27.981018] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T22:05:28.090217] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T22:05:28.742818] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-16T22:05:29.542801] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-16T22:05:29.728976] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T22:05:29.844824] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T22:05:30.342869] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-16T22:05:31.142795] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-16T22:05:31.265780] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T22:05:31.268459] [INFO ] [REMOTE ] UHAL: Full fetch complete (23347 records). [2025-10-16T22:05:31.268533] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-16T22:05:31.591875] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-16T22:05:31.677234] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-16T22:05:31.677306] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-16T22:05:31.677897] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-16T22:05:31.677961] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-16T22:05:31.678777] [DEBUG] [LOCAL ] UHAL: Trimmed 23347 records to 16985 (keeping 200 days of data) [2025-10-16T22:05:31.789528] [DEBUG] [LOCAL ] UHAL: Primary data saved (16985 records). [2025-10-16T22:05:31.789716] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-16T22:05:31.789824] [INFO ] [MAIN ] Update Progress: 2173/2369 symbols completed. UHAL took 26.4s. Estimated remaining: 27m 33s. Rate: 7.1 symbols/min [2025-10-16T22:05:31.968560] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:05:31.948100] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-16T22:05:31.969470] [DEBUG] [LOCAL ] UHT: No existing data file found in primary storage. [2025-10-16T22:05:31.969522] [WARN ] [MAIN ] UHT: No existing data found, performing full refresh instead. [2025-10-16T22:05:31.969632] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-16T22:05:31.969716] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-16T22:05:31.969768] [DEBUG] [LOCAL ] UHT: No primary data file found to delete. [2025-10-16T22:05:31.969802] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-16T22:05:32.317120] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:05:32.742789] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-16T22:05:32.884914] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T22:05:33.542803] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-10-16T22:05:33.933439] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-16T22:05:34.342787] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-16T22:05:34.426256] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-16T22:05:34.466716] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T22:05:35.142832] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-16T22:05:35.942789] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-16T22:05:36.164957] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T22:05:36.670098] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T22:05:36.675890] [INFO ] [REMOTE ] UGP: Full fetch complete (62199 records). [2025-10-16T22:05:36.676001] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-16T22:05:36.750306] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-16T22:05:37.066589] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-16T22:05:37.066707] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-16T22:05:37.067828] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-16T22:05:37.067892] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-16T22:05:37.069232] [DEBUG] [LOCAL ] UGP: Trimmed 62199 records to 43205 (keeping 200 days of data) [2025-10-16T22:05:37.317869] [DEBUG] [LOCAL ] UGP: Primary data saved (43205 records). [2025-10-16T22:05:37.318005] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-16T22:05:37.318565] [INFO ] [MAIN ] Update Progress: 2174/2369 symbols completed. UGP took 37.5s. Estimated remaining: 27m 24s. Rate: 7.1 symbols/min [2025-10-16T22:05:37.519258] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T22:05:37.517718] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:05:37.543732] [DEBUG] [LOCAL ] UI: Loaded 13975 existing records from primary storage. [2025-10-16T22:05:37.543263] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-16T22:05:37.544883] [INFO ] [MAIN ] UI: Loaded 13975 existing records. [2025-10-16T22:05:37.738693] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:05:37.733356] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T22:05:37.742028] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-16T22:05:37.742092] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-16T22:05:37.742252] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-16T22:05:37.742291] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-16T22:05:38.095531] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:05:38.342826] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-10-16T22:05:39.142805] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-16T22:05:39.186827] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T22:05:39.252674] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-16T22:05:39.744911] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T22:05:39.942868] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-16T22:05:40.742806] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-16T22:05:40.914525] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T22:05:41.542835] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-16T22:05:42.342787] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-16T22:05:42.404990] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T22:05:43.142848] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-16T22:05:43.187344] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T22:05:43.280485] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-16T22:05:43.942869] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-16T22:05:44.606094] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T22:05:44.725508] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-16T22:05:44.742784] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-10-16T22:05:45.519902] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T22:05:45.542766] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-10-16T22:05:46.151626] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T22:05:46.342854] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-10-16T22:05:47.142842] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-16T22:05:47.172701] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-16T22:05:47.891570] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T22:05:47.942779] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-16T22:05:48.510832] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T22:05:48.515463] [INFO ] [REMOTE ] UHS: Full fetch complete (58313 records). [2025-10-16T22:05:48.515595] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-16T22:05:48.747976] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-10-16T22:05:48.896517] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-16T22:05:48.896589] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-16T22:05:48.897630] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-16T22:05:48.897712] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-16T22:05:48.898860] [DEBUG] [LOCAL ] UHS: Trimmed 58313 records to 40374 (keeping 200 days of data) [2025-10-16T22:05:49.146158] [DEBUG] [LOCAL ] UHS: Primary data saved (40374 records). [2025-10-16T22:05:49.146284] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-16T22:05:49.146361] [INFO ] [MAIN ] Update Progress: 2175/2369 symbols completed. UHS took 28.8s. Estimated remaining: 27m 16s. Rate: 7.1 symbols/min [2025-10-16T22:05:49.310736] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:05:49.343350] [DEBUG] [LOCAL ] UIS: Loaded 36906 existing records from primary storage. [2025-10-16T22:05:49.343615] [INFO ] [MAIN ] UIS: Loaded 36906 existing records. [2025-10-16T22:05:49.517397] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:05:49.517617] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-16T22:05:49.517693] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-16T22:05:49.517872] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-16T22:05:49.517910] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-16T22:05:49.548357] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-16T22:05:49.701988] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T22:05:49.881515] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:05:50.342814] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-16T22:05:51.142790] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-10-16T22:05:51.233600] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T22:05:51.240694] [INFO ] [REMOTE ] UGI: Full fetch complete (73519 records). [2025-10-16T22:05:51.240872] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-16T22:05:51.358324] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T22:05:51.660734] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-16T22:05:51.660818] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-16T22:05:51.661992] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-16T22:05:51.662055] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-16T22:05:51.663434] [DEBUG] [LOCAL ] UGI: Trimmed 73519 records to 50994 (keeping 200 days of data) [2025-10-16T22:05:51.955827] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-10-16T22:05:51.976421] [DEBUG] [LOCAL ] UGI: Primary data saved (50994 records). [2025-10-16T22:05:51.976526] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-16T22:05:51.977277] [INFO ] [MAIN ] Update Progress: 2176/2369 symbols completed. UGI took 1m 2s. Estimated remaining: 27m 7s. Rate: 7.1 symbols/min [2025-10-16T22:05:52.142923] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:05:52.193938] [DEBUG] [LOCAL ] UL: Loaded 53078 existing records from primary storage. [2025-10-16T22:05:52.194260] [INFO ] [MAIN ] UL: Loaded 53078 existing records. [2025-10-16T22:05:52.383112] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:05:52.383402] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-16T22:05:52.383569] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-16T22:05:52.383812] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-16T22:05:52.383869] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-16T22:05:52.746839] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T22:05:52.750084] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-16T22:05:52.776558] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:05:52.796250] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T22:05:53.542840] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-10. [2025-10-16T22:05:53.661785] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-16T22:05:54.337882] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T22:05:54.340046] [INFO ] [REMOTE ] UHT: Full fetch complete (15085 records). [2025-10-16T22:05:54.340130] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-16T22:05:54.352404] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-16T22:05:54.708837] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-16T22:05:54.708912] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-16T22:05:54.709255] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-16T22:05:54.709295] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-16T22:05:54.709789] [DEBUG] [LOCAL ] UHT: Trimmed 15085 records to 10250 (keeping 200 days of data) [2025-10-16T22:05:54.771168] [DEBUG] [LOCAL ] UHT: Primary data saved (10250 records). [2025-10-16T22:05:54.771295] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-16T22:05:54.771368] [INFO ] [MAIN ] Update Progress: 2177/2369 symbols completed. UHT took 23.0s. Estimated remaining: 26m 58s. Rate: 7.1 symbols/min [2025-10-16T22:05:54.963311] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:05:54.998511] [DEBUG] [LOCAL ] ULS: Loaded 38979 existing records from primary storage. [2025-10-16T22:05:54.998815] [INFO ] [MAIN ] ULS: Loaded 38979 existing records. [2025-10-16T22:05:55.147989] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-10-16T22:05:55.186004] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:05:55.186337] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-16T22:05:55.186384] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-16T22:05:55.186562] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-16T22:05:55.186601] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-16T22:05:55.497530] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T22:05:55.553057] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:05:55.942846] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-16T22:05:56.742845] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-16T22:05:56.837063] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-16T22:05:57.022550] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T22:05:57.542785] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-10-16T22:05:57.999941] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T22:05:58.342866] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-16T22:05:58.966546] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T22:05:59.142776] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-16T22:05:59.581610] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T22:05:59.942919] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-16T22:06:00.509200] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T22:06:00.742890] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-16T22:06:01.542803] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-16T22:06:01.952565] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T22:06:02.206224] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T22:06:02.342866] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-16T22:06:02.379899] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T22:06:03.142888] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-16T22:06:03.942831] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-16T22:06:04.132751] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T22:06:04.559445] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T22:06:04.742829] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-16T22:06:05.391832] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T22:06:05.542821] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-16T22:06:06.342788] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-10-16T22:06:06.379586] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T22:06:06.603479] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T22:06:07.142869] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-16T22:06:07.942819] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-16T22:06:08.275884] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-16T22:06:08.322274] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T22:06:08.742850] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-10-16T22:06:08.998900] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T22:06:09.542849] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-16T22:06:10.342855] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-16T22:06:10.683089] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-16T22:06:10.722376] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-16T22:06:11.142864] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-16T22:06:11.866728] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T22:06:11.921669] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T22:06:11.924506] [INFO ] [REMOTE ] UI: Full fetch complete (19433 records). [2025-10-16T22:06:11.924576] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-16T22:06:11.953143] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-16T22:06:12.286392] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-16T22:06:12.286466] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-16T22:06:12.286937] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-16T22:06:12.287000] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-16T22:06:12.287533] [DEBUG] [LOCAL ] UI: Trimmed 19433 records to 14120 (keeping 200 days of data) [2025-10-16T22:06:12.378379] [DEBUG] [LOCAL ] UI: Primary data saved (14120 records). [2025-10-16T22:06:12.378491] [INFO ] [MAIN ] UI: Full history saved. [2025-10-16T22:06:12.378572] [INFO ] [MAIN ] Update Progress: 2178/2369 symbols completed. UI took 35.1s. Estimated remaining: 26m 51s. Rate: 7.1 symbols/min [2025-10-16T22:06:12.546468] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:06:12.593547] [DEBUG] [LOCAL ] UMC: Loaded 52686 existing records from primary storage. [2025-10-16T22:06:12.593899] [INFO ] [MAIN ] UMC: Loaded 52686 existing records. [2025-10-16T22:06:12.747943] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-16T22:06:12.780993] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:06:12.781406] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-16T22:06:12.781532] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-16T22:06:12.781776] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-16T22:06:12.781833] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-16T22:06:13.136257] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:06:13.448071] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-16T22:06:13.542784] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-10-16T22:06:14.200746] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-16T22:06:14.342812] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-16T22:06:15.142811] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-16T22:06:15.507660] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-16T22:06:15.911715] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T22:06:15.942783] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-16T22:06:16.742802] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-10-16T22:06:16.776589] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T22:06:17.318088] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T22:06:17.542829] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-16T22:06:18.342795] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-10-16T22:06:18.793376] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-16T22:06:18.909185] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T22:06:19.142828] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-16T22:06:19.942833] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-16T22:06:20.279205] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-16T22:06:20.622369] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T22:06:20.742775] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-16T22:06:21.224185] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T22:06:21.228852] [INFO ] [REMOTE ] ULS: Full fetch complete (54115 records). [2025-10-16T22:06:21.228951] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-16T22:06:21.547894] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-10-16T22:06:21.617757] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-16T22:06:21.617840] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-16T22:06:21.619058] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-16T22:06:21.619122] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-16T22:06:21.620220] [DEBUG] [LOCAL ] ULS: Trimmed 54115 records to 39279 (keeping 200 days of data) [2025-10-16T22:06:21.862438] [DEBUG] [LOCAL ] ULS: Primary data saved (39279 records). [2025-10-16T22:06:21.862585] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-16T22:06:21.862714] [INFO ] [MAIN ] Update Progress: 2179/2369 symbols completed. ULS took 27.1s. Estimated remaining: 26m 43s. Rate: 7.1 symbols/min [2025-10-16T22:06:22.032597] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:06:22.072967] [DEBUG] [LOCAL ] UMH: Loaded 34142 existing records from primary storage. [2025-10-16T22:06:22.073283] [INFO ] [MAIN ] UMH: Loaded 34142 existing records. [2025-10-16T22:06:22.252761] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T22:06:22.282014] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:06:22.282893] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-16T22:06:22.282944] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-16T22:06:22.283140] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-16T22:06:22.283194] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-16T22:06:22.349869] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-16T22:06:22.636923] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:06:23.142783] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-10-16T22:06:23.515971] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-16T22:06:23.942856] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-10-16T22:06:24.134135] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T22:06:24.259132] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-16T22:06:24.742866] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-16T22:06:25.542806] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-16T22:06:25.678358] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T22:06:26.342827] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-16T22:06:26.682072] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-16T22:06:26.835566] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T22:06:27.142882] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-16T22:06:27.772442] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-16T22:06:27.942879] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-16T22:06:28.742796] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-10-16T22:06:29.072226] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-16T22:06:29.207521] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-16T22:06:29.212245] [INFO ] [REMOTE ] UIS: Full fetch complete (52036 records). [2025-10-16T22:06:29.212333] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-16T22:06:29.547973] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-16T22:06:29.589457] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-16T22:06:29.589523] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-16T22:06:29.590535] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-16T22:06:29.590596] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-16T22:06:29.591993] [DEBUG] [LOCAL ] UIS: Trimmed 52036 records to 37124 (keeping 200 days of data) [2025-10-16T22:06:29.798836] [DEBUG] [LOCAL ] UIS: Primary data saved (37124 records). [2025-10-16T22:06:29.798995] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-16T22:06:29.799120] [INFO ] [MAIN ] Update Progress: 2180/2369 symbols completed. UIS took 40.7s. Estimated remaining: 26m 34s. Rate: 7.1 symbols/min [2025-10-16T22:06:29.968122] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:06:29.968297] [DEBUG] [LOCAL ] UNF: No existing data file found in primary storage. [2025-10-16T22:06:29.968342] [WARN ] [MAIN ] UNF: No existing data found, performing full refresh instead. [2025-10-16T22:06:29.968452] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-16T22:06:29.968492] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-16T22:06:29.968532] [DEBUG] [LOCAL ] UNF: No primary data file found to delete. [2025-10-16T22:06:29.968586] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-16T22:06:30.330282] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:06:30.342772] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-10-16T22:06:30.690901] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-16T22:06:30.788233] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T22:06:31.142799] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-10. [2025-10-16T22:06:31.160888] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-16T22:06:31.942840] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-16T22:06:32.742856] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-16T22:06:32.943420] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T22:06:32.950514] [INFO ] [REMOTE ] UL: Full fetch complete (77087 records). [2025-10-16T22:06:32.950689] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-16T22:06:33.341856] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-16T22:06:33.341995] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-16T22:06:33.343202] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-16T22:06:33.343265] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-16T22:06:33.344905] [DEBUG] [LOCAL ] UL: Trimmed 77087 records to 53468 (keeping 200 days of data) [2025-10-16T22:06:33.559595] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-16T22:06:33.679702] [DEBUG] [LOCAL ] UL: Primary data saved (53468 records). [2025-10-16T22:06:33.679853] [INFO ] [MAIN ] UL: Full history saved. [2025-10-16T22:06:33.680490] [INFO ] [MAIN ] Update Progress: 2181/2369 symbols completed. UL took 41.7s. Estimated remaining: 26m 25s. Rate: 7.1 symbols/min [2025-10-16T22:06:33.855942] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:06:33.868993] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T22:06:33.904292] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T22:06:33.945603] [DEBUG] [LOCAL ] UNFI: Loaded 42628 existing records from primary storage. [2025-10-16T22:06:33.945955] [INFO ] [MAIN ] UNFI: Loaded 42628 existing records. [2025-10-16T22:06:34.121775] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:06:34.121984] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-16T22:06:34.122031] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-16T22:06:34.122242] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-16T22:06:34.122297] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-16T22:06:34.348793] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-16T22:06:34.472767] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:06:34.972980] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T22:06:35.142818] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-16T22:06:35.165378] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T22:06:35.942890] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-10-16T22:06:36.742835] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-16T22:06:37.051006] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-16T22:06:37.542822] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-16T22:06:37.573303] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T22:06:37.618764] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-16T22:06:38.342833] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-16T22:06:39.142908] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-16T22:06:39.355365] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T22:06:39.443993] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T22:06:39.789208] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-16T22:06:39.942833] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-16T22:06:40.742846] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-16T22:06:41.065319] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T22:06:41.542832] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-16T22:06:42.209843] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T22:06:42.342877] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-16T22:06:42.361752] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T22:06:43.142841] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-16T22:06:43.766745] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T22:06:43.942829] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-10-16T22:06:44.486354] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-16T22:06:44.742833] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-10-16T22:06:45.090327] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-16T22:06:45.542792] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-16T22:06:45.781967] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T22:06:46.342820] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-10-16T22:06:46.943164] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T22:06:47.090351] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T22:06:47.142784] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-10-16T22:06:47.942814] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-16T22:06:47.961475] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T22:06:48.742823] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-10. [2025-10-16T22:06:49.542798] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-16T22:06:49.575765] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T22:06:49.578501] [INFO ] [REMOTE ] UNF: Full fetch complete (17603 records). [2025-10-16T22:06:49.578681] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-16T22:06:49.714925] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T22:06:49.982608] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-16T22:06:49.982715] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-16T22:06:49.983303] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-16T22:06:49.983348] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-16T22:06:49.983922] [DEBUG] [LOCAL ] UNF: Trimmed 17603 records to 11978 (keeping 200 days of data) [2025-10-16T22:06:50.061894] [DEBUG] [LOCAL ] UNF: Primary data saved (11978 records). [2025-10-16T22:06:50.062052] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-16T22:06:50.062132] [INFO ] [MAIN ] Update Progress: 2182/2369 symbols completed. UNF took 20.3s. Estimated remaining: 26m 17s. Rate: 7.1 symbols/min [2025-10-16T22:06:50.231145] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:06:50.281414] [DEBUG] [LOCAL ] UNH: Loaded 53818 existing records from primary storage. [2025-10-16T22:06:50.281780] [INFO ] [MAIN ] UNH: Loaded 53818 existing records. [2025-10-16T22:06:50.348119] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-16T22:06:50.461135] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:06:50.461438] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-16T22:06:50.461489] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-16T22:06:50.461941] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-16T22:06:50.462000] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-16T22:06:50.813150] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:06:51.142801] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-10-16T22:06:51.421080] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T22:06:51.456571] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T22:06:51.942829] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-16T22:06:52.742863] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-16T22:06:53.292611] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T22:06:53.550105] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-16T22:06:53.573707] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-16T22:06:54.250790] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T22:06:54.342819] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-16T22:06:55.142793] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-16T22:06:55.562864] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-16T22:06:55.598946] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T22:06:55.942823] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-16T22:06:56.644881] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T22:06:56.742862] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-16T22:06:57.542790] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-16T22:06:57.812964] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-16T22:06:57.821549] [INFO ] [REMOTE ] UMC: Full fetch complete (76674 records). [2025-10-16T22:06:57.821889] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-16T22:06:58.258756] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-16T22:06:58.258873] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-16T22:06:58.261118] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-16T22:06:58.261190] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-16T22:06:58.263585] [DEBUG] [LOCAL ] UMC: Trimmed 76674 records to 53073 (keeping 200 days of data) [2025-10-16T22:06:58.353987] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-16T22:06:58.535984] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T22:06:58.650461] [DEBUG] [LOCAL ] UMC: Primary data saved (53073 records). [2025-10-16T22:06:58.650733] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-16T22:06:58.651589] [INFO ] [MAIN ] Update Progress: 2183/2369 symbols completed. UMC took 46.3s. Estimated remaining: 26m 9s. Rate: 7.1 symbols/min [2025-10-16T22:06:58.828103] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:06:58.881720] [DEBUG] [LOCAL ] UNM: Loaded 48146 existing records from primary storage. [2025-10-16T22:06:58.882185] [INFO ] [MAIN ] UNM: Loaded 48146 existing records. [2025-10-16T22:06:59.074944] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:06:59.075254] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-16T22:06:59.075309] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-16T22:06:59.075560] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-16T22:06:59.075617] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-16T22:06:59.150194] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-16T22:06:59.467012] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:06:59.817134] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-16T22:06:59.830279] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T22:06:59.836529] [INFO ] [REMOTE ] UMH: Full fetch complete (47147 records). [2025-10-16T22:06:59.836688] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-16T22:06:59.947941] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-10-16T22:07:00.229764] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-16T22:07:00.229966] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-16T22:07:00.231966] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-16T22:07:00.232036] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-16T22:07:00.233782] [DEBUG] [LOCAL ] UMH: Trimmed 47147 records to 34443 (keeping 200 days of data) [2025-10-16T22:07:00.462626] [DEBUG] [LOCAL ] UMH: Primary data saved (34443 records). [2025-10-16T22:07:00.462842] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-16T22:07:00.462975] [INFO ] [MAIN ] Update Progress: 2184/2369 symbols completed. UMH took 38.6s. Estimated remaining: 26m 0s. Rate: 7.1 symbols/min [2025-10-16T22:07:00.656275] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:07:00.664104] [DEBUG] [LOCAL ] UNMA: Loaded 3499 existing records from primary storage. [2025-10-16T22:07:00.664398] [INFO ] [MAIN ] UNMA: Loaded 3499 existing records. [2025-10-16T22:07:00.746584] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-16T22:07:00.899014] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:07:00.894947] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T22:07:00.909108] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-16T22:07:00.909377] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-16T22:07:00.910070] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-16T22:07:00.910127] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-16T22:07:01.312073] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:07:01.486281] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T22:07:01.542877] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-10-16T22:07:02.170258] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-16T22:07:02.342885] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-16T22:07:02.984941] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-16T22:07:03.142825] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-16T22:07:03.747554] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T22:07:03.942893] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-16T22:07:04.742864] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-16T22:07:05.444214] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-16T22:07:05.536100] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-16T22:07:05.551075] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-16T22:07:05.567808] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T22:07:06.342857] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-16T22:07:07.147933] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-16T22:07:07.164017] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T22:07:07.916803] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T22:07:07.942774] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-16T22:07:08.742895] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-16T22:07:09.542840] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-16T22:07:09.664290] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T22:07:09.703530] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-16T22:07:10.101688] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-16T22:07:10.342847] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-16T22:07:10.453691] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-16T22:07:10.459699] [INFO ] [REMOTE ] UNFI: Full fetch complete (59735 records). [2025-10-16T22:07:10.459810] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-16T22:07:10.898377] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-16T22:07:10.898472] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-16T22:07:10.899626] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-16T22:07:10.899711] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-16T22:07:10.900999] [DEBUG] [LOCAL ] UNFI: Trimmed 59735 records to 42911 (keeping 200 days of data) [2025-10-16T22:07:11.143913] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-16T22:07:11.154047] [DEBUG] [LOCAL ] UNFI: Primary data saved (42911 records). [2025-10-16T22:07:11.154187] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-16T22:07:11.154732] [INFO ] [MAIN ] Update Progress: 2185/2369 symbols completed. UNFI took 37.5s. Estimated remaining: 25m 52s. Rate: 7.1 symbols/min [2025-10-16T22:07:11.326789] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:07:11.383421] [DEBUG] [LOCAL ] UNP: Loaded 53328 existing records from primary storage. [2025-10-16T22:07:11.383817] [INFO ] [MAIN ] UNP: Loaded 53328 existing records. [2025-10-16T22:07:11.565408] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:07:11.565625] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-16T22:07:11.565707] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-16T22:07:11.565923] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-16T22:07:11.565978] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-16T22:07:11.917487] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:07:11.942773] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-10-16T22:07:12.025663] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T22:07:12.742857] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-16T22:07:13.542819] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-16T22:07:13.787191] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-16T22:07:13.814313] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-16T22:07:14.156276] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T22:07:14.342850] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-16T22:07:14.473062] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T22:07:14.924217] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-16T22:07:15.142833] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-16T22:07:15.942793] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-16T22:07:16.742828] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-16T22:07:17.143627] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-16T22:07:17.542873] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-16T22:07:17.642490] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T22:07:18.342820] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-16T22:07:19.142814] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-16T22:07:19.287852] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T22:07:19.463539] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-16T22:07:19.715502] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T22:07:19.942800] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-16T22:07:20.116892] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-16T22:07:20.593344] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-16T22:07:20.742827] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-16T22:07:21.542797] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-16T22:07:22.347887] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-16T22:07:22.366229] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T22:07:22.998526] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-16T22:07:23.142817] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-16T22:07:23.716696] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-16T22:07:23.942818] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-16T22:07:24.507313] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-10-16T22:07:24.742827] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-16T22:07:25.557343] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-16T22:07:25.561133] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T22:07:26.342823] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-16T22:07:26.896425] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-16T22:07:27.142826] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-16T22:07:27.387785] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T22:07:27.485888] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-16T22:07:27.507457] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-16T22:07:27.508463] [INFO ] [REMOTE ] UNMA: Full fetch complete (5598 records). [2025-10-16T22:07:27.508534] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-16T22:07:27.873416] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-16T22:07:27.873487] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-16T22:07:27.873727] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-16T22:07:27.873789] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-16T22:07:27.874159] [DEBUG] [LOCAL ] UNMA: Trimmed 5598 records to 3537 (keeping 200 days of data) [2025-10-16T22:07:27.895561] [DEBUG] [LOCAL ] UNMA: Primary data saved (3537 records). [2025-10-16T22:07:27.895670] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-16T22:07:27.895780] [INFO ] [MAIN ] Update Progress: 2186/2369 symbols completed. UNMA took 27.4s. Estimated remaining: 25m 44s. Rate: 7.1 symbols/min [2025-10-16T22:07:27.948048] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-16T22:07:28.063306] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:07:28.105618] [DEBUG] [LOCAL ] UP: Loaded 44181 existing records from primary storage. [2025-10-16T22:07:28.105975] [INFO ] [MAIN ] UP: Loaded 44181 existing records. [2025-10-16T22:07:28.278407] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:07:28.278628] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-16T22:07:28.278709] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-16T22:07:28.278937] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-16T22:07:28.279006] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-16T22:07:28.634492] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:07:28.742834] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-16T22:07:29.396639] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T22:07:29.402904] [INFO ] [REMOTE ] UNM: Full fetch complete (70015 records). [2025-10-16T22:07:29.403041] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-16T22:07:29.548475] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-10-16T22:07:29.807599] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-16T22:07:29.807712] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-16T22:07:29.808894] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-16T22:07:29.808960] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-16T22:07:29.810330] [DEBUG] [LOCAL ] UNM: Trimmed 70015 records to 48472 (keeping 200 days of data) [2025-10-16T22:07:30.114854] [DEBUG] [LOCAL ] UNM: Primary data saved (48472 records). [2025-10-16T22:07:30.115095] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-16T22:07:30.115800] [INFO ] [MAIN ] Update Progress: 2187/2369 symbols completed. UNM took 31.5s. Estimated remaining: 25m 35s. Rate: 7.1 symbols/min [2025-10-16T22:07:30.294752] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:07:30.352432] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-16T22:07:30.357446] [DEBUG] [LOCAL ] UPS: Loaded 53719 existing records from primary storage. [2025-10-16T22:07:30.358543] [INFO ] [MAIN ] UPS: Loaded 53719 existing records. [2025-10-16T22:07:30.547605] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:07:30.548109] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-16T22:07:30.548246] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-16T22:07:30.548568] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-10-16T22:07:30.548629] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-16T22:07:30.954766] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-16T22:07:30.971009] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:07:31.142793] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-16T22:07:31.208111] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T22:07:31.942821] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-16T22:07:32.742910] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-10-16T22:07:33.029213] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-10-16T22:07:33.200269] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-16T22:07:33.236839] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T22:07:33.542803] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-16T22:07:34.342787] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-16T22:07:34.887971] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T22:07:34.921595] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-16T22:07:35.142850] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-16T22:07:35.805520] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T22:07:35.812748] [INFO ] [REMOTE ] UNH: Full fetch complete (77960 records). [2025-10-16T22:07:35.812890] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-16T22:07:35.944769] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-16T22:07:36.257786] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-16T22:07:36.257986] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-16T22:07:36.259573] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-16T22:07:36.259807] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-16T22:07:36.261471] [DEBUG] [LOCAL ] UNH: Trimmed 77960 records to 54208 (keeping 200 days of data) [2025-10-16T22:07:36.387929] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-16T22:07:36.673359] [DEBUG] [LOCAL ] UNH: Primary data saved (54208 records). [2025-10-16T22:07:36.673679] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-16T22:07:36.673815] [INFO ] [MAIN ] Update Progress: 2188/2369 symbols completed. UNH took 46.6s. Estimated remaining: 25m 27s. Rate: 7.1 symbols/min [2025-10-16T22:07:36.748066] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-16T22:07:36.871405] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:07:36.918303] [DEBUG] [LOCAL ] URI: Loaded 34764 existing records from primary storage. [2025-10-16T22:07:36.918793] [INFO ] [MAIN ] URI: Loaded 34764 existing records. [2025-10-16T22:07:37.138466] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:07:37.138900] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-16T22:07:37.138989] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-16T22:07:37.139475] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-16T22:07:37.139554] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-16T22:07:37.278447] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T22:07:37.551809] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-16T22:07:37.600120] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:07:38.342826] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-10-16T22:07:38.738814] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-16T22:07:39.142835] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-16T22:07:39.277617] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T22:07:39.929562] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T22:07:39.942767] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-16T22:07:40.425831] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T22:07:40.742819] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-16T22:07:41.542818] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-16T22:07:41.910814] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T22:07:41.947161] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-16T22:07:42.342820] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-16T22:07:43.142786] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-16T22:07:43.296874] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T22:07:43.942855] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-16T22:07:44.435768] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-16T22:07:44.686070] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T22:07:44.742791] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-16T22:07:45.542800] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-16T22:07:45.919992] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T22:07:46.342840] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-16T22:07:46.427854] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T22:07:47.147953] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-16T22:07:47.157736] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T22:07:47.164857] [INFO ] [REMOTE ] UNP: Full fetch complete (77100 records). [2025-10-16T22:07:47.164979] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-16T22:07:47.561589] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-16T22:07:47.561826] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-16T22:07:47.563038] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-16T22:07:47.563141] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-16T22:07:47.564690] [DEBUG] [LOCAL ] UNP: Trimmed 77100 records to 53718 (keeping 200 days of data) [2025-10-16T22:07:47.827575] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-16T22:07:47.941890] [DEBUG] [LOCAL ] UNP: Primary data saved (53718 records). [2025-10-16T22:07:47.942026] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-16T22:07:47.942716] [INFO ] [MAIN ] Update Progress: 2189/2369 symbols completed. UNP took 36.8s. Estimated remaining: 25m 18s. Rate: 7.1 symbols/min [2025-10-16T22:07:47.942784] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-10-16T22:07:48.118939] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:07:48.155177] [DEBUG] [LOCAL ] USA: Loaded 36382 existing records from primary storage. [2025-10-16T22:07:48.155449] [INFO ] [MAIN ] USA: Loaded 36382 existing records. [2025-10-16T22:07:48.343069] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:07:48.343294] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-16T22:07:48.343348] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-16T22:07:48.343555] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-16T22:07:48.343611] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-16T22:07:48.700010] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:07:48.742788] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-16T22:07:48.995783] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T22:07:49.549370] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-10-16T22:07:49.551494] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T22:07:50.342812] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-10-16T22:07:50.885411] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T22:07:50.991296] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-16T22:07:51.142814] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-10-16T22:07:51.942790] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-16T22:07:52.160696] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T22:07:52.742868] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-10-16T22:07:53.349941] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T22:07:53.397931] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-16T22:07:53.542787] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-16T22:07:54.180416] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T22:07:54.342806] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-16T22:07:54.798483] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T22:07:55.142851] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-10-16T22:07:55.942832] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-16T22:07:56.578487] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-16T22:07:56.612987] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T22:07:56.742795] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-10-16T22:07:57.382510] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T22:07:57.542841] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-16T22:07:58.150474] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T22:07:58.342807] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-10-16T22:07:59.142852] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-16T22:07:59.552126] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-16T22:07:59.559763] [INFO ] [REMOTE ] UP: Full fetch complete (62999 records). [2025-10-16T22:07:59.559894] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-16T22:07:59.950374] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-10-16T22:07:59.971945] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-16T22:07:59.972085] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-16T22:07:59.973277] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-16T22:07:59.973511] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-16T22:07:59.974932] [DEBUG] [LOCAL ] UP: Trimmed 62999 records to 44555 (keeping 200 days of data) [2025-10-16T22:08:00.081452] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T22:08:00.262635] [DEBUG] [LOCAL ] UP: Primary data saved (44555 records). [2025-10-16T22:08:00.262804] [INFO ] [MAIN ] UP: Full history saved. [2025-10-16T22:08:00.262895] [INFO ] [MAIN ] Update Progress: 2190/2369 symbols completed. UP took 32.4s. Estimated remaining: 25m 10s. Rate: 7.1 symbols/min [2025-10-16T22:08:00.431974] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:08:00.453133] [DEBUG] [LOCAL ] USAC: Loaded 21665 existing records from primary storage. [2025-10-16T22:08:00.453459] [INFO ] [MAIN ] USAC: Loaded 21665 existing records. [2025-10-16T22:08:00.655374] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:08:00.678278] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-16T22:08:00.680112] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-16T22:08:00.679985] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T22:08:00.689143] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-16T22:08:00.689388] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-16T22:08:00.752509] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-10-16T22:08:01.072599] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:08:01.542802] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-16T22:08:01.935447] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-16T22:08:02.344842] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-10-16T22:08:02.346707] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T22:08:02.702831] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-16T22:08:03.142830] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-10-16T22:08:03.547568] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T22:08:03.942827] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-16T22:08:04.619010] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T22:08:04.742816] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-10. [2025-10-16T22:08:04.875896] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T22:08:05.307901] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T22:08:05.311860] [INFO ] [REMOTE ] URI: Full fetch complete (52891 records). [2025-10-16T22:08:05.311981] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-16T22:08:05.548103] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-10-16T22:08:05.705133] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-16T22:08:05.705228] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-16T22:08:05.706280] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-16T22:08:05.706357] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-16T22:08:05.707606] [DEBUG] [LOCAL ] URI: Trimmed 52891 records to 34979 (keeping 200 days of data) [2025-10-16T22:08:05.933047] [DEBUG] [LOCAL ] URI: Primary data saved (34979 records). [2025-10-16T22:08:05.933210] [INFO ] [MAIN ] URI: Full history saved. [2025-10-16T22:08:05.933325] [INFO ] [MAIN ] Update Progress: 2191/2369 symbols completed. URI took 29.3s. Estimated remaining: 25m 2s. Rate: 7.1 symbols/min [2025-10-16T22:08:06.137144] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:08:06.187359] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-16T22:08:06.187738] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-10-16T22:08:06.348019] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-16T22:08:06.395291] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:08:06.395794] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-16T22:08:06.395879] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-16T22:08:06.396092] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-16T22:08:06.396149] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-16T22:08:06.755464] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:08:07.142809] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-10-16T22:08:07.911859] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T22:08:07.955166] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-16T22:08:07.979040] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-16T22:08:08.662078] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T22:08:08.742784] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-16T22:08:08.823726] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T22:08:09.542905] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-16T22:08:10.342816] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-10-16T22:08:10.556292] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T22:08:10.897343] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T22:08:11.142817] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-16T22:08:11.942822] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-16T22:08:12.472541] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T22:08:12.702294] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-16T22:08:12.742787] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-10-16T22:08:13.388123] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-16T22:08:13.542820] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-16T22:08:14.342890] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-16T22:08:15.142854] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-16T22:08:15.205902] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-16T22:08:15.264140] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T22:08:15.890677] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T22:08:15.942787] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-16T22:08:15.977270] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T22:08:16.742820] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-10. [2025-10-16T22:08:17.431023] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T22:08:17.438476] [INFO ] [REMOTE ] UPS: Full fetch complete (77880 records). [2025-10-16T22:08:17.438700] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-16T22:08:17.549944] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-16T22:08:17.849171] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-16T22:08:17.849339] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-16T22:08:17.850670] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-16T22:08:17.850848] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-16T22:08:17.881467] [DEBUG] [LOCAL ] UPS: Trimmed 77880 records to 54109 (keeping 200 days of data) [2025-10-16T22:08:17.885165] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-16T22:08:18.233043] [DEBUG] [LOCAL ] UPS: Primary data saved (54109 records). [2025-10-16T22:08:18.233209] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-16T22:08:18.233963] [INFO ] [MAIN ] Update Progress: 2192/2369 symbols completed. UPS took 48.1s. Estimated remaining: 24m 53s. Rate: 7.1 symbols/min [2025-10-16T22:08:18.347934] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-16T22:08:18.404586] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:08:18.455481] [DEBUG] [LOCAL ] USFD: Loaded 51183 existing records from primary storage. [2025-10-16T22:08:18.455862] [INFO ] [MAIN ] USFD: Loaded 51183 existing records. [2025-10-16T22:08:18.631363] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:08:18.631561] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-16T22:08:18.631611] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-16T22:08:18.631835] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-16T22:08:18.631890] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-16T22:08:18.989170] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:08:19.054194] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T22:08:19.059820] [INFO ] [REMOTE ] USA: Full fetch complete (52499 records). [2025-10-16T22:08:19.059927] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-16T22:08:19.148997] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-16T22:08:19.458627] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-16T22:08:19.504700] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-16T22:08:19.504808] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-16T22:08:19.505810] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-16T22:08:19.505883] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-16T22:08:19.506908] [DEBUG] [LOCAL ] USA: Trimmed 52499 records to 36692 (keeping 200 days of data) [2025-10-16T22:08:19.724418] [DEBUG] [LOCAL ] USA: Primary data saved (36692 records). [2025-10-16T22:08:19.724558] [INFO ] [MAIN ] USA: Full history saved. [2025-10-16T22:08:19.725229] [INFO ] [MAIN ] Update Progress: 2193/2369 symbols completed. USA took 31.8s. Estimated remaining: 24m 44s. Rate: 7.1 symbols/min [2025-10-16T22:08:19.892947] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:08:19.912296] [DEBUG] [LOCAL ] USNA: Loaded 17949 existing records from primary storage. [2025-10-16T22:08:19.912529] [INFO ] [MAIN ] USNA: Loaded 17949 existing records. [2025-10-16T22:08:19.947965] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-10-16T22:08:20.092755] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:08:20.092957] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-16T22:08:20.093002] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-16T22:08:20.093158] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-16T22:08:20.093195] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-16T22:08:20.444106] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:08:20.742841] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-10-16T22:08:21.287729] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-16T22:08:21.542814] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-16T22:08:21.684596] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T22:08:21.727405] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T22:08:22.342788] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-16T22:08:22.633040] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T22:08:23.142821] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-16T22:08:23.928740] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T22:08:23.942770] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-16T22:08:24.742799] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-16T22:08:25.124455] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-16T22:08:25.542811] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-16T22:08:25.597159] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T22:08:25.812753] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T22:08:26.342823] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-16T22:08:27.142784] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-16T22:08:27.297307] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T22:08:27.352956] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T22:08:27.942782] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-16T22:08:28.251326] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T22:08:28.742894] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-16T22:08:29.457414] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T22:08:29.542840] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-16T22:08:29.774021] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T22:08:30.342798] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-16T22:08:30.699219] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-16T22:08:31.142817] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-16T22:08:31.942784] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-16T22:08:32.314521] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-16T22:08:32.340143] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-16T22:08:32.742843] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-16T22:08:33.076695] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T22:08:33.542830] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-16T22:08:33.927941] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-16T22:08:34.342865] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-16T22:08:34.518346] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T22:08:34.521297] [INFO ] [REMOTE ] USAC: Full fetch complete (35167 records). [2025-10-16T22:08:34.521440] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-16T22:08:34.901415] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-16T22:08:34.901490] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-16T22:08:34.902362] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-16T22:08:34.902427] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-16T22:08:34.903224] [DEBUG] [LOCAL ] USAC: Trimmed 35167 records to 21905 (keeping 200 days of data) [2025-10-16T22:08:35.034581] [DEBUG] [LOCAL ] USAC: Primary data saved (21905 records). [2025-10-16T22:08:35.034732] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-16T22:08:35.034843] [INFO ] [MAIN ] Update Progress: 2194/2369 symbols completed. USAC took 34.8s. Estimated remaining: 24m 37s. Rate: 7.1 symbols/min [2025-10-16T22:08:35.147941] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-16T22:08:35.210459] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:08:35.228906] [DEBUG] [LOCAL ] USPH: Loaded 17107 existing records from primary storage. [2025-10-16T22:08:35.229270] [INFO ] [MAIN ] USPH: Loaded 17107 existing records. [2025-10-16T22:08:35.380909] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T22:08:35.444171] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:08:35.444471] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-16T22:08:35.444523] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-16T22:08:35.444964] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-16T22:08:35.445219] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-16T22:08:35.811161] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:08:35.942811] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-10-16T22:08:36.742849] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-16T22:08:36.942233] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-16T22:08:36.976586] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T22:08:37.542866] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-16T22:08:38.342857] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-16T22:08:38.617257] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T22:08:39.142872] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-16T22:08:39.287115] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T22:08:39.319430] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-16T22:08:39.942883] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-16T22:08:40.742851] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-16T22:08:41.053803] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-16T22:08:41.138912] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T22:08:41.542834] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-16T22:08:41.645900] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-16T22:08:42.342836] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-16T22:08:43.142791] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-16T22:08:43.209716] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T22:08:43.458389] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T22:08:43.838512] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T22:08:43.845478] [INFO ] [REMOTE ] USB: Full fetch complete (77867 records). [2025-10-16T22:08:43.845589] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-16T22:08:43.948871] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-16T22:08:44.256315] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-16T22:08:44.256395] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-16T22:08:44.257741] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-16T22:08:44.257808] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-16T22:08:44.259363] [DEBUG] [LOCAL ] USB: Trimmed 77867 records to 54078 (keeping 200 days of data) [2025-10-16T22:08:44.592906] [DEBUG] [LOCAL ] USB: Primary data saved (54078 records). [2025-10-16T22:08:44.593031] [INFO ] [MAIN ] USB: Full history saved. [2025-10-16T22:08:44.593109] [INFO ] [MAIN ] Update Progress: 2195/2369 symbols completed. USB took 38.7s. Estimated remaining: 24m 28s. Rate: 7.1 symbols/min [2025-10-16T22:08:44.748804] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-16T22:08:44.770611] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:08:44.800796] [DEBUG] [LOCAL ] UTF: Loaded 30808 existing records from primary storage. [2025-10-16T22:08:44.801076] [INFO ] [MAIN ] UTF: Loaded 30808 existing records. [2025-10-16T22:08:44.930668] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T22:08:44.990056] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:08:44.990315] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-16T22:08:44.990373] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-16T22:08:44.990621] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-16T22:08:44.990727] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-16T22:08:45.363672] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:08:45.542864] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-10-16T22:08:46.330235] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T22:08:46.342779] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-16T22:08:46.385903] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T22:08:47.142885] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-16T22:08:47.948026] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-16T22:08:47.963971] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T22:08:48.449068] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T22:08:48.742874] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-16T22:08:48.906777] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T22:08:49.542794] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-16T22:08:50.349682] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-16T22:08:50.354279] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T22:08:50.361617] [INFO ] [REMOTE ] USFD: Full fetch complete (74268 records). [2025-10-16T22:08:50.361888] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-16T22:08:50.535454] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-16T22:08:50.780626] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-16T22:08:50.780744] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-16T22:08:50.781910] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-16T22:08:50.781973] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-16T22:08:50.783453] [DEBUG] [LOCAL ] USFD: Trimmed 74268 records to 51565 (keeping 200 days of data) [2025-10-16T22:08:51.086966] [DEBUG] [LOCAL ] USFD: Primary data saved (51565 records). [2025-10-16T22:08:51.087121] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-16T22:08:51.087918] [INFO ] [MAIN ] Update Progress: 2196/2369 symbols completed. USFD took 32.9s. Estimated remaining: 24m 20s. Rate: 7.1 symbols/min [2025-10-16T22:08:51.151406] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-16T22:08:51.269426] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:08:51.310315] [DEBUG] [LOCAL ] UTI: Loaded 40492 existing records from primary storage. [2025-10-16T22:08:51.310728] [INFO ] [MAIN ] UTI: Loaded 40492 existing records. [2025-10-16T22:08:51.496073] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-16T22:08:51.499593] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:08:51.503100] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-16T22:08:51.503244] [INFO ] [REMOTE ] USNA: Full fetch complete (26937 records). [2025-10-16T22:08:51.503332] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-16T22:08:51.503515] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-16T22:08:51.503853] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-16T22:08:51.535478] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-16T22:08:51.956887] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-16T22:08:52.204963] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:08:52.253373] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-16T22:08:52.253524] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-16T22:08:52.254255] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-16T22:08:52.254427] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-16T22:08:52.266571] [DEBUG] [LOCAL ] USNA: Trimmed 26937 records to 18138 (keeping 200 days of data) [2025-10-16T22:08:52.266440] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T22:08:52.376568] [DEBUG] [LOCAL ] USNA: Primary data saved (18138 records). [2025-10-16T22:08:52.376744] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-16T22:08:52.376837] [INFO ] [MAIN ] Update Progress: 2197/2369 symbols completed. USNA took 32.7s. Estimated remaining: 24m 11s. Rate: 7.1 symbols/min [2025-10-16T22:08:52.742812] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-10-16T22:08:53.263027] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T22:08:53.542826] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-16T22:08:54.187034] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T22:08:54.342848] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-16T22:08:54.485681] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T22:08:55.142827] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-16T22:08:55.668519] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T22:08:55.942834] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-16T22:08:56.427291] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-16T22:08:56.742830] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-16T22:08:57.007129] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T22:08:57.542867] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-16T22:08:58.219529] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T22:08:58.342858] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-16T22:08:58.889052] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T22:08:59.142887] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-16T22:08:59.453092] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T22:08:59.942858] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-16T22:09:00.489374] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T22:09:00.742850] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-16T22:09:01.499389] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T22:09:01.542799] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-16T22:09:02.060822] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T22:09:02.242153] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-16T22:09:02.342902] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-16T22:09:03.142844] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-16T22:09:03.412458] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T22:09:03.942869] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-16T22:09:04.739059] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-16T22:09:04.749075] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-16T22:09:04.943672] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T22:09:04.946637] [INFO ] [REMOTE ] USPH: Full fetch complete (22972 records). [2025-10-16T22:09:04.946739] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-16T22:09:05.307513] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-16T22:09:05.307593] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-16T22:09:05.308174] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-16T22:09:05.308259] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-16T22:09:05.308891] [DEBUG] [LOCAL ] USPH: Trimmed 22972 records to 17259 (keeping 200 days of data) [2025-10-16T22:09:05.419872] [DEBUG] [LOCAL ] USPH: Primary data saved (17259 records). [2025-10-16T22:09:05.420045] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-16T22:09:05.420153] [INFO ] [MAIN ] Update Progress: 2198/2369 symbols completed. USPH took 30.4s. Estimated remaining: 24m 3s. Rate: 7.1 symbols/min [2025-10-16T22:09:05.542872] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-16T22:09:05.974589] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-16T22:09:06.342861] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-16T22:09:07.123754] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T22:09:07.142835] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-10-16T22:09:07.545089] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T22:09:07.942894] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-16T22:09:08.351557] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T22:09:08.742852] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-10-16T22:09:09.612520] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T22:09:09.620936] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-16T22:09:10.269236] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T22:09:10.342847] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-10-16T22:09:11.342591] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T22:09:11.348924] [INFO ] [REMOTE ] UTF: Full fetch complete (43478 records). [2025-10-16T22:09:11.349061] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-16T22:09:11.753511] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-16T22:09:11.753639] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-16T22:09:11.754577] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-16T22:09:11.754669] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-16T22:09:11.755866] [DEBUG] [LOCAL ] UTF: Trimmed 43478 records to 31127 (keeping 200 days of data) [2025-10-16T22:09:11.973923] [DEBUG] [LOCAL ] UTF: Primary data saved (31127 records). [2025-10-16T22:09:11.974778] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-16T22:09:11.975840] [INFO ] [MAIN ] Update Progress: 2199/2369 symbols completed. UTF took 27.4s. Estimated remaining: 23m 54s. Rate: 7.1 symbols/min [2025-10-16T22:09:11.975711] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T22:09:11.985497] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-10-16T22:09:13.467276] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T22:09:13.476077] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-10. [2025-10-16T22:09:14.911164] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T22:09:14.916709] [INFO ] [REMOTE ] UTI: Full fetch complete (58688 records). [2025-10-16T22:09:14.916874] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-16T22:09:15.314585] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-16T22:09:15.314685] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-16T22:09:15.315852] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-16T22:09:15.315917] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-16T22:09:15.318926] [DEBUG] [LOCAL ] UTI: Trimmed 58688 records to 40786 (keeping 200 days of data) [2025-10-16T22:09:15.556213] [DEBUG] [LOCAL ] UTI: Primary data saved (40786 records). [2025-10-16T22:09:15.556378] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-16T22:09:15.556518] [INFO ] [MAIN ] Update Progress: 2200/2369 symbols completed. UTI took 24.5s. Estimated remaining: 23m 45s. Rate: 7.1 symbols/min [2025-10-16T22:09:16.134921] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:09:16.177557] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:09:16.233632] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:09:16.263821] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:09:16.302404] [DEBUG] [LOCAL ] UTL: Loaded 11800 existing records from primary storage. [2025-10-16T22:09:16.311860] [INFO ] [MAIN ] UTL: Loaded 11800 existing records. [2025-10-16T22:09:16.311394] [DEBUG] [LOCAL ] UVV: Loaded 22766 existing records from primary storage. [2025-10-16T22:09:16.302089] [DEBUG] [LOCAL ] UVE: Loaded 22014 existing records from primary storage. [2025-10-16T22:09:16.312280] [INFO ] [MAIN ] UVV: Loaded 22766 existing records. [2025-10-16T22:09:16.335041] [INFO ] [MAIN ] UVE: Loaded 22014 existing records. [2025-10-16T22:09:16.662870] [DEBUG] [LOCAL ] UTZ: Loaded 44602 existing records from primary storage. [2025-10-16T22:09:16.700850] [INFO ] [MAIN ] UTZ: Loaded 44602 existing records. [2025-10-16T22:09:16.812153] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:09:16.830821] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:09:16.882689] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-16T22:09:16.890759] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-16T22:09:16.916706] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:09:16.912419] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-16T22:09:16.939305] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-16T22:09:16.954930] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-16T22:09:16.955021] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-16T22:09:16.965449] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-16T22:09:16.965420] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-16T22:09:16.975996] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-16T22:09:16.979168] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-16T22:09:16.989810] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-16T22:09:17.000563] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-16T22:09:17.281354] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:09:17.345064] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-16T22:09:17.419265] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-16T22:09:17.572673] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-16T22:09:17.657047] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-16T22:09:18.140218] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:09:18.176908] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-10-16T22:09:18.305844] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:09:18.329762] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:09:18.330290] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-10-16T22:09:18.366076] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-10-16T22:09:18.569260] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:09:18.569586] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-10-16T22:09:19.051385] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T22:09:19.053837] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-16T22:09:19.364413] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T22:09:19.368049] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-16T22:09:19.473936] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T22:09:19.477761] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-16T22:09:19.610074] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T22:09:19.612499] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-16T22:09:19.951196] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T22:09:19.958586] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-16T22:09:20.351366] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T22:09:20.355357] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-16T22:09:20.506707] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T22:09:20.519073] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T22:09:20.742844] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-16T22:09:21.093364] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T22:09:21.450946] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T22:09:21.542871] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-16T22:09:21.727829] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T22:09:22.342920] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-16T22:09:22.836668] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T22:09:22.850909] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-16T22:09:23.142867] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-16T22:09:23.942828] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-16T22:09:23.954987] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-16T22:09:24.742818] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-16T22:09:25.542840] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-16T22:09:25.597954] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T22:09:25.780430] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T22:09:26.342850] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-16T22:09:26.401806] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T22:09:27.142816] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-16T22:09:27.942796] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-16T22:09:27.960367] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-16T22:09:28.047929] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T22:09:28.742788] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-16T22:09:29.115459] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T22:09:29.542807] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-16T22:09:29.646756] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-16T22:09:30.352985] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-16T22:09:30.356245] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-16T22:09:31.142842] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-16T22:09:31.419924] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T22:09:31.942789] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-16T22:09:32.343129] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-16T22:09:32.585397] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-16T22:09:32.742811] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-16T22:09:33.542820] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-16T22:09:33.664765] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T22:09:33.667390] [INFO ] [REMOTE ] UTL: Full fetch complete (15760 records). [2025-10-16T22:09:33.667474] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-16T22:09:34.055481] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-16T22:09:34.055615] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-16T22:09:34.056297] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-16T22:09:34.056353] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-16T22:09:34.057066] [DEBUG] [LOCAL ] UTL: Trimmed 15760 records to 11917 (keeping 200 days of data) [2025-10-16T22:09:34.135742] [DEBUG] [LOCAL ] UTL: Primary data saved (11917 records). [2025-10-16T22:09:34.135941] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-16T22:09:34.136042] [INFO ] [MAIN ] Update Progress: 2201/2369 symbols completed. UTL took 18.6s. Estimated remaining: 23m 37s. Rate: 7.1 symbols/min [2025-10-16T22:09:34.306882] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:09:34.345170] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-16T22:09:34.368140] [DEBUG] [LOCAL ] UWMC: Loaded 52955 existing records from primary storage. [2025-10-16T22:09:34.368605] [INFO ] [MAIN ] UWMC: Loaded 52955 existing records. [2025-10-16T22:09:34.545592] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:09:34.545962] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-16T22:09:34.546018] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-16T22:09:34.546267] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-16T22:09:34.546310] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-16T22:09:34.876223] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T22:09:34.947120] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:09:35.142818] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-16T22:09:35.849705] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T22:09:35.942826] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-10-16T22:09:36.307513] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-16T22:09:36.742820] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-16T22:09:37.542799] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-16T22:09:37.811532] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T22:09:37.963768] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T22:09:38.342906] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-16T22:09:39.034664] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T22:09:39.142820] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-16T22:09:39.627243] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T22:09:39.942820] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-16T22:09:40.551367] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T22:09:40.742803] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-16T22:09:41.212335] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-16T22:09:41.448730] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T22:09:41.542779] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-16T22:09:42.342832] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-16T22:09:42.899072] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T22:09:43.142855] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-16T22:09:43.407424] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T22:09:43.942815] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-10-16T22:09:44.559693] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T22:09:44.742799] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-16T22:09:44.951477] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T22:09:45.542807] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-10-16T22:09:45.803685] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T22:09:46.342843] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-16T22:09:46.622518] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T22:09:47.142831] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-16T22:09:47.942836] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-10. [2025-10-16T22:09:48.031231] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T22:09:48.301223] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T22:09:48.574267] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-16T22:09:48.578263] [INFO ] [REMOTE ] UVE: Full fetch complete (30276 records). [2025-10-16T22:09:48.578375] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-16T22:09:48.745176] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-16T22:09:48.978581] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-16T22:09:48.978706] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-16T22:09:48.979916] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-16T22:09:48.979981] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-16T22:09:48.980936] [DEBUG] [LOCAL ] UVE: Trimmed 30276 records to 22150 (keeping 200 days of data) [2025-10-16T22:09:49.122956] [DEBUG] [LOCAL ] UVE: Primary data saved (22150 records). [2025-10-16T22:09:49.123128] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-16T22:09:49.123222] [INFO ] [MAIN ] Update Progress: 2202/2369 symbols completed. UVE took 33.6s. Estimated remaining: 23m 30s. Rate: 7.1 symbols/min [2025-10-16T22:09:49.296362] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:09:49.305977] [DEBUG] [LOCAL ] UZD: Loaded 6128 existing records from primary storage. [2025-10-16T22:09:49.306224] [INFO ] [MAIN ] UZD: Loaded 6128 existing records. [2025-10-16T22:09:49.490668] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:09:49.491075] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-16T22:09:49.491172] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-16T22:09:49.491442] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-16T22:09:49.491501] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-16T22:09:49.555246] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-16T22:09:49.866146] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:09:50.342804] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-16T22:09:50.637449] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-16T22:09:50.640590] [INFO ] [REMOTE ] UVV: Full fetch complete (30134 records). [2025-10-16T22:09:50.640713] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-16T22:09:51.028869] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-16T22:09:51.029083] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-16T22:09:51.029842] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-16T22:09:51.029927] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-16T22:09:51.031022] [DEBUG] [LOCAL ] UVV: Trimmed 30134 records to 22878 (keeping 200 days of data) [2025-10-16T22:09:51.151862] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-10-16T22:09:51.174507] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-16T22:09:51.224556] [DEBUG] [LOCAL ] UVV: Primary data saved (22878 records). [2025-10-16T22:09:51.225191] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-16T22:09:51.225316] [INFO ] [MAIN ] Update Progress: 2203/2369 symbols completed. UVV took 35.7s. Estimated remaining: 23m 21s. Rate: 7.1 symbols/min [2025-10-16T22:09:51.393886] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:09:51.405163] [DEBUG] [LOCAL ] UZE: Loaded 7273 existing records from primary storage. [2025-10-16T22:09:51.405418] [INFO ] [MAIN ] UZE: Loaded 7273 existing records. [2025-10-16T22:09:51.533889] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T22:09:51.587791] [INFO ] [REMOTE ] UTZ: Full fetch complete (64707 records). [2025-10-16T22:09:51.605554] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-16T22:09:51.609396] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:09:51.685027] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-16T22:09:51.656527] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-16T22:09:51.697338] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-16T22:09:51.711379] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-16T22:09:51.728107] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-16T22:09:51.955143] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-16T22:09:52.370973] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-16T22:09:52.388855] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-16T22:09:52.400365] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-16T22:09:52.406866] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-16T22:09:52.429998] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:09:52.430878] [DEBUG] [LOCAL ] UTZ: Trimmed 64707 records to 44886 (keeping 200 days of data) [2025-10-16T22:09:52.698572] [DEBUG] [LOCAL ] UTZ: Primary data saved (44886 records). [2025-10-16T22:09:52.698723] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-16T22:09:52.698813] [INFO ] [MAIN ] Update Progress: 2204/2369 symbols completed. UTZ took 37.1s. Estimated remaining: 23m 12s. Rate: 7.1 symbols/min [2025-10-16T22:09:52.751750] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-10-16T22:09:52.869533] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:09:52.878259] [DEBUG] [LOCAL ] UZF: Loaded 6082 existing records from primary storage. [2025-10-16T22:09:52.878476] [INFO ] [MAIN ] UZF: Loaded 6082 existing records. [2025-10-16T22:09:53.053280] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:09:53.053435] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-16T22:09:53.053483] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-16T22:09:53.053614] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-10-16T22:09:53.053680] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-16T22:09:53.408432] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:09:53.542774] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-10-16T22:09:53.578534] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T22:09:53.995374] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-16T22:09:54.313873] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T22:09:54.342770] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-16T22:09:54.978464] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-16T22:09:55.142788] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-16T22:09:55.776806] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-16T22:09:55.942798] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-16T22:09:56.742843] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-16T22:09:56.754718] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-16T22:09:57.472708] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-16T22:09:57.542842] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-16T22:09:58.144074] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T22:09:58.342841] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-16T22:09:59.142831] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-16T22:09:59.836613] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-16T22:09:59.942844] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-16T22:10:00.153357] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T22:10:00.742851] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-16T22:10:00.764914] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-16T22:10:01.542793] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-16T22:10:01.648564] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T22:10:02.239280] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T22:10:02.342825] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-16T22:10:02.991497] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-16T22:10:03.142897] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-16T22:10:03.942875] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-16T22:10:04.687747] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T22:10:04.742787] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-16T22:10:04.878756] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T22:10:05.373822] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T22:10:05.542855] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-16T22:10:06.031693] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T22:10:06.342831] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-16T22:10:07.142806] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-16T22:10:07.712882] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T22:10:07.942800] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-16T22:10:08.673602] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-16T22:10:08.742801] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-16T22:10:08.809763] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-16T22:10:09.542843] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-16T22:10:10.145946] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T22:10:10.342874] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-16T22:10:10.497789] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T22:10:11.143445] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-16T22:10:11.144332] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T22:10:11.862315] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-16T22:10:11.942815] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-16T22:10:12.742813] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-16T22:10:13.335754] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-16T22:10:13.542872] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-16T22:10:13.659010] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T22:10:13.898307] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-16T22:10:13.899798] [INFO ] [REMOTE ] UZD: Full fetch complete (9130 records). [2025-10-16T22:10:13.899942] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-16T22:10:14.326386] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-16T22:10:14.326481] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-16T22:10:14.326759] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-16T22:10:14.326822] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-16T22:10:14.327387] [DEBUG] [LOCAL ] UZD: Trimmed 9130 records to 6131 (keeping 200 days of data) [2025-10-16T22:10:14.343305] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-16T22:10:14.367083] [DEBUG] [LOCAL ] UZD: Primary data saved (6131 records). [2025-10-16T22:10:14.367225] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-16T22:10:14.367313] [INFO ] [MAIN ] Update Progress: 2205/2369 symbols completed. UZD took 25.2s. Estimated remaining: 23m 4s. Rate: 7.1 symbols/min [2025-10-16T22:10:14.540607] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:10:14.592410] [DEBUG] [LOCAL ] V: Loaded 53753 existing records from primary storage. [2025-10-16T22:10:14.592856] [INFO ] [MAIN ] V: Loaded 53753 existing records. [2025-10-16T22:10:14.771113] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:10:14.771332] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-16T22:10:14.771383] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-16T22:10:14.771600] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-16T22:10:14.771639] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-16T22:10:14.877871] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-16T22:10:14.890759] [INFO ] [REMOTE ] UZF: Full fetch complete (8611 records). [2025-10-16T22:10:14.919676] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-16T22:10:14.941140] [FATAL] [VALIDATOR ] UZF: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T22:10:14.958984] [FATAL] [MAIN ] UZF: Fetched primary data is invalid. Refusing to save it. [2025-10-16T22:10:15.026602] [WARN ] [MAIN ] UZF: Deleting existing primary and derivative data due to validation failure. [2025-10-16T22:10:15.043730] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-16T22:10:15.065262] [DEBUG] [LOCAL ] UZF: No primary data file found to delete. [2025-10-16T22:10:15.065372] [INFO ] [LOCAL ] UZF: Starting deletion of derivative data. [2025-10-16T22:10:15.071120] [DEBUG] [LOCAL ] UZF: Deleted derivative data file. [2025-10-16T22:10:15.071267] [INFO ] [MAIN ] Update Progress: 2206/2369 symbols completed. UZF took 22.4s. Estimated remaining: 22m 55s. Rate: 7.1 symbols/min [2025-10-16T22:10:15.158128] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-16T22:10:15.249391] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:10:15.316113] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:10:15.348362] [DEBUG] [LOCAL ] VAC: Loaded 34088 existing records from primary storage. [2025-10-16T22:10:15.348711] [INFO ] [MAIN ] VAC: Loaded 34088 existing records. [2025-10-16T22:10:15.521280] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:10:15.521483] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-16T22:10:15.521530] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-16T22:10:15.521745] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-16T22:10:15.521820] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-16T22:10:15.867215] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:10:15.942795] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-10-16T22:10:16.742843] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-16T22:10:16.998599] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T22:10:17.007592] [INFO ] [REMOTE ] UWMC: Full fetch complete (75893 records). [2025-10-16T22:10:17.008839] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-16T22:10:17.142849] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T22:10:17.151831] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-16T22:10:17.436015] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-16T22:10:17.436096] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-16T22:10:17.437311] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-16T22:10:17.437374] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-16T22:10:17.438858] [DEBUG] [LOCAL ] UWMC: Trimmed 75893 records to 53342 (keeping 200 days of data) [2025-10-16T22:10:17.544798] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-16T22:10:17.750593] [DEBUG] [LOCAL ] UWMC: Primary data saved (53342 records). [2025-10-16T22:10:17.750754] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-16T22:10:17.751270] [INFO ] [MAIN ] Update Progress: 2207/2369 symbols completed. UWMC took 43.6s. Estimated remaining: 22m 46s. Rate: 7.1 symbols/min [2025-10-16T22:10:17.918712] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:10:17.964238] [DEBUG] [LOCAL ] VAL: Loaded 50174 existing records from primary storage. [2025-10-16T22:10:17.964533] [INFO ] [MAIN ] VAL: Loaded 50174 existing records. [2025-10-16T22:10:18.161287] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:10:18.161632] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-16T22:10:18.161722] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-16T22:10:18.161930] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-16T22:10:18.161986] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-16T22:10:18.340474] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-16T22:10:18.354724] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-10-16T22:10:18.523231] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:10:19.142806] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-10-16T22:10:19.942846] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-16T22:10:20.663247] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-16T22:10:20.716438] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T22:10:20.742793] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-16T22:10:21.263222] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T22:10:21.542822] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-16T22:10:22.342837] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-16T22:10:22.398124] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T22:10:22.853483] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T22:10:23.133954] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T22:10:23.142771] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-16T22:10:23.942824] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-16T22:10:24.742798] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-16T22:10:25.249061] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-16T22:10:25.320788] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T22:10:25.542913] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-16T22:10:26.326359] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T22:10:26.342757] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-16T22:10:26.359869] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T22:10:27.142822] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-16T22:10:27.942851] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-16T22:10:28.070750] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T22:10:28.742824] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-16T22:10:29.258553] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-16T22:10:29.467320] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T22:10:29.542797] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-16T22:10:30.347948] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-16T22:10:30.362859] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T22:10:31.142856] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-16T22:10:31.798691] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-16T22:10:31.816444] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-16T22:10:31.916135] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T22:10:31.942780] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-16T22:10:32.742824] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-16T22:10:33.542827] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-16T22:10:33.719548] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T22:10:34.114722] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T22:10:34.342803] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-16T22:10:35.142814] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-16T22:10:35.920501] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-16T22:10:35.942770] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-16T22:10:36.148587] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T22:10:36.230986] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-16T22:10:36.742818] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-16T22:10:37.542813] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-16T22:10:37.962454] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-16T22:10:38.342783] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-16T22:10:38.444524] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T22:10:38.885188] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T22:10:39.142821] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-16T22:10:39.744109] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T22:10:39.942847] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-16T22:10:40.746900] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-16T22:10:40.756737] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-16T22:10:41.288678] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T22:10:41.542859] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-16T22:10:41.689578] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-16T22:10:42.342908] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-16T22:10:43.142854] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-16T22:10:43.276280] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T22:10:43.665259] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T22:10:43.669354] [INFO ] [REMOTE ] VAC: Full fetch complete (48792 records). [2025-10-16T22:10:43.669439] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-16T22:10:43.952767] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-16T22:10:44.045363] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-16T22:10:44.045441] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-16T22:10:44.046410] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-16T22:10:44.046471] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-16T22:10:44.047470] [DEBUG] [LOCAL ] VAC: Trimmed 48792 records to 34301 (keeping 200 days of data) [2025-10-16T22:10:44.252319] [DEBUG] [LOCAL ] VAC: Primary data saved (34301 records). [2025-10-16T22:10:44.252449] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-16T22:10:44.252528] [INFO ] [MAIN ] Update Progress: 2208/2369 symbols completed. VAC took 29.2s. Estimated remaining: 22m 39s. Rate: 7.1 symbols/min [2025-10-16T22:10:44.433528] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:10:44.489110] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-16T22:10:44.489413] [INFO ] [MAIN ] VALE: Loaded 53693 existing records. [2025-10-16T22:10:44.662056] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:10:44.662226] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-16T22:10:44.662271] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-16T22:10:44.662450] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-16T22:10:44.662487] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-16T22:10:44.749892] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-16T22:10:45.010836] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:10:45.406566] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-16T22:10:45.551893] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-10-16T22:10:45.562742] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-16T22:10:45.718176] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T22:10:46.342832] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-16T22:10:47.142801] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-16T22:10:47.605489] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-16T22:10:47.606962] [INFO ] [REMOTE ] UZE: Full fetch complete (9938 records). [2025-10-16T22:10:47.607034] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-16T22:10:47.736893] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-16T22:10:47.946349] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-16T22:10:48.025836] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-16T22:10:48.025910] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-16T22:10:48.026146] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-16T22:10:48.026229] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-16T22:10:48.026791] [DEBUG] [LOCAL ] UZE: Trimmed 9938 records to 7288 (keeping 200 days of data) [2025-10-16T22:10:48.070722] [DEBUG] [LOCAL ] UZE: Primary data saved (7288 records). [2025-10-16T22:10:48.070818] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-16T22:10:48.070893] [INFO ] [MAIN ] Update Progress: 2209/2369 symbols completed. UZE took 56.8s. Estimated remaining: 22m 30s. Rate: 7.1 symbols/min [2025-10-16T22:10:48.244751] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:10:48.253239] [DEBUG] [LOCAL ] VATE: Loaded 5215 existing records from primary storage. [2025-10-16T22:10:48.253512] [INFO ] [MAIN ] VATE: Loaded 5215 existing records. [2025-10-16T22:10:48.425335] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-16T22:10:48.477994] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:10:48.478222] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-16T22:10:48.478295] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-16T22:10:48.478461] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-16T22:10:48.478519] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-16T22:10:48.746593] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-16T22:10:48.824683] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:10:49.542824] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-10-16T22:10:49.614680] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T22:10:49.620873] [INFO ] [REMOTE ] VAL: Full fetch complete (73192 records). [2025-10-16T22:10:49.620986] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-16T22:10:50.026494] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-16T22:10:50.026575] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-16T22:10:50.027748] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-16T22:10:50.027811] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-16T22:10:50.029194] [DEBUG] [LOCAL ] VAL: Trimmed 73192 records to 50523 (keeping 200 days of data) [2025-10-16T22:10:50.229948] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-16T22:10:50.323854] [DEBUG] [LOCAL ] VAL: Primary data saved (50523 records). [2025-10-16T22:10:50.323988] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-16T22:10:50.324561] [INFO ] [MAIN ] Update Progress: 2210/2369 symbols completed. VAL took 32.6s. Estimated remaining: 22m 22s. Rate: 7.1 symbols/min [2025-10-16T22:10:50.347975] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-16T22:10:50.499167] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:10:50.509970] [DEBUG] [LOCAL ] VBF: Loaded 7220 existing records from primary storage. [2025-10-16T22:10:50.510189] [INFO ] [MAIN ] VBF: Loaded 7220 existing records. [2025-10-16T22:10:50.694315] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:10:50.694528] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-16T22:10:50.694611] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-16T22:10:50.694806] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-16T22:10:50.694860] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-16T22:10:51.049033] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:10:51.142780] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-10-16T22:10:51.176506] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-16T22:10:51.611916] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T22:10:51.940715] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-16T22:10:51.942761] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-16T22:10:52.546276] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-16T22:10:52.742854] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-16T22:10:53.360833] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-16T22:10:53.368015] [INFO ] [REMOTE ] V: Full fetch complete (77928 records). [2025-10-16T22:10:53.368182] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-16T22:10:53.553468] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-16T22:10:53.768588] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-16T22:10:53.768697] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-16T22:10:53.769944] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-16T22:10:53.770014] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-16T22:10:53.771496] [DEBUG] [LOCAL ] V: Trimmed 77928 records to 54143 (keeping 200 days of data) [2025-10-16T22:10:54.102734] [DEBUG] [LOCAL ] V: Primary data saved (54143 records). [2025-10-16T22:10:54.102875] [INFO ] [MAIN ] V: Full history saved. [2025-10-16T22:10:54.102953] [INFO ] [MAIN ] Update Progress: 2211/2369 symbols completed. V took 39.7s. Estimated remaining: 22m 13s. Rate: 7.1 symbols/min [2025-10-16T22:10:54.275272] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:10:54.290006] [DEBUG] [LOCAL ] VCV: Loaded 13659 existing records from primary storage. [2025-10-16T22:10:54.290208] [INFO ] [MAIN ] VCV: Loaded 13659 existing records. [2025-10-16T22:10:54.356498] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-16T22:10:54.469207] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:10:54.469469] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-16T22:10:54.469535] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-16T22:10:54.469752] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-16T22:10:54.469843] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-16T22:10:54.558798] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T22:10:54.829888] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:10:55.142850] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-10-16T22:10:55.942879] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-16T22:10:56.205800] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T22:10:56.422457] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-16T22:10:56.466497] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-16T22:10:56.742808] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-16T22:10:57.522441] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-16T22:10:57.542790] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-16T22:10:58.240865] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-16T22:10:58.342825] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-16T22:10:58.992050] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-16T22:10:59.142852] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-16T22:10:59.929885] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T22:10:59.942761] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-16T22:11:00.686125] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T22:11:00.742835] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-16T22:11:01.517276] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-16T22:11:01.542824] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-16T22:11:02.338558] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T22:11:02.342848] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-16T22:11:03.142812] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-16T22:11:03.939546] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-16T22:11:03.942761] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-16T22:11:04.386217] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-16T22:11:04.671474] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T22:11:04.742809] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-16T22:11:05.540506] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T22:11:05.543186] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-16T22:11:06.275518] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T22:11:06.342822] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-16T22:11:07.117663] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-16T22:11:07.119693] [INFO ] [REMOTE ] VBF: Full fetch complete (10926 records). [2025-10-16T22:11:07.119766] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-16T22:11:07.149722] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-16T22:11:07.534206] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-16T22:11:07.534288] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-16T22:11:07.534604] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-16T22:11:07.534680] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-16T22:11:07.535164] [DEBUG] [LOCAL ] VBF: Trimmed 10926 records to 7296 (keeping 200 days of data) [2025-10-16T22:11:07.583894] [DEBUG] [LOCAL ] VBF: Primary data saved (7296 records). [2025-10-16T22:11:07.584040] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-16T22:11:07.584147] [INFO ] [MAIN ] Update Progress: 2212/2369 symbols completed. VBF took 17.3s. Estimated remaining: 22m 5s. Rate: 7.1 symbols/min [2025-10-16T22:11:07.789561] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:11:07.834900] [DEBUG] [LOCAL ] VEEV: Loaded 47309 existing records from primary storage. [2025-10-16T22:11:07.835208] [INFO ] [MAIN ] VEEV: Loaded 47309 existing records. [2025-10-16T22:11:07.918502] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-16T22:11:07.943251] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-16T22:11:08.022168] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:11:08.022430] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-16T22:11:08.022479] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-16T22:11:08.022726] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-16T22:11:08.022784] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-16T22:11:08.361714] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:11:08.742828] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-16T22:11:09.313893] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T22:11:09.542825] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-16T22:11:10.262175] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-16T22:11:10.278680] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-16T22:11:10.342794] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-16T22:11:11.142823] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-10-16T22:11:11.942811] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-16T22:11:12.311635] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T22:11:12.715160] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T22:11:12.742776] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-16T22:11:12.852888] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T22:11:13.540743] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-16T22:11:13.543676] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-16T22:11:14.170093] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-16T22:11:14.342849] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-16T22:11:14.887951] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-16T22:11:14.889198] [INFO ] [REMOTE ] VATE: Full fetch complete (10542 records). [2025-10-16T22:11:14.889267] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-16T22:11:15.147962] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-16T22:11:15.253184] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-16T22:11:15.253263] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-16T22:11:15.253541] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-16T22:11:15.253581] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-16T22:11:15.254063] [DEBUG] [LOCAL ] VATE: Trimmed 10542 records to 5231 (keeping 200 days of data) [2025-10-16T22:11:15.282918] [DEBUG] [LOCAL ] VATE: Primary data saved (5231 records). [2025-10-16T22:11:15.283017] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-16T22:11:15.283106] [INFO ] [MAIN ] Update Progress: 2213/2369 symbols completed. VATE took 27.2s. Estimated remaining: 21m 56s. Rate: 7.1 symbols/min [2025-10-16T22:11:15.450813] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:11:15.464385] [DEBUG] [LOCAL ] VEL: Loaded 12188 existing records from primary storage. [2025-10-16T22:11:15.464602] [INFO ] [MAIN ] VEL: Loaded 12188 existing records. [2025-10-16T22:11:15.642734] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:11:15.642991] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-16T22:11:15.643043] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-16T22:11:15.643291] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-16T22:11:15.643348] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-16T22:11:15.947989] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-16T22:11:16.046632] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:11:16.742853] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-10-16T22:11:16.933127] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-16T22:11:16.956788] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-16T22:11:17.474088] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-16T22:11:17.542808] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-16T22:11:18.342839] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-16T22:11:19.142850] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-16T22:11:19.228160] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-16T22:11:19.462520] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-16T22:11:19.942857] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-16T22:11:20.693483] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T22:11:20.693782] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T22:11:20.742763] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-16T22:11:21.542856] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-16T22:11:22.284222] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T22:11:22.342789] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-16T22:11:22.565422] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T22:11:23.032870] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-16T22:11:23.142789] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-16T22:11:23.942788] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-16T22:11:24.137214] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T22:11:24.742893] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-16T22:11:25.542828] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-16T22:11:25.703735] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T22:11:25.882434] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-16T22:11:26.342871] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-10-16T22:11:27.142833] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-16T22:11:27.300333] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-16T22:11:27.330771] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T22:11:27.939269] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T22:11:27.942757] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-16T22:11:28.742881] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-16T22:11:28.862398] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-16T22:11:29.542832] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-16T22:11:30.356545] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-10-16T22:11:30.358434] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T22:11:31.142827] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-16T22:11:31.320690] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T22:11:31.510783] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-16T22:11:31.942824] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-16T22:11:32.472882] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T22:11:32.742781] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-16T22:11:32.805095] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-16T22:11:33.542815] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-16T22:11:34.342785] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-16T22:11:34.463052] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T22:11:34.922569] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-16T22:11:35.142821] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-16T22:11:35.371245] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T22:11:35.942805] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-10. [2025-10-16T22:11:36.742868] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-16T22:11:36.858336] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T22:11:36.860000] [INFO ] [REMOTE ] VCV: Full fetch complete (18505 records). [2025-10-16T22:11:36.860075] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-16T22:11:37.176155] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-16T22:11:37.267319] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-16T22:11:37.267400] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-16T22:11:37.267817] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-16T22:11:37.267878] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-16T22:11:37.268496] [DEBUG] [LOCAL ] VCV: Trimmed 18505 records to 13732 (keeping 200 days of data) [2025-10-16T22:11:37.351602] [DEBUG] [LOCAL ] VCV: Primary data saved (13732 records). [2025-10-16T22:11:37.351777] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-16T22:11:37.351865] [INFO ] [MAIN ] Update Progress: 2214/2369 symbols completed. VCV took 43.2s. Estimated remaining: 21m 49s. Rate: 7.1 symbols/min [2025-10-16T22:11:37.528832] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T22:11:37.530614] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:11:37.542809] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-16T22:11:37.574388] [DEBUG] [LOCAL ] VET: Loaded 44112 existing records from primary storage. [2025-10-16T22:11:37.574755] [INFO ] [MAIN ] VET: Loaded 44112 existing records. [2025-10-16T22:11:37.752064] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:11:37.752290] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-16T22:11:37.752341] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-16T22:11:37.752543] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-16T22:11:37.752599] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-16T22:11:38.098626] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:11:38.342799] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-16T22:11:39.142840] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-16T22:11:39.324919] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T22:11:39.942789] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-16T22:11:40.017852] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T22:11:40.117818] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T22:11:40.742863] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-10-16T22:11:41.423375] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T22:11:41.429634] [INFO ] [REMOTE ] VEEV: Full fetch complete (68407 records). [2025-10-16T22:11:41.429784] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-16T22:11:41.548027] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-16T22:11:41.821860] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-16T22:11:41.821973] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-16T22:11:41.823209] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-16T22:11:41.823280] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-16T22:11:41.824746] [DEBUG] [LOCAL ] VEEV: Trimmed 68407 records to 47681 (keeping 200 days of data) [2025-10-16T22:11:42.117544] [DEBUG] [LOCAL ] VEEV: Primary data saved (47681 records). [2025-10-16T22:11:42.117719] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-16T22:11:42.118392] [INFO ] [MAIN ] Update Progress: 2215/2369 symbols completed. VEEV took 34.5s. Estimated remaining: 21m 40s. Rate: 7.1 symbols/min [2025-10-16T22:11:42.288298] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:11:42.314051] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T22:11:42.349793] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-16T22:11:42.377024] [DEBUG] [LOCAL ] VFC: Loaded 53605 existing records from primary storage. [2025-10-16T22:11:42.377419] [INFO ] [MAIN ] VFC: Loaded 53605 existing records. [2025-10-16T22:11:42.462090] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T22:11:42.492686] [INFO ] [REMOTE ] VEL: Full fetch complete (17202 records). [2025-10-16T22:11:42.498549] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-16T22:11:42.672572] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:11:42.675342] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-16T22:11:42.675766] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-16T22:11:42.696714] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-16T22:11:42.714244] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-16T22:11:43.183724] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-16T22:11:43.167319] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-16T22:11:43.212902] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-16T22:11:43.244275] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-16T22:11:43.248175] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-16T22:11:43.265144] [DEBUG] [LOCAL ] VEL: Trimmed 17202 records to 12291 (keeping 200 days of data) [2025-10-16T22:11:43.359303] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:11:43.403524] [DEBUG] [LOCAL ] VEL: Primary data saved (12291 records). [2025-10-16T22:11:43.403709] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-16T22:11:43.403825] [INFO ] [MAIN ] Update Progress: 2216/2369 symbols completed. VEL took 28.1s. Estimated remaining: 21m 31s. Rate: 7.1 symbols/min [2025-10-16T22:11:43.574812] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:11:43.575098] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-16T22:11:43.575196] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-16T22:11:43.575351] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-16T22:11:43.575394] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-16T22:11:43.575438] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-16T22:11:43.575472] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-16T22:11:43.954370] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-10-16T22:11:43.960196] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:11:43.997084] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T22:11:44.742791] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-16T22:11:45.177431] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-16T22:11:45.185215] [INFO ] [REMOTE ] VALE: Full fetch complete (77873 records). [2025-10-16T22:11:45.185351] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-16T22:11:45.542777] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-10-16T22:11:45.582766] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-16T22:11:45.582890] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-16T22:11:45.584156] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-16T22:11:45.584293] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-16T22:11:45.596267] [DEBUG] [LOCAL ] VALE: Trimmed 77873 records to 54083 (keeping 200 days of data) [2025-10-16T22:11:45.616998] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T22:11:45.833338] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T22:11:45.835270] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-10-16T22:11:45.835397] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T22:11:45.842726] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-10-16T22:11:45.853758] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T22:11:45.857013] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-16T22:11:45.881658] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-16T22:11:45.889618] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-16T22:11:45.892817] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T22:11:45.893264] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-16T22:11:45.902222] [INFO ] [MAIN ] Update Progress: 2217/2369 symbols completed. VG took 2.5s. Estimated remaining: 21m 22s. Rate: 7.1 symbols/min [2025-10-16T22:11:46.176749] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:11:46.193033] [DEBUG] [LOCAL ] VALE: Primary data saved (54083 records). [2025-10-16T22:11:46.193306] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-16T22:11:46.195720] [INFO ] [MAIN ] Update Progress: 2218/2369 symbols completed. VALE took 1m 2s. Estimated remaining: 21m 13s. Rate: 7.1 symbols/min [2025-10-16T22:11:46.277007] [DEBUG] [LOCAL ] VGI: Loaded 5204 existing records from primary storage. [2025-10-16T22:11:46.293945] [INFO ] [MAIN ] VGI: Loaded 5204 existing records. [2025-10-16T22:11:46.350196] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-16T22:11:46.522023] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:11:46.592567] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:11:46.592977] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-16T22:11:46.593034] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-16T22:11:46.593235] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-16T22:11:46.593294] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-16T22:11:46.717195] [DEBUG] [LOCAL ] VGM: Loaded 18563 existing records from primary storage. [2025-10-16T22:11:46.728724] [INFO ] [MAIN ] VGM: Loaded 18563 existing records. [2025-10-16T22:11:47.131982] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:11:47.142507] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-16T22:11:47.142594] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-16T22:11:47.161275] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-16T22:11:47.161468] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-16T22:11:47.161142] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-16T22:11:47.238522] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:11:47.573962] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:11:47.942872] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-10-16T22:11:48.238819] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-16T22:11:48.742853] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-16T22:11:48.836444] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T22:11:49.013596] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T22:11:49.542813] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-10-16T22:11:50.198929] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-16T22:11:50.342778] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-16T22:11:50.551608] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T22:11:50.758914] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-16T22:11:51.142816] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-16T22:11:51.942841] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-16T22:11:52.742907] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-16T22:11:53.074397] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-16T22:11:53.500810] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T22:11:53.542826] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-16T22:11:53.619868] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T22:11:54.139699] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T22:11:54.342850] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-16T22:11:55.142820] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-16T22:11:55.241956] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T22:11:55.942898] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-16T22:11:56.742882] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-16T22:11:56.784269] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T22:11:57.542822] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-16T22:11:57.887878] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-16T22:11:57.915745] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T22:11:58.342859] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-16T22:11:59.142856] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-16T22:11:59.193062] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T22:11:59.828765] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-16T22:11:59.942822] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-16T22:12:00.179248] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-16T22:12:00.742854] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-16T22:12:01.416974] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-16T22:12:01.454490] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T22:12:01.542854] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-16T22:12:02.129786] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-16T22:12:02.342835] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-16T22:12:03.142855] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-16T22:12:03.942837] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-16T22:12:03.996347] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-16T22:12:04.252782] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-16T22:12:04.742832] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-16T22:12:05.499315] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T22:12:05.542813] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-16T22:12:05.744097] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T22:12:06.342837] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-16T22:12:07.096378] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T22:12:07.142846] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-16T22:12:07.942859] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-16T22:12:08.286740] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-16T22:12:08.374730] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-16T22:12:08.389412] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-16T22:12:08.742859] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-16T22:12:09.542818] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-16T22:12:10.342816] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-16T22:12:10.661699] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-16T22:12:11.074199] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T22:12:11.084196] [INFO ] [REMOTE ] VET: Full fetch complete (64626 records). [2025-10-16T22:12:11.084367] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-16T22:12:11.084564] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-16T22:12:11.147887] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-16T22:12:11.476145] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-16T22:12:11.476255] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-16T22:12:11.477578] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-16T22:12:11.477663] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-16T22:12:11.479076] [DEBUG] [LOCAL ] VET: Trimmed 64626 records to 44441 (keeping 200 days of data) [2025-10-16T22:12:11.734802] [DEBUG] [LOCAL ] VET: Primary data saved (44441 records). [2025-10-16T22:12:11.734938] [INFO ] [MAIN ] VET: Full history saved. [2025-10-16T22:12:11.735017] [INFO ] [MAIN ] Update Progress: 2219/2369 symbols completed. VET took 34.4s. Estimated remaining: 21m 6s. Rate: 7.1 symbols/min [2025-10-16T22:12:11.909893] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:12:11.915079] [DEBUG] [LOCAL ] VHI: Loaded 2775 existing records from primary storage. [2025-10-16T22:12:11.915235] [INFO ] [MAIN ] VHI: Loaded 2775 existing records. [2025-10-16T22:12:11.946846] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-16T22:12:12.100702] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:12:12.101007] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-16T22:12:12.101064] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-16T22:12:12.101221] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-16T22:12:12.101276] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-16T22:12:12.366397] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T22:12:12.485924] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:12:12.742811] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-16T22:12:13.362632] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T22:12:13.542816] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-16T22:12:13.659004] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T22:12:14.301955] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-16T22:12:14.342838] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-16T22:12:15.142842] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-16T22:12:15.661671] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-16T22:12:15.662788] [INFO ] [REMOTE ] VGI: Full fetch complete (7656 records). [2025-10-16T22:12:15.662873] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-16T22:12:15.945516] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-16T22:12:16.041045] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-16T22:12:16.041119] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-16T22:12:16.041328] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-16T22:12:16.041370] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-16T22:12:16.041812] [DEBUG] [LOCAL ] VGI: Trimmed 7656 records to 5246 (keeping 200 days of data) [2025-10-16T22:12:16.074911] [DEBUG] [LOCAL ] VGI: Primary data saved (5246 records). [2025-10-16T22:12:16.075054] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-16T22:12:16.075136] [INFO ] [MAIN ] Update Progress: 2220/2369 symbols completed. VGI took 30.2s. Estimated remaining: 20m 57s. Rate: 7.1 symbols/min [2025-10-16T22:12:16.255325] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:12:16.255606] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-16T22:12:16.266795] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-16T22:12:16.275301] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-16T22:12:16.274466] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-16T22:12:16.281997] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-16T22:12:16.282614] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-16T22:12:16.282715] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-16T22:12:16.326865] [INFO ] [REMOTE ] VFC: Full fetch complete (77750 records). [2025-10-16T22:12:16.377565] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-16T22:12:16.763549] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-10-16T22:12:16.970630] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:12:17.100328] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-16T22:12:17.100530] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-16T22:12:17.107026] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-16T22:12:17.107110] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-16T22:12:17.114194] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T22:12:17.119016] [DEBUG] [LOCAL ] VFC: Trimmed 77750 records to 53995 (keeping 200 days of data) [2025-10-16T22:12:17.229387] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-16T22:12:17.451835] [DEBUG] [LOCAL ] VFC: Primary data saved (53995 records). [2025-10-16T22:12:17.451969] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-16T22:12:17.452590] [INFO ] [MAIN ] Update Progress: 2221/2369 symbols completed. VFC took 35.3s. Estimated remaining: 20m 48s. Rate: 7.1 symbols/min [2025-10-16T22:12:17.551156] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-10-16T22:12:17.624439] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:12:17.676288] [DEBUG] [LOCAL ] VICI: Loaded 53653 existing records from primary storage. [2025-10-16T22:12:17.676673] [INFO ] [MAIN ] VICI: Loaded 53653 existing records. [2025-10-16T22:12:17.849762] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T22:12:17.849515] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:12:17.850277] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-10-16T22:12:17.850692] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T22:12:17.850461] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-16T22:12:17.850937] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-16T22:12:17.850846] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-16T22:12:17.851129] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T22:12:17.851202] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-16T22:12:17.851272] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-16T22:12:17.851330] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-16T22:12:17.851375] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-16T22:12:17.851426] [INFO ] [MAIN ] Update Progress: 2222/2369 symbols completed. VIA took 1.8s. Estimated remaining: 20m 39s. Rate: 7.1 symbols/min [2025-10-16T22:12:17.887162] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-16T22:12:17.928490] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-16T22:12:18.161720] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:12:18.343086] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-16T22:12:18.439385] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:12:18.459173] [DEBUG] [LOCAL ] VIK: Loaded 52471 existing records from primary storage. [2025-10-16T22:12:18.459479] [INFO ] [MAIN ] VIK: Loaded 52471 existing records. [2025-10-16T22:12:18.638517] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:12:18.638737] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-16T22:12:18.638790] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-16T22:12:18.638975] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-16T22:12:18.639030] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-16T22:12:18.997295] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:12:19.028353] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T22:12:19.142805] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-10-16T22:12:19.942867] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-10-16T22:12:20.742792] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-16T22:12:20.912950] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-16T22:12:20.956218] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T22:12:21.235355] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-16T22:12:21.542869] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-16T22:12:22.342845] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-16T22:12:22.605575] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T22:12:23.099248] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T22:12:23.142780] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-16T22:12:23.942831] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-16T22:12:24.038437] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T22:12:24.041486] [INFO ] [REMOTE ] VGM: Full fetch complete (25896 records). [2025-10-16T22:12:24.041621] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-16T22:12:24.421432] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-16T22:12:24.421511] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-16T22:12:24.422064] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-16T22:12:24.422126] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-16T22:12:24.422806] [DEBUG] [LOCAL ] VGM: Trimmed 25896 records to 18717 (keeping 200 days of data) [2025-10-16T22:12:24.538787] [DEBUG] [LOCAL ] VGM: Primary data saved (18717 records). [2025-10-16T22:12:24.538942] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-16T22:12:24.539022] [INFO ] [MAIN ] Update Progress: 2223/2369 symbols completed. VGM took 38.3s. Estimated remaining: 20m 31s. Rate: 7.1 symbols/min [2025-10-16T22:12:24.727170] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:12:24.750782] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-16T22:12:24.756700] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T22:12:24.811736] [DEBUG] [LOCAL ] VIPS: Loaded 51304 existing records from primary storage. [2025-10-16T22:12:24.812075] [INFO ] [MAIN ] VIPS: Loaded 51304 existing records. [2025-10-16T22:12:24.989198] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:12:24.989403] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-16T22:12:24.989460] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-16T22:12:24.989711] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-16T22:12:24.989773] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-16T22:12:25.352004] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:12:25.364838] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T22:12:25.542801] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-16T22:12:26.048892] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-16T22:12:26.342833] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-16T22:12:27.142819] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-16T22:12:27.951978] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-16T22:12:27.977631] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-16T22:12:28.062755] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T22:12:28.481382] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-16T22:12:28.742810] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-16T22:12:29.301548] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-16T22:12:29.542833] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-16T22:12:30.141733] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T22:12:30.342789] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-10-16T22:12:31.142823] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-16T22:12:31.942835] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-16T22:12:32.057102] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T22:12:32.742871] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-16T22:12:32.831880] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T22:12:32.847362] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T22:12:33.299507] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-16T22:12:33.542827] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-16T22:12:34.042475] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-16T22:12:34.342836] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-16T22:12:35.142868] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-16T22:12:35.943303] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-16T22:12:35.949258] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T22:12:36.012619] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T22:12:36.491362] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-16T22:12:36.492385] [INFO ] [REMOTE ] VHI: Full fetch complete (4347 records). [2025-10-16T22:12:36.492456] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-16T22:12:36.747991] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-16T22:12:36.852776] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-16T22:12:36.852852] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-16T22:12:36.853002] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-16T22:12:36.853041] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-16T22:12:36.853430] [DEBUG] [LOCAL ] VHI: Trimmed 4347 records to 2792 (keeping 200 days of data) [2025-10-16T22:12:36.870200] [DEBUG] [LOCAL ] VHI: Primary data saved (2792 records). [2025-10-16T22:12:36.870261] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-16T22:12:36.870333] [INFO ] [MAIN ] Update Progress: 2224/2369 symbols completed. VHI took 25.1s. Estimated remaining: 20m 23s. Rate: 7.1 symbols/min [2025-10-16T22:12:37.032424] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:12:37.032558] [DEBUG] [LOCAL ] VIRT: No existing data file found in primary storage. [2025-10-16T22:12:37.032594] [WARN ] [MAIN ] VIRT: No existing data found, performing full refresh instead. [2025-10-16T22:12:37.032723] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-16T22:12:37.032768] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-16T22:12:37.032807] [DEBUG] [LOCAL ] VIRT: No primary data file found to delete. [2025-10-16T22:12:37.032839] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-16T22:12:37.377842] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:12:37.542821] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-10-16T22:12:38.342878] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-16T22:12:38.559269] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T22:12:38.643871] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T22:12:39.147934] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-16T22:12:39.172010] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T22:12:39.942888] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-16T22:12:40.747946] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-16T22:12:40.769336] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-16T22:12:40.807283] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T22:12:41.542816] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-10-16T22:12:42.342801] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-16T22:12:42.426895] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T22:12:42.660703] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T22:12:43.142844] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-16T22:12:43.942872] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-10-16T22:12:44.120689] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T22:12:44.526803] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T22:12:44.742825] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-16T22:12:45.542822] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-16T22:12:45.682287] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T22:12:46.342858] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-10-16T22:12:46.523222] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T22:12:47.142815] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-16T22:12:47.410991] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T22:12:47.942839] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-16T22:12:47.992280] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-16T22:12:48.059984] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T22:12:48.742948] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-10-16T22:12:49.542844] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-16T22:12:49.672560] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T22:12:50.307071] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T22:12:50.342862] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-16T22:12:50.406250] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-16T22:12:51.030010] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T22:12:51.037000] [INFO ] [REMOTE ] VICI: Full fetch complete (77801 records). [2025-10-16T22:12:51.037155] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-16T22:12:51.148060] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-10-16T22:12:51.439792] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-16T22:12:51.439874] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-16T22:12:51.441283] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-16T22:12:51.441387] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-16T22:12:51.442957] [DEBUG] [LOCAL ] VICI: Trimmed 77801 records to 54043 (keeping 200 days of data) [2025-10-16T22:12:51.782405] [DEBUG] [LOCAL ] VICI: Primary data saved (54043 records). [2025-10-16T22:12:51.782548] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-16T22:12:51.783156] [INFO ] [MAIN ] Update Progress: 2225/2369 symbols completed. VICI took 34.3s. Estimated remaining: 20m 15s. Rate: 7.1 symbols/min [2025-10-16T22:12:51.952536] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-10-16T22:12:51.956212] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:12:52.001846] [DEBUG] [LOCAL ] VIST: Loaded 46546 existing records from primary storage. [2025-10-16T22:12:52.002182] [INFO ] [MAIN ] VIST: Loaded 46546 existing records. [2025-10-16T22:12:52.185815] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:12:52.186048] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-16T22:12:52.186107] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-16T22:12:52.186303] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-16T22:12:52.186342] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-16T22:12:52.560789] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:12:52.742778] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-10-16T22:12:52.771899] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T22:12:53.389382] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T22:12:53.542809] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-10-16T22:12:53.997981] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T22:12:54.342862] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-16T22:12:55.147901] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-10-16T22:12:55.167905] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T22:12:55.942810] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-16T22:12:55.996364] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T22:12:56.742805] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-16T22:12:56.873499] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T22:12:57.542816] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-10-16T22:12:57.667848] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T22:12:58.338256] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T22:12:58.347121] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-10-16T22:12:58.926948] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T22:12:59.142808] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-16T22:12:59.449674] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-16T22:12:59.942831] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-10-16T22:13:00.427971] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T22:13:00.742851] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-10-16T22:13:01.360111] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T22:13:01.542829] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-10-16T22:13:02.342883] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-16T22:13:02.404684] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T22:13:02.913453] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-16T22:13:03.142830] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-16T22:13:03.942817] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-10. [2025-10-16T22:13:04.219694] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T22:13:04.742808] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-16T22:13:04.851184] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T22:13:05.464149] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T22:13:05.471142] [INFO ] [REMOTE ] VIRT: Full fetch complete (67575 records). [2025-10-16T22:13:05.471281] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-16T22:13:05.547966] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-10. [2025-10-16T22:13:05.870108] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-16T22:13:05.870234] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-16T22:13:05.871801] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-16T22:13:05.871870] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-16T22:13:05.873323] [DEBUG] [LOCAL ] VIRT: Trimmed 67575 records to 47005 (keeping 200 days of data) [2025-10-16T22:13:06.175383] [DEBUG] [LOCAL ] VIRT: Primary data saved (47005 records). [2025-10-16T22:13:06.175550] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-16T22:13:06.175663] [INFO ] [MAIN ] Update Progress: 2226/2369 symbols completed. VIRT took 29.3s. Estimated remaining: 20m 7s. Rate: 7.1 symbols/min [2025-10-16T22:13:06.342864] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-16T22:13:06.359540] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:13:06.395212] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T22:13:06.446625] [DEBUG] [LOCAL ] VIV: Loaded 44858 existing records from primary storage. [2025-10-16T22:13:06.447088] [INFO ] [MAIN ] VIV: Loaded 44858 existing records. [2025-10-16T22:13:06.640602] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:13:06.640874] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-16T22:13:06.640924] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-16T22:13:06.641131] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-16T22:13:06.641187] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-16T22:13:06.996039] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:13:07.142832] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-16T22:13:07.259899] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-16T22:13:07.267107] [INFO ] [REMOTE ] VIPS: Full fetch complete (74842 records). [2025-10-16T22:13:07.267283] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-16T22:13:07.683956] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-16T22:13:07.684064] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-16T22:13:07.685786] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-16T22:13:07.685861] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-16T22:13:07.687742] [DEBUG] [LOCAL ] VIPS: Trimmed 74842 records to 51666 (keeping 200 days of data) [2025-10-16T22:13:07.944459] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-10-16T22:13:08.019802] [DEBUG] [LOCAL ] VIPS: Primary data saved (51666 records). [2025-10-16T22:13:08.020049] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-16T22:13:08.020226] [INFO ] [MAIN ] Update Progress: 2227/2369 symbols completed. VIPS took 43.5s. Estimated remaining: 19m 58s. Rate: 7.1 symbols/min [2025-10-16T22:13:08.236387] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:13:08.240459] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T22:13:08.269868] [DEBUG] [LOCAL ] VKQ: Loaded 17636 existing records from primary storage. [2025-10-16T22:13:08.270169] [INFO ] [MAIN ] VKQ: Loaded 17636 existing records. [2025-10-16T22:13:08.457747] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:13:08.458214] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-16T22:13:08.458281] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-16T22:13:08.458621] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-16T22:13:08.458770] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-16T22:13:08.688444] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-16T22:13:08.767508] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-16T22:13:08.792143] [INFO ] [REMOTE ] VIK: Full fetch complete (76042 records). [2025-10-16T22:13:08.807180] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-16T22:13:09.050092] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:13:09.335199] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-16T22:13:09.335275] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-16T22:13:09.336467] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-16T22:13:09.336529] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-16T22:13:09.337974] [DEBUG] [LOCAL ] VIK: Trimmed 76042 records to 52852 (keeping 200 days of data) [2025-10-16T22:13:09.554769] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-10-16T22:13:09.597000] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T22:13:09.714916] [DEBUG] [LOCAL ] VIK: Primary data saved (52852 records). [2025-10-16T22:13:09.715059] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-16T22:13:09.715139] [INFO ] [MAIN ] Update Progress: 2228/2369 symbols completed. VIK took 51.9s. Estimated remaining: 19m 49s. Rate: 7.1 symbols/min [2025-10-16T22:13:09.884887] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:13:09.914793] [DEBUG] [LOCAL ] VLN: Loaded 30740 existing records from primary storage. [2025-10-16T22:13:09.915061] [INFO ] [MAIN ] VLN: Loaded 30740 existing records. [2025-10-16T22:13:10.122235] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:13:10.122448] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-16T22:13:10.122497] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-16T22:13:10.122739] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-16T22:13:10.122797] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-16T22:13:10.354126] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-16T22:13:10.515551] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:13:10.520835] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T22:13:10.585086] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T22:13:11.142815] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-10-16T22:13:11.805176] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T22:13:11.942809] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-16T22:13:12.742807] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-16T22:13:12.779363] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T22:13:13.364521] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T22:13:13.542833] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-16T22:13:13.679488] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T22:13:14.342828] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-16T22:13:15.142782] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-16T22:13:15.182041] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T22:13:15.226329] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T22:13:15.942832] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-16T22:13:16.565242] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T22:13:16.742825] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-16T22:13:17.554821] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-16T22:13:17.575250] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T22:13:17.629317] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T22:13:18.342874] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-16T22:13:19.142920] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-16T22:13:19.404805] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T22:13:19.502391] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-16T22:13:19.942795] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-16T22:13:20.188261] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T22:13:20.742886] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-16T22:13:21.505729] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T22:13:21.542802] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-16T22:13:21.880632] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T22:13:22.342880] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-16T22:13:23.119933] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-16T22:13:23.143613] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-16T22:13:23.146327] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T22:13:23.942798] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-16T22:13:24.247087] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T22:13:24.742785] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-16T22:13:24.856678] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-16T22:13:25.542820] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-16T22:13:26.160097] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T22:13:26.169954] [INFO ] [REMOTE ] VIST: Full fetch complete (67256 records). [2025-10-16T22:13:26.170142] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-16T22:13:26.348973] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-16T22:13:26.569726] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-16T22:13:26.569813] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-16T22:13:26.571078] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-16T22:13:26.571143] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-16T22:13:26.572462] [DEBUG] [LOCAL ] VIST: Trimmed 67256 records to 46887 (keeping 200 days of data) [2025-10-16T22:13:26.858869] [DEBUG] [LOCAL ] VIST: Primary data saved (46887 records). [2025-10-16T22:13:26.859271] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-16T22:13:26.860170] [INFO ] [MAIN ] Update Progress: 2229/2369 symbols completed. VIST took 35.1s. Estimated remaining: 19m 41s. Rate: 7.1 symbols/min [2025-10-16T22:13:27.060842] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:13:27.119373] [DEBUG] [LOCAL ] VLO: Loaded 53027 existing records from primary storage. [2025-10-16T22:13:27.119811] [INFO ] [MAIN ] VLO: Loaded 53027 existing records. [2025-10-16T22:13:27.142813] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-16T22:13:27.330042] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:13:27.330424] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-16T22:13:27.330572] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-16T22:13:27.340364] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-16T22:13:27.355214] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-16T22:13:27.396392] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-16T22:13:27.751948] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:13:27.855900] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T22:13:27.877911] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T22:13:27.942809] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-16T22:13:28.742838] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-16T22:13:29.502441] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T22:13:29.542789] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-16T22:13:29.643089] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T22:13:30.342845] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-10-16T22:13:31.059162] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T22:13:31.142805] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-16T22:13:31.272960] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T22:13:31.942879] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-10-16T22:13:32.742796] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-16T22:13:33.069256] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T22:13:33.542779] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-16T22:13:33.778969] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-16T22:13:33.814538] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T22:13:33.820673] [INFO ] [REMOTE ] VLN: Full fetch complete (43637 records). [2025-10-16T22:13:33.820867] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-16T22:13:34.216406] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-16T22:13:34.216527] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-16T22:13:34.218571] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-16T22:13:34.218638] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-16T22:13:34.220166] [DEBUG] [LOCAL ] VLN: Trimmed 43637 records to 31015 (keeping 200 days of data) [2025-10-16T22:13:34.361807] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-16T22:13:34.407570] [DEBUG] [LOCAL ] VLN: Primary data saved (31015 records). [2025-10-16T22:13:34.407806] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-16T22:13:34.407920] [INFO ] [MAIN ] Update Progress: 2230/2369 symbols completed. VLN took 24.7s. Estimated remaining: 19m 33s. Rate: 7.1 symbols/min [2025-10-16T22:13:34.577457] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:13:34.617210] [DEBUG] [LOCAL ] VLRS: Loaded 39730 existing records from primary storage. [2025-10-16T22:13:34.617592] [INFO ] [MAIN ] VLRS: Loaded 39730 existing records. [2025-10-16T22:13:34.803617] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:13:34.804009] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-16T22:13:34.804075] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-16T22:13:34.804301] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-16T22:13:34.804358] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-16T22:13:35.118125] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T22:13:35.148842] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-10-16T22:13:35.216154] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:13:35.942860] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-16T22:13:36.196250] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T22:13:36.235902] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-16T22:13:36.742820] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-16T22:13:37.492359] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T22:13:37.542846] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-10-16T22:13:38.354310] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-10-16T22:13:38.360079] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T22:13:39.104025] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T22:13:39.142770] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-16T22:13:39.477077] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-16T22:13:39.942795] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-16T22:13:40.742864] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-16T22:13:41.148901] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T22:13:41.175288] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-16T22:13:41.181288] [INFO ] [REMOTE ] VIV: Full fetch complete (64519 records). [2025-10-16T22:13:41.181407] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-16T22:13:41.547423] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-16T22:13:41.569923] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-16T22:13:41.570077] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-16T22:13:41.571387] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-16T22:13:41.571481] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-16T22:13:41.573502] [DEBUG] [LOCAL ] VIV: Trimmed 64519 records to 45156 (keeping 200 days of data) [2025-10-16T22:13:41.683663] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T22:13:41.874787] [DEBUG] [LOCAL ] VIV: Primary data saved (45156 records). [2025-10-16T22:13:41.874921] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-16T22:13:41.875000] [INFO ] [MAIN ] Update Progress: 2231/2369 symbols completed. VIV took 35.7s. Estimated remaining: 19m 24s. Rate: 7.1 symbols/min [2025-10-16T22:13:42.038067] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:13:42.044792] [DEBUG] [LOCAL ] VLT: Loaded 4415 existing records from primary storage. [2025-10-16T22:13:42.044980] [INFO ] [MAIN ] VLT: Loaded 4415 existing records. [2025-10-16T22:13:42.219115] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:13:42.219329] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-16T22:13:42.219387] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-16T22:13:42.219515] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-16T22:13:42.219552] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-16T22:13:42.355176] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-16T22:13:42.576897] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:13:43.142826] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-10-16T22:13:43.683003] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-16T22:13:43.824276] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T22:13:43.857755] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-16T22:13:43.942843] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-10. [2025-10-16T22:13:44.742822] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-10-16T22:13:44.856964] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T22:13:44.859749] [INFO ] [REMOTE ] VKQ: Full fetch complete (24547 records). [2025-10-16T22:13:44.859872] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-16T22:13:45.238077] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-16T22:13:45.238203] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-16T22:13:45.238903] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-16T22:13:45.238967] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-16T22:13:45.239674] [DEBUG] [LOCAL ] VKQ: Trimmed 24547 records to 17804 (keeping 200 days of data) [2025-10-16T22:13:45.345850] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-16T22:13:45.354850] [DEBUG] [LOCAL ] VKQ: Primary data saved (17804 records). [2025-10-16T22:13:45.355005] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-16T22:13:45.355095] [INFO ] [MAIN ] Update Progress: 2232/2369 symbols completed. VKQ took 37.3s. Estimated remaining: 19m 15s. Rate: 7.1 symbols/min [2025-10-16T22:13:45.523511] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:13:45.547562] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-16T22:13:45.567629] [DEBUG] [LOCAL ] VLTO: Loaded 46190 existing records from primary storage. [2025-10-16T22:13:45.568578] [INFO ] [MAIN ] VLTO: Loaded 46190 existing records. [2025-10-16T22:13:45.741954] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:13:45.742194] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-16T22:13:45.742242] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-16T22:13:45.742459] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-16T22:13:45.742515] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-16T22:13:46.103039] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:13:46.342817] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-10-16T22:13:47.142799] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-16T22:13:47.322418] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T22:13:47.930496] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-16T22:13:47.932339] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T22:13:47.944307] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-16T22:13:48.742817] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-16T22:13:49.542806] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-16T22:13:49.603389] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T22:13:50.177446] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T22:13:50.342804] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-16T22:13:51.142844] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-16T22:13:51.179934] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T22:13:51.942924] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-16T22:13:52.355061] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T22:13:52.554753] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-16T22:13:52.742805] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-16T22:13:52.784347] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T22:13:53.542822] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-16T22:13:54.342790] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-16T22:13:54.647736] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T22:13:55.069695] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T22:13:55.101002] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T22:13:55.142831] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-16T22:13:55.942862] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-16T22:13:56.673125] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T22:13:56.742952] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-16T22:13:56.930628] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T22:13:57.542846] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-16T22:13:58.270423] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T22:13:58.342819] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-16T22:13:59.142802] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-16T22:13:59.264273] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T22:13:59.942824] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-16T22:14:00.303179] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-16T22:14:00.317355] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-16T22:14:00.742883] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-16T22:14:01.351874] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-16T22:14:01.542864] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-16T22:14:01.690933] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T22:14:02.342842] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-16T22:14:02.930517] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-16T22:14:03.094014] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T22:14:03.142768] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-16T22:14:03.942818] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-16T22:14:04.605069] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T22:14:04.635476] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T22:14:04.643486] [INFO ] [REMOTE ] VLO: Full fetch complete (76964 records). [2025-10-16T22:14:04.643801] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-16T22:14:04.748037] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-16T22:14:05.085534] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-16T22:14:05.085693] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-16T22:14:05.087519] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-16T22:14:05.087593] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-16T22:14:05.089662] [DEBUG] [LOCAL ] VLO: Trimmed 76964 records to 53400 (keeping 200 days of data) [2025-10-16T22:14:05.454485] [DEBUG] [LOCAL ] VLO: Primary data saved (53400 records). [2025-10-16T22:14:05.454718] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-16T22:14:05.455557] [INFO ] [MAIN ] Update Progress: 2233/2369 symbols completed. VLO took 38.6s. Estimated remaining: 19m 8s. Rate: 7.1 symbols/min [2025-10-16T22:14:05.548010] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-16T22:14:05.651721] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:14:05.705242] [DEBUG] [LOCAL ] VMC: Loaded 42564 existing records from primary storage. [2025-10-16T22:14:05.705766] [INFO ] [MAIN ] VMC: Loaded 42564 existing records. [2025-10-16T22:14:05.894741] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:14:05.895063] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-16T22:14:05.895117] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-16T22:14:05.895368] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-16T22:14:05.895425] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-16T22:14:06.253006] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:14:06.342781] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-10-16T22:14:06.398486] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T22:14:07.045924] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T22:14:07.142804] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-16T22:14:07.911151] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T22:14:07.942785] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-16T22:14:08.532545] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T22:14:08.594091] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-16T22:14:08.742803] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-16T22:14:09.331284] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-16T22:14:09.542793] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-16T22:14:10.342851] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-16T22:14:10.863498] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T22:14:10.868963] [INFO ] [REMOTE ] VLRS: Full fetch complete (58517 records). [2025-10-16T22:14:10.869101] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-16T22:14:11.148558] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-16T22:14:11.305256] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-16T22:14:11.305349] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-16T22:14:11.306711] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-16T22:14:11.306779] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-16T22:14:11.308057] [DEBUG] [LOCAL ] VLRS: Trimmed 58517 records to 40013 (keeping 200 days of data) [2025-10-16T22:14:11.548980] [DEBUG] [LOCAL ] VLRS: Primary data saved (40013 records). [2025-10-16T22:14:11.549147] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-16T22:14:11.549268] [INFO ] [MAIN ] Update Progress: 2234/2369 symbols completed. VLRS took 37.1s. Estimated remaining: 18m 59s. Rate: 7.1 symbols/min [2025-10-16T22:14:11.745414] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:14:11.762609] [DEBUG] [LOCAL ] VMI: Loaded 15071 existing records from primary storage. [2025-10-16T22:14:11.762878] [INFO ] [MAIN ] VMI: Loaded 15071 existing records. [2025-10-16T22:14:11.977086] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:14:11.977372] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-16T22:14:11.978111] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-16T22:14:11.970029] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-16T22:14:11.979326] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-16T22:14:11.979460] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-16T22:14:12.183393] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T22:14:12.437342] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:14:12.595356] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-16T22:14:12.742783] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-16T22:14:12.931582] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T22:14:13.542814] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-10-16T22:14:14.342834] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-16T22:14:14.436505] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T22:14:14.473300] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-16T22:14:15.142822] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-16T22:14:15.942799] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-16T22:14:16.012143] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T22:14:16.119797] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T22:14:16.172687] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (0.23 seconds). [2025-10-16T22:14:16.178925] [INFO ] [REMOTE ] VLTO: Full fetch complete (67345 records). [2025-10-16T22:14:16.179056] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-16T22:14:16.560369] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-16T22:14:16.560446] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-16T22:14:16.561563] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-16T22:14:16.561682] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-16T22:14:16.562965] [DEBUG] [LOCAL ] VLTO: Trimmed 67345 records to 46553 (keeping 200 days of data) [2025-10-16T22:14:16.745735] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-16T22:14:16.865510] [DEBUG] [LOCAL ] VLTO: Primary data saved (46553 records). [2025-10-16T22:14:16.865671] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-16T22:14:16.865771] [INFO ] [MAIN ] Update Progress: 2235/2369 symbols completed. VLTO took 31.5s. Estimated remaining: 18m 50s. Rate: 7.1 symbols/min [2025-10-16T22:14:17.030545] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:14:17.050823] [DEBUG] [LOCAL ] VMO: Loaded 20777 existing records from primary storage. [2025-10-16T22:14:17.051063] [INFO ] [MAIN ] VMO: Loaded 20777 existing records. [2025-10-16T22:14:17.226412] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:14:17.226613] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-16T22:14:17.226689] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-16T22:14:17.226927] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-16T22:14:17.226983] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-16T22:14:17.542838] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-16T22:14:17.583551] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:14:17.686227] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T22:14:18.342818] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-10-16T22:14:19.142796] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-16T22:14:19.347429] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-16T22:14:19.393806] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-16T22:14:19.774637] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-16T22:14:19.775790] [INFO ] [REMOTE ] VLT: Full fetch complete (7501 records). [2025-10-16T22:14:19.775868] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-16T22:14:19.947987] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-16T22:14:20.144493] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-16T22:14:20.144585] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-16T22:14:20.144848] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-16T22:14:20.144921] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-16T22:14:20.145356] [DEBUG] [LOCAL ] VLT: Trimmed 7501 records to 4434 (keeping 200 days of data) [2025-10-16T22:14:20.172983] [DEBUG] [LOCAL ] VLT: Primary data saved (4434 records). [2025-10-16T22:14:20.173136] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-16T22:14:20.173228] [INFO ] [MAIN ] Update Progress: 2236/2369 symbols completed. VLT took 38.3s. Estimated remaining: 18m 42s. Rate: 7.1 symbols/min [2025-10-16T22:14:20.347996] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:14:20.359604] [DEBUG] [LOCAL ] VNCE: Loaded 9018 existing records from primary storage. [2025-10-16T22:14:20.359855] [INFO ] [MAIN ] VNCE: Loaded 9018 existing records. [2025-10-16T22:14:20.537023] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:14:20.537222] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-10-16T22:14:20.537268] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-10-16T22:14:20.537423] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-10-16T22:14:20.537478] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-10-16T22:14:20.750169] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-16T22:14:20.890704] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:14:21.073088] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T22:14:21.542772] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-16T22:14:21.931351] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T22:14:22.342800] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-16T22:14:22.759565] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T22:14:23.142814] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-16T22:14:23.942808] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-16T22:14:24.059912] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T22:14:24.207914] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-16T22:14:24.742808] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-16T22:14:24.859726] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-16T22:14:25.542819] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-16T22:14:26.331256] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T22:14:26.342791] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-10-16T22:14:26.444895] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T22:14:27.142780] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-16T22:14:27.513280] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T22:14:27.942825] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-10-16T22:14:28.742844] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-16T22:14:28.815227] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T22:14:29.275364] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T22:14:29.542819] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-16T22:14:29.768725] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T22:14:30.342814] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-10-16T22:14:30.671478] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T22:14:30.872804] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-16T22:14:31.142809] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-16T22:14:31.942804] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-16T22:14:32.203188] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T22:14:32.742813] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-16T22:14:33.377935] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T22:14:33.397449] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-16T22:14:33.542795] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-16T22:14:34.342807] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-16T22:14:35.142926] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-16T22:14:35.169612] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T22:14:35.457196] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T22:14:35.942824] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-10-16T22:14:36.140385] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T22:14:36.554243] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T22:14:36.742829] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-16T22:14:37.542883] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-16T22:14:37.964708] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-16T22:14:38.342779] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-16T22:14:38.580630] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T22:14:39.142791] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-10-16T22:14:39.302419] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T22:14:39.727032] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-16T22:14:39.942799] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-10-16T22:14:40.742818] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-16T22:14:40.947585] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T22:14:41.355968] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-16T22:14:41.361065] [INFO ] [REMOTE ] VMC: Full fetch complete (62367 records). [2025-10-16T22:14:41.361197] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-16T22:14:41.549128] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-16T22:14:41.747404] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-16T22:14:41.747517] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-16T22:14:41.748687] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-16T22:14:41.748784] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-16T22:14:41.750144] [DEBUG] [LOCAL ] VMC: Trimmed 62367 records to 42844 (keeping 200 days of data) [2025-10-16T22:14:42.019143] [DEBUG] [LOCAL ] VMC: Primary data saved (42844 records). [2025-10-16T22:14:42.019274] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-16T22:14:42.019946] [INFO ] [MAIN ] Update Progress: 2237/2369 symbols completed. VMC took 36.6s. Estimated remaining: 18m 34s. Rate: 7.1 symbols/min [2025-10-16T22:14:42.342825] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-10-16T22:14:42.627687] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-16T22:14:42.629937] [INFO ] [REMOTE ] VMI: Full fetch complete (21225 records). [2025-10-16T22:14:42.630018] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-16T22:14:43.028059] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-16T22:14:43.028148] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-16T22:14:43.028734] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-16T22:14:43.028797] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-16T22:14:43.029379] [DEBUG] [LOCAL ] VMI: Trimmed 21225 records to 15183 (keeping 200 days of data) [2025-10-16T22:14:43.125164] [DEBUG] [LOCAL ] VMI: Primary data saved (15183 records). [2025-10-16T22:14:43.125305] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-16T22:14:43.125389] [INFO ] [MAIN ] Update Progress: 2238/2369 symbols completed. VMI took 31.6s. Estimated remaining: 18m 25s. Rate: 7.1 symbols/min [2025-10-16T22:14:43.142840] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-10-16T22:14:43.536183] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-16T22:14:43.765790] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T22:14:43.942912] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-10. [2025-10-16T22:14:44.742833] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-10-16T22:14:44.869765] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T22:14:44.872740] [INFO ] [REMOTE ] VMO: Full fetch complete (31030 records). [2025-10-16T22:14:44.872827] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-16T22:14:45.246362] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-16T22:14:45.246446] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-16T22:14:45.247133] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-16T22:14:45.247195] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-16T22:14:45.248020] [DEBUG] [LOCAL ] VMO: Trimmed 31030 records to 20913 (keeping 200 days of data) [2025-10-16T22:14:45.372525] [DEBUG] [LOCAL ] VMO: Primary data saved (20913 records). [2025-10-16T22:14:45.372683] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-16T22:14:45.372778] [INFO ] [MAIN ] Update Progress: 2239/2369 symbols completed. VMO took 28.5s. Estimated remaining: 18m 16s. Rate: 7.1 symbols/min [2025-10-16T22:14:45.524891] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T22:14:45.542778] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-10-16T22:14:46.166821] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T22:14:46.342810] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-10-16T22:14:46.993010] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-16T22:14:47.142848] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-10-16T22:14:48.543374] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T22:14:48.552875] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-10. [2025-10-16T22:14:49.734197] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T22:14:49.737231] [INFO ] [REMOTE ] VNCE: Full fetch complete (15383 records). [2025-10-16T22:14:49.737319] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-10-16T22:14:50.102847] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-10-16T22:14:50.102941] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-10-16T22:14:50.103349] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-10-16T22:14:50.103391] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-10-16T22:14:50.104177] [DEBUG] [LOCAL ] VNCE: Trimmed 15383 records to 9103 (keeping 200 days of data) [2025-10-16T22:14:50.160425] [DEBUG] [LOCAL ] VNCE: Primary data saved (9103 records). [2025-10-16T22:14:50.160591] [INFO ] [MAIN ] VNCE: Full history saved. [2025-10-16T22:14:50.160708] [INFO ] [MAIN ] Update Progress: 2240/2369 symbols completed. VNCE took 30.0s. Estimated remaining: 18m 8s. Rate: 7.1 symbols/min [2025-10-16T22:14:50.711471] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:14:50.814623] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:14:50.863320] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:14:50.895370] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:14:50.905392] [DEBUG] [LOCAL ] VOC: Loaded 9008 existing records from primary storage. [2025-10-16T22:14:50.905772] [INFO ] [MAIN ] VOC: Loaded 9008 existing records. [2025-10-16T22:14:51.136879] [DEBUG] [LOCAL ] VNT: Loaded 43959 existing records from primary storage. [2025-10-16T22:14:51.153552] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:14:51.153921] [INFO ] [MAIN ] VNT: Loaded 43959 existing records. [2025-10-16T22:14:51.166423] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-16T22:14:51.167357] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-16T22:14:51.178410] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-16T22:14:51.167271] [DEBUG] [LOCAL ] VOYA: Loaded 42237 existing records from primary storage. [2025-10-16T22:14:51.221149] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-16T22:14:51.207683] [DEBUG] [LOCAL ] VNO: Loaded 48956 existing records from primary storage. [2025-10-16T22:14:51.229859] [INFO ] [MAIN ] VOYA: Loaded 42237 existing records. [2025-10-16T22:14:51.267010] [INFO ] [MAIN ] VNO: Loaded 48956 existing records. [2025-10-16T22:14:51.662684] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:14:51.717254] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-16T22:14:51.796584] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-16T22:14:51.873813] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-16T22:14:51.938946] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-16T22:14:51.938745] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:14:51.933346] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:14:51.939168] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-16T22:14:51.950167] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-16T22:14:51.973562] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-16T22:14:51.950115] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-16T22:14:51.992851] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-16T22:14:51.978907] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-16T22:14:52.015669] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-16T22:14:52.117357] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-16T22:14:52.568865] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:14:52.620893] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-10-16T22:14:53.047802] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:14:53.079894] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:14:53.100276] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-10-16T22:14:53.106604] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-10-16T22:14:53.225173] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:14:53.225710] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-10-16T22:14:53.437718] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-16T22:14:53.440897] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-16T22:14:54.255215] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-16T22:14:54.257895] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-16T22:14:54.494680] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T22:14:54.502805] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-16T22:14:54.794156] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T22:14:54.803439] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-16T22:14:54.992310] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T22:14:55.142767] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-16T22:14:55.154512] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T22:14:55.757933] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T22:14:55.942781] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-16T22:14:56.190342] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T22:14:56.300077] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T22:14:56.500602] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T22:14:56.742846] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-16T22:14:57.542915] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-16T22:14:58.342844] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-16T22:14:58.379351] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T22:14:58.699572] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T22:14:58.916001] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T22:14:59.142822] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-16T22:14:59.942844] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-16T22:15:00.744006] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-16T22:15:00.745029] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T22:15:00.842349] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T22:15:01.542814] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-16T22:15:02.342803] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-16T22:15:02.394349] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T22:15:03.142841] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-16T22:15:03.225075] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T22:15:03.252763] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T22:15:03.942846] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-16T22:15:04.742839] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-16T22:15:04.905557] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T22:15:05.542793] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-16T22:15:05.614028] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T22:15:06.085106] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-16T22:15:06.145121] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T22:15:06.342806] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-16T22:15:07.142808] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-16T22:15:07.947380] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-16T22:15:07.949206] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T22:15:08.026202] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T22:15:08.742820] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-16T22:15:09.542805] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-16T22:15:09.606003] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T22:15:10.296372] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T22:15:10.320212] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T22:15:10.342772] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-16T22:15:11.142869] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-16T22:15:11.801893] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T22:15:11.803923] [INFO ] [REMOTE ] VOC: Full fetch complete (13203 records). [2025-10-16T22:15:11.804017] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-16T22:15:11.965294] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-16T22:15:12.142401] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-16T22:15:12.230566] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-16T22:15:12.230671] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-16T22:15:12.231094] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-16T22:15:12.231158] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-16T22:15:12.231666] [DEBUG] [LOCAL ] VOC: Trimmed 13203 records to 9054 (keeping 200 days of data) [2025-10-16T22:15:12.285518] [DEBUG] [LOCAL ] VOC: Primary data saved (9054 records). [2025-10-16T22:15:12.285696] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-16T22:15:12.285813] [INFO ] [MAIN ] Update Progress: 2241/2369 symbols completed. VOC took 22.1s. Estimated remaining: 18m 0s. Rate: 7.1 symbols/min [2025-10-16T22:15:12.452072] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:15:12.452232] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-16T22:15:12.452288] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-16T22:15:12.452397] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-16T22:15:12.452437] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-16T22:15:12.452477] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-16T22:15:12.452508] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-16T22:15:12.747900] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-16T22:15:12.818358] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:15:13.542790] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-16T22:15:13.627080] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-16T22:15:14.347878] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-10-16T22:15:14.362081] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T22:15:14.576515] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T22:15:14.576874] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-10-16T22:15:14.576967] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T22:15:14.577048] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-16T22:15:14.577128] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T22:15:14.577211] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-16T22:15:14.577292] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-16T22:15:14.577366] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-16T22:15:14.577447] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-16T22:15:14.577511] [INFO ] [MAIN ] Update Progress: 2242/2369 symbols completed. VOYG took 2.3s. Estimated remaining: 17m 51s. Rate: 7.1 symbols/min [2025-10-16T22:15:14.745067] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:15:14.765637] [DEBUG] [LOCAL ] VPG: Loaded 17178 existing records from primary storage. [2025-10-16T22:15:14.765982] [INFO ] [MAIN ] VPG: Loaded 17178 existing records. [2025-10-16T22:15:14.952713] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:15:14.952940] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-16T22:15:14.953007] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-16T22:15:14.953227] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-16T22:15:14.953285] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-16T22:15:15.147876] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-16T22:15:15.346066] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:15:15.348081] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T22:15:15.942833] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-16T22:15:16.748068] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-10-16T22:15:16.765783] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T22:15:17.511972] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T22:15:17.542771] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-16T22:15:17.564761] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-16T22:15:18.342815] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-16T22:15:18.871427] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T22:15:18.877092] [INFO ] [REMOTE ] VOYA: Full fetch complete (61863 records). [2025-10-16T22:15:18.877235] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-16T22:15:19.147923] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-16T22:15:19.263599] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-16T22:15:19.263718] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-16T22:15:19.264931] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-16T22:15:19.264998] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-16T22:15:19.266351] [DEBUG] [LOCAL ] VOYA: Trimmed 61863 records to 42544 (keeping 200 days of data) [2025-10-16T22:15:19.548581] [DEBUG] [LOCAL ] VOYA: Primary data saved (42544 records). [2025-10-16T22:15:19.548738] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-16T22:15:19.548902] [INFO ] [MAIN ] Update Progress: 2243/2369 symbols completed. VOYA took 29.4s. Estimated remaining: 17m 43s. Rate: 7.1 symbols/min [2025-10-16T22:15:19.728069] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:15:19.736566] [DEBUG] [LOCAL ] VPV: Loaded 5450 existing records from primary storage. [2025-10-16T22:15:19.736796] [INFO ] [MAIN ] VPV: Loaded 5450 existing records. [2025-10-16T22:15:19.945728] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:15:19.947816] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T22:15:19.947946] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-16T22:15:19.956209] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-16T22:15:19.957222] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-16T22:15:19.957597] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-16T22:15:19.957698] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-16T22:15:20.230537] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T22:15:20.331688] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:15:20.742860] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-10-16T22:15:21.542792] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-16T22:15:21.596203] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T22:15:21.744631] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-16T22:15:22.342825] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-16T22:15:22.724456] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-16T22:15:23.142813] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-16T22:15:23.942895] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-16T22:15:24.070462] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T22:15:24.279477] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T22:15:24.618939] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T22:15:24.742794] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-16T22:15:25.542873] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-16T22:15:26.301389] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T22:15:26.342786] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-16T22:15:26.613997] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T22:15:26.949082] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T22:15:27.142834] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-16T22:15:27.902063] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T22:15:27.942788] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-16T22:15:28.742830] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-16T22:15:28.834102] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T22:15:29.542819] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-16T22:15:30.256044] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-16T22:15:30.262466] [INFO ] [REMOTE ] VNO: Full fetch complete (70526 records). [2025-10-16T22:15:30.262669] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-16T22:15:30.347966] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-16T22:15:30.579914] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T22:15:30.671225] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-16T22:15:30.671305] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-16T22:15:30.672482] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-16T22:15:30.672546] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-16T22:15:30.673941] [DEBUG] [LOCAL ] VNO: Trimmed 70526 records to 49317 (keeping 200 days of data) [2025-10-16T22:15:30.957634] [DEBUG] [LOCAL ] VNO: Primary data saved (49317 records). [2025-10-16T22:15:30.957797] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-16T22:15:30.958461] [INFO ] [MAIN ] Update Progress: 2244/2369 symbols completed. VNO took 40.8s. Estimated remaining: 17m 34s. Rate: 7.1 symbols/min [2025-10-16T22:15:31.126069] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:15:31.142819] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-16T22:15:31.170038] [DEBUG] [LOCAL ] VRE: Loaded 35289 existing records from primary storage. [2025-10-16T22:15:31.170333] [INFO ] [MAIN ] VRE: Loaded 35289 existing records. [2025-10-16T22:15:31.351270] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:15:31.352394] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-16T22:15:31.352453] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-16T22:15:31.353210] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-16T22:15:31.353268] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-16T22:15:31.725010] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:15:31.748460] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T22:15:31.776483] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-16T22:15:31.942807] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-10-16T22:15:32.742829] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-16T22:15:33.255034] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T22:15:33.538939] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T22:15:33.544035] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-16T22:15:34.342837] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-16T22:15:35.059044] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T22:15:35.067525] [INFO ] [REMOTE ] VNT: Full fetch complete (64119 records). [2025-10-16T22:15:35.067701] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-16T22:15:35.147911] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-16T22:15:35.459596] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-16T22:15:35.459714] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-16T22:15:35.460945] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-16T22:15:35.461007] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-16T22:15:35.462231] [DEBUG] [LOCAL ] VNT: Trimmed 64119 records to 44321 (keeping 200 days of data) [2025-10-16T22:15:35.664379] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T22:15:35.756108] [DEBUG] [LOCAL ] VNT: Primary data saved (44321 records). [2025-10-16T22:15:35.756250] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-16T22:15:35.756934] [INFO ] [MAIN ] Update Progress: 2245/2369 symbols completed. VNT took 45.6s. Estimated remaining: 17m 26s. Rate: 7.1 symbols/min [2025-10-16T22:15:35.872335] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T22:15:35.945117] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-16T22:15:35.944996] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:15:36.001493] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-16T22:15:36.001899] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-10-16T22:15:36.182545] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:15:36.182811] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-16T22:15:36.182860] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-16T22:15:36.183086] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-16T22:15:36.183142] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-16T22:15:36.575078] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:15:36.742859] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-10-16T22:15:37.098745] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T22:15:37.542818] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-16T22:15:38.203290] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-16T22:15:38.342869] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-16T22:15:38.977143] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T22:15:39.142836] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-16T22:15:39.288150] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-10-16T22:15:39.942839] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-16T22:15:40.509044] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T22:15:40.742872] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-16T22:15:41.542890] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-16T22:15:42.216976] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-16T22:15:42.251315] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T22:15:42.266777] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T22:15:42.342815] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-16T22:15:43.142823] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-16T22:15:43.812883] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T22:15:43.832515] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T22:15:43.942779] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-16T22:15:44.742804] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-16T22:15:45.405230] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T22:15:45.542777] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-16T22:15:45.752946] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T22:15:46.342824] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-16T22:15:46.948853] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T22:15:47.142811] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-16T22:15:47.942811] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-16T22:15:48.482488] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T22:15:48.554213] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T22:15:48.742785] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-16T22:15:48.807190] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-16T22:15:49.542826] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-16T22:15:50.212758] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T22:15:50.342828] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-16T22:15:51.142866] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-16T22:15:51.243335] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-16T22:15:51.942787] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-16T22:15:52.106687] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T22:15:52.109998] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-16T22:15:52.111852] [INFO ] [REMOTE ] VPV: Full fetch complete (9045 records). [2025-10-16T22:15:52.123298] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-16T22:15:52.492480] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-16T22:15:52.492565] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-16T22:15:52.492819] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-16T22:15:52.492881] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-16T22:15:52.493446] [DEBUG] [LOCAL ] VPV: Trimmed 9045 records to 5476 (keeping 200 days of data) [2025-10-16T22:15:52.527622] [DEBUG] [LOCAL ] VPV: Primary data saved (5476 records). [2025-10-16T22:15:52.527795] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-16T22:15:52.527883] [INFO ] [MAIN ] Update Progress: 2246/2369 symbols completed. VPV took 33.0s. Estimated remaining: 17m 18s. Rate: 7.1 symbols/min [2025-10-16T22:15:52.698099] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:15:52.710932] [DEBUG] [LOCAL ] VRTS: Loaded 9390 existing records from primary storage. [2025-10-16T22:15:52.711273] [INFO ] [MAIN ] VRTS: Loaded 9390 existing records. [2025-10-16T22:15:52.748039] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-16T22:15:52.853449] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-16T22:15:52.913585] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:15:52.913806] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-16T22:15:52.913901] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-16T22:15:52.914072] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-16T22:15:52.914126] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-16T22:15:53.270557] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:15:53.542875] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-10-16T22:15:53.771601] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T22:15:53.776345] [INFO ] [REMOTE ] VRE: Full fetch complete (48500 records). [2025-10-16T22:15:53.776464] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-16T22:15:54.157458] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-16T22:15:54.157605] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-16T22:15:54.158826] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-16T22:15:54.158895] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-16T22:15:54.160125] [DEBUG] [LOCAL ] VRE: Trimmed 48500 records to 35522 (keeping 200 days of data) [2025-10-16T22:15:54.255766] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T22:15:54.343510] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-16T22:15:54.397101] [DEBUG] [LOCAL ] VRE: Primary data saved (35522 records). [2025-10-16T22:15:54.397265] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-16T22:15:54.397877] [INFO ] [MAIN ] Update Progress: 2247/2369 symbols completed. VRE took 23.4s. Estimated remaining: 17m 9s. Rate: 7.1 symbols/min [2025-10-16T22:15:54.567248] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:15:54.622803] [DEBUG] [LOCAL ] VSCO: Loaded 52738 existing records from primary storage. [2025-10-16T22:15:54.623136] [INFO ] [MAIN ] VSCO: Loaded 52738 existing records. [2025-10-16T22:15:54.798017] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:15:54.798284] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-16T22:15:54.798336] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-16T22:15:54.798536] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-16T22:15:54.798590] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-16T22:15:55.089518] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T22:15:55.160685] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:15:55.155376] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-16T22:15:55.942882] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-16T22:15:56.587700] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T22:15:56.742844] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-16T22:15:57.542857] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-16T22:15:57.692938] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-16T22:15:57.709405] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-16T22:15:58.342853] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-16T22:15:58.367727] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-16T22:15:58.371355] [INFO ] [REMOTE ] VPG: Full fetch complete (22935 records). [2025-10-16T22:15:58.371472] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-16T22:15:58.749004] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-16T22:15:58.749109] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-16T22:15:58.749591] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-16T22:15:58.749632] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-16T22:15:58.750234] [DEBUG] [LOCAL ] VPG: Trimmed 22935 records to 17336 (keeping 200 days of data) [2025-10-16T22:15:58.851306] [DEBUG] [LOCAL ] VPG: Primary data saved (17336 records). [2025-10-16T22:15:58.851428] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-16T22:15:58.851521] [INFO ] [MAIN ] Update Progress: 2248/2369 symbols completed. VPG took 44.3s. Estimated remaining: 17m 0s. Rate: 7.1 symbols/min [2025-10-16T22:15:59.016163] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:15:59.059758] [DEBUG] [LOCAL ] VSH: Loaded 48215 existing records from primary storage. [2025-10-16T22:15:59.060077] [INFO ] [MAIN ] VSH: Loaded 48215 existing records. [2025-10-16T22:15:59.151204] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-10-16T22:15:59.238504] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:15:59.238738] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-16T22:15:59.238797] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-16T22:15:59.238974] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-16T22:15:59.239013] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-16T22:15:59.614105] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:15:59.942866] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-16T22:16:00.742920] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-10-16T22:16:00.779367] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-16T22:16:00.842755] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-16T22:16:01.035577] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T22:16:01.542817] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-16T22:16:02.342795] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-16T22:16:02.631426] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-16T22:16:03.011234] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-16T22:16:03.142845] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-16T22:16:03.943100] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-16T22:16:03.949423] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-16T22:16:04.136032] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T22:16:04.742827] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-16T22:16:05.542829] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-16T22:16:05.614965] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T22:16:06.342833] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-16T22:16:06.424969] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T22:16:07.142824] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-16T22:16:07.220153] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T22:16:07.942786] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-16T22:16:08.127276] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-16T22:16:08.290233] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T22:16:08.742825] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-16T22:16:09.542817] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-16T22:16:09.589539] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T22:16:10.311604] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T22:16:10.342847] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-16T22:16:10.473419] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T22:16:11.112816] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-16T22:16:11.142779] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-16T22:16:11.805085] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T22:16:11.806595] [INFO ] [REMOTE ] VRTS: Full fetch complete (11661 records). [2025-10-16T22:16:11.806691] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-16T22:16:11.952543] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-16T22:16:12.163119] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-16T22:16:12.163203] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-16T22:16:12.163563] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-16T22:16:12.163603] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-16T22:16:12.164107] [DEBUG] [LOCAL ] VRTS: Trimmed 11661 records to 9431 (keeping 200 days of data) [2025-10-16T22:16:12.223126] [DEBUG] [LOCAL ] VRTS: Primary data saved (9431 records). [2025-10-16T22:16:12.223268] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-16T22:16:12.223350] [INFO ] [MAIN ] Update Progress: 2249/2369 symbols completed. VRTS took 19.7s. Estimated remaining: 16m 52s. Rate: 7.1 symbols/min [2025-10-16T22:16:12.388372] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:16:12.439247] [DEBUG] [LOCAL ] VST: Loaded 53711 existing records from primary storage. [2025-10-16T22:16:12.439586] [INFO ] [MAIN ] VST: Loaded 53711 existing records. [2025-10-16T22:16:12.621800] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:16:12.622050] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-16T22:16:12.622099] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-16T22:16:12.622310] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-16T22:16:12.622367] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-16T22:16:12.747950] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-16T22:16:12.977564] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:16:13.542884] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-10-16T22:16:14.069345] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-16T22:16:14.342842] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-16T22:16:14.567348] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T22:16:15.142886] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-16T22:16:15.928615] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T22:16:15.942773] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-16T22:16:16.072350] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-16T22:16:16.742876] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-16T22:16:17.341498] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-16T22:16:17.542779] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-16T22:16:17.759121] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T22:16:18.342785] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-16T22:16:18.421274] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T22:16:19.142811] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-16T22:16:19.789902] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-16T22:16:19.944146] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-16T22:16:19.946919] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T22:16:20.448161] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T22:16:20.742877] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-16T22:16:21.542867] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-16T22:16:22.342837] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-16T22:16:22.548050] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-16T22:16:23.142872] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-10-16T22:16:23.179831] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-16T22:16:23.187264] [INFO ] [REMOTE ] VRT: Full fetch complete (77932 records). [2025-10-16T22:16:23.187459] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-16T22:16:23.515951] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-16T22:16:23.643926] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-16T22:16:23.644024] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-16T22:16:23.645298] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-16T22:16:23.645370] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-16T22:16:23.646880] [DEBUG] [LOCAL ] VRT: Trimmed 77932 records to 54143 (keeping 200 days of data) [2025-10-16T22:16:23.952420] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-16T22:16:24.017891] [DEBUG] [LOCAL ] VRT: Primary data saved (54143 records). [2025-10-16T22:16:24.018048] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-16T22:16:24.018130] [INFO ] [MAIN ] Update Progress: 2250/2369 symbols completed. VRT took 48.3s. Estimated remaining: 16m 44s. Rate: 7.1 symbols/min [2025-10-16T22:16:24.190136] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:16:24.247231] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-16T22:16:24.274931] [DEBUG] [LOCAL ] VSTS: Loaded 48944 existing records from primary storage. [2025-10-16T22:16:24.275250] [INFO ] [MAIN ] VSTS: Loaded 48944 existing records. [2025-10-16T22:16:24.456936] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:16:24.457188] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-16T22:16:24.457238] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-16T22:16:24.457426] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-16T22:16:24.457483] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-16T22:16:24.758147] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-16T22:16:24.854118] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:16:25.542824] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-10-16T22:16:25.818604] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-10-16T22:16:25.866030] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T22:16:26.254525] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T22:16:26.342849] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-10-16T22:16:27.142797] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-16T22:16:27.251294] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T22:16:27.942838] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-16T22:16:28.742791] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-16T22:16:28.937075] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-16T22:16:28.993211] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T22:16:29.491268] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T22:16:29.542844] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-16T22:16:30.329887] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T22:16:30.342790] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-16T22:16:30.941035] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-16T22:16:30.948100] [INFO ] [REMOTE ] VSH: Full fetch complete (70908 records). [2025-10-16T22:16:30.948284] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-16T22:16:31.158705] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-16T22:16:31.378574] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-16T22:16:31.378702] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-16T22:16:31.380046] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-16T22:16:31.380116] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-16T22:16:31.381711] [DEBUG] [LOCAL ] VSH: Trimmed 70908 records to 48605 (keeping 200 days of data) [2025-10-16T22:16:31.689870] [DEBUG] [LOCAL ] VSH: Primary data saved (48605 records). [2025-10-16T22:16:31.690070] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-16T22:16:31.690185] [INFO ] [MAIN ] Update Progress: 2251/2369 symbols completed. VSH took 32.8s. Estimated remaining: 16m 35s. Rate: 7.1 symbols/min [2025-10-16T22:16:31.864738] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:16:31.904289] [DEBUG] [LOCAL ] VTEX: Loaded 42958 existing records from primary storage. [2025-10-16T22:16:31.904803] [INFO ] [MAIN ] VTEX: Loaded 42958 existing records. [2025-10-16T22:16:31.948002] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-10-16T22:16:32.111784] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:16:32.121767] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-16T22:16:32.121929] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-16T22:16:32.122574] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-16T22:16:32.122636] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-16T22:16:32.123835] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T22:16:32.497472] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:16:32.742855] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-10-16T22:16:32.898057] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T22:16:32.908070] [INFO ] [REMOTE ] VSCO: Full fetch complete (76443 records). [2025-10-16T22:16:32.908358] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-16T22:16:33.344532] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-16T22:16:33.344736] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-16T22:16:33.346437] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-16T22:16:33.346542] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-16T22:16:33.348306] [DEBUG] [LOCAL ] VSCO: Trimmed 76443 records to 53126 (keeping 200 days of data) [2025-10-16T22:16:33.551509] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-16T22:16:33.756086] [DEBUG] [LOCAL ] VSCO: Primary data saved (53126 records). [2025-10-16T22:16:33.756256] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-16T22:16:33.756998] [INFO ] [MAIN ] Update Progress: 2252/2369 symbols completed. VSCO took 39.4s. Estimated remaining: 16m 27s. Rate: 7.1 symbols/min [2025-10-16T22:16:34.035523] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:16:34.100796] [DEBUG] [LOCAL ] VTLE: Loaded 48028 existing records from primary storage. [2025-10-16T22:16:34.101275] [INFO ] [MAIN ] VTLE: Loaded 48028 existing records. [2025-10-16T22:16:34.318333] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:16:34.349942] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-16T22:16:34.351119] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-16T22:16:34.354176] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T22:16:34.365031] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-16T22:16:34.365254] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-16T22:16:34.367001] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-16T22:16:34.742522] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:16:34.773700] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-10-16T22:16:35.031308] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T22:16:35.142803] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-10-16T22:16:35.795828] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T22:16:35.942835] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-16T22:16:36.748109] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-16T22:16:36.766009] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T22:16:36.892203] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T22:16:37.542855] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-16T22:16:38.342877] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-16T22:16:38.413589] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T22:16:39.142879] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-10-16T22:16:39.184234] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T22:16:39.921886] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T22:16:39.942770] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-16T22:16:40.742874] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-16T22:16:40.861813] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T22:16:41.389594] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-16T22:16:41.542832] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-10-16T22:16:42.018953] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T22:16:42.342824] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-16T22:16:43.142840] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-16T22:16:43.942834] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-10-16T22:16:43.991865] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T22:16:44.094127] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-16T22:16:44.742842] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-10-16T22:16:44.910254] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T22:16:45.120901] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T22:16:45.542880] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-10-16T22:16:46.342867] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-16T22:16:46.914255] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-16T22:16:46.985623] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T22:16:47.142788] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-10-16T22:16:47.869956] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T22:16:47.942833] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-16T22:16:48.742824] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-16T22:16:49.254258] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-16T22:16:49.542846] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-10-16T22:16:49.802932] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-16T22:16:50.227201] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T22:16:50.342794] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-10-16T22:16:51.142834] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-16T22:16:51.268100] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T22:16:51.942824] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-10-16T22:16:52.581334] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T22:16:52.742796] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-16T22:16:52.777633] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-16T22:16:53.194167] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T22:16:53.542841] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-16T22:16:53.947494] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T22:16:54.342813] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-10-16T22:16:55.126347] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T22:16:55.142777] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-16T22:16:55.942878] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-16T22:16:56.649712] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T22:16:56.742842] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-16T22:16:56.806729] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-16T22:16:57.542793] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-10. [2025-10-16T22:16:57.642712] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T22:16:58.116221] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T22:16:58.124101] [INFO ] [REMOTE ] VTEX: Full fetch complete (60802 records). [2025-10-16T22:16:58.124262] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-16T22:16:58.347876] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-10. [2025-10-16T22:16:58.465200] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T22:16:58.498247] [INFO ] [REMOTE ] VST: Full fetch complete (77890 records). [2025-10-16T22:16:58.516573] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-16T22:16:58.642532] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-16T22:16:58.653522] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-16T22:16:58.672955] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-16T22:16:58.675519] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-16T22:16:58.754703] [DEBUG] [LOCAL ] VTEX: Trimmed 60802 records to 43293 (keeping 200 days of data) [2025-10-16T22:16:59.102431] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-16T22:16:59.102879] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-16T22:16:59.104876] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-16T22:16:59.105285] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-16T22:16:59.111744] [DEBUG] [LOCAL ] VST: Trimmed 77890 records to 54101 (keeping 200 days of data) [2025-10-16T22:16:59.169203] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-16T22:16:59.515562] [DEBUG] [LOCAL ] VTEX: Primary data saved (43293 records). [2025-10-16T22:16:59.518332] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-16T22:16:59.518690] [INFO ] [MAIN ] Update Progress: 2253/2369 symbols completed. VTEX took 27.8s. Estimated remaining: 16m 19s. Rate: 7.1 symbols/min [2025-10-16T22:16:59.695638] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:16:59.782743] [DEBUG] [LOCAL ] VTMX: Loaded 17592 existing records from primary storage. [2025-10-16T22:16:59.783508] [INFO ] [MAIN ] VTMX: Loaded 17592 existing records. [2025-10-16T22:16:59.978317] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:16:59.980366] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-16T22:16:59.981136] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-16T22:16:59.996891] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-16T22:16:59.998061] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-16T22:17:00.011872] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T22:17:00.075920] [DEBUG] [LOCAL ] VST: Primary data saved (54101 records). [2025-10-16T22:17:00.054946] [INFO ] [REMOTE ] VSTS: Full fetch complete (69797 records). [2025-10-16T22:17:00.081347] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-16T22:17:00.081259] [INFO ] [MAIN ] VST: Full history saved. [2025-10-16T22:17:00.088222] [INFO ] [MAIN ] Update Progress: 2254/2369 symbols completed. VST took 47.9s. Estimated remaining: 16m 10s. Rate: 7.1 symbols/min [2025-10-16T22:17:00.678335] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:17:00.882232] [DEBUG] [LOCAL ] VTN: Loaded 7008 existing records from primary storage. [2025-10-16T22:17:00.886751] [INFO ] [MAIN ] VTN: Loaded 7008 existing records. [2025-10-16T22:17:00.886196] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:17:00.933012] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-10-16T22:17:01.089360] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-16T22:17:01.089555] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-16T22:17:01.090892] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-16T22:17:01.091136] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-16T22:17:01.173785] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:17:01.174478] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-16T22:17:01.174583] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-16T22:17:01.175027] [DEBUG] [LOCAL ] VSTS: Trimmed 69797 records to 49292 (keeping 200 days of data) [2025-10-16T22:17:01.175101] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-16T22:17:01.175335] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-16T22:17:01.320212] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-16T22:17:01.411831] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-16T22:17:01.782957] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:17:01.783921] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-10-16T22:17:01.864578] [DEBUG] [LOCAL ] VSTS: Primary data saved (49292 records). [2025-10-16T22:17:01.864745] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-16T22:17:01.865306] [INFO ] [MAIN ] Update Progress: 2255/2369 symbols completed. VSTS took 37.8s. Estimated remaining: 16m 1s. Rate: 7.1 symbols/min [2025-10-16T22:17:02.038958] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:17:02.060315] [DEBUG] [LOCAL ] VTOL: Loaded 19622 existing records from primary storage. [2025-10-16T22:17:02.060558] [INFO ] [MAIN ] VTOL: Loaded 19622 existing records. [2025-10-16T22:17:02.253798] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:17:02.255133] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T22:17:02.255241] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-16T22:17:02.260007] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-16T22:17:02.260179] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-16T22:17:02.260219] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-16T22:17:02.349003] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-16T22:17:02.610925] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:17:02.620111] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T22:17:02.826197] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T22:17:03.048977] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-16T22:17:03.142818] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-16T22:17:03.942822] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-16T22:17:04.026379] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T22:17:04.742825] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-10-16T22:17:04.751242] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-16T22:17:05.542815] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-16T22:17:05.722042] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T22:17:06.337131] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-16T22:17:06.342762] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-16T22:17:07.109335] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T22:17:07.142867] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-16T22:17:07.875235] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T22:17:07.942824] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-16T22:17:08.569957] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-16T22:17:08.742860] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-16T22:17:09.542843] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-16T22:17:09.567127] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T22:17:10.342873] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-16T22:17:10.511620] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-16T22:17:11.013669] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-16T22:17:11.142853] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-16T22:17:11.942813] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-16T22:17:12.639999] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T22:17:12.651420] [INFO ] [REMOTE ] VTLE: Full fetch complete (68720 records). [2025-10-16T22:17:12.651610] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-16T22:17:12.652445] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-16T22:17:12.747959] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-16T22:17:13.043138] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-16T22:17:13.043239] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-16T22:17:13.044422] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-16T22:17:13.044487] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-16T22:17:13.045910] [DEBUG] [LOCAL ] VTLE: Trimmed 68720 records to 48338 (keeping 200 days of data) [2025-10-16T22:17:13.332519] [DEBUG] [LOCAL ] VTLE: Primary data saved (48338 records). [2025-10-16T22:17:13.332704] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-16T22:17:13.333314] [INFO ] [MAIN ] Update Progress: 2256/2369 symbols completed. VTLE took 39.6s. Estimated remaining: 15m 53s. Rate: 7.1 symbols/min [2025-10-16T22:17:13.502353] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:17:13.509277] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-16T22:17:13.542767] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-16T22:17:13.560810] [DEBUG] [LOCAL ] VTR: Loaded 52778 existing records from primary storage. [2025-10-16T22:17:13.561128] [INFO ] [MAIN ] VTR: Loaded 52778 existing records. [2025-10-16T22:17:13.733862] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:17:13.734102] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-16T22:17:13.734149] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-16T22:17:13.734346] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-16T22:17:13.734385] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-16T22:17:14.078384] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:17:14.342787] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-10-16T22:17:14.540818] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T22:17:15.142816] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-16T22:17:15.857307] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T22:17:15.898282] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-16T22:17:15.942782] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-16T22:17:16.728216] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-16T22:17:16.742763] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-16T22:17:17.428410] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T22:17:17.429990] [INFO ] [REMOTE ] VTN: Full fetch complete (10847 records). [2025-10-16T22:17:17.430064] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-16T22:17:17.550894] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-16T22:17:17.850962] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-16T22:17:17.851042] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-16T22:17:17.851396] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-16T22:17:17.851436] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-16T22:17:17.851898] [DEBUG] [LOCAL ] VTN: Trimmed 10847 records to 7094 (keeping 200 days of data) [2025-10-16T22:17:17.893343] [DEBUG] [LOCAL ] VTN: Primary data saved (7094 records). [2025-10-16T22:17:17.893478] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-16T22:17:17.893567] [INFO ] [MAIN ] Update Progress: 2257/2369 symbols completed. VTN took 17.8s. Estimated remaining: 15m 45s. Rate: 7.1 symbols/min [2025-10-16T22:17:18.065552] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:17:18.096547] [DEBUG] [LOCAL ] VTS: Loaded 29996 existing records from primary storage. [2025-10-16T22:17:18.096857] [INFO ] [MAIN ] VTS: Loaded 29996 existing records. [2025-10-16T22:17:18.269424] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:17:18.269689] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-16T22:17:18.269745] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-16T22:17:18.269946] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-16T22:17:18.270001] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-16T22:17:18.348007] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-16T22:17:18.631138] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:17:18.701243] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T22:17:19.142881] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-16T22:17:19.506792] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-16T22:17:19.942870] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-16T22:17:20.153755] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T22:17:20.742832] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-10-16T22:17:21.542806] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-16T22:17:21.714055] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T22:17:21.891366] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T22:17:22.145394] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T22:17:22.342893] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-16T22:17:23.142886] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-16T22:17:23.942853] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-16T22:17:24.070996] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T22:17:24.143274] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T22:17:24.742870] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-16T22:17:24.782407] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T22:17:25.542856] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-16T22:17:26.342843] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-16T22:17:26.581349] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-16T22:17:26.630935] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T22:17:27.142839] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-16T22:17:27.385520] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T22:17:27.942870] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-16T22:17:28.743003] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-16T22:17:29.017541] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T22:17:29.054310] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-16T22:17:29.542820] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-16T22:17:29.760838] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-16T22:17:30.343022] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-16T22:17:30.482572] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-16T22:17:31.142840] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-16T22:17:31.942792] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-16T22:17:32.031572] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T22:17:32.742792] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-16T22:17:32.940505] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-16T22:17:33.027019] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-16T22:17:33.542877] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-16T22:17:34.346934] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-16T22:17:34.352405] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T22:17:34.920241] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T22:17:35.142817] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-16T22:17:35.337211] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T22:17:35.942868] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-16T22:17:36.742806] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-16T22:17:36.836668] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T22:17:36.839102] [INFO ] [REMOTE ] VTOL: Full fetch complete (26179 records). [2025-10-16T22:17:36.839175] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-16T22:17:37.222419] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-16T22:17:37.222591] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-16T22:17:37.223367] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-16T22:17:37.223454] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-16T22:17:37.253000] [DEBUG] [LOCAL ] VTOL: Trimmed 26179 records to 19752 (keeping 200 days of data) [2025-10-16T22:17:37.254854] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-16T22:17:37.385623] [DEBUG] [LOCAL ] VTOL: Primary data saved (19752 records). [2025-10-16T22:17:37.385785] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-16T22:17:37.385870] [INFO ] [MAIN ] Update Progress: 2258/2369 symbols completed. VTOL took 35.5s. Estimated remaining: 15m 37s. Rate: 7.1 symbols/min [2025-10-16T22:17:37.544670] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-16T22:17:37.574133] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:17:37.605691] [DEBUG] [LOCAL ] VVR: Loaded 31167 existing records from primary storage. [2025-10-16T22:17:37.605978] [INFO ] [MAIN ] VVR: Loaded 31167 existing records. [2025-10-16T22:17:37.728349] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T22:17:37.809837] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:17:37.810086] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-16T22:17:37.810144] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-16T22:17:37.810315] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-16T22:17:37.810365] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-16T22:17:38.171263] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:17:38.342806] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-10-16T22:17:39.028473] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T22:17:39.142792] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-16T22:17:39.699031] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T22:17:39.942819] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-16T22:17:40.742885] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-16T22:17:40.804084] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T22:17:40.806686] [INFO ] [REMOTE ] VTMX: Full fetch complete (25623 records). [2025-10-16T22:17:40.806798] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-16T22:17:41.216313] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-16T22:17:41.216420] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-16T22:17:41.217335] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-16T22:17:41.217414] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-16T22:17:41.219448] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-16T22:17:41.230831] [DEBUG] [LOCAL ] VTMX: Trimmed 25623 records to 17721 (keeping 200 days of data) [2025-10-16T22:17:41.340023] [DEBUG] [LOCAL ] VTMX: Primary data saved (17721 records). [2025-10-16T22:17:41.340164] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-16T22:17:41.340273] [INFO ] [MAIN ] Update Progress: 2259/2369 symbols completed. VTMX took 41.8s. Estimated remaining: 15m 28s. Rate: 7.1 symbols/min [2025-10-16T22:17:41.513014] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:17:41.542874] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-16T22:17:41.560631] [DEBUG] [LOCAL ] VVV: Loaded 50336 existing records from primary storage. [2025-10-16T22:17:41.560961] [INFO ] [MAIN ] VVV: Loaded 50336 existing records. [2025-10-16T22:17:41.746240] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:17:41.746554] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-16T22:17:41.746631] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-16T22:17:41.746915] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-16T22:17:41.746973] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-16T22:17:42.211472] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T22:17:42.342808] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-16T22:17:42.368756] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:17:42.371216] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T22:17:42.382467] [INFO ] [REMOTE ] VTR: Full fetch complete (76507 records). [2025-10-16T22:17:42.382706] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-16T22:17:42.819145] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-16T22:17:42.819222] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-16T22:17:42.820399] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-16T22:17:42.820461] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-16T22:17:42.821909] [DEBUG] [LOCAL ] VTR: Trimmed 76507 records to 53155 (keeping 200 days of data) [2025-10-16T22:17:43.139287] [DEBUG] [LOCAL ] VTR: Primary data saved (53155 records). [2025-10-16T22:17:43.139417] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-16T22:17:43.139985] [INFO ] [MAIN ] Update Progress: 2260/2369 symbols completed. VTR took 29.8s. Estimated remaining: 15m 19s. Rate: 7.1 symbols/min [2025-10-16T22:17:43.151116] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-10-16T22:17:43.311336] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:17:43.335391] [DEBUG] [LOCAL ] VVX: Loaded 22934 existing records from primary storage. [2025-10-16T22:17:43.335629] [INFO ] [MAIN ] VVX: Loaded 22934 existing records. [2025-10-16T22:17:43.513136] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:17:43.513341] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-16T22:17:43.513388] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-16T22:17:43.513577] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-16T22:17:43.513633] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-16T22:17:43.829747] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T22:17:43.892081] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:17:43.942763] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-10-16T22:17:44.742769] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-16T22:17:44.922750] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T22:17:45.136689] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T22:17:45.542863] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-16T22:17:45.720800] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T22:17:46.342835] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-16T22:17:46.589030] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T22:17:47.142860] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-16T22:17:47.906108] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T22:17:47.942790] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-16T22:17:48.492179] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T22:17:48.742927] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-16T22:17:49.547966] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-16T22:17:49.564423] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T22:17:50.029324] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T22:17:50.342848] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-16T22:17:50.707472] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T22:17:51.142918] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-16T22:17:51.812089] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T22:17:51.942837] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-16T22:17:52.075062] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T22:17:52.742849] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-16T22:17:53.081980] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T22:17:53.542854] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-16T22:17:54.104518] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T22:17:54.342858] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-16T22:17:55.147925] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-16T22:17:55.172054] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T22:17:55.549438] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T22:17:55.942855] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-16T22:17:56.078917] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T22:17:56.082923] [INFO ] [REMOTE ] VTS: Full fetch complete (41637 records). [2025-10-16T22:17:56.083036] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-16T22:17:56.459258] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-16T22:17:56.459571] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-16T22:17:56.460438] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-16T22:17:56.460501] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-16T22:17:56.461478] [DEBUG] [LOCAL ] VTS: Trimmed 41637 records to 30212 (keeping 200 days of data) [2025-10-16T22:17:56.641663] [DEBUG] [LOCAL ] VTS: Primary data saved (30212 records). [2025-10-16T22:17:56.641804] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-16T22:17:56.641884] [INFO ] [MAIN ] Update Progress: 2261/2369 symbols completed. VTS took 38.7s. Estimated remaining: 15m 11s. Rate: 7.1 symbols/min [2025-10-16T22:17:56.747993] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-16T22:17:56.819132] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:17:56.863290] [DEBUG] [LOCAL ] VYX: Loaded 48499 existing records from primary storage. [2025-10-16T22:17:56.863609] [INFO ] [MAIN ] VYX: Loaded 48499 existing records. [2025-10-16T22:17:57.041702] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:17:57.041908] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-16T22:17:57.041955] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-16T22:17:57.042352] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-16T22:17:57.042410] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-16T22:17:57.402029] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:17:57.542814] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-10-16T22:17:57.635977] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T22:17:57.682119] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-16T22:17:58.342909] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-16T22:17:58.801686] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T22:17:59.142891] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-16T22:17:59.625602] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T22:17:59.942800] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-16T22:18:00.742879] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-16T22:18:00.834026] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T22:18:01.281326] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T22:18:01.542856] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-16T22:18:01.895491] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T22:18:02.342838] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-16T22:18:02.730297] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T22:18:03.142832] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-16T22:18:03.937285] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T22:18:03.947929] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-16T22:18:04.389368] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T22:18:04.742835] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-16T22:18:05.300494] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T22:18:05.542881] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-16T22:18:06.342842] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-16T22:18:06.405416] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T22:18:06.825323] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-16T22:18:07.142815] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-16T22:18:07.942800] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-16T22:18:08.053963] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T22:18:08.649114] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T22:18:08.742846] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-16T22:18:09.542795] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-16T22:18:09.659974] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T22:18:10.158021] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T22:18:10.162996] [INFO ] [REMOTE ] VVR: Full fetch complete (46914 records). [2025-10-16T22:18:10.163098] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-16T22:18:10.349195] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-16T22:18:10.546104] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-16T22:18:10.546281] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-16T22:18:10.547347] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-16T22:18:10.547471] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-16T22:18:10.548716] [DEBUG] [LOCAL ] VVR: Trimmed 46914 records to 31476 (keeping 200 days of data) [2025-10-16T22:18:10.676803] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T22:18:10.751119] [DEBUG] [LOCAL ] VVR: Primary data saved (31476 records). [2025-10-16T22:18:10.751258] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-16T22:18:10.751337] [INFO ] [MAIN ] Update Progress: 2262/2369 symbols completed. VVR took 33.4s. Estimated remaining: 15m 3s. Rate: 7.1 symbols/min [2025-10-16T22:18:10.917408] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:18:10.967210] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-16T22:18:10.967544] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-10-16T22:18:11.142454] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:18:11.142704] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-16T22:18:11.142762] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-16T22:18:11.142825] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-16T22:18:11.143123] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-16T22:18:11.144764] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-16T22:18:11.499902] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:18:11.942802] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-16T22:18:12.175569] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T22:18:12.742836] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-10-16T22:18:12.832356] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T22:18:13.071167] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T22:18:13.542892] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-16T22:18:14.342825] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-16T22:18:15.142866] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-16T22:18:15.195344] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-16T22:18:15.243602] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T22:18:15.714683] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T22:18:15.942893] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-16T22:18:16.035547] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T22:18:16.742825] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-16T22:18:17.542818] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-16T22:18:17.952612] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T22:18:17.956374] [INFO ] [REMOTE ] VVX: Full fetch complete (33153 records). [2025-10-16T22:18:17.956488] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-16T22:18:18.335191] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-16T22:18:18.335265] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-16T22:18:18.335943] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-16T22:18:18.336005] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-16T22:18:18.336793] [DEBUG] [LOCAL ] VVX: Trimmed 33153 records to 23115 (keeping 200 days of data) [2025-10-16T22:18:18.386854] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-16T22:18:18.481993] [DEBUG] [LOCAL ] VVX: Primary data saved (23115 records). [2025-10-16T22:18:18.482290] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-16T22:18:18.492415] [INFO ] [MAIN ] Update Progress: 2263/2369 symbols completed. VVX took 35.4s. Estimated remaining: 14m 54s. Rate: 7.1 symbols/min [2025-10-16T22:18:18.614665] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-16T22:18:18.699184] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:18:18.749513] [DEBUG] [LOCAL ] W: Loaded 53435 existing records from primary storage. [2025-10-16T22:18:18.749920] [INFO ] [MAIN ] W: Loaded 53435 existing records. [2025-10-16T22:18:18.925478] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:18:18.925900] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-16T22:18:18.926037] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-16T22:18:18.926459] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-16T22:18:18.926523] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-16T22:18:19.100581] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T22:18:19.154835] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-16T22:18:19.179672] [INFO ] [REMOTE ] VVV: Full fetch complete (72623 records). [2025-10-16T22:18:19.202817] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-16T22:18:19.415878] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:18:19.698789] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-16T22:18:19.698917] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-16T22:18:19.700238] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-16T22:18:19.700365] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-16T22:18:19.702066] [DEBUG] [LOCAL ] VVV: Trimmed 72623 records to 50661 (keeping 200 days of data) [2025-10-16T22:18:19.943230] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-10-16T22:18:20.021599] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T22:18:20.050562] [DEBUG] [LOCAL ] VVV: Primary data saved (50661 records). [2025-10-16T22:18:20.050715] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-16T22:18:20.050807] [INFO ] [MAIN ] Update Progress: 2264/2369 symbols completed. VVV took 38.7s. Estimated remaining: 14m 46s. Rate: 7.1 symbols/min [2025-10-16T22:18:20.216932] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:18:20.258059] [DEBUG] [LOCAL ] WAB: Loaded 43966 existing records from primary storage. [2025-10-16T22:18:20.258376] [INFO ] [MAIN ] WAB: Loaded 43966 existing records. [2025-10-16T22:18:20.431560] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:18:20.431830] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-16T22:18:20.431889] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-16T22:18:20.432068] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-16T22:18:20.432107] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-16T22:18:20.749426] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-16T22:18:20.838955] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:18:21.261104] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-16T22:18:21.547944] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-16T22:18:21.564078] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T22:18:22.342885] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-10-16T22:18:22.419073] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T22:18:23.142917] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-16T22:18:23.942872] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-16T22:18:24.087749] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T22:18:24.099221] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-16T22:18:24.742919] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-16T22:18:25.010201] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T22:18:25.542864] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-16T22:18:25.749199] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T22:18:26.083685] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T22:18:26.342900] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-16T22:18:27.142810] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-16T22:18:27.938921] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-16T22:18:27.949549] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-16T22:18:28.000830] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T22:18:28.742812] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-16T22:18:28.845250] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T22:18:29.542850] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-16T22:18:29.760582] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T22:18:30.152031] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T22:18:30.157925] [INFO ] [REMOTE ] VYX: Full fetch complete (70253 records). [2025-10-16T22:18:30.158053] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-16T22:18:30.348092] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-16T22:18:30.539737] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-16T22:18:30.539830] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-16T22:18:30.541000] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-16T22:18:30.541070] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-16T22:18:30.542491] [DEBUG] [LOCAL ] VYX: Trimmed 70253 records to 48829 (keeping 200 days of data) [2025-10-16T22:18:30.830287] [DEBUG] [LOCAL ] VYX: Primary data saved (48829 records). [2025-10-16T22:18:30.830426] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-16T22:18:30.830507] [INFO ] [MAIN ] Update Progress: 2265/2369 symbols completed. VYX took 34.2s. Estimated remaining: 14m 37s. Rate: 7.1 symbols/min [2025-10-16T22:18:30.996960] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:18:31.037350] [DEBUG] [LOCAL ] WAL: Loaded 45512 existing records from primary storage. [2025-10-16T22:18:31.037680] [INFO ] [MAIN ] WAL: Loaded 45512 existing records. [2025-10-16T22:18:31.148078] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-16T22:18:31.216345] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:18:31.216721] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-16T22:18:31.216825] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-16T22:18:31.217019] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-16T22:18:31.217058] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-16T22:18:31.577154] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:18:31.606116] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-16T22:18:31.942798] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-16T22:18:32.442374] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-16T22:18:32.742882] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-10-16T22:18:33.542795] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-16T22:18:33.599762] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-16T22:18:33.761482] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T22:18:33.918730] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T22:18:34.342901] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-16T22:18:35.148022] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-16T22:18:35.167375] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T22:18:35.906890] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T22:18:35.942776] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-16T22:18:36.742871] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-16T22:18:37.462541] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T22:18:37.548025] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-16T22:18:37.580261] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-16T22:18:38.342854] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-16T22:18:38.850806] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-16T22:18:39.142865] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-16T22:18:39.212618] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T22:18:39.948774] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-16T22:18:39.961072] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T22:18:40.742916] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-16T22:18:40.987430] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-16T22:18:41.542829] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-16T22:18:42.092294] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T22:18:42.161594] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-16T22:18:42.342868] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-16T22:18:43.142840] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-16T22:18:43.577639] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-16T22:18:43.634194] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T22:18:43.942851] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-16T22:18:44.537739] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T22:18:44.742811] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-16T22:18:45.542852] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-16T22:18:46.357073] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-16T22:18:46.365503] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-16T22:18:46.410629] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T22:18:47.132021] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T22:18:47.143008] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-16T22:18:47.942850] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-16T22:18:48.404301] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-16T22:18:48.471325] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T22:18:48.742897] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-16T22:18:49.481463] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T22:18:49.542819] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-16T22:18:50.342880] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-16T22:18:51.127117] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-16T22:18:51.142792] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-16T22:18:51.263530] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T22:18:51.889807] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T22:18:51.898748] [INFO ] [REMOTE ] VZ: Full fetch complete (77971 records). [2025-10-16T22:18:51.898999] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-16T22:18:51.948004] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-16T22:18:52.385100] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-16T22:18:52.384940] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-16T22:18:52.385306] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-16T22:18:52.399873] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-16T22:18:52.400260] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-16T22:18:52.402697] [DEBUG] [LOCAL ] VZ: Trimmed 77971 records to 54181 (keeping 200 days of data) [2025-10-16T22:18:52.755705] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-16T22:18:52.766407] [DEBUG] [LOCAL ] VZ: Primary data saved (54181 records). [2025-10-16T22:18:52.767453] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-16T22:18:52.768203] [INFO ] [MAIN ] Update Progress: 2266/2369 symbols completed. VZ took 42.0s. Estimated remaining: 14m 30s. Rate: 7.1 symbols/min [2025-10-16T22:18:52.967636] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:18:53.004193] [DEBUG] [LOCAL ] WAT: Loaded 35821 existing records from primary storage. [2025-10-16T22:18:53.004480] [INFO ] [MAIN ] WAT: Loaded 35821 existing records. [2025-10-16T22:18:53.178122] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:18:53.178388] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-16T22:18:53.178437] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-16T22:18:53.178680] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-16T22:18:53.178737] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-16T22:18:53.551253] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-16T22:18:53.558633] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:18:53.626810] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T22:18:54.155139] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-16T22:18:54.162139] [INFO ] [REMOTE ] WAB: Full fetch complete (64347 records). [2025-10-16T22:18:54.162334] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-16T22:18:54.347255] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-10-16T22:18:54.607123] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-16T22:18:54.630917] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-16T22:18:54.631153] [INFO ] [REMOTE ] W: Full fetch complete (77537 records). [2025-10-16T22:18:54.631522] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-16T22:18:54.633836] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-16T22:18:54.634070] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-16T22:18:54.633966] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-16T22:18:54.733131] [DEBUG] [LOCAL ] WAB: Trimmed 64347 records to 44289 (keeping 200 days of data) [2025-10-16T22:18:55.152347] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-16T22:18:55.307248] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-16T22:18:55.307662] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-16T22:18:55.309672] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-16T22:18:55.310272] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-16T22:18:55.316492] [DEBUG] [LOCAL ] W: Trimmed 77537 records to 53825 (keeping 200 days of data) [2025-10-16T22:18:55.687037] [DEBUG] [LOCAL ] W: Primary data saved (53825 records). [2025-10-16T22:18:55.689003] [INFO ] [MAIN ] W: Full history saved. [2025-10-16T22:18:55.692753] [DEBUG] [LOCAL ] WAB: Primary data saved (44289 records). [2025-10-16T22:18:55.689786] [INFO ] [MAIN ] Update Progress: 2267/2369 symbols completed. W took 37.2s. Estimated remaining: 14m 21s. Rate: 7.1 symbols/min [2025-10-16T22:18:55.692975] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-16T22:18:55.713810] [INFO ] [MAIN ] Update Progress: 2268/2369 symbols completed. WAB took 35.7s. Estimated remaining: 14m 12s. Rate: 7.1 symbols/min [2025-10-16T22:18:56.012370] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:18:56.058414] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-16T22:18:56.061877] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:18:56.062109] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-16T22:18:56.062300] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-16T22:18:56.062499] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-16T22:18:56.063007] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-16T22:18:56.069783] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-16T22:18:56.153731] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T22:18:56.184900] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-16T22:18:56.438868] [DEBUG] [LOCAL ] WBS: Loaded 48740 existing records from primary storage. [2025-10-16T22:18:56.461891] [INFO ] [MAIN ] WBS: Loaded 48740 existing records. [2025-10-16T22:18:56.581257] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:18:56.678561] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:18:56.679064] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-16T22:18:56.679179] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-16T22:18:56.679490] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-16T22:18:56.679540] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-16T22:18:56.752368] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-10-16T22:18:56.999979] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T22:18:57.031285] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-10-16T22:18:57.071690] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T22:18:57.106497] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-16T22:18:57.106631] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T22:18:57.106412] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:18:57.107371] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-16T22:18:57.109584] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-16T22:18:57.108037] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-16T22:18:57.119051] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-16T22:18:57.119407] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-16T22:18:57.119491] [INFO ] [MAIN ] Update Progress: 2269/2369 symbols completed. WBI took 1.4s. Estimated remaining: 14m 3s. Rate: 7.1 symbols/min [2025-10-16T22:18:57.286239] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:18:57.297518] [DEBUG] [LOCAL ] WBX: Loaded 10429 existing records from primary storage. [2025-10-16T22:18:57.297743] [INFO ] [MAIN ] WBX: Loaded 10429 existing records. [2025-10-16T22:18:57.472086] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:18:57.472396] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-16T22:18:57.472472] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-16T22:18:57.472839] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-16T22:18:57.472898] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-16T22:18:57.545976] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-10-16T22:18:57.795687] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T22:18:57.854684] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:18:58.342868] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-16T22:18:59.142829] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-10-16T22:18:59.201424] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T22:18:59.419427] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T22:18:59.942856] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-16T22:19:00.469369] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T22:19:00.742833] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-16T22:19:01.542875] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-16T22:19:01.581072] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T22:19:02.024584] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T22:19:02.342826] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-16T22:19:02.948768] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T22:19:02.955191] [INFO ] [REMOTE ] WAL: Full fetch complete (67050 records). [2025-10-16T22:19:02.955320] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-16T22:19:03.148034] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-16T22:19:03.338101] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-16T22:19:03.338178] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-16T22:19:03.339483] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-16T22:19:03.339568] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-16T22:19:03.340874] [DEBUG] [LOCAL ] WAL: Trimmed 67050 records to 45902 (keeping 200 days of data) [2025-10-16T22:19:03.642184] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T22:19:03.650170] [DEBUG] [LOCAL ] WAL: Primary data saved (45902 records). [2025-10-16T22:19:03.650246] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-16T22:19:03.650327] [INFO ] [MAIN ] Update Progress: 2270/2369 symbols completed. WAL took 32.8s. Estimated remaining: 13m 55s. Rate: 7.1 symbols/min [2025-10-16T22:19:03.814026] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:19:03.850337] [DEBUG] [LOCAL ] WCC: Loaded 39073 existing records from primary storage. [2025-10-16T22:19:03.850611] [INFO ] [MAIN ] WCC: Loaded 39073 existing records. [2025-10-16T22:19:03.948798] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-16T22:19:04.025101] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:19:04.025322] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-16T22:19:04.025370] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-16T22:19:04.025571] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-16T22:19:04.025626] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-16T22:19:04.389896] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:19:04.471198] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T22:19:04.742827] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-10-16T22:19:04.849619] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-16T22:19:05.542861] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-16T22:19:06.280001] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T22:19:06.342882] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-16T22:19:06.375925] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T22:19:07.142874] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-16T22:19:07.845153] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T22:19:07.942824] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-16T22:19:08.664415] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T22:19:08.742789] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-16T22:19:09.552164] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-16T22:19:09.559193] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T22:19:10.331747] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T22:19:10.342758] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-16T22:19:10.571245] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T22:19:11.142890] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-16T22:19:11.949144] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-16T22:19:11.965937] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T22:19:12.259826] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T22:19:12.742880] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-16T22:19:13.307900] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T22:19:13.542827] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-16T22:19:14.342860] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-16T22:19:14.486602] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T22:19:15.017454] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T22:19:15.142799] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-16T22:19:15.818409] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T22:19:15.942849] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-16T22:19:16.506986] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T22:19:16.518751] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-16T22:19:16.742900] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-16T22:19:17.370632] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T22:19:17.542913] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-16T22:19:18.342855] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-16T22:19:19.142867] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-16T22:19:19.174855] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T22:19:19.443809] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T22:19:19.942840] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-16T22:19:20.590048] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T22:19:20.742847] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-16T22:19:20.810083] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T22:19:21.542861] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-16T22:19:22.205404] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-16T22:19:22.348048] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-16T22:19:22.365326] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T22:19:23.142833] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-16T22:19:23.893136] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T22:19:23.942780] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-16T22:19:24.309590] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T22:19:24.742792] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-16T22:19:25.311349] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T22:19:25.482810] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-16T22:19:25.542768] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-16T22:19:26.130809] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T22:19:26.135936] [INFO ] [REMOTE ] WAT: Full fetch complete (50594 records). [2025-10-16T22:19:26.136022] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-16T22:19:26.352089] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-16T22:19:26.517918] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-16T22:19:26.518012] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-16T22:19:26.519089] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-16T22:19:26.519156] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-16T22:19:26.520385] [DEBUG] [LOCAL ] WAT: Trimmed 50594 records to 36136 (keeping 200 days of data) [2025-10-16T22:19:26.811981] [DEBUG] [LOCAL ] WAT: Primary data saved (36136 records). [2025-10-16T22:19:26.812157] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-16T22:19:26.812247] [INFO ] [MAIN ] Update Progress: 2271/2369 symbols completed. WAT took 34.0s. Estimated remaining: 13m 47s. Rate: 7.1 symbols/min [2025-10-16T22:19:27.089819] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:19:27.098790] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T22:19:27.102085] [INFO ] [REMOTE ] WBX: Full fetch complete (22968 records). [2025-10-16T22:19:27.102247] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-16T22:19:27.143142] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-16T22:19:27.410614] [DEBUG] [LOCAL ] WCN: Loaded 48049 existing records from primary storage. [2025-10-16T22:19:27.441808] [INFO ] [MAIN ] WCN: Loaded 48049 existing records. [2025-10-16T22:19:27.816562] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-16T22:19:27.824379] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-16T22:19:27.832539] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-16T22:19:27.834090] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-16T22:19:27.837631] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:19:27.837919] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-16T22:19:27.838126] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-16T22:19:27.838437] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-16T22:19:27.838494] [DEBUG] [LOCAL ] WBX: Trimmed 22968 records to 10474 (keeping 200 days of data) [2025-10-16T22:19:27.838626] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-16T22:19:27.943474] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-16T22:19:28.270210] [DEBUG] [LOCAL ] WBX: Primary data saved (10474 records). [2025-10-16T22:19:28.274853] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:19:28.275147] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-16T22:19:28.275282] [INFO ] [MAIN ] Update Progress: 2272/2369 symbols completed. WBX took 31.2s. Estimated remaining: 13m 38s. Rate: 7.1 symbols/min [2025-10-16T22:19:28.443957] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:19:28.465872] [DEBUG] [LOCAL ] WD: Loaded 23147 existing records from primary storage. [2025-10-16T22:19:28.466121] [INFO ] [MAIN ] WD: Loaded 23147 existing records. [2025-10-16T22:19:28.645868] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:19:28.646318] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-16T22:19:28.646432] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-16T22:19:28.646622] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-16T22:19:28.646775] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-16T22:19:28.746403] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-10-16T22:19:28.850789] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T22:19:29.047296] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:19:29.552413] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-16T22:19:29.573428] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T22:19:30.342818] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-16T22:19:30.462500] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T22:19:30.932083] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T22:19:30.936969] [INFO ] [REMOTE ] WCC: Full fetch complete (57477 records). [2025-10-16T22:19:30.937137] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-16T22:19:31.151101] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-16T22:19:31.326728] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-16T22:19:31.326812] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-16T22:19:31.328064] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-16T22:19:31.328131] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-16T22:19:31.329385] [DEBUG] [LOCAL ] WCC: Trimmed 57477 records to 39326 (keeping 200 days of data) [2025-10-16T22:19:31.580794] [DEBUG] [LOCAL ] WCC: Primary data saved (39326 records). [2025-10-16T22:19:31.580934] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-16T22:19:31.581015] [INFO ] [MAIN ] Update Progress: 2273/2369 symbols completed. WCC took 27.9s. Estimated remaining: 13m 30s. Rate: 7.1 symbols/min [2025-10-16T22:19:31.767356] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:19:31.786676] [DEBUG] [LOCAL ] WDH: Loaded 18120 existing records from primary storage. [2025-10-16T22:19:31.786922] [INFO ] [MAIN ] WDH: Loaded 18120 existing records. [2025-10-16T22:19:31.955009] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-10-16T22:19:31.988011] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:19:31.988870] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-16T22:19:31.988984] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-16T22:19:31.989184] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-16T22:19:31.989247] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-16T22:19:32.182938] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T22:19:32.404007] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:19:32.742848] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-16T22:19:32.943121] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-16T22:19:33.004415] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-16T22:19:33.542897] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-10-16T22:19:34.279592] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T22:19:34.342780] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-16T22:19:34.571025] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T22:19:35.142896] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-16T22:19:35.397027] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T22:19:35.942839] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-16T22:19:36.586056] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T22:19:36.593598] [INFO ] [REMOTE ] WBS: Full fetch complete (70203 records). [2025-10-16T22:19:36.593978] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-16T22:19:36.751988] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-16T22:19:36.754521] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T22:19:37.072281] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-16T22:19:37.072383] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-16T22:19:37.073776] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-16T22:19:37.073844] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-16T22:19:37.075254] [DEBUG] [LOCAL ] WBS: Trimmed 70203 records to 49129 (keeping 200 days of data) [2025-10-16T22:19:37.330448] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T22:19:37.398835] [DEBUG] [LOCAL ] WBS: Primary data saved (49129 records). [2025-10-16T22:19:37.399015] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-16T22:19:37.399130] [INFO ] [MAIN ] Update Progress: 2274/2369 symbols completed. WBS took 41.7s. Estimated remaining: 13m 21s. Rate: 7.1 symbols/min [2025-10-16T22:19:37.547922] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-16T22:19:37.572772] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:19:37.595438] [DEBUG] [LOCAL ] WDI: Loaded 21237 existing records from primary storage. [2025-10-16T22:19:37.595736] [INFO ] [MAIN ] WDI: Loaded 21237 existing records. [2025-10-16T22:19:37.776023] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:19:37.776259] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-16T22:19:37.776307] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-16T22:19:37.776498] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-16T22:19:37.776555] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-16T22:19:38.152795] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:19:38.342790] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-16T22:19:38.743024] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T22:19:39.139897] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T22:19:39.142899] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-16T22:19:39.942811] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-10-16T22:19:40.322496] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-16T22:19:40.742790] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-16T22:19:41.130161] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T22:19:41.542893] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-16T22:19:42.342796] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-16T22:19:42.528550] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T22:19:42.652859] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T22:19:43.142859] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-16T22:19:43.446132] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T22:19:43.942847] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-16T22:19:43.970351] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T22:19:44.742856] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-16T22:19:44.854149] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T22:19:45.542865] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-16T22:19:46.342818] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-16T22:19:46.544767] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T22:19:46.578600] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T22:19:47.102926] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T22:19:47.142864] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-16T22:19:47.942863] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-16T22:19:48.742894] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-16T22:19:49.001202] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-16T22:19:49.047002] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T22:19:49.542869] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-16T22:19:49.994755] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T22:19:50.342816] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-16T22:19:50.739819] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-16T22:19:51.142821] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-16T22:19:51.942796] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-16T22:19:52.088463] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T22:19:52.155752] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T22:19:52.742840] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-16T22:19:53.009392] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-16T22:19:53.542844] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-16T22:19:53.587074] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T22:19:54.342849] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-16T22:19:55.142877] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-16T22:19:55.184388] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T22:19:55.423084] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T22:19:55.942847] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-16T22:19:56.070409] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T22:19:56.742839] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-16T22:19:56.918684] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T22:19:56.921457] [INFO ] [REMOTE ] WD: Full fetch complete (33255 records). [2025-10-16T22:19:56.921580] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-16T22:19:57.301917] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-16T22:19:57.302016] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-16T22:19:57.303068] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-16T22:19:57.303133] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-16T22:19:57.304190] [DEBUG] [LOCAL ] WD: Trimmed 33255 records to 23265 (keeping 200 days of data) [2025-10-16T22:19:57.469251] [DEBUG] [LOCAL ] WD: Primary data saved (23265 records). [2025-10-16T22:19:57.469764] [INFO ] [MAIN ] WD: Full history saved. [2025-10-16T22:19:57.469876] [INFO ] [MAIN ] Update Progress: 2275/2369 symbols completed. WD took 29.2s. Estimated remaining: 13m 13s. Rate: 7.1 symbols/min [2025-10-16T22:19:57.549881] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-16T22:19:57.655303] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:19:57.704051] [DEBUG] [LOCAL ] WDS: Loaded 43167 existing records from primary storage. [2025-10-16T22:19:57.704566] [INFO ] [MAIN ] WDS: Loaded 43167 existing records. [2025-10-16T22:19:57.900404] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:19:57.900946] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-16T22:19:57.901110] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-16T22:19:57.915280] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-16T22:19:57.916190] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-16T22:19:57.915957] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-16T22:19:58.290231] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:19:58.342817] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-16T22:19:59.142913] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-10-16T22:19:59.401267] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T22:19:59.498562] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T22:19:59.942876] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-16T22:20:00.742804] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-16T22:20:00.865311] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T22:20:01.270204] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T22:20:01.542827] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-16T22:20:02.342904] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-16T22:20:02.464833] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T22:20:03.142890] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-16T22:20:03.236488] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T22:20:03.275359] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T22:20:03.942851] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-16T22:20:04.257104] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-16T22:20:04.742849] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-16T22:20:05.542909] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-16T22:20:05.546702] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T22:20:06.088708] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T22:20:06.342911] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-16T22:20:07.008839] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T22:20:07.142823] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-16T22:20:07.637244] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-16T22:20:07.641438] [INFO ] [REMOTE ] WDH: Full fetch complete (23826 records). [2025-10-16T22:20:07.641521] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-16T22:20:07.948162] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-16T22:20:08.052677] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-16T22:20:08.052807] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-16T22:20:08.053811] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-16T22:20:08.053879] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-16T22:20:08.054711] [DEBUG] [LOCAL ] WDH: Trimmed 23826 records to 18241 (keeping 200 days of data) [2025-10-16T22:20:08.172265] [DEBUG] [LOCAL ] WDH: Primary data saved (18241 records). [2025-10-16T22:20:08.172433] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-16T22:20:08.172526] [INFO ] [MAIN ] Update Progress: 2276/2369 symbols completed. WDH took 36.6s. Estimated remaining: 13m 5s. Rate: 7.1 symbols/min [2025-10-16T22:20:08.340779] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:20:08.350515] [DEBUG] [LOCAL ] WEA: Loaded 7761 existing records from primary storage. [2025-10-16T22:20:08.350778] [INFO ] [MAIN ] WEA: Loaded 7761 existing records. [2025-10-16T22:20:08.465028] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T22:20:08.497462] [INFO ] [REMOTE ] WCN: Full fetch complete (69548 records). [2025-10-16T22:20:08.519586] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-16T22:20:08.579983] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:20:08.618172] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-16T22:20:08.618272] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-16T22:20:08.649177] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-16T22:20:08.651875] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-16T22:20:08.743875] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-16T22:20:09.238252] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-16T22:20:09.238626] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-16T22:20:09.250396] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-16T22:20:09.255577] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-16T22:20:09.319005] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:20:09.320242] [DEBUG] [LOCAL ] WCN: Trimmed 69548 records to 48419 (keeping 200 days of data) [2025-10-16T22:20:09.542992] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-10-16T22:20:09.579882] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T22:20:09.663089] [DEBUG] [LOCAL ] WCN: Primary data saved (48419 records). [2025-10-16T22:20:09.663232] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-16T22:20:09.663314] [INFO ] [MAIN ] Update Progress: 2277/2369 symbols completed. WCN took 42.9s. Estimated remaining: 12m 56s. Rate: 7.1 symbols/min [2025-10-16T22:20:09.864543] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T22:20:10.051699] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-16T22:20:10.342854] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-16T22:20:11.142810] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-16T22:20:11.214563] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T22:20:11.218298] [INFO ] [REMOTE ] WDI: Full fetch complete (30382 records). [2025-10-16T22:20:11.218469] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-16T22:20:11.613949] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-16T22:20:11.614065] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-16T22:20:11.615352] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-16T22:20:11.615421] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-16T22:20:11.616600] [DEBUG] [LOCAL ] WDI: Trimmed 30382 records to 21363 (keeping 200 days of data) [2025-10-16T22:20:11.759159] [DEBUG] [LOCAL ] WDI: Primary data saved (21363 records). [2025-10-16T22:20:11.759341] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-16T22:20:11.759443] [INFO ] [MAIN ] Update Progress: 2278/2369 symbols completed. WDI took 34.4s. Estimated remaining: 12m 47s. Rate: 7.1 symbols/min [2025-10-16T22:20:11.942859] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-16T22:20:12.632541] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T22:20:12.742785] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-16T22:20:12.867975] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T22:20:13.326174] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T22:20:13.542889] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-16T22:20:14.342891] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-16T22:20:14.942088] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T22:20:15.151372] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-16T22:20:15.153554] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T22:20:15.842508] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-16T22:20:15.942832] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-16T22:20:16.742870] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-16T22:20:17.493766] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T22:20:17.517341] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T22:20:17.542814] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-16T22:20:18.283083] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T22:20:18.342777] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-16T22:20:19.114921] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T22:20:19.142800] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-16T22:20:19.842883] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-16T22:20:19.942928] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-16T22:20:20.661386] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T22:20:20.742974] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-16T22:20:21.542890] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-16T22:20:22.285197] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T22:20:22.287144] [INFO ] [REMOTE ] WEA: Full fetch complete (10042 records). [2025-10-16T22:20:22.287219] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-16T22:20:22.615237] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-16T22:20:22.669394] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-16T22:20:22.676749] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-16T22:20:22.676960] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-16T22:20:22.677825] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-16T22:20:22.677886] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-16T22:20:22.678397] [DEBUG] [LOCAL ] WEA: Trimmed 10042 records to 7830 (keeping 200 days of data) [2025-10-16T22:20:22.726629] [DEBUG] [LOCAL ] WEA: Primary data saved (7830 records). [2025-10-16T22:20:22.726795] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-16T22:20:22.726884] [INFO ] [MAIN ] Update Progress: 2279/2369 symbols completed. WEA took 14.6s. Estimated remaining: 12m 39s. Rate: 7.1 symbols/min [2025-10-16T22:20:24.139049] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T22:20:24.147929] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-16T22:20:25.814809] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T22:20:25.824168] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-16T22:20:27.186725] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T22:20:27.192603] [INFO ] [REMOTE ] WDS: Full fetch complete (64268 records). [2025-10-16T22:20:27.192802] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-16T22:20:27.586312] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-16T22:20:27.586428] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-16T22:20:27.587575] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-16T22:20:27.587659] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-16T22:20:27.589111] [DEBUG] [LOCAL ] WDS: Trimmed 64268 records to 43496 (keeping 200 days of data) [2025-10-16T22:20:27.851344] [DEBUG] [LOCAL ] WDS: Primary data saved (43496 records). [2025-10-16T22:20:27.851469] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-16T22:20:27.852055] [INFO ] [MAIN ] Update Progress: 2280/2369 symbols completed. WDS took 30.4s. Estimated remaining: 12m 30s. Rate: 7.1 symbols/min [2025-10-16T22:20:28.416535] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:20:28.482498] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:20:28.527073] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:20:28.550019] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:20:28.592757] [DEBUG] [LOCAL ] WES: Loaded 48498 existing records from primary storage. [2025-10-16T22:20:28.593705] [INFO ] [MAIN ] WES: Loaded 48498 existing records. [2025-10-16T22:20:28.786769] [DEBUG] [LOCAL ] WELL: Loaded 52330 existing records from primary storage. [2025-10-16T22:20:28.788154] [DEBUG] [LOCAL ] WEAV: Loaded 42273 existing records from primary storage. [2025-10-16T22:20:28.788367] [INFO ] [MAIN ] WELL: Loaded 52330 existing records. [2025-10-16T22:20:28.789127] [INFO ] [MAIN ] WEAV: Loaded 42273 existing records. [2025-10-16T22:20:28.917922] [DEBUG] [LOCAL ] WEC: Loaded 52174 existing records from primary storage. [2025-10-16T22:20:28.975763] [INFO ] [MAIN ] WEC: Loaded 52174 existing records. [2025-10-16T22:20:28.997952] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:20:29.051701] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-16T22:20:29.126682] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-16T22:20:29.258764] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-16T22:20:29.313267] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-16T22:20:29.373904] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:20:29.456507] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:20:29.516745] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:20:29.504722] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-16T22:20:29.530195] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-16T22:20:29.524858] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-16T22:20:29.551157] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-16T22:20:29.551329] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-16T22:20:29.530348] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-16T22:20:29.551532] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-16T22:20:29.568697] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-16T22:20:29.562011] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-16T22:20:29.594618] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-16T22:20:29.615169] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-16T22:20:29.754759] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-16T22:20:30.391281] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:20:30.445430] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-10-16T22:20:30.891702] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:20:30.913460] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-10-16T22:20:31.035342] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:20:31.045950] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-10-16T22:20:31.068576] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:20:31.068992] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-10-16T22:20:32.271451] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T22:20:32.280941] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-16T22:20:32.519588] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T22:20:32.529535] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-16T22:20:32.789083] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T22:20:32.800054] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-16T22:20:32.901533] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T22:20:32.913371] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-16T22:20:33.578341] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T22:20:33.588358] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-16T22:20:33.725352] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T22:20:33.735287] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-16T22:20:34.534398] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T22:20:34.545413] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-16T22:20:34.639630] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T22:20:34.650091] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-16T22:20:35.120913] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T22:20:35.130488] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-16T22:20:35.197554] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T22:20:35.206477] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-16T22:20:35.950661] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T22:20:35.960896] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-16T22:20:36.370835] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-16T22:20:36.642324] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T22:20:36.742781] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-16T22:20:36.955295] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T22:20:37.544949] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-16T22:20:37.548525] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T22:20:37.804470] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T22:20:38.342874] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-16T22:20:39.142861] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-16T22:20:39.507015] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-16T22:20:39.855481] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T22:20:39.942808] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-16T22:20:40.742897] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-16T22:20:40.825527] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T22:20:41.364958] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T22:20:41.542860] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-16T22:20:42.291814] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T22:20:42.342807] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-16T22:20:43.142873] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-16T22:20:43.645584] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-16T22:20:43.942802] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-16T22:20:44.224713] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-16T22:20:44.745777] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-16T22:20:44.751377] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T22:20:45.542793] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-16T22:20:45.825238] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-16T22:20:46.342801] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-16T22:20:46.573762] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T22:20:47.026875] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T22:20:47.142819] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-16T22:20:47.942874] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-16T22:20:48.182320] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-16T22:20:48.742845] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-16T22:20:49.179717] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-16T22:20:49.441253] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T22:20:49.542822] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-16T22:20:50.342871] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-16T22:20:50.470501] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T22:20:51.142849] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-16T22:20:51.323905] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T22:20:51.848485] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T22:20:51.942868] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-16T22:20:52.722592] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-16T22:20:52.742806] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-16T22:20:53.271476] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T22:20:53.542776] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-16T22:20:54.059829] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T22:20:54.342815] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-16T22:20:55.149031] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-16T22:20:55.162467] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T22:20:55.349829] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-16T22:20:55.358527] [INFO ] [REMOTE ] WEAV: Full fetch complete (61833 records). [2025-10-16T22:20:55.358776] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-16T22:20:55.759110] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-16T22:20:55.759193] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-16T22:20:55.760280] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-16T22:20:55.760343] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-16T22:20:55.761531] [DEBUG] [LOCAL ] WEAV: Trimmed 61833 records to 42602 (keeping 200 days of data) [2025-10-16T22:20:55.952421] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-16T22:20:56.003273] [DEBUG] [LOCAL ] WEAV: Primary data saved (42602 records). [2025-10-16T22:20:56.003397] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-16T22:20:56.003472] [INFO ] [MAIN ] Update Progress: 2281/2369 symbols completed. WEAV took 28.2s. Estimated remaining: 12m 23s. Rate: 7.1 symbols/min [2025-10-16T22:20:56.171463] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:20:56.204420] [DEBUG] [LOCAL ] WEX: Loaded 32945 existing records from primary storage. [2025-10-16T22:20:56.204733] [INFO ] [MAIN ] WEX: Loaded 32945 existing records. [2025-10-16T22:20:56.377861] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:20:56.378049] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-16T22:20:56.378095] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-16T22:20:56.378286] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-16T22:20:56.378341] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-16T22:20:56.740795] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:20:56.751669] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-10-16T22:20:56.771169] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T22:20:57.460793] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T22:20:57.542769] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-16T22:20:58.130733] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T22:20:58.226162] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T22:20:58.233034] [INFO ] [REMOTE ] WEC: Full fetch complete (75826 records). [2025-10-16T22:20:58.233148] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-16T22:20:58.347905] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-16T22:20:58.636992] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-16T22:20:58.637073] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-16T22:20:58.638411] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-16T22:20:58.638477] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-16T22:20:58.639962] [DEBUG] [LOCAL ] WEC: Trimmed 75826 records to 52558 (keeping 200 days of data) [2025-10-16T22:20:58.972268] [DEBUG] [LOCAL ] WEC: Primary data saved (52558 records). [2025-10-16T22:20:58.972406] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-16T22:20:58.972488] [INFO ] [MAIN ] Update Progress: 2282/2369 symbols completed. WEC took 31.1s. Estimated remaining: 12m 14s. Rate: 7.1 symbols/min [2025-10-16T22:20:59.147721] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:20:59.146113] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-16T22:20:59.161111] [DEBUG] [LOCAL ] WF: Loaded 10985 existing records from primary storage. [2025-10-16T22:20:59.161349] [INFO ] [MAIN ] WF: Loaded 10985 existing records. [2025-10-16T22:20:59.340605] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:20:59.341556] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-16T22:20:59.341615] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-16T22:20:59.341812] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-16T22:20:59.341865] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-16T22:20:59.705667] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:20:59.822732] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T22:20:59.830111] [INFO ] [REMOTE ] WELL: Full fetch complete (75965 records). [2025-10-16T22:20:59.830290] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-16T22:20:59.945909] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-16T22:21:00.231551] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-16T22:21:00.278071] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-16T22:21:00.278492] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-16T22:21:00.279768] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-16T22:21:00.279852] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-16T22:21:00.281481] [DEBUG] [LOCAL ] WELL: Trimmed 75965 records to 52706 (keeping 200 days of data) [2025-10-16T22:21:00.603068] [DEBUG] [LOCAL ] WELL: Primary data saved (52706 records). [2025-10-16T22:21:00.603201] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-16T22:21:00.603282] [INFO ] [MAIN ] Update Progress: 2283/2369 symbols completed. WELL took 32.7s. Estimated remaining: 12m 5s. Rate: 7.1 symbols/min [2025-10-16T22:21:00.747976] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-16T22:21:00.784348] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:21:00.832983] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-16T22:21:00.833280] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-10-16T22:21:01.009227] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:21:01.009421] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-16T22:21:01.009491] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-16T22:21:01.009776] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-16T22:21:01.009843] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-16T22:21:01.379801] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:21:01.447812] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T22:21:01.542806] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-10-16T22:21:02.342798] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-10-16T22:21:02.395203] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T22:21:02.402365] [INFO ] [REMOTE ] WES: Full fetch complete (70519 records). [2025-10-16T22:21:02.402553] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-16T22:21:02.787609] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-16T22:21:02.787769] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-16T22:21:02.789027] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-16T22:21:02.789137] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-16T22:21:02.790629] [DEBUG] [LOCAL ] WES: Trimmed 70519 records to 48881 (keeping 200 days of data) [2025-10-16T22:21:03.079136] [DEBUG] [LOCAL ] WES: Primary data saved (48881 records). [2025-10-16T22:21:03.079273] [INFO ] [MAIN ] WES: Full history saved. [2025-10-16T22:21:03.080027] [INFO ] [MAIN ] Update Progress: 2284/2369 symbols completed. WES took 35.2s. Estimated remaining: 11m 57s. Rate: 7.1 symbols/min [2025-10-16T22:21:03.143052] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-16T22:21:03.248960] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:21:03.272978] [DEBUG] [LOCAL ] WFG: Loaded 24781 existing records from primary storage. [2025-10-16T22:21:03.273224] [INFO ] [MAIN ] WFG: Loaded 24781 existing records. [2025-10-16T22:21:03.381423] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T22:21:03.463090] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:21:03.463292] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-16T22:21:03.463345] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-16T22:21:03.463695] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-16T22:21:03.463752] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-16T22:21:03.821899] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:21:03.851415] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-16T22:21:03.942785] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-10-16T22:21:04.339891] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T22:21:04.742822] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-10-16T22:21:05.542858] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-16T22:21:05.753292] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T22:21:05.862591] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-16T22:21:06.342839] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-16T22:21:06.450141] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T22:21:07.142869] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-10-16T22:21:07.942831] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-16T22:21:08.046799] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T22:21:08.742797] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-16T22:21:08.815633] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T22:21:09.028331] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-16T22:21:09.542861] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-10-16T22:21:10.335752] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T22:21:10.344016] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-16T22:21:11.142840] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-16T22:21:11.222052] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-16T22:21:11.484356] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-16T22:21:11.942812] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-10-16T22:21:12.360315] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-16T22:21:12.742822] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-16T22:21:13.542843] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-16T22:21:14.150179] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T22:21:14.280290] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-16T22:21:14.342811] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-10-16T22:21:14.577475] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T22:21:15.142838] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-16T22:21:15.942855] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-16T22:21:16.442151] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T22:21:16.468025] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-16T22:21:16.742800] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-10-16T22:21:17.037818] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T22:21:17.542822] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-16T22:21:18.342832] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-16T22:21:18.798922] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-16T22:21:18.965294] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T22:21:19.142840] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-10-16T22:21:19.330417] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T22:21:19.942870] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-16T22:21:20.742818] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-16T22:21:21.274003] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T22:21:21.404545] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-16T22:21:21.542818] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-16T22:21:21.564279] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T22:21:22.342894] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-16T22:21:22.629243] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T22:21:23.142874] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-16T22:21:23.706248] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T22:21:23.942857] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-16T22:21:24.258026] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T22:21:24.742818] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-16T22:21:25.276119] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T22:21:25.542898] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-16T22:21:25.895339] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T22:21:26.342851] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-10-16T22:21:26.761117] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-16T22:21:26.765129] [INFO ] [REMOTE ] WEX: Full fetch complete (50515 records). [2025-10-16T22:21:26.765263] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-16T22:21:27.137556] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-16T22:21:27.137629] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-16T22:21:27.138747] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-16T22:21:27.138810] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-16T22:21:27.139804] [DEBUG] [LOCAL ] WEX: Trimmed 50515 records to 33254 (keeping 200 days of data) [2025-10-16T22:21:27.142831] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-16T22:21:27.342754] [DEBUG] [LOCAL ] WEX: Primary data saved (33254 records). [2025-10-16T22:21:27.342899] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-16T22:21:27.342979] [INFO ] [MAIN ] Update Progress: 2285/2369 symbols completed. WEX took 31.3s. Estimated remaining: 11m 49s. Rate: 7.1 symbols/min [2025-10-16T22:21:27.508016] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:21:27.544088] [DEBUG] [LOCAL ] WGO: Loaded 38130 existing records from primary storage. [2025-10-16T22:21:27.544396] [INFO ] [MAIN ] WGO: Loaded 38130 existing records. [2025-10-16T22:21:27.720943] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:21:27.721178] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-16T22:21:27.721229] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-16T22:21:27.721420] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-16T22:21:27.721476] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-16T22:21:27.945106] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-16T22:21:28.083852] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:21:28.093589] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T22:21:28.459616] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-16T22:21:28.742777] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-16T22:21:29.146334] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T22:21:29.542858] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-16T22:21:29.822463] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T22:21:30.342930] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-16T22:21:30.713025] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-16T22:21:30.995297] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-16T22:21:31.142836] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-16T22:21:31.938973] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T22:21:31.942798] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-16T22:21:32.718463] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T22:21:32.720540] [INFO ] [REMOTE ] WF: Full fetch complete (16240 records). [2025-10-16T22:21:32.720616] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-16T22:21:32.751232] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-10-16T22:21:33.105467] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-16T22:21:33.105552] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-16T22:21:33.106038] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-16T22:21:33.106109] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-16T22:21:33.106600] [DEBUG] [LOCAL ] WF: Trimmed 16240 records to 11033 (keeping 200 days of data) [2025-10-16T22:21:33.173093] [DEBUG] [LOCAL ] WF: Primary data saved (11033 records). [2025-10-16T22:21:33.173236] [INFO ] [MAIN ] WF: Full history saved. [2025-10-16T22:21:33.173315] [INFO ] [MAIN ] Update Progress: 2286/2369 symbols completed. WF took 34.2s. Estimated remaining: 11m 40s. Rate: 7.1 symbols/min [2025-10-16T22:21:33.340052] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:21:33.382957] [DEBUG] [LOCAL ] WH: Loaded 45259 existing records from primary storage. [2025-10-16T22:21:33.383246] [INFO ] [MAIN ] WH: Loaded 45259 existing records. [2025-10-16T22:21:33.557572] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:21:33.552453] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-10-16T22:21:33.558511] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-16T22:21:33.558565] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-16T22:21:33.558774] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-16T22:21:33.558830] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-16T22:21:33.914041] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:21:34.347916] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-10-16T22:21:34.359300] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T22:21:35.142856] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-16T22:21:35.496245] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-16T22:21:35.942844] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-10. [2025-10-16T22:21:36.046324] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T22:21:36.259806] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-16T22:21:36.266928] [INFO ] [REMOTE ] WFC: Full fetch complete (77925 records). [2025-10-16T22:21:36.267091] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-16T22:21:36.666839] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-16T22:21:36.666934] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-16T22:21:36.668141] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-16T22:21:36.668235] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-16T22:21:36.669769] [DEBUG] [LOCAL ] WFC: Trimmed 77925 records to 54138 (keeping 200 days of data) [2025-10-16T22:21:36.759355] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-16T22:21:36.819883] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T22:21:37.026495] [DEBUG] [LOCAL ] WFC: Primary data saved (54138 records). [2025-10-16T22:21:37.026624] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-16T22:21:37.026736] [INFO ] [MAIN ] Update Progress: 2287/2369 symbols completed. WFC took 36.4s. Estimated remaining: 11m 32s. Rate: 7.1 symbols/min [2025-10-16T22:21:37.191526] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:21:37.226848] [DEBUG] [LOCAL ] WHD: Loaded 40131 existing records from primary storage. [2025-10-16T22:21:37.227118] [INFO ] [MAIN ] WHD: Loaded 40131 existing records. [2025-10-16T22:21:37.398527] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:21:37.398740] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-16T22:21:37.398791] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-16T22:21:37.399045] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-16T22:21:37.399088] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-16T22:21:37.546606] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-16T22:21:37.779769] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:21:38.296910] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T22:21:38.342835] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-16T22:21:38.747865] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T22:21:38.751512] [INFO ] [REMOTE ] WFG: Full fetch complete (36267 records). [2025-10-16T22:21:38.751625] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-16T22:21:39.118743] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-16T22:21:39.118828] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-16T22:21:39.119574] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-16T22:21:39.119615] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-16T22:21:39.120525] [DEBUG] [LOCAL ] WFG: Trimmed 36267 records to 24996 (keeping 200 days of data) [2025-10-16T22:21:39.179233] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-16T22:21:39.282849] [DEBUG] [LOCAL ] WFG: Primary data saved (24996 records). [2025-10-16T22:21:39.283010] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-16T22:21:39.283097] [INFO ] [MAIN ] Update Progress: 2288/2369 symbols completed. WFG took 36.2s. Estimated remaining: 11m 23s. Rate: 7.1 symbols/min [2025-10-16T22:21:39.451714] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:21:39.457564] [DEBUG] [LOCAL ] WHG: Loaded 3153 existing records from primary storage. [2025-10-16T22:21:39.457779] [INFO ] [MAIN ] WHG: Loaded 3153 existing records. [2025-10-16T22:21:39.636091] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:21:39.636357] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-16T22:21:39.636406] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-16T22:21:39.636610] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-16T22:21:39.636714] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-16T22:21:39.947745] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-10-16T22:21:39.987822] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:21:40.014758] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T22:21:40.715429] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T22:21:40.742793] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-10-16T22:21:41.322847] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-16T22:21:41.471023] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T22:21:41.542776] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-16T22:21:42.342831] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-16T22:21:42.975366] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-16T22:21:42.998020] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T22:21:43.142784] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-16T22:21:43.942800] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-16T22:21:44.517621] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T22:21:44.528069] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T22:21:44.742782] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-16T22:21:45.326822] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T22:21:45.542808] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-16T22:21:46.342868] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-16T22:21:47.142851] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-16T22:21:47.283152] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T22:21:47.746728] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-16T22:21:47.912218] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T22:21:47.942771] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-16T22:21:48.742812] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-16T22:21:49.507262] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T22:21:49.542774] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-16T22:21:50.342793] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-16T22:21:50.450924] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T22:21:51.062425] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-16T22:21:51.093849] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T22:21:51.142795] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-16T22:21:51.942807] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-16T22:21:52.742794] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-16T22:21:52.769537] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T22:21:53.352861] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T22:21:53.542807] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-16T22:21:53.681128] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T22:21:54.127300] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-16T22:21:54.342845] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-16T22:21:55.142869] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-16T22:21:55.867206] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T22:21:55.942771] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-16T22:21:56.141598] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T22:21:56.742883] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-16T22:21:57.226060] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-16T22:21:57.542894] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-16T22:21:58.285188] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T22:21:58.342801] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-16T22:21:58.673920] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T22:21:59.142838] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-16T22:21:59.905985] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T22:21:59.942781] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-16T22:22:00.742819] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-16T22:22:00.839905] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T22:22:01.505778] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T22:22:01.542781] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-16T22:22:02.188035] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T22:22:02.193700] [INFO ] [REMOTE ] WHD: Full fetch complete (57910 records). [2025-10-16T22:22:02.193857] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-16T22:22:02.347926] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-16T22:22:02.585030] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-16T22:22:02.585110] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-16T22:22:02.586178] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-16T22:22:02.586242] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-16T22:22:02.587481] [DEBUG] [LOCAL ] WHD: Trimmed 57910 records to 40434 (keeping 200 days of data) [2025-10-16T22:22:02.837432] [DEBUG] [LOCAL ] WHD: Primary data saved (40434 records). [2025-10-16T22:22:02.837563] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-16T22:22:02.837638] [INFO ] [MAIN ] Update Progress: 2289/2369 symbols completed. WHD took 25.8s. Estimated remaining: 11m 15s. Rate: 7.1 symbols/min [2025-10-16T22:22:03.035772] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:22:03.080254] [DEBUG] [LOCAL ] WHR: Loaded 48799 existing records from primary storage. [2025-10-16T22:22:03.080637] [INFO ] [MAIN ] WHR: Loaded 48799 existing records. [2025-10-16T22:22:03.143766] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-16T22:22:03.284438] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T22:22:03.294382] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:22:03.303709] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-16T22:22:03.303780] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-16T22:22:03.304498] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-16T22:22:03.304563] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-16T22:22:03.660226] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:22:03.665687] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-16T22:22:03.942785] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-10-16T22:22:04.115811] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T22:22:04.742862] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-16T22:22:05.220571] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-16T22:22:05.542793] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-16T22:22:05.657935] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T22:22:06.342856] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-16T22:22:06.952947] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T22:22:07.142854] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-16T22:22:07.562298] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-16T22:22:07.563527] [INFO ] [REMOTE ] WHG: Full fetch complete (4467 records). [2025-10-16T22:22:07.563622] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-16T22:22:07.994532] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-16T22:22:07.994694] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-16T22:22:07.995042] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-16T22:22:07.958476] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-16T22:22:07.996748] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-16T22:22:08.000813] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T22:22:08.006875] [DEBUG] [LOCAL ] WHG: Trimmed 4467 records to 3162 (keeping 200 days of data) [2025-10-16T22:22:08.008831] [INFO ] [REMOTE ] WGO: Full fetch complete (57208 records). [2025-10-16T22:22:08.024681] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-16T22:22:08.099344] [DEBUG] [LOCAL ] WHG: Primary data saved (3162 records). [2025-10-16T22:22:08.111501] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-16T22:22:08.116817] [INFO ] [MAIN ] Update Progress: 2290/2369 symbols completed. WHG took 28.8s. Estimated remaining: 11m 7s. Rate: 7.1 symbols/min [2025-10-16T22:22:08.519589] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:22:08.631772] [DEBUG] [LOCAL ] WIA: Loaded 5007 existing records from primary storage. [2025-10-16T22:22:08.649790] [INFO ] [MAIN ] WIA: Loaded 5007 existing records. [2025-10-16T22:22:08.653095] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-16T22:22:08.686528] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-16T22:22:08.721581] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-16T22:22:08.721749] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-16T22:22:08.759113] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-16T22:22:08.769815] [DEBUG] [LOCAL ] WGO: Trimmed 57208 records to 38394 (keeping 200 days of data) [2025-10-16T22:22:08.851200] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:22:08.852221] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-16T22:22:08.852282] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-16T22:22:08.852470] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-16T22:22:08.852527] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-16T22:22:09.366410] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:22:09.507006] [DEBUG] [LOCAL ] WGO: Primary data saved (38394 records). [2025-10-16T22:22:09.507212] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-16T22:22:09.507315] [INFO ] [MAIN ] Update Progress: 2291/2369 symbols completed. WGO took 42.2s. Estimated remaining: 10m 58s. Rate: 7.1 symbols/min [2025-10-16T22:22:09.556307] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-10-16T22:22:09.695493] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:22:09.712333] [DEBUG] [LOCAL ] WINN: Loaded 11533 existing records from primary storage. [2025-10-16T22:22:09.712630] [INFO ] [MAIN ] WINN: Loaded 11533 existing records. [2025-10-16T22:22:09.929711] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:22:09.941888] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-16T22:22:09.943855] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-16T22:22:09.942547] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-16T22:22:09.954164] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-16T22:22:09.954247] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-16T22:22:10.327435] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:22:10.335823] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-16T22:22:10.354350] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-16T22:22:10.378305] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T22:22:11.017432] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-16T22:22:11.142830] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-10-16T22:22:11.942840] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-16T22:22:11.980587] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T22:22:12.742844] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-16T22:22:13.499180] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T22:22:13.542903] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-16T22:22:13.700789] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T22:22:14.153101] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-16T22:22:14.342840] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-16T22:22:15.142891] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-16T22:22:15.942915] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-16T22:22:16.078998] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T22:22:16.119865] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T22:22:16.557762] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T22:22:16.742838] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-16T22:22:17.542802] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-16T22:22:17.664391] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-16T22:22:18.206215] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-16T22:22:18.342867] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-16T22:22:19.142862] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-16T22:22:19.804261] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-16T22:22:19.881557] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T22:22:19.942853] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-16T22:22:20.559302] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-16T22:22:20.742826] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-16T22:22:21.542906] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-16T22:22:21.741191] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T22:22:22.342895] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-16T22:22:23.142916] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-16T22:22:23.368448] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T22:22:23.834752] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T22:22:23.844220] [INFO ] [REMOTE ] WH: Full fetch complete (65248 records). [2025-10-16T22:22:23.844493] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-16T22:22:23.955184] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-16T22:22:24.082002] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T22:22:24.298707] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-16T22:22:24.298854] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-16T22:22:24.300962] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-16T22:22:24.301044] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-16T22:22:24.303212] [DEBUG] [LOCAL ] WH: Trimmed 65248 records to 45585 (keeping 200 days of data) [2025-10-16T22:22:24.618487] [DEBUG] [LOCAL ] WH: Primary data saved (45585 records). [2025-10-16T22:22:24.618715] [INFO ] [MAIN ] WH: Full history saved. [2025-10-16T22:22:24.618847] [INFO ] [MAIN ] Update Progress: 2292/2369 symbols completed. WH took 51.4s. Estimated remaining: 10m 50s. Rate: 7.1 symbols/min [2025-10-16T22:22:24.748080] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-16T22:22:24.817532] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:22:24.876943] [DEBUG] [LOCAL ] WIT: Loaded 52494 existing records from primary storage. [2025-10-16T22:22:24.877382] [INFO ] [MAIN ] WIT: Loaded 52494 existing records. [2025-10-16T22:22:25.083306] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:22:25.083622] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-16T22:22:25.083708] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-16T22:22:25.084707] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-16T22:22:25.084769] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-16T22:22:25.472836] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:22:25.542881] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-10-16T22:22:25.584760] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T22:22:25.969404] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-16T22:22:26.342834] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-16T22:22:26.941339] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T22:22:27.142835] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-16T22:22:27.294267] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T22:22:27.775592] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T22:22:27.942882] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-16T22:22:28.745680] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-16T22:22:28.748672] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-16T22:22:29.351240] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-16T22:22:29.542843] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-16T22:22:30.342830] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-16T22:22:31.142803] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-16T22:22:31.414855] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T22:22:31.942428] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-16T22:22:31.945401] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-16T22:22:32.169826] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T22:22:32.556316] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-16T22:22:32.557841] [INFO ] [REMOTE ] WIA: Full fetch complete (7186 records). [2025-10-16T22:22:32.557914] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-16T22:22:32.745786] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-16T22:22:32.944734] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-16T22:22:32.944842] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-16T22:22:32.945138] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-16T22:22:32.945184] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-16T22:22:32.945801] [DEBUG] [LOCAL ] WIA: Trimmed 7186 records to 5036 (keeping 200 days of data) [2025-10-16T22:22:32.983260] [DEBUG] [LOCAL ] WIA: Primary data saved (5036 records). [2025-10-16T22:22:32.983482] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-16T22:22:32.983602] [INFO ] [MAIN ] Update Progress: 2293/2369 symbols completed. WIA took 24.9s. Estimated remaining: 10m 41s. Rate: 7.1 symbols/min [2025-10-16T22:22:33.166253] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:22:33.190461] [DEBUG] [LOCAL ] WIW: Loaded 20323 existing records from primary storage. [2025-10-16T22:22:33.190795] [INFO ] [MAIN ] WIW: Loaded 20323 existing records. [2025-10-16T22:22:33.379468] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:22:33.379821] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-16T22:22:33.379885] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-16T22:22:33.380208] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-16T22:22:33.380274] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-16T22:22:33.555562] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-16T22:22:33.769134] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:22:33.799466] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-16T22:22:34.342882] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-10-16T22:22:35.145710] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-16T22:22:35.153091] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T22:22:35.484734] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T22:22:35.709054] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-16T22:22:35.711021] [INFO ] [REMOTE ] WINN: Full fetch complete (17439 records). [2025-10-16T22:22:35.711096] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-16T22:22:35.950374] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-16T22:22:36.074255] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-16T22:22:36.074342] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-16T22:22:36.074730] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-16T22:22:36.074792] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-16T22:22:36.075311] [DEBUG] [LOCAL ] WINN: Trimmed 17439 records to 11615 (keeping 200 days of data) [2025-10-16T22:22:36.148880] [DEBUG] [LOCAL ] WINN: Primary data saved (11615 records). [2025-10-16T22:22:36.149026] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-16T22:22:36.149108] [INFO ] [MAIN ] Update Progress: 2294/2369 symbols completed. WINN took 26.6s. Estimated remaining: 10m 33s. Rate: 7.1 symbols/min [2025-10-16T22:22:36.315258] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:22:36.351878] [DEBUG] [LOCAL ] WK: Loaded 37276 existing records from primary storage. [2025-10-16T22:22:36.352209] [INFO ] [MAIN ] WK: Loaded 37276 existing records. [2025-10-16T22:22:36.527499] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:22:36.527831] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-16T22:22:36.527889] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-16T22:22:36.528086] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-16T22:22:36.528141] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-16T22:22:36.748099] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-16T22:22:36.881061] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:22:37.015329] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-16T22:22:37.542816] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-10-16T22:22:38.342854] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-16T22:22:38.503130] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T22:22:38.585962] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T22:22:39.142837] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-16T22:22:39.332380] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T22:22:39.942824] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-16T22:22:40.697528] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T22:22:40.742786] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-16T22:22:41.542847] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-16T22:22:41.866430] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T22:22:42.342792] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-16T22:22:42.598249] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T22:22:42.634400] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T22:22:43.142796] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-16T22:22:43.394211] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T22:22:43.942870] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-16T22:22:44.650118] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T22:22:44.742768] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-16T22:22:45.039902] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T22:22:45.542836] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-16T22:22:45.875478] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T22:22:46.342835] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-16T22:22:46.546709] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T22:22:47.142867] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-16T22:22:47.951936] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-16T22:22:47.970944] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T22:22:48.742825] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-16T22:22:48.775796] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T22:22:49.085399] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T22:22:49.542804] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-16T22:22:50.342793] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-16T22:22:50.615895] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T22:22:50.638731] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T22:22:51.142873] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-16T22:22:51.771692] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T22:22:51.942890] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-16T22:22:52.742878] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-16T22:22:53.542868] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-16T22:23:05.274761] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (13.33 seconds). [2025-10-16T22:23:05.280358] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-16T22:23:05.375749] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (11.83 seconds). [2025-10-16T22:23:05.382816] [INFO ] [REMOTE ] WHR: Full fetch complete (69375 records). [2025-10-16T22:23:05.383019] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-16T22:23:05.768818] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-16T22:23:05.769352] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-16T22:23:05.770554] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-16T22:23:05.770618] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-16T22:23:05.772190] [DEBUG] [LOCAL ] WHR: Trimmed 69375 records to 49168 (keeping 200 days of data) [2025-10-16T22:23:06.074008] [DEBUG] [LOCAL ] WHR: Primary data saved (49168 records). [2025-10-16T22:23:06.074154] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-16T22:23:06.074237] [INFO ] [MAIN ] Update Progress: 2295/2369 symbols completed. WHR took 1m 3s. Estimated remaining: 10m 25s. Rate: 7.1 symbols/min [2025-10-16T22:23:06.247468] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:23:06.301739] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (13.56 seconds). [2025-10-16T22:23:06.302790] [DEBUG] [LOCAL ] WKC: Loaded 34587 existing records from primary storage. [2025-10-16T22:23:06.337609] [INFO ] [MAIN ] WKC: Loaded 34587 existing records. [2025-10-16T22:23:06.356252] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (15.21 seconds). [2025-10-16T22:23:06.353814] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-16T22:23:06.448482] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-16T22:23:06.450204] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-16T22:23:06.489063] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-16T22:23:06.571216] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:23:06.571522] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-16T22:23:06.571577] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-16T22:23:06.571798] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-16T22:23:06.571855] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-16T22:23:06.917755] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:23:06.918147] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-10-16T22:23:07.818060] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T22:23:07.820825] [INFO ] [REMOTE ] WIW: Full fetch complete (29183 records). [2025-10-16T22:23:07.820915] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-16T22:23:08.227829] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-16T22:23:08.227975] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-16T22:23:08.229996] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-16T22:23:08.230117] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-16T22:23:08.233465] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T22:23:08.243384] [DEBUG] [LOCAL ] WIW: Trimmed 29183 records to 20407 (keeping 200 days of data) [2025-10-16T22:23:08.243987] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-16T22:23:08.376929] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-16T22:23:08.392179] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-16T22:23:08.430245] [DEBUG] [LOCAL ] WIW: Primary data saved (20407 records). [2025-10-16T22:23:08.430383] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-16T22:23:08.430466] [INFO ] [MAIN ] Update Progress: 2296/2369 symbols completed. WIW took 35.4s. Estimated remaining: 10m 16s. Rate: 7.1 symbols/min [2025-10-16T22:23:08.625261] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:23:08.627976] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T22:23:08.637232] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-16T22:23:08.679114] [DEBUG] [LOCAL ] WLK: Loaded 45746 existing records from primary storage. [2025-10-16T22:23:08.679460] [INFO ] [MAIN ] WLK: Loaded 45746 existing records. [2025-10-16T22:23:08.853782] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:23:08.854056] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-16T22:23:08.854124] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-16T22:23:08.854334] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-16T22:23:08.854375] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-16T22:23:09.191568] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:23:09.191896] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-10-16T22:23:09.817772] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T22:23:09.828900] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-16T22:23:09.991860] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T22:23:09.999200] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-16T22:23:10.296667] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-16T22:23:10.310078] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-16T22:23:10.786402] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T22:23:10.794311] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-16T22:23:11.458780] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T22:23:11.471161] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-16T22:23:11.498401] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T22:23:11.508109] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-16T22:23:11.741363] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T22:23:11.754765] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-16T22:23:11.901150] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T22:23:11.908789] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-16T22:23:12.612541] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T22:23:12.621691] [INFO ] [REMOTE ] WK: Full fetch complete (53275 records). [2025-10-16T22:23:12.621965] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-16T22:23:13.067054] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-16T22:23:13.067423] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-16T22:23:13.069596] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-16T22:23:13.090347] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-16T22:23:13.092371] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T22:23:13.102198] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-16T22:23:13.103139] [DEBUG] [LOCAL ] WK: Trimmed 53275 records to 37595 (keeping 200 days of data) [2025-10-16T22:23:13.231800] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T22:23:13.266058] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-16T22:23:13.296040] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T22:23:13.310279] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-16T22:23:13.416900] [DEBUG] [LOCAL ] WK: Primary data saved (37595 records). [2025-10-16T22:23:13.417052] [INFO ] [MAIN ] WK: Full history saved. [2025-10-16T22:23:13.417132] [INFO ] [MAIN ] Update Progress: 2297/2369 symbols completed. WK took 37.3s. Estimated remaining: 10m 8s. Rate: 7.1 symbols/min [2025-10-16T22:23:13.581960] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:23:13.591275] [DEBUG] [LOCAL ] WLKP: Loaded 6989 existing records from primary storage. [2025-10-16T22:23:13.591478] [INFO ] [MAIN ] WLKP: Loaded 6989 existing records. [2025-10-16T22:23:13.764959] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:23:13.765180] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-16T22:23:13.765226] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-16T22:23:13.765382] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-16T22:23:13.765419] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-16T22:23:14.108606] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:23:14.108962] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-10-16T22:23:14.711024] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T22:23:14.721405] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-16T22:23:14.799253] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T22:23:14.809839] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-16T22:23:14.880186] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T22:23:14.882981] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-16T22:23:14.951697] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T22:23:14.962934] [INFO ] [REMOTE ] WIT: Full fetch complete (75906 records). [2025-10-16T22:23:14.963177] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-16T22:23:15.539799] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-16T22:23:15.539910] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-16T22:23:15.541616] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-16T22:23:15.541740] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-16T22:23:15.543526] [DEBUG] [LOCAL ] WIT: Trimmed 75906 records to 52880 (keeping 200 days of data) [2025-10-16T22:23:15.662202] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T22:23:15.670540] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-16T22:23:15.895833] [DEBUG] [LOCAL ] WIT: Primary data saved (52880 records). [2025-10-16T22:23:15.896002] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-16T22:23:15.896090] [INFO ] [MAIN ] Update Progress: 2298/2369 symbols completed. WIT took 51.3s. Estimated remaining: 9m 59s. Rate: 7.1 symbols/min [2025-10-16T22:23:16.094491] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:23:16.095541] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-16T22:23:16.096461] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-16T22:23:16.096348] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T22:23:16.103901] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-16T22:23:16.104511] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-16T22:23:16.104764] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-16T22:23:16.105273] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-16T22:23:16.104917] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-16T22:23:16.432402] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T22:23:16.458874] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-16T22:23:16.511823] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-16T22:23:16.520310] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:23:16.521125] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-16T22:23:16.742848] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-10-16T22:23:17.022736] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-16T22:23:17.105847] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-16T22:23:17.228570] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T22:23:17.542839] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-16T22:23:18.342861] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-16T22:23:18.381497] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-16T22:23:18.408677] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-16T22:23:19.142869] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-16T22:23:19.728608] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T22:23:19.923708] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T22:23:19.942851] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-16T22:23:20.744109] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-16T22:23:20.749515] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T22:23:21.542825] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-16T22:23:22.144562] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T22:23:22.157275] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T22:23:22.342841] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-16T22:23:23.142819] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-16T22:23:23.493799] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-16T22:23:23.760770] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T22:23:23.942813] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-16T22:23:24.742863] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-16T22:23:24.780223] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T22:23:25.095271] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-16T22:23:25.542832] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-16T22:23:25.955457] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-16T22:23:26.342823] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-16T22:23:26.767787] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-16T22:23:27.142849] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-16T22:23:27.942829] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-16T22:23:28.482367] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T22:23:28.486635] [INFO ] [REMOTE ] WKC: Full fetch complete (50145 records). [2025-10-16T22:23:28.486775] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-16T22:23:28.747941] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-16T22:23:28.868442] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-16T22:23:28.868531] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-16T22:23:28.869701] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-16T22:23:28.869765] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-16T22:23:28.870854] [DEBUG] [LOCAL ] WKC: Trimmed 50145 records to 34850 (keeping 200 days of data) [2025-10-16T22:23:29.085285] [DEBUG] [LOCAL ] WKC: Primary data saved (34850 records). [2025-10-16T22:23:29.085415] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-16T22:23:29.085495] [INFO ] [MAIN ] Update Progress: 2299/2369 symbols completed. WKC took 23.0s. Estimated remaining: 9m 51s. Rate: 7.1 symbols/min [2025-10-16T22:23:29.255032] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:23:29.284308] [DEBUG] [LOCAL ] WLY: Loaded 29866 existing records from primary storage. [2025-10-16T22:23:29.284624] [INFO ] [MAIN ] WLY: Loaded 29866 existing records. [2025-10-16T22:23:29.527555] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:23:29.528265] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-16T22:23:29.528462] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-16T22:23:29.534956] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-16T22:23:29.535121] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-16T22:23:29.546993] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-16T22:23:29.567388] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T22:23:29.863534] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T22:23:29.944530] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:23:29.960474] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-16T22:23:30.342826] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-16T22:23:30.643597] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-16T22:23:31.142821] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-16T22:23:31.816572] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T22:23:31.823491] [INFO ] [REMOTE ] WLKP: Full fetch complete (10086 records). [2025-10-16T22:23:31.823711] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-16T22:23:31.947953] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-16T22:23:32.186138] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-16T22:23:32.186232] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-16T22:23:32.186487] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-16T22:23:32.186528] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-16T22:23:32.186980] [DEBUG] [LOCAL ] WLKP: Trimmed 10086 records to 7090 (keeping 200 days of data) [2025-10-16T22:23:32.230763] [DEBUG] [LOCAL ] WLKP: Primary data saved (7090 records). [2025-10-16T22:23:32.230914] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-16T22:23:32.231016] [INFO ] [MAIN ] Update Progress: 2300/2369 symbols completed. WLKP took 18.8s. Estimated remaining: 9m 42s. Rate: 7.1 symbols/min [2025-10-16T22:23:32.403909] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:23:32.442129] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T22:23:32.461831] [DEBUG] [LOCAL ] WM: Loaded 51011 existing records from primary storage. [2025-10-16T22:23:32.462154] [INFO ] [MAIN ] WM: Loaded 51011 existing records. [2025-10-16T22:23:32.638697] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:23:32.638920] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-16T22:23:32.638977] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-16T22:23:32.639191] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-16T22:23:32.639229] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-16T22:23:32.748023] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-16T22:23:32.985206] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:23:33.542835] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-10-16T22:23:34.342858] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-16T22:23:34.720727] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-16T22:23:34.764849] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T22:23:34.838396] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T22:23:35.142845] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-16T22:23:35.942821] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-10-16T22:23:36.307083] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T22:23:36.742840] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-16T22:23:37.094841] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-16T22:23:37.542790] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-16T22:23:37.698904] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T22:23:38.342876] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-16T22:23:38.699313] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-16T22:23:38.700189] [INFO ] [REMOTE ] WLTG: Full fetch complete (1678 records). [2025-10-16T22:23:38.700268] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-16T22:23:38.877442] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T22:23:38.877611] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T22:23:38.877700] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T22:23:38.877786] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-16T22:23:38.877866] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-16T22:23:38.877919] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-16T22:23:38.877987] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-16T22:23:38.878047] [INFO ] [MAIN ] Update Progress: 2301/2369 symbols completed. WLTG took 23.0s. Estimated remaining: 9m 34s. Rate: 7.1 symbols/min [2025-10-16T22:23:39.056449] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:23:39.108398] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-16T22:23:39.108748] [INFO ] [MAIN ] WMB: Loaded 53672 existing records. [2025-10-16T22:23:39.148001] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-16T22:23:39.299257] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:23:39.299549] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-16T22:23:39.299671] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-16T22:23:39.300001] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-16T22:23:39.300119] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-16T22:23:39.474068] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-16T22:23:39.685087] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:23:39.942875] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-10-16T22:23:40.742838] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-16T22:23:41.196578] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-16T22:23:41.542861] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-16T22:23:41.782545] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-16T22:23:42.342856] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-16T22:23:42.381191] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T22:23:42.680611] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T22:23:43.142813] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-16T22:23:43.942805] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-16T22:23:44.081775] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T22:23:44.502287] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-16T22:23:44.742807] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-16T22:23:45.343690] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-16T22:23:45.350110] [INFO ] [REMOTE ] WLK: Full fetch complete (63811 records). [2025-10-16T22:23:45.350287] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-16T22:23:45.552595] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-16T22:23:45.759263] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-16T22:23:45.759352] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-16T22:23:45.760847] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-16T22:23:45.760915] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-16T22:23:45.762241] [DEBUG] [LOCAL ] WLK: Trimmed 63811 records to 46068 (keeping 200 days of data) [2025-10-16T22:23:46.045934] [DEBUG] [LOCAL ] WLK: Primary data saved (46068 records). [2025-10-16T22:23:46.046124] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-16T22:23:46.046910] [INFO ] [MAIN ] Update Progress: 2302/2369 symbols completed. WLK took 37.6s. Estimated remaining: 9m 25s. Rate: 7.1 symbols/min [2025-10-16T22:23:46.251408] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T22:23:46.249229] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:23:46.277859] [DEBUG] [LOCAL ] WMK: Loaded 14729 existing records from primary storage. [2025-10-16T22:23:46.278120] [INFO ] [MAIN ] WMK: Loaded 14729 existing records. [2025-10-16T22:23:46.352582] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-16T22:23:46.458273] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:23:46.458551] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-16T22:23:46.458600] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-16T22:23:46.458798] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-16T22:23:46.458873] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-16T22:23:46.823791] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:23:47.142819] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-10-16T22:23:47.485980] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-16T22:23:47.942998] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-16T22:23:47.943159] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-16T22:23:47.977905] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T22:23:48.742868] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-16T22:23:49.362303] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T22:23:49.542863] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-16T22:23:50.342847] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-16T22:23:50.620129] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T22:23:50.675285] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-16T22:23:51.142852] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-16T22:23:51.942851] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-16T22:23:51.993627] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T22:23:52.362126] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-16T22:23:52.742824] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-16T22:23:53.542846] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-16T22:23:53.834285] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T22:23:54.174942] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T22:23:54.342840] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-16T22:23:54.885365] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T22:23:55.142855] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-16T22:23:55.331936] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T22:23:55.942868] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-16T22:23:56.542342] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T22:23:56.742842] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-16T22:23:57.542868] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-16T22:23:57.724662] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T22:23:57.759724] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T22:23:58.342827] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-16T22:23:58.729423] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T22:23:59.142861] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-16T22:23:59.410083] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-16T22:23:59.942876] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-16T22:24:00.176931] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T22:24:00.742886] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-16T22:24:01.542837] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-16T22:24:01.936407] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T22:24:01.942628] [INFO ] [REMOTE ] WLY: Full fetch complete (42975 records). [2025-10-16T22:24:01.942881] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-16T22:24:02.351214] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-16T22:24:02.349535] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-16T22:24:02.375432] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-16T22:24:02.376531] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-16T22:24:02.378841] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-16T22:24:02.379111] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-16T22:24:02.381173] [DEBUG] [LOCAL ] WLY: Trimmed 42975 records to 30121 (keeping 200 days of data) [2025-10-16T22:24:02.582719] [DEBUG] [LOCAL ] WLY: Primary data saved (30121 records). [2025-10-16T22:24:02.582949] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-16T22:24:02.583059] [INFO ] [MAIN ] Update Progress: 2303/2369 symbols completed. WLY took 33.5s. Estimated remaining: 9m 17s. Rate: 7.1 symbols/min [2025-10-16T22:24:02.768268] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:24:02.812682] [DEBUG] [LOCAL ] WMS: Loaded 39738 existing records from primary storage. [2025-10-16T22:24:02.813088] [INFO ] [MAIN ] WMS: Loaded 39738 existing records. [2025-10-16T22:24:03.010141] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:24:03.010741] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-16T22:24:03.010808] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-16T22:24:03.011089] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-16T22:24:03.011147] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-16T22:24:03.147202] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-16T22:24:03.409245] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:24:03.445676] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T22:24:03.506409] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-16T22:24:03.942866] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-10-16T22:24:04.742783] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-16T22:24:05.157467] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T22:24:05.504424] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T22:24:05.542838] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-16T22:24:06.342905] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-16T22:24:06.587790] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-16T22:24:07.142805] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-16T22:24:07.362460] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T22:24:07.875493] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T22:24:07.942880] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-16T22:24:08.667170] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T22:24:08.742881] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-16T22:24:09.102682] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T22:24:09.542860] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-16T22:24:10.342922] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-16T22:24:10.666590] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-16T22:24:10.987879] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T22:24:11.142854] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-16T22:24:11.159698] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-16T22:24:11.809483] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T22:24:11.816287] [INFO ] [REMOTE ] WM: Full fetch complete (73927 records). [2025-10-16T22:24:11.816463] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-16T22:24:11.947939] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-16T22:24:12.214446] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-16T22:24:12.214550] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-16T22:24:12.215940] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-16T22:24:12.216013] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-16T22:24:12.217528] [DEBUG] [LOCAL ] WM: Trimmed 73927 records to 51360 (keeping 200 days of data) [2025-10-16T22:24:12.542855] [DEBUG] [LOCAL ] WM: Primary data saved (51360 records). [2025-10-16T22:24:12.542992] [INFO ] [MAIN ] WM: Full history saved. [2025-10-16T22:24:12.543674] [INFO ] [MAIN ] Update Progress: 2304/2369 symbols completed. WM took 40.3s. Estimated remaining: 9m 9s. Rate: 7.1 symbols/min [2025-10-16T22:24:12.713194] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:24:12.746974] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-16T22:24:12.770448] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-16T22:24:12.770793] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-10-16T22:24:12.948994] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:24:12.949317] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-16T22:24:12.949386] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-16T22:24:12.949757] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-16T22:24:12.949816] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-16T22:24:13.047714] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T22:24:13.317067] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:24:13.542797] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-10-16T22:24:14.342823] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-16T22:24:14.724131] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T22:24:15.142815] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-16T22:24:15.823472] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T22:24:15.862310] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-16T22:24:15.942774] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-16T22:24:16.103540] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-16T22:24:16.742875] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-16T22:24:17.267668] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-16T22:24:17.274663] [INFO ] [REMOTE ] WMB: Full fetch complete (77851 records). [2025-10-16T22:24:17.274788] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-16T22:24:17.547993] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-16T22:24:17.673478] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-16T22:24:17.673572] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-16T22:24:17.674996] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-16T22:24:17.675071] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-16T22:24:17.676707] [DEBUG] [LOCAL ] WMB: Trimmed 77851 records to 54062 (keeping 200 days of data) [2025-10-16T22:24:18.020034] [DEBUG] [LOCAL ] WMB: Primary data saved (54062 records). [2025-10-16T22:24:18.020175] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-16T22:24:18.020818] [INFO ] [MAIN ] Update Progress: 2305/2369 symbols completed. WMB took 39.1s. Estimated remaining: 9m 0s. Rate: 7.1 symbols/min [2025-10-16T22:24:18.192557] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:24:18.231638] [DEBUG] [LOCAL ] WNC: Loaded 38500 existing records from primary storage. [2025-10-16T22:24:18.232006] [INFO ] [MAIN ] WNC: Loaded 38500 existing records. [2025-10-16T22:24:18.344298] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-16T22:24:18.414470] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:24:18.414784] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-16T22:24:18.414861] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-16T22:24:18.415082] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-16T22:24:18.415140] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-16T22:24:18.550946] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-16T22:24:18.814309] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:24:19.125920] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T22:24:19.142758] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-16T22:24:19.170229] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T22:24:19.942806] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-16T22:24:20.711717] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T22:24:20.742784] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-16T22:24:21.542821] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-10-16T22:24:21.605512] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T22:24:21.608038] [INFO ] [REMOTE ] WMK: Full fetch complete (20004 records). [2025-10-16T22:24:21.608114] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-16T22:24:21.990959] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-16T22:24:21.991056] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-16T22:24:21.991473] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-16T22:24:21.991520] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-16T22:24:21.992083] [DEBUG] [LOCAL ] WMK: Trimmed 20004 records to 14814 (keeping 200 days of data) [2025-10-16T22:24:22.079075] [DEBUG] [LOCAL ] WMK: Primary data saved (14814 records). [2025-10-16T22:24:22.079216] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-16T22:24:22.079314] [INFO ] [MAIN ] Update Progress: 2306/2369 symbols completed. WMK took 36.0s. Estimated remaining: 8m 52s. Rate: 7.1 symbols/min [2025-10-16T22:24:22.245977] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:24:22.284483] [DEBUG] [LOCAL ] WNS: Loaded 40257 existing records from primary storage. [2025-10-16T22:24:22.284792] [INFO ] [MAIN ] WNS: Loaded 40257 existing records. [2025-10-16T22:24:22.350487] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-16T22:24:22.471073] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:24:22.471897] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-10-16T22:24:22.472162] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-10-16T22:24:22.472545] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-10-16T22:24:22.472706] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-10-16T22:24:22.627501] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-10-16T22:24:22.879947] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:24:22.892388] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T22:24:23.142825] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-10-16T22:24:23.633187] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-16T22:24:23.942795] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-16T22:24:24.512638] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T22:24:24.742822] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-16T22:24:25.514057] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T22:24:25.542803] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-16T22:24:26.342927] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-16T22:24:26.985062] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-16T22:24:27.079981] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-16T22:24:27.142779] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-16T22:24:27.796123] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T22:24:27.942814] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-16T22:24:28.742876] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-16T22:24:29.223206] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T22:24:29.228787] [INFO ] [REMOTE ] WMS: Full fetch complete (57174 records). [2025-10-16T22:24:29.228926] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-16T22:24:29.543263] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-10-16T22:24:29.645555] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-16T22:24:29.671126] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-16T22:24:29.672402] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-16T22:24:29.673829] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-16T22:24:29.673963] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-16T22:24:29.675550] [DEBUG] [LOCAL ] WMS: Trimmed 57174 records to 39953 (keeping 200 days of data) [2025-10-16T22:24:29.926429] [DEBUG] [LOCAL ] WMS: Primary data saved (39953 records). [2025-10-16T22:24:29.926609] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-16T22:24:29.926730] [INFO ] [MAIN ] Update Progress: 2307/2369 symbols completed. WMS took 27.3s. Estimated remaining: 8m 43s. Rate: 7.1 symbols/min [2025-10-16T22:24:30.099110] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:24:30.147862] [DEBUG] [LOCAL ] WOLF: Loaded 53164 existing records from primary storage. [2025-10-16T22:24:30.148231] [INFO ] [MAIN ] WOLF: Loaded 53164 existing records. [2025-10-16T22:24:30.328304] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:24:30.328668] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-16T22:24:30.328874] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-16T22:24:30.329171] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-16T22:24:30.329274] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-16T22:24:30.350133] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-16T22:24:30.461964] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T22:24:30.715029] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:24:31.042381] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T22:24:31.142771] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-10-16T22:24:31.942813] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-10-16T22:24:32.269076] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T22:24:32.437977] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-16T22:24:32.742821] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-16T22:24:33.542824] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-16T22:24:34.102718] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-16T22:24:34.342847] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-16T22:24:34.441545] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T22:24:35.142850] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-10-16T22:24:35.197763] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T22:24:35.942821] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-16T22:24:36.282627] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-16T22:24:36.647956] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T22:24:36.742809] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-10-16T22:24:37.447513] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T22:24:37.542789] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-16T22:24:38.262360] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T22:24:38.342830] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-10-16T22:24:39.151257] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-16T22:24:39.153861] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T22:24:39.759751] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T22:24:39.942818] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-10-16T22:24:40.742817] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-16T22:24:41.102841] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-16T22:24:41.360008] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T22:24:41.542809] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-16T22:24:42.342841] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-16T22:24:43.142828] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-10-16T22:24:43.399446] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-16T22:24:43.803793] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T22:24:43.847907] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-16T22:24:43.942818] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-16T22:24:44.554672] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T22:24:44.742820] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-10-16T22:24:45.542886] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-16T22:24:45.820617] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T22:24:46.213748] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T22:24:46.342820] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-10-16T22:24:47.015578] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T22:24:47.142842] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-16T22:24:47.733991] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T22:24:47.942890] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-16T22:24:48.458149] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-16T22:24:48.742824] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-16T22:24:49.542886] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-10. [2025-10-16T22:24:49.920542] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-16T22:24:50.331529] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-16T22:24:50.342793] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-16T22:24:50.542711] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T22:24:50.548178] [INFO ] [REMOTE ] WNS: Full fetch complete (55866 records). [2025-10-16T22:24:50.548309] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-10-16T22:24:50.956050] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-10-16T22:24:50.956183] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-10-16T22:24:50.957258] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-10-16T22:24:50.957320] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-10-16T22:24:50.958516] [DEBUG] [LOCAL ] WNS: Trimmed 55866 records to 40573 (keeping 200 days of data) [2025-10-16T22:24:51.155823] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-16T22:24:51.194202] [DEBUG] [LOCAL ] WNS: Primary data saved (40573 records). [2025-10-16T22:24:51.194335] [INFO ] [MAIN ] WNS: Full history saved. [2025-10-16T22:24:51.194875] [INFO ] [MAIN ] Update Progress: 2308/2369 symbols completed. WNS took 29.1s. Estimated remaining: 8m 35s. Rate: 7.1 symbols/min [2025-10-16T22:24:51.366852] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:24:51.394633] [DEBUG] [LOCAL ] WOR: Loaded 24008 existing records from primary storage. [2025-10-16T22:24:51.394926] [INFO ] [MAIN ] WOR: Loaded 24008 existing records. [2025-10-16T22:24:51.570700] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:24:51.570949] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-16T22:24:51.570996] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-16T22:24:51.571172] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-16T22:24:51.571228] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-16T22:24:51.924980] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:24:51.942774] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-10-16T22:24:52.742791] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-16T22:24:52.928342] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-16T22:24:52.985204] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T22:24:53.520259] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-16T22:24:53.542766] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-16T22:24:53.634436] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T22:24:53.639410] [INFO ] [REMOTE ] WNC: Full fetch complete (57734 records). [2025-10-16T22:24:53.639530] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-16T22:24:54.017809] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-16T22:24:54.017988] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-16T22:24:54.019249] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-16T22:24:54.019316] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-16T22:24:54.020577] [DEBUG] [LOCAL ] WNC: Trimmed 57734 records to 38772 (keeping 200 days of data) [2025-10-16T22:24:54.291232] [DEBUG] [LOCAL ] WNC: Primary data saved (38772 records). [2025-10-16T22:24:54.292139] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-16T22:24:54.293040] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T22:24:54.301596] [INFO ] [MAIN ] Update Progress: 2309/2369 symbols completed. WNC took 36.3s. Estimated remaining: 8m 26s. Rate: 7.1 symbols/min [2025-10-16T22:24:54.345590] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-16T22:24:54.377693] [INFO ] [REMOTE ] WMT: Full fetch complete (77980 records). [2025-10-16T22:24:54.394586] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-16T22:24:54.576203] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:24:54.849980] [DEBUG] [LOCAL ] WOW: Loaded 30976 existing records from primary storage. [2025-10-16T22:24:54.867110] [INFO ] [MAIN ] WOW: Loaded 30976 existing records. [2025-10-16T22:24:54.921044] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-16T22:24:54.932503] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-16T22:24:54.955834] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-16T22:24:54.955927] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-16T22:24:55.000946] [DEBUG] [LOCAL ] WMT: Trimmed 77980 records to 54190 (keeping 200 days of data) [2025-10-16T22:24:55.158684] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-16T22:24:55.163468] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:24:55.171688] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-16T22:24:55.172158] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-16T22:24:55.178025] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-16T22:24:55.179214] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-16T22:24:55.738986] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:24:55.788790] [DEBUG] [LOCAL ] WMT: Primary data saved (54190 records). [2025-10-16T22:24:55.788918] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-16T22:24:55.789679] [INFO ] [MAIN ] Update Progress: 2310/2369 symbols completed. WMT took 43.2s. Estimated remaining: 8m 18s. Rate: 7.1 symbols/min [2025-10-16T22:24:55.951887] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-10-16T22:24:55.954284] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:24:56.002485] [DEBUG] [LOCAL ] WPC: Loaded 48267 existing records from primary storage. [2025-10-16T22:24:56.002828] [INFO ] [MAIN ] WPC: Loaded 48267 existing records. [2025-10-16T22:24:56.177735] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:24:56.178116] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-16T22:24:56.178172] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-16T22:24:56.178443] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-16T22:24:56.178487] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-16T22:24:56.412866] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T22:24:56.572623] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:24:56.604452] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-16T22:24:56.742785] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-10-16T22:24:56.780155] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T22:24:57.542824] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-10-16T22:24:58.342823] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-16T22:24:59.127324] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T22:24:59.142756] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-16T22:24:59.470996] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-16T22:24:59.497520] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T22:24:59.942815] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-16T22:25:00.742888] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-10-16T22:25:00.922474] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T22:25:01.400199] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T22:25:01.542929] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-16T22:25:02.342830] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-16T22:25:02.947836] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T22:25:02.984382] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-16T22:25:03.142790] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-16T22:25:03.461141] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T22:25:03.942821] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-16T22:25:04.742792] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-16T22:25:04.904889] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T22:25:05.012277] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T22:25:05.542845] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-16T22:25:06.001601] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T22:25:06.342791] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-16T22:25:07.142832] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-16T22:25:07.434445] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T22:25:07.435929] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T22:25:07.942860] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-16T22:25:08.484891] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T22:25:08.742839] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-10-16T22:25:09.231576] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T22:25:09.542810] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-16T22:25:10.342816] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-16T22:25:10.671480] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T22:25:11.150050] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-16T22:25:11.153347] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-16T22:25:11.631573] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T22:25:11.942883] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-16T22:25:12.755010] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-10. [2025-10-16T22:25:12.780451] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T22:25:13.153298] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T22:25:13.542863] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-16T22:25:14.342877] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-16T22:25:15.142862] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-16T22:25:15.265577] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T22:25:15.303092] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T22:25:15.307431] [INFO ] [REMOTE ] WOR: Full fetch complete (36324 records). [2025-10-16T22:25:15.307862] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-16T22:25:15.521325] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-10 (2.77 seconds). [2025-10-16T22:25:15.574963] [INFO ] [REMOTE ] WOLF: Full fetch complete (77330 records). [2025-10-16T22:25:15.611085] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-16T22:25:15.942957] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-16T22:25:16.090365] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-16T22:25:16.097774] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-16T22:25:16.157077] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-16T22:25:16.165099] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T22:25:16.189356] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-16T22:25:16.263683] [DEBUG] [LOCAL ] WOR: Trimmed 36324 records to 24158 (keeping 200 days of data) [2025-10-16T22:25:16.454344] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-16T22:25:16.456530] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-16T22:25:16.472621] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-16T22:25:16.492890] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-16T22:25:16.517776] [DEBUG] [LOCAL ] WOR: Primary data saved (24158 records). [2025-10-16T22:25:16.518015] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-16T22:25:16.518326] [INFO ] [MAIN ] Update Progress: 2311/2369 symbols completed. WOR took 25.3s. Estimated remaining: 8m 10s. Rate: 7.1 symbols/min [2025-10-16T22:25:16.518569] [DEBUG] [LOCAL ] WOLF: Trimmed 77330 records to 53549 (keeping 200 days of data) [2025-10-16T22:25:16.751693] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-16T22:25:16.781938] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:25:16.954373] [DEBUG] [LOCAL ] WPM: Loaded 52775 existing records from primary storage. [2025-10-16T22:25:16.958067] [INFO ] [MAIN ] WPM: Loaded 52775 existing records. [2025-10-16T22:25:17.215928] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:25:17.217335] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-16T22:25:17.218358] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-16T22:25:17.219048] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-16T22:25:17.219443] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-16T22:25:17.603324] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:25:17.604127] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-10-16T22:25:17.607273] [DEBUG] [LOCAL ] WOLF: Primary data saved (53549 records). [2025-10-16T22:25:17.607762] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-16T22:25:17.607998] [INFO ] [MAIN ] Update Progress: 2312/2369 symbols completed. WOLF took 47.7s. Estimated remaining: 8m 1s. Rate: 7.1 symbols/min [2025-10-16T22:25:17.777280] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:25:17.807158] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-16T22:25:17.851188] [DEBUG] [LOCAL ] WPP: Loaded 34446 existing records from primary storage. [2025-10-16T22:25:17.851587] [INFO ] [MAIN ] WPP: Loaded 34446 existing records. [2025-10-16T22:25:18.031925] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T22:25:18.044583] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:25:18.050577] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-16T22:25:18.051020] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-16T22:25:18.051244] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-16T22:25:18.051300] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-16T22:25:18.347894] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-16T22:25:18.409820] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:25:19.142815] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-16T22:25:19.397744] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T22:25:19.675967] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T22:25:19.942824] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-10-16T22:25:20.569023] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T22:25:20.742792] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-16T22:25:21.117561] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T22:25:21.542881] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-16T22:25:22.342823] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-16T22:25:22.438607] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T22:25:23.079944] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T22:25:23.142789] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-16T22:25:23.295947] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T22:25:23.942814] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-16T22:25:24.523629] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T22:25:24.742829] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-16T22:25:25.404781] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T22:25:25.542863] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-16T22:25:26.342918] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-16T22:25:26.888111] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-16T22:25:27.142803] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-16T22:25:27.165263] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-16T22:25:27.169974] [INFO ] [REMOTE ] WOW: Full fetch complete (42811 records). [2025-10-16T22:25:27.170079] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-16T22:25:27.546296] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T22:25:27.586124] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-16T22:25:27.586263] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-16T22:25:27.588228] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-16T22:25:27.588303] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-16T22:25:27.589936] [DEBUG] [LOCAL ] WOW: Trimmed 42811 records to 31268 (keeping 200 days of data) [2025-10-16T22:25:27.783449] [DEBUG] [LOCAL ] WOW: Primary data saved (31268 records). [2025-10-16T22:25:27.783676] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-16T22:25:27.783795] [INFO ] [MAIN ] Update Progress: 2313/2369 symbols completed. WOW took 33.5s. Estimated remaining: 7m 53s. Rate: 7.1 symbols/min [2025-10-16T22:25:27.945004] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-16T22:25:27.969906] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:25:28.030339] [DEBUG] [LOCAL ] WRB: Loaded 50783 existing records from primary storage. [2025-10-16T22:25:28.030826] [INFO ] [MAIN ] WRB: Loaded 50783 existing records. [2025-10-16T22:25:28.230980] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:25:28.231580] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-16T22:25:28.231789] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-16T22:25:28.232112] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-16T22:25:28.232172] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-16T22:25:28.629325] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:25:28.742871] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-10-16T22:25:28.854872] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T22:25:29.542819] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-16T22:25:29.575937] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T22:25:29.582138] [INFO ] [REMOTE ] WPC: Full fetch complete (70631 records). [2025-10-16T22:25:29.582255] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-16T22:25:29.973595] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-16T22:25:29.973706] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-16T22:25:29.974884] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-16T22:25:29.974946] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-16T22:25:29.976277] [DEBUG] [LOCAL ] WPC: Trimmed 70631 records to 48619 (keeping 200 days of data) [2025-10-16T22:25:30.270889] [DEBUG] [LOCAL ] WPC: Primary data saved (48619 records). [2025-10-16T22:25:30.271018] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-16T22:25:30.271615] [INFO ] [MAIN ] Update Progress: 2314/2369 symbols completed. WPC took 34.5s. Estimated remaining: 7m 44s. Rate: 7.1 symbols/min [2025-10-16T22:25:30.348290] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-16T22:25:30.452742] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:25:30.507698] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T22:25:30.537081] [DEBUG] [LOCAL ] WRBY: Loaded 50726 existing records from primary storage. [2025-10-16T22:25:30.537511] [INFO ] [MAIN ] WRBY: Loaded 50726 existing records. [2025-10-16T22:25:30.718823] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:25:30.719157] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-16T22:25:30.719249] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-16T22:25:30.719598] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-16T22:25:30.719699] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-16T22:25:30.821850] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-16T22:25:31.108508] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:25:31.142824] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-16T22:25:31.942809] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-10-16T22:25:32.325498] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-16T22:25:32.742786] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-16T22:25:32.975639] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T22:25:33.299408] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T22:25:33.542827] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-16T22:25:34.342804] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-16T22:25:34.477714] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T22:25:34.898595] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T22:25:35.142860] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-16T22:25:35.914180] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T22:25:35.942851] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-16T22:25:36.548287] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T22:25:36.742899] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-16T22:25:37.542811] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-16T22:25:37.604474] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T22:25:38.294514] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T22:25:38.342767] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-16T22:25:39.142830] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-16T22:25:39.530777] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-16T22:25:39.705268] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-16T22:25:39.942849] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-16T22:25:40.742765] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-16T22:25:40.955211] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T22:25:41.301929] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T22:25:41.542840] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-16T22:25:42.229151] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T22:25:42.342782] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-16T22:25:43.150308] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-16T22:25:43.152885] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T22:25:43.942847] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-16T22:25:44.146619] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T22:25:44.557347] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T22:25:44.742817] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-16T22:25:44.847910] [DEBUG] [REMOTE ] WPP: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-16T22:25:44.848245] [WARN ] [REMOTE ] WPP: No data returned for month 2025-08 [2025-10-16T22:25:44.848337] [FATAL] [REMOTE ] WPP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T22:25:44.848423] [FATAL] [MAIN ] WPP: Failed to fetch primary data. [2025-10-16T22:25:44.848483] [WARN ] [MAIN ] WPP: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T22:25:44.848556] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-16T22:25:44.848621] [DEBUG] [LOCAL ] WPP: No primary data file found to delete. [2025-10-16T22:25:44.848690] [INFO ] [LOCAL ] WPP: Starting deletion of derivative data. [2025-10-16T22:25:44.849195] [DEBUG] [LOCAL ] WPP: Deleted derivative data file. [2025-10-16T22:25:44.849560] [INFO ] [MAIN ] Update Progress: 2315/2369 symbols completed. WPP took 27.2s. Estimated remaining: 7m 36s. Rate: 7.1 symbols/min [2025-10-16T22:25:45.032714] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:25:45.054984] [DEBUG] [LOCAL ] WS: Loaded 23373 existing records from primary storage. [2025-10-16T22:25:45.055234] [INFO ] [MAIN ] WS: Loaded 23373 existing records. [2025-10-16T22:25:45.231141] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:25:45.231410] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-16T22:25:45.231485] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-16T22:25:45.231729] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-16T22:25:45.231789] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-16T22:25:45.548424] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-16T22:25:45.594883] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:25:45.749853] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T22:25:46.342859] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-16T22:25:47.142888] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-10-16T22:25:47.524604] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T22:25:47.740877] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T22:25:47.942790] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-16T22:25:48.412751] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T22:25:48.742838] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-16T22:25:49.542854] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-16T22:25:49.601394] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T22:25:49.751539] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T22:25:50.342824] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-16T22:25:51.142780] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-16T22:25:51.312784] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T22:25:51.632780] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T22:25:51.942822] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-16T22:25:52.742792] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-16T22:25:53.085007] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T22:25:53.214114] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-16T22:25:53.542811] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-16T22:25:54.342884] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-16T22:25:54.413232] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T22:25:54.469910] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-16T22:25:55.142903] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-16T22:25:55.942792] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-16T22:25:56.062768] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T22:25:56.742863] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-16T22:25:56.857919] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T22:25:57.542791] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-16T22:25:57.653001] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T22:25:58.342794] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-16T22:25:58.566731] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T22:25:58.573782] [INFO ] [REMOTE ] WPM: Full fetch complete (76326 records). [2025-10-16T22:25:58.573942] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-16T22:25:58.746981] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-16T22:25:58.997365] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-16T22:25:58.997453] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-16T22:25:58.998742] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-16T22:25:58.998816] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-16T22:25:59.000323] [DEBUG] [LOCAL ] WPM: Trimmed 76326 records to 53164 (keeping 200 days of data) [2025-10-16T22:25:59.182748] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-16T22:25:59.330798] [DEBUG] [LOCAL ] WPM: Primary data saved (53164 records). [2025-10-16T22:25:59.330974] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-16T22:25:59.331585] [INFO ] [MAIN ] Update Progress: 2316/2369 symbols completed. WPM took 42.8s. Estimated remaining: 7m 28s. Rate: 7.1 symbols/min [2025-10-16T22:25:59.497409] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:25:59.545405] [DEBUG] [LOCAL ] WSM: Loaded 49101 existing records from primary storage. [2025-10-16T22:25:59.545764] [INFO ] [MAIN ] WSM: Loaded 49101 existing records. [2025-10-16T22:25:59.721001] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:25:59.721211] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-16T22:25:59.721280] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-16T22:25:59.721487] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-16T22:25:59.721542] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-16T22:25:59.948483] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-16T22:26:00.091293] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:26:00.128274] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T22:26:00.151628] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T22:26:00.742854] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-16T22:26:01.391635] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-16T22:26:01.542836] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-16T22:26:02.342865] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-16T22:26:02.623078] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-16T22:26:02.714739] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T22:26:03.012203] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T22:26:03.019848] [INFO ] [REMOTE ] WRB: Full fetch complete (73693 records). [2025-10-16T22:26:03.020055] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-16T22:26:03.147995] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-16T22:26:03.428135] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-16T22:26:03.428281] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-16T22:26:03.430171] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-16T22:26:03.430238] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-16T22:26:03.432157] [DEBUG] [LOCAL ] WRB: Trimmed 73693 records to 51168 (keeping 200 days of data) [2025-10-16T22:26:03.780942] [DEBUG] [LOCAL ] WRB: Primary data saved (51168 records). [2025-10-16T22:26:03.781161] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-16T22:26:03.781296] [INFO ] [MAIN ] Update Progress: 2317/2369 symbols completed. WRB took 36.0s. Estimated remaining: 7m 19s. Rate: 7.1 symbols/min [2025-10-16T22:26:03.942915] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-16T22:26:04.742852] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-10-16T22:26:04.894036] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T22:26:04.901065] [INFO ] [REMOTE ] WRBY: Full fetch complete (73709 records). [2025-10-16T22:26:04.901232] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-16T22:26:04.913420] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T22:26:05.302189] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-16T22:26:05.302272] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-16T22:26:05.303455] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-16T22:26:05.303518] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-16T22:26:05.304916] [DEBUG] [LOCAL ] WRBY: Trimmed 73709 records to 51103 (keeping 200 days of data) [2025-10-16T22:26:05.562932] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-16T22:26:05.605518] [DEBUG] [LOCAL ] WRBY: Primary data saved (51103 records). [2025-10-16T22:26:05.605667] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-16T22:26:05.606230] [INFO ] [MAIN ] Update Progress: 2318/2369 symbols completed. WRBY took 35.3s. Estimated remaining: 7m 10s. Rate: 7.1 symbols/min [2025-10-16T22:26:06.656134] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-16T22:26:06.667033] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-16T22:26:06.823792] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T22:26:07.142868] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-16T22:26:08.193391] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T22:26:08.197906] [INFO ] [REMOTE ] WS: Full fetch complete (35853 records). [2025-10-16T22:26:08.198053] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-16T22:26:08.783986] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-16T22:26:08.784146] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-16T22:26:08.785540] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-16T22:26:08.785763] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-16T22:26:08.836778] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-16T22:26:08.833778] [DEBUG] [LOCAL ] WS: Trimmed 35853 records to 23549 (keeping 200 days of data) [2025-10-16T22:26:08.852172] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-16T22:26:09.073600] [DEBUG] [LOCAL ] WS: Primary data saved (23549 records). [2025-10-16T22:26:09.073859] [INFO ] [MAIN ] WS: Full history saved. [2025-10-16T22:26:09.073996] [INFO ] [MAIN ] Update Progress: 2319/2369 symbols completed. WS took 24.2s. Estimated remaining: 7m 2s. Rate: 7.1 symbols/min [2025-10-16T22:26:10.725186] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-16T22:26:10.735425] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-16T22:26:12.793964] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-16T22:26:12.805123] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-16T22:26:14.737569] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-16T22:26:14.748916] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-16T22:26:16.589558] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-16T22:26:16.600744] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-16T22:26:18.421774] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T22:26:18.432793] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-16T22:26:20.250778] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T22:26:20.261978] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-16T22:26:22.102875] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T22:26:22.113982] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-16T22:26:23.721968] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T22:26:23.731846] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-16T22:26:24.379957] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-16T22:26:24.386101] [INFO ] [REMOTE ] WSM: Full fetch complete (71637 records). [2025-10-16T22:26:24.386274] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-16T22:26:24.770414] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-16T22:26:24.770495] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-16T22:26:24.771690] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-16T22:26:24.771754] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-16T22:26:24.773105] [DEBUG] [LOCAL ] WSM: Trimmed 71637 records to 49435 (keeping 200 days of data) [2025-10-16T22:26:25.089291] [DEBUG] [LOCAL ] WSM: Primary data saved (49435 records). [2025-10-16T22:26:25.089430] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-16T22:26:25.090116] [INFO ] [MAIN ] Update Progress: 2320/2369 symbols completed. WSM took 25.8s. Estimated remaining: 6m 54s. Rate: 7.1 symbols/min [2025-10-16T22:26:25.696750] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:26:25.737062] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:26:25.796697] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:26:25.800615] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:26:25.851043] [DEBUG] [LOCAL ] WSR: Loaded 22976 existing records from primary storage. [2025-10-16T22:26:25.850373] [DEBUG] [LOCAL ] WSO: Loaded 25670 existing records from primary storage. [2025-10-16T22:26:25.851615] [INFO ] [MAIN ] WSR: Loaded 22976 existing records. [2025-10-16T22:26:25.861169] [INFO ] [MAIN ] WSO: Loaded 25670 existing records. [2025-10-16T22:26:26.051772] [DEBUG] [LOCAL ] WST: Loaded 36740 existing records from primary storage. [2025-10-16T22:26:26.092825] [INFO ] [MAIN ] WST: Loaded 36740 existing records. [2025-10-16T22:26:26.197735] [DEBUG] [LOCAL ] WT: Loaded 48092 existing records from primary storage. [2025-10-16T22:26:26.201009] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:26:26.274437] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:26:26.271527] [INFO ] [MAIN ] WT: Loaded 48092 existing records. [2025-10-16T22:26:26.288603] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-16T22:26:26.312924] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-16T22:26:26.293790] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-16T22:26:26.405518] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-16T22:26:26.449300] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-16T22:26:26.449383] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-16T22:26:26.449561] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-16T22:26:26.460497] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-16T22:26:26.745272] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:26:26.755933] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:26:26.784417] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-16T22:26:26.803751] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-16T22:26:26.823607] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-16T22:26:26.823675] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-16T22:26:26.898293] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-16T22:26:26.898222] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-16T22:26:26.945964] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-16T22:26:26.913848] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-16T22:26:27.793128] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:26:27.837789] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-10-16T22:26:27.865265] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:26:27.903623] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-10-16T22:26:28.089981] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:26:28.109993] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-10-16T22:26:28.109760] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:26:28.111185] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-10-16T22:26:28.987890] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T22:26:28.992824] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-16T22:26:29.126303] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-16T22:26:29.134615] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-16T22:26:29.416545] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T22:26:29.423251] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-16T22:26:29.490122] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T22:26:29.500104] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-16T22:26:29.934028] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T22:26:29.938825] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-16T22:26:30.019402] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T22:26:30.024221] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-16T22:26:30.927014] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T22:26:30.933815] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-16T22:26:31.058248] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T22:26:31.073597] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-16T22:26:31.074274] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-16T22:26:31.079291] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-16T22:26:31.227124] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T22:26:31.237220] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-16T22:26:32.171863] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T22:26:32.178006] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-16T22:26:32.267287] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T22:26:32.272668] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-16T22:26:32.653229] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T22:26:32.661845] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-16T22:26:32.829672] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T22:26:32.838915] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-16T22:26:33.076565] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T22:26:33.082445] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-16T22:26:33.591962] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T22:26:33.598042] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-16T22:26:33.978267] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T22:26:33.984396] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-16T22:26:34.174319] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T22:26:34.184766] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-16T22:26:34.347305] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T22:26:34.356990] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-16T22:26:34.436110] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T22:26:34.444017] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-16T22:26:34.706527] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T22:26:34.714403] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-16T22:26:35.486138] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T22:26:35.496235] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-16T22:26:35.610160] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-16T22:26:35.794585] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T22:26:35.825635] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T22:26:35.942864] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-16T22:26:36.742823] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-16T22:26:36.790839] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T22:26:37.090802] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T22:26:37.542907] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-16T22:26:37.768118] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T22:26:38.342834] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-16T22:26:38.692829] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-16T22:26:39.142868] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-16T22:26:39.424713] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T22:26:39.942818] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-16T22:26:40.504830] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T22:26:40.742829] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-16T22:26:41.480291] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T22:26:41.542789] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-16T22:26:42.058831] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T22:26:42.342884] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-16T22:26:42.982459] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T22:26:43.142783] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-16T22:26:43.616727] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-16T22:26:43.942825] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-16T22:26:44.742829] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-16T22:26:44.838474] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T22:26:45.542750] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-16T22:26:45.573387] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T22:26:45.712193] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T22:26:45.717326] [INFO ] [REMOTE ] WSO: Full fetch complete (35617 records). [2025-10-16T22:26:45.717470] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-16T22:26:46.110259] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-16T22:26:46.110377] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-16T22:26:46.111908] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-16T22:26:46.112025] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-16T22:26:46.113387] [DEBUG] [LOCAL ] WSO: Trimmed 35617 records to 25974 (keeping 200 days of data) [2025-10-16T22:26:46.297105] [DEBUG] [LOCAL ] WSO: Primary data saved (25974 records). [2025-10-16T22:26:46.297308] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-16T22:26:46.297416] [INFO ] [MAIN ] Update Progress: 2321/2369 symbols completed. WSO took 21.2s. Estimated remaining: 6m 45s. Rate: 7.1 symbols/min [2025-10-16T22:26:46.347967] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-16T22:26:46.489070] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:26:46.541188] [DEBUG] [LOCAL ] WTI: Loaded 44655 existing records from primary storage. [2025-10-16T22:26:46.541607] [INFO ] [MAIN ] WTI: Loaded 44655 existing records. [2025-10-16T22:26:46.737705] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:26:46.737986] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-16T22:26:46.738040] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-16T22:26:46.738367] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-16T22:26:46.738432] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-16T22:26:47.143499] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-16T22:26:47.153009] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-16T22:26:47.159527] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:26:47.942799] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-16T22:26:47.978948] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T22:26:48.014686] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T22:26:48.018355] [INFO ] [REMOTE ] WSR: Full fetch complete (32738 records). [2025-10-16T22:26:48.018479] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-16T22:26:48.418541] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-16T22:26:48.418681] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-16T22:26:48.420121] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-16T22:26:48.420312] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-16T22:26:48.421719] [DEBUG] [LOCAL ] WSR: Trimmed 32738 records to 23098 (keeping 200 days of data) [2025-10-16T22:26:48.576834] [DEBUG] [LOCAL ] WSR: Primary data saved (23098 records). [2025-10-16T22:26:48.577018] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-16T22:26:48.577123] [INFO ] [MAIN ] Update Progress: 2322/2369 symbols completed. WSR took 23.5s. Estimated remaining: 6m 37s. Rate: 7.1 symbols/min [2025-10-16T22:26:48.751999] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-10-16T22:26:48.755024] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:26:48.756180] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-16T22:26:48.756264] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-16T22:26:48.756416] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-16T22:26:48.756501] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-16T22:26:48.756708] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-16T22:26:48.756876] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-16T22:26:48.886371] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-16T22:26:49.148508] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:26:49.542819] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-16T22:26:49.767741] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (0.22 seconds). [2025-10-16T22:26:49.772968] [INFO ] [REMOTE ] WST: Full fetch complete (54240 records). [2025-10-16T22:26:49.773115] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-16T22:26:50.158746] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-16T22:26:50.158847] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-16T22:26:50.159919] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-16T22:26:50.159981] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-16T22:26:50.161136] [DEBUG] [LOCAL ] WST: Trimmed 54240 records to 37051 (keeping 200 days of data) [2025-10-16T22:26:50.359518] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-16T22:26:50.395279] [DEBUG] [LOCAL ] WST: Primary data saved (37051 records). [2025-10-16T22:26:50.395425] [INFO ] [MAIN ] WST: Full history saved. [2025-10-16T22:26:50.395504] [INFO ] [MAIN ] Update Progress: 2323/2369 symbols completed. WST took 25.3s. Estimated remaining: 6m 28s. Rate: 7.1 symbols/min [2025-10-16T22:26:50.568062] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:26:50.612265] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-16T22:26:50.668964] [DEBUG] [LOCAL ] WTRG: Loaded 50972 existing records from primary storage. [2025-10-16T22:26:50.669270] [INFO ] [MAIN ] WTRG: Loaded 50972 existing records. [2025-10-16T22:26:50.842995] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:26:50.843233] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-16T22:26:50.843291] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-16T22:26:50.843470] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-16T22:26:50.843510] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-16T22:26:51.147903] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-16T22:26:51.200211] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:26:51.887720] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T22:26:51.894847] [INFO ] [REMOTE ] WT: Full fetch complete (69707 records). [2025-10-16T22:26:51.894991] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-16T22:26:51.951549] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-10-16T22:26:52.285700] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-16T22:26:52.285808] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-16T22:26:52.287011] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-16T22:26:52.287073] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-16T22:26:52.288822] [DEBUG] [LOCAL ] WT: Trimmed 69707 records to 48467 (keeping 200 days of data) [2025-10-16T22:26:52.407895] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-16T22:26:52.590433] [DEBUG] [LOCAL ] WT: Primary data saved (48467 records). [2025-10-16T22:26:52.590600] [INFO ] [MAIN ] WT: Full history saved. [2025-10-16T22:26:52.591323] [INFO ] [MAIN ] Update Progress: 2324/2369 symbols completed. WT took 27.5s. Estimated remaining: 6m 20s. Rate: 7.1 symbols/min [2025-10-16T22:26:52.769868] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:26:52.762869] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-16T22:26:52.804075] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T22:26:52.827961] [DEBUG] [LOCAL ] WTS: Loaded 17424 existing records from primary storage. [2025-10-16T22:26:52.828224] [INFO ] [MAIN ] WTS: Loaded 17424 existing records. [2025-10-16T22:26:53.000778] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:26:53.001008] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-16T22:26:53.001056] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-16T22:26:53.001249] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-16T22:26:53.001305] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-16T22:26:53.274341] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-16T22:26:53.351052] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:26:53.542834] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-16T22:26:53.960027] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-16T22:26:54.342843] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-10-16T22:26:55.142790] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-16T22:26:55.373809] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T22:26:55.625853] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-16T22:26:55.942856] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-10-16T22:26:56.742859] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-16T22:26:57.542786] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-16T22:26:57.636166] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T22:26:57.694348] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T22:26:58.342856] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-10-16T22:26:58.953216] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-16T22:26:58.975740] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T22:26:59.142880] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-16T22:26:59.942810] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-16T22:27:00.203602] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T22:27:00.742885] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-16T22:27:01.542840] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-16T22:27:01.801515] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T22:27:02.342836] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-16T22:27:02.422131] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T22:27:02.474824] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-16T22:27:03.142867] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-16T22:27:03.942826] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-10-16T22:27:04.041231] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T22:27:04.104827] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-16T22:27:04.354525] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-16T22:27:04.742811] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-16T22:27:05.542833] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-16T22:27:06.342835] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-16T22:27:06.494840] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T22:27:07.143090] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-16T22:27:07.143015] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-16T22:27:07.474971] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-16T22:27:07.942808] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-10-16T22:27:08.435391] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-16T22:27:08.742843] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-16T22:27:08.910970] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T22:27:09.542819] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-16T22:27:10.342796] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-16T22:27:10.455369] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-16T22:27:11.142872] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-16T22:27:11.242007] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T22:27:11.294380] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T22:27:11.942893] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-16T22:27:12.742925] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-10-16T22:27:13.060818] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T22:27:13.225556] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-16T22:27:13.523421] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T22:27:13.542857] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-16T22:27:14.342887] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-10-16T22:27:14.906110] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-16T22:27:15.142886] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-10-16T22:27:15.201785] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T22:27:15.745118] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T22:27:15.942896] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-16T22:27:16.742860] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-16T22:27:17.089788] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T22:27:17.542854] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-16T22:27:18.342874] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-10. [2025-10-16T22:27:18.563900] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T22:27:18.587749] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-16T22:27:19.028873] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T22:27:19.030100] [INFO ] [REMOTE ] WTM: Full fetch complete (2724 records). [2025-10-16T22:27:19.030196] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-16T22:27:19.148052] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-16T22:27:19.215389] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T22:27:19.215686] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T22:27:19.215759] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T22:27:19.215884] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-16T22:27:19.215965] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-16T22:27:19.216007] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-16T22:27:19.216049] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-16T22:27:19.216109] [INFO ] [MAIN ] Update Progress: 2325/2369 symbols completed. WTM took 30.6s. Estimated remaining: 6m 12s. Rate: 7.1 symbols/min [2025-10-16T22:27:19.391614] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:27:19.432562] [DEBUG] [LOCAL ] WTTR: Loaded 44606 existing records from primary storage. [2025-10-16T22:27:19.432860] [INFO ] [MAIN ] WTTR: Loaded 44606 existing records. [2025-10-16T22:27:19.604278] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:27:19.604506] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-16T22:27:19.604553] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-16T22:27:19.604786] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-16T22:27:19.604841] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-16T22:27:19.950714] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:27:19.950853] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-16T22:27:20.742891] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-16T22:27:20.817546] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T22:27:21.478489] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T22:27:21.542818] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-16T22:27:21.692681] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T22:27:22.342845] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-16T22:27:23.023490] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T22:27:23.142831] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-16T22:27:23.938122] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T22:27:23.948363] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-16T22:27:24.715078] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T22:27:24.723121] [INFO ] [REMOTE ] WTI: Full fetch complete (64145 records). [2025-10-16T22:27:24.723292] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-16T22:27:24.747905] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-10-16T22:27:24.833331] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T22:27:24.857048] [INFO ] [REMOTE ] WTS: Full fetch complete (25686 records). [2025-10-16T22:27:24.879075] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-16T22:27:25.436206] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-16T22:27:25.436299] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-16T22:27:25.437828] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-16T22:27:25.437923] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-16T22:27:25.509972] [DEBUG] [LOCAL ] WTI: Trimmed 64145 records to 44979 (keeping 200 days of data) [2025-10-16T22:27:25.537256] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-16T22:27:25.537338] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-16T22:27:25.537849] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-16T22:27:25.537930] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-16T22:27:25.538870] [DEBUG] [LOCAL ] WTS: Trimmed 25686 records to 17528 (keeping 200 days of data) [2025-10-16T22:27:25.631982] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-16T22:27:25.759698] [DEBUG] [LOCAL ] WTS: Primary data saved (17528 records). [2025-10-16T22:27:25.760332] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-16T22:27:25.760743] [INFO ] [MAIN ] Update Progress: 2326/2369 symbols completed. WTS took 33.2s. Estimated remaining: 6m 3s. Rate: 7.1 symbols/min [2025-10-16T22:27:25.998165] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:27:26.126741] [DEBUG] [LOCAL ] WU: Loaded 53480 existing records from primary storage. [2025-10-16T22:27:26.128750] [INFO ] [MAIN ] WU: Loaded 53480 existing records. [2025-10-16T22:27:26.208674] [DEBUG] [LOCAL ] WTI: Primary data saved (44979 records). [2025-10-16T22:27:26.242006] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-16T22:27:26.242245] [INFO ] [MAIN ] Update Progress: 2327/2369 symbols completed. WTI took 39.9s. Estimated remaining: 5m 55s. Rate: 7.1 symbols/min [2025-10-16T22:27:26.432793] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:27:26.433256] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-16T22:27:26.433837] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-16T22:27:26.474423] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-16T22:27:26.488734] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-16T22:27:26.506185] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:27:26.662160] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-16T22:27:26.688545] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-16T22:27:26.900362] [DEBUG] [LOCAL ] WWW: Loaded 49251 existing records from primary storage. [2025-10-16T22:27:26.943535] [INFO ] [MAIN ] WWW: Loaded 49251 existing records. [2025-10-16T22:27:26.992892] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:27:27.154939] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-10-16T22:27:27.160406] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:27:27.161978] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-16T22:27:27.162039] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-16T22:27:27.162277] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-16T22:27:27.162335] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-16T22:27:27.441065] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-16T22:27:27.490463] [INFO ] [REMOTE ] WTRG: Full fetch complete (73820 records). [2025-10-16T22:27:27.496683] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-16T22:27:27.669274] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:27:27.949586] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-10-16T22:27:27.990268] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-16T22:27:27.990500] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-16T22:27:27.991879] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-16T22:27:27.991944] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-16T22:27:27.993893] [DEBUG] [LOCAL ] WTRG: Trimmed 73820 records to 51347 (keeping 200 days of data) [2025-10-16T22:27:28.310289] [DEBUG] [LOCAL ] WTRG: Primary data saved (51347 records). [2025-10-16T22:27:28.310454] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-16T22:27:28.310545] [INFO ] [MAIN ] Update Progress: 2328/2369 symbols completed. WTRG took 37.9s. Estimated remaining: 5m 46s. Rate: 7.1 symbols/min [2025-10-16T22:27:28.490715] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-16T22:27:28.520704] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:27:28.569541] [DEBUG] [LOCAL ] WY: Loaded 53219 existing records from primary storage. [2025-10-16T22:27:28.569929] [INFO ] [MAIN ] WY: Loaded 53219 existing records. [2025-10-16T22:27:28.745210] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-16T22:27:28.750363] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:27:28.751941] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-16T22:27:28.751995] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-16T22:27:28.752170] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-16T22:27:28.752209] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-16T22:27:29.116842] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:27:29.147476] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-16T22:27:29.188394] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T22:27:29.542824] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-10-16T22:27:30.342831] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-16T22:27:30.398864] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T22:27:31.142797] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-16T22:27:31.340822] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-16T22:27:31.635947] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T22:27:31.942847] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-16T22:27:32.742873] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-16T22:27:32.852689] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T22:27:33.542849] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-16T22:27:33.753279] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T22:27:33.944854] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T22:27:34.342862] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-16T22:27:35.142844] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-16T22:27:35.264977] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T22:27:35.659181] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T22:27:35.942821] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-16T22:27:36.509272] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T22:27:36.742814] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-16T22:27:37.115765] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T22:27:37.542784] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-16T22:27:38.342810] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-16T22:27:38.416539] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T22:27:39.142814] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-16T22:27:39.192120] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T22:27:39.942788] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-16T22:27:40.017176] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T22:27:40.742793] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-16T22:27:41.066797] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T22:27:41.542823] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-16T22:27:41.572852] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T22:27:42.238421] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T22:27:42.342772] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-16T22:27:43.142789] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-16T22:27:43.301633] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T22:27:43.840628] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T22:27:43.942787] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-16T22:27:44.619692] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T22:27:44.742843] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-16T22:27:45.461279] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T22:27:45.542771] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-16T22:27:46.082290] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T22:27:46.342812] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-16T22:27:47.116395] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T22:27:47.142767] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-16T22:27:47.942838] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-16T22:27:48.123516] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T22:27:48.592588] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T22:27:48.598779] [INFO ] [REMOTE ] WTTR: Full fetch complete (65628 records). [2025-10-16T22:27:48.598898] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-16T22:27:48.747968] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-16T22:27:49.010738] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-16T22:27:49.010834] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-16T22:27:49.012037] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-16T22:27:49.012102] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-16T22:27:49.013383] [DEBUG] [LOCAL ] WTTR: Trimmed 65628 records to 44977 (keeping 200 days of data) [2025-10-16T22:27:49.288202] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T22:27:49.317304] [DEBUG] [LOCAL ] WTTR: Primary data saved (44977 records). [2025-10-16T22:27:49.317438] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-16T22:27:49.318040] [INFO ] [MAIN ] Update Progress: 2329/2369 symbols completed. WTTR took 30.1s. Estimated remaining: 5m 38s. Rate: 7.1 symbols/min [2025-10-16T22:27:49.483416] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:27:49.513598] [DEBUG] [LOCAL ] XFLT: Loaded 29971 existing records from primary storage. [2025-10-16T22:27:49.513888] [INFO ] [MAIN ] XFLT: Loaded 29971 existing records. [2025-10-16T22:27:49.547903] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-16T22:27:49.696942] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:27:49.697212] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-16T22:27:49.697263] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-16T22:27:49.697463] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-16T22:27:49.697522] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-16T22:27:50.041215] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:27:50.342796] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-10-16T22:27:50.728286] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-16T22:27:51.142806] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-16T22:27:51.232711] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T22:27:51.492047] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T22:27:51.942820] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-16T22:27:52.720173] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-16T22:27:52.742792] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-16T22:27:53.542836] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-16T22:27:53.786101] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T22:27:54.207844] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T22:27:54.342825] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-16T22:27:55.142838] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-16T22:27:55.492407] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-16T22:27:55.520492] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T22:27:55.942970] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-16T22:27:56.742839] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-16T22:27:57.025113] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-16T22:27:57.163009] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T22:27:57.282447] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-16T22:27:57.542846] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-16T22:27:58.342859] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-16T22:27:59.142822] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-16T22:27:59.268586] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T22:27:59.807730] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T22:27:59.814864] [INFO ] [REMOTE ] WY: Full fetch complete (77037 records). [2025-10-16T22:27:59.814996] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-16T22:27:59.951740] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-16T22:28:00.209902] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-16T22:28:00.210006] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-16T22:28:00.211332] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-16T22:28:00.211415] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-16T22:28:00.241925] [DEBUG] [LOCAL ] WY: Trimmed 77037 records to 53609 (keeping 200 days of data) [2025-10-16T22:28:00.243877] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-16T22:28:00.575384] [DEBUG] [LOCAL ] WY: Primary data saved (53609 records). [2025-10-16T22:28:00.575526] [INFO ] [MAIN ] WY: Full history saved. [2025-10-16T22:28:00.575632] [INFO ] [MAIN ] Update Progress: 2330/2369 symbols completed. WY took 32.3s. Estimated remaining: 5m 29s. Rate: 7.1 symbols/min [2025-10-16T22:28:00.738431] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:28:00.742857] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-16T22:28:00.778790] [DEBUG] [LOCAL ] XHR: Loaded 43603 existing records from primary storage. [2025-10-16T22:28:00.779096] [INFO ] [MAIN ] XHR: Loaded 43603 existing records. [2025-10-16T22:28:00.955942] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:28:00.956332] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-16T22:28:00.956440] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-16T22:28:00.956678] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-16T22:28:00.956735] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-16T22:28:01.270228] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T22:28:01.345825] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:28:01.542817] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-10-16T22:28:02.342921] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-16T22:28:02.853296] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-16T22:28:03.040116] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T22:28:03.142915] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-16T22:28:03.942883] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-16T22:28:03.993963] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T22:28:04.000478] [INFO ] [REMOTE ] WWW: Full fetch complete (70534 records). [2025-10-16T22:28:04.000637] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-16T22:28:04.391093] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-16T22:28:04.391195] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-16T22:28:04.392817] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-16T22:28:04.392884] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-16T22:28:04.394843] [DEBUG] [LOCAL ] WWW: Trimmed 70534 records to 49601 (keeping 200 days of data) [2025-10-16T22:28:04.725762] [DEBUG] [LOCAL ] WWW: Primary data saved (49601 records). [2025-10-16T22:28:04.725928] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-16T22:28:04.726063] [INFO ] [MAIN ] Update Progress: 2331/2369 symbols completed. WWW took 38.5s. Estimated remaining: 5m 21s. Rate: 7.1 symbols/min [2025-10-16T22:28:04.758036] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-16T22:28:04.906293] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:28:04.906525] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-16T22:28:04.906582] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-16T22:28:04.906719] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-16T22:28:04.906768] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-16T22:28:04.906811] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-16T22:28:04.906842] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-16T22:28:05.321434] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:28:05.325212] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-16T22:28:05.357437] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T22:28:05.542823] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-10-16T22:28:05.708226] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-16T22:28:05.753620] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T22:28:05.754024] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-10-16T22:28:05.754116] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T22:28:05.754162] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-16T22:28:05.754221] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T22:28:05.754291] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-16T22:28:05.754354] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-16T22:28:05.754413] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-16T22:28:05.754481] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-16T22:28:05.754528] [INFO ] [MAIN ] Update Progress: 2332/2369 symbols completed. XIFR took 1.0s. Estimated remaining: 5m 12s. Rate: 7.1 symbols/min [2025-10-16T22:28:05.922005] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:28:05.980172] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-16T22:28:05.980693] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-10-16T22:28:06.157186] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:28:06.157426] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-16T22:28:06.157486] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-16T22:28:06.157722] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-16T22:28:06.157777] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-16T22:28:06.352330] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-16T22:28:06.510116] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:28:07.142851] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-16T22:28:07.944170] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-16T22:28:07.946870] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T22:28:08.443418] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T22:28:08.742809] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-16T22:28:09.542838] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-10-16T22:28:09.795778] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T22:28:10.342918] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-16T22:28:10.480836] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T22:28:11.142919] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-16T22:28:11.363681] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-16T22:28:11.942899] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-16T22:28:12.036601] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-16T22:28:12.576295] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T22:28:12.583796] [INFO ] [REMOTE ] WU: Full fetch complete (77511 records). [2025-10-16T22:28:12.583969] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-16T22:28:12.753523] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-16T22:28:13.041909] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-16T22:28:13.042027] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-16T22:28:13.043488] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-16T22:28:13.043578] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-16T22:28:13.045262] [DEBUG] [LOCAL ] WU: Trimmed 77511 records to 53869 (keeping 200 days of data) [2025-10-16T22:28:13.418209] [DEBUG] [LOCAL ] WU: Primary data saved (53869 records). [2025-10-16T22:28:13.418381] [INFO ] [MAIN ] WU: Full history saved. [2025-10-16T22:28:13.419112] [INFO ] [MAIN ] Update Progress: 2333/2369 symbols completed. WU took 47.7s. Estimated remaining: 5m 4s. Rate: 7.1 symbols/min [2025-10-16T22:28:13.544228] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-16T22:28:13.627715] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:28:13.654188] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T22:28:13.693795] [DEBUG] [LOCAL ] XPER: Loaded 30424 existing records from primary storage. [2025-10-16T22:28:13.694092] [INFO ] [MAIN ] XPER: Loaded 30424 existing records. [2025-10-16T22:28:13.912427] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:28:13.913046] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-16T22:28:13.913106] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-16T22:28:13.913578] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-16T22:28:13.913743] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-16T22:28:14.322592] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:28:14.342786] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-16T22:28:14.995350] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-16T22:28:15.142839] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-16T22:28:15.200030] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-16T22:28:15.915530] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T22:28:15.942800] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-16T22:28:16.571814] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-16T22:28:16.742807] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-16T22:28:17.542864] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-16T22:28:17.742185] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T22:28:17.746884] [INFO ] [REMOTE ] XFLT: Full fetch complete (43894 records). [2025-10-16T22:28:17.747016] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-16T22:28:18.123859] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-16T22:28:18.123985] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-16T22:28:18.124893] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-16T22:28:18.124971] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-16T22:28:18.150682] [DEBUG] [LOCAL ] XFLT: Trimmed 43894 records to 30243 (keeping 200 days of data) [2025-10-16T22:28:18.152322] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-16T22:28:18.335865] [DEBUG] [LOCAL ] XFLT: Primary data saved (30243 records). [2025-10-16T22:28:18.336009] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-16T22:28:18.336089] [INFO ] [MAIN ] Update Progress: 2334/2369 symbols completed. XFLT took 29.0s. Estimated remaining: 4m 55s. Rate: 7.1 symbols/min [2025-10-16T22:28:18.351308] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-16T22:28:18.507185] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:28:18.558081] [DEBUG] [LOCAL ] XPEV: Loaded 53631 existing records from primary storage. [2025-10-16T22:28:18.558422] [INFO ] [MAIN ] XPEV: Loaded 53631 existing records. [2025-10-16T22:28:18.732000] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:28:18.732231] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-16T22:28:18.732276] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-16T22:28:18.732501] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-16T22:28:18.732556] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-16T22:28:19.096474] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:28:19.122935] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T22:28:19.142775] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-10-16T22:28:19.942814] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-16T22:28:20.742824] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-10-16T22:28:20.776023] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-16T22:28:21.483330] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-16T22:28:21.548973] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-16T22:28:21.566083] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T22:28:22.061203] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T22:28:22.342865] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-16T22:28:23.142864] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-16T22:28:23.807402] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-16T22:28:23.942817] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-16T22:28:24.008536] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T22:28:24.742845] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-16T22:28:24.848099] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-16T22:28:25.542820] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-16T22:28:26.168870] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-16T22:28:26.205966] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T22:28:26.342861] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-16T22:28:27.142823] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-16T22:28:27.786220] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-16T22:28:27.903354] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T22:28:27.942771] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-16T22:28:27.972042] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T22:28:28.742799] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-16T22:28:29.542819] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-16T22:28:30.008116] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-16T22:28:30.120226] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-16T22:28:30.342836] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-16T22:28:30.514534] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T22:28:30.521753] [INFO ] [REMOTE ] XHR: Full fetch complete (61905 records). [2025-10-16T22:28:30.521941] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-16T22:28:30.931351] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-16T22:28:30.931454] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-16T22:28:30.933623] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-16T22:28:30.933716] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-16T22:28:30.935392] [DEBUG] [LOCAL ] XHR: Trimmed 61905 records to 43863 (keeping 200 days of data) [2025-10-16T22:28:31.160832] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-16T22:28:31.226122] [DEBUG] [LOCAL ] XHR: Primary data saved (43863 records). [2025-10-16T22:28:31.226320] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-16T22:28:31.226423] [INFO ] [MAIN ] Update Progress: 2335/2369 symbols completed. XHR took 30.7s. Estimated remaining: 4m 47s. Rate: 7.1 symbols/min [2025-10-16T22:28:31.410870] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:28:31.458598] [DEBUG] [LOCAL ] XPO: Loaded 47630 existing records from primary storage. [2025-10-16T22:28:31.459013] [INFO ] [MAIN ] XPO: Loaded 47630 existing records. [2025-10-16T22:28:31.650074] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:28:31.650473] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-16T22:28:31.650528] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-16T22:28:31.651135] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-16T22:28:31.651199] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-16T22:28:31.952839] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-16T22:28:32.062972] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:28:32.742838] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-10-16T22:28:32.916255] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-16T22:28:32.964012] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-16T22:28:33.542807] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-16T22:28:33.747266] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-16T22:28:34.342874] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-16T22:28:34.486189] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T22:28:34.517821] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T22:28:35.142850] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-16T22:28:35.942858] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-16T22:28:36.744879] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-16T22:28:36.754575] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-16T22:28:36.860826] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T22:28:37.143283] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T22:28:37.542854] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-16T22:28:38.342846] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-16T22:28:39.142918] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-16T22:28:39.248124] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-16T22:28:39.609149] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-16T22:28:39.904288] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-16T22:28:39.942785] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-16T22:28:40.249095] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-16T22:28:40.257386] [INFO ] [REMOTE ] XOM: Full fetch complete (77973 records). [2025-10-16T22:28:40.257620] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-16T22:28:40.681570] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-16T22:28:40.681778] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-16T22:28:40.684022] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-16T22:28:40.684118] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-16T22:28:40.717123] [DEBUG] [LOCAL ] XOM: Trimmed 77973 records to 54183 (keeping 200 days of data) [2025-10-16T22:28:40.719123] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T22:28:40.785025] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-16T22:28:41.104756] [DEBUG] [LOCAL ] XOM: Primary data saved (54183 records). [2025-10-16T22:28:41.104992] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-16T22:28:41.105744] [INFO ] [MAIN ] Update Progress: 2336/2369 symbols completed. XOM took 35.4s. Estimated remaining: 4m 39s. Rate: 7.1 symbols/min [2025-10-16T22:28:41.282216] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:28:41.324396] [DEBUG] [LOCAL ] XPOF: Loaded 37439 existing records from primary storage. [2025-10-16T22:28:41.324783] [INFO ] [MAIN ] XPOF: Loaded 37439 existing records. [2025-10-16T22:28:41.506318] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:28:41.506667] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-16T22:28:41.506735] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-16T22:28:41.507001] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-16T22:28:41.507075] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-16T22:28:41.551244] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-16T22:28:41.899906] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:28:42.342876] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-10-16T22:28:42.971830] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T22:28:43.142810] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-16T22:28:43.317601] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-16T22:28:43.597509] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-16T22:28:43.942823] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-16T22:28:44.446617] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T22:28:44.742833] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-16T22:28:45.542848] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-16T22:28:45.989036] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T22:28:46.304013] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-16T22:28:46.342805] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-16T22:28:46.877058] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T22:28:46.882373] [INFO ] [REMOTE ] XPER: Full fetch complete (43566 records). [2025-10-16T22:28:46.882502] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-16T22:28:47.148404] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-16T22:28:47.291897] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-16T22:28:47.292028] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-16T22:28:47.293587] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-16T22:28:47.293676] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-16T22:28:47.295207] [DEBUG] [LOCAL ] XPER: Trimmed 43566 records to 30698 (keeping 200 days of data) [2025-10-16T22:28:47.500888] [DEBUG] [LOCAL ] XPER: Primary data saved (30698 records). [2025-10-16T22:28:47.501096] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-16T22:28:47.501209] [INFO ] [MAIN ] Update Progress: 2337/2369 symbols completed. XPER took 34.1s. Estimated remaining: 4m 30s. Rate: 7.1 symbols/min [2025-10-16T22:28:47.679249] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:28:47.730881] [DEBUG] [LOCAL ] XPRO: Loaded 45894 existing records from primary storage. [2025-10-16T22:28:47.731352] [INFO ] [MAIN ] XPRO: Loaded 45894 existing records. [2025-10-16T22:28:47.942361] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:28:47.942867] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-16T22:28:47.943118] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-16T22:28:47.942973] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-16T22:28:47.944312] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-16T22:28:47.944397] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-16T22:28:48.336294] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:28:48.403185] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-16T22:28:48.400803] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T22:28:48.742861] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-16T22:28:49.542840] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-10-16T22:28:50.342843] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-16T22:28:50.394906] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-16T22:28:50.477906] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T22:28:51.142907] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-16T22:28:51.188128] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T22:28:51.728134] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T22:28:51.942900] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-16T22:28:52.742827] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-16T22:28:53.436983] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T22:28:53.542847] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-16T22:28:53.686786] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-16T22:28:54.342834] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-16T22:28:54.527459] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T22:28:54.952075] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T22:28:55.142898] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-16T22:28:55.942876] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-16T22:28:56.550383] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-16T22:28:56.652132] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T22:28:56.742774] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-16T22:28:57.186130] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T22:28:57.550576] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-16T22:28:57.556144] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T22:28:58.342872] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-16T22:28:58.986117] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T22:28:59.142816] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-16T22:28:59.891621] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T22:28:59.942843] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-16T22:29:00.636417] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T22:29:00.742813] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-16T22:29:01.542943] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-16T22:29:01.670119] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T22:29:02.342839] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-16T22:29:02.426667] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T22:29:03.142859] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-16T22:29:03.942865] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-16T22:29:04.014257] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-16T22:29:04.727851] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-16T22:29:04.739112] [INFO ] [REMOTE ] XPEV: Full fetch complete (77783 records). [2025-10-16T22:29:04.739495] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-16T22:29:04.754959] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-16T22:29:04.897967] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T22:29:05.185492] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T22:29:05.271574] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-16T22:29:05.271702] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-16T22:29:05.273276] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-16T22:29:05.273340] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-16T22:29:05.275017] [DEBUG] [LOCAL ] XPEV: Trimmed 77783 records to 54020 (keeping 200 days of data) [2025-10-16T22:29:05.548579] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-16T22:29:05.608099] [DEBUG] [LOCAL ] XPEV: Primary data saved (54020 records). [2025-10-16T22:29:05.608314] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-16T22:29:05.608934] [INFO ] [MAIN ] Update Progress: 2338/2369 symbols completed. XPEV took 47.3s. Estimated remaining: 4m 22s. Rate: 7.1 symbols/min [2025-10-16T22:29:05.785954] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:29:05.818498] [DEBUG] [LOCAL ] XYF: Loaded 27851 existing records from primary storage. [2025-10-16T22:29:05.818824] [INFO ] [MAIN ] XYF: Loaded 27851 existing records. [2025-10-16T22:29:06.012762] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:29:06.013087] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-16T22:29:06.013147] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-16T22:29:06.013343] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-16T22:29:06.013382] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-16T22:29:06.347180] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-16T22:29:06.393482] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:29:06.422122] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T22:29:06.883378] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T22:29:06.888729] [INFO ] [REMOTE ] XPOF: Full fetch complete (52889 records). [2025-10-16T22:29:06.888875] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-16T22:29:07.150243] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-16T22:29:07.326742] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-16T22:29:07.326898] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-16T22:29:07.329265] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-16T22:29:07.329349] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-16T22:29:07.331802] [DEBUG] [LOCAL ] XPOF: Trimmed 52889 records to 37670 (keeping 200 days of data) [2025-10-16T22:29:07.564610] [DEBUG] [LOCAL ] XPOF: Primary data saved (37670 records). [2025-10-16T22:29:07.564909] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-16T22:29:07.565027] [INFO ] [MAIN ] Update Progress: 2339/2369 symbols completed. XPOF took 26.5s. Estimated remaining: 4m 13s. Rate: 7.1 symbols/min [2025-10-16T22:29:07.750440] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:29:07.805213] [DEBUG] [LOCAL ] XYL: Loaded 47784 existing records from primary storage. [2025-10-16T22:29:07.805672] [INFO ] [MAIN ] XYL: Loaded 47784 existing records. [2025-10-16T22:29:07.956381] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-10-16T22:29:08.006756] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:29:08.007180] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-16T22:29:08.007270] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-16T22:29:08.007719] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-16T22:29:08.007784] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-16T22:29:08.344514] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-16T22:29:08.430343] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:29:08.612245] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-16T22:29:08.710858] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T22:29:08.742781] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-16T22:29:09.352052] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T22:29:09.542881] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-16T22:29:10.342807] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-10-16T22:29:10.363382] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T22:29:11.142826] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-16T22:29:11.946557] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-16T22:29:11.951845] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T22:29:12.706868] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T22:29:12.714997] [INFO ] [REMOTE ] XPO: Full fetch complete (69800 records). [2025-10-16T22:29:12.715226] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-16T22:29:12.748009] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-16T22:29:13.117974] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-16T22:29:13.118096] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-16T22:29:13.119368] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-16T22:29:13.119433] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-16T22:29:13.120904] [DEBUG] [LOCAL ] XPO: Trimmed 69800 records to 48000 (keeping 200 days of data) [2025-10-16T22:29:13.409392] [DEBUG] [LOCAL ] XPO: Primary data saved (48000 records). [2025-10-16T22:29:13.409537] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-16T22:29:13.409619] [INFO ] [MAIN ] Update Progress: 2340/2369 symbols completed. XPO took 42.2s. Estimated remaining: 4m 5s. Rate: 7.1 symbols/min [2025-10-16T22:29:13.548378] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-16T22:29:13.584225] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:29:13.584706] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-16T22:29:13.584801] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-16T22:29:13.585000] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-16T22:29:13.585045] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-16T22:29:13.585087] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-16T22:29:13.585120] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-16T22:29:13.927211] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T22:29:14.035466] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:29:14.342776] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-10-16T22:29:14.500574] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T22:29:14.721579] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T22:29:14.721992] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-10-16T22:29:14.722084] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T22:29:14.722151] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-10-16T22:29:14.722220] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T22:29:14.722303] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-16T22:29:14.722367] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-16T22:29:14.722405] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-16T22:29:14.722444] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-16T22:29:14.722488] [INFO ] [MAIN ] Update Progress: 2341/2369 symbols completed. XYZ took 1.3s. Estimated remaining: 3m 56s. Rate: 7.1 symbols/min [2025-10-16T22:29:14.887500] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T22:29:14.912560] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:29:14.952813] [DEBUG] [LOCAL ] YALA: Loaded 36820 existing records from primary storage. [2025-10-16T22:29:14.953111] [INFO ] [MAIN ] YALA: Loaded 36820 existing records. [2025-10-16T22:29:15.131507] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:29:15.131768] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-16T22:29:15.131820] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-16T22:29:15.132007] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-16T22:29:15.132044] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-16T22:29:15.148112] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-16T22:29:15.498257] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:29:15.942827] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-10-16T22:29:16.742897] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-16T22:29:17.007375] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-16T22:29:17.037532] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T22:29:17.542829] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-16T22:29:18.350618] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-16T22:29:18.353703] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T22:29:18.830035] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T22:29:19.142841] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-16T22:29:19.332591] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T22:29:19.942819] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-16T22:29:20.682411] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T22:29:20.743031] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-16T22:29:20.745147] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T22:29:21.542829] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-16T22:29:22.233278] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T22:29:22.240147] [INFO ] [REMOTE ] XPRO: Full fetch complete (66508 records). [2025-10-16T22:29:22.240371] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-16T22:29:22.348066] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-16T22:29:22.640726] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-16T22:29:22.640820] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-16T22:29:22.642012] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-16T22:29:22.642076] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-16T22:29:22.643471] [DEBUG] [LOCAL ] XPRO: Trimmed 66508 records to 46247 (keeping 200 days of data) [2025-10-16T22:29:22.906214] [DEBUG] [LOCAL ] XPRO: Primary data saved (46247 records). [2025-10-16T22:29:22.906397] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-16T22:29:22.906982] [INFO ] [MAIN ] Update Progress: 2342/2369 symbols completed. XPRO took 35.4s. Estimated remaining: 3m 48s. Rate: 7.1 symbols/min [2025-10-16T22:29:23.075144] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:29:23.118408] [DEBUG] [LOCAL ] YELP: Loaded 45489 existing records from primary storage. [2025-10-16T22:29:23.118728] [INFO ] [MAIN ] YELP: Loaded 45489 existing records. [2025-10-16T22:29:23.149525] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-16T22:29:23.301842] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:29:23.302040] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-16T22:29:23.302105] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-16T22:29:23.302324] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-16T22:29:23.302397] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-16T22:29:23.670507] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:29:23.742474] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-16T22:29:23.755841] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T22:29:23.942811] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-16T22:29:24.414140] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T22:29:24.742850] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-10-16T22:29:25.542812] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-16T22:29:25.579869] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T22:29:25.868129] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T22:29:26.342794] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-16T22:29:27.142827] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-16T22:29:27.705382] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-16T22:29:27.738499] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T22:29:27.942850] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-16T22:29:28.707731] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T22:29:28.742778] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-16T22:29:29.410016] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T22:29:29.542840] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-16T22:29:30.132403] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T22:29:30.342868] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-16T22:29:31.142819] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-16T22:29:31.281935] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T22:29:31.777595] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T22:29:31.942898] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-16T22:29:32.742781] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-16T22:29:32.850854] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T22:29:33.392533] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T22:29:33.542870] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-16T22:29:34.299052] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T22:29:34.342785] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-16T22:29:35.142895] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-16T22:29:35.296083] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-16T22:29:35.352971] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T22:29:35.942872] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-16T22:29:36.136057] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T22:29:36.742894] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-16T22:29:37.476790] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T22:29:37.542836] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-16T22:29:38.123269] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T22:29:38.342797] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-16T22:29:39.142816] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-16T22:29:39.265848] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T22:29:39.695164] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T22:29:39.942830] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-16T22:29:40.293106] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-16T22:29:40.297272] [INFO ] [REMOTE ] YALA: Full fetch complete (47121 records). [2025-10-16T22:29:40.297414] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-16T22:29:40.691459] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-16T22:29:40.700847] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-16T22:29:40.702009] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-16T22:29:40.702127] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-16T22:29:40.703766] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T22:29:40.710358] [INFO ] [REMOTE ] XYL: Full fetch complete (70013 records). [2025-10-16T22:29:40.710457] [DEBUG] [LOCAL ] YALA: Trimmed 47121 records to 37013 (keeping 200 days of data) [2025-10-16T22:29:40.710970] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-16T22:29:40.784599] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-16T22:29:41.326796] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-16T22:29:41.327538] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-16T22:29:41.329340] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-16T22:29:41.329430] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-16T22:29:41.342354] [DEBUG] [LOCAL ] XYL: Trimmed 70013 records to 48164 (keeping 200 days of data) [2025-10-16T22:29:41.422345] [DEBUG] [LOCAL ] YALA: Primary data saved (37013 records). [2025-10-16T22:29:41.431184] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-16T22:29:41.431367] [INFO ] [MAIN ] Update Progress: 2343/2369 symbols completed. YALA took 26.7s. Estimated remaining: 3m 39s. Rate: 7.1 symbols/min [2025-10-16T22:29:41.548866] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-16T22:29:41.661003] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:29:41.791787] [DEBUG] [LOCAL ] YETI: Loaded 52503 existing records from primary storage. [2025-10-16T22:29:41.819082] [INFO ] [MAIN ] YETI: Loaded 52503 existing records. [2025-10-16T22:29:41.989220] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-16T22:29:42.029488] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:29:42.036082] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-16T22:29:42.037161] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-16T22:29:42.038273] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-16T22:29:42.039125] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-16T22:29:42.347819] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-16T22:29:42.419872] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:29:42.478577] [DEBUG] [LOCAL ] XYL: Primary data saved (48164 records). [2025-10-16T22:29:42.478756] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-16T22:29:42.478864] [INFO ] [MAIN ] Update Progress: 2344/2369 symbols completed. XYL took 34.9s. Estimated remaining: 3m 31s. Rate: 7.1 symbols/min [2025-10-16T22:29:42.644632] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:29:42.684348] [DEBUG] [LOCAL ] YEXT: Loaded 43180 existing records from primary storage. [2025-10-16T22:29:42.684664] [INFO ] [MAIN ] YEXT: Loaded 43180 existing records. [2025-10-16T22:29:42.859899] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:29:42.860153] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-16T22:29:42.860222] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-16T22:29:42.860451] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-16T22:29:42.860510] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-16T22:29:43.143250] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-10-16T22:29:43.222952] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:29:43.252251] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T22:29:43.419557] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T22:29:43.422976] [INFO ] [REMOTE ] XYF: Full fetch complete (33290 records). [2025-10-16T22:29:43.423054] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-16T22:29:43.784582] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-16T22:29:43.784695] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-16T22:29:43.785411] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-16T22:29:43.785453] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-16T22:29:43.786274] [DEBUG] [LOCAL ] XYF: Trimmed 33290 records to 28000 (keeping 200 days of data) [2025-10-16T22:29:43.947361] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-10-16T22:29:43.963105] [DEBUG] [LOCAL ] XYF: Primary data saved (28000 records). [2025-10-16T22:29:43.963201] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-16T22:29:43.963279] [INFO ] [MAIN ] Update Progress: 2345/2369 symbols completed. XYF took 38.4s. Estimated remaining: 3m 22s. Rate: 7.1 symbols/min [2025-10-16T22:29:44.129796] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:29:44.180803] [DEBUG] [LOCAL ] YMM: Loaded 52607 existing records from primary storage. [2025-10-16T22:29:44.181111] [INFO ] [MAIN ] YMM: Loaded 52607 existing records. [2025-10-16T22:29:44.354478] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:29:44.354745] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-16T22:29:44.354801] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-16T22:29:44.355024] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-16T22:29:44.355080] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-16T22:29:44.719229] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:29:44.742770] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-10-16T22:29:44.924074] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T22:29:45.542911] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-16T22:29:45.576417] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T22:29:46.342864] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-16T22:29:46.457198] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T22:29:47.112363] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T22:29:47.142767] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-16T22:29:47.855046] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T22:29:47.942768] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-16T22:29:48.742854] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-16T22:29:48.775608] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T22:29:49.000073] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T22:29:49.542815] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-16T22:29:50.342849] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-16T22:29:50.464898] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T22:29:51.142893] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-16T22:29:51.177105] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T22:29:51.701519] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-16T22:29:51.942810] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-16T22:29:52.291119] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T22:29:52.742815] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-16T22:29:53.499085] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T22:29:53.542866] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-16T22:29:54.342914] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-16T22:29:54.385908] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T22:29:54.866015] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T22:29:55.142846] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-16T22:29:55.467164] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T22:29:55.942881] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-16T22:29:56.742878] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-16T22:29:56.971605] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-16T22:29:57.047848] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T22:29:57.542842] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-16T22:29:58.093096] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T22:29:58.342887] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-16T22:29:59.071956] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T22:29:59.142837] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-16T22:29:59.942797] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-16T22:30:00.036555] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T22:30:00.742809] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-16T22:30:01.023728] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T22:30:01.542791] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-16T22:30:01.671105] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T22:30:02.342876] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-16T22:30:02.449846] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-16T22:30:02.456439] [INFO ] [REMOTE ] YELP: Full fetch complete (64875 records). [2025-10-16T22:30:02.456628] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-16T22:30:02.869935] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-16T22:30:02.870016] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-16T22:30:02.871177] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-16T22:30:02.871259] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-16T22:30:02.873849] [DEBUG] [LOCAL ] YELP: Trimmed 64875 records to 45813 (keeping 200 days of data) [2025-10-16T22:30:03.144165] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-16T22:30:03.145565] [DEBUG] [LOCAL ] YELP: Primary data saved (45813 records). [2025-10-16T22:30:03.147053] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-16T22:30:03.147698] [INFO ] [MAIN ] Update Progress: 2346/2369 symbols completed. YELP took 40.2s. Estimated remaining: 3m 14s. Rate: 7.1 symbols/min [2025-10-16T22:30:03.321484] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:30:03.369059] [DEBUG] [LOCAL ] YOU: Loaded 49670 existing records from primary storage. [2025-10-16T22:30:03.369437] [INFO ] [MAIN ] YOU: Loaded 49670 existing records. [2025-10-16T22:30:03.566860] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:30:03.567573] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-16T22:30:03.567789] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-16T22:30:03.568029] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-16T22:30:03.568165] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-16T22:30:03.918228] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-16T22:30:04.000248] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-16T22:30:03.999875] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:30:04.226919] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T22:30:04.742858] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-16T22:30:04.902299] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T22:30:05.542783] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-16T22:30:05.671213] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T22:30:06.204311] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T22:30:06.342789] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-16T22:30:07.142923] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-16T22:30:07.233414] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T22:30:07.942825] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-10-16T22:30:08.229628] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-16T22:30:08.356806] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T22:30:08.742829] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-16T22:30:09.542844] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-16T22:30:09.807561] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-16T22:30:10.316997] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T22:30:10.342775] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-16T22:30:11.142792] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-16T22:30:11.312725] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T22:30:11.942785] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-16T22:30:12.019156] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T22:30:12.025449] [INFO ] [REMOTE ] YEXT: Full fetch complete (63305 records). [2025-10-16T22:30:12.025638] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-16T22:30:12.427384] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-16T22:30:12.427463] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-16T22:30:12.428742] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-16T22:30:12.428805] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-16T22:30:12.430016] [DEBUG] [LOCAL ] YEXT: Trimmed 63305 records to 43500 (keeping 200 days of data) [2025-10-16T22:30:12.674772] [DEBUG] [LOCAL ] YEXT: Primary data saved (43500 records). [2025-10-16T22:30:12.674900] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-16T22:30:12.675044] [INFO ] [MAIN ] Update Progress: 2347/2369 symbols completed. YEXT took 30.2s. Estimated remaining: 3m 6s. Rate: 7.1 symbols/min [2025-10-16T22:30:12.750287] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-16T22:30:12.851934] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:30:12.900433] [DEBUG] [LOCAL ] YPF: Loaded 50678 existing records from primary storage. [2025-10-16T22:30:12.900825] [INFO ] [MAIN ] YPF: Loaded 50678 existing records. [2025-10-16T22:30:13.082948] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:30:13.083478] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-16T22:30:13.083532] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-16T22:30:13.083824] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-16T22:30:13.083892] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-16T22:30:13.505481] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:30:13.508729] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-16T22:30:13.542766] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-16T22:30:13.866779] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T22:30:14.058762] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-16T22:30:14.066048] [INFO ] [REMOTE ] YETI: Full fetch complete (75560 records). [2025-10-16T22:30:14.066233] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-16T22:30:14.348084] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-16T22:30:14.492296] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-16T22:30:14.492463] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-16T22:30:14.494933] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-16T22:30:14.495031] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-16T22:30:14.497301] [DEBUG] [LOCAL ] YETI: Trimmed 75560 records to 52880 (keeping 200 days of data) [2025-10-16T22:30:14.839987] [DEBUG] [LOCAL ] YETI: Primary data saved (52880 records). [2025-10-16T22:30:14.840149] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-16T22:30:14.840274] [INFO ] [MAIN ] Update Progress: 2348/2369 symbols completed. YETI took 33.4s. Estimated remaining: 2m 57s. Rate: 7.1 symbols/min [2025-10-16T22:30:15.047260] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:30:15.061145] [DEBUG] [LOCAL ] YRD: Loaded 11484 existing records from primary storage. [2025-10-16T22:30:15.061377] [INFO ] [MAIN ] YRD: Loaded 11484 existing records. [2025-10-16T22:30:15.159570] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-10-16T22:30:15.281777] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T22:30:15.326586] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:30:15.326870] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-16T22:30:15.326925] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-16T22:30:15.327125] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-16T22:30:15.327184] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-16T22:30:15.740449] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:30:15.892712] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T22:30:15.942779] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-16T22:30:16.613759] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T22:30:16.742834] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-16T22:30:17.542847] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-16T22:30:17.663230] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T22:30:18.342810] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-10-16T22:30:18.495306] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T22:30:19.105839] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T22:30:19.142792] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-16T22:30:19.304371] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-16T22:30:19.942899] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-16T22:30:20.742794] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-16T22:30:20.887451] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T22:30:21.542833] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-16T22:30:21.623812] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T22:30:21.667054] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T22:30:22.342872] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-16T22:30:23.142800] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-16T22:30:23.164785] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-16T22:30:23.172615] [INFO ] [REMOTE ] YMM: Full fetch complete (76494 records). [2025-10-16T22:30:23.172820] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-16T22:30:23.386707] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T22:30:23.584976] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-16T22:30:23.585070] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-16T22:30:23.586335] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-16T22:30:23.586407] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-16T22:30:23.588072] [DEBUG] [LOCAL ] YMM: Trimmed 76494 records to 52990 (keeping 200 days of data) [2025-10-16T22:30:23.917192] [DEBUG] [LOCAL ] YMM: Primary data saved (52990 records). [2025-10-16T22:30:23.917364] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-16T22:30:23.918218] [INFO ] [MAIN ] Update Progress: 2349/2369 symbols completed. YMM took 40.0s. Estimated remaining: 2m 49s. Rate: 7.1 symbols/min [2025-10-16T22:30:23.948109] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-16T22:30:24.094298] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:30:24.120762] [DEBUG] [LOCAL ] YSG: Loaded 25514 existing records from primary storage. [2025-10-16T22:30:24.121037] [INFO ] [MAIN ] YSG: Loaded 25514 existing records. [2025-10-16T22:30:24.301637] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:30:24.301911] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-16T22:30:24.301958] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-16T22:30:24.302203] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-16T22:30:24.302259] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-16T22:30:24.693324] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:30:24.742771] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-10-16T22:30:24.966455] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T22:30:25.019601] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-16T22:30:25.542788] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-16T22:30:26.009561] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T22:30:26.342805] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-16T22:30:27.142789] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-16T22:30:27.317378] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T22:30:27.335390] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T22:30:27.942848] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-10-16T22:30:28.742869] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-16T22:30:28.889040] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T22:30:29.542793] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-16T22:30:29.717227] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-16T22:30:29.877146] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T22:30:30.342880] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-10-16T22:30:31.142913] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-16T22:30:31.196883] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T22:30:31.942816] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-16T22:30:31.998551] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T22:30:32.133171] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T22:30:32.742799] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-10-16T22:30:32.758739] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T22:30:33.542869] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-16T22:30:34.315487] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T22:30:34.342783] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-10. [2025-10-16T22:30:35.142870] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-16T22:30:35.318350] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T22:30:35.862812] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T22:30:35.869704] [INFO ] [REMOTE ] YOU: Full fetch complete (72323 records). [2025-10-16T22:30:35.869836] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-16T22:30:35.944421] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-16T22:30:36.052384] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-16T22:30:36.287963] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-16T22:30:36.288046] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-16T22:30:36.289390] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-16T22:30:36.289458] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-16T22:30:36.290971] [DEBUG] [LOCAL ] YOU: Trimmed 72323 records to 50016 (keeping 200 days of data) [2025-10-16T22:30:36.602130] [DEBUG] [LOCAL ] YOU: Primary data saved (50016 records). [2025-10-16T22:30:36.602272] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-16T22:30:36.602839] [INFO ] [MAIN ] Update Progress: 2350/2369 symbols completed. YOU took 33.5s. Estimated remaining: 2m 40s. Rate: 7.1 symbols/min [2025-10-16T22:30:36.746727] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-16T22:30:36.770512] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:30:36.823502] [DEBUG] [LOCAL ] YUM: Loaded 51170 existing records from primary storage. [2025-10-16T22:30:36.823867] [INFO ] [MAIN ] YUM: Loaded 51170 existing records. [2025-10-16T22:30:36.999927] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:30:37.000158] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-16T22:30:37.000227] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-16T22:30:37.000427] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-16T22:30:37.000465] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-16T22:30:37.346046] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:30:37.542769] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-10-16T22:30:37.591340] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T22:30:37.790154] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T22:30:38.342818] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-16T22:30:39.142829] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-16T22:30:39.328553] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T22:30:39.658816] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-16T22:30:39.942846] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T22:30:39.942973] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-16T22:30:40.742815] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-16T22:30:40.875530] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T22:30:41.542874] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-16T22:30:42.345266] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T22:30:42.344266] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-16T22:30:42.700024] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-16T22:30:43.142874] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-16T22:30:43.942868] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-16T22:30:44.176103] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T22:30:44.211573] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T22:30:44.742825] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-16T22:30:45.542848] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-16T22:30:45.619485] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T22:30:46.109672] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T22:30:46.342923] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-16T22:30:46.473548] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T22:30:47.142898] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-16T22:30:47.433728] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-16T22:30:47.905362] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T22:30:47.907598] [INFO ] [REMOTE ] YRD: Full fetch complete (19063 records). [2025-10-16T22:30:47.907705] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-16T22:30:47.947981] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-16T22:30:48.271553] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-16T22:30:48.271635] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-16T22:30:48.272090] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-16T22:30:48.272133] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-16T22:30:48.272733] [DEBUG] [LOCAL ] YRD: Trimmed 19063 records to 11610 (keeping 200 days of data) [2025-10-16T22:30:48.341679] [DEBUG] [LOCAL ] YRD: Primary data saved (11610 records). [2025-10-16T22:30:48.341832] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-16T22:30:48.341914] [INFO ] [MAIN ] Update Progress: 2351/2369 symbols completed. YRD took 33.5s. Estimated remaining: 2m 32s. Rate: 7.1 symbols/min [2025-10-16T22:30:48.506161] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:30:48.555140] [DEBUG] [LOCAL ] YUMC: Loaded 52590 existing records from primary storage. [2025-10-16T22:30:48.555494] [INFO ] [MAIN ] YUMC: Loaded 52590 existing records. [2025-10-16T22:30:48.734816] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:30:48.735107] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-16T22:30:48.735164] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-16T22:30:48.735352] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-16T22:30:48.735390] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-16T22:30:48.747955] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-16T22:30:49.077858] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:30:49.542835] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-10-16T22:30:49.875991] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-16T22:30:50.342803] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-10-16T22:30:50.622826] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-16T22:30:50.630107] [INFO ] [REMOTE ] YPF: Full fetch complete (73780 records). [2025-10-16T22:30:50.630310] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-16T22:30:50.864087] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-16T22:30:51.070143] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-16T22:30:51.070239] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-16T22:30:51.071488] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-16T22:30:51.071556] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-16T22:30:51.073143] [DEBUG] [LOCAL ] YPF: Trimmed 73780 records to 51053 (keeping 200 days of data) [2025-10-16T22:30:51.155935] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-10-16T22:30:51.378673] [DEBUG] [LOCAL ] YPF: Primary data saved (51053 records). [2025-10-16T22:30:51.378883] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-16T22:30:51.379513] [INFO ] [MAIN ] Update Progress: 2352/2369 symbols completed. YPF took 38.7s. Estimated remaining: 2m 23s. Rate: 7.1 symbols/min [2025-10-16T22:30:51.547430] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:30:51.599804] [DEBUG] [LOCAL ] ZBH: Loaded 50834 existing records from primary storage. [2025-10-16T22:30:51.600155] [INFO ] [MAIN ] ZBH: Loaded 50834 existing records. [2025-10-16T22:30:51.780960] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:30:51.781377] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-16T22:30:51.781538] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-16T22:30:51.781915] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-16T22:30:51.781975] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-16T22:30:51.943264] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-16T22:30:52.145798] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:30:52.184428] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-16T22:30:52.453314] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T22:30:52.742828] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-10-16T22:30:53.464349] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T22:30:53.542838] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-10. [2025-10-16T22:30:54.342826] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-16T22:30:54.377812] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T22:30:54.694363] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-16T22:30:54.699225] [INFO ] [REMOTE ] YSG: Full fetch complete (32478 records). [2025-10-16T22:30:54.699407] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-16T22:30:55.071674] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-16T22:30:55.071780] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-16T22:30:55.072426] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-16T22:30:55.072467] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-16T22:30:55.073318] [DEBUG] [LOCAL ] YSG: Trimmed 32478 records to 25729 (keeping 200 days of data) [2025-10-16T22:30:55.155276] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-16T22:30:55.218932] [DEBUG] [LOCAL ] YSG: Primary data saved (25729 records). [2025-10-16T22:30:55.219076] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-16T22:30:55.219158] [INFO ] [MAIN ] Update Progress: 2353/2369 symbols completed. YSG took 31.3s. Estimated remaining: 2m 15s. Rate: 7.1 symbols/min [2025-10-16T22:30:55.382386] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:30:55.401531] [DEBUG] [LOCAL ] ZEPP: Loaded 19046 existing records from primary storage. [2025-10-16T22:30:55.401866] [INFO ] [MAIN ] ZEPP: Loaded 19046 existing records. [2025-10-16T22:30:55.573151] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:30:55.573381] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-16T22:30:55.573429] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-16T22:30:55.573596] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-16T22:30:55.573634] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-16T22:30:55.931777] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:30:55.942768] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-10-16T22:30:56.237326] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-16T22:30:56.570848] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-16T22:30:56.742790] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-10-16T22:30:57.058548] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-16T22:30:57.309297] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-16T22:30:57.542869] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-16T22:30:58.342879] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-16T22:30:59.142819] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-10-16T22:30:59.394943] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-16T22:30:59.942790] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-16T22:31:00.038753] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T22:31:00.060055] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T22:31:00.742843] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-16T22:31:01.542971] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-10-16T22:31:01.607741] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T22:31:02.169351] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T22:31:02.342937] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-16T22:31:02.635543] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-16T22:31:03.142885] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-10-16T22:31:03.719744] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-16T22:31:03.942815] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-16T22:31:04.267285] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T22:31:04.742866] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-16T22:31:05.542830] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-16T22:31:05.737084] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T22:31:06.342776] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-16T22:31:06.674023] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-16T22:31:07.142789] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-10-16T22:31:07.207417] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T22:31:07.607726] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-16T22:31:07.942873] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-16T22:31:08.247464] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-16T22:31:08.742854] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-10-16T22:31:09.358882] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-16T22:31:09.542862] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-10-16T22:31:09.891573] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T22:31:10.342869] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-16T22:31:10.922604] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T22:31:11.142864] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-10-16T22:31:11.942795] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-16T22:31:12.054408] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T22:31:12.742872] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-16T22:31:12.881927] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T22:31:13.422797] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T22:31:13.542822] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-16T22:31:14.342862] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-16T22:31:14.515683] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T22:31:15.142799] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-16T22:31:15.393331] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-16T22:31:15.908404] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-16T22:31:15.915385] [INFO ] [REMOTE ] YUM: Full fetch complete (74682 records). [2025-10-16T22:31:15.915563] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-16T22:31:15.948021] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-10-16T22:31:16.325872] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-16T22:31:16.326028] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-16T22:31:16.327306] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-16T22:31:16.327387] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-16T22:31:16.354623] [DEBUG] [LOCAL ] YUM: Trimmed 74682 records to 51556 (keeping 200 days of data) [2025-10-16T22:31:16.356033] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-16T22:31:16.687403] [DEBUG] [LOCAL ] YUM: Primary data saved (51556 records). [2025-10-16T22:31:16.687546] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-16T22:31:16.688171] [INFO ] [MAIN ] Update Progress: 2354/2369 symbols completed. YUM took 40.1s. Estimated remaining: 2m 7s. Rate: 7.1 symbols/min [2025-10-16T22:31:16.752140] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-16T22:31:16.860708] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:31:16.914556] [DEBUG] [LOCAL ] ZETA: Loaded 53617 existing records from primary storage. [2025-10-16T22:31:16.914903] [INFO ] [MAIN ] ZETA: Loaded 53617 existing records. [2025-10-16T22:31:17.097561] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:31:17.097966] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-16T22:31:17.098038] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-16T22:31:17.098341] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-16T22:31:17.098412] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-16T22:31:17.456258] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:31:17.475244] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T22:31:17.542780] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-10-16T22:31:18.310722] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T22:31:18.342801] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-16T22:31:19.142841] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-10. [2025-10-16T22:31:19.942792] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-16T22:31:20.053697] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-16T22:31:20.133001] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T22:31:20.210538] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T22:31:20.214061] [INFO ] [REMOTE ] ZEPP: Full fetch complete (20771 records). [2025-10-16T22:31:20.214174] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-16T22:31:20.581911] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-16T22:31:20.581998] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-16T22:31:20.582485] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-16T22:31:20.582527] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-16T22:31:20.583298] [DEBUG] [LOCAL ] ZEPP: Trimmed 20771 records to 19177 (keeping 200 days of data) [2025-10-16T22:31:20.695591] [DEBUG] [LOCAL ] ZEPP: Primary data saved (19177 records). [2025-10-16T22:31:20.695769] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-16T22:31:20.695861] [INFO ] [MAIN ] Update Progress: 2355/2369 symbols completed. ZEPP took 25.5s. Estimated remaining: 1m 58s. Rate: 7.1 symbols/min [2025-10-16T22:31:20.751725] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-16T22:31:20.877294] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:31:20.930598] [DEBUG] [LOCAL ] ZGN: Loaded 40869 existing records from primary storage. [2025-10-16T22:31:20.930989] [INFO ] [MAIN ] ZGN: Loaded 40869 existing records. [2025-10-16T22:31:21.115130] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:31:21.115332] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-16T22:31:21.115395] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-16T22:31:21.115616] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-16T22:31:21.115709] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-16T22:31:21.494401] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:31:21.551960] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-16T22:31:21.559552] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T22:31:22.342807] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-10-16T22:31:23.023089] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-16T22:31:23.142786] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-16T22:31:23.404982] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T22:31:23.490881] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T22:31:23.942829] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-16T22:31:24.742839] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-16T22:31:25.290551] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-16T22:31:25.532881] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T22:31:25.542762] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-16T22:31:26.342868] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-16T22:31:26.579326] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T22:31:26.904571] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-16T22:31:27.142784] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-16T22:31:27.942854] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-16T22:31:28.425311] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-16T22:31:28.679312] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T22:31:28.742831] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-16T22:31:29.396211] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T22:31:29.542821] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-16T22:31:30.289299] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T22:31:30.342827] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-16T22:31:31.142824] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-16T22:31:31.218515] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T22:31:31.226701] [INFO ] [REMOTE ] YUMC: Full fetch complete (76404 records). [2025-10-16T22:31:31.226951] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-16T22:31:31.635449] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-16T22:31:31.635560] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-16T22:31:31.637078] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-16T22:31:31.637148] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-16T22:31:31.638930] [DEBUG] [LOCAL ] YUMC: Trimmed 76404 records to 52976 (keeping 200 days of data) [2025-10-16T22:31:31.951738] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-16T22:31:32.004440] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-16T22:31:32.045064] [DEBUG] [LOCAL ] YUMC: Primary data saved (52976 records). [2025-10-16T22:31:32.045243] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-16T22:31:32.045344] [INFO ] [MAIN ] Update Progress: 2356/2369 symbols completed. YUMC took 43.7s. Estimated remaining: 1m 50s. Rate: 7.1 symbols/min [2025-10-16T22:31:32.245618] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:31:32.272994] [DEBUG] [LOCAL ] ZH: Loaded 25337 existing records from primary storage. [2025-10-16T22:31:32.273340] [INFO ] [MAIN ] ZH: Loaded 25337 existing records. [2025-10-16T22:31:32.460431] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:31:32.461066] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-16T22:31:32.461152] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-16T22:31:32.461491] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-16T22:31:32.461548] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-16T22:31:32.750729] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-16T22:31:32.776477] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-16T22:31:32.898787] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:31:33.468986] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T22:31:33.476783] [INFO ] [REMOTE ] ZBH: Full fetch complete (73902 records). [2025-10-16T22:31:33.477019] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-16T22:31:33.544997] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-16T22:31:33.697041] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T22:31:33.942940] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-16T22:31:33.943045] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-16T22:31:33.944458] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-16T22:31:33.944528] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-16T22:31:33.946319] [DEBUG] [LOCAL ] ZBH: Trimmed 73902 records to 51201 (keeping 200 days of data) [2025-10-16T22:31:34.273757] [DEBUG] [LOCAL ] ZBH: Primary data saved (51201 records). [2025-10-16T22:31:34.273906] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-16T22:31:34.274693] [INFO ] [MAIN ] Update Progress: 2357/2369 symbols completed. ZBH took 42.9s. Estimated remaining: 1m 41s. Rate: 7.1 symbols/min [2025-10-16T22:31:34.342903] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-10-16T22:31:35.142889] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-16T22:31:35.446895] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T22:31:35.635867] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-16T22:31:35.942832] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-16T22:31:36.310594] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-16T22:31:36.742906] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-16T22:31:37.542923] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-16T22:31:38.166529] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-16T22:31:38.293244] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T22:31:38.342781] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-16T22:31:38.601321] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-16T22:31:39.143811] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-16T22:31:39.773231] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T22:31:39.942856] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-16T22:31:40.742859] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-16T22:31:41.264460] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T22:31:41.361126] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-16T22:31:41.542859] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-16T22:31:41.912801] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T22:31:42.342808] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-16T22:31:42.933406] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T22:31:42.939119] [INFO ] [REMOTE ] ZGN: Full fetch complete (58595 records). [2025-10-16T22:31:42.939234] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-16T22:31:43.171270] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-16T22:31:43.335967] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-16T22:31:43.336048] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-16T22:31:43.337241] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-16T22:31:43.337306] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-16T22:31:43.338552] [DEBUG] [LOCAL ] ZGN: Trimmed 58595 records to 41214 (keeping 200 days of data) [2025-10-16T22:31:43.587621] [DEBUG] [LOCAL ] ZGN: Primary data saved (41214 records). [2025-10-16T22:31:43.587780] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-16T22:31:43.588381] [INFO ] [MAIN ] Update Progress: 2358/2369 symbols completed. ZGN took 22.9s. Estimated remaining: 1m 33s. Rate: 7.1 symbols/min [2025-10-16T22:31:44.714854] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T22:31:44.723734] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-16T22:31:44.886662] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-16T22:31:44.898315] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-16T22:31:46.021372] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T22:31:46.028177] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-16T22:31:46.990755] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-16T22:31:46.995207] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-16T22:31:47.363904] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-16T22:31:47.375711] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-16T22:31:47.701352] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T22:31:47.942854] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-16T22:31:48.921597] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-16T22:31:48.928177] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-16T22:31:49.401319] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-16T22:31:49.408519] [INFO ] [REMOTE ] ZETA: Full fetch complete (77734 records). [2025-10-16T22:31:49.408754] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-16T22:31:49.854280] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T22:31:49.904957] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-16T22:31:49.905201] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-16T22:31:49.907017] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-16T22:31:49.907109] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-16T22:31:49.907732] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-16T22:31:49.910031] [DEBUG] [LOCAL ] ZETA: Trimmed 77734 records to 54007 (keeping 200 days of data) [2025-10-16T22:31:50.268227] [DEBUG] [LOCAL ] ZETA: Primary data saved (54007 records). [2025-10-16T22:31:50.268382] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-16T22:31:50.269026] [INFO ] [MAIN ] Update Progress: 2359/2369 symbols completed. ZETA took 33.6s. Estimated remaining: 1m 24s. Rate: 7.1 symbols/min [2025-10-16T22:31:51.131262] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-16T22:31:51.138165] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-16T22:31:52.206854] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T22:31:52.210461] [INFO ] [REMOTE ] ZH: Full fetch complete (39893 records). [2025-10-16T22:31:52.210562] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-16T22:31:52.623492] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-16T22:31:52.623593] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-16T22:31:52.624614] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-16T22:31:52.624702] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-16T22:31:52.625800] [DEBUG] [LOCAL ] ZH: Trimmed 39893 records to 25479 (keeping 200 days of data) [2025-10-16T22:31:52.768628] [DEBUG] [LOCAL ] ZH: Primary data saved (25479 records). [2025-10-16T22:31:52.768945] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-16T22:31:52.769088] [INFO ] [MAIN ] Update Progress: 2360/2369 symbols completed. ZH took 20.7s. Estimated remaining: 1m 16s. Rate: 7.1 symbols/min [2025-10-16T22:31:53.499911] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:31:53.537490] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:31:53.570324] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:31:53.576577] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:31:53.590266] [DEBUG] [LOCAL ] ZKH: Loaded 7471 existing records from primary storage. [2025-10-16T22:31:53.590833] [INFO ] [MAIN ] ZKH: Loaded 7471 existing records. [2025-10-16T22:31:53.812420] [DEBUG] [LOCAL ] ZK: Loaded 39127 existing records from primary storage. [2025-10-16T22:31:53.813394] [DEBUG] [LOCAL ] ZIP: Loaded 43691 existing records from primary storage. [2025-10-16T22:31:53.813889] [INFO ] [MAIN ] ZK: Loaded 39127 existing records. [2025-10-16T22:31:53.836186] [INFO ] [MAIN ] ZIP: Loaded 43691 existing records. [2025-10-16T22:31:54.004188] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:31:54.055176] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-16T22:31:54.096557] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-16T22:31:54.128895] [DEBUG] [LOCAL ] ZIM: Loaded 53493 existing records from primary storage. [2025-10-16T22:31:54.132770] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-16T22:31:54.139332] [INFO ] [MAIN ] ZIM: Loaded 53493 existing records. [2025-10-16T22:31:54.186378] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-16T22:31:54.348830] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:31:54.364216] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-16T22:31:54.465130] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-16T22:31:54.423310] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:31:54.504782] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-16T22:31:54.520432] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-16T22:31:54.520548] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-16T22:31:54.546163] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-16T22:31:54.567597] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-16T22:31:54.686501] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-16T22:31:54.741094] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:31:54.865193] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-16T22:31:54.884163] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-16T22:31:54.975062] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-16T22:31:55.019278] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-16T22:31:55.208909] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:31:55.441892] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-10-16T22:31:55.698480] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:31:55.763582] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-10-16T22:31:55.898799] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:31:55.909489] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-10-16T22:31:55.976150] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:31:55.976444] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-10-16T22:31:56.193950] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T22:31:56.195750] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-16T22:31:56.886217] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T22:31:56.888525] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-16T22:31:57.161147] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T22:31:57.169960] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-16T22:31:57.222050] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T22:31:57.229537] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-16T22:31:57.383057] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-16T22:31:57.542759] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-16T22:31:57.819196] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-16T22:31:57.973567] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-16T22:31:58.166189] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T22:31:58.342862] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-16T22:31:58.633410] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T22:31:58.932411] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-16T22:31:59.142839] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-16T22:31:59.942871] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-16T22:32:00.610468] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T22:32:00.742836] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-16T22:32:01.542830] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-16T22:32:01.924613] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-16T22:32:01.960887] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-16T22:32:02.342862] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-16T22:32:02.464522] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T22:32:02.914267] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-16T22:32:03.142824] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-16T22:32:03.942861] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-16T22:32:04.446977] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T22:32:04.742841] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-16T22:32:04.946391] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-16T22:32:05.542901] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-16T22:32:06.342855] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-16T22:32:06.558066] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-16T22:32:07.142858] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-16T22:32:07.310312] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T22:32:07.887490] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T22:32:07.942781] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-16T22:32:08.742863] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-16T22:32:09.498442] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-16T22:32:09.547904] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-16T22:32:09.564364] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T22:32:10.342819] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-16T22:32:10.393241] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T22:32:11.142825] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-16T22:32:11.701209] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T22:32:11.955174] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-16T22:32:11.962333] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-16T22:32:12.351285] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T22:32:12.742830] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-16T22:32:12.900895] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T22:32:13.542821] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-16T22:32:13.950134] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T22:32:14.342844] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-16T22:32:15.142839] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-16T22:32:15.851460] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T22:32:15.942812] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-16T22:32:16.051498] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-16T22:32:16.340309] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T22:32:16.742822] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-16T22:32:17.445562] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T22:32:17.542821] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-16T22:32:17.928679] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T22:32:18.342895] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-16T22:32:18.849620] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-16T22:32:18.855238] [INFO ] [REMOTE ] ZK: Full fetch complete (56961 records). [2025-10-16T22:32:18.855390] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-16T22:32:19.147912] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-16T22:32:19.257879] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-16T22:32:19.257957] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-16T22:32:19.259052] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-16T22:32:19.259114] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-16T22:32:19.260274] [DEBUG] [LOCAL ] ZK: Trimmed 56961 records to 39387 (keeping 200 days of data) [2025-10-16T22:32:19.354409] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T22:32:19.498054] [DEBUG] [LOCAL ] ZK: Primary data saved (39387 records). [2025-10-16T22:32:19.498205] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-16T22:32:19.498306] [INFO ] [MAIN ] Update Progress: 2361/2369 symbols completed. ZK took 26.7s. Estimated remaining: 1m 8s. Rate: 7.1 symbols/min [2025-10-16T22:32:19.672816] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:32:19.720427] [DEBUG] [LOCAL ] ZTO: Loaded 49488 existing records from primary storage. [2025-10-16T22:32:19.720757] [INFO ] [MAIN ] ZTO: Loaded 49488 existing records. [2025-10-16T22:32:19.891983] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:32:19.892263] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-16T22:32:19.892320] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-16T22:32:19.893088] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-16T22:32:19.893156] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-16T22:32:19.954721] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-16T22:32:20.239401] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:32:20.729612] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-16T22:32:20.742763] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-16T22:32:21.491843] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T22:32:21.493396] [INFO ] [REMOTE ] ZKH: Full fetch complete (11895 records). [2025-10-16T22:32:21.493474] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-16T22:32:21.547933] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-10-16T22:32:21.878823] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-16T22:32:21.879062] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-16T22:32:21.879637] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-16T22:32:21.879769] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-16T22:32:21.880566] [DEBUG] [LOCAL ] ZKH: Trimmed 11895 records to 7484 (keeping 200 days of data) [2025-10-16T22:32:21.927592] [DEBUG] [LOCAL ] ZKH: Primary data saved (7484 records). [2025-10-16T22:32:21.927853] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-16T22:32:21.927973] [INFO ] [MAIN ] Update Progress: 2362/2369 symbols completed. ZKH took 29.2s. Estimated remaining: 59.1s. Rate: 7.1 symbols/min [2025-10-16T22:32:22.123255] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:32:22.155193] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (3.01 seconds). [2025-10-16T22:32:22.184711] [DEBUG] [LOCAL ] ZTR: Loaded 16698 existing records from primary storage. [2025-10-16T22:32:22.185176] [INFO ] [MAIN ] ZTR: Loaded 16698 existing records. [2025-10-16T22:32:22.347227] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-16T22:32:22.380715] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:32:22.381135] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-16T22:32:22.381197] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-16T22:32:22.381486] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-16T22:32:22.381589] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-16T22:32:22.770015] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:32:23.142819] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-16T22:32:23.355361] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T22:32:23.942869] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-10-16T22:32:24.579981] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-16T22:32:24.747084] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-16T22:32:24.746914] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-16T22:32:24.776846] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T22:32:25.542886] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-10-16T22:32:26.119163] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T22:32:26.124824] [INFO ] [REMOTE ] ZIP: Full fetch complete (60360 records). [2025-10-16T22:32:26.124987] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-16T22:32:26.347951] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-16T22:32:26.506556] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-16T22:32:26.506665] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-16T22:32:26.507802] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-16T22:32:26.507865] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-16T22:32:26.509194] [DEBUG] [LOCAL ] ZIP: Trimmed 60360 records to 43935 (keeping 200 days of data) [2025-10-16T22:32:26.760318] [DEBUG] [LOCAL ] ZIP: Primary data saved (43935 records). [2025-10-16T22:32:26.760458] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-16T22:32:26.760540] [INFO ] [MAIN ] Update Progress: 2363/2369 symbols completed. ZIP took 34.0s. Estimated remaining: 50.6s. Rate: 7.1 symbols/min [2025-10-16T22:32:26.925822] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:32:26.981224] [DEBUG] [LOCAL ] ZTS: Loaded 53149 existing records from primary storage. [2025-10-16T22:32:26.981665] [INFO ] [MAIN ] ZTS: Loaded 53149 existing records. [2025-10-16T22:32:27.148693] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-16T22:32:27.154102] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:32:27.155366] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-16T22:32:27.155418] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-16T22:32:27.155603] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-16T22:32:27.155660] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-16T22:32:27.500541] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:32:27.887617] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-16T22:32:27.954947] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-10-16T22:32:27.961578] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T22:32:28.473893] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T22:32:28.742883] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-16T22:32:29.542924] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-10-16T22:32:30.175946] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-16T22:32:30.342907] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-10. [2025-10-16T22:32:30.467170] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T22:32:30.996557] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T22:32:31.142831] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-16T22:32:31.942932] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-16T22:32:32.104903] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-16T22:32:32.112904] [INFO ] [REMOTE ] ZIM: Full fetch complete (77598 records). [2025-10-16T22:32:32.113162] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-16T22:32:32.526570] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-16T22:32:32.526704] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-16T22:32:32.528668] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-16T22:32:32.528737] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-16T22:32:32.530717] [DEBUG] [LOCAL ] ZIM: Trimmed 77598 records to 53881 (keeping 200 days of data) [2025-10-16T22:32:32.779078] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-16T22:32:32.785828] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T22:32:32.926037] [DEBUG] [LOCAL ] ZIM: Primary data saved (53881 records). [2025-10-16T22:32:32.926281] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-16T22:32:32.926404] [INFO ] [MAIN ] Update Progress: 2364/2369 symbols completed. ZIM took 40.2s. Estimated remaining: 42.2s. Rate: 7.1 symbols/min [2025-10-16T22:32:33.111083] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:32:33.111389] [DEBUG] [LOCAL ] ZVIA: No existing data file found in primary storage. [2025-10-16T22:32:33.111626] [WARN ] [MAIN ] ZVIA: No existing data found, performing full refresh instead. [2025-10-16T22:32:33.111970] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-16T22:32:33.112014] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-16T22:32:33.137385] [DEBUG] [LOCAL ] ZVIA: No primary data file found to delete. [2025-10-16T22:32:33.137531] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-16T22:32:33.222769] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-16T22:32:33.543818] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:32:33.543950] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-16T22:32:34.342841] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-10-16T22:32:34.687731] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-16T22:32:35.142829] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-16T22:32:35.345484] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T22:32:35.826572] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T22:32:35.942782] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-16T22:32:36.742797] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-16T22:32:36.915436] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T22:32:37.483147] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T22:32:37.542783] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-16T22:32:37.761505] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T22:32:38.342868] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-16T22:32:38.883711] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-16T22:32:39.142827] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-16T22:32:39.942889] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-16T22:32:40.289694] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T22:32:40.619339] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T22:32:40.742899] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-16T22:32:41.542878] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-16T22:32:41.755234] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T22:32:42.342884] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-16T22:32:42.649338] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-16T22:32:42.816811] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T22:32:43.142855] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-16T22:32:43.569324] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T22:32:43.942870] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-16T22:32:44.607370] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T22:32:44.742815] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-16T22:32:45.542829] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-16T22:32:45.739133] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-16T22:32:45.770091] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T22:32:46.342823] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-16T22:32:47.142813] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-16T22:32:47.393320] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-16T22:32:47.875881] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T22:32:47.942895] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-16T22:32:48.742782] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-16T22:32:48.860379] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T22:32:49.542862] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-16T22:32:49.711718] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T22:32:49.761448] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-16T22:32:50.342872] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-16T22:32:51.110607] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T22:32:51.142773] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-16T22:32:51.320906] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T22:32:51.942812] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-16T22:32:52.579888] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-16T22:32:52.742827] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-16T22:32:53.542792] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-16T22:32:53.712236] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T22:32:54.154398] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T22:32:54.159460] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52846 records). [2025-10-16T22:32:54.159548] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-16T22:32:54.347935] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-16T22:32:54.547688] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-16T22:32:54.547785] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-16T22:32:54.549084] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-16T22:32:54.549154] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-16T22:32:54.550244] [DEBUG] [LOCAL ] ZVIA: Trimmed 52846 records to 36071 (keeping 200 days of data) [2025-10-16T22:32:54.755626] [DEBUG] [LOCAL ] ZVIA: Primary data saved (36071 records). [2025-10-16T22:32:54.755794] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-16T22:32:54.755869] [INFO ] [MAIN ] Update Progress: 2365/2369 symbols completed. ZVIA took 21.8s. Estimated remaining: 33.8s. Rate: 7.1 symbols/min [2025-10-16T22:32:54.930671] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T22:32:54.971368] [DEBUG] [LOCAL ] ZWS: Loaded 42402 existing records from primary storage. [2025-10-16T22:32:54.971671] [INFO ] [MAIN ] ZWS: Loaded 42402 existing records. [2025-10-16T22:32:55.142807] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-16T22:32:55.146667] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T22:32:55.147709] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-16T22:32:55.147853] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-16T22:32:55.148058] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-16T22:32:55.148098] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-16T22:32:55.510969] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T22:32:55.541545] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-16T22:32:55.789177] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-16T22:32:55.942800] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-16T22:32:56.036122] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T22:32:56.042608] [INFO ] [REMOTE ] ZTO: Full fetch complete (72880 records). [2025-10-16T22:32:56.042772] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-16T22:32:56.429103] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-16T22:32:56.429215] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-16T22:32:56.430444] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-16T22:32:56.430506] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-16T22:32:56.432078] [DEBUG] [LOCAL ] ZTO: Trimmed 72880 records to 49876 (keeping 200 days of data) [2025-10-16T22:32:56.742964] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-16T22:32:56.744425] [DEBUG] [LOCAL ] ZTO: Primary data saved (49876 records). [2025-10-16T22:32:56.745770] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-16T22:32:56.746369] [INFO ] [MAIN ] Update Progress: 2366/2369 symbols completed. ZTO took 37.2s. Estimated remaining: 25.3s. Rate: 7.1 symbols/min [2025-10-16T22:32:57.001965] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T22:32:57.542832] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-10-16T22:32:58.342834] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-16T22:32:58.644414] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T22:32:59.030404] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T22:32:59.142860] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-16T22:32:59.368260] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T22:32:59.942831] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-16T22:33:00.742819] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-16T22:33:00.980735] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T22:33:01.551699] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-16T22:33:01.555381] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T22:33:01.728324] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T22:33:02.247515] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T22:33:02.255301] [INFO ] [REMOTE ] ZTS: Full fetch complete (76878 records). [2025-10-16T22:33:02.255512] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-16T22:33:02.353135] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-16T22:33:02.669761] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-16T22:33:02.669877] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-16T22:33:02.671662] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-16T22:33:02.671736] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-16T22:33:02.673819] [DEBUG] [LOCAL ] ZTS: Trimmed 76878 records to 53529 (keeping 200 days of data) [2025-10-16T22:33:03.036893] [DEBUG] [LOCAL ] ZTS: Primary data saved (53529 records). [2025-10-16T22:33:03.037115] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-16T22:33:03.038061] [INFO ] [MAIN ] Update Progress: 2367/2369 symbols completed. ZTS took 36.3s. Estimated remaining: 16.9s. Rate: 7.1 symbols/min [2025-10-16T22:33:03.142829] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-16T22:33:03.331257] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T22:33:03.334329] [INFO ] [REMOTE ] ZTR: Full fetch complete (26880 records). [2025-10-16T22:33:03.334416] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-16T22:33:03.732476] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-16T22:33:03.732616] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-16T22:33:03.733540] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-16T22:33:03.733598] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-16T22:33:03.734761] [DEBUG] [LOCAL ] ZTR: Trimmed 26880 records to 16776 (keeping 200 days of data) [2025-10-16T22:33:03.853843] [DEBUG] [LOCAL ] ZTR: Primary data saved (16776 records). [2025-10-16T22:33:03.854094] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-16T22:33:03.854232] [INFO ] [MAIN ] Update Progress: 2368/2369 symbols completed. ZTR took 41.9s. Estimated remaining: 8.4s. Rate: 7.1 symbols/min [2025-10-16T22:33:04.705082] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T22:33:04.714262] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-16T22:33:06.345904] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T22:33:06.355036] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-16T22:33:08.079453] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T22:33:08.090556] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-16T22:33:09.695904] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T22:33:09.704471] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-16T22:33:11.085776] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T22:33:11.095076] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-16T22:33:12.721021] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T22:33:12.731019] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-16T22:33:14.342792] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T22:33:14.352792] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-16T22:33:15.982972] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T22:33:15.994608] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-16T22:33:17.466545] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T22:33:17.472508] [INFO ] [REMOTE ] ZWS: Full fetch complete (62070 records). [2025-10-16T22:33:17.472694] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-16T22:33:17.859526] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-16T22:33:17.859611] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-16T22:33:17.860787] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-16T22:33:17.860850] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-16T22:33:17.862233] [DEBUG] [LOCAL ] ZWS: Trimmed 62070 records to 42718 (keeping 200 days of data) [2025-10-16T22:33:18.118037] [DEBUG] [LOCAL ] ZWS: Primary data saved (42718 records). [2025-10-16T22:33:18.118160] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-16T22:33:18.118259] [INFO ] [MAIN ] Update Progress: 2369/2369 symbols completed. ZWS took 23.4s. Estimated remaining: 0.0s. Rate: 7.1 symbols/min [2025-10-16T22:33:18.119623] [INFO ] [MAIN ] Parallel update completed in 5h 33m 14s [2025-10-16T22:33:18.119740] [WARN ] [MAIN ] Failed symbols (566): AAMI, AAM, AAUC, ABBV, ACA, AD, ADC, ADM, AEFC, AEXA... [2025-10-16T22:33:18.119825] [INFO ] [MAIN ] Update success rate: 76.1% (1803/2369 symbols) [2025-10-16T22:33:18.904191] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (1803/2369 @ 76.11%)' [2025-10-16T22:33:18.904883] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-16T22:33:18.904958] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-16T22:33:18.904996] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-16T22:33:18.905114] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-16T22:33:18.905151] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-16T22:33:20.569563] [DEBUG] [SYMBOL ] Found 2421 valid NYSE symbols. [2025-10-16T22:33:20.569806] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-16T22:33:20.570154] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-16T22:33:20.570706] [INFO ] [LOCAL ] Symbols cache updated with 2369 symbols. [2025-10-16T22:33:20.570764] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-16T22:33:20.570842] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-16T22:33:20.570918] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-16T22:33:20.570985] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-16T22:33:20.571028] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-16T22:33:20.571575] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-10-16T22:33:20.571674] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-16T22:33:20.571922] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-16T22:33:20.571995] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2369 valid symbols. [2025-10-16T22:33:20.572055] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-16T22:33:20.572130] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-16T22:33:20.595269] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-16T22:33:20.616698] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-16T22:33:20.616794] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-16T22:33:20.616829] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-16T22:33:20.616857] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-16T22:33:20.616910] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-16T22:33:20.616941] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-16T22:33:20.616974] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-16T22:33:20.617997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-16T22:33:20.618095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-16T22:33:20.618220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-16T22:33:20.618357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-16T22:33:20.618463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-10-16T22:33:20.618557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-10-16T22:33:20.618674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-16T22:33:20.618771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-16T22:33:20.618855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-10-16T22:33:20.618949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-16T22:33:20.619017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-10-16T22:33:20.619100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-10-16T22:33:20.619202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-10-16T22:33:20.619289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-16T22:33:20.619405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-16T22:33:20.619511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-16T22:33:20.619618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-10-16T22:33:20.619750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-10-16T22:33:20.619863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-16T22:33:20.619958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-10-16T22:33:20.620030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-10-16T22:33:20.620095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-10-16T22:33:20.620173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-16T22:33:20.620276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-10-16T22:33:20.620367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-10-16T22:33:20.620436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-16T22:33:20.620517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-10-16T22:33:20.620615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-16T22:33:20.620730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-10-16T22:33:20.620823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-16T22:33:20.620907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-10-16T22:33:20.620999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-10-16T22:33:20.621065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-10-16T22:33:20.621153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-10-16T22:33:20.621247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-16T22:33:20.621314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-16T22:33:20.621398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-10-16T22:33:20.621508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-10-16T22:33:20.621595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-10-16T22:33:20.621689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-16T22:33:20.621786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-16T22:33:20.621854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-16T22:33:20.621918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-10-16T22:33:20.621981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-16T22:33:20.622084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-16T22:33:20.622205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-16T22:33:20.622295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-16T22:33:20.622375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-16T22:33:20.622478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-16T22:33:20.622567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-16T22:33:20.622632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-10-16T22:33:20.622766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-10-16T22:33:20.622870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-16T22:33:20.622960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-10-16T22:33:20.623042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-16T22:33:20.623161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-10-16T22:33:20.623247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-16T22:33:20.623372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-16T22:33:20.623492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-16T22:33:20.623620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-16T22:33:20.623780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-16T22:33:20.623899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-16T22:33:20.624021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-10-16T22:33:20.624158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-16T22:33:20.624282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-16T22:33:20.624418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-16T22:33:20.624562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-10-16T22:33:20.624730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-16T22:33:20.624864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-16T22:33:20.624992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-16T22:33:20.625126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-16T22:33:20.625265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-16T22:33:20.625386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-16T22:33:20.625516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-10-16T22:33:20.625673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-16T22:33:20.625789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-16T22:33:20.625908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-16T22:33:20.626047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-16T22:33:20.626161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-16T22:33:20.626307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-16T22:33:20.626420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-16T22:33:20.626543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-10-16T22:33:20.626682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-10-16T22:33:20.626808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-16T22:33:20.626930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-10-16T22:33:20.627048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-16T22:33:20.627166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-16T22:33:20.627293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-10-16T22:33:20.627413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-16T22:33:20.627516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-10-16T22:33:20.627608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-16T22:33:20.627757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-16T22:33:20.627846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-16T22:33:20.627935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-16T22:33:20.628026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-16T22:33:20.628093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-10-16T22:33:20.628156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-16T22:33:20.628258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-16T22:33:20.628345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-10-16T22:33:20.628424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-10-16T22:33:20.628516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-16T22:33:20.628585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-16T22:33:20.628676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-16T22:33:20.628782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-10-16T22:33:20.628869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-16T22:33:20.628936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-10-16T22:33:20.628999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-10-16T22:33:20.629064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-16T22:33:20.629128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-16T22:33:20.629192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-16T22:33:20.629270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-10-16T22:33:20.629361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-16T22:33:20.629427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-10-16T22:33:20.629490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-16T22:33:20.629553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-16T22:33:20.629615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-16T22:33:20.629715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-16T22:33:20.629839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-10-16T22:33:20.629931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-16T22:33:20.630000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-10-16T22:33:20.630082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-16T22:33:20.630168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-16T22:33:20.630248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-16T22:33:20.630375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-10-16T22:33:20.630476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-16T22:33:20.630565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-16T22:33:20.630709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-16T22:33:20.630832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-16T22:33:20.630957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-10-16T22:33:20.631067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-10-16T22:33:20.631185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-16T22:33:20.631303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-10-16T22:33:20.631417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-16T22:33:20.631542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-10-16T22:33:20.631689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-10-16T22:33:20.631828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-10-16T22:33:20.631937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-16T22:33:20.632051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-16T22:33:20.632169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-10-16T22:33:20.632296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-16T22:33:20.632416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-16T22:33:20.632521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-16T22:33:20.632660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-16T22:33:20.632780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-16T22:33:20.632898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-16T22:33:20.633016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-16T22:33:20.633119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-16T22:33:20.633232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-10-16T22:33:20.633361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-16T22:33:20.633490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-16T22:33:20.633611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-16T22:33:20.633753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-16T22:33:20.633856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-16T22:33:20.633959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-16T22:33:20.634086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-16T22:33:20.634214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-16T22:33:20.634319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-16T22:33:20.634423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-10-16T22:33:20.634496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-16T22:33:20.634574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-16T22:33:20.634697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-16T22:33:20.634802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-16T22:33:20.634889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-10-16T22:33:20.634983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-10-16T22:33:20.635071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-10-16T22:33:20.635154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-10-16T22:33:20.635239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-16T22:33:20.635306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-10-16T22:33:20.635369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-16T22:33:20.635444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-10-16T22:33:20.635555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-10-16T22:33:20.635701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-16T22:33:20.635794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-10-16T22:33:20.635858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-16T22:33:20.635919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-16T22:33:20.636007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-16T22:33:20.636113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-10-16T22:33:20.636178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-10-16T22:33:20.636239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-10-16T22:33:20.636299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-16T22:33:20.636360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-10-16T22:33:20.636419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-16T22:33:20.636496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-10-16T22:33:20.636580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-16T22:33:20.636666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-10-16T22:33:20.636756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-10-16T22:33:20.636819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-10-16T22:33:20.636879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-16T22:33:20.636939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-10-16T22:33:20.637004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-10-16T22:33:20.637081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-16T22:33:20.637182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-10-16T22:33:20.637274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-16T22:33:20.637348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-16T22:33:20.637417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-16T22:33:20.637487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-16T22:33:20.637572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-16T22:33:20.637716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-10-16T22:33:20.637839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-16T22:33:20.637958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-10-16T22:33:20.638080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-10-16T22:33:20.638227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-10-16T22:33:20.638352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-16T22:33:20.638486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-16T22:33:20.638601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-10-16T22:33:20.638758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-10-16T22:33:20.638887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-10-16T22:33:20.639008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-16T22:33:20.639133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-10-16T22:33:20.639261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-16T22:33:20.639392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-10-16T22:33:20.639511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-16T22:33:20.639632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-10-16T22:33:20.639786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-16T22:33:20.639913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-10-16T22:33:20.640023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-10-16T22:33:20.640151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-16T22:33:20.640263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-10-16T22:33:20.640390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-16T22:33:20.640514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-16T22:33:20.640729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-16T22:33:20.640885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-16T22:33:20.641004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-16T22:33:20.641119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-16T22:33:20.641252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-10-16T22:33:20.641373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-16T22:33:20.641480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-16T22:33:20.641592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-10-16T22:33:20.641875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-16T22:33:20.641975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-16T22:33:20.642049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-16T22:33:20.642127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-10-16T22:33:20.642191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-10-16T22:33:20.642252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-16T22:33:20.642319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-16T22:33:20.642386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-16T22:33:20.642448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-10-16T22:33:20.642514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-16T22:33:20.642594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-16T22:33:20.642717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-16T22:33:20.642799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-10-16T22:33:20.642865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-16T22:33:20.642931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-10-16T22:33:20.642999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-16T22:33:20.643063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-16T22:33:20.643130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-16T22:33:20.643194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-16T22:33:20.643261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-10-16T22:33:20.643326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-16T22:33:20.643388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-16T22:33:20.643449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-10-16T22:33:20.643513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-16T22:33:20.643577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-16T22:33:20.643665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-16T22:33:20.643759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-10-16T22:33:20.643826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-16T22:33:20.643891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-16T22:33:20.643960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-16T22:33:20.644027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-16T22:33:20.644090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-10-16T22:33:20.644155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-16T22:33:20.644220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-10-16T22:33:20.644286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-16T22:33:20.644350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-10-16T22:33:20.644417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-16T22:33:20.644498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-16T22:33:20.644587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-16T22:33:20.644692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-16T22:33:20.644830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-16T22:33:20.644957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-10-16T22:33:20.645094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-10-16T22:33:20.645210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-16T22:33:20.645314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-10-16T22:33:20.645429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-16T22:33:20.645537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-16T22:33:20.645693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-16T22:33:20.645848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-16T22:33:20.645958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-10-16T22:33:20.646078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-16T22:33:20.646196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-10-16T22:33:20.646322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-10-16T22:33:20.646439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-10-16T22:33:20.646564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-16T22:33:20.646706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-16T22:33:20.646838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-16T22:33:20.646951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-16T22:33:20.647056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-10-16T22:33:20.647171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-16T22:33:20.647271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-16T22:33:20.647383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-16T22:33:20.647497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-16T22:33:20.647638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-16T22:33:20.647786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-16T22:33:20.647894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-10-16T22:33:20.648019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-10-16T22:33:20.648134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-16T22:33:20.648261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-16T22:33:20.648405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-16T22:33:20.648517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-16T22:33:20.648598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-10-16T22:33:20.648711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-10-16T22:33:20.648806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-10-16T22:33:20.648872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-10-16T22:33:20.648939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-16T22:33:20.649003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-10-16T22:33:20.649067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-16T22:33:20.649131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-16T22:33:20.649209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-10-16T22:33:20.649302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-16T22:33:20.649370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-10-16T22:33:20.649433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-16T22:33:20.649509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-16T22:33:20.649600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-10-16T22:33:20.649778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-10-16T22:33:20.649868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-10-16T22:33:20.649933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-16T22:33:20.650005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-10-16T22:33:20.650082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-16T22:33:20.650171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETSY.csv [2025-10-16T22:33:20.650237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-10-16T22:33:20.650300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-10-16T22:33:20.650360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-10-16T22:33:20.650423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-16T22:33:20.650501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-16T22:33:20.650564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-16T22:33:20.650624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-16T22:33:20.650728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-16T22:33:20.650821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-16T22:33:20.650919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-10-16T22:33:20.650993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-10-16T22:33:20.651055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-10-16T22:33:20.651115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-10-16T22:33:20.651174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-10-16T22:33:20.651233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-16T22:33:20.651293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-16T22:33:20.651352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-10-16T22:33:20.651414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-16T22:33:20.651475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-16T22:33:20.651534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-16T22:33:20.651659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-16T22:33:20.651781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-16T22:33:20.651898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-16T22:33:20.652020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-16T22:33:20.652138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-10-16T22:33:20.652254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-16T22:33:20.652370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-16T22:33:20.652523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-16T22:33:20.652664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-10-16T22:33:20.652786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-16T22:33:20.652902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-16T22:33:20.653010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-16T22:33:20.653118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-16T22:33:20.653234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-16T22:33:20.653368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-16T22:33:20.653478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-16T22:33:20.653581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-10-16T22:33:20.653726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-16T22:33:20.653848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-10-16T22:33:20.653956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-10-16T22:33:20.654052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-16T22:33:20.654164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-16T22:33:20.654281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-16T22:33:20.654387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-16T22:33:20.654499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-10-16T22:33:20.654602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-16T22:33:20.654817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-16T22:33:20.654936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-16T22:33:20.655035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-16T22:33:20.655182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-16T22:33:20.655306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-16T22:33:20.655417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-16T22:33:20.655536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-16T22:33:20.655625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-16T22:33:20.655747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-16T22:33:20.655825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-10-16T22:33:20.655890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-10-16T22:33:20.655954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-16T22:33:20.656019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-10-16T22:33:20.656086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-16T22:33:20.656149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-10-16T22:33:20.656214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-16T22:33:20.656280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-16T22:33:20.656343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-10-16T22:33:20.656409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-16T22:33:20.656482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-16T22:33:20.656546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-10-16T22:33:20.656609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-16T22:33:20.656700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-16T22:33:20.656789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-16T22:33:20.656858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-16T22:33:20.656921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-16T22:33:20.656983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-10-16T22:33:20.657044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-10-16T22:33:20.657108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-16T22:33:20.657172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-16T22:33:20.657256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-10-16T22:33:20.657349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-16T22:33:20.657417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-16T22:33:20.657484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-16T22:33:20.657548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-16T22:33:20.657627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-16T22:33:20.657752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-16T22:33:20.657822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-10-16T22:33:20.657886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-10-16T22:33:20.657946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-10-16T22:33:20.658025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-10-16T22:33:20.658116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-10-16T22:33:20.658231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-10-16T22:33:20.658324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-10-16T22:33:20.658388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-10-16T22:33:20.658503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-10-16T22:33:20.658615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-16T22:33:20.658766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-16T22:33:20.658886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-16T22:33:20.659028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-16T22:33:20.659137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-10-16T22:33:20.659253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-10-16T22:33:20.659388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-10-16T22:33:20.659531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-16T22:33:20.659857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-16T22:33:20.660003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-16T22:33:20.660140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-10-16T22:33:20.660295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-16T22:33:20.660436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-16T22:33:20.660573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-10-16T22:33:20.660733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-16T22:33:20.660877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-10-16T22:33:20.661016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-16T22:33:20.661150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-10-16T22:33:20.661284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-10-16T22:33:20.661423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-16T22:33:20.661554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-10-16T22:33:20.661713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-16T22:33:20.661854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-16T22:33:20.662001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-10-16T22:33:20.662139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-16T22:33:20.662275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-16T22:33:20.662407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-10-16T22:33:20.662550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-10-16T22:33:20.662703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-10-16T22:33:20.662851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-16T22:33:20.662983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-10-16T22:33:20.663122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-16T22:33:20.663255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-16T22:33:20.663394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-16T22:33:20.663536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-10-16T22:33:20.663702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-10-16T22:33:20.663811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-16T22:33:20.663897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-16T22:33:20.663980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-16T22:33:20.664062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-10-16T22:33:20.664158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-16T22:33:20.664279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-10-16T22:33:20.664385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-10-16T22:33:20.664503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-16T22:33:20.664665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-16T22:33:20.664784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-16T22:33:20.664896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-16T22:33:20.665015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-10-16T22:33:20.665128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-16T22:33:20.665258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-16T22:33:20.665399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-16T22:33:20.665515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-10-16T22:33:20.665614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-16T22:33:20.665753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-16T22:33:20.665867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-16T22:33:20.665985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-16T22:33:20.666103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-10-16T22:33:20.666221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-10-16T22:33:20.666337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-16T22:33:20.666438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-10-16T22:33:20.666557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-16T22:33:20.666707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-10-16T22:33:20.666834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-16T22:33:20.666960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-16T22:33:20.667081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-16T22:33:20.667195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-16T22:33:20.667278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-16T22:33:20.667365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-16T22:33:20.667452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-16T22:33:20.667516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-16T22:33:20.667635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-10-16T22:33:20.667853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-16T22:33:20.667962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-16T22:33:20.668082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-16T22:33:20.668229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-16T22:33:20.668347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-16T22:33:20.668467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-16T22:33:20.668585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-16T22:33:20.668777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-16T22:33:20.668886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-16T22:33:20.669001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-16T22:33:20.669100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-16T22:33:20.669202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-10-16T22:33:20.669315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-16T22:33:20.669431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-16T22:33:20.669566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-16T22:33:20.669709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-16T22:33:20.669833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-16T22:33:20.669960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-16T22:33:20.670074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-10-16T22:33:20.670185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-16T22:33:20.670303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-16T22:33:20.670413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-16T22:33:20.670515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-16T22:33:20.670612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-10-16T22:33:20.670763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-16T22:33:20.670902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-16T22:33:20.671025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-10-16T22:33:20.671134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-16T22:33:20.671239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-16T22:33:20.671317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-16T22:33:20.671382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-10-16T22:33:20.671444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-16T22:33:20.671508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-16T22:33:20.671571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-10-16T22:33:20.671634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-16T22:33:20.671756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-16T22:33:20.671831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-10-16T22:33:20.671896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-10-16T22:33:20.671962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-16T22:33:20.672023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-10-16T22:33:20.672089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-16T22:33:20.672168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-10-16T22:33:20.672255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-16T22:33:20.672319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-10-16T22:33:20.672381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-16T22:33:20.672444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-16T22:33:20.672506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-10-16T22:33:20.672567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-16T22:33:20.672628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-16T22:33:20.672739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-16T22:33:20.672816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-16T22:33:20.672880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-16T22:33:20.672942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-16T22:33:20.673004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-16T22:33:20.673082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-10-16T22:33:20.673177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-16T22:33:20.673243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-10-16T22:33:20.673308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-16T22:33:20.673370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-16T22:33:20.673433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-16T22:33:20.673494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-10-16T22:33:20.673556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-16T22:33:20.673617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-16T22:33:20.673720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-16T22:33:20.673799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-16T22:33:20.673861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-10-16T22:33:20.673924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-10-16T22:33:20.673985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-16T22:33:20.674047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-16T22:33:20.674110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-10-16T22:33:20.674232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-16T22:33:20.674353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-16T22:33:20.674472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-16T22:33:20.674573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-16T22:33:20.674701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-16T22:33:20.674816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-10-16T22:33:20.674935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-16T22:33:20.675044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-16T22:33:20.675146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-16T22:33:20.675266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-16T22:33:20.675378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-16T22:33:20.675494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-16T22:33:20.675614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-10-16T22:33:20.675862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-16T22:33:20.675983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-16T22:33:20.676094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-16T22:33:20.676212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-16T22:33:20.676344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-16T22:33:20.676460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-10-16T22:33:20.676580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-16T22:33:20.676724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-16T22:33:20.676840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-10-16T22:33:20.676955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-16T22:33:20.677097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-16T22:33:20.677217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-16T22:33:20.677318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-16T22:33:20.677421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-10-16T22:33:20.677531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-10-16T22:33:20.677633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-16T22:33:20.677762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-16T22:33:20.677834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-16T22:33:20.677897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-16T22:33:20.677959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-16T22:33:20.678027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-16T22:33:20.678104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-16T22:33:20.678166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-10-16T22:33:20.678279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-10-16T22:33:20.678367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-16T22:33:20.678432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-16T22:33:20.678493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-16T22:33:20.678554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-16T22:33:20.678615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-16T22:33:20.678725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-10-16T22:33:20.678805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-16T22:33:20.678868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-16T22:33:20.678929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-16T22:33:20.678994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-10-16T22:33:20.679072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-16T22:33:20.679161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-10-16T22:33:20.679225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-10-16T22:33:20.679286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-10-16T22:33:20.679346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-16T22:33:20.679407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-16T22:33:20.679468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-16T22:33:20.679526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-16T22:33:20.679594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-16T22:33:20.679684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-16T22:33:20.679775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-16T22:33:20.679843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-16T22:33:20.679906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-10-16T22:33:20.679971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-10-16T22:33:20.680052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-10-16T22:33:20.680180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-16T22:33:20.680268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-16T22:33:20.680334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-16T22:33:20.680398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-10-16T22:33:20.680462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-10-16T22:33:20.680523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-16T22:33:20.680586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-10-16T22:33:20.680673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-16T22:33:20.680768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-16T22:33:20.680900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-10-16T22:33:20.680993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-16T22:33:20.681061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-10-16T22:33:20.681128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-16T22:33:20.681212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-10-16T22:33:20.681326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-10-16T22:33:20.681408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-10-16T22:33:20.681477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-16T22:33:20.681542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-10-16T22:33:20.681607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-16T22:33:20.681702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-16T22:33:20.681789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-10-16T22:33:20.681856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-16T22:33:20.681921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-10-16T22:33:20.681985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-16T22:33:20.682051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-16T22:33:20.682115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-10-16T22:33:20.682180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-16T22:33:20.682242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-10-16T22:33:20.682303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-16T22:33:20.682369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-16T22:33:20.682433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-16T22:33:20.682513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-10-16T22:33:20.682610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-16T22:33:20.682720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-16T22:33:20.682820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-16T22:33:20.682909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-10-16T22:33:20.682976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-16T22:33:20.683036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-10-16T22:33:20.683148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-16T22:33:20.683229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-10-16T22:33:20.683309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-10-16T22:33:20.683374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-16T22:33:20.683438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-10-16T22:33:20.683513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-16T22:33:20.683576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-10-16T22:33:20.683639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-16T22:33:20.683856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-10-16T22:33:20.683936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-16T22:33:20.684000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-16T22:33:20.684060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-10-16T22:33:20.684122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-16T22:33:20.684184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-10-16T22:33:20.684247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-16T22:33:20.684308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-16T22:33:20.684370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-16T22:33:20.684433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-16T22:33:20.684494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-10-16T22:33:20.684555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-16T22:33:20.684617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-16T22:33:20.684715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-10-16T22:33:20.684795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-10-16T22:33:20.684858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-10-16T22:33:20.684919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-10-16T22:33:20.685014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-10-16T22:33:20.685130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-10-16T22:33:20.685211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-10-16T22:33:20.685275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-10-16T22:33:20.685337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-16T22:33:20.685400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-10-16T22:33:20.685461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-10-16T22:33:20.685521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-16T22:33:20.685581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-16T22:33:20.685666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-16T22:33:20.685757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-16T22:33:20.685824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-16T22:33:20.685902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-10-16T22:33:20.685998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-16T22:33:20.686064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-16T22:33:20.686124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-10-16T22:33:20.686193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-16T22:33:20.686300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-10-16T22:33:20.686371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-16T22:33:20.686435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-10-16T22:33:20.686503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-10-16T22:33:20.686567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-10-16T22:33:20.686631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-16T22:33:20.686741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-16T22:33:20.686813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-10-16T22:33:20.686878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-10-16T22:33:20.686939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-16T22:33:20.687001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-10-16T22:33:20.687062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-16T22:33:20.687124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-16T22:33:20.687186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-16T22:33:20.687248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-10-16T22:33:20.687310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-10-16T22:33:20.687371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-16T22:33:20.687432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-16T22:33:20.687492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-16T22:33:20.687555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-10-16T22:33:20.687617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-16T22:33:20.687715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-10-16T22:33:20.687795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-16T22:33:20.687859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-16T22:33:20.687921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-16T22:33:20.687983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-16T22:33:20.688050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-10-16T22:33:20.688117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-16T22:33:20.688182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-16T22:33:20.688445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-16T22:33:20.688517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-16T22:33:20.688582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-10-16T22:33:20.688674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-16T22:33:20.688775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-16T22:33:20.688848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-16T22:33:20.688916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-16T22:33:20.688979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-10-16T22:33:20.689041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-10-16T22:33:20.689105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-16T22:33:20.689167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-16T22:33:20.689230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-10-16T22:33:20.689290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-16T22:33:20.689352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-16T22:33:20.689413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-16T22:33:20.689475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-10-16T22:33:20.689536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-16T22:33:20.689600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-16T22:33:20.689695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-16T22:33:20.689783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-16T22:33:20.689853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-16T22:33:20.689918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-16T22:33:20.689983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-16T22:33:20.690044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-16T22:33:20.690106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-16T22:33:20.690188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-10-16T22:33:20.690276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-16T22:33:20.690344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-16T22:33:20.690410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-16T22:33:20.690472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-16T22:33:20.690535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-10-16T22:33:20.690598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-10-16T22:33:20.690697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-16T22:33:20.690787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-10-16T22:33:20.690852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-16T22:33:20.690927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-10-16T22:33:20.691019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-10-16T22:33:20.691099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-10-16T22:33:20.691163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-10-16T22:33:20.691228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-16T22:33:20.691290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-16T22:33:20.691352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-10-16T22:33:20.691458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-10-16T22:33:20.691563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-10-16T22:33:20.691769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-10-16T22:33:20.691862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-16T22:33:20.691936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-10-16T22:33:20.692017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-16T22:33:20.692086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-16T22:33:20.692149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-16T22:33:20.692230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-16T22:33:20.692317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-16T22:33:20.692383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-16T22:33:20.692448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-16T22:33:20.692512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-16T22:33:20.692577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-16T22:33:20.692674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-10-16T22:33:20.692774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-10-16T22:33:20.692841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-16T22:33:20.692905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-16T22:33:20.692967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-10-16T22:33:20.693029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-16T22:33:20.693089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-10-16T22:33:20.693150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-10-16T22:33:20.693210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-10-16T22:33:20.693273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-16T22:33:20.693336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-16T22:33:20.693397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-10-16T22:33:20.693458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-10-16T22:33:20.693520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-16T22:33:20.693581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-16T22:33:20.693683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-16T22:33:20.693771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-10-16T22:33:20.693836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-10-16T22:33:20.693899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-16T22:33:20.693962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-16T22:33:20.694026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-16T22:33:20.694089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-16T22:33:20.694150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-16T22:33:20.694211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-16T22:33:20.694274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-16T22:33:20.694370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-10-16T22:33:20.694449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-10-16T22:33:20.694528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-16T22:33:20.694615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-16T22:33:20.694734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-16T22:33:20.694813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-16T22:33:20.694877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-16T22:33:20.694938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-16T22:33:20.695000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-16T22:33:20.695060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-10-16T22:33:20.695122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-16T22:33:20.695185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-10-16T22:33:20.695247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-16T22:33:20.695308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-10-16T22:33:20.695369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-10-16T22:33:20.695430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-10-16T22:33:20.695489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-10-16T22:33:20.695550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-16T22:33:20.695611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-16T22:33:20.695704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-16T22:33:20.695791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-16T22:33:20.695855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-10-16T22:33:20.695916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-10-16T22:33:20.695977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-16T22:33:20.696045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-16T22:33:20.696113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-10-16T22:33:20.696175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-16T22:33:20.696234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-10-16T22:33:20.696294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-10-16T22:33:20.696354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-16T22:33:20.696414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-16T22:33:20.696480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-16T22:33:20.696590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-10-16T22:33:20.696692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-16T22:33:20.696783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-16T22:33:20.696847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-10-16T22:33:20.696910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-16T22:33:20.696973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-16T22:33:20.697039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-16T22:33:20.697111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-10-16T22:33:20.697177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-16T22:33:20.697240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-10-16T22:33:20.697303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-10-16T22:33:20.697365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-10-16T22:33:20.697426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-10-16T22:33:20.697490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-16T22:33:20.697553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-10-16T22:33:20.697617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-16T22:33:20.697717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-16T22:33:20.697799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-10-16T22:33:20.697864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-10-16T22:33:20.697928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-16T22:33:20.697992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-10-16T22:33:20.698054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-16T22:33:20.698116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-16T22:33:20.698179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-16T22:33:20.698297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-16T22:33:20.698384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-16T22:33:20.698458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-16T22:33:20.698521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-10-16T22:33:20.698583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-10-16T22:33:20.698677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-16T22:33:20.698773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-10-16T22:33:20.698840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-16T22:33:20.698904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-16T22:33:20.698968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-16T22:33:20.699030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-10-16T22:33:20.699093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-16T22:33:20.699161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-16T22:33:20.699224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-16T22:33:20.699317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-10-16T22:33:20.699407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-16T22:33:20.699505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-10-16T22:33:20.699573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-16T22:33:20.699636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-16T22:33:20.699914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-10-16T22:33:20.699982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-16T22:33:20.700080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-10-16T22:33:20.700162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-10-16T22:33:20.700225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-10-16T22:33:20.700289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-16T22:33:20.700351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-16T22:33:20.700414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-16T22:33:20.700475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-10-16T22:33:20.700537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-10-16T22:33:20.700598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-16T22:33:20.700685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-16T22:33:20.700782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-16T22:33:20.700849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-16T22:33:20.700912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-16T22:33:20.700974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-16T22:33:20.701035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-16T22:33:20.701096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-10-16T22:33:20.701158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-10-16T22:33:20.701219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-16T22:33:20.701280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-16T22:33:20.701340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-16T22:33:20.701413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-16T22:33:20.701476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-10-16T22:33:20.701538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-16T22:33:20.701599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-16T22:33:20.701687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-10-16T22:33:20.701778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-16T22:33:20.701883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-16T22:33:20.701954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-16T22:33:20.702016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-16T22:33:20.702079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-16T22:33:20.702142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-16T22:33:20.702203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-16T22:33:20.702263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-16T22:33:20.702324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-10-16T22:33:20.702384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-16T22:33:20.702445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-10-16T22:33:20.702505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-16T22:33:20.702565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-10-16T22:33:20.702637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-10-16T22:33:20.702752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-10-16T22:33:20.702824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-10-16T22:33:20.702888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-10-16T22:33:20.702949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-16T22:33:20.703010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-16T22:33:20.703071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-16T22:33:20.703131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-16T22:33:20.703191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-16T22:33:20.703253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-16T22:33:20.703310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-16T22:33:20.703370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-16T22:33:20.703430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-16T22:33:20.703489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-16T22:33:20.703549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-10-16T22:33:20.703609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-10-16T22:33:20.703699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-16T22:33:20.703783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-16T22:33:20.703846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-16T22:33:20.703907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-16T22:33:20.703969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-16T22:33:20.704029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-16T22:33:20.704089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-16T22:33:20.704148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-10-16T22:33:20.704207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-16T22:33:20.704266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-16T22:33:20.704325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-10-16T22:33:20.704389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-16T22:33:20.704451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-16T22:33:20.704515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-16T22:33:20.704581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-16T22:33:20.704737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-10-16T22:33:20.704855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-10-16T22:33:20.704935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-10-16T22:33:20.705000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-10-16T22:33:20.705064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-16T22:33:20.705127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-16T22:33:20.705194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-16T22:33:20.705262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-10-16T22:33:20.705327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-10-16T22:33:20.705392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-10-16T22:33:20.705458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-16T22:33:20.705523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-10-16T22:33:20.705590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-16T22:33:20.705854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-10-16T22:33:20.705946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-16T22:33:20.706012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-10-16T22:33:20.706077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-16T22:33:20.706141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-16T22:33:20.706204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-10-16T22:33:20.706267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-16T22:33:20.706328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-10-16T22:33:20.706387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-16T22:33:20.706451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-16T22:33:20.706511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-10-16T22:33:20.706571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-16T22:33:20.706632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-10-16T22:33:20.706742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-10-16T22:33:20.706814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-16T22:33:20.706921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-16T22:33:20.706991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-16T22:33:20.707055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-16T22:33:20.707117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-16T22:33:20.707180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-16T22:33:20.707244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-10-16T22:33:20.707316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-16T22:33:20.707379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-10-16T22:33:20.707441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-16T22:33:20.707502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-16T22:33:20.707562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-16T22:33:20.707624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-16T22:33:20.707742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-10-16T22:33:20.707817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-16T22:33:20.707881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-16T22:33:20.707943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-10-16T22:33:20.708006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-10-16T22:33:20.708070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-10-16T22:33:20.708165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-16T22:33:20.708306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-16T22:33:20.708403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-16T22:33:20.708469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-16T22:33:20.708532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-16T22:33:20.708594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-10-16T22:33:20.708694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-10-16T22:33:20.708782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-16T22:33:20.708850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-16T22:33:20.708913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-16T22:33:20.708975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-10-16T22:33:20.709039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-16T22:33:20.709100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-16T22:33:20.709162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-16T22:33:20.709224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-16T22:33:20.709286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-16T22:33:20.709348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-16T22:33:20.709410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-16T22:33:20.709470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-10-16T22:33:20.709530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-16T22:33:20.709591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-16T22:33:20.709687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-16T22:33:20.709776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-10-16T22:33:20.709840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-10-16T22:33:20.709903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-10-16T22:33:20.709964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-16T22:33:20.710023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-16T22:33:20.710082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-10-16T22:33:20.710143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-10-16T22:33:20.710203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-16T22:33:20.710265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-10-16T22:33:20.710342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-10-16T22:33:20.710403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-10-16T22:33:20.710464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-16T22:33:20.710524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-16T22:33:20.710584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-16T22:33:20.710665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-16T22:33:20.710756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-16T22:33:20.710852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-10-16T22:33:20.710931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-16T22:33:20.710994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-10-16T22:33:20.711070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-10-16T22:33:20.711133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-16T22:33:20.711194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-16T22:33:20.711256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-16T22:33:20.711317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-16T22:33:20.711378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-16T22:33:20.711440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-16T22:33:20.711501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-10-16T22:33:20.711561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-10-16T22:33:20.711621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-16T22:33:20.711720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-16T22:33:20.711812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-10-16T22:33:20.711918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-16T22:33:20.711986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-10-16T22:33:20.712049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-16T22:33:20.712110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-16T22:33:20.712170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-16T22:33:20.712231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-16T22:33:20.712292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-10-16T22:33:20.712353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-16T22:33:20.712412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-16T22:33:20.712473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-16T22:33:20.712533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-10-16T22:33:20.712595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-10-16T22:33:20.712688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-16T22:33:20.712779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-16T22:33:20.712845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-16T22:33:20.712910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-16T22:33:20.712973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-16T22:33:20.713036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-16T22:33:20.713100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-16T22:33:20.713166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-16T22:33:20.713228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-10-16T22:33:20.713293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-16T22:33:20.713353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-16T22:33:20.713423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-16T22:33:20.713485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-16T22:33:20.713548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-10-16T22:33:20.713608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-10-16T22:33:20.713836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-10-16T22:33:20.713926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-16T22:33:20.713991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-16T22:33:20.714058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-16T22:33:20.714119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-16T22:33:20.714182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-10-16T22:33:20.714246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-10-16T22:33:20.714307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-16T22:33:20.714370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-16T22:33:20.714432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-16T22:33:20.714494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-16T22:33:20.714555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-16T22:33:20.714626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-16T22:33:20.714738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-16T22:33:20.714812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-10-16T22:33:20.714877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-10-16T22:33:20.714939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-10-16T22:33:20.715001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-16T22:33:20.715066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-16T22:33:20.715129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-16T22:33:20.715194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-16T22:33:20.715255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-10-16T22:33:20.715320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-16T22:33:20.715381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-10-16T22:33:20.715442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-16T22:33:20.715503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-16T22:33:20.715564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-16T22:33:20.715626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-16T22:33:20.715731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-16T22:33:20.715805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-16T22:33:20.715868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-16T22:33:20.715934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-16T22:33:20.715997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-10-16T22:33:20.716061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-16T22:33:20.716132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-16T22:33:20.716194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-10-16T22:33:20.716254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-16T22:33:20.716327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-16T22:33:20.716389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-16T22:33:20.716452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-10-16T22:33:20.716514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-16T22:33:20.716577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-10-16T22:33:20.716639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-16T22:33:20.716760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-10-16T22:33:20.716870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-16T22:33:20.716983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-10-16T22:33:20.717078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-16T22:33:20.717166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-10-16T22:33:20.717231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-16T22:33:20.717295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-16T22:33:20.717356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-16T22:33:20.717422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-16T22:33:20.717485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-16T22:33:20.717547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-10-16T22:33:20.717610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-16T22:33:20.717706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-10-16T22:33:20.717790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-16T22:33:20.717853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-10-16T22:33:20.717914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-16T22:33:20.717976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-16T22:33:20.718037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-16T22:33:20.718098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-10-16T22:33:20.718157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-10-16T22:33:20.718243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-16T22:33:20.718340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-10-16T22:33:20.718407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-16T22:33:20.718469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-16T22:33:20.718529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-10-16T22:33:20.718590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-16T22:33:20.718674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-10-16T22:33:20.718764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-16T22:33:20.718827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-10-16T22:33:20.718895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-16T22:33:20.718958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-16T22:33:20.719021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-16T22:33:20.719083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-10-16T22:33:20.719144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-10-16T22:33:20.719205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-16T22:33:20.719264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-16T22:33:20.719325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-10-16T22:33:20.719391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-16T22:33:20.719453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-16T22:33:20.719513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-10-16T22:33:20.719573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-16T22:33:20.719633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-16T22:33:20.719745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-10-16T22:33:20.719816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-10-16T22:33:20.719878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-10-16T22:33:20.719940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-16T22:33:20.720023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-10-16T22:33:20.720085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-10-16T22:33:20.720145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-16T22:33:20.720219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-16T22:33:20.720279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-16T22:33:20.720339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-16T22:33:20.720400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-16T22:33:20.720460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-10-16T22:33:20.720538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-10-16T22:33:20.720635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-16T22:33:20.720797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-10-16T22:33:20.720863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-10-16T22:33:20.720924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-10-16T22:33:20.720986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-16T22:33:20.721045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-16T22:33:20.721106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-16T22:33:20.721166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-10-16T22:33:20.721226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-16T22:33:20.721285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-10-16T22:33:20.721345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-16T22:33:20.721405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-16T22:33:20.721482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-16T22:33:20.721553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-16T22:33:20.721618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-10-16T22:33:20.721842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-10-16T22:33:20.721925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-10-16T22:33:20.722030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-16T22:33:20.722103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-16T22:33:20.722193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-16T22:33:20.722263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-16T22:33:20.722329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-16T22:33:20.722396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-10-16T22:33:20.722458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-16T22:33:20.722520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-16T22:33:20.722584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-10-16T22:33:20.722673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-16T22:33:20.722767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-10-16T22:33:20.722833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-16T22:33:20.722897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-16T22:33:20.722962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-10-16T22:33:20.723028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-16T22:33:20.723091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-10-16T22:33:20.723154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-16T22:33:20.723217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-10-16T22:33:20.723279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-10-16T22:33:20.723344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-16T22:33:20.723408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-16T22:33:20.723472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-16T22:33:20.723535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-10-16T22:33:20.723597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-16T22:33:20.723684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-16T22:33:20.723775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-16T22:33:20.723844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-16T22:33:20.723907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-16T22:33:20.723970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-16T22:33:20.724033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-10-16T22:33:20.724094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-16T22:33:20.724180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-10-16T22:33:20.724269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-10-16T22:33:20.724335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-16T22:33:20.724406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-16T22:33:20.724468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-10-16T22:33:20.724532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-16T22:33:20.724594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-16T22:33:20.724702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-16T22:33:20.724792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-16T22:33:20.724860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-10-16T22:33:20.724923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-16T22:33:20.724985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-16T22:33:20.725046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-10-16T22:33:20.725110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-10-16T22:33:20.725185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-10-16T22:33:20.725247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-10-16T22:33:20.725310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-16T22:33:20.725371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-10-16T22:33:20.725433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-10-16T22:33:20.725496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-16T22:33:20.725557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-16T22:33:20.725618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-16T22:33:20.725715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-10-16T22:33:20.725795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-10-16T22:33:20.725858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-16T22:33:20.725920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-16T22:33:20.725983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-10-16T22:33:20.726046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-16T22:33:20.726107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-10-16T22:33:20.726168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-10-16T22:33:20.726230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-16T22:33:20.726290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-10-16T22:33:20.726352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-16T22:33:20.726415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-10-16T22:33:20.726475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-16T22:33:20.726539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-10-16T22:33:20.726602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TCBX.csv [2025-10-16T22:33:20.726689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-10-16T22:33:20.726776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-10-16T22:33:20.726841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-10-16T22:33:20.726984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-16T22:33:20.727062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-10-16T22:33:20.727126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-16T22:33:20.727188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-10-16T22:33:20.727250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-16T22:33:20.727312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-16T22:33:20.727374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-16T22:33:20.727434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-10-16T22:33:20.727495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-16T22:33:20.727556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-10-16T22:33:20.727617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-16T22:33:20.727713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-10-16T22:33:20.727792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-16T22:33:20.727856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-16T22:33:20.727917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-16T22:33:20.727979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-16T22:33:20.728042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-16T22:33:20.728104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-16T22:33:20.728166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-16T22:33:20.728274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-16T22:33:20.728356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-16T22:33:20.728420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-16T22:33:20.728481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-10-16T22:33:20.728543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-10-16T22:33:20.728605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-16T22:33:20.728703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-16T22:33:20.728791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-16T22:33:20.728872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-10-16T22:33:20.728957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-10-16T22:33:20.729021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-16T22:33:20.729090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-10-16T22:33:20.729152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-10-16T22:33:20.729213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-16T22:33:20.729278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-16T22:33:20.729338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-16T22:33:20.729398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-16T22:33:20.729459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-10-16T22:33:20.729519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-16T22:33:20.729580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-16T22:33:20.729835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-16T22:33:20.729923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-16T22:33:20.729986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-16T22:33:20.730046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-16T22:33:20.730106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-10-16T22:33:20.730166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-16T22:33:20.730228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-16T22:33:20.730288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-16T22:33:20.730349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-16T22:33:20.730411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-10-16T22:33:20.730472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-10-16T22:33:20.730548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-10-16T22:33:20.730613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-16T22:33:20.730709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-10-16T22:33:20.730791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-16T22:33:20.730857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-16T22:33:20.730918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-10-16T22:33:20.730994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-10-16T22:33:20.731055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-10-16T22:33:20.731124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-16T22:33:20.731187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-16T22:33:20.731265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-16T22:33:20.731325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-10-16T22:33:20.731385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-10-16T22:33:20.731446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-16T22:33:20.731523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-16T22:33:20.731611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-16T22:33:20.731709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-10-16T22:33:20.731789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-16T22:33:20.731854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-16T22:33:20.731917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-10-16T22:33:20.731979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-10-16T22:33:20.732091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-10-16T22:33:20.732162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-10-16T22:33:20.732225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-10-16T22:33:20.732287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-16T22:33:20.732349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-16T22:33:20.732412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-10-16T22:33:20.732516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-10-16T22:33:20.732598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-16T22:33:20.732687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-16T22:33:20.732777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-10-16T22:33:20.732841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-16T22:33:20.732903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-16T22:33:20.732965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-16T22:33:20.733028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-16T22:33:20.733090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-10-16T22:33:20.733150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-16T22:33:20.733211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-16T22:33:20.733271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-10-16T22:33:20.733351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-10-16T22:33:20.733437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-16T22:33:20.733504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-16T22:33:20.733569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-16T22:33:20.733630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-16T22:33:20.733741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-16T22:33:20.733814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-10-16T22:33:20.733878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-16T22:33:20.733938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-16T22:33:20.733999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-16T22:33:20.734060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-16T22:33:20.734121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-16T22:33:20.734180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-16T22:33:20.734247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-16T22:33:20.734310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-16T22:33:20.734372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-10-16T22:33:20.734432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-10-16T22:33:20.734493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-10-16T22:33:20.734553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-16T22:33:20.734614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-10-16T22:33:20.734718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-10-16T22:33:20.734798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-10-16T22:33:20.734863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-16T22:33:20.734925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-16T22:33:20.734987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-16T22:33:20.735048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-10-16T22:33:20.735110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-16T22:33:20.735179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-16T22:33:20.735242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-10-16T22:33:20.735302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-10-16T22:33:20.735362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-16T22:33:20.735423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-16T22:33:20.735483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-16T22:33:20.735544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-10-16T22:33:20.735604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-10-16T22:33:20.735689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-10-16T22:33:20.735776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-16T22:33:20.735855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-10-16T22:33:20.735918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-16T22:33:20.735981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-16T22:33:20.736041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-16T22:33:20.736102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-10-16T22:33:20.736162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-16T22:33:20.736221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-10-16T22:33:20.736282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-10-16T22:33:20.736342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-16T22:33:20.736410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-10-16T22:33:20.736471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-10-16T22:33:20.736531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-16T22:33:20.736590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-10-16T22:33:20.736693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-16T22:33:20.736788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-10-16T22:33:20.736851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-16T22:33:20.736956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-16T22:33:20.737029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-10-16T22:33:20.737103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-16T22:33:20.737187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-10-16T22:33:20.737251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-10-16T22:33:20.737314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-10-16T22:33:20.737379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-16T22:33:20.737442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-16T22:33:20.737503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-10-16T22:33:20.737566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-16T22:33:20.737639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-10-16T22:33:20.737875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-16T22:33:20.737973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-16T22:33:20.738054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-16T22:33:20.738116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-16T22:33:20.738179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-16T22:33:20.738305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-16T22:33:20.738396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-16T22:33:20.738460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-16T22:33:20.738527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-16T22:33:20.738592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-10-16T22:33:20.738677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-10-16T22:33:20.738766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-10-16T22:33:20.738831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-16T22:33:20.738895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-16T22:33:20.738956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-10-16T22:33:20.739020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-16T22:33:20.739083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-16T22:33:20.739144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-16T22:33:20.739206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-16T22:33:20.739266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-10-16T22:33:20.739327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-16T22:33:20.739388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-16T22:33:20.739447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-16T22:33:20.739508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-10-16T22:33:20.739569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-16T22:33:20.739632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-16T22:33:20.739744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-10-16T22:33:20.739817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-10-16T22:33:20.739880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-10-16T22:33:20.739941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-10-16T22:33:20.740003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-16T22:33:20.740061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-10-16T22:33:20.740122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-10-16T22:33:20.740183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-16T22:33:20.740245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-16T22:33:20.740305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-10-16T22:33:20.740364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-10-16T22:33:20.740445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-10-16T22:33:20.740506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-16T22:33:20.740576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-16T22:33:20.740639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-16T22:33:20.740761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-10-16T22:33:20.740826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-16T22:33:20.740887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-10-16T22:33:20.740947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-10-16T22:33:20.741008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-16T22:33:20.741068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-10-16T22:33:20.741128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-16T22:33:20.741188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-16T22:33:20.741266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-16T22:33:20.741354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-16T22:33:20.741418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-16T22:33:20.741479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-10-16T22:33:20.741542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-16T22:33:20.741602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-10-16T22:33:20.741689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-16T22:33:20.741776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-16T22:33:20.741840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-16T22:33:20.741902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-16T22:33:20.741961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-16T22:33:20.742068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-10-16T22:33:20.742139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-16T22:33:20.742203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-16T22:33:20.742265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-16T22:33:20.742326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-16T22:33:20.742387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-16T22:33:20.742447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-16T22:33:20.742507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-10-16T22:33:20.742567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-16T22:33:20.742627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-10-16T22:33:20.742729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-16T22:33:20.742802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-16T22:33:20.742864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-16T22:33:20.742925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-16T22:33:20.742989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-10-16T22:33:20.743051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-16T22:33:20.743112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-16T22:33:20.743188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-16T22:33:20.743251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-10-16T22:33:20.743311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-10-16T22:33:20.743386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-10-16T22:33:20.743448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-16T22:33:20.743509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-16T22:33:20.743570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-16T22:33:20.743629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-16T22:33:20.743733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-16T22:33:20.743804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-10-16T22:33:20.743866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-16T22:33:20.743926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-16T22:33:20.743987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-10-16T22:33:20.744046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-16T22:33:20.744107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-16T22:33:20.744170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-10-16T22:33:20.744232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-10-16T22:33:20.744297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-16T22:33:20.744361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-16T22:33:20.744425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-16T22:33:20.744487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-16T22:33:20.744551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-10-16T22:33:20.744613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-16T22:33:20.744724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-16T22:33:20.744812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-16T22:33:20.744877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-10-16T22:33:20.744941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-10-16T22:33:20.745005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-16T22:33:20.745069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-16T22:33:20.745174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-16T22:33:20.745237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-10-16T22:33:20.745299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-10-16T22:33:20.745362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-10-16T22:33:20.745422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-16T22:33:20.745484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-16T22:33:20.745546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-16T22:33:20.745606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-10-16T22:33:20.745813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-16T22:33:20.745929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-16T22:33:20.746011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-10-16T22:33:20.746077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-10-16T22:33:20.746140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-16T22:33:20.746203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-16T22:33:20.746278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-10-16T22:33:20.746347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-16T22:33:20.746410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-10-16T22:33:20.746472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-10-16T22:33:20.746533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-10-16T22:33:20.746594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-16T22:33:20.746685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-10-16T22:33:20.746774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-10-16T22:33:20.746854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-16T22:33:20.746919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-16T22:33:20.747027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-16T22:33:20.747132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-16T22:33:20.747202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-16T22:33:20.747263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-10-16T22:33:20.747326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-16T22:33:20.747387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-10-16T22:33:20.747448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-16T22:33:20.747508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-10-16T22:33:20.747583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-10-16T22:33:20.747666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-10-16T22:33:20.747756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-10-16T22:33:20.747821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-16T22:33:20.747884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-10-16T22:33:20.747946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-10-16T22:33:20.748006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-16T22:33:20.748067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-16T22:33:20.748127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-10-16T22:33:20.748221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-16T22:33:20.748327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-16T22:33:20.748394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-16T22:33:20.748456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-10-16T22:33:20.748516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-16T22:33:20.748582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-16T22:33:20.748674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-16T22:33:20.748788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-16T22:33:20.748868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-10-16T22:33:20.748934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-10-16T22:33:20.748997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-16T22:33:20.749058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-10-16T22:33:20.749120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-16T22:33:20.749180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-16T22:33:20.749241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-16T22:33:20.749301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-10-16T22:33:20.749362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-16T22:33:20.749422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-16T22:33:20.749495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-10-16T22:33:20.749562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-10-16T22:33:20.749622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-16T22:33:20.749745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-10-16T22:33:20.749821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-10-16T22:33:20.749883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-16T22:33:20.749944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-16T22:33:20.750005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-16T22:33:20.750065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-16T22:33:20.750125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-10-16T22:33:20.750184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-10-16T22:33:20.750245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-16T22:33:20.750305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-16T22:33:20.750364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-16T22:33:20.750423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-16T22:33:20.750481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-16T22:33:20.750540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-16T22:33:20.750600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-16T22:33:20.750685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-16T22:33:20.750794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-16T22:33:20.750879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-16T22:33:20.750943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-10-16T22:33:20.751003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-10-16T22:33:20.751063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-16T22:33:20.751123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-10-16T22:33:20.751197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-16T22:33:20.751260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-16T22:33:20.751330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-16T22:33:20.751391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-16T22:33:20.751450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-10-16T22:33:20.751513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-10-16T22:33:20.751575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-16T22:33:20.751637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-10-16T22:33:20.751750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-16T22:33:20.751817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-10-16T22:33:20.751880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-16T22:33:20.751942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-10-16T22:33:20.752049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-16T22:33:20.752121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-16T22:33:20.752187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-10-16T22:33:20.752247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-10-16T22:33:20.752310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-16T22:33:20.752370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-16T22:33:20.752430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-10-16T22:33:20.752494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-10-16T22:33:20.752555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-10-16T22:33:20.752621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-10-16T22:33:20.752724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-16T22:33:20.752802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-16T22:33:20.752865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-10-16T22:33:20.752930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-16T22:33:20.752991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-16T22:33:20.753053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-16T22:33:20.753115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-16T22:33:20.753174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-16T22:33:20.753236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-16T22:33:20.753297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-16T22:33:20.753358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-16T22:33:20.753434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-10-16T22:33:20.753497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-16T22:33:20.753560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-10-16T22:33:20.753624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-16T22:33:20.753845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-10-16T22:33:20.753921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-10-16T22:33:20.753985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-16T22:33:20.754081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-10-16T22:33:20.754162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-16T22:33:20.754228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-16T22:33:20.754291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-16T22:33:20.754354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-10-16T22:33:20.754417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-16T22:33:20.754482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-16T22:33:20.754548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-10-16T22:33:20.754610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-16T22:33:20.754708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-16T22:33:20.754793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-10-16T22:33:20.754858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-16T22:33:20.754922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-10-16T22:33:20.754986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-16T22:33:20.755047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-16T22:33:20.755111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-10-16T22:33:20.755171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-16T22:33:20.755232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-16T22:33:20.755296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-16T22:33:20.755364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-16T22:33:20.755429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-16T22:33:20.755492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-16T22:33:20.755553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-16T22:33:20.755614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-16T22:33:20.755712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-10-16T22:33:20.755792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-10-16T22:33:20.755856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-16T22:33:20.755931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-16T22:33:20.756001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-16T22:33:20.756063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-16T22:33:20.756129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-16T22:33:20.756191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-10-16T22:33:20.756254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-10-16T22:33:20.756317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-16T22:33:20.756380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-16T22:33:20.756442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-10-16T22:33:20.756503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-10-16T22:33:20.756563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-16T22:33:20.756632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-16T22:33:20.756746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-16T22:33:20.756850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-16T22:33:20.756915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-10-16T22:33:20.756976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-10-16T22:33:20.757080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-16T22:33:20.757150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-10-16T22:33:20.757212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-16T22:33:20.757273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-16T22:33:20.757333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-16T22:33:20.757393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-16T22:33:20.757452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-16T22:33:20.757511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-16T22:33:20.757570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-16T22:33:20.757629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-16T22:33:20.757733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-16T22:33:20.757805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-16T22:33:20.757866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-10-16T22:33:20.757926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-16T22:33:20.757985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-16T22:33:20.758045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-16T22:33:20.758104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-16T22:33:20.758162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-10-16T22:33:20.758265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-16T22:33:20.758382] [INFO ] [LOCAL ] Deleted 1707 derivative data files. [2025-10-16T22:33:20.758419] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-16T22:33:20.760255] [INFO ] [LOCAL ] Found 1803 symbols with primary data. [2025-10-16T22:33:20.760618] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 1803 symbols [2025-10-16T22:33:20.761955] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:20.761450] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:20.762387] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:20.839445] [DEBUG] [LOCAL ] AA: Loaded 54011 existing records from primary storage. [2025-10-16T22:33:20.866819] [INFO ] [MAIN ] AA: Loaded 54011 primary data records. [2025-10-16T22:33:20.881063] [DEBUG] [LOCAL ] A: Loaded 51164 existing records from primary storage. [2025-10-16T22:33:20.901461] [DEBUG] [LOCAL ] AAP: Loaded 52218 existing records from primary storage. [2025-10-16T22:33:20.901598] [INFO ] [MAIN ] A: Loaded 51164 primary data records. [2025-10-16T22:33:20.935979] [INFO ] [MAIN ] AAP: Loaded 52218 primary data records. [2025-10-16T22:33:21.849997] [DEBUG] [MAIN ] AA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:21.850942] [INFO ] [MAIN ] AA: Generated 1807 derivative records from 54011 primary records. [2025-10-16T22:33:21.852015] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-16T22:33:21.881484] [DEBUG] [MAIN ] AAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:21.884989] [INFO ] [MAIN ] AAP: Generated 1807 derivative records from 52218 primary records. [2025-10-16T22:33:21.886711] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-16T22:33:21.885432] [DEBUG] [LOCAL ] AA: Derivative data saved (1807 records). [2025-10-16T22:33:21.893595] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-16T22:33:21.903043] [INFO ] [MAIN ] Derivative Progress: 1/1803 symbols completed. AA took 1.1s. Estimated remaining: 34m 19s. Rate: 52.5 symbols/min [2025-10-16T22:33:21.907430] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:21.924379] [DEBUG] [LOCAL ] AAP: Derivative data saved (1807 records). [2025-10-16T22:33:21.924901] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-16T22:33:21.924839] [DEBUG] [MAIN ] A: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:21.928120] [INFO ] [MAIN ] Derivative Progress: 2/1803 symbols completed. AAP took 1.2s. Estimated remaining: 17m 32s. Rate: 102.8 symbols/min [2025-10-16T22:33:21.925620] [INFO ] [MAIN ] A: Generated 1807 derivative records from 51164 primary records. [2025-10-16T22:33:21.928392] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:21.928570] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-16T22:33:21.946853] [DEBUG] [LOCAL ] A: Derivative data saved (1807 records). [2025-10-16T22:33:21.947005] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-16T22:33:21.949345] [INFO ] [MAIN ] Derivative Progress: 3/1803 symbols completed. A took 1.2s. Estimated remaining: 11m 53s. Rate: 151.4 symbols/min [2025-10-16T22:33:21.949569] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:21.983541] [DEBUG] [LOCAL ] AB: Loaded 25663 existing records from primary storage. [2025-10-16T22:33:21.984544] [INFO ] [MAIN ] AB: Loaded 25663 primary data records. [2025-10-16T22:33:21.996726] [DEBUG] [LOCAL ] AAT: Loaded 30661 existing records from primary storage. [2025-10-16T22:33:22.006302] [INFO ] [MAIN ] AAT: Loaded 30661 primary data records. [2025-10-16T22:33:22.330607] [DEBUG] [LOCAL ] ABCB: Loaded 30801 existing records from primary storage. [2025-10-16T22:33:22.359696] [INFO ] [MAIN ] ABCB: Loaded 30801 primary data records. [2025-10-16T22:33:22.917707] [DEBUG] [MAIN ] AB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:22.918548] [INFO ] [MAIN ] AB: Generated 1807 derivative records from 25663 primary records. [2025-10-16T22:33:22.919132] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-10-16T22:33:22.937006] [DEBUG] [LOCAL ] AB: Derivative data saved (1807 records). [2025-10-16T22:33:22.937852] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-10-16T22:33:22.940432] [INFO ] [MAIN ] Derivative Progress: 4/1803 symbols completed. AB took 1.0s. Estimated remaining: 16m 21s. Rate: 110.1 symbols/min [2025-10-16T22:33:22.940726] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:22.956076] [DEBUG] [MAIN ] AAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:22.957025] [INFO ] [MAIN ] AAT: Generated 1807 derivative records from 30661 primary records. [2025-10-16T22:33:22.957381] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-16T22:33:22.992192] [DEBUG] [LOCAL ] AAT: Derivative data saved (1807 records). [2025-10-16T22:33:22.992751] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-10-16T22:33:22.995072] [INFO ] [MAIN ] Derivative Progress: 5/1803 symbols completed. AAT took 1.1s. Estimated remaining: 13m 24s. Rate: 134.2 symbols/min [2025-10-16T22:33:22.992697] [DEBUG] [MAIN ] ABCB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:22.995336] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:22.996149] [INFO ] [MAIN ] ABCB: Generated 1807 derivative records from 30801 primary records. [2025-10-16T22:33:22.996815] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-16T22:33:23.026610] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1807 records). [2025-10-16T22:33:23.031179] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-10-16T22:33:23.033437] [INFO ] [MAIN ] Derivative Progress: 6/1803 symbols completed. ABCB took 1.1s. Estimated remaining: 11m 21s. Rate: 158.4 symbols/min [2025-10-16T22:33:23.048775] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:23.050417] [DEBUG] [LOCAL ] ABEV: Loaded 53668 existing records from primary storage. [2025-10-16T22:33:23.050589] [INFO ] [MAIN ] ABEV: Loaded 53668 primary data records. [2025-10-16T22:33:23.122225] [DEBUG] [LOCAL ] ABG: Loaded 18453 existing records from primary storage. [2025-10-16T22:33:23.139449] [INFO ] [MAIN ] ABG: Loaded 18453 primary data records. [2025-10-16T22:33:23.482857] [DEBUG] [LOCAL ] ABM: Loaded 32403 existing records from primary storage. [2025-10-16T22:33:23.483560] [INFO ] [MAIN ] ABM: Loaded 32403 primary data records. [2025-10-16T22:33:24.047565] [DEBUG] [MAIN ] ABEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:24.048960] [INFO ] [MAIN ] ABEV: Generated 1807 derivative records from 53668 primary records. [2025-10-16T22:33:24.049419] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-16T22:33:24.083047] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1807 records). [2025-10-16T22:33:24.084480] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-16T22:33:24.084417] [DEBUG] [MAIN ] ABG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:24.085201] [INFO ] [MAIN ] ABG: Generated 1807 derivative records from 18453 primary records. [2025-10-16T22:33:24.087270] [INFO ] [MAIN ] Derivative Progress: 7/1803 symbols completed. ABEV took 1.1s. Estimated remaining: 14m 14s. Rate: 126.2 symbols/min [2025-10-16T22:33:24.085294] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-10-16T22:33:24.088430] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:24.104883] [DEBUG] [LOCAL ] ABG: Derivative data saved (1807 records). [2025-10-16T22:33:24.105257] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-10-16T22:33:24.107199] [INFO ] [MAIN ] Derivative Progress: 8/1803 symbols completed. ABG took 1.1s. Estimated remaining: 12m 31s. Rate: 143.4 symbols/min [2025-10-16T22:33:24.108536] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:24.125155] [DEBUG] [MAIN ] ABM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:24.126064] [INFO ] [MAIN ] ABM: Generated 1807 derivative records from 32403 primary records. [2025-10-16T22:33:24.126279] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-10-16T22:33:24.144336] [DEBUG] [LOCAL ] ABM: Derivative data saved (1807 records). [2025-10-16T22:33:24.144684] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-10-16T22:33:24.147491] [INFO ] [MAIN ] Derivative Progress: 9/1803 symbols completed. ABM took 1.1s. Estimated remaining: 11m 15s. Rate: 159.4 symbols/min [2025-10-16T22:33:24.147994] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:24.216552] [DEBUG] [LOCAL ] ABT: Loaded 54011 existing records from primary storage. [2025-10-16T22:33:24.224038] [INFO ] [MAIN ] ABT: Loaded 54011 primary data records. [2025-10-16T22:33:24.236812] [DEBUG] [LOCAL ] ABR: Loaded 52354 existing records from primary storage. [2025-10-16T22:33:24.268685] [INFO ] [MAIN ] ABR: Loaded 52354 primary data records. [2025-10-16T22:33:24.415174] [DEBUG] [LOCAL ] ACCO: Loaded 37310 existing records from primary storage. [2025-10-16T22:33:24.446397] [INFO ] [MAIN ] ACCO: Loaded 37310 primary data records. [2025-10-16T22:33:25.177370] [DEBUG] [MAIN ] ABT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:25.178886] [INFO ] [MAIN ] ABT: Generated 1807 derivative records from 54011 primary records. [2025-10-16T22:33:25.179136] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-10-16T22:33:25.216371] [DEBUG] [MAIN ] ABR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:25.211276] [DEBUG] [LOCAL ] ABT: Derivative data saved (1807 records). [2025-10-16T22:33:25.217361] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-10-16T22:33:25.217170] [INFO ] [MAIN ] ABR: Generated 1807 derivative records from 52354 primary records. [2025-10-16T22:33:25.219276] [INFO ] [MAIN ] Derivative Progress: 10/1803 symbols completed. ABT took 1.1s. Estimated remaining: 13m 19s. Rate: 134.6 symbols/min [2025-10-16T22:33:25.217456] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-10-16T22:33:25.231487] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:25.233169] [DEBUG] [MAIN ] ACCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:25.241303] [INFO ] [MAIN ] ACCO: Generated 1807 derivative records from 37310 primary records. [2025-10-16T22:33:25.241483] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-10-16T22:33:25.257811] [DEBUG] [LOCAL ] ABR: Derivative data saved (1807 records). [2025-10-16T22:33:25.261605] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-10-16T22:33:25.265569] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1807 records). [2025-10-16T22:33:25.265740] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-10-16T22:33:25.267689] [INFO ] [MAIN ] Derivative Progress: 11/1803 symbols completed. ABR took 1.2s. Estimated remaining: 12m 14s. Rate: 146.4 symbols/min [2025-10-16T22:33:25.270322] [INFO ] [MAIN ] Derivative Progress: 12/1803 symbols completed. ACCO took 1.1s. Estimated remaining: 11m 13s. Rate: 159.6 symbols/min [2025-10-16T22:33:25.270218] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:25.270579] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:25.292811] [DEBUG] [LOCAL ] ACEL: Loaded 26895 existing records from primary storage. [2025-10-16T22:33:25.292951] [INFO ] [MAIN ] ACEL: Loaded 26895 primary data records. [2025-10-16T22:33:25.677242] [DEBUG] [LOCAL ] ACHR: Loaded 54208 existing records from primary storage. [2025-10-16T22:33:25.677468] [INFO ] [MAIN ] ACHR: Loaded 54208 primary data records. [2025-10-16T22:33:25.678222] [DEBUG] [LOCAL ] ACI: Loaded 53672 existing records from primary storage. [2025-10-16T22:33:25.699737] [INFO ] [MAIN ] ACI: Loaded 53672 primary data records. [2025-10-16T22:33:26.347516] [DEBUG] [MAIN ] ACEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:26.349313] [INFO ] [MAIN ] ACEL: Generated 1807 derivative records from 26895 primary records. [2025-10-16T22:33:26.349679] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-10-16T22:33:26.372817] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1807 records). [2025-10-16T22:33:26.372953] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-10-16T22:33:26.375317] [INFO ] [MAIN ] Derivative Progress: 13/1803 symbols completed. ACEL took 1.1s. Estimated remaining: 12m 53s. Rate: 138.9 symbols/min [2025-10-16T22:33:26.388692] [DEBUG] [MAIN ] ACHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:26.389422] [INFO ] [MAIN ] ACHR: Generated 1807 derivative records from 54208 primary records. [2025-10-16T22:33:26.389574] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-16T22:33:26.408321] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1807 records). [2025-10-16T22:33:26.420411] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-10-16T22:33:26.422586] [INFO ] [MAIN ] Derivative Progress: 14/1803 symbols completed. ACHR took 1.2s. Estimated remaining: 12m 4s. Rate: 148.4 symbols/min [2025-10-16T22:33:26.420723] [DEBUG] [MAIN ] ACI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:26.423534] [INFO ] [MAIN ] ACI: Generated 1807 derivative records from 53672 primary records. [2025-10-16T22:33:26.423767] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-16T22:33:26.439444] [DEBUG] [LOCAL ] ACI: Derivative data saved (1807 records). [2025-10-16T22:33:26.439509] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-10-16T22:33:26.441587] [INFO ] [MAIN ] Derivative Progress: 15/1803 symbols completed. ACI took 1.2s. Estimated remaining: 11m 17s. Rate: 158.4 symbols/min [2025-10-16T22:33:26.442179] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:26.442732] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:26.442506] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:26.500855] [DEBUG] [LOCAL ] ACP: Loaded 31216 existing records from primary storage. [2025-10-16T22:33:26.501005] [INFO ] [MAIN ] ACP: Loaded 31216 primary data records. [2025-10-16T22:33:26.629527] [DEBUG] [LOCAL ] ACM: Loaded 43294 existing records from primary storage. [2025-10-16T22:33:26.641105] [DEBUG] [LOCAL ] ACN: Loaded 53829 existing records from primary storage. [2025-10-16T22:33:26.646426] [INFO ] [MAIN ] ACN: Loaded 53829 primary data records. [2025-10-16T22:33:26.646361] [INFO ] [MAIN ] ACM: Loaded 43294 primary data records. [2025-10-16T22:33:27.434677] [DEBUG] [MAIN ] ACP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:27.435484] [INFO ] [MAIN ] ACP: Generated 1807 derivative records from 31216 primary records. [2025-10-16T22:33:27.435772] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-10-16T22:33:27.454736] [DEBUG] [LOCAL ] ACP: Derivative data saved (1807 records). [2025-10-16T22:33:27.456098] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-10-16T22:33:27.458753] [INFO ] [MAIN ] Derivative Progress: 16/1803 symbols completed. ACP took 1.0s. Estimated remaining: 12m 28s. Rate: 143.3 symbols/min [2025-10-16T22:33:27.459015] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:27.480391] [DEBUG] [MAIN ] ACN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:27.487310] [INFO ] [MAIN ] ACN: Generated 1807 derivative records from 53829 primary records. [2025-10-16T22:33:27.487673] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-10-16T22:33:27.488211] [DEBUG] [MAIN ] ACM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:27.489178] [INFO ] [MAIN ] ACM: Generated 1807 derivative records from 43294 primary records. [2025-10-16T22:33:27.491981] [DEBUG] [LOCAL ] ACR: Loaded 5466 existing records from primary storage. [2025-10-16T22:33:27.492096] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-10-16T22:33:27.492339] [INFO ] [MAIN ] ACR: Loaded 5466 primary data records. [2025-10-16T22:33:27.583303] [DEBUG] [LOCAL ] ACM: Derivative data saved (1807 records). [2025-10-16T22:33:27.589296] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-10-16T22:33:27.603991] [INFO ] [MAIN ] Derivative Progress: 17/1803 symbols completed. ACM took 1.2s. Estimated remaining: 11m 59s. Rate: 149.0 symbols/min [2025-10-16T22:33:27.609791] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:27.629235] [DEBUG] [LOCAL ] ACN: Derivative data saved (1807 records). [2025-10-16T22:33:27.629362] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-10-16T22:33:27.631525] [INFO ] [MAIN ] Derivative Progress: 18/1803 symbols completed. ACN took 1.2s. Estimated remaining: 11m 21s. Rate: 157.2 symbols/min [2025-10-16T22:33:27.631718] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:27.843814] [DEBUG] [LOCAL ] ACV: Loaded 7694 existing records from primary storage. [2025-10-16T22:33:27.857829] [INFO ] [MAIN ] ACV: Loaded 7694 primary data records. [2025-10-16T22:33:27.993925] [DEBUG] [LOCAL ] ACRE: Loaded 33901 existing records from primary storage. [2025-10-16T22:33:27.994238] [INFO ] [MAIN ] ACRE: Loaded 33901 primary data records. [2025-10-16T22:33:28.518564] [DEBUG] [MAIN ] ACR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:28.519520] [INFO ] [MAIN ] ACR: Generated 1807 derivative records from 5466 primary records. [2025-10-16T22:33:28.520087] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-16T22:33:28.537528] [DEBUG] [LOCAL ] ACR: Derivative data saved (1807 records). [2025-10-16T22:33:28.538493] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-10-16T22:33:28.540584] [INFO ] [MAIN ] Derivative Progress: 19/1803 symbols completed. ACR took 1.1s. Estimated remaining: 12m 11s. Rate: 146.5 symbols/min [2025-10-16T22:33:28.541631] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:28.568212] [DEBUG] [MAIN ] ACV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:28.569994] [INFO ] [MAIN ] ACV: Generated 1807 derivative records from 7694 primary records. [2025-10-16T22:33:28.570380] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-10-16T22:33:28.601329] [DEBUG] [MAIN ] ACRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:28.606761] [DEBUG] [LOCAL ] ACV: Derivative data saved (1807 records). [2025-10-16T22:33:28.607789] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-10-16T22:33:28.610150] [INFO ] [MAIN ] Derivative Progress: 20/1803 symbols completed. ACV took 1.0s. Estimated remaining: 11m 40s. Rate: 152.9 symbols/min [2025-10-16T22:33:28.607609] [INFO ] [MAIN ] ACRE: Generated 1807 derivative records from 33901 primary records. [2025-10-16T22:33:28.610345] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:28.622129] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-16T22:33:28.637949] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1807 records). [2025-10-16T22:33:28.638214] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-10-16T22:33:28.640587] [INFO ] [MAIN ] Derivative Progress: 21/1803 symbols completed. ACRE took 1.0s. Estimated remaining: 11m 9s. Rate: 159.9 symbols/min [2025-10-16T22:33:28.640916] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:28.657212] [DEBUG] [LOCAL ] ACVA: Loaded 49671 existing records from primary storage. [2025-10-16T22:33:28.657509] [INFO ] [MAIN ] ACVA: Loaded 49671 primary data records. [2025-10-16T22:33:28.994789] [DEBUG] [LOCAL ] ADCT: Loaded 35639 existing records from primary storage. [2025-10-16T22:33:28.995760] [INFO ] [MAIN ] ADCT: Loaded 35639 primary data records. [2025-10-16T22:33:29.116056] [DEBUG] [LOCAL ] ADNT: Loaded 47055 existing records from primary storage. [2025-10-16T22:33:29.132637] [INFO ] [MAIN ] ADNT: Loaded 47055 primary data records. [2025-10-16T22:33:29.673289] [DEBUG] [MAIN ] ACVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:29.674219] [INFO ] [MAIN ] ACVA: Generated 1807 derivative records from 49671 primary records. [2025-10-16T22:33:29.674443] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-10-16T22:33:29.693502] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1807 records). [2025-10-16T22:33:29.694009] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-10-16T22:33:29.696162] [INFO ] [MAIN ] Derivative Progress: 22/1803 symbols completed. ACVA took 1.2s. Estimated remaining: 12m 3s. Rate: 147.7 symbols/min [2025-10-16T22:33:29.696678] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:29.718209] [DEBUG] [MAIN ] ADCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:29.719291] [INFO ] [MAIN ] ADCT: Generated 1807 derivative records from 35639 primary records. [2025-10-16T22:33:29.719501] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-10-16T22:33:29.738574] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1807 records). [2025-10-16T22:33:29.738779] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-10-16T22:33:29.740771] [INFO ] [MAIN ] Derivative Progress: 23/1803 symbols completed. ADCT took 1.1s. Estimated remaining: 11m 35s. Rate: 153.7 symbols/min [2025-10-16T22:33:29.753306] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:29.754225] [DEBUG] [MAIN ] ADNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:29.755398] [INFO ] [MAIN ] ADNT: Generated 1807 derivative records from 47055 primary records. [2025-10-16T22:33:29.755507] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-10-16T22:33:29.786324] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1807 records). [2025-10-16T22:33:29.786604] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-10-16T22:33:29.788799] [INFO ] [MAIN ] Derivative Progress: 24/1803 symbols completed. ADNT took 1.1s. Estimated remaining: 11m 9s. Rate: 159.5 symbols/min [2025-10-16T22:33:29.789069] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:29.815494] [DEBUG] [LOCAL ] ADT: Loaded 53829 existing records from primary storage. [2025-10-16T22:33:29.815834] [INFO ] [MAIN ] ADT: Loaded 53829 primary data records. [2025-10-16T22:33:29.900291] [DEBUG] [LOCAL ] ADX: Loaded 27929 existing records from primary storage. [2025-10-16T22:33:29.910840] [INFO ] [MAIN ] ADX: Loaded 27929 primary data records. [2025-10-16T22:33:30.285488] [DEBUG] [LOCAL ] AEE: Loaded 50542 existing records from primary storage. [2025-10-16T22:33:30.310857] [INFO ] [MAIN ] AEE: Loaded 50542 primary data records. [2025-10-16T22:33:30.778466] [DEBUG] [MAIN ] ADT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:30.780991] [INFO ] [MAIN ] ADT: Generated 1807 derivative records from 53829 primary records. [2025-10-16T22:33:30.781613] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-16T22:33:30.815592] [DEBUG] [LOCAL ] ADT: Derivative data saved (1807 records). [2025-10-16T22:33:30.811941] [DEBUG] [MAIN ] ADX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:30.817024] [INFO ] [MAIN ] ADX: Generated 1807 derivative records from 27929 primary records. [2025-10-16T22:33:30.817249] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-16T22:33:30.815967] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-16T22:33:30.822258] [INFO ] [MAIN ] Derivative Progress: 25/1803 symbols completed. ADT took 1.1s. Estimated remaining: 11m 56s. Rate: 149.1 symbols/min [2025-10-16T22:33:30.823412] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:30.841853] [DEBUG] [LOCAL ] ADX: Derivative data saved (1807 records). [2025-10-16T22:33:30.849713] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-16T22:33:30.856935] [INFO ] [MAIN ] Derivative Progress: 26/1803 symbols completed. ADX took 1.1s. Estimated remaining: 11m 30s. Rate: 154.5 symbols/min [2025-10-16T22:33:30.857268] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:30.857726] [DEBUG] [MAIN ] AEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:30.859129] [INFO ] [MAIN ] AEE: Generated 1807 derivative records from 50542 primary records. [2025-10-16T22:33:30.859283] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-16T22:33:30.878404] [DEBUG] [LOCAL ] AEE: Derivative data saved (1807 records). [2025-10-16T22:33:30.878779] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-10-16T22:33:30.880904] [INFO ] [MAIN ] Derivative Progress: 27/1803 symbols completed. AEE took 1.1s. Estimated remaining: 11m 6s. Rate: 160.1 symbols/min [2025-10-16T22:33:30.881197] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:30.955036] [DEBUG] [LOCAL ] AEG: Loaded 49936 existing records from primary storage. [2025-10-16T22:33:30.955168] [INFO ] [MAIN ] AEG: Loaded 49936 primary data records. [2025-10-16T22:33:31.072113] [DEBUG] [LOCAL ] AEM: Loaded 53868 existing records from primary storage. [2025-10-16T22:33:31.086284] [INFO ] [MAIN ] AEM: Loaded 53868 primary data records. [2025-10-16T22:33:31.149637] [DEBUG] [LOCAL ] AEO: Loaded 53956 existing records from primary storage. [2025-10-16T22:33:31.184798] [INFO ] [MAIN ] AEO: Loaded 53956 primary data records. [2025-10-16T22:33:31.995182] [DEBUG] [MAIN ] AEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:31.996530] [INFO ] [MAIN ] AEG: Generated 1807 derivative records from 49936 primary records. [2025-10-16T22:33:31.996921] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-10-16T22:33:32.013745] [DEBUG] [LOCAL ] AEG: Derivative data saved (1807 records). [2025-10-16T22:33:32.013979] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-10-16T22:33:32.015828] [INFO ] [MAIN ] Derivative Progress: 28/1803 symbols completed. AEG took 1.2s. Estimated remaining: 11m 54s. Rate: 149.3 symbols/min [2025-10-16T22:33:32.034737] [DEBUG] [MAIN ] AEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:32.048077] [INFO ] [MAIN ] AEM: Generated 1807 derivative records from 53868 primary records. [2025-10-16T22:33:32.048163] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-16T22:33:32.047329] [DEBUG] [MAIN ] AEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:32.049535] [INFO ] [MAIN ] AEO: Generated 1807 derivative records from 53956 primary records. [2025-10-16T22:33:32.049856] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-16T22:33:32.065578] [DEBUG] [LOCAL ] AEM: Derivative data saved (1807 records). [2025-10-16T22:33:32.065871] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-16T22:33:32.075374] [INFO ] [MAIN ] Derivative Progress: 29/1803 symbols completed. AEM took 1.2s. Estimated remaining: 11m 32s. Rate: 153.8 symbols/min [2025-10-16T22:33:32.083081] [DEBUG] [LOCAL ] AEO: Derivative data saved (1807 records). [2025-10-16T22:33:32.083149] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-16T22:33:32.085188] [INFO ] [MAIN ] Derivative Progress: 30/1803 symbols completed. AEO took 1.2s. Estimated remaining: 11m 9s. Rate: 158.9 symbols/min [2025-10-16T22:33:32.085570] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:32.085742] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:32.086201] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:32.171672] [DEBUG] [LOCAL ] AESI: Loaded 50127 existing records from primary storage. [2025-10-16T22:33:32.186314] [INFO ] [MAIN ] AESI: Loaded 50127 primary data records. [2025-10-16T22:33:32.187193] [DEBUG] [LOCAL ] AES: Loaded 54059 existing records from primary storage. [2025-10-16T22:33:32.225454] [DEBUG] [LOCAL ] AER: Loaded 48455 existing records from primary storage. [2025-10-16T22:33:32.225769] [INFO ] [MAIN ] AER: Loaded 48455 primary data records. [2025-10-16T22:33:32.225676] [INFO ] [MAIN ] AES: Loaded 54059 primary data records. [2025-10-16T22:33:33.124348] [DEBUG] [MAIN ] AES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:33.125499] [INFO ] [MAIN ] AES: Generated 1807 derivative records from 54059 primary records. [2025-10-16T22:33:33.127589] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-16T22:33:33.147859] [DEBUG] [LOCAL ] AES: Derivative data saved (1807 records). [2025-10-16T22:33:33.174327] [DEBUG] [MAIN ] AER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:33.148045] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-16T22:33:33.175056] [DEBUG] [MAIN ] AESI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:33.175918] [INFO ] [MAIN ] AER: Generated 1807 derivative records from 48455 primary records. [2025-10-16T22:33:33.178007] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-16T22:33:33.177916] [INFO ] [MAIN ] Derivative Progress: 31/1803 symbols completed. AES took 1.1s. Estimated remaining: 11m 50s. Rate: 149.8 symbols/min [2025-10-16T22:33:33.179492] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:33.179028] [INFO ] [MAIN ] AESI: Generated 1807 derivative records from 50127 primary records. [2025-10-16T22:33:33.180637] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-16T22:33:33.208811] [DEBUG] [LOCAL ] AER: Derivative data saved (1807 records). [2025-10-16T22:33:33.213702] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-16T22:33:33.213567] [DEBUG] [LOCAL ] AESI: Derivative data saved (1807 records). [2025-10-16T22:33:33.215833] [INFO ] [MAIN ] Derivative Progress: 32/1803 symbols completed. AER took 1.1s. Estimated remaining: 11m 29s. Rate: 154.1 symbols/min [2025-10-16T22:33:33.216004] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-16T22:33:33.221544] [INFO ] [MAIN ] Derivative Progress: 33/1803 symbols completed. AESI took 1.1s. Estimated remaining: 11m 8s. Rate: 158.9 symbols/min [2025-10-16T22:33:33.221413] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:33.222322] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:33.228239] [DEBUG] [LOCAL ] AFB: Loaded 11274 existing records from primary storage. [2025-10-16T22:33:33.229198] [INFO ] [MAIN ] AFB: Loaded 11274 primary data records. [2025-10-16T22:33:33.274552] [DEBUG] [LOCAL ] AFGC: Loaded 2570 existing records from primary storage. [2025-10-16T22:33:33.330070] [INFO ] [MAIN ] AFGC: Loaded 2570 primary data records. [2025-10-16T22:33:33.675713] [DEBUG] [LOCAL ] AFG: Loaded 32434 existing records from primary storage. [2025-10-16T22:33:33.687358] [INFO ] [MAIN ] AFG: Loaded 32434 primary data records. [2025-10-16T22:33:34.264772] [DEBUG] [MAIN ] AFB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:34.266577] [INFO ] [MAIN ] AFB: Generated 1807 derivative records from 11274 primary records. [2025-10-16T22:33:34.269398] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-16T22:33:34.300108] [DEBUG] [LOCAL ] AFB: Derivative data saved (1807 records). [2025-10-16T22:33:34.300967] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-16T22:33:34.303225] [INFO ] [MAIN ] Derivative Progress: 34/1803 symbols completed. AFB took 1.1s. Estimated remaining: 11m 45s. Rate: 150.6 symbols/min [2025-10-16T22:33:34.303930] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:34.303777] [DEBUG] [MAIN ] AFGC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:33:34.305181] [INFO ] [MAIN ] AFGC: Generated 1806 derivative records from 2570 primary records. [2025-10-16T22:33:34.305766] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-16T22:33:34.324933] [DEBUG] [LOCAL ] AFGD: Loaded 1786 existing records from primary storage. [2025-10-16T22:33:34.333111] [INFO ] [MAIN ] AFGD: Loaded 1786 primary data records. [2025-10-16T22:33:34.361607] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1806 records). [2025-10-16T22:33:34.372967] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-16T22:33:34.361105] [DEBUG] [MAIN ] AFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:34.379236] [INFO ] [MAIN ] AFG: Generated 1807 derivative records from 32434 primary records. [2025-10-16T22:33:34.381310] [INFO ] [MAIN ] Derivative Progress: 35/1803 symbols completed. AFGC took 1.2s. Estimated remaining: 11m 28s. Rate: 154.2 symbols/min [2025-10-16T22:33:34.414139] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-16T22:33:34.414422] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:34.478698] [DEBUG] [LOCAL ] AFG: Derivative data saved (1807 records). [2025-10-16T22:33:34.478894] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-16T22:33:34.481418] [INFO ] [MAIN ] Derivative Progress: 36/1803 symbols completed. AFG took 1.3s. Estimated remaining: 11m 13s. Rate: 157.4 symbols/min [2025-10-16T22:33:34.509495] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:34.540030] [DEBUG] [LOCAL ] AFGE: Loaded 2380 existing records from primary storage. [2025-10-16T22:33:34.565635] [INFO ] [MAIN ] AFGE: Loaded 2380 primary data records. [2025-10-16T22:33:35.017918] [DEBUG] [LOCAL ] AFL: Loaded 53580 existing records from primary storage. [2025-10-16T22:33:35.019104] [INFO ] [MAIN ] AFL: Loaded 53580 primary data records. [2025-10-16T22:33:35.163972] [DEBUG] [MAIN ] AFGD: Filtered 6966 bins outside market hours, 7762 incomplete bins [2025-10-16T22:33:35.219043] [INFO ] [MAIN ] AFGD: Generated 1804 derivative records from 1786 primary records. [2025-10-16T22:33:35.219348] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-10-16T22:33:35.349266] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1804 records). [2025-10-16T22:33:35.362295] [DEBUG] [MAIN ] AFGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:35.363205] [INFO ] [MAIN ] AFGE: Generated 1807 derivative records from 2380 primary records. [2025-10-16T22:33:35.363296] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-10-16T22:33:35.365434] [INFO ] [MAIN ] Derivative Progress: 37/1803 symbols completed. AFGD took 1.1s. Estimated remaining: 11m 37s. Rate: 152.0 symbols/min [2025-10-16T22:33:35.365844] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:35.366394] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-16T22:33:35.382912] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1807 records). [2025-10-16T22:33:35.383351] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-16T22:33:35.385493] [INFO ] [MAIN ] Derivative Progress: 38/1803 symbols completed. AFGE took 1.0s. Estimated remaining: 11m 19s. Rate: 155.9 symbols/min [2025-10-16T22:33:35.386093] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:35.404744] [DEBUG] [MAIN ] AFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:35.405559] [INFO ] [MAIN ] AFL: Generated 1807 derivative records from 53580 primary records. [2025-10-16T22:33:35.405795] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-16T22:33:35.422874] [DEBUG] [LOCAL ] AFL: Derivative data saved (1807 records). [2025-10-16T22:33:35.423090] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-16T22:33:35.425323] [INFO ] [MAIN ] Derivative Progress: 39/1803 symbols completed. AFL took 0.9s. Estimated remaining: 11m 3s. Rate: 159.6 symbols/min [2025-10-16T22:33:35.438619] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:35.473330] [DEBUG] [LOCAL ] AG: Loaded 54033 existing records from primary storage. [2025-10-16T22:33:35.490439] [INFO ] [MAIN ] AG: Loaded 54033 primary data records. [2025-10-16T22:33:35.491478] [DEBUG] [LOCAL ] AGD: Loaded 19404 existing records from primary storage. [2025-10-16T22:33:35.491691] [INFO ] [MAIN ] AGD: Loaded 19404 primary data records. [2025-10-16T22:33:35.533499] [DEBUG] [LOCAL ] AGCO: Loaded 42651 existing records from primary storage. [2025-10-16T22:33:35.533637] [INFO ] [MAIN ] AGCO: Loaded 42651 primary data records. [2025-10-16T22:33:36.481797] [DEBUG] [MAIN ] AG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:36.507721] [INFO ] [MAIN ] AG: Generated 1807 derivative records from 54033 primary records. [2025-10-16T22:33:36.508069] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-16T22:33:36.508588] [DEBUG] [MAIN ] AGD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:36.509017] [DEBUG] [MAIN ] AGCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:36.510062] [INFO ] [MAIN ] AGD: Generated 1807 derivative records from 19404 primary records. [2025-10-16T22:33:36.510837] [INFO ] [MAIN ] AGCO: Generated 1807 derivative records from 42651 primary records. [2025-10-16T22:33:36.511929] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-16T22:33:36.511357] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-16T22:33:36.555910] [DEBUG] [LOCAL ] AGD: Derivative data saved (1807 records). [2025-10-16T22:33:36.556789] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-16T22:33:36.558973] [INFO ] [MAIN ] Derivative Progress: 40/1803 symbols completed. AGD took 1.1s. Estimated remaining: 11m 36s. Rate: 151.9 symbols/min [2025-10-16T22:33:36.560852] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:36.564152] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1807 records). [2025-10-16T22:33:36.565827] [DEBUG] [LOCAL ] AG: Derivative data saved (1807 records). [2025-10-16T22:33:36.565943] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-16T22:33:36.568790] [INFO ] [MAIN ] Derivative Progress: 41/1803 symbols completed. AG took 1.2s. Estimated remaining: 11m 19s. Rate: 155.6 symbols/min [2025-10-16T22:33:36.569076] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:36.569538] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-16T22:33:36.571757] [INFO ] [MAIN ] Derivative Progress: 42/1803 symbols completed. AGCO took 1.2s. Estimated remaining: 11m 3s. Rate: 159.4 symbols/min [2025-10-16T22:33:36.572365] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:36.587972] [DEBUG] [LOCAL ] AGM: Loaded 10792 existing records from primary storage. [2025-10-16T22:33:36.588178] [INFO ] [MAIN ] AGM: Loaded 10792 primary data records. [2025-10-16T22:33:36.797262] [DEBUG] [LOCAL ] AGL: Loaded 52970 existing records from primary storage. [2025-10-16T22:33:36.834405] [INFO ] [MAIN ] AGL: Loaded 52970 primary data records. [2025-10-16T22:33:36.965115] [DEBUG] [LOCAL ] AGI: Loaded 53813 existing records from primary storage. [2025-10-16T22:33:36.981665] [INFO ] [MAIN ] AGI: Loaded 53813 primary data records. [2025-10-16T22:33:37.656546] [DEBUG] [MAIN ] AGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:37.657601] [INFO ] [MAIN ] AGM: Generated 1807 derivative records from 10792 primary records. [2025-10-16T22:33:37.658574] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-16T22:33:37.686152] [DEBUG] [LOCAL ] AGM: Derivative data saved (1807 records). [2025-10-16T22:33:37.700138] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-16T22:33:37.702631] [INFO ] [MAIN ] Derivative Progress: 43/1803 symbols completed. AGM took 1.1s. Estimated remaining: 11m 33s. Rate: 152.3 symbols/min [2025-10-16T22:33:37.703837] [DEBUG] [MAIN ] AGL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:37.705807] [INFO ] [MAIN ] AGL: Generated 1807 derivative records from 52970 primary records. [2025-10-16T22:33:37.706828] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-16T22:33:37.729390] [DEBUG] [MAIN ] AGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:37.737004] [DEBUG] [LOCAL ] AGL: Derivative data saved (1807 records). [2025-10-16T22:33:37.737106] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-16T22:33:37.739422] [INFO ] [MAIN ] Derivative Progress: 44/1803 symbols completed. AGL took 1.2s. Estimated remaining: 11m 19s. Rate: 155.5 symbols/min [2025-10-16T22:33:37.733039] [INFO ] [MAIN ] AGI: Generated 1807 derivative records from 53813 primary records. [2025-10-16T22:33:37.739734] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-16T22:33:37.755750] [DEBUG] [LOCAL ] AGI: Derivative data saved (1807 records). [2025-10-16T22:33:37.755834] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-10-16T22:33:37.758214] [INFO ] [MAIN ] Derivative Progress: 45/1803 symbols completed. AGI took 1.2s. Estimated remaining: 11m 4s. Rate: 158.8 symbols/min [2025-10-16T22:33:37.758831] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:37.758963] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:37.758763] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:37.827348] [DEBUG] [LOCAL ] AGRO: Loaded 33278 existing records from primary storage. [2025-10-16T22:33:37.828624] [DEBUG] [LOCAL ] AGX: Loaded 33089 existing records from primary storage. [2025-10-16T22:33:37.828819] [INFO ] [MAIN ] AGRO: Loaded 33278 primary data records. [2025-10-16T22:33:37.828941] [INFO ] [MAIN ] AGX: Loaded 33089 primary data records. [2025-10-16T22:33:37.828026] [DEBUG] [LOCAL ] AGO: Loaded 28168 existing records from primary storage. [2025-10-16T22:33:37.829185] [INFO ] [MAIN ] AGO: Loaded 28168 primary data records. [2025-10-16T22:33:38.783554] [DEBUG] [MAIN ] AGRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:38.784734] [INFO ] [MAIN ] AGRO: Generated 1807 derivative records from 33278 primary records. [2025-10-16T22:33:38.785270] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-16T22:33:38.803532] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1807 records). [2025-10-16T22:33:38.805880] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-16T22:33:38.808302] [INFO ] [MAIN ] Derivative Progress: 46/1803 symbols completed. AGRO took 1.0s. Estimated remaining: 11m 29s. Rate: 152.9 symbols/min [2025-10-16T22:33:38.808869] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:38.822559] [DEBUG] [MAIN ] AGX: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:33:38.835798] [INFO ] [MAIN ] AGX: Generated 1806 derivative records from 33089 primary records. [2025-10-16T22:33:38.835075] [DEBUG] [MAIN ] AGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:38.835919] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-16T22:33:38.836492] [INFO ] [MAIN ] AGO: Generated 1807 derivative records from 28168 primary records. [2025-10-16T22:33:38.837011] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-16T22:33:38.868056] [DEBUG] [LOCAL ] AGX: Derivative data saved (1806 records). [2025-10-16T22:33:38.868175] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-16T22:33:38.870550] [INFO ] [MAIN ] Derivative Progress: 47/1803 symbols completed. AGX took 1.1s. Estimated remaining: 11m 17s. Rate: 155.7 symbols/min [2025-10-16T22:33:38.866849] [DEBUG] [LOCAL ] AGO: Derivative data saved (1807 records). [2025-10-16T22:33:38.870767] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:38.871035] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-16T22:33:38.873737] [INFO ] [MAIN ] Derivative Progress: 48/1803 symbols completed. AGO took 1.1s. Estimated remaining: 11m 2s. Rate: 159.0 symbols/min [2025-10-16T22:33:38.874013] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:38.884121] [DEBUG] [LOCAL ] AHT: Loaded 6425 existing records from primary storage. [2025-10-16T22:33:38.884442] [INFO ] [MAIN ] AHT: Loaded 6425 primary data records. [2025-10-16T22:33:39.047738] [DEBUG] [LOCAL ] AHH: Loaded 40838 existing records from primary storage. [2025-10-16T22:33:39.070484] [INFO ] [MAIN ] AHH: Loaded 40838 primary data records. [2025-10-16T22:33:39.368724] [DEBUG] [LOCAL ] AHR: Loaded 49438 existing records from primary storage. [2025-10-16T22:33:39.411132] [INFO ] [MAIN ] AHR: Loaded 49438 primary data records. [2025-10-16T22:33:40.084254] [DEBUG] [MAIN ] AHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:40.085337] [INFO ] [MAIN ] AHT: Generated 1807 derivative records from 6425 primary records. [2025-10-16T22:33:40.085751] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-16T22:33:40.109510] [DEBUG] [LOCAL ] AHT: Derivative data saved (1807 records). [2025-10-16T22:33:40.110918] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-16T22:33:40.113110] [INFO ] [MAIN ] Derivative Progress: 49/1803 symbols completed. AHT took 1.2s. Estimated remaining: 11m 33s. Rate: 151.9 symbols/min [2025-10-16T22:33:40.113371] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:40.131325] [DEBUG] [MAIN ] AHH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:40.133203] [INFO ] [MAIN ] AHH: Generated 1807 derivative records from 40838 primary records. [2025-10-16T22:33:40.133477] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-16T22:33:40.160157] [DEBUG] [LOCAL ] AHH: Derivative data saved (1807 records). [2025-10-16T22:33:40.162502] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-16T22:33:40.166556] [INFO ] [MAIN ] Derivative Progress: 50/1803 symbols completed. AHH took 1.4s. Estimated remaining: 11m 20s. Rate: 154.6 symbols/min [2025-10-16T22:33:40.167278] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:40.190252] [DEBUG] [MAIN ] AHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:40.191467] [INFO ] [MAIN ] AHR: Generated 1807 derivative records from 49438 primary records. [2025-10-16T22:33:40.191598] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-10-16T22:33:40.233085] [DEBUG] [LOCAL ] AHR: Derivative data saved (1807 records). [2025-10-16T22:33:40.233408] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-10-16T22:33:40.236491] [INFO ] [MAIN ] Derivative Progress: 51/1803 symbols completed. AHR took 1.4s. Estimated remaining: 11m 9s. Rate: 157.1 symbols/min [2025-10-16T22:33:40.237085] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:40.280668] [DEBUG] [LOCAL ] AI: Loaded 54155 existing records from primary storage. [2025-10-16T22:33:40.281116] [INFO ] [MAIN ] AI: Loaded 54155 primary data records. [2025-10-16T22:33:40.465289] [DEBUG] [LOCAL ] AIG: Loaded 53860 existing records from primary storage. [2025-10-16T22:33:40.464237] [DEBUG] [LOCAL ] AIN: Loaded 24655 existing records from primary storage. [2025-10-16T22:33:40.465759] [INFO ] [MAIN ] AIG: Loaded 53860 primary data records. [2025-10-16T22:33:40.466177] [INFO ] [MAIN ] AIN: Loaded 24655 primary data records. [2025-10-16T22:33:41.331755] [DEBUG] [MAIN ] AI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:41.334036] [INFO ] [MAIN ] AI: Generated 1807 derivative records from 54155 primary records. [2025-10-16T22:33:41.334427] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-16T22:33:41.357004] [DEBUG] [LOCAL ] AI: Derivative data saved (1807 records). [2025-10-16T22:33:41.364875] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-16T22:33:41.382680] [DEBUG] [MAIN ] AIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:41.385674] [INFO ] [MAIN ] Derivative Progress: 52/1803 symbols completed. AI took 1.3s. Estimated remaining: 11m 35s. Rate: 151.3 symbols/min [2025-10-16T22:33:41.386553] [INFO ] [MAIN ] AIN: Generated 1807 derivative records from 24655 primary records. [2025-10-16T22:33:41.386696] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-16T22:33:41.383595] [DEBUG] [MAIN ] AIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:41.388287] [INFO ] [MAIN ] AIG: Generated 1807 derivative records from 53860 primary records. [2025-10-16T22:33:41.388411] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:41.389355] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-16T22:33:41.424261] [DEBUG] [LOCAL ] AIN: Derivative data saved (1807 records). [2025-10-16T22:33:41.424937] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-16T22:33:41.427692] [INFO ] [MAIN ] Derivative Progress: 53/1803 symbols completed. AIN took 1.2s. Estimated remaining: 11m 22s. Rate: 153.9 symbols/min [2025-10-16T22:33:41.428566] [DEBUG] [LOCAL ] AIG: Derivative data saved (1807 records). [2025-10-16T22:33:41.434041] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:41.434447] [DEBUG] [LOCAL ] AIO: Loaded 13450 existing records from primary storage. [2025-10-16T22:33:41.435027] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-16T22:33:41.438237] [INFO ] [MAIN ] Derivative Progress: 54/1803 symbols completed. AIG took 1.3s. Estimated remaining: 11m 10s. Rate: 156.7 symbols/min [2025-10-16T22:33:41.435225] [INFO ] [MAIN ] AIO: Loaded 13450 primary data records. [2025-10-16T22:33:41.438624] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:41.678861] [DEBUG] [LOCAL ] AIR: Loaded 29128 existing records from primary storage. [2025-10-16T22:33:41.679637] [DEBUG] [LOCAL ] AIT: Loaded 27175 existing records from primary storage. [2025-10-16T22:33:41.786801] [INFO ] [MAIN ] AIR: Loaded 29128 primary data records. [2025-10-16T22:33:41.800147] [INFO ] [MAIN ] AIT: Loaded 27175 primary data records. [2025-10-16T22:33:42.520776] [DEBUG] [MAIN ] AIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:42.522109] [INFO ] [MAIN ] AIO: Generated 1807 derivative records from 13450 primary records. [2025-10-16T22:33:42.522814] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-16T22:33:42.541542] [DEBUG] [LOCAL ] AIO: Derivative data saved (1807 records). [2025-10-16T22:33:42.542297] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-10-16T22:33:42.544500] [INFO ] [MAIN ] Derivative Progress: 55/1803 symbols completed. AIO took 1.2s. Estimated remaining: 11m 32s. Rate: 151.5 symbols/min [2025-10-16T22:33:42.545169] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:42.568970] [DEBUG] [MAIN ] AIR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:42.577565] [INFO ] [MAIN ] AIR: Generated 1807 derivative records from 29128 primary records. [2025-10-16T22:33:42.582850] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-10-16T22:33:42.583676] [DEBUG] [MAIN ] AIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:42.584532] [INFO ] [MAIN ] AIT: Generated 1807 derivative records from 27175 primary records. [2025-10-16T22:33:42.584852] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-16T22:33:42.626476] [DEBUG] [LOCAL ] AIR: Derivative data saved (1807 records). [2025-10-16T22:33:42.627370] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-10-16T22:33:42.631678] [INFO ] [MAIN ] Derivative Progress: 56/1803 symbols completed. AIR took 1.2s. Estimated remaining: 11m 22s. Rate: 153.6 symbols/min [2025-10-16T22:33:42.632341] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:42.634326] [DEBUG] [LOCAL ] AIT: Derivative data saved (1807 records). [2025-10-16T22:33:42.634485] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-16T22:33:42.637408] [INFO ] [MAIN ] Derivative Progress: 57/1803 symbols completed. AIT took 1.2s. Estimated remaining: 11m 10s. Rate: 156.3 symbols/min [2025-10-16T22:33:42.637908] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:42.651356] [DEBUG] [LOCAL ] AIV: Loaded 41824 existing records from primary storage. [2025-10-16T22:33:42.651590] [INFO ] [MAIN ] AIV: Loaded 41824 primary data records. [2025-10-16T22:33:42.770004] [DEBUG] [LOCAL ] AIZN: Loaded 3972 existing records from primary storage. [2025-10-16T22:33:42.770170] [INFO ] [MAIN ] AIZN: Loaded 3972 primary data records. [2025-10-16T22:33:42.913346] [DEBUG] [LOCAL ] AIZ: Loaded 29712 existing records from primary storage. [2025-10-16T22:33:42.952494] [INFO ] [MAIN ] AIZ: Loaded 29712 primary data records. [2025-10-16T22:33:43.644398] [DEBUG] [MAIN ] AIV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:43.645270] [INFO ] [MAIN ] AIV: Generated 1807 derivative records from 41824 primary records. [2025-10-16T22:33:43.645541] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-16T22:33:43.665903] [DEBUG] [LOCAL ] AIV: Derivative data saved (1807 records). [2025-10-16T22:33:43.666188] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-16T22:33:43.668353] [INFO ] [MAIN ] Derivative Progress: 58/1803 symbols completed. AIV took 1.1s. Estimated remaining: 11m 29s. Rate: 151.9 symbols/min [2025-10-16T22:33:43.684391] [DEBUG] [MAIN ] AIZN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:43.685240] [INFO ] [MAIN ] AIZN: Generated 1807 derivative records from 3972 primary records. [2025-10-16T22:33:43.685389] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-10-16T22:33:43.698377] [DEBUG] [MAIN ] AIZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:43.699182] [INFO ] [MAIN ] AIZ: Generated 1807 derivative records from 29712 primary records. [2025-10-16T22:33:43.709606] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-16T22:33:43.728380] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1807 records). [2025-10-16T22:33:43.729674] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-10-16T22:33:43.729613] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1807 records). [2025-10-16T22:33:43.732212] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-16T22:33:43.732110] [INFO ] [MAIN ] Derivative Progress: 59/1803 symbols completed. AIZN took 1.1s. Estimated remaining: 11m 19s. Rate: 154.1 symbols/min [2025-10-16T22:33:43.735068] [INFO ] [MAIN ] Derivative Progress: 60/1803 symbols completed. AIZ took 1.1s. Estimated remaining: 11m 7s. Rate: 156.7 symbols/min [2025-10-16T22:33:43.735515] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:43.735621] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:43.736041] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:43.824461] [DEBUG] [LOCAL ] AKR: Loaded 46457 existing records from primary storage. [2025-10-16T22:33:43.825364] [DEBUG] [LOCAL ] AJG: Loaded 46920 existing records from primary storage. [2025-10-16T22:33:43.825546] [INFO ] [MAIN ] AKR: Loaded 46457 primary data records. [2025-10-16T22:33:43.825480] [INFO ] [MAIN ] AJG: Loaded 46920 primary data records. [2025-10-16T22:33:43.847290] [DEBUG] [LOCAL ] AL: Loaded 45074 existing records from primary storage. [2025-10-16T22:33:43.884677] [INFO ] [MAIN ] AL: Loaded 45074 primary data records. [2025-10-16T22:33:44.869443] [DEBUG] [MAIN ] AL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:44.884450] [DEBUG] [MAIN ] AKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:44.884168] [INFO ] [MAIN ] AL: Generated 1807 derivative records from 45074 primary records. [2025-10-16T22:33:44.885350] [INFO ] [MAIN ] AKR: Generated 1807 derivative records from 46457 primary records. [2025-10-16T22:33:44.884669] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-16T22:33:44.886703] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-16T22:33:44.885802] [DEBUG] [MAIN ] AJG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:44.896171] [INFO ] [MAIN ] AJG: Generated 1807 derivative records from 46920 primary records. [2025-10-16T22:33:44.908609] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-16T22:33:44.933870] [DEBUG] [LOCAL ] AKR: Derivative data saved (1807 records). [2025-10-16T22:33:44.934237] [DEBUG] [LOCAL ] AL: Derivative data saved (1807 records). [2025-10-16T22:33:44.934867] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-16T22:33:44.934601] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-16T22:33:44.937462] [INFO ] [MAIN ] Derivative Progress: 61/1803 symbols completed. AKR took 1.2s. Estimated remaining: 11m 30s. Rate: 151.4 symbols/min [2025-10-16T22:33:44.940574] [INFO ] [MAIN ] Derivative Progress: 62/1803 symbols completed. AL took 1.2s. Estimated remaining: 11m 19s. Rate: 153.8 symbols/min [2025-10-16T22:33:44.940789] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:44.938240] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:44.946165] [DEBUG] [LOCAL ] AJG: Derivative data saved (1807 records). [2025-10-16T22:33:44.946424] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-16T22:33:44.949322] [INFO ] [MAIN ] Derivative Progress: 63/1803 symbols completed. AJG took 1.2s. Estimated remaining: 11m 8s. Rate: 156.3 symbols/min [2025-10-16T22:33:44.949603] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:44.997455] [DEBUG] [LOCAL ] ALE: Loaded 32255 existing records from primary storage. [2025-10-16T22:33:44.997792] [INFO ] [MAIN ] ALE: Loaded 32255 primary data records. [2025-10-16T22:33:45.140241] [DEBUG] [LOCAL ] ALC: Loaded 51569 existing records from primary storage. [2025-10-16T22:33:45.146069] [INFO ] [MAIN ] ALC: Loaded 51569 primary data records. [2025-10-16T22:33:45.229041] [DEBUG] [LOCAL ] ALB: Loaded 53733 existing records from primary storage. [2025-10-16T22:33:45.254873] [INFO ] [MAIN ] ALB: Loaded 53733 primary data records. [2025-10-16T22:33:46.067880] [DEBUG] [MAIN ] ALE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:46.068827] [INFO ] [MAIN ] ALE: Generated 1807 derivative records from 32255 primary records. [2025-10-16T22:33:46.069726] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-16T22:33:46.090374] [DEBUG] [LOCAL ] ALE: Derivative data saved (1807 records). [2025-10-16T22:33:46.091603] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-16T22:33:46.094554] [INFO ] [MAIN ] Derivative Progress: 64/1803 symbols completed. ALE took 1.1s. Estimated remaining: 11m 28s. Rate: 151.6 symbols/min [2025-10-16T22:33:46.095779] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:46.120194] [DEBUG] [MAIN ] ALC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:46.126104] [INFO ] [MAIN ] ALC: Generated 1807 derivative records from 51569 primary records. [2025-10-16T22:33:46.126538] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-10-16T22:33:46.126361] [DEBUG] [MAIN ] ALB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:46.128399] [INFO ] [MAIN ] ALB: Generated 1807 derivative records from 53733 primary records. [2025-10-16T22:33:46.128852] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-16T22:33:46.159691] [DEBUG] [LOCAL ] ALB: Derivative data saved (1807 records). [2025-10-16T22:33:46.169619] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-16T22:33:46.169417] [DEBUG] [LOCAL ] ALC: Derivative data saved (1807 records). [2025-10-16T22:33:46.172232] [INFO ] [MAIN ] Derivative Progress: 65/1803 symbols completed. ALB took 1.2s. Estimated remaining: 11m 19s. Rate: 153.5 symbols/min [2025-10-16T22:33:46.172317] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-10-16T22:33:46.172606] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:46.174948] [INFO ] [MAIN ] Derivative Progress: 66/1803 symbols completed. ALC took 1.2s. Estimated remaining: 11m 9s. Rate: 155.8 symbols/min [2025-10-16T22:33:46.175761] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:46.191281] [DEBUG] [LOCAL ] ALEX: Loaded 31407 existing records from primary storage. [2025-10-16T22:33:46.195068] [INFO ] [MAIN ] ALEX: Loaded 31407 primary data records. [2025-10-16T22:33:46.258690] [DEBUG] [LOCAL ] ALG: Loaded 9812 existing records from primary storage. [2025-10-16T22:33:46.285059] [INFO ] [MAIN ] ALG: Loaded 9812 primary data records. [2025-10-16T22:33:46.667169] [DEBUG] [LOCAL ] ALIT: Loaded 53175 existing records from primary storage. [2025-10-16T22:33:46.683142] [INFO ] [MAIN ] ALIT: Loaded 53175 primary data records. [2025-10-16T22:33:47.185601] [DEBUG] [MAIN ] ALEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:47.188613] [INFO ] [MAIN ] ALEX: Generated 1807 derivative records from 31407 primary records. [2025-10-16T22:33:47.189581] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-16T22:33:47.215288] [DEBUG] [MAIN ] ALG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:47.219320] [INFO ] [MAIN ] ALG: Generated 1807 derivative records from 9812 primary records. [2025-10-16T22:33:47.221151] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-16T22:33:47.220804] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1807 records). [2025-10-16T22:33:47.222062] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-16T22:33:47.224327] [INFO ] [MAIN ] Derivative Progress: 67/1803 symbols completed. ALEX took 1.1s. Estimated remaining: 11m 26s. Rate: 151.9 symbols/min [2025-10-16T22:33:47.232907] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:47.240189] [DEBUG] [LOCAL ] ALG: Derivative data saved (1807 records). [2025-10-16T22:33:47.240621] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-16T22:33:47.242931] [INFO ] [MAIN ] Derivative Progress: 68/1803 symbols completed. ALG took 1.1s. Estimated remaining: 11m 16s. Rate: 154.1 symbols/min [2025-10-16T22:33:47.243232] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:47.262342] [DEBUG] [MAIN ] ALIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:47.263196] [INFO ] [MAIN ] ALIT: Generated 1807 derivative records from 53175 primary records. [2025-10-16T22:33:47.263289] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-16T22:33:47.281539] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1807 records). [2025-10-16T22:33:47.281922] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-16T22:33:47.284587] [INFO ] [MAIN ] Derivative Progress: 69/1803 symbols completed. ALIT took 1.1s. Estimated remaining: 11m 7s. Rate: 156.1 symbols/min [2025-10-16T22:33:47.284871] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:47.334799] [DEBUG] [LOCAL ] ALL: Loaded 50161 existing records from primary storage. [2025-10-16T22:33:47.335051] [INFO ] [MAIN ] ALL: Loaded 50161 primary data records. [2025-10-16T22:33:47.427368] [DEBUG] [LOCAL ] ALK: Loaded 53470 existing records from primary storage. [2025-10-16T22:33:47.464277] [INFO ] [MAIN ] ALK: Loaded 53470 primary data records. [2025-10-16T22:33:47.787742] [DEBUG] [LOCAL ] ALLE: Loaded 44517 existing records from primary storage. [2025-10-16T22:33:47.793824] [INFO ] [MAIN ] ALLE: Loaded 44517 primary data records. [2025-10-16T22:33:48.360430] [DEBUG] [MAIN ] ALL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:48.362070] [INFO ] [MAIN ] ALL: Generated 1807 derivative records from 50161 primary records. [2025-10-16T22:33:48.362165] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-16T22:33:48.386843] [DEBUG] [LOCAL ] ALL: Derivative data saved (1807 records). [2025-10-16T22:33:48.387348] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-16T22:33:48.389311] [INFO ] [MAIN ] Derivative Progress: 70/1803 symbols completed. ALL took 1.1s. Estimated remaining: 11m 24s. Rate: 152.0 symbols/min [2025-10-16T22:33:48.389766] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:48.403492] [DEBUG] [MAIN ] ALK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:48.404690] [INFO ] [MAIN ] ALK: Generated 1807 derivative records from 53470 primary records. [2025-10-16T22:33:48.404996] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-16T22:33:48.438221] [DEBUG] [MAIN ] ALLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:48.438937] [DEBUG] [LOCAL ] ALK: Derivative data saved (1807 records). [2025-10-16T22:33:48.439241] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-16T22:33:48.443300] [INFO ] [MAIN ] Derivative Progress: 71/1803 symbols completed. ALK took 1.2s. Estimated remaining: 11m 15s. Rate: 153.9 symbols/min [2025-10-16T22:33:48.444252] [INFO ] [MAIN ] ALLE: Generated 1807 derivative records from 44517 primary records. [2025-10-16T22:33:48.444432] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-16T22:33:48.444593] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:48.463093] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1807 records). [2025-10-16T22:33:48.463341] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-10-16T22:33:48.465991] [INFO ] [MAIN ] Derivative Progress: 72/1803 symbols completed. ALLE took 1.2s. Estimated remaining: 11m 6s. Rate: 155.9 symbols/min [2025-10-16T22:33:48.466466] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:48.492488] [DEBUG] [LOCAL ] ALUR: Loaded 9589 existing records from primary storage. [2025-10-16T22:33:48.492811] [INFO ] [MAIN ] ALUR: Loaded 9589 primary data records. [2025-10-16T22:33:48.612693] [DEBUG] [LOCAL ] ALLY: Loaded 53610 existing records from primary storage. [2025-10-16T22:33:48.624325] [INFO ] [MAIN ] ALLY: Loaded 53610 primary data records. [2025-10-16T22:33:48.868328] [DEBUG] [LOCAL ] ALSN: Loaded 43767 existing records from primary storage. [2025-10-16T22:33:48.926602] [INFO ] [MAIN ] ALSN: Loaded 43767 primary data records. [2025-10-16T22:33:49.463291] [DEBUG] [MAIN ] ALUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:49.464442] [INFO ] [MAIN ] ALUR: Generated 1807 derivative records from 9589 primary records. [2025-10-16T22:33:49.464957] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-16T22:33:49.484144] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1807 records). [2025-10-16T22:33:49.484534] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-16T22:33:49.486722] [INFO ] [MAIN ] Derivative Progress: 73/1803 symbols completed. ALUR took 1.0s. Estimated remaining: 11m 21s. Rate: 152.5 symbols/min [2025-10-16T22:33:49.499418] [DEBUG] [MAIN ] ALLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:49.500301] [INFO ] [MAIN ] ALLY: Generated 1807 derivative records from 53610 primary records. [2025-10-16T22:33:49.500484] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-16T22:33:49.530585] [DEBUG] [MAIN ] ALSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:49.531277] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1807 records). [2025-10-16T22:33:49.531944] [INFO ] [MAIN ] ALSN: Generated 1807 derivative records from 43767 primary records. [2025-10-16T22:33:49.532026] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-16T22:33:49.535131] [INFO ] [MAIN ] Derivative Progress: 74/1803 symbols completed. ALLY took 1.1s. Estimated remaining: 11m 12s. Rate: 154.3 symbols/min [2025-10-16T22:33:49.532106] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-16T22:33:49.550584] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1807 records). [2025-10-16T22:33:49.550664] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-10-16T22:33:49.553145] [INFO ] [MAIN ] Derivative Progress: 75/1803 symbols completed. ALSN took 1.1s. Estimated remaining: 11m 3s. Rate: 156.3 symbols/min [2025-10-16T22:33:49.553534] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:49.553638] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:49.553956] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:49.564463] [DEBUG] [LOCAL ] ALX: Loaded 7061 existing records from primary storage. [2025-10-16T22:33:49.564585] [INFO ] [MAIN ] ALX: Loaded 7061 primary data records. [2025-10-16T22:33:49.898375] [DEBUG] [LOCAL ] ALV: Loaded 42481 existing records from primary storage. [2025-10-16T22:33:49.900194] [INFO ] [MAIN ] ALV: Loaded 42481 primary data records. [2025-10-16T22:33:49.972327] [DEBUG] [LOCAL ] AM: Loaded 52320 existing records from primary storage. [2025-10-16T22:33:50.003408] [INFO ] [MAIN ] AM: Loaded 52320 primary data records. [2025-10-16T22:33:50.571716] [DEBUG] [MAIN ] ALX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:50.573834] [INFO ] [MAIN ] ALX: Generated 1807 derivative records from 7061 primary records. [2025-10-16T22:33:50.574046] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-16T22:33:50.597423] [DEBUG] [LOCAL ] ALX: Derivative data saved (1807 records). [2025-10-16T22:33:50.597675] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-16T22:33:50.599981] [INFO ] [MAIN ] Derivative Progress: 76/1803 symbols completed. ALX took 1.0s. Estimated remaining: 11m 18s. Rate: 152.8 symbols/min [2025-10-16T22:33:50.600915] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:50.620594] [DEBUG] [MAIN ] ALV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:50.623593] [INFO ] [MAIN ] ALV: Generated 1807 derivative records from 42481 primary records. [2025-10-16T22:33:50.624026] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-16T22:33:50.647849] [DEBUG] [MAIN ] AM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:50.653928] [INFO ] [MAIN ] AM: Generated 1807 derivative records from 52320 primary records. [2025-10-16T22:33:50.664364] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-16T22:33:50.669174] [DEBUG] [LOCAL ] ALV: Derivative data saved (1807 records). [2025-10-16T22:33:50.669323] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-16T22:33:50.672547] [INFO ] [MAIN ] Derivative Progress: 77/1803 symbols completed. ALV took 1.1s. Estimated remaining: 11m 10s. Rate: 154.5 symbols/min [2025-10-16T22:33:50.682608] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:50.707576] [DEBUG] [LOCAL ] AM: Derivative data saved (1807 records). [2025-10-16T22:33:50.707886] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-16T22:33:50.712235] [INFO ] [MAIN ] Derivative Progress: 78/1803 symbols completed. AM took 1.2s. Estimated remaining: 11m 2s. Rate: 156.3 symbols/min [2025-10-16T22:33:50.708631] [DEBUG] [LOCAL ] AMBC: Loaded 36530 existing records from primary storage. [2025-10-16T22:33:50.712564] [INFO ] [MAIN ] AMBC: Loaded 36530 primary data records. [2025-10-16T22:33:50.712730] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:51.050131] [DEBUG] [LOCAL ] AMBP: Loaded 44894 existing records from primary storage. [2025-10-16T22:33:51.050489] [INFO ] [MAIN ] AMBP: Loaded 44894 primary data records. [2025-10-16T22:33:51.199583] [DEBUG] [LOCAL ] AMC: Loaded 54152 existing records from primary storage. [2025-10-16T22:33:51.230830] [INFO ] [MAIN ] AMC: Loaded 54152 primary data records. [2025-10-16T22:33:51.736142] [DEBUG] [MAIN ] AMBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:51.743242] [INFO ] [MAIN ] AMBC: Generated 1807 derivative records from 36530 primary records. [2025-10-16T22:33:51.753183] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-16T22:33:51.771924] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1807 records). [2025-10-16T22:33:51.772363] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-16T22:33:51.775323] [INFO ] [MAIN ] Derivative Progress: 79/1803 symbols completed. AMBC took 1.2s. Estimated remaining: 11m 17s. Rate: 152.8 symbols/min [2025-10-16T22:33:51.775626] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:51.795803] [DEBUG] [MAIN ] AMBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:51.796956] [INFO ] [MAIN ] AMBP: Generated 1807 derivative records from 44894 primary records. [2025-10-16T22:33:51.797148] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-16T22:33:51.821068] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1807 records). [2025-10-16T22:33:51.821575] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-16T22:33:51.827140] [INFO ] [MAIN ] Derivative Progress: 80/1803 symbols completed. AMBP took 1.1s. Estimated remaining: 11m 9s. Rate: 154.5 symbols/min [2025-10-16T22:33:51.827957] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:51.857249] [DEBUG] [MAIN ] AMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:51.858364] [INFO ] [MAIN ] AMC: Generated 1807 derivative records from 54152 primary records. [2025-10-16T22:33:51.858440] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-16T22:33:51.893126] [DEBUG] [LOCAL ] AMC: Derivative data saved (1807 records). [2025-10-16T22:33:51.894548] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-16T22:33:51.894185] [DEBUG] [LOCAL ] AMCR: Loaded 54059 existing records from primary storage. [2025-10-16T22:33:51.894778] [INFO ] [MAIN ] AMCR: Loaded 54059 primary data records. [2025-10-16T22:33:51.898103] [INFO ] [MAIN ] Derivative Progress: 81/1803 symbols completed. AMC took 1.2s. Estimated remaining: 11m 2s. Rate: 156.1 symbols/min [2025-10-16T22:33:51.919781] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:52.277305] [DEBUG] [LOCAL ] AMG: Loaded 20310 existing records from primary storage. [2025-10-16T22:33:52.277741] [INFO ] [MAIN ] AMG: Loaded 20310 primary data records. [2025-10-16T22:33:52.294963] [DEBUG] [LOCAL ] AME: Loaded 49020 existing records from primary storage. [2025-10-16T22:33:52.309992] [INFO ] [MAIN ] AME: Loaded 49020 primary data records. [2025-10-16T22:33:52.954711] [DEBUG] [MAIN ] AMCR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:52.956407] [INFO ] [MAIN ] AMCR: Generated 1807 derivative records from 54059 primary records. [2025-10-16T22:33:52.956886] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-16T22:33:52.980676] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1807 records). [2025-10-16T22:33:52.980813] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-16T22:33:52.983201] [INFO ] [MAIN ] Derivative Progress: 82/1803 symbols completed. AMCR took 1.2s. Estimated remaining: 11m 16s. Rate: 152.7 symbols/min [2025-10-16T22:33:52.983702] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:53.004508] [DEBUG] [MAIN ] AMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:53.006872] [INFO ] [MAIN ] AMG: Generated 1807 derivative records from 20310 primary records. [2025-10-16T22:33:53.008170] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-16T22:33:53.037279] [DEBUG] [MAIN ] AME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:53.039615] [INFO ] [MAIN ] AME: Generated 1807 derivative records from 49020 primary records. [2025-10-16T22:33:53.040811] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-16T22:33:53.057170] [DEBUG] [LOCAL ] AMG: Derivative data saved (1807 records). [2025-10-16T22:33:53.061128] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-16T22:33:53.064183] [INFO ] [MAIN ] Derivative Progress: 83/1803 symbols completed. AMG took 1.1s. Estimated remaining: 11m 9s. Rate: 154.2 symbols/min [2025-10-16T22:33:53.066199] [DEBUG] [LOCAL ] AME: Derivative data saved (1807 records). [2025-10-16T22:33:53.066668] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-16T22:33:53.066373] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:53.070124] [INFO ] [MAIN ] Derivative Progress: 84/1803 symbols completed. AME took 1.2s. Estimated remaining: 11m 1s. Rate: 156.0 symbols/min [2025-10-16T22:33:53.070474] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:53.112453] [DEBUG] [LOCAL ] AMH: Loaded 52220 existing records from primary storage. [2025-10-16T22:33:53.112605] [INFO ] [MAIN ] AMH: Loaded 52220 primary data records. [2025-10-16T22:33:53.280522] [DEBUG] [LOCAL ] AMP: Loaded 32286 existing records from primary storage. [2025-10-16T22:33:53.331318] [INFO ] [MAIN ] AMP: Loaded 32286 primary data records. [2025-10-16T22:33:53.517869] [DEBUG] [LOCAL ] AMN: Loaded 42102 existing records from primary storage. [2025-10-16T22:33:53.550210] [INFO ] [MAIN ] AMN: Loaded 42102 primary data records. [2025-10-16T22:33:54.171472] [DEBUG] [MAIN ] AMH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:54.173311] [INFO ] [MAIN ] AMH: Generated 1807 derivative records from 52220 primary records. [2025-10-16T22:33:54.173870] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-16T22:33:54.195238] [DEBUG] [LOCAL ] AMH: Derivative data saved (1807 records). [2025-10-16T22:33:54.198035] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-16T22:33:54.202981] [INFO ] [MAIN ] Derivative Progress: 85/1803 symbols completed. AMH took 1.2s. Estimated remaining: 11m 16s. Rate: 152.5 symbols/min [2025-10-16T22:33:54.216886] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:54.217146] [DEBUG] [MAIN ] AMP: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:33:54.219321] [INFO ] [MAIN ] AMP: Generated 1806 derivative records from 32286 primary records. [2025-10-16T22:33:54.219462] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-16T22:33:54.240484] [DEBUG] [LOCAL ] AMP: Derivative data saved (1806 records). [2025-10-16T22:33:54.240732] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-16T22:33:54.243128] [INFO ] [MAIN ] Derivative Progress: 86/1803 symbols completed. AMP took 1.2s. Estimated remaining: 11m 8s. Rate: 154.1 symbols/min [2025-10-16T22:33:54.243545] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:54.258353] [DEBUG] [MAIN ] AMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:54.259200] [INFO ] [MAIN ] AMN: Generated 1807 derivative records from 42102 primary records. [2025-10-16T22:33:54.259338] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-16T22:33:54.278021] [DEBUG] [LOCAL ] AMN: Derivative data saved (1807 records). [2025-10-16T22:33:54.278432] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-10-16T22:33:54.281594] [INFO ] [MAIN ] Derivative Progress: 87/1803 symbols completed. AMN took 1.2s. Estimated remaining: 11m 1s. Rate: 155.7 symbols/min [2025-10-16T22:33:54.282006] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:54.361838] [DEBUG] [LOCAL ] AMPY: Loaded 39500 existing records from primary storage. [2025-10-16T22:33:54.362061] [INFO ] [MAIN ] AMPY: Loaded 39500 primary data records. [2025-10-16T22:33:54.364202] [DEBUG] [LOCAL ] AMPX: Loaded 52728 existing records from primary storage. [2025-10-16T22:33:54.386169] [INFO ] [MAIN ] AMPX: Loaded 52728 primary data records. [2025-10-16T22:33:54.585924] [DEBUG] [LOCAL ] AMR: Loaded 29158 existing records from primary storage. [2025-10-16T22:33:54.666365] [INFO ] [MAIN ] AMR: Loaded 29158 primary data records. [2025-10-16T22:33:55.406357] [DEBUG] [MAIN ] AMPY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:55.407896] [INFO ] [MAIN ] AMPY: Generated 1807 derivative records from 39500 primary records. [2025-10-16T22:33:55.408145] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-16T22:33:55.443177] [DEBUG] [MAIN ] AMPX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:55.445183] [INFO ] [MAIN ] AMPX: Generated 1807 derivative records from 52728 primary records. [2025-10-16T22:33:55.445408] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-10-16T22:33:55.446292] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1807 records). [2025-10-16T22:33:55.446994] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-16T22:33:55.449490] [INFO ] [MAIN ] Derivative Progress: 88/1803 symbols completed. AMPY took 1.2s. Estimated remaining: 11m 16s. Rate: 152.2 symbols/min [2025-10-16T22:33:55.469666] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1807 records). [2025-10-16T22:33:55.470825] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-10-16T22:33:55.473859] [INFO ] [MAIN ] Derivative Progress: 89/1803 symbols completed. AMPX took 1.3s. Estimated remaining: 11m 9s. Rate: 153.8 symbols/min [2025-10-16T22:33:55.489234] [DEBUG] [MAIN ] AMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:55.490174] [INFO ] [MAIN ] AMR: Generated 1807 derivative records from 29158 primary records. [2025-10-16T22:33:55.490248] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-16T22:33:55.507546] [DEBUG] [LOCAL ] AMR: Derivative data saved (1807 records). [2025-10-16T22:33:55.507777] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-16T22:33:55.511211] [INFO ] [MAIN ] Derivative Progress: 90/1803 symbols completed. AMR took 1.2s. Estimated remaining: 11m 1s. Rate: 155.4 symbols/min [2025-10-16T22:33:55.511950] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:55.512155] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:55.512328] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:55.541824] [DEBUG] [LOCAL ] AMTB: Loaded 20672 existing records from primary storage. [2025-10-16T22:33:55.542021] [INFO ] [MAIN ] AMTB: Loaded 20672 primary data records. [2025-10-16T22:33:55.792248] [DEBUG] [LOCAL ] AMRC: Loaded 38803 existing records from primary storage. [2025-10-16T22:33:55.935261] [INFO ] [MAIN ] AMRC: Loaded 38803 primary data records. [2025-10-16T22:33:55.959429] [DEBUG] [LOCAL ] AMT: Loaded 52860 existing records from primary storage. [2025-10-16T22:33:55.998877] [INFO ] [MAIN ] AMT: Loaded 52860 primary data records. [2025-10-16T22:33:56.678358] [DEBUG] [MAIN ] AMTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:56.679355] [INFO ] [MAIN ] AMTB: Generated 1807 derivative records from 20672 primary records. [2025-10-16T22:33:56.679781] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-16T22:33:56.697932] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1807 records). [2025-10-16T22:33:56.698252] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-16T22:33:56.700561] [INFO ] [MAIN ] Derivative Progress: 91/1803 symbols completed. AMTB took 1.2s. Estimated remaining: 11m 16s. Rate: 151.9 symbols/min [2025-10-16T22:33:56.700939] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:56.714043] [DEBUG] [LOCAL ] AMTD: Loaded 3819 existing records from primary storage. [2025-10-16T22:33:56.729006] [INFO ] [MAIN ] AMTD: Loaded 3819 primary data records. [2025-10-16T22:33:56.750680] [DEBUG] [MAIN ] AMRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:56.771150] [INFO ] [MAIN ] AMRC: Generated 1807 derivative records from 38803 primary records. [2025-10-16T22:33:56.802703] [DEBUG] [MAIN ] AMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:56.817195] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-16T22:33:56.836371] [INFO ] [MAIN ] AMT: Generated 1807 derivative records from 52860 primary records. [2025-10-16T22:33:56.843186] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-16T22:33:56.887514] [DEBUG] [LOCAL ] AMT: Derivative data saved (1807 records). [2025-10-16T22:33:56.898342] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-16T22:33:56.911035] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1807 records). [2025-10-16T22:33:56.919807] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-16T22:33:56.914535] [INFO ] [MAIN ] Derivative Progress: 92/1803 symbols completed. AMT took 1.4s. Estimated remaining: 11m 12s. Rate: 152.7 symbols/min [2025-10-16T22:33:56.980411] [INFO ] [MAIN ] Derivative Progress: 93/1803 symbols completed. AMRC took 1.4s. Estimated remaining: 11m 6s. Rate: 154.1 symbols/min [2025-10-16T22:33:56.980207] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:57.100447] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:57.119126] [DEBUG] [LOCAL ] AMWL: Loaded 9671 existing records from primary storage. [2025-10-16T22:33:57.119359] [INFO ] [MAIN ] AMWL: Loaded 9671 primary data records. [2025-10-16T22:33:57.311986] [DEBUG] [MAIN ] AMTD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:57.363617] [INFO ] [MAIN ] AMTD: Generated 1807 derivative records from 3819 primary records. [2025-10-16T22:33:57.479991] [DEBUG] [LOCAL ] AMTM: Loaded 50899 existing records from primary storage. [2025-10-16T22:33:57.480177] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-16T22:33:57.492477] [INFO ] [MAIN ] AMTM: Loaded 50899 primary data records. [2025-10-16T22:33:57.530861] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1807 records). [2025-10-16T22:33:57.555834] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-16T22:33:57.557941] [INFO ] [MAIN ] Derivative Progress: 94/1803 symbols completed. AMTD took 0.9s. Estimated remaining: 11m 9s. Rate: 153.3 symbols/min [2025-10-16T22:33:57.563263] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:57.899852] [DEBUG] [MAIN ] AMWL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:57.901858] [INFO ] [MAIN ] AMWL: Generated 1807 derivative records from 9671 primary records. [2025-10-16T22:33:57.903230] [DEBUG] [LOCAL ] AMX: Loaded 49533 existing records from primary storage. [2025-10-16T22:33:57.903504] [INFO ] [MAIN ] AMX: Loaded 49533 primary data records. [2025-10-16T22:33:57.903617] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-16T22:33:58.036690] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1807 records). [2025-10-16T22:33:58.037393] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-16T22:33:58.046436] [INFO ] [MAIN ] Derivative Progress: 95/1803 symbols completed. AMWL took 0.9s. Estimated remaining: 11m 10s. Rate: 152.9 symbols/min [2025-10-16T22:33:58.057455] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:58.278140] [DEBUG] [MAIN ] AMTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:58.279328] [INFO ] [MAIN ] AMTM: Generated 1807 derivative records from 50899 primary records. [2025-10-16T22:33:58.279402] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-16T22:33:58.314594] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1807 records). [2025-10-16T22:33:58.323311] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-16T22:33:58.326940] [INFO ] [MAIN ] Derivative Progress: 96/1803 symbols completed. AMTM took 1.3s. Estimated remaining: 11m 8s. Rate: 153.3 symbols/min [2025-10-16T22:33:58.327369] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:58.329075] [DEBUG] [LOCAL ] AN: Loaded 31615 existing records from primary storage. [2025-10-16T22:33:58.329493] [INFO ] [MAIN ] AN: Loaded 31615 primary data records. [2025-10-16T22:33:58.527886] [DEBUG] [MAIN ] AMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:58.565292] [INFO ] [MAIN ] AMX: Generated 1807 derivative records from 49533 primary records. [2025-10-16T22:33:58.761506] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-16T22:33:58.798974] [DEBUG] [LOCAL ] AMX: Derivative data saved (1807 records). [2025-10-16T22:33:58.800407] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-10-16T22:33:58.800084] [DEBUG] [LOCAL ] ANET: Loaded 54156 existing records from primary storage. [2025-10-16T22:33:58.804421] [INFO ] [MAIN ] ANET: Loaded 54156 primary data records. [2025-10-16T22:33:58.804299] [INFO ] [MAIN ] Derivative Progress: 97/1803 symbols completed. AMX took 1.2s. Estimated remaining: 11m 9s. Rate: 153.0 symbols/min [2025-10-16T22:33:58.804709] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:59.148873] [DEBUG] [MAIN ] AN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:59.165693] [INFO ] [MAIN ] AN: Generated 1807 derivative records from 31615 primary records. [2025-10-16T22:33:59.166041] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-10-16T22:33:59.168316] [DEBUG] [LOCAL ] ANF: Loaded 52463 existing records from primary storage. [2025-10-16T22:33:59.168928] [INFO ] [MAIN ] ANF: Loaded 52463 primary data records. [2025-10-16T22:33:59.228138] [DEBUG] [LOCAL ] AN: Derivative data saved (1807 records). [2025-10-16T22:33:59.259932] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-10-16T22:33:59.263318] [INFO ] [MAIN ] Derivative Progress: 98/1803 symbols completed. AN took 1.2s. Estimated remaining: 11m 10s. Rate: 152.7 symbols/min [2025-10-16T22:33:59.264044] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:59.374606] [DEBUG] [MAIN ] ANET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:33:59.392996] [INFO ] [MAIN ] ANET: Generated 1807 derivative records from 54156 primary records. [2025-10-16T22:33:59.524123] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-16T22:33:59.542251] [DEBUG] [LOCAL ] ANRO: Loaded 19575 existing records from primary storage. [2025-10-16T22:33:59.550089] [INFO ] [MAIN ] ANRO: Loaded 19575 primary data records. [2025-10-16T22:33:59.564939] [DEBUG] [LOCAL ] ANET: Derivative data saved (1807 records). [2025-10-16T22:33:59.577732] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-16T22:33:59.588585] [INFO ] [MAIN ] Derivative Progress: 99/1803 symbols completed. ANET took 1.3s. Estimated remaining: 11m 8s. Rate: 153.0 symbols/min [2025-10-16T22:33:59.636348] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:33:59.892354] [DEBUG] [LOCAL ] ANVS: Loaded 24112 existing records from primary storage. [2025-10-16T22:33:59.893087] [INFO ] [MAIN ] ANVS: Loaded 24112 primary data records. [2025-10-16T22:34:00.020704] [DEBUG] [MAIN ] ANF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:00.050742] [INFO ] [MAIN ] ANF: Generated 1807 derivative records from 52463 primary records. [2025-10-16T22:34:00.107679] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-16T22:34:00.244881] [DEBUG] [LOCAL ] ANF: Derivative data saved (1807 records). [2025-10-16T22:34:00.245046] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-16T22:34:00.248002] [INFO ] [MAIN ] Derivative Progress: 100/1803 symbols completed. ANF took 1.4s. Estimated remaining: 11m 12s. Rate: 151.9 symbols/min [2025-10-16T22:34:00.248410] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:00.269985] [DEBUG] [MAIN ] ANRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:00.271364] [INFO ] [MAIN ] ANRO: Generated 1807 derivative records from 19575 primary records. [2025-10-16T22:34:00.271774] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-10-16T22:34:00.290978] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1807 records). [2025-10-16T22:34:00.291191] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-10-16T22:34:00.293412] [INFO ] [MAIN ] Derivative Progress: 101/1803 symbols completed. ANRO took 1.0s. Estimated remaining: 11m 6s. Rate: 153.3 symbols/min [2025-10-16T22:34:00.293861] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:00.332169] [DEBUG] [MAIN ] ANVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:00.333203] [INFO ] [MAIN ] ANVS: Generated 1807 derivative records from 24112 primary records. [2025-10-16T22:34:00.333311] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-16T22:34:00.334593] [DEBUG] [LOCAL ] AOD: Loaded 31036 existing records from primary storage. [2025-10-16T22:34:00.334710] [INFO ] [MAIN ] AOD: Loaded 31036 primary data records. [2025-10-16T22:34:00.536233] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1807 records). [2025-10-16T22:34:00.553692] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-16T22:34:00.657399] [INFO ] [MAIN ] Derivative Progress: 102/1803 symbols completed. ANVS took 1.0s. Estimated remaining: 11m 5s. Rate: 153.4 symbols/min [2025-10-16T22:34:00.657808] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:00.675339] [DEBUG] [LOCAL ] AON: Loaded 45501 existing records from primary storage. [2025-10-16T22:34:00.676710] [INFO ] [MAIN ] AON: Loaded 45501 primary data records. [2025-10-16T22:34:00.846684] [DEBUG] [LOCAL ] AORT: Loaded 29387 existing records from primary storage. [2025-10-16T22:34:00.880629] [INFO ] [MAIN ] AORT: Loaded 29387 primary data records. [2025-10-16T22:34:01.215225] [DEBUG] [MAIN ] AOD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:01.225151] [INFO ] [MAIN ] AOD: Generated 1807 derivative records from 31036 primary records. [2025-10-16T22:34:01.238789] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-16T22:34:01.314631] [DEBUG] [LOCAL ] AOD: Derivative data saved (1807 records). [2025-10-16T22:34:01.325263] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-10-16T22:34:01.327466] [INFO ] [MAIN ] Derivative Progress: 103/1803 symbols completed. AOD took 1.1s. Estimated remaining: 11m 10s. Rate: 152.3 symbols/min [2025-10-16T22:34:01.522028] [DEBUG] [MAIN ] AON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:01.523302] [INFO ] [MAIN ] AON: Generated 1807 derivative records from 45501 primary records. [2025-10-16T22:34:01.523516] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-16T22:34:01.540808] [DEBUG] [LOCAL ] AON: Derivative data saved (1807 records). [2025-10-16T22:34:01.541831] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-16T22:34:01.544123] [INFO ] [MAIN ] Derivative Progress: 104/1803 symbols completed. AON took 1.3s. Estimated remaining: 11m 6s. Rate: 153.0 symbols/min [2025-10-16T22:34:01.563065] [DEBUG] [MAIN ] AORT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:01.563875] [INFO ] [MAIN ] AORT: Generated 1807 derivative records from 29387 primary records. [2025-10-16T22:34:01.563956] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-10-16T22:34:01.580218] [DEBUG] [LOCAL ] AORT: Derivative data saved (1807 records). [2025-10-16T22:34:01.580388] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-10-16T22:34:01.582762] [INFO ] [MAIN ] Derivative Progress: 105/1803 symbols completed. AORT took 0.9s. Estimated remaining: 11m 0s. Rate: 154.3 symbols/min [2025-10-16T22:34:01.583419] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:01.583346] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:01.583927] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:01.618110] [DEBUG] [LOCAL ] AP: Loaded 7398 existing records from primary storage. [2025-10-16T22:34:01.618398] [INFO ] [MAIN ] AP: Loaded 7398 primary data records. [2025-10-16T22:34:01.962739] [DEBUG] [LOCAL ] APG: Loaded 50964 existing records from primary storage. [2025-10-16T22:34:01.989781] [INFO ] [MAIN ] APG: Loaded 50964 primary data records. [2025-10-16T22:34:02.022778] [DEBUG] [LOCAL ] APD: Loaded 45857 existing records from primary storage. [2025-10-16T22:34:02.035191] [INFO ] [MAIN ] APD: Loaded 45857 primary data records. [2025-10-16T22:34:02.641567] [DEBUG] [MAIN ] AP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:02.642526] [INFO ] [MAIN ] AP: Generated 1807 derivative records from 7398 primary records. [2025-10-16T22:34:02.643453] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-10-16T22:34:02.661299] [DEBUG] [LOCAL ] AP: Derivative data saved (1807 records). [2025-10-16T22:34:02.661567] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-10-16T22:34:02.664232] [INFO ] [MAIN ] Derivative Progress: 106/1803 symbols completed. AP took 1.1s. Estimated remaining: 11m 11s. Rate: 151.8 symbols/min [2025-10-16T22:34:02.664831] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:02.682046] [DEBUG] [MAIN ] APG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:02.682786] [INFO ] [MAIN ] APG: Generated 1807 derivative records from 50964 primary records. [2025-10-16T22:34:02.682974] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-16T22:34:02.701802] [DEBUG] [LOCAL ] APG: Derivative data saved (1807 records). [2025-10-16T22:34:02.709502] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-10-16T22:34:02.717092] [DEBUG] [MAIN ] APD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:02.716504] [INFO ] [MAIN ] Derivative Progress: 107/1803 symbols completed. APG took 1.1s. Estimated remaining: 11m 5s. Rate: 153.0 symbols/min [2025-10-16T22:34:02.718181] [INFO ] [MAIN ] APD: Generated 1807 derivative records from 45857 primary records. [2025-10-16T22:34:02.717336] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:02.718394] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-16T22:34:02.736208] [DEBUG] [LOCAL ] APD: Derivative data saved (1807 records). [2025-10-16T22:34:02.736392] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-16T22:34:02.738878] [INFO ] [MAIN ] Derivative Progress: 108/1803 symbols completed. APD took 1.2s. Estimated remaining: 10m 59s. Rate: 154.4 symbols/min [2025-10-16T22:34:02.752345] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:02.763833] [DEBUG] [LOCAL ] APOS: Loaded 7359 existing records from primary storage. [2025-10-16T22:34:02.764217] [INFO ] [MAIN ] APOS: Loaded 7359 primary data records. [2025-10-16T22:34:02.854024] [DEBUG] [LOCAL ] APLE: Loaded 52352 existing records from primary storage. [2025-10-16T22:34:02.872297] [INFO ] [MAIN ] APLE: Loaded 52352 primary data records. [2025-10-16T22:34:03.220171] [DEBUG] [LOCAL ] APO: Loaded 53779 existing records from primary storage. [2025-10-16T22:34:03.302678] [INFO ] [MAIN ] APO: Loaded 53779 primary data records. [2025-10-16T22:34:03.776958] [DEBUG] [MAIN ] APOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:03.778554] [INFO ] [MAIN ] APOS: Generated 1807 derivative records from 7359 primary records. [2025-10-16T22:34:03.790576] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-10-16T22:34:03.791920] [DEBUG] [MAIN ] APLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:03.794254] [INFO ] [MAIN ] APLE: Generated 1807 derivative records from 52352 primary records. [2025-10-16T22:34:03.802455] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-10-16T22:34:03.825987] [DEBUG] [LOCAL ] APOS: Derivative data saved (1807 records). [2025-10-16T22:34:03.826243] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-10-16T22:34:03.828997] [INFO ] [MAIN ] Derivative Progress: 109/1803 symbols completed. APOS took 1.1s. Estimated remaining: 11m 9s. Rate: 151.9 symbols/min [2025-10-16T22:34:03.829837] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:03.831021] [DEBUG] [LOCAL ] APLE: Derivative data saved (1807 records). [2025-10-16T22:34:03.832117] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-10-16T22:34:03.834870] [INFO ] [MAIN ] Derivative Progress: 110/1803 symbols completed. APLE took 1.2s. Estimated remaining: 11m 3s. Rate: 153.2 symbols/min [2025-10-16T22:34:03.837330] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:03.851463] [DEBUG] [MAIN ] APO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:03.852485] [INFO ] [MAIN ] APO: Generated 1807 derivative records from 53779 primary records. [2025-10-16T22:34:03.852761] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-16T22:34:03.871879] [DEBUG] [LOCAL ] AQNB: Loaded 4077 existing records from primary storage. [2025-10-16T22:34:03.873250] [INFO ] [MAIN ] AQNB: Loaded 4077 primary data records. [2025-10-16T22:34:03.940826] [DEBUG] [LOCAL ] APO: Derivative data saved (1807 records). [2025-10-16T22:34:03.982870] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-10-16T22:34:04.027460] [INFO ] [MAIN ] Derivative Progress: 111/1803 symbols completed. APO took 1.3s. Estimated remaining: 10m 60s. Rate: 153.9 symbols/min [2025-10-16T22:34:04.071209] [DEBUG] [LOCAL ] AQN: Loaded 52131 existing records from primary storage. [2025-10-16T22:34:04.071394] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:04.091374] [INFO ] [MAIN ] AQN: Loaded 52131 primary data records. [2025-10-16T22:34:04.561948] [DEBUG] [LOCAL ] AR: Loaded 53977 existing records from primary storage. [2025-10-16T22:34:04.562486] [INFO ] [MAIN ] AR: Loaded 53977 primary data records. [2025-10-16T22:34:04.732191] [DEBUG] [MAIN ] AQNB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:04.759449] [INFO ] [MAIN ] AQNB: Generated 1807 derivative records from 4077 primary records. [2025-10-16T22:34:04.776047] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-16T22:34:04.953782] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1807 records). [2025-10-16T22:34:04.954353] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-16T22:34:04.957300] [INFO ] [MAIN ] Derivative Progress: 112/1803 symbols completed. AQNB took 1.1s. Estimated remaining: 11m 7s. Rate: 152.0 symbols/min [2025-10-16T22:34:04.969863] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:04.971167] [DEBUG] [MAIN ] AQN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:04.971866] [INFO ] [MAIN ] AQN: Generated 1807 derivative records from 52131 primary records. [2025-10-16T22:34:04.971938] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-10-16T22:34:04.993538] [DEBUG] [LOCAL ] AQN: Derivative data saved (1807 records). [2025-10-16T22:34:04.993754] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-10-16T22:34:04.996092] [INFO ] [MAIN ] Derivative Progress: 113/1803 symbols completed. AQN took 1.2s. Estimated remaining: 11m 2s. Rate: 153.3 symbols/min [2025-10-16T22:34:04.996431] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:05.003972] [DEBUG] [LOCAL ] ARDC: Loaded 15429 existing records from primary storage. [2025-10-16T22:34:05.004413] [INFO ] [MAIN ] ARDC: Loaded 15429 primary data records. [2025-10-16T22:34:05.121554] [DEBUG] [MAIN ] AR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:05.140153] [INFO ] [MAIN ] AR: Generated 1807 derivative records from 53977 primary records. [2025-10-16T22:34:05.150708] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-10-16T22:34:05.216540] [DEBUG] [LOCAL ] ARDT: Loaded 27912 existing records from primary storage. [2025-10-16T22:34:05.222009] [INFO ] [MAIN ] ARDT: Loaded 27912 primary data records. [2025-10-16T22:34:05.436784] [DEBUG] [LOCAL ] AR: Derivative data saved (1807 records). [2025-10-16T22:34:05.453995] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-10-16T22:34:05.457565] [INFO ] [MAIN ] Derivative Progress: 114/1803 symbols completed. AR took 1.4s. Estimated remaining: 11m 2s. Rate: 153.0 symbols/min [2025-10-16T22:34:05.465786] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:05.691800] [DEBUG] [MAIN ] ARDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:05.692867] [INFO ] [MAIN ] ARDC: Generated 1807 derivative records from 15429 primary records. [2025-10-16T22:34:05.693037] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-10-16T22:34:05.725519] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1807 records). [2025-10-16T22:34:05.726543] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-10-16T22:34:05.729042] [INFO ] [MAIN ] Derivative Progress: 115/1803 symbols completed. ARDC took 0.8s. Estimated remaining: 11m 0s. Rate: 153.4 symbols/min [2025-10-16T22:34:05.729542] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:05.759426] [DEBUG] [LOCAL ] ARE: Loaded 51360 existing records from primary storage. [2025-10-16T22:34:05.772882] [DEBUG] [MAIN ] ARDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:05.772569] [INFO ] [MAIN ] ARE: Loaded 51360 primary data records. [2025-10-16T22:34:05.773840] [INFO ] [MAIN ] ARDT: Generated 1807 derivative records from 27912 primary records. [2025-10-16T22:34:05.774001] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-16T22:34:05.897979] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1807 records). [2025-10-16T22:34:05.914028] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-16T22:34:05.921634] [INFO ] [MAIN ] Derivative Progress: 116/1803 symbols completed. ARDT took 0.9s. Estimated remaining: 10m 57s. Rate: 154.1 symbols/min [2025-10-16T22:34:05.965509] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:06.118511] [DEBUG] [LOCAL ] ARI: Loaded 44048 existing records from primary storage. [2025-10-16T22:34:06.119684] [INFO ] [MAIN ] ARI: Loaded 44048 primary data records. [2025-10-16T22:34:06.455621] [DEBUG] [LOCAL ] ARMK: Loaded 50753 existing records from primary storage. [2025-10-16T22:34:06.457242] [INFO ] [MAIN ] ARMK: Loaded 50753 primary data records. [2025-10-16T22:34:06.514563] [DEBUG] [MAIN ] ARE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:06.515973] [INFO ] [MAIN ] ARE: Generated 1807 derivative records from 51360 primary records. [2025-10-16T22:34:06.527629] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-10-16T22:34:06.670035] [DEBUG] [LOCAL ] ARE: Derivative data saved (1807 records). [2025-10-16T22:34:06.670208] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-10-16T22:34:06.674164] [INFO ] [MAIN ] Derivative Progress: 117/1803 symbols completed. ARE took 1.2s. Estimated remaining: 11m 2s. Rate: 152.9 symbols/min [2025-10-16T22:34:06.820551] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:06.849846] [DEBUG] [MAIN ] ARI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:06.851312] [INFO ] [MAIN ] ARI: Generated 1807 derivative records from 44048 primary records. [2025-10-16T22:34:06.851402] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-10-16T22:34:06.870026] [DEBUG] [LOCAL ] ARI: Derivative data saved (1807 records). [2025-10-16T22:34:06.875178] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-10-16T22:34:06.877429] [INFO ] [MAIN ] Derivative Progress: 118/1803 symbols completed. ARI took 1.1s. Estimated remaining: 10m 59s. Rate: 153.5 symbols/min [2025-10-16T22:34:06.894585] [DEBUG] [MAIN ] ARMK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:06.895315] [INFO ] [MAIN ] ARMK: Generated 1807 derivative records from 50753 primary records. [2025-10-16T22:34:06.895437] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-16T22:34:06.924346] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1807 records). [2025-10-16T22:34:06.924486] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-16T22:34:06.926949] [INFO ] [MAIN ] Derivative Progress: 119/1803 symbols completed. ARMK took 1.0s. Estimated remaining: 10m 53s. Rate: 154.7 symbols/min [2025-10-16T22:34:06.944103] [DEBUG] [LOCAL ] ARR: Loaded 52502 existing records from primary storage. [2025-10-16T22:34:06.944253] [INFO ] [MAIN ] ARR: Loaded 52502 primary data records. [2025-10-16T22:34:07.246707] [DEBUG] [MAIN ] ARR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:07.247317] [INFO ] [MAIN ] ARR: Generated 1807 derivative records from 52502 primary records. [2025-10-16T22:34:07.247379] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-10-16T22:34:07.263003] [DEBUG] [LOCAL ] ARR: Derivative data saved (1807 records). [2025-10-16T22:34:07.263062] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-10-16T22:34:07.265783] [INFO ] [MAIN ] Derivative Progress: 120/1803 symbols completed. ARR took 0.4s. Estimated remaining: 10m 52s. Rate: 154.8 symbols/min [2025-10-16T22:34:07.266453] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:07.266381] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:07.266904] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:07.284311] [DEBUG] [LOCAL ] ASA: Loaded 15405 existing records from primary storage. [2025-10-16T22:34:07.284611] [INFO ] [MAIN ] ASA: Loaded 15405 primary data records. [2025-10-16T22:34:07.450909] [DEBUG] [LOCAL ] ARW: Loaded 33338 existing records from primary storage. [2025-10-16T22:34:07.476323] [INFO ] [MAIN ] ARW: Loaded 33338 primary data records. [2025-10-16T22:34:07.737074] [DEBUG] [LOCAL ] AS: Loaded 53564 existing records from primary storage. [2025-10-16T22:34:07.763264] [INFO ] [MAIN ] AS: Loaded 53564 primary data records. [2025-10-16T22:34:08.329813] [DEBUG] [MAIN ] ASA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:08.330973] [INFO ] [MAIN ] ASA: Generated 1807 derivative records from 15405 primary records. [2025-10-16T22:34:08.331573] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-16T22:34:08.350630] [DEBUG] [LOCAL ] ASA: Derivative data saved (1807 records). [2025-10-16T22:34:08.351189] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-16T22:34:08.353961] [INFO ] [MAIN ] Derivative Progress: 121/1803 symbols completed. ASA took 1.1s. Estimated remaining: 11m 2s. Rate: 152.5 symbols/min [2025-10-16T22:34:08.362434] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:08.368389] [DEBUG] [MAIN ] ARW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:08.369211] [INFO ] [MAIN ] ARW: Generated 1807 derivative records from 33338 primary records. [2025-10-16T22:34:08.369497] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-16T22:34:08.398808] [DEBUG] [MAIN ] AS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:08.399902] [INFO ] [MAIN ] AS: Generated 1807 derivative records from 53564 primary records. [2025-10-16T22:34:08.400246] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-16T22:34:08.417357] [DEBUG] [LOCAL ] ARW: Derivative data saved (1807 records). [2025-10-16T22:34:08.417989] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-16T22:34:08.420994] [INFO ] [MAIN ] Derivative Progress: 122/1803 symbols completed. ARW took 1.2s. Estimated remaining: 10m 57s. Rate: 153.6 symbols/min [2025-10-16T22:34:08.421383] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:08.425635] [DEBUG] [LOCAL ] AS: Derivative data saved (1807 records). [2025-10-16T22:34:08.425902] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-16T22:34:08.428234] [INFO ] [MAIN ] Derivative Progress: 123/1803 symbols completed. AS took 1.2s. Estimated remaining: 10m 51s. Rate: 154.8 symbols/min [2025-10-16T22:34:08.428474] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:08.448629] [DEBUG] [LOCAL ] ASBA: Loaded 3483 existing records from primary storage. [2025-10-16T22:34:08.448965] [INFO ] [MAIN ] ASBA: Loaded 3483 primary data records. [2025-10-16T22:34:08.566070] [DEBUG] [LOCAL ] ASAN: Loaded 53123 existing records from primary storage. [2025-10-16T22:34:08.583683] [INFO ] [MAIN ] ASAN: Loaded 53123 primary data records. [2025-10-16T22:34:08.770964] [DEBUG] [LOCAL ] ASB: Loaded 50019 existing records from primary storage. [2025-10-16T22:34:08.817155] [INFO ] [MAIN ] ASB: Loaded 50019 primary data records. [2025-10-16T22:34:09.611508] [DEBUG] [MAIN ] ASBA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:09.612853] [INFO ] [MAIN ] ASBA: Generated 1807 derivative records from 3483 primary records. [2025-10-16T22:34:09.613729] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-16T22:34:09.645255] [DEBUG] [MAIN ] ASAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:09.647347] [INFO ] [MAIN ] ASAN: Generated 1807 derivative records from 53123 primary records. [2025-10-16T22:34:09.648157] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-16T22:34:09.649205] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1807 records). [2025-10-16T22:34:09.649467] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-16T22:34:09.651736] [INFO ] [MAIN ] Derivative Progress: 124/1803 symbols completed. ASBA took 1.2s. Estimated remaining: 11m 2s. Rate: 152.2 symbols/min [2025-10-16T22:34:09.660267] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:09.675601] [DEBUG] [MAIN ] ASB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:09.679278] [INFO ] [MAIN ] ASB: Generated 1807 derivative records from 50019 primary records. [2025-10-16T22:34:09.680177] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-16T22:34:09.700478] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1807 records). [2025-10-16T22:34:09.701560] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-16T22:34:09.704795] [INFO ] [MAIN ] Derivative Progress: 125/1803 symbols completed. ASAN took 1.3s. Estimated remaining: 10m 57s. Rate: 153.2 symbols/min [2025-10-16T22:34:09.706985] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:09.706841] [DEBUG] [LOCAL ] ASB: Derivative data saved (1807 records). [2025-10-16T22:34:09.707664] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-16T22:34:09.710832] [INFO ] [MAIN ] Derivative Progress: 126/1803 symbols completed. ASB took 1.3s. Estimated remaining: 10m 52s. Rate: 154.4 symbols/min [2025-10-16T22:34:09.711249] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:09.742288] [DEBUG] [LOCAL ] ASC: Loaded 37642 existing records from primary storage. [2025-10-16T22:34:09.748712] [INFO ] [MAIN ] ASC: Loaded 37642 primary data records. [2025-10-16T22:34:09.822914] [DEBUG] [LOCAL ] ASG: Loaded 19723 existing records from primary storage. [2025-10-16T22:34:09.828319] [INFO ] [MAIN ] ASG: Loaded 19723 primary data records. [2025-10-16T22:34:09.895100] [DEBUG] [LOCAL ] ASGI: Loaded 23140 existing records from primary storage. [2025-10-16T22:34:09.918316] [INFO ] [MAIN ] ASGI: Loaded 23140 primary data records. [2025-10-16T22:34:10.729017] [DEBUG] [MAIN ] ASC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:10.729289] [DEBUG] [MAIN ] ASG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:10.729983] [INFO ] [MAIN ] ASC: Generated 1807 derivative records from 37642 primary records. [2025-10-16T22:34:10.730632] [INFO ] [MAIN ] ASG: Generated 1807 derivative records from 19723 primary records. [2025-10-16T22:34:10.730975] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-16T22:34:10.731025] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-16T22:34:10.758742] [DEBUG] [LOCAL ] ASC: Derivative data saved (1807 records). [2025-10-16T22:34:10.759074] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-16T22:34:10.764007] [INFO ] [MAIN ] Derivative Progress: 127/1803 symbols completed. ASC took 1.1s. Estimated remaining: 10m 60s. Rate: 152.4 symbols/min [2025-10-16T22:34:10.765055] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:10.780113] [DEBUG] [LOCAL ] ASG: Derivative data saved (1807 records). [2025-10-16T22:34:10.780518] [DEBUG] [MAIN ] ASGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:10.780248] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-10-16T22:34:10.782778] [INFO ] [MAIN ] Derivative Progress: 128/1803 symbols completed. ASG took 1.1s. Estimated remaining: 10m 55s. Rate: 153.5 symbols/min [2025-10-16T22:34:10.783000] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:10.784033] [INFO ] [MAIN ] ASGI: Generated 1807 derivative records from 23140 primary records. [2025-10-16T22:34:10.784324] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-10-16T22:34:10.801031] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1807 records). [2025-10-16T22:34:10.801218] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-10-16T22:34:10.804295] [INFO ] [MAIN ] Derivative Progress: 129/1803 symbols completed. ASGI took 1.1s. Estimated remaining: 10m 49s. Rate: 154.7 symbols/min [2025-10-16T22:34:10.804721] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:10.832265] [DEBUG] [LOCAL ] ASGN: Loaded 36906 existing records from primary storage. [2025-10-16T22:34:10.832592] [INFO ] [MAIN ] ASGN: Loaded 36906 primary data records. [2025-10-16T22:34:10.967421] [DEBUG] [LOCAL ] ASIX: Loaded 23274 existing records from primary storage. [2025-10-16T22:34:10.978846] [DEBUG] [LOCAL ] ASH: Loaded 37839 existing records from primary storage. [2025-10-16T22:34:10.978993] [INFO ] [MAIN ] ASH: Loaded 37839 primary data records. [2025-10-16T22:34:10.994546] [INFO ] [MAIN ] ASIX: Loaded 23274 primary data records. [2025-10-16T22:34:11.797639] [DEBUG] [MAIN ] ASGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:11.798552] [INFO ] [MAIN ] ASGN: Generated 1807 derivative records from 36906 primary records. [2025-10-16T22:34:11.798724] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-16T22:34:11.818158] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1807 records). [2025-10-16T22:34:11.818375] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-16T22:34:11.820610] [INFO ] [MAIN ] Derivative Progress: 130/1803 symbols completed. ASGN took 1.1s. Estimated remaining: 10m 57s. Rate: 152.8 symbols/min [2025-10-16T22:34:11.821224] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:11.852885] [DEBUG] [MAIN ] ASIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:11.852614] [DEBUG] [MAIN ] ASH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:11.854187] [INFO ] [MAIN ] ASIX: Generated 1807 derivative records from 23274 primary records. [2025-10-16T22:34:11.854347] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-16T22:34:11.853602] [INFO ] [MAIN ] ASH: Generated 1807 derivative records from 37839 primary records. [2025-10-16T22:34:11.854438] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-16T22:34:11.887523] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1807 records). [2025-10-16T22:34:11.886626] [DEBUG] [LOCAL ] ASH: Derivative data saved (1807 records). [2025-10-16T22:34:11.887728] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-16T22:34:11.890279] [INFO ] [MAIN ] Derivative Progress: 131/1803 symbols completed. ASIX took 1.1s. Estimated remaining: 10m 53s. Rate: 153.7 symbols/min [2025-10-16T22:34:11.890380] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-16T22:34:11.893195] [INFO ] [MAIN ] Derivative Progress: 132/1803 symbols completed. ASH took 1.1s. Estimated remaining: 10m 47s. Rate: 154.9 symbols/min [2025-10-16T22:34:11.893109] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:11.893833] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:11.915591] [DEBUG] [LOCAL ] ASR: Loaded 9418 existing records from primary storage. [2025-10-16T22:34:11.915751] [INFO ] [MAIN ] ASR: Loaded 9418 primary data records. [2025-10-16T22:34:12.033762] [DEBUG] [LOCAL ] ASPN: Loaded 50279 existing records from primary storage. [2025-10-16T22:34:12.034015] [INFO ] [MAIN ] ASPN: Loaded 50279 primary data records. [2025-10-16T22:34:12.545702] [DEBUG] [LOCAL ] ASX: Loaded 53264 existing records from primary storage. [2025-10-16T22:34:12.546152] [INFO ] [MAIN ] ASX: Loaded 53264 primary data records. [2025-10-16T22:34:12.906871] [DEBUG] [MAIN ] ASR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:12.907612] [INFO ] [MAIN ] ASR: Generated 1807 derivative records from 9418 primary records. [2025-10-16T22:34:12.907959] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-10-16T22:34:12.937402] [DEBUG] [LOCAL ] ASR: Derivative data saved (1807 records). [2025-10-16T22:34:12.942869] [DEBUG] [MAIN ] ASPN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:12.944365] [INFO ] [MAIN ] ASPN: Generated 1807 derivative records from 50279 primary records. [2025-10-16T22:34:12.943467] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-10-16T22:34:12.944573] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-16T22:34:12.947176] [INFO ] [MAIN ] Derivative Progress: 133/1803 symbols completed. ASR took 1.1s. Estimated remaining: 10m 55s. Rate: 152.9 symbols/min [2025-10-16T22:34:12.962890] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1807 records). [2025-10-16T22:34:12.963071] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-16T22:34:12.966010] [INFO ] [MAIN ] Derivative Progress: 134/1803 symbols completed. ASPN took 1.1s. Estimated remaining: 10m 50s. Rate: 154.0 symbols/min [2025-10-16T22:34:12.980581] [DEBUG] [MAIN ] ASX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:12.981116] [INFO ] [MAIN ] ASX: Generated 1807 derivative records from 53264 primary records. [2025-10-16T22:34:12.981176] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-16T22:34:12.996170] [DEBUG] [LOCAL ] ASX: Derivative data saved (1807 records). [2025-10-16T22:34:12.996231] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-16T22:34:12.998408] [INFO ] [MAIN ] Derivative Progress: 135/1803 symbols completed. ASX took 1.1s. Estimated remaining: 10m 45s. Rate: 155.1 symbols/min [2025-10-16T22:34:12.998830] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:12.998933] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:12.999003] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:13.056474] [DEBUG] [LOCAL ] ATGE: Loaded 31229 existing records from primary storage. [2025-10-16T22:34:13.066077] [INFO ] [MAIN ] ATGE: Loaded 31229 primary data records. [2025-10-16T22:34:13.055137] [DEBUG] [LOCAL ] ATHM: Loaded 31712 existing records from primary storage. [2025-10-16T22:34:13.087377] [INFO ] [MAIN ] ATHM: Loaded 31712 primary data records. [2025-10-16T22:34:13.109873] [DEBUG] [LOCAL ] ATEN: Loaded 38592 existing records from primary storage. [2025-10-16T22:34:13.168255] [INFO ] [MAIN ] ATEN: Loaded 38592 primary data records. [2025-10-16T22:34:14.006962] [DEBUG] [MAIN ] ATGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:14.007979] [INFO ] [MAIN ] ATGE: Generated 1807 derivative records from 31229 primary records. [2025-10-16T22:34:14.008165] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-16T22:34:14.026905] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1807 records). [2025-10-16T22:34:14.028053] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-16T22:34:14.030236] [INFO ] [MAIN ] Derivative Progress: 136/1803 symbols completed. ATGE took 1.0s. Estimated remaining: 10m 53s. Rate: 153.2 symbols/min [2025-10-16T22:34:14.031357] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:14.048356] [DEBUG] [MAIN ] ATHM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:14.050111] [INFO ] [MAIN ] ATHM: Generated 1807 derivative records from 31712 primary records. [2025-10-16T22:34:14.050283] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-16T22:34:14.072378] [DEBUG] [MAIN ] ATEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:14.080748] [INFO ] [MAIN ] ATEN: Generated 1807 derivative records from 38592 primary records. [2025-10-16T22:34:14.084429] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1807 records). [2025-10-16T22:34:14.082737] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-16T22:34:14.084669] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-10-16T22:34:14.088286] [INFO ] [MAIN ] Derivative Progress: 137/1803 symbols completed. ATHM took 1.1s. Estimated remaining: 10m 48s. Rate: 154.1 symbols/min [2025-10-16T22:34:14.101246] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:14.092739] [DEBUG] [LOCAL ] ATHS: Loaded 6668 existing records from primary storage. [2025-10-16T22:34:14.108666] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1807 records). [2025-10-16T22:34:14.108769] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-16T22:34:14.108560] [INFO ] [MAIN ] ATHS: Loaded 6668 primary data records. [2025-10-16T22:34:14.123155] [INFO ] [MAIN ] Derivative Progress: 138/1803 symbols completed. ATEN took 1.1s. Estimated remaining: 10m 44s. Rate: 155.2 symbols/min [2025-10-16T22:34:14.133122] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:14.459575] [DEBUG] [LOCAL ] ATKR: Loaded 35500 existing records from primary storage. [2025-10-16T22:34:14.462448] [INFO ] [MAIN ] ATKR: Loaded 35500 primary data records. [2025-10-16T22:34:14.475179] [DEBUG] [LOCAL ] ATI: Loaded 51723 existing records from primary storage. [2025-10-16T22:34:14.485463] [INFO ] [MAIN ] ATI: Loaded 51723 primary data records. [2025-10-16T22:34:15.146444] [DEBUG] [MAIN ] ATHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:15.148331] [INFO ] [MAIN ] ATHS: Generated 1807 derivative records from 6668 primary records. [2025-10-16T22:34:15.148787] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-16T22:34:15.170444] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1807 records). [2025-10-16T22:34:15.171149] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-16T22:34:15.173713] [INFO ] [MAIN ] Derivative Progress: 139/1803 symbols completed. ATHS took 1.1s. Estimated remaining: 10m 51s. Rate: 153.3 symbols/min [2025-10-16T22:34:15.174087] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:15.193612] [DEBUG] [MAIN ] ATKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:15.194437] [INFO ] [MAIN ] ATKR: Generated 1807 derivative records from 35500 primary records. [2025-10-16T22:34:15.194601] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-16T22:34:15.215001] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1807 records). [2025-10-16T22:34:15.215163] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-16T22:34:15.217431] [INFO ] [MAIN ] Derivative Progress: 140/1803 symbols completed. ATKR took 1.1s. Estimated remaining: 10m 47s. Rate: 154.2 symbols/min [2025-10-16T22:34:15.226668] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:15.233514] [DEBUG] [MAIN ] ATI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:15.234517] [INFO ] [MAIN ] ATI: Generated 1807 derivative records from 51723 primary records. [2025-10-16T22:34:15.234627] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-16T22:34:15.261299] [DEBUG] [LOCAL ] ATI: Derivative data saved (1807 records). [2025-10-16T22:34:15.261520] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-10-16T22:34:15.264142] [INFO ] [MAIN ] Derivative Progress: 141/1803 symbols completed. ATI took 1.2s. Estimated remaining: 10m 42s. Rate: 155.2 symbols/min [2025-10-16T22:34:15.264476] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:15.287231] [DEBUG] [LOCAL ] ATMU: Loaded 39185 existing records from primary storage. [2025-10-16T22:34:15.287446] [INFO ] [MAIN ] ATMU: Loaded 39185 primary data records. [2025-10-16T22:34:15.488022] [DEBUG] [LOCAL ] ATO: Loaded 42086 existing records from primary storage. [2025-10-16T22:34:15.504781] [INFO ] [MAIN ] ATO: Loaded 42086 primary data records. [2025-10-16T22:34:15.714150] [DEBUG] [LOCAL ] ATR: Loaded 30763 existing records from primary storage. [2025-10-16T22:34:15.733014] [INFO ] [MAIN ] ATR: Loaded 30763 primary data records. [2025-10-16T22:34:16.283918] [DEBUG] [MAIN ] ATMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:16.285123] [INFO ] [MAIN ] ATMU: Generated 1807 derivative records from 39185 primary records. [2025-10-16T22:34:16.285562] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-16T22:34:16.329122] [DEBUG] [MAIN ] ATO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:16.330846] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1807 records). [2025-10-16T22:34:16.331075] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-10-16T22:34:16.334220] [INFO ] [MAIN ] Derivative Progress: 142/1803 symbols completed. ATMU took 1.2s. Estimated remaining: 10m 50s. Rate: 153.3 symbols/min [2025-10-16T22:34:16.334431] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:16.336468] [INFO ] [MAIN ] ATO: Generated 1807 derivative records from 42086 primary records. [2025-10-16T22:34:16.336904] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-16T22:34:16.366285] [DEBUG] [MAIN ] ATR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:16.367906] [INFO ] [MAIN ] ATR: Generated 1807 derivative records from 30763 primary records. [2025-10-16T22:34:16.368297] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-16T22:34:16.397995] [DEBUG] [LOCAL ] ATS: Loaded 17690 existing records from primary storage. [2025-10-16T22:34:16.398727] [INFO ] [MAIN ] ATS: Loaded 17690 primary data records. [2025-10-16T22:34:16.395442] [DEBUG] [LOCAL ] ATO: Derivative data saved (1807 records). [2025-10-16T22:34:16.406626] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-10-16T22:34:16.439510] [INFO ] [MAIN ] Derivative Progress: 143/1803 symbols completed. ATO took 1.2s. Estimated remaining: 10m 46s. Rate: 154.1 symbols/min [2025-10-16T22:34:16.426734] [DEBUG] [LOCAL ] ATR: Derivative data saved (1807 records). [2025-10-16T22:34:16.439792] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:16.445149] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-10-16T22:34:16.475368] [INFO ] [MAIN ] Derivative Progress: 144/1803 symbols completed. ATR took 1.2s. Estimated remaining: 10m 42s. Rate: 155.1 symbols/min [2025-10-16T22:34:16.487035] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:16.748914] [DEBUG] [LOCAL ] ATUS: Loaded 50229 existing records from primary storage. [2025-10-16T22:34:16.760312] [INFO ] [MAIN ] ATUS: Loaded 50229 primary data records. [2025-10-16T22:34:16.805878] [DEBUG] [LOCAL ] AUB: Loaded 46391 existing records from primary storage. [2025-10-16T22:34:16.826790] [INFO ] [MAIN ] AUB: Loaded 46391 primary data records. [2025-10-16T22:34:16.940463] [DEBUG] [MAIN ] ATS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:16.953862] [INFO ] [MAIN ] ATS: Generated 1807 derivative records from 17690 primary records. [2025-10-16T22:34:16.974759] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-16T22:34:17.453046] [DEBUG] [LOCAL ] ATS: Derivative data saved (1807 records). [2025-10-16T22:34:17.453982] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-10-16T22:34:17.457326] [INFO ] [MAIN ] Derivative Progress: 145/1803 symbols completed. ATS took 1.1s. Estimated remaining: 10m 48s. Rate: 153.4 symbols/min [2025-10-16T22:34:17.459021] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:17.469924] [DEBUG] [LOCAL ] AUNA: Loaded 5158 existing records from primary storage. [2025-10-16T22:34:17.471350] [INFO ] [MAIN ] AUNA: Loaded 5158 primary data records. [2025-10-16T22:34:17.783356] [DEBUG] [MAIN ] ATUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:17.805044] [DEBUG] [MAIN ] AUB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:17.805966] [INFO ] [MAIN ] ATUS: Generated 1807 derivative records from 50229 primary records. [2025-10-16T22:34:17.806768] [INFO ] [MAIN ] AUB: Generated 1807 derivative records from 46391 primary records. [2025-10-16T22:34:17.807350] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-16T22:34:17.808338] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-16T22:34:17.838755] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1807 records). [2025-10-16T22:34:17.839421] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-16T22:34:17.844370] [INFO ] [MAIN ] Derivative Progress: 146/1803 symbols completed. ATUS took 1.4s. Estimated remaining: 10m 48s. Rate: 153.5 symbols/min [2025-10-16T22:34:17.845261] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:17.845741] [DEBUG] [LOCAL ] AUB: Derivative data saved (1807 records). [2025-10-16T22:34:17.846469] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-16T22:34:17.849566] [INFO ] [MAIN ] Derivative Progress: 147/1803 symbols completed. AUB took 1.4s. Estimated remaining: 10m 43s. Rate: 154.5 symbols/min [2025-10-16T22:34:17.849972] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:17.874810] [DEBUG] [LOCAL ] AVAL: Loaded 8650 existing records from primary storage. [2025-10-16T22:34:17.875015] [INFO ] [MAIN ] AVAL: Loaded 8650 primary data records. [2025-10-16T22:34:17.874550] [DEBUG] [MAIN ] AUNA: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:34:17.906730] [INFO ] [MAIN ] AUNA: Generated 1806 derivative records from 5158 primary records. [2025-10-16T22:34:17.930478] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-16T22:34:18.071331] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1806 records). [2025-10-16T22:34:18.094481] [DEBUG] [LOCAL ] AVA: Loaded 39001 existing records from primary storage. [2025-10-16T22:34:18.212761] [INFO ] [MAIN ] AVA: Loaded 39001 primary data records. [2025-10-16T22:34:18.201513] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-16T22:34:18.221716] [INFO ] [MAIN ] Derivative Progress: 148/1803 symbols completed. AUNA took 0.8s. Estimated remaining: 10m 43s. Rate: 154.5 symbols/min [2025-10-16T22:34:18.530160] [DEBUG] [MAIN ] AVAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:18.531204] [INFO ] [MAIN ] AVAL: Generated 1807 derivative records from 8650 primary records. [2025-10-16T22:34:18.531350] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-10-16T22:34:18.548142] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1807 records). [2025-10-16T22:34:18.548348] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-10-16T22:34:18.550517] [INFO ] [MAIN ] Derivative Progress: 149/1803 symbols completed. AVAL took 0.7s. Estimated remaining: 10m 42s. Rate: 154.7 symbols/min [2025-10-16T22:34:18.567144] [DEBUG] [MAIN ] AVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:18.567717] [INFO ] [MAIN ] AVA: Generated 1807 derivative records from 39001 primary records. [2025-10-16T22:34:18.567779] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-16T22:34:18.582841] [DEBUG] [LOCAL ] AVA: Derivative data saved (1807 records). [2025-10-16T22:34:18.582900] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-16T22:34:18.585368] [INFO ] [MAIN ] Derivative Progress: 150/1803 symbols completed. AVA took 0.7s. Estimated remaining: 10m 37s. Rate: 155.6 symbols/min [2025-10-16T22:34:18.586334] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:18.586408] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:18.586205] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:18.623577] [DEBUG] [LOCAL ] AVK: Loaded 18751 existing records from primary storage. [2025-10-16T22:34:18.623756] [INFO ] [MAIN ] AVK: Loaded 18751 primary data records. [2025-10-16T22:34:18.747537] [DEBUG] [LOCAL ] AVNS: Loaded 33913 existing records from primary storage. [2025-10-16T22:34:18.753904] [INFO ] [MAIN ] AVNS: Loaded 33913 primary data records. [2025-10-16T22:34:18.823897] [DEBUG] [LOCAL ] AVB: Loaded 42587 existing records from primary storage. [2025-10-16T22:34:18.883778] [INFO ] [MAIN ] AVB: Loaded 42587 primary data records. [2025-10-16T22:34:19.731186] [DEBUG] [MAIN ] AVK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:19.733048] [INFO ] [MAIN ] AVK: Generated 1807 derivative records from 18751 primary records. [2025-10-16T22:34:19.733294] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-16T22:34:19.753845] [DEBUG] [LOCAL ] AVK: Derivative data saved (1807 records). [2025-10-16T22:34:19.753951] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-16T22:34:19.756619] [INFO ] [MAIN ] Derivative Progress: 151/1803 symbols completed. AVK took 1.2s. Estimated remaining: 10m 45s. Rate: 153.6 symbols/min [2025-10-16T22:34:19.757286] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:19.772798] [DEBUG] [MAIN ] AVNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:19.774614] [INFO ] [MAIN ] AVNS: Generated 1807 derivative records from 33913 primary records. [2025-10-16T22:34:19.775162] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-16T22:34:19.799297] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1807 records). [2025-10-16T22:34:19.800942] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-16T22:34:19.805593] [INFO ] [MAIN ] Derivative Progress: 152/1803 symbols completed. AVNS took 1.2s. Estimated remaining: 10m 41s. Rate: 154.5 symbols/min [2025-10-16T22:34:19.806760] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:19.821514] [DEBUG] [MAIN ] AVB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:19.822521] [INFO ] [MAIN ] AVB: Generated 1807 derivative records from 42587 primary records. [2025-10-16T22:34:19.822893] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-16T22:34:19.862068] [DEBUG] [LOCAL ] AVB: Derivative data saved (1807 records). [2025-10-16T22:34:19.863927] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-16T22:34:19.866728] [INFO ] [MAIN ] Derivative Progress: 153/1803 symbols completed. AVB took 1.3s. Estimated remaining: 10m 37s. Rate: 155.3 symbols/min [2025-10-16T22:34:19.866931] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:19.868269] [DEBUG] [LOCAL ] AVNT: Loaded 39339 existing records from primary storage. [2025-10-16T22:34:19.868788] [INFO ] [MAIN ] AVNT: Loaded 39339 primary data records. [2025-10-16T22:34:20.092999] [DEBUG] [LOCAL ] AWF: Loaded 24143 existing records from primary storage. [2025-10-16T22:34:20.095012] [DEBUG] [LOCAL ] AVTR: Loaded 53962 existing records from primary storage. [2025-10-16T22:34:20.214361] [INFO ] [MAIN ] AVTR: Loaded 53962 primary data records. [2025-10-16T22:34:20.227763] [INFO ] [MAIN ] AWF: Loaded 24143 primary data records. [2025-10-16T22:34:20.933443] [DEBUG] [MAIN ] AVNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:20.934824] [INFO ] [MAIN ] AVNT: Generated 1807 derivative records from 39339 primary records. [2025-10-16T22:34:20.935446] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-16T22:34:20.957350] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1807 records). [2025-10-16T22:34:20.958791] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-10-16T22:34:20.961161] [INFO ] [MAIN ] Derivative Progress: 154/1803 symbols completed. AVNT took 1.2s. Estimated remaining: 10m 45s. Rate: 153.5 symbols/min [2025-10-16T22:34:20.961354] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:20.976090] [DEBUG] [MAIN ] AWF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:20.976982] [INFO ] [MAIN ] AWF: Generated 1807 derivative records from 24143 primary records. [2025-10-16T22:34:20.977149] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-16T22:34:21.017197] [DEBUG] [MAIN ] AVTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:21.019320] [INFO ] [MAIN ] AVTR: Generated 1807 derivative records from 53962 primary records. [2025-10-16T22:34:21.019427] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-16T22:34:21.018475] [DEBUG] [LOCAL ] AWF: Derivative data saved (1807 records). [2025-10-16T22:34:21.020074] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-16T22:34:21.022593] [INFO ] [MAIN ] Derivative Progress: 155/1803 symbols completed. AWF took 1.2s. Estimated remaining: 10m 41s. Rate: 154.3 symbols/min [2025-10-16T22:34:21.031025] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:21.033682] [DEBUG] [LOCAL ] AWI: Loaded 25598 existing records from primary storage. [2025-10-16T22:34:21.044891] [INFO ] [MAIN ] AWI: Loaded 25598 primary data records. [2025-10-16T22:34:21.139509] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1807 records). [2025-10-16T22:34:21.153180] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-10-16T22:34:21.158968] [INFO ] [MAIN ] Derivative Progress: 156/1803 symbols completed. AVTR took 1.4s. Estimated remaining: 10m 38s. Rate: 155.0 symbols/min [2025-10-16T22:34:21.159198] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:21.380843] [DEBUG] [LOCAL ] AWP: Loaded 21759 existing records from primary storage. [2025-10-16T22:34:21.381258] [INFO ] [MAIN ] AWP: Loaded 21759 primary data records. [2025-10-16T22:34:21.463769] [DEBUG] [LOCAL ] AWK: Loaded 48909 existing records from primary storage. [2025-10-16T22:34:21.476266] [INFO ] [MAIN ] AWK: Loaded 48909 primary data records. [2025-10-16T22:34:22.028526] [DEBUG] [MAIN ] AWI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:22.030970] [INFO ] [MAIN ] AWI: Generated 1807 derivative records from 25598 primary records. [2025-10-16T22:34:22.031498] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-16T22:34:22.056032] [DEBUG] [LOCAL ] AWI: Derivative data saved (1807 records). [2025-10-16T22:34:22.056837] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-16T22:34:22.061044] [INFO ] [MAIN ] Derivative Progress: 157/1803 symbols completed. AWI took 1.1s. Estimated remaining: 10m 43s. Rate: 153.7 symbols/min [2025-10-16T22:34:22.061372] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:22.076205] [DEBUG] [MAIN ] AWP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:22.077515] [INFO ] [MAIN ] AWP: Generated 1807 derivative records from 21759 primary records. [2025-10-16T22:34:22.079767] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-16T22:34:22.108479] [DEBUG] [MAIN ] AWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:22.117186] [DEBUG] [LOCAL ] AWP: Derivative data saved (1807 records). [2025-10-16T22:34:22.118211] [INFO ] [MAIN ] AWK: Generated 1807 derivative records from 48909 primary records. [2025-10-16T22:34:22.118531] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-16T22:34:22.118636] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-16T22:34:22.122193] [INFO ] [MAIN ] Derivative Progress: 158/1803 symbols completed. AWP took 1.0s. Estimated remaining: 10m 39s. Rate: 154.5 symbols/min [2025-10-16T22:34:22.122667] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:22.146911] [DEBUG] [LOCAL ] AWR: Loaded 23000 existing records from primary storage. [2025-10-16T22:34:22.148389] [INFO ] [MAIN ] AWR: Loaded 23000 primary data records. [2025-10-16T22:34:22.151454] [DEBUG] [LOCAL ] AWK: Derivative data saved (1807 records). [2025-10-16T22:34:22.156772] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-16T22:34:22.175579] [INFO ] [MAIN ] Derivative Progress: 159/1803 symbols completed. AWK took 1.1s. Estimated remaining: 10m 35s. Rate: 155.3 symbols/min [2025-10-16T22:34:22.213286] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:22.462136] [DEBUG] [LOCAL ] AX: Loaded 28285 existing records from primary storage. [2025-10-16T22:34:22.462442] [INFO ] [MAIN ] AX: Loaded 28285 primary data records. [2025-10-16T22:34:22.828848] [DEBUG] [LOCAL ] AXL: Loaded 50921 existing records from primary storage. [2025-10-16T22:34:22.829549] [INFO ] [MAIN ] AXL: Loaded 50921 primary data records. [2025-10-16T22:34:23.184800] [DEBUG] [MAIN ] AWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:23.199696] [INFO ] [MAIN ] AWR: Generated 1807 derivative records from 23000 primary records. [2025-10-16T22:34:23.200000] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-16T22:34:23.219604] [DEBUG] [LOCAL ] AWR: Derivative data saved (1807 records). [2025-10-16T22:34:23.219955] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-16T22:34:23.222847] [INFO ] [MAIN ] Derivative Progress: 160/1803 symbols completed. AWR took 1.2s. Estimated remaining: 10m 41s. Rate: 153.7 symbols/min [2025-10-16T22:34:23.224992] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:23.242866] [DEBUG] [MAIN ] AX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:23.243942] [INFO ] [MAIN ] AX: Generated 1807 derivative records from 28285 primary records. [2025-10-16T22:34:23.244045] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-16T22:34:23.260827] [DEBUG] [LOCAL ] AX: Derivative data saved (1807 records). [2025-10-16T22:34:23.261014] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-16T22:34:23.264929] [INFO ] [MAIN ] Derivative Progress: 161/1803 symbols completed. AX took 1.1s. Estimated remaining: 10m 37s. Rate: 154.5 symbols/min [2025-10-16T22:34:23.265519] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:23.283354] [DEBUG] [MAIN ] AXL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:23.284332] [INFO ] [MAIN ] AXL: Generated 1807 derivative records from 50921 primary records. [2025-10-16T22:34:23.284400] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-16T22:34:23.301713] [DEBUG] [LOCAL ] AXL: Derivative data saved (1807 records). [2025-10-16T22:34:23.302076] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-16T22:34:23.304906] [INFO ] [MAIN ] Derivative Progress: 162/1803 symbols completed. AXL took 1.1s. Estimated remaining: 10m 34s. Rate: 155.4 symbols/min [2025-10-16T22:34:23.318471] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:23.343185] [DEBUG] [LOCAL ] AXS: Loaded 38896 existing records from primary storage. [2025-10-16T22:34:23.357599] [INFO ] [MAIN ] AXS: Loaded 38896 primary data records. [2025-10-16T22:34:23.380343] [DEBUG] [LOCAL ] AXP: Loaded 53555 existing records from primary storage. [2025-10-16T22:34:23.403538] [INFO ] [MAIN ] AXP: Loaded 53555 primary data records. [2025-10-16T22:34:23.817464] [DEBUG] [LOCAL ] AXTA: Loaded 52641 existing records from primary storage. [2025-10-16T22:34:23.846348] [INFO ] [MAIN ] AXTA: Loaded 52641 primary data records. [2025-10-16T22:34:24.331680] [DEBUG] [MAIN ] AXS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:24.333686] [INFO ] [MAIN ] AXS: Generated 1807 derivative records from 38896 primary records. [2025-10-16T22:34:24.334227] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-16T22:34:24.370973] [DEBUG] [LOCAL ] AXS: Derivative data saved (1807 records). [2025-10-16T22:34:24.371561] [DEBUG] [MAIN ] AXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:24.372767] [INFO ] [MAIN ] AXP: Generated 1807 derivative records from 53555 primary records. [2025-10-16T22:34:24.371677] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-10-16T22:34:24.374706] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-16T22:34:24.377319] [INFO ] [MAIN ] Derivative Progress: 163/1803 symbols completed. AXS took 1.1s. Estimated remaining: 10m 40s. Rate: 153.7 symbols/min [2025-10-16T22:34:24.396577] [DEBUG] [LOCAL ] AXP: Derivative data saved (1807 records). [2025-10-16T22:34:24.396951] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-16T22:34:24.400036] [INFO ] [MAIN ] Derivative Progress: 164/1803 symbols completed. AXP took 1.2s. Estimated remaining: 10m 36s. Rate: 154.6 symbols/min [2025-10-16T22:34:24.416620] [DEBUG] [MAIN ] AXTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:24.417423] [INFO ] [MAIN ] AXTA: Generated 1807 derivative records from 52641 primary records. [2025-10-16T22:34:24.417489] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-16T22:34:24.433544] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1807 records). [2025-10-16T22:34:24.433700] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-16T22:34:24.437378] [INFO ] [MAIN ] Derivative Progress: 165/1803 symbols completed. AXTA took 1.1s. Estimated remaining: 10m 32s. Rate: 155.5 symbols/min [2025-10-16T22:34:24.438064] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:24.438266] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:24.438369] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:24.466144] [DEBUG] [LOCAL ] AZO: Loaded 11071 existing records from primary storage. [2025-10-16T22:34:24.466311] [INFO ] [MAIN ] AZO: Loaded 11071 primary data records. [2025-10-16T22:34:24.552331] [DEBUG] [LOCAL ] AYI: Loaded 25059 existing records from primary storage. [2025-10-16T22:34:24.558362] [DEBUG] [LOCAL ] AZZ: Loaded 22902 existing records from primary storage. [2025-10-16T22:34:24.592424] [INFO ] [MAIN ] AZZ: Loaded 22902 primary data records. [2025-10-16T22:34:24.592633] [INFO ] [MAIN ] AYI: Loaded 25059 primary data records. [2025-10-16T22:34:25.546821] [DEBUG] [MAIN ] AZO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:25.549127] [INFO ] [MAIN ] AZO: Generated 1807 derivative records from 11071 primary records. [2025-10-16T22:34:25.549360] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-16T22:34:25.566764] [DEBUG] [LOCAL ] AZO: Derivative data saved (1807 records). [2025-10-16T22:34:25.567101] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-16T22:34:25.569788] [INFO ] [MAIN ] Derivative Progress: 166/1803 symbols completed. AZO took 1.1s. Estimated remaining: 10m 39s. Rate: 153.7 symbols/min [2025-10-16T22:34:25.570000] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:25.588990] [DEBUG] [MAIN ] AZZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:25.590878] [INFO ] [MAIN ] AZZ: Generated 1807 derivative records from 22902 primary records. [2025-10-16T22:34:25.591015] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-16T22:34:25.616912] [DEBUG] [MAIN ] AYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:25.618300] [INFO ] [MAIN ] AYI: Generated 1807 derivative records from 25059 primary records. [2025-10-16T22:34:25.618919] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-10-16T22:34:25.636232] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1807 records). [2025-10-16T22:34:25.637516] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-16T22:34:25.654660] [INFO ] [MAIN ] Derivative Progress: 167/1803 symbols completed. AZZ took 1.2s. Estimated remaining: 10m 36s. Rate: 154.4 symbols/min [2025-10-16T22:34:25.654866] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:25.657265] [DEBUG] [LOCAL ] AYI: Derivative data saved (1807 records). [2025-10-16T22:34:25.657386] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-10-16T22:34:25.660007] [INFO ] [MAIN ] Derivative Progress: 168/1803 symbols completed. AYI took 1.2s. Estimated remaining: 10m 32s. Rate: 155.3 symbols/min [2025-10-16T22:34:25.660264] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:25.681252] [DEBUG] [LOCAL ] BA: Loaded 54180 existing records from primary storage. [2025-10-16T22:34:25.681680] [INFO ] [MAIN ] BA: Loaded 54180 primary data records. [2025-10-16T22:34:26.066702] [DEBUG] [LOCAL ] BAC: Loaded 54198 existing records from primary storage. [2025-10-16T22:34:26.068303] [DEBUG] [LOCAL ] BABA: Loaded 54210 existing records from primary storage. [2025-10-16T22:34:26.068613] [INFO ] [MAIN ] BABA: Loaded 54210 primary data records. [2025-10-16T22:34:26.068435] [INFO ] [MAIN ] BAC: Loaded 54198 primary data records. [2025-10-16T22:34:26.694443] [DEBUG] [MAIN ] BA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:26.697127] [INFO ] [MAIN ] BA: Generated 1807 derivative records from 54180 primary records. [2025-10-16T22:34:26.699172] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-16T22:34:26.719482] [DEBUG] [LOCAL ] BA: Derivative data saved (1807 records). [2025-10-16T22:34:26.719728] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-16T22:34:26.722391] [INFO ] [MAIN ] Derivative Progress: 169/1803 symbols completed. BA took 1.2s. Estimated remaining: 10m 38s. Rate: 153.7 symbols/min [2025-10-16T22:34:26.722692] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:26.755299] [DEBUG] [MAIN ] BAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:26.755469] [DEBUG] [MAIN ] BABA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:26.756943] [INFO ] [MAIN ] BAC: Generated 1807 derivative records from 54198 primary records. [2025-10-16T22:34:26.756351] [INFO ] [MAIN ] BABA: Generated 1807 derivative records from 54210 primary records. [2025-10-16T22:34:26.757146] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-16T22:34:26.757200] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-16T22:34:26.787095] [DEBUG] [LOCAL ] BABA: Derivative data saved (1807 records). [2025-10-16T22:34:26.787284] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-16T22:34:26.790551] [INFO ] [MAIN ] Derivative Progress: 170/1803 symbols completed. BABA took 1.1s. Estimated remaining: 10m 34s. Rate: 154.5 symbols/min [2025-10-16T22:34:26.790950] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:26.795439] [DEBUG] [LOCAL ] BAC: Derivative data saved (1807 records). [2025-10-16T22:34:26.795686] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-10-16T22:34:26.797811] [INFO ] [MAIN ] Derivative Progress: 171/1803 symbols completed. BAC took 1.1s. Estimated remaining: 10m 30s. Rate: 155.4 symbols/min [2025-10-16T22:34:26.798045] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:26.862450] [DEBUG] [LOCAL ] BAH: Loaded 52097 existing records from primary storage. [2025-10-16T22:34:26.872301] [INFO ] [MAIN ] BAH: Loaded 52097 primary data records. [2025-10-16T22:34:27.006987] [DEBUG] [LOCAL ] BAK: Loaded 39589 existing records from primary storage. [2025-10-16T22:34:27.026781] [INFO ] [MAIN ] BAK: Loaded 39589 primary data records. [2025-10-16T22:34:27.066339] [DEBUG] [LOCAL ] BALL: Loaded 52278 existing records from primary storage. [2025-10-16T22:34:27.101718] [INFO ] [MAIN ] BALL: Loaded 52278 primary data records. [2025-10-16T22:34:27.935558] [DEBUG] [MAIN ] BAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:27.939533] [INFO ] [MAIN ] BAH: Generated 1807 derivative records from 52097 primary records. [2025-10-16T22:34:27.939975] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-10-16T22:34:27.967075] [DEBUG] [MAIN ] BAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:27.972516] [DEBUG] [LOCAL ] BAH: Derivative data saved (1807 records). [2025-10-16T22:34:27.969940] [INFO ] [MAIN ] BAK: Generated 1807 derivative records from 39589 primary records. [2025-10-16T22:34:27.972850] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-16T22:34:27.973148] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-10-16T22:34:27.976508] [INFO ] [MAIN ] Derivative Progress: 172/1803 symbols completed. BAH took 1.3s. Estimated remaining: 10m 37s. Rate: 153.5 symbols/min [2025-10-16T22:34:27.988891] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:27.994271] [DEBUG] [LOCAL ] BAK: Derivative data saved (1807 records). [2025-10-16T22:34:27.994442] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-16T22:34:27.998955] [INFO ] [MAIN ] Derivative Progress: 173/1803 symbols completed. BAK took 1.2s. Estimated remaining: 10m 34s. Rate: 154.4 symbols/min [2025-10-16T22:34:27.999583] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:28.013967] [DEBUG] [MAIN ] BALL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:28.014745] [INFO ] [MAIN ] BALL: Generated 1807 derivative records from 52278 primary records. [2025-10-16T22:34:28.015020] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-16T22:34:28.032051] [DEBUG] [LOCAL ] BALL: Derivative data saved (1807 records). [2025-10-16T22:34:28.032737] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-16T22:34:28.035408] [INFO ] [MAIN ] Derivative Progress: 174/1803 symbols completed. BALL took 1.2s. Estimated remaining: 10m 30s. Rate: 155.2 symbols/min [2025-10-16T22:34:28.035929] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:28.102170] [DEBUG] [LOCAL ] BAM: Loaded 52489 existing records from primary storage. [2025-10-16T22:34:28.102535] [DEBUG] [LOCAL ] BAP: Loaded 25985 existing records from primary storage. [2025-10-16T22:34:28.102813] [INFO ] [MAIN ] BAP: Loaded 25985 primary data records. [2025-10-16T22:34:28.102896] [INFO ] [MAIN ] BAM: Loaded 52489 primary data records. [2025-10-16T22:34:28.330805] [DEBUG] [LOCAL ] BANC: Loaded 51734 existing records from primary storage. [2025-10-16T22:34:28.377839] [INFO ] [MAIN ] BANC: Loaded 51734 primary data records. [2025-10-16T22:34:29.120128] [DEBUG] [MAIN ] BAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:29.121790] [INFO ] [MAIN ] BAP: Generated 1807 derivative records from 25985 primary records. [2025-10-16T22:34:29.134588] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-16T22:34:29.135639] [DEBUG] [MAIN ] BAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:29.137375] [INFO ] [MAIN ] BAM: Generated 1807 derivative records from 52489 primary records. [2025-10-16T22:34:29.146726] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-16T22:34:29.168298] [DEBUG] [LOCAL ] BAP: Derivative data saved (1807 records). [2025-10-16T22:34:29.170284] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-16T22:34:29.172863] [INFO ] [MAIN ] Derivative Progress: 175/1803 symbols completed. BAP took 1.1s. Estimated remaining: 10m 36s. Rate: 153.5 symbols/min [2025-10-16T22:34:29.173976] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:29.178577] [DEBUG] [LOCAL ] BAM: Derivative data saved (1807 records). [2025-10-16T22:34:29.192395] [DEBUG] [MAIN ] BANC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:29.191984] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-16T22:34:29.193150] [INFO ] [MAIN ] BANC: Generated 1807 derivative records from 51734 primary records. [2025-10-16T22:34:29.195951] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-16T22:34:29.195827] [INFO ] [MAIN ] Derivative Progress: 176/1803 symbols completed. BAM took 1.2s. Estimated remaining: 10m 33s. Rate: 154.3 symbols/min [2025-10-16T22:34:29.196563] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:29.213760] [DEBUG] [LOCAL ] BANC: Derivative data saved (1807 records). [2025-10-16T22:34:29.213935] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-16T22:34:29.217062] [INFO ] [MAIN ] Derivative Progress: 177/1803 symbols completed. BANC took 1.2s. Estimated remaining: 10m 29s. Rate: 155.1 symbols/min [2025-10-16T22:34:29.217426] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:29.254516] [DEBUG] [LOCAL ] BARK: Loaded 38444 existing records from primary storage. [2025-10-16T22:34:29.254703] [INFO ] [MAIN ] BARK: Loaded 38444 primary data records. [2025-10-16T22:34:29.497468] [DEBUG] [LOCAL ] BB: Loaded 53298 existing records from primary storage. [2025-10-16T22:34:29.614610] [INFO ] [MAIN ] BB: Loaded 53298 primary data records. [2025-10-16T22:34:29.616802] [DEBUG] [LOCAL ] BAX: Loaded 53919 existing records from primary storage. [2025-10-16T22:34:29.629182] [INFO ] [MAIN ] BAX: Loaded 53919 primary data records. [2025-10-16T22:34:30.261162] [DEBUG] [MAIN ] BARK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:30.263422] [INFO ] [MAIN ] BARK: Generated 1807 derivative records from 38444 primary records. [2025-10-16T22:34:30.263725] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-16T22:34:30.285468] [DEBUG] [LOCAL ] BARK: Derivative data saved (1807 records). [2025-10-16T22:34:30.286735] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-16T22:34:30.289560] [INFO ] [MAIN ] Derivative Progress: 178/1803 symbols completed. BARK took 1.1s. Estimated remaining: 10m 35s. Rate: 153.6 symbols/min [2025-10-16T22:34:30.305568] [DEBUG] [MAIN ] BAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:30.306454] [INFO ] [MAIN ] BAX: Generated 1807 derivative records from 53919 primary records. [2025-10-16T22:34:30.306733] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-16T22:34:30.320225] [DEBUG] [MAIN ] BB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:30.329854] [INFO ] [MAIN ] BB: Generated 1807 derivative records from 53298 primary records. [2025-10-16T22:34:30.329943] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-16T22:34:30.351667] [DEBUG] [LOCAL ] BB: Derivative data saved (1807 records). [2025-10-16T22:34:30.353002] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-16T22:34:30.355965] [INFO ] [MAIN ] Derivative Progress: 179/1803 symbols completed. BB took 1.1s. Estimated remaining: 10m 31s. Rate: 154.3 symbols/min [2025-10-16T22:34:30.353464] [DEBUG] [LOCAL ] BAX: Derivative data saved (1807 records). [2025-10-16T22:34:30.356268] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-16T22:34:30.359130] [INFO ] [MAIN ] Derivative Progress: 180/1803 symbols completed. BAX took 1.2s. Estimated remaining: 10m 28s. Rate: 155.2 symbols/min [2025-10-16T22:34:30.359934] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:30.359597] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:30.359782] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:30.468118] [DEBUG] [LOCAL ] BBAI: Loaded 54210 existing records from primary storage. [2025-10-16T22:34:30.466630] [DEBUG] [LOCAL ] BBD: Loaded 53650 existing records from primary storage. [2025-10-16T22:34:30.467383] [DEBUG] [LOCAL ] BBAR: Loaded 42696 existing records from primary storage. [2025-10-16T22:34:30.468416] [INFO ] [MAIN ] BBD: Loaded 53650 primary data records. [2025-10-16T22:34:30.468755] [INFO ] [MAIN ] BBAI: Loaded 54210 primary data records. [2025-10-16T22:34:30.468667] [INFO ] [MAIN ] BBAR: Loaded 42696 primary data records. [2025-10-16T22:34:31.521457] [DEBUG] [MAIN ] BBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:31.523027] [DEBUG] [MAIN ] BBAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:31.522261] [INFO ] [MAIN ] BBD: Generated 1807 derivative records from 53650 primary records. [2025-10-16T22:34:31.523764] [DEBUG] [MAIN ] BBAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:31.523920] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-16T22:34:31.532855] [INFO ] [MAIN ] BBAR: Generated 1807 derivative records from 42696 primary records. [2025-10-16T22:34:31.535032] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-16T22:34:31.535135] [INFO ] [MAIN ] BBAI: Generated 1807 derivative records from 54210 primary records. [2025-10-16T22:34:31.539690] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-16T22:34:31.569701] [DEBUG] [LOCAL ] BBD: Derivative data saved (1807 records). [2025-10-16T22:34:31.570095] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-10-16T22:34:31.572954] [INFO ] [MAIN ] Derivative Progress: 181/1803 symbols completed. BBD took 1.2s. Estimated remaining: 10m 35s. Rate: 153.4 symbols/min [2025-10-16T22:34:31.577568] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1807 records). [2025-10-16T22:34:31.577833] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:31.578765] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1807 records). [2025-10-16T22:34:31.577735] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-16T22:34:31.580799] [INFO ] [MAIN ] Derivative Progress: 182/1803 symbols completed. BBAI took 1.2s. Estimated remaining: 10m 31s. Rate: 154.2 symbols/min [2025-10-16T22:34:31.580924] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-16T22:34:31.583999] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:31.584295] [INFO ] [MAIN ] Derivative Progress: 183/1803 symbols completed. BBAR took 1.2s. Estimated remaining: 10m 27s. Rate: 155.0 symbols/min [2025-10-16T22:34:31.584543] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:31.590137] [DEBUG] [LOCAL ] BBDO: Loaded 5066 existing records from primary storage. [2025-10-16T22:34:31.590412] [INFO ] [MAIN ] BBDO: Loaded 5066 primary data records. [2025-10-16T22:34:31.719146] [DEBUG] [LOCAL ] BBN: Loaded 18148 existing records from primary storage. [2025-10-16T22:34:31.730062] [INFO ] [MAIN ] BBN: Loaded 18148 primary data records. [2025-10-16T22:34:31.724723] [DEBUG] [LOCAL ] BBUC: Loaded 13949 existing records from primary storage. [2025-10-16T22:34:31.754160] [INFO ] [MAIN ] BBUC: Loaded 13949 primary data records. [2025-10-16T22:34:32.772024] [DEBUG] [MAIN ] BBDO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:32.773152] [INFO ] [MAIN ] BBDO: Generated 1807 derivative records from 5066 primary records. [2025-10-16T22:34:32.773373] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-10-16T22:34:32.809770] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1807 records). [2025-10-16T22:34:32.816611] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-10-16T22:34:32.840143] [INFO ] [MAIN ] Derivative Progress: 184/1803 symbols completed. BBDO took 1.3s. Estimated remaining: 10m 34s. Rate: 153.2 symbols/min [2025-10-16T22:34:32.850446] [DEBUG] [MAIN ] BBN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:32.851794] [DEBUG] [MAIN ] BBUC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:32.853374] [INFO ] [MAIN ] BBN: Generated 1807 derivative records from 18148 primary records. [2025-10-16T22:34:32.854466] [INFO ] [MAIN ] BBUC: Generated 1807 derivative records from 13949 primary records. [2025-10-16T22:34:32.848901] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:32.855397] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-10-16T22:34:32.855995] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-10-16T22:34:32.904636] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1807 records). [2025-10-16T22:34:32.906476] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-10-16T22:34:32.910413] [INFO ] [MAIN ] Derivative Progress: 185/1803 symbols completed. BBUC took 1.3s. Estimated remaining: 10m 31s. Rate: 153.8 symbols/min [2025-10-16T22:34:32.913335] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:32.915374] [DEBUG] [LOCAL ] BBN: Derivative data saved (1807 records). [2025-10-16T22:34:32.915551] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-10-16T22:34:32.919428] [INFO ] [MAIN ] Derivative Progress: 186/1803 symbols completed. BBN took 1.3s. Estimated remaining: 10m 27s. Rate: 154.7 symbols/min [2025-10-16T22:34:32.920016] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:32.979752] [DEBUG] [LOCAL ] BBW: Loaded 27636 existing records from primary storage. [2025-10-16T22:34:33.011409] [INFO ] [MAIN ] BBW: Loaded 27636 primary data records. [2025-10-16T22:34:33.013053] [DEBUG] [LOCAL ] BBVA: Loaded 49475 existing records from primary storage. [2025-10-16T22:34:33.013397] [INFO ] [MAIN ] BBVA: Loaded 49475 primary data records. [2025-10-16T22:34:33.276417] [DEBUG] [LOCAL ] BBWI: Loaded 53974 existing records from primary storage. [2025-10-16T22:34:33.287322] [INFO ] [MAIN ] BBWI: Loaded 53974 primary data records. [2025-10-16T22:34:34.048066] [DEBUG] [MAIN ] BBW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:34.050846] [INFO ] [MAIN ] BBW: Generated 1807 derivative records from 27636 primary records. [2025-10-16T22:34:34.051121] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-16T22:34:34.073217] [DEBUG] [MAIN ] BBVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:34.085516] [DEBUG] [MAIN ] BBWI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:34.086301] [INFO ] [MAIN ] BBVA: Generated 1807 derivative records from 49475 primary records. [2025-10-16T22:34:34.090257] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-16T22:34:34.095396] [DEBUG] [LOCAL ] BBW: Derivative data saved (1807 records). [2025-10-16T22:34:34.093378] [INFO ] [MAIN ] BBWI: Generated 1807 derivative records from 53974 primary records. [2025-10-16T22:34:34.095892] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-16T22:34:34.096006] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-16T22:34:34.098433] [INFO ] [MAIN ] Derivative Progress: 187/1803 symbols completed. BBW took 1.2s. Estimated remaining: 10m 34s. Rate: 153.0 symbols/min [2025-10-16T22:34:34.106257] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:34.127484] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1807 records). [2025-10-16T22:34:34.129123] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-16T22:34:34.131758] [INFO ] [MAIN ] Derivative Progress: 188/1803 symbols completed. BBVA took 1.3s. Estimated remaining: 10m 30s. Rate: 153.7 symbols/min [2025-10-16T22:34:34.132178] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:34.134187] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1807 records). [2025-10-16T22:34:34.134312] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-16T22:34:34.137226] [INFO ] [MAIN ] Derivative Progress: 189/1803 symbols completed. BBWI took 1.2s. Estimated remaining: 10m 27s. Rate: 154.5 symbols/min [2025-10-16T22:34:34.137469] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:34.185991] [DEBUG] [LOCAL ] BCC: Loaded 28737 existing records from primary storage. [2025-10-16T22:34:34.200553] [INFO ] [MAIN ] BCC: Loaded 28737 primary data records. [2025-10-16T22:34:34.253077] [DEBUG] [LOCAL ] BBY: Loaded 53831 existing records from primary storage. [2025-10-16T22:34:34.274580] [INFO ] [MAIN ] BBY: Loaded 53831 primary data records. [2025-10-16T22:34:34.325066] [DEBUG] [LOCAL ] BCAT: Loaded 34487 existing records from primary storage. [2025-10-16T22:34:34.345689] [INFO ] [MAIN ] BCAT: Loaded 34487 primary data records. [2025-10-16T22:34:35.156723] [DEBUG] [MAIN ] BCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:35.158320] [INFO ] [MAIN ] BCC: Generated 1807 derivative records from 28737 primary records. [2025-10-16T22:34:35.158520] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-16T22:34:35.176317] [DEBUG] [LOCAL ] BCC: Derivative data saved (1807 records). [2025-10-16T22:34:35.185476] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-10-16T22:34:35.193182] [DEBUG] [MAIN ] BBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:35.192858] [INFO ] [MAIN ] Derivative Progress: 190/1803 symbols completed. BCC took 1.1s. Estimated remaining: 10m 32s. Rate: 153.2 symbols/min [2025-10-16T22:34:35.194100] [INFO ] [MAIN ] BBY: Generated 1807 derivative records from 53831 primary records. [2025-10-16T22:34:35.194507] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-16T22:34:35.194317] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:35.208102] [DEBUG] [MAIN ] BCAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:35.216084] [INFO ] [MAIN ] BCAT: Generated 1807 derivative records from 34487 primary records. [2025-10-16T22:34:35.216270] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-16T22:34:35.232449] [DEBUG] [LOCAL ] BBY: Derivative data saved (1807 records). [2025-10-16T22:34:35.238864] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-16T22:34:35.240041] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1807 records). [2025-10-16T22:34:35.242553] [INFO ] [MAIN ] Derivative Progress: 191/1803 symbols completed. BBY took 1.1s. Estimated remaining: 10m 29s. Rate: 153.9 symbols/min [2025-10-16T22:34:35.242871] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:35.243232] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-16T22:34:35.246033] [INFO ] [MAIN ] Derivative Progress: 192/1803 symbols completed. BCAT took 1.1s. Estimated remaining: 10m 25s. Rate: 154.7 symbols/min [2025-10-16T22:34:35.246337] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:35.272563] [DEBUG] [LOCAL ] BCO: Loaded 25583 existing records from primary storage. [2025-10-16T22:34:35.272848] [INFO ] [MAIN ] BCO: Loaded 25583 primary data records. [2025-10-16T22:34:35.662275] [DEBUG] [LOCAL ] BCE: Loaded 52634 existing records from primary storage. [2025-10-16T22:34:35.677291] [INFO ] [MAIN ] BCE: Loaded 52634 primary data records. [2025-10-16T22:34:35.713610] [DEBUG] [LOCAL ] BCS: Loaded 53832 existing records from primary storage. [2025-10-16T22:34:35.747969] [INFO ] [MAIN ] BCS: Loaded 53832 primary data records. [2025-10-16T22:34:36.315274] [DEBUG] [MAIN ] BCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:36.316427] [INFO ] [MAIN ] BCO: Generated 1807 derivative records from 25583 primary records. [2025-10-16T22:34:36.318592] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-16T22:34:36.337182] [DEBUG] [LOCAL ] BCO: Derivative data saved (1807 records). [2025-10-16T22:34:36.338565] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-16T22:34:36.341229] [INFO ] [MAIN ] Derivative Progress: 193/1803 symbols completed. BCO took 1.1s. Estimated remaining: 10m 30s. Rate: 153.2 symbols/min [2025-10-16T22:34:36.360820] [DEBUG] [MAIN ] BCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:36.361614] [INFO ] [MAIN ] BCE: Generated 1807 derivative records from 52634 primary records. [2025-10-16T22:34:36.361815] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-16T22:34:36.393462] [DEBUG] [LOCAL ] BCE: Derivative data saved (1807 records). [2025-10-16T22:34:36.393976] [DEBUG] [MAIN ] BCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:36.394074] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-16T22:34:36.396241] [INFO ] [MAIN ] Derivative Progress: 194/1803 symbols completed. BCE took 1.2s. Estimated remaining: 10m 27s. Rate: 153.9 symbols/min [2025-10-16T22:34:36.397412] [INFO ] [MAIN ] BCS: Generated 1807 derivative records from 53832 primary records. [2025-10-16T22:34:36.397613] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-16T22:34:36.413412] [DEBUG] [LOCAL ] BCS: Derivative data saved (1807 records). [2025-10-16T22:34:36.413517] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-10-16T22:34:36.416790] [INFO ] [MAIN ] Derivative Progress: 195/1803 symbols completed. BCS took 1.2s. Estimated remaining: 10m 24s. Rate: 154.6 symbols/min [2025-10-16T22:34:36.417323] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:36.417827] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:36.417866] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:36.456128] [DEBUG] [LOCAL ] BDC: Loaded 24680 existing records from primary storage. [2025-10-16T22:34:36.456322] [INFO ] [MAIN ] BDC: Loaded 24680 primary data records. [2025-10-16T22:34:36.554009] [DEBUG] [LOCAL ] BDJ: Loaded 29694 existing records from primary storage. [2025-10-16T22:34:36.564862] [DEBUG] [LOCAL ] BCSF: Loaded 28381 existing records from primary storage. [2025-10-16T22:34:36.575313] [INFO ] [MAIN ] BDJ: Loaded 29694 primary data records. [2025-10-16T22:34:36.591666] [INFO ] [MAIN ] BCSF: Loaded 28381 primary data records. [2025-10-16T22:34:37.473525] [DEBUG] [MAIN ] BDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:37.486970] [INFO ] [MAIN ] BDC: Generated 1807 derivative records from 24680 primary records. [2025-10-16T22:34:37.488046] [DEBUG] [MAIN ] BCSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:37.489299] [INFO ] [MAIN ] BCSF: Generated 1807 derivative records from 28381 primary records. [2025-10-16T22:34:37.488466] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-16T22:34:37.490161] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-16T22:34:37.518526] [DEBUG] [LOCAL ] BDC: Derivative data saved (1807 records). [2025-10-16T22:34:37.521862] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-16T22:34:37.534072] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1807 records). [2025-10-16T22:34:37.541377] [INFO ] [MAIN ] Derivative Progress: 196/1803 symbols completed. BDC took 1.1s. Estimated remaining: 10m 30s. Rate: 153.2 symbols/min [2025-10-16T22:34:37.541727] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-16T22:34:37.542183] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:37.544972] [INFO ] [MAIN ] Derivative Progress: 197/1803 symbols completed. BCSF took 1.1s. Estimated remaining: 10m 26s. Rate: 153.9 symbols/min [2025-10-16T22:34:37.545203] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:37.542065] [DEBUG] [MAIN ] BDJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:37.546682] [INFO ] [MAIN ] BDJ: Generated 1807 derivative records from 29694 primary records. [2025-10-16T22:34:37.546750] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-16T22:34:37.577997] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1807 records). [2025-10-16T22:34:37.587939] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-16T22:34:37.590751] [INFO ] [MAIN ] Derivative Progress: 198/1803 symbols completed. BDJ took 1.2s. Estimated remaining: 10m 23s. Rate: 154.6 symbols/min [2025-10-16T22:34:37.591079] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:37.621480] [DEBUG] [LOCAL ] BDN: Loaded 48013 existing records from primary storage. [2025-10-16T22:34:37.621804] [INFO ] [MAIN ] BDN: Loaded 48013 primary data records. [2025-10-16T22:34:37.740384] [DEBUG] [LOCAL ] BDX: Loaded 52564 existing records from primary storage. [2025-10-16T22:34:37.756407] [INFO ] [MAIN ] BDX: Loaded 52564 primary data records. [2025-10-16T22:34:38.141198] [DEBUG] [LOCAL ] BE: Loaded 54051 existing records from primary storage. [2025-10-16T22:34:38.143555] [INFO ] [MAIN ] BE: Loaded 54051 primary data records. [2025-10-16T22:34:38.615157] [DEBUG] [MAIN ] BDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:38.616940] [INFO ] [MAIN ] BDN: Generated 1807 derivative records from 48013 primary records. [2025-10-16T22:34:38.617709] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-10-16T22:34:38.640154] [DEBUG] [LOCAL ] BDN: Derivative data saved (1807 records). [2025-10-16T22:34:38.640816] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-10-16T22:34:38.643170] [INFO ] [MAIN ] Derivative Progress: 199/1803 symbols completed. BDN took 1.1s. Estimated remaining: 10m 28s. Rate: 153.3 symbols/min [2025-10-16T22:34:38.656760] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:38.657961] [DEBUG] [MAIN ] BDX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:38.659028] [INFO ] [MAIN ] BDX: Generated 1807 derivative records from 52564 primary records. [2025-10-16T22:34:38.659409] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-16T22:34:38.695553] [DEBUG] [MAIN ] BE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:38.697407] [INFO ] [MAIN ] BE: Generated 1807 derivative records from 54051 primary records. [2025-10-16T22:34:38.696379] [DEBUG] [LOCAL ] BDX: Derivative data saved (1807 records). [2025-10-16T22:34:38.697570] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-16T22:34:38.697724] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-16T22:34:38.700814] [INFO ] [MAIN ] Derivative Progress: 200/1803 symbols completed. BDX took 1.2s. Estimated remaining: 10m 25s. Rate: 154.0 symbols/min [2025-10-16T22:34:38.701885] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:38.734510] [DEBUG] [LOCAL ] BE: Derivative data saved (1807 records). [2025-10-16T22:34:38.734694] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-10-16T22:34:38.737840] [INFO ] [MAIN ] Derivative Progress: 201/1803 symbols completed. BE took 1.1s. Estimated remaining: 10m 21s. Rate: 154.7 symbols/min [2025-10-16T22:34:38.738242] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:38.760076] [DEBUG] [LOCAL ] BEKE: Loaded 53596 existing records from primary storage. [2025-10-16T22:34:38.760550] [INFO ] [MAIN ] BEKE: Loaded 53596 primary data records. [2025-10-16T22:34:38.978888] [DEBUG] [LOCAL ] BEN: Loaded 53511 existing records from primary storage. [2025-10-16T22:34:39.004517] [INFO ] [MAIN ] BEN: Loaded 53511 primary data records. [2025-10-16T22:34:39.220520] [DEBUG] [LOCAL ] BEPC: Loaded 46866 existing records from primary storage. [2025-10-16T22:34:39.233104] [INFO ] [MAIN ] BEPC: Loaded 46866 primary data records. [2025-10-16T22:34:39.865739] [DEBUG] [MAIN ] BEKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:39.867491] [INFO ] [MAIN ] BEKE: Generated 1807 derivative records from 53596 primary records. [2025-10-16T22:34:39.867759] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-16T22:34:39.899961] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1807 records). [2025-10-16T22:34:39.899599] [DEBUG] [MAIN ] BEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:39.900775] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-16T22:34:39.900679] [INFO ] [MAIN ] BEN: Generated 1807 derivative records from 53511 primary records. [2025-10-16T22:34:39.902980] [INFO ] [MAIN ] Derivative Progress: 202/1803 symbols completed. BEKE took 1.2s. Estimated remaining: 10m 27s. Rate: 153.1 symbols/min [2025-10-16T22:34:39.903121] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:39.903197] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-16T22:34:39.938823] [DEBUG] [LOCAL ] BEN: Derivative data saved (1807 records). [2025-10-16T22:34:39.936275] [DEBUG] [MAIN ] BEPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:39.938945] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-16T22:34:39.941826] [INFO ] [MAIN ] Derivative Progress: 203/1803 symbols completed. BEN took 1.2s. Estimated remaining: 10m 24s. Rate: 153.8 symbols/min [2025-10-16T22:34:39.942182] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:39.939614] [INFO ] [MAIN ] BEPC: Generated 1807 derivative records from 46866 primary records. [2025-10-16T22:34:39.942093] [DEBUG] [LOCAL ] BEPH: Loaded 5205 existing records from primary storage. [2025-10-16T22:34:39.942401] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-10-16T22:34:39.943248] [INFO ] [MAIN ] BEPH: Loaded 5205 primary data records. [2025-10-16T22:34:40.054364] [DEBUG] [LOCAL ] BEPI: Loaded 3629 existing records from primary storage. [2025-10-16T22:34:40.065909] [INFO ] [MAIN ] BEPI: Loaded 3629 primary data records. [2025-10-16T22:34:40.205632] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1807 records). [2025-10-16T22:34:40.245203] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-10-16T22:34:40.357156] [INFO ] [MAIN ] Derivative Progress: 204/1803 symbols completed. BEPC took 1.6s. Estimated remaining: 10m 24s. Rate: 153.8 symbols/min [2025-10-16T22:34:40.372422] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:40.455570] [DEBUG] [LOCAL ] BEPJ: Loaded 3119 existing records from primary storage. [2025-10-16T22:34:40.571619] [INFO ] [MAIN ] BEPJ: Loaded 3119 primary data records. [2025-10-16T22:34:40.898327] [DEBUG] [MAIN ] BEPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:40.899205] [INFO ] [MAIN ] BEPH: Generated 1807 derivative records from 5205 primary records. [2025-10-16T22:34:40.899297] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-10-16T22:34:40.926635] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1807 records). [2025-10-16T22:34:40.932256] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-10-16T22:34:40.934220] [INFO ] [MAIN ] Derivative Progress: 205/1803 symbols completed. BEPH took 1.0s. Estimated remaining: 10m 25s. Rate: 153.4 symbols/min [2025-10-16T22:34:40.934425] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:40.932168] [DEBUG] [MAIN ] BEPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:40.935919] [INFO ] [MAIN ] BEPI: Generated 1807 derivative records from 3629 primary records. [2025-10-16T22:34:40.936663] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-16T22:34:40.952822] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1807 records). [2025-10-16T22:34:40.953110] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-16T22:34:40.955635] [INFO ] [MAIN ] Derivative Progress: 206/1803 symbols completed. BEPI took 1.0s. Estimated remaining: 10m 22s. Rate: 154.1 symbols/min [2025-10-16T22:34:40.955824] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:40.981298] [DEBUG] [MAIN ] BEPJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:40.982066] [INFO ] [MAIN ] BEPJ: Generated 1807 derivative records from 3119 primary records. [2025-10-16T22:34:40.982285] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-16T22:34:40.996423] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1807 records). [2025-10-16T22:34:40.996716] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-16T22:34:41.009444] [INFO ] [MAIN ] Derivative Progress: 207/1803 symbols completed. BEPJ took 0.6s. Estimated remaining: 10m 19s. Rate: 154.8 symbols/min [2025-10-16T22:34:41.009729] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:41.010812] [DEBUG] [LOCAL ] BFAM: Loaded 34121 existing records from primary storage. [2025-10-16T22:34:41.011003] [INFO ] [MAIN ] BFAM: Loaded 34121 primary data records. [2025-10-16T22:34:41.182123] [DEBUG] [LOCAL ] BFK: Loaded 13686 existing records from primary storage. [2025-10-16T22:34:41.193034] [INFO ] [MAIN ] BFK: Loaded 13686 primary data records. [2025-10-16T22:34:41.215797] [DEBUG] [LOCAL ] BFH: Loaded 41891 existing records from primary storage. [2025-10-16T22:34:41.365365] [INFO ] [MAIN ] BFH: Loaded 41891 primary data records. [2025-10-16T22:34:42.019444] [DEBUG] [MAIN ] BFAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:42.021820] [INFO ] [MAIN ] BFAM: Generated 1807 derivative records from 34121 primary records. [2025-10-16T22:34:42.023329] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-16T22:34:42.050417] [DEBUG] [MAIN ] BFK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:42.053520] [INFO ] [MAIN ] BFK: Generated 1807 derivative records from 13686 primary records. [2025-10-16T22:34:42.053626] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-16T22:34:42.056437] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1807 records). [2025-10-16T22:34:42.056798] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-16T22:34:42.059467] [INFO ] [MAIN ] Derivative Progress: 208/1803 symbols completed. BFAM took 1.1s. Estimated remaining: 10m 23s. Rate: 153.5 symbols/min [2025-10-16T22:34:42.078157] [DEBUG] [LOCAL ] BFK: Derivative data saved (1807 records). [2025-10-16T22:34:42.078311] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-10-16T22:34:42.081353] [INFO ] [MAIN ] Derivative Progress: 209/1803 symbols completed. BFK took 1.1s. Estimated remaining: 10m 20s. Rate: 154.2 symbols/min [2025-10-16T22:34:42.093827] [DEBUG] [MAIN ] BFH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:42.094384] [INFO ] [MAIN ] BFH: Generated 1807 derivative records from 41891 primary records. [2025-10-16T22:34:42.094444] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-10-16T22:34:42.109543] [DEBUG] [LOCAL ] BFH: Derivative data saved (1807 records). [2025-10-16T22:34:42.109600] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-10-16T22:34:42.112610] [INFO ] [MAIN ] Derivative Progress: 210/1803 symbols completed. BFH took 1.2s. Estimated remaining: 10m 17s. Rate: 154.9 symbols/min [2025-10-16T22:34:42.113131] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:42.113254] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:42.113341] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:42.129238] [DEBUG] [LOCAL ] BFZ: Loaded 12108 existing records from primary storage. [2025-10-16T22:34:42.129462] [INFO ] [MAIN ] BFZ: Loaded 12108 primary data records. [2025-10-16T22:34:42.506369] [DEBUG] [LOCAL ] BG: Loaded 50912 existing records from primary storage. [2025-10-16T22:34:42.506768] [INFO ] [MAIN ] BG: Loaded 50912 primary data records. [2025-10-16T22:34:42.529540] [DEBUG] [LOCAL ] BFLY: Loaded 52222 existing records from primary storage. [2025-10-16T22:34:42.545385] [INFO ] [MAIN ] BFLY: Loaded 52222 primary data records. [2025-10-16T22:34:43.138489] [DEBUG] [MAIN ] BFZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:43.139898] [INFO ] [MAIN ] BFZ: Generated 1807 derivative records from 12108 primary records. [2025-10-16T22:34:43.140238] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-16T22:34:43.163409] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1807 records). [2025-10-16T22:34:43.163801] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-16T22:34:43.166555] [INFO ] [MAIN ] Derivative Progress: 211/1803 symbols completed. BFZ took 1.1s. Estimated remaining: 10m 22s. Rate: 153.6 symbols/min [2025-10-16T22:34:43.166765] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:43.186813] [DEBUG] [MAIN ] BG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:43.187796] [INFO ] [MAIN ] BG: Generated 1807 derivative records from 50912 primary records. [2025-10-16T22:34:43.187928] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-16T22:34:43.213113] [DEBUG] [MAIN ] BFLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:43.221758] [INFO ] [MAIN ] BFLY: Generated 1807 derivative records from 52222 primary records. [2025-10-16T22:34:43.221851] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-16T22:34:43.221605] [DEBUG] [LOCAL ] BG: Derivative data saved (1807 records). [2025-10-16T22:34:43.222765] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-16T22:34:43.224861] [INFO ] [MAIN ] Derivative Progress: 212/1803 symbols completed. BG took 1.1s. Estimated remaining: 10m 19s. Rate: 154.2 symbols/min [2025-10-16T22:34:43.225250] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:43.245526] [DEBUG] [LOCAL ] BGH: Loaded 17362 existing records from primary storage. [2025-10-16T22:34:43.246818] [INFO ] [MAIN ] BGH: Loaded 17362 primary data records. [2025-10-16T22:34:43.248026] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1807 records). [2025-10-16T22:34:43.269283] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-16T22:34:43.306193] [INFO ] [MAIN ] Derivative Progress: 213/1803 symbols completed. BFLY took 1.2s. Estimated remaining: 10m 16s. Rate: 154.8 symbols/min [2025-10-16T22:34:43.346639] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:43.415477] [DEBUG] [LOCAL ] BGR: Loaded 13687 existing records from primary storage. [2025-10-16T22:34:43.423350] [INFO ] [MAIN ] BGR: Loaded 13687 primary data records. [2025-10-16T22:34:43.918763] [DEBUG] [LOCAL ] BGS: Loaded 50921 existing records from primary storage. [2025-10-16T22:34:43.919137] [INFO ] [MAIN ] BGS: Loaded 50921 primary data records. [2025-10-16T22:34:44.246208] [DEBUG] [MAIN ] BGH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:44.247311] [INFO ] [MAIN ] BGH: Generated 1807 derivative records from 17362 primary records. [2025-10-16T22:34:44.247675] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-16T22:34:44.282865] [DEBUG] [LOCAL ] BGH: Derivative data saved (1807 records). [2025-10-16T22:34:44.288518] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-10-16T22:34:44.291568] [INFO ] [MAIN ] Derivative Progress: 214/1803 symbols completed. BGH took 1.1s. Estimated remaining: 10m 20s. Rate: 153.7 symbols/min [2025-10-16T22:34:44.292061] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:44.289041] [DEBUG] [MAIN ] BGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:44.293997] [INFO ] [MAIN ] BGR: Generated 1807 derivative records from 13687 primary records. [2025-10-16T22:34:44.294213] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-16T22:34:44.316173] [DEBUG] [LOCAL ] BGR: Derivative data saved (1807 records). [2025-10-16T22:34:44.316280] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-16T22:34:44.326489] [DEBUG] [LOCAL ] BGSF: Loaded 8063 existing records from primary storage. [2025-10-16T22:34:44.325909] [INFO ] [MAIN ] Derivative Progress: 215/1803 symbols completed. BGR took 1.1s. Estimated remaining: 10m 17s. Rate: 154.4 symbols/min [2025-10-16T22:34:44.327830] [INFO ] [MAIN ] BGSF: Loaded 8063 primary data records. [2025-10-16T22:34:44.328793] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:44.384679] [DEBUG] [MAIN ] BGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:44.426919] [INFO ] [MAIN ] BGS: Generated 1807 derivative records from 50921 primary records. [2025-10-16T22:34:44.454226] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-16T22:34:44.560041] [DEBUG] [LOCAL ] BGT: Loaded 16514 existing records from primary storage. [2025-10-16T22:34:44.664748] [INFO ] [MAIN ] BGT: Loaded 16514 primary data records. [2025-10-16T22:34:44.681211] [DEBUG] [LOCAL ] BGS: Derivative data saved (1807 records). [2025-10-16T22:34:44.682087] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-16T22:34:44.689971] [INFO ] [MAIN ] Derivative Progress: 216/1803 symbols completed. BGS took 1.3s. Estimated remaining: 10m 17s. Rate: 154.4 symbols/min [2025-10-16T22:34:44.706595] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:44.881713] [DEBUG] [LOCAL ] BGX: Loaded 11261 existing records from primary storage. [2025-10-16T22:34:44.886001] [INFO ] [MAIN ] BGX: Loaded 11261 primary data records. [2025-10-16T22:34:45.222307] [DEBUG] [MAIN ] BGSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:45.225739] [INFO ] [MAIN ] BGSF: Generated 1807 derivative records from 8063 primary records. [2025-10-16T22:34:45.229376] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-16T22:34:45.372116] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1807 records). [2025-10-16T22:34:45.375402] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-16T22:34:45.377613] [INFO ] [MAIN ] Derivative Progress: 217/1803 symbols completed. BGSF took 1.1s. Estimated remaining: 10m 18s. Rate: 153.9 symbols/min [2025-10-16T22:34:45.378112] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:45.392686] [DEBUG] [MAIN ] BGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:45.393467] [INFO ] [MAIN ] BGT: Generated 1807 derivative records from 16514 primary records. [2025-10-16T22:34:45.393788] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-16T22:34:45.410701] [DEBUG] [LOCAL ] BGT: Derivative data saved (1807 records). [2025-10-16T22:34:45.411079] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-16T22:34:45.413581] [INFO ] [MAIN ] Derivative Progress: 218/1803 symbols completed. BGT took 1.1s. Estimated remaining: 10m 15s. Rate: 154.5 symbols/min [2025-10-16T22:34:45.413874] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:45.436637] [DEBUG] [MAIN ] BGX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:45.437568] [INFO ] [MAIN ] BGX: Generated 1807 derivative records from 11261 primary records. [2025-10-16T22:34:45.437712] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-16T22:34:45.460257] [DEBUG] [LOCAL ] BGY: Loaded 22120 existing records from primary storage. [2025-10-16T22:34:45.461074] [INFO ] [MAIN ] BGY: Loaded 22120 primary data records. [2025-10-16T22:34:45.491532] [DEBUG] [LOCAL ] BGX: Derivative data saved (1807 records). [2025-10-16T22:34:45.482188] [DEBUG] [LOCAL ] BH: Loaded 16356 existing records from primary storage. [2025-10-16T22:34:45.506715] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-16T22:34:45.529288] [INFO ] [MAIN ] BH: Loaded 16356 primary data records. [2025-10-16T22:34:45.529203] [INFO ] [MAIN ] Derivative Progress: 219/1803 symbols completed. BGX took 0.8s. Estimated remaining: 10m 13s. Rate: 155.0 symbols/min [2025-10-16T22:34:45.549580] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:46.157984] [DEBUG] [LOCAL ] BHC: Loaded 47069 existing records from primary storage. [2025-10-16T22:34:46.161307] [INFO ] [MAIN ] BHC: Loaded 47069 primary data records. [2025-10-16T22:34:46.498885] [DEBUG] [MAIN ] BGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:46.518062] [INFO ] [MAIN ] BGY: Generated 1807 derivative records from 22120 primary records. [2025-10-16T22:34:46.518905] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-16T22:34:46.535017] [DEBUG] [MAIN ] BH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:46.537446] [INFO ] [MAIN ] BH: Generated 1807 derivative records from 16356 primary records. [2025-10-16T22:34:46.552776] [DEBUG] [LOCAL ] BGY: Derivative data saved (1807 records). [2025-10-16T22:34:46.552671] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-10-16T22:34:46.552969] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-16T22:34:46.556987] [INFO ] [MAIN ] Derivative Progress: 220/1803 symbols completed. BGY took 1.2s. Estimated remaining: 10m 17s. Rate: 153.9 symbols/min [2025-10-16T22:34:46.557512] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:46.575254] [DEBUG] [LOCAL ] BH: Derivative data saved (1807 records). [2025-10-16T22:34:46.576245] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-10-16T22:34:46.579073] [INFO ] [MAIN ] Derivative Progress: 221/1803 symbols completed. BH took 1.2s. Estimated remaining: 10m 14s. Rate: 154.5 symbols/min [2025-10-16T22:34:46.579422] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:46.609132] [DEBUG] [MAIN ] BHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:46.609940] [INFO ] [MAIN ] BHC: Generated 1807 derivative records from 47069 primary records. [2025-10-16T22:34:46.610058] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-16T22:34:46.631590] [DEBUG] [LOCAL ] BHE: Loaded 24043 existing records from primary storage. [2025-10-16T22:34:46.631722] [INFO ] [MAIN ] BHE: Loaded 24043 primary data records. [2025-10-16T22:34:46.724322] [DEBUG] [LOCAL ] BHC: Derivative data saved (1807 records). [2025-10-16T22:34:46.756092] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-16T22:34:46.774349] [INFO ] [MAIN ] Derivative Progress: 222/1803 symbols completed. BHC took 1.2s. Estimated remaining: 10m 13s. Rate: 154.9 symbols/min [2025-10-16T22:34:46.785324] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:46.997684] [DEBUG] [LOCAL ] BHP: Loaded 53762 existing records from primary storage. [2025-10-16T22:34:47.007216] [INFO ] [MAIN ] BHP: Loaded 53762 primary data records. [2025-10-16T22:34:47.129163] [DEBUG] [LOCAL ] BHR: Loaded 22248 existing records from primary storage. [2025-10-16T22:34:47.146498] [INFO ] [MAIN ] BHR: Loaded 22248 primary data records. [2025-10-16T22:34:47.733194] [DEBUG] [MAIN ] BHE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:47.734172] [INFO ] [MAIN ] BHE: Generated 1807 derivative records from 24043 primary records. [2025-10-16T22:34:47.734827] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-16T22:34:47.754365] [DEBUG] [LOCAL ] BHE: Derivative data saved (1807 records). [2025-10-16T22:34:47.755219] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-16T22:34:47.757468] [INFO ] [MAIN ] Derivative Progress: 223/1803 symbols completed. BHE took 1.2s. Estimated remaining: 10m 16s. Rate: 153.8 symbols/min [2025-10-16T22:34:47.777846] [DEBUG] [MAIN ] BHP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:47.778757] [INFO ] [MAIN ] BHP: Generated 1807 derivative records from 53762 primary records. [2025-10-16T22:34:47.778907] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-10-16T22:34:47.812803] [DEBUG] [LOCAL ] BHP: Derivative data saved (1807 records). [2025-10-16T22:34:47.813947] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-10-16T22:34:47.816539] [INFO ] [MAIN ] Derivative Progress: 224/1803 symbols completed. BHP took 1.2s. Estimated remaining: 10m 14s. Rate: 154.4 symbols/min [2025-10-16T22:34:47.816828] [DEBUG] [MAIN ] BHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:47.817678] [INFO ] [MAIN ] BHR: Generated 1807 derivative records from 22248 primary records. [2025-10-16T22:34:47.817912] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-16T22:34:47.834690] [DEBUG] [LOCAL ] BHR: Derivative data saved (1807 records). [2025-10-16T22:34:47.834842] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-16T22:34:47.838923] [INFO ] [MAIN ] Derivative Progress: 225/1803 symbols completed. BHR took 1.1s. Estimated remaining: 10m 11s. Rate: 155.0 symbols/min [2025-10-16T22:34:47.839532] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:47.839775] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:47.839424] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:47.876665] [DEBUG] [LOCAL ] BIO: Loaded 24218 existing records from primary storage. [2025-10-16T22:34:47.876893] [INFO ] [MAIN ] BIO: Loaded 24218 primary data records. [2025-10-16T22:34:48.061619] [DEBUG] [LOCAL ] BILL: Loaded 52887 existing records from primary storage. [2025-10-16T22:34:48.068377] [INFO ] [MAIN ] BILL: Loaded 52887 primary data records. [2025-10-16T22:34:48.143849] [DEBUG] [LOCAL ] BHVN: Loaded 50989 existing records from primary storage. [2025-10-16T22:34:48.173958] [INFO ] [MAIN ] BHVN: Loaded 50989 primary data records. [2025-10-16T22:34:48.971832] [DEBUG] [MAIN ] BIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:48.977029] [INFO ] [MAIN ] BIO: Generated 1807 derivative records from 24218 primary records. [2025-10-16T22:34:48.977328] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-10-16T22:34:49.007057] [DEBUG] [MAIN ] BILL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:49.010015] [INFO ] [MAIN ] BILL: Generated 1807 derivative records from 52887 primary records. [2025-10-16T22:34:49.010911] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-16T22:34:49.014405] [DEBUG] [LOCAL ] BIO: Derivative data saved (1807 records). [2025-10-16T22:34:49.016015] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-10-16T22:34:49.019922] [INFO ] [MAIN ] Derivative Progress: 226/1803 symbols completed. BIO took 1.2s. Estimated remaining: 10m 16s. Rate: 153.6 symbols/min [2025-10-16T22:34:49.020299] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:49.054768] [DEBUG] [MAIN ] BHVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:49.056915] [DEBUG] [LOCAL ] BILL: Derivative data saved (1807 records). [2025-10-16T22:34:49.058299] [INFO ] [MAIN ] BHVN: Generated 1807 derivative records from 50989 primary records. [2025-10-16T22:34:49.058512] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-16T22:34:49.058783] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-16T22:34:49.063567] [INFO ] [MAIN ] Derivative Progress: 227/1803 symbols completed. BILL took 1.2s. Estimated remaining: 10m 13s. Rate: 154.2 symbols/min [2025-10-16T22:34:49.064909] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:49.084449] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1807 records). [2025-10-16T22:34:49.095270] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-16T22:34:49.099931] [INFO ] [MAIN ] Derivative Progress: 228/1803 symbols completed. BHVN took 1.3s. Estimated remaining: 10m 10s. Rate: 154.9 symbols/min [2025-10-16T22:34:49.100402] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:49.107099] [DEBUG] [LOCAL ] BIPH: Loaded 2526 existing records from primary storage. [2025-10-16T22:34:49.108071] [INFO ] [MAIN ] BIPH: Loaded 2526 primary data records. [2025-10-16T22:34:49.165998] [DEBUG] [LOCAL ] BIP: Loaded 39510 existing records from primary storage. [2025-10-16T22:34:49.195636] [INFO ] [MAIN ] BIP: Loaded 39510 primary data records. [2025-10-16T22:34:49.441885] [DEBUG] [LOCAL ] BIPC: Loaded 41583 existing records from primary storage. [2025-10-16T22:34:49.555354] [INFO ] [MAIN ] BIPC: Loaded 41583 primary data records. [2025-10-16T22:34:50.198851] [DEBUG] [MAIN ] BIPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:50.200318] [INFO ] [MAIN ] BIPH: Generated 1807 derivative records from 2526 primary records. [2025-10-16T22:34:50.201515] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-16T22:34:50.225508] [DEBUG] [MAIN ] BIP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:50.229569] [INFO ] [MAIN ] BIP: Generated 1807 derivative records from 39510 primary records. [2025-10-16T22:34:50.230231] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-16T22:34:50.233966] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1807 records). [2025-10-16T22:34:50.235057] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-16T22:34:50.237779] [INFO ] [MAIN ] Derivative Progress: 229/1803 symbols completed. BIPH took 1.1s. Estimated remaining: 10m 15s. Rate: 153.6 symbols/min [2025-10-16T22:34:50.245800] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:50.258424] [DEBUG] [LOCAL ] BIP: Derivative data saved (1807 records). [2025-10-16T22:34:50.259029] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-16T22:34:50.261832] [DEBUG] [LOCAL ] BIPI: Loaded 3012 existing records from primary storage. [2025-10-16T22:34:50.267150] [INFO ] [MAIN ] Derivative Progress: 230/1803 symbols completed. BIP took 1.2s. Estimated remaining: 10m 12s. Rate: 154.2 symbols/min [2025-10-16T22:34:50.267430] [INFO ] [MAIN ] BIPI: Loaded 3012 primary data records. [2025-10-16T22:34:50.269164] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:50.358327] [DEBUG] [LOCAL ] BIPJ: Loaded 3180 existing records from primary storage. [2025-10-16T22:34:50.370762] [INFO ] [MAIN ] BIPJ: Loaded 3180 primary data records. [2025-10-16T22:34:50.403953] [DEBUG] [MAIN ] BIPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:50.452058] [INFO ] [MAIN ] BIPC: Generated 1807 derivative records from 41583 primary records. [2025-10-16T22:34:50.521855] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-16T22:34:50.813124] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1807 records). [2025-10-16T22:34:50.817671] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-10-16T22:34:50.922177] [INFO ] [MAIN ] Derivative Progress: 231/1803 symbols completed. BIPC took 1.9s. Estimated remaining: 10m 14s. Rate: 153.7 symbols/min [2025-10-16T22:34:50.936714] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:50.973088] [DEBUG] [MAIN ] BIPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:50.987018] [INFO ] [MAIN ] BIPI: Generated 1807 derivative records from 3012 primary records. [2025-10-16T22:34:51.004072] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-16T22:34:51.005385] [DEBUG] [MAIN ] BIPJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:51.013355] [INFO ] [MAIN ] BIPJ: Generated 1807 derivative records from 3180 primary records. [2025-10-16T22:34:51.013567] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-16T22:34:51.022226] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1807 records). [2025-10-16T22:34:51.023079] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-16T22:34:51.041244] [INFO ] [MAIN ] Derivative Progress: 232/1803 symbols completed. BIPI took 0.8s. Estimated remaining: 10m 11s. Rate: 154.2 symbols/min [2025-10-16T22:34:51.037694] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1807 records). [2025-10-16T22:34:51.041632] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:51.041789] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-16T22:34:51.062022] [INFO ] [MAIN ] Derivative Progress: 233/1803 symbols completed. BIPJ took 0.8s. Estimated remaining: 10m 8s. Rate: 154.8 symbols/min [2025-10-16T22:34:51.064536] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:51.066516] [DEBUG] [LOCAL ] BIRK: Loaded 51493 existing records from primary storage. [2025-10-16T22:34:51.066897] [INFO ] [MAIN ] BIRK: Loaded 51493 primary data records. [2025-10-16T22:34:51.305266] [DEBUG] [LOCAL ] BIT: Loaded 23884 existing records from primary storage. [2025-10-16T22:34:51.305717] [INFO ] [MAIN ] BIT: Loaded 23884 primary data records. [2025-10-16T22:34:51.527592] [DEBUG] [LOCAL ] BJ: Loaded 51977 existing records from primary storage. [2025-10-16T22:34:51.535189] [INFO ] [MAIN ] BJ: Loaded 51977 primary data records. [2025-10-16T22:34:52.214117] [DEBUG] [MAIN ] BIRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:52.215525] [INFO ] [MAIN ] BIRK: Generated 1807 derivative records from 51493 primary records. [2025-10-16T22:34:52.215628] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-16T22:34:52.239046] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1807 records). [2025-10-16T22:34:52.239818] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-16T22:34:52.242474] [INFO ] [MAIN ] Derivative Progress: 234/1803 symbols completed. BIRK took 1.3s. Estimated remaining: 10m 13s. Rate: 153.5 symbols/min [2025-10-16T22:34:52.243130] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:52.266560] [DEBUG] [MAIN ] BIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:52.267939] [INFO ] [MAIN ] BIT: Generated 1807 derivative records from 23884 primary records. [2025-10-16T22:34:52.268009] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-16T22:34:52.286053] [DEBUG] [LOCAL ] BIT: Derivative data saved (1807 records). [2025-10-16T22:34:52.286179] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-16T22:34:52.289052] [INFO ] [MAIN ] Derivative Progress: 235/1803 symbols completed. BIT took 1.2s. Estimated remaining: 10m 11s. Rate: 154.1 symbols/min [2025-10-16T22:34:52.292472] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:52.307555] [DEBUG] [MAIN ] BJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:52.308517] [INFO ] [MAIN ] BJ: Generated 1807 derivative records from 51977 primary records. [2025-10-16T22:34:52.308754] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-16T22:34:52.341411] [DEBUG] [LOCAL ] BJ: Derivative data saved (1807 records). [2025-10-16T22:34:52.342741] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-16T22:34:52.347275] [INFO ] [MAIN ] Derivative Progress: 236/1803 symbols completed. BJ took 1.3s. Estimated remaining: 10m 8s. Rate: 154.6 symbols/min [2025-10-16T22:34:52.361599] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:52.364626] [DEBUG] [LOCAL ] BK: Loaded 53933 existing records from primary storage. [2025-10-16T22:34:52.365077] [INFO ] [MAIN ] BK: Loaded 53933 primary data records. [2025-10-16T22:34:52.521195] [DEBUG] [LOCAL ] BKD: Loaded 50839 existing records from primary storage. [2025-10-16T22:34:52.555349] [INFO ] [MAIN ] BKD: Loaded 50839 primary data records. [2025-10-16T22:34:52.822569] [DEBUG] [LOCAL ] BKE: Loaded 34197 existing records from primary storage. [2025-10-16T22:34:52.836902] [INFO ] [MAIN ] BKE: Loaded 34197 primary data records. [2025-10-16T22:34:53.410912] [DEBUG] [MAIN ] BK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:53.413395] [INFO ] [MAIN ] BK: Generated 1807 derivative records from 53933 primary records. [2025-10-16T22:34:53.414030] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-16T22:34:53.434290] [DEBUG] [LOCAL ] BK: Derivative data saved (1807 records). [2025-10-16T22:34:53.435042] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-16T22:34:53.438387] [INFO ] [MAIN ] Derivative Progress: 237/1803 symbols completed. BK took 1.2s. Estimated remaining: 10m 12s. Rate: 153.4 symbols/min [2025-10-16T22:34:53.438855] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:53.460374] [DEBUG] [MAIN ] BKD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:53.461621] [INFO ] [MAIN ] BKD: Generated 1807 derivative records from 50839 primary records. [2025-10-16T22:34:53.461989] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-16T22:34:53.510960] [DEBUG] [LOCAL ] BKD: Derivative data saved (1807 records). [2025-10-16T22:34:53.510859] [DEBUG] [MAIN ] BKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:53.511882] [INFO ] [MAIN ] BKE: Generated 1807 derivative records from 34197 primary records. [2025-10-16T22:34:53.512100] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-16T22:34:53.512213] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-10-16T22:34:53.515819] [INFO ] [MAIN ] Derivative Progress: 238/1803 symbols completed. BKD took 1.2s. Estimated remaining: 10m 10s. Rate: 154.0 symbols/min [2025-10-16T22:34:53.534369] [DEBUG] [LOCAL ] BKE: Derivative data saved (1807 records). [2025-10-16T22:34:53.547915] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-10-16T22:34:53.552359] [INFO ] [MAIN ] Derivative Progress: 239/1803 symbols completed. BKE took 1.2s. Estimated remaining: 10m 7s. Rate: 154.5 symbols/min [2025-10-16T22:34:53.554885] [DEBUG] [LOCAL ] BKH: Loaded 37416 existing records from primary storage. [2025-10-16T22:34:53.555118] [INFO ] [MAIN ] BKH: Loaded 37416 primary data records. [2025-10-16T22:34:53.886115] [DEBUG] [MAIN ] BKH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:53.886959] [INFO ] [MAIN ] BKH: Generated 1807 derivative records from 37416 primary records. [2025-10-16T22:34:53.887026] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-10-16T22:34:53.904014] [DEBUG] [LOCAL ] BKH: Derivative data saved (1807 records). [2025-10-16T22:34:53.904167] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-10-16T22:34:53.907145] [INFO ] [MAIN ] Derivative Progress: 240/1803 symbols completed. BKH took 0.5s. Estimated remaining: 10m 7s. Rate: 154.6 symbols/min [2025-10-16T22:34:53.907962] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:53.908040] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:53.907850] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:53.923201] [DEBUG] [LOCAL ] BKN: Loaded 7345 existing records from primary storage. [2025-10-16T22:34:53.923550] [INFO ] [MAIN ] BKN: Loaded 7345 primary data records. [2025-10-16T22:34:54.204249] [DEBUG] [LOCAL ] BKSY: Loaded 49090 existing records from primary storage. [2025-10-16T22:34:54.303626] [DEBUG] [LOCAL ] BKKT: Loaded 36968 existing records from primary storage. [2025-10-16T22:34:54.363407] [INFO ] [MAIN ] BKSY: Loaded 49090 primary data records. [2025-10-16T22:34:54.374345] [INFO ] [MAIN ] BKKT: Loaded 36968 primary data records. [2025-10-16T22:34:55.032888] [DEBUG] [MAIN ] BKN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:55.034811] [INFO ] [MAIN ] BKN: Generated 1807 derivative records from 7345 primary records. [2025-10-16T22:34:55.034916] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-16T22:34:55.055721] [DEBUG] [LOCAL ] BKN: Derivative data saved (1807 records). [2025-10-16T22:34:55.055992] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-16T22:34:55.058446] [INFO ] [MAIN ] Derivative Progress: 241/1803 symbols completed. BKN took 1.2s. Estimated remaining: 10m 11s. Rate: 153.3 symbols/min [2025-10-16T22:34:55.058913] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:55.076672] [DEBUG] [MAIN ] BKKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:55.081451] [INFO ] [MAIN ] BKKT: Generated 1807 derivative records from 36968 primary records. [2025-10-16T22:34:55.081538] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-16T22:34:55.102014] [DEBUG] [LOCAL ] BKT: Loaded 12606 existing records from primary storage. [2025-10-16T22:34:55.102239] [INFO ] [MAIN ] BKT: Loaded 12606 primary data records. [2025-10-16T22:34:55.104452] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1807 records). [2025-10-16T22:34:55.115793] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-16T22:34:55.125944] [INFO ] [MAIN ] Derivative Progress: 242/1803 symbols completed. BKKT took 1.2s. Estimated remaining: 10m 9s. Rate: 153.9 symbols/min [2025-10-16T22:34:55.135360] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:55.166919] [DEBUG] [MAIN ] BKSY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:55.183314] [INFO ] [MAIN ] BKSY: Generated 1807 derivative records from 49090 primary records. [2025-10-16T22:34:55.199974] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-16T22:34:55.316207] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1807 records). [2025-10-16T22:34:55.316354] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-16T22:34:55.432443] [INFO ] [MAIN ] Derivative Progress: 243/1803 symbols completed. BKSY took 1.5s. Estimated remaining: 10m 8s. Rate: 154.0 symbols/min [2025-10-16T22:34:55.433483] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:55.464209] [DEBUG] [LOCAL ] BKU: Loaded 42528 existing records from primary storage. [2025-10-16T22:34:55.471178] [INFO ] [MAIN ] BKU: Loaded 42528 primary data records. [2025-10-16T22:34:55.604999] [DEBUG] [LOCAL ] BKV: Loaded 29852 existing records from primary storage. [2025-10-16T22:34:55.605561] [INFO ] [MAIN ] BKV: Loaded 29852 primary data records. [2025-10-16T22:34:55.720282] [DEBUG] [MAIN ] BKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:55.736205] [INFO ] [MAIN ] BKT: Generated 1807 derivative records from 12606 primary records. [2025-10-16T22:34:55.752519] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-16T22:34:55.952154] [DEBUG] [LOCAL ] BKT: Derivative data saved (1807 records). [2025-10-16T22:34:55.952397] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-16T22:34:55.954964] [INFO ] [MAIN ] Derivative Progress: 244/1803 symbols completed. BKT took 0.9s. Estimated remaining: 10m 8s. Rate: 153.8 symbols/min [2025-10-16T22:34:55.955384] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:56.261047] [DEBUG] [LOCAL ] BLCO: Loaded 35460 existing records from primary storage. [2025-10-16T22:34:56.261924] [INFO ] [MAIN ] BLCO: Loaded 35460 primary data records. [2025-10-16T22:34:56.312423] [DEBUG] [MAIN ] BKU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:56.332931] [INFO ] [MAIN ] BKU: Generated 1807 derivative records from 42528 primary records. [2025-10-16T22:34:56.341932] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-16T22:34:56.454740] [DEBUG] [LOCAL ] BKU: Derivative data saved (1807 records). [2025-10-16T22:34:56.463901] [DEBUG] [MAIN ] BKV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:56.490799] [INFO ] [MAIN ] BKV: Generated 1807 derivative records from 29852 primary records. [2025-10-16T22:34:56.488516] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-16T22:34:56.607887] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-16T22:34:56.620304] [INFO ] [MAIN ] Derivative Progress: 245/1803 symbols completed. BKU took 1.5s. Estimated remaining: 10m 10s. Rate: 153.3 symbols/min [2025-10-16T22:34:56.628284] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:56.638187] [DEBUG] [LOCAL ] BKV: Derivative data saved (1807 records). [2025-10-16T22:34:56.638998] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-16T22:34:56.641707] [INFO ] [MAIN ] Derivative Progress: 246/1803 symbols completed. BKV took 1.2s. Estimated remaining: 10m 7s. Rate: 153.9 symbols/min [2025-10-16T22:34:56.642965] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:56.680484] [DEBUG] [MAIN ] BLCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:56.681953] [INFO ] [MAIN ] BLCO: Generated 1807 derivative records from 35460 primary records. [2025-10-16T22:34:56.682114] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-16T22:34:56.708808] [DEBUG] [LOCAL ] BLD: Loaded 27593 existing records from primary storage. [2025-10-16T22:34:56.709985] [INFO ] [MAIN ] BLD: Loaded 27593 primary data records. [2025-10-16T22:34:56.724116] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1807 records). [2025-10-16T22:34:56.759510] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-16T22:34:56.769260] [INFO ] [MAIN ] Derivative Progress: 247/1803 symbols completed. BLCO took 0.8s. Estimated remaining: 10m 5s. Rate: 154.4 symbols/min [2025-10-16T22:34:56.788889] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:56.866676] [DEBUG] [LOCAL ] BLDR: Loaded 52281 existing records from primary storage. [2025-10-16T22:34:56.898686] [INFO ] [MAIN ] BLDR: Loaded 52281 primary data records. [2025-10-16T22:34:57.138712] [DEBUG] [LOCAL ] BLE: Loaded 13880 existing records from primary storage. [2025-10-16T22:34:57.164000] [INFO ] [MAIN ] BLE: Loaded 13880 primary data records. [2025-10-16T22:34:57.798418] [DEBUG] [MAIN ] BLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:57.800635] [INFO ] [MAIN ] BLD: Generated 1807 derivative records from 27593 primary records. [2025-10-16T22:34:57.800983] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-16T22:34:57.823868] [DEBUG] [LOCAL ] BLD: Derivative data saved (1807 records). [2025-10-16T22:34:57.824574] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-10-16T22:34:57.828778] [INFO ] [MAIN ] Derivative Progress: 248/1803 symbols completed. BLD took 1.2s. Estimated remaining: 10m 9s. Rate: 153.3 symbols/min [2025-10-16T22:34:57.831419] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:57.856889] [DEBUG] [MAIN ] BLDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:57.868306] [INFO ] [MAIN ] BLDR: Generated 1807 derivative records from 52281 primary records. [2025-10-16T22:34:57.868992] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-16T22:34:57.868835] [DEBUG] [MAIN ] BLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:57.871774] [INFO ] [MAIN ] BLE: Generated 1807 derivative records from 13880 primary records. [2025-10-16T22:34:57.871925] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-16T22:34:57.913975] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1807 records). [2025-10-16T22:34:57.914796] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-16T22:34:57.914463] [DEBUG] [LOCAL ] BLE: Derivative data saved (1807 records). [2025-10-16T22:34:57.918874] [INFO ] [MAIN ] Derivative Progress: 249/1803 symbols completed. BLDR took 1.3s. Estimated remaining: 10m 6s. Rate: 153.8 symbols/min [2025-10-16T22:34:57.919081] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:57.919848] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-16T22:34:57.934112] [INFO ] [MAIN ] Derivative Progress: 250/1803 symbols completed. BLE took 1.1s. Estimated remaining: 10m 4s. Rate: 154.4 symbols/min [2025-10-16T22:34:57.934622] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:57.952688] [DEBUG] [LOCAL ] BLK: Loaded 34632 existing records from primary storage. [2025-10-16T22:34:57.957349] [INFO ] [MAIN ] BLK: Loaded 34632 primary data records. [2025-10-16T22:34:58.045777] [DEBUG] [LOCAL ] BLW: Loaded 13261 existing records from primary storage. [2025-10-16T22:34:58.077456] [INFO ] [MAIN ] BLW: Loaded 13261 primary data records. [2025-10-16T22:34:58.286413] [DEBUG] [LOCAL ] BLND: Loaded 49649 existing records from primary storage. [2025-10-16T22:34:58.459397] [INFO ] [MAIN ] BLND: Loaded 49649 primary data records. [2025-10-16T22:34:59.058166] [DEBUG] [MAIN ] BLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:59.059563] [INFO ] [MAIN ] BLK: Generated 1807 derivative records from 34632 primary records. [2025-10-16T22:34:59.059885] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-16T22:34:59.079961] [DEBUG] [LOCAL ] BLK: Derivative data saved (1807 records). [2025-10-16T22:34:59.080528] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-16T22:34:59.084141] [INFO ] [MAIN ] Derivative Progress: 251/1803 symbols completed. BLK took 1.3s. Estimated remaining: 10m 8s. Rate: 153.2 symbols/min [2025-10-16T22:34:59.084473] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:59.103609] [DEBUG] [MAIN ] BLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:59.104870] [INFO ] [MAIN ] BLW: Generated 1807 derivative records from 13261 primary records. [2025-10-16T22:34:59.107816] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-10-16T22:34:59.130446] [DEBUG] [LOCAL ] BLW: Derivative data saved (1807 records). [2025-10-16T22:34:59.130685] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-10-16T22:34:59.142109] [INFO ] [MAIN ] Derivative Progress: 252/1803 symbols completed. BLW took 1.2s. Estimated remaining: 10m 6s. Rate: 153.7 symbols/min [2025-10-16T22:34:59.147104] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:59.154344] [DEBUG] [MAIN ] BLND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:59.157113] [INFO ] [MAIN ] BLND: Generated 1807 derivative records from 49649 primary records. [2025-10-16T22:34:59.156117] [DEBUG] [LOCAL ] BLX: Loaded 15678 existing records from primary storage. [2025-10-16T22:34:59.157237] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-16T22:34:59.157449] [INFO ] [MAIN ] BLX: Loaded 15678 primary data records. [2025-10-16T22:34:59.260984] [DEBUG] [LOCAL ] BLND: Derivative data saved (1807 records). [2025-10-16T22:34:59.272513] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-16T22:34:59.276931] [INFO ] [MAIN ] Derivative Progress: 253/1803 symbols completed. BLND took 1.4s. Estimated remaining: 10m 4s. Rate: 154.1 symbols/min [2025-10-16T22:34:59.525994] [DEBUG] [LOCAL ] BMA: Loaded 36440 existing records from primary storage. [2025-10-16T22:34:59.526282] [INFO ] [MAIN ] BMA: Loaded 36440 primary data records. [2025-10-16T22:34:59.871405] [DEBUG] [MAIN ] BLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:59.873057] [INFO ] [MAIN ] BLX: Generated 1807 derivative records from 15678 primary records. [2025-10-16T22:34:59.873366] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-16T22:34:59.893134] [DEBUG] [LOCAL ] BLX: Derivative data saved (1807 records). [2025-10-16T22:34:59.893526] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-16T22:34:59.896014] [INFO ] [MAIN ] Derivative Progress: 254/1803 symbols completed. BLX took 0.8s. Estimated remaining: 10m 5s. Rate: 153.7 symbols/min [2025-10-16T22:34:59.914864] [DEBUG] [MAIN ] BMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:34:59.915745] [INFO ] [MAIN ] BMA: Generated 1807 derivative records from 36440 primary records. [2025-10-16T22:34:59.915817] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-16T22:34:59.932932] [DEBUG] [LOCAL ] BMA: Derivative data saved (1807 records). [2025-10-16T22:34:59.933087] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-16T22:34:59.936975] [INFO ] [MAIN ] Derivative Progress: 255/1803 symbols completed. BMA took 0.8s. Estimated remaining: 10m 2s. Rate: 154.3 symbols/min [2025-10-16T22:34:59.937534] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:59.937470] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:59.937727] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:34:59.955821] [DEBUG] [LOCAL ] BME: Loaded 11376 existing records from primary storage. [2025-10-16T22:34:59.956100] [INFO ] [MAIN ] BME: Loaded 11376 primary data records. [2025-10-16T22:35:00.094894] [DEBUG] [LOCAL ] BMI: Loaded 24756 existing records from primary storage. [2025-10-16T22:35:00.122774] [INFO ] [MAIN ] BMI: Loaded 24756 primary data records. [2025-10-16T22:35:00.117439] [DEBUG] [LOCAL ] BMEZ: Loaded 26080 existing records from primary storage. [2025-10-16T22:35:00.264879] [INFO ] [MAIN ] BMEZ: Loaded 26080 primary data records. [2025-10-16T22:35:00.990416] [DEBUG] [MAIN ] BME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:00.991831] [INFO ] [MAIN ] BME: Generated 1807 derivative records from 11376 primary records. [2025-10-16T22:35:00.992145] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-16T22:35:01.019910] [DEBUG] [LOCAL ] BME: Derivative data saved (1807 records). [2025-10-16T22:35:01.026416] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-16T22:35:01.030190] [INFO ] [MAIN ] Derivative Progress: 256/1803 symbols completed. BME took 1.1s. Estimated remaining: 10m 6s. Rate: 153.2 symbols/min [2025-10-16T22:35:01.031069] [DEBUG] [MAIN ] BMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:01.031393] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:01.033220] [INFO ] [MAIN ] BMI: Generated 1807 derivative records from 24756 primary records. [2025-10-16T22:35:01.033421] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-16T22:35:01.063441] [DEBUG] [MAIN ] BMEZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:01.065720] [INFO ] [MAIN ] BMEZ: Generated 1807 derivative records from 26080 primary records. [2025-10-16T22:35:01.064743] [DEBUG] [LOCAL ] BMI: Derivative data saved (1807 records). [2025-10-16T22:35:01.065962] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-16T22:35:01.066166] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-16T22:35:01.071863] [INFO ] [MAIN ] Derivative Progress: 257/1803 symbols completed. BMI took 1.1s. Estimated remaining: 10m 3s. Rate: 153.7 symbols/min [2025-10-16T22:35:01.068913] [DEBUG] [LOCAL ] BMN: Loaded 2621 existing records from primary storage. [2025-10-16T22:35:01.079770] [INFO ] [MAIN ] BMN: Loaded 2621 primary data records. [2025-10-16T22:35:01.079633] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:01.100238] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1807 records). [2025-10-16T22:35:01.100421] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-10-16T22:35:01.137023] [INFO ] [MAIN ] Derivative Progress: 258/1803 symbols completed. BMEZ took 1.2s. Estimated remaining: 10m 1s. Rate: 154.2 symbols/min [2025-10-16T22:35:01.170313] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:01.424710] [DEBUG] [LOCAL ] BMO: Loaded 41606 existing records from primary storage. [2025-10-16T22:35:01.425846] [INFO ] [MAIN ] BMO: Loaded 41606 primary data records. [2025-10-16T22:35:01.786734] [DEBUG] [LOCAL ] BMY: Loaded 54147 existing records from primary storage. [2025-10-16T22:35:01.787704] [INFO ] [MAIN ] BMY: Loaded 54147 primary data records. [2025-10-16T22:35:01.883374] [DEBUG] [MAIN ] BMN: Filtered 6966 bins outside market hours, 7763 incomplete bins [2025-10-16T22:35:01.915215] [INFO ] [MAIN ] BMN: Generated 1803 derivative records from 2621 primary records. [2025-10-16T22:35:01.927338] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-16T22:35:01.987815] [DEBUG] [LOCAL ] BMN: Derivative data saved (1803 records). [2025-10-16T22:35:02.029610] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-16T22:35:02.138347] [INFO ] [MAIN ] Derivative Progress: 259/1803 symbols completed. BMN took 1.1s. Estimated remaining: 10m 4s. Rate: 153.3 symbols/min [2025-10-16T22:35:02.152234] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:02.173974] [DEBUG] [MAIN ] BMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:02.174781] [INFO ] [MAIN ] BMO: Generated 1807 derivative records from 41606 primary records. [2025-10-16T22:35:02.174935] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-16T22:35:02.208741] [DEBUG] [LOCAL ] BNED: Loaded 28780 existing records from primary storage. [2025-10-16T22:35:02.210207] [DEBUG] [LOCAL ] BMO: Derivative data saved (1807 records). [2025-10-16T22:35:02.210286] [INFO ] [MAIN ] BNED: Loaded 28780 primary data records. [2025-10-16T22:35:02.210345] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-16T22:35:02.213250] [INFO ] [MAIN ] Derivative Progress: 260/1803 symbols completed. BMO took 1.1s. Estimated remaining: 10m 2s. Rate: 153.8 symbols/min [2025-10-16T22:35:02.245166] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:02.341885] [DEBUG] [LOCAL ] BNH: Loaded 5044 existing records from primary storage. [2025-10-16T22:35:02.347118] [INFO ] [MAIN ] BNH: Loaded 5044 primary data records. [2025-10-16T22:35:02.341688] [DEBUG] [MAIN ] BMY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:02.453324] [INFO ] [MAIN ] BMY: Generated 1807 derivative records from 54147 primary records. [2025-10-16T22:35:02.519886] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-16T22:35:02.783387] [DEBUG] [LOCAL ] BMY: Derivative data saved (1807 records). [2025-10-16T22:35:02.887467] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-16T22:35:02.904244] [INFO ] [MAIN ] Derivative Progress: 261/1803 symbols completed. BMY took 1.7s. Estimated remaining: 10m 3s. Rate: 153.3 symbols/min [2025-10-16T22:35:02.905143] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:02.915485] [DEBUG] [LOCAL ] BNJ: Loaded 2620 existing records from primary storage. [2025-10-16T22:35:02.915986] [INFO ] [MAIN ] BNJ: Loaded 2620 primary data records. [2025-10-16T22:35:03.054952] [DEBUG] [MAIN ] BNED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:03.076900] [INFO ] [MAIN ] BNED: Generated 1807 derivative records from 28780 primary records. [2025-10-16T22:35:03.094791] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-16T22:35:03.263604] [DEBUG] [LOCAL ] BNED: Derivative data saved (1807 records). [2025-10-16T22:35:03.264097] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-16T22:35:03.274277] [INFO ] [MAIN ] Derivative Progress: 262/1803 symbols completed. BNED took 1.1s. Estimated remaining: 10m 3s. Rate: 153.3 symbols/min [2025-10-16T22:35:03.280357] [DEBUG] [MAIN ] BNH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:03.281149] [INFO ] [MAIN ] BNH: Generated 1807 derivative records from 5044 primary records. [2025-10-16T22:35:03.281254] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-16T22:35:03.281716] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:03.300706] [DEBUG] [LOCAL ] BNH: Derivative data saved (1807 records). [2025-10-16T22:35:03.301107] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-16T22:35:03.303634] [INFO ] [MAIN ] Derivative Progress: 263/1803 symbols completed. BNH took 1.1s. Estimated remaining: 10m 0s. Rate: 153.9 symbols/min [2025-10-16T22:35:03.304027] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:03.322864] [DEBUG] [MAIN ] BNJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:03.323576] [INFO ] [MAIN ] BNJ: Generated 1807 derivative records from 2620 primary records. [2025-10-16T22:35:03.323796] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-16T22:35:03.348608] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1807 records). [2025-10-16T22:35:03.348917] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-16T22:35:03.351529] [INFO ] [MAIN ] Derivative Progress: 264/1803 symbols completed. BNJ took 0.4s. Estimated remaining: 9m 58s. Rate: 154.4 symbols/min [2025-10-16T22:35:03.351888] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:03.369482] [DEBUG] [LOCAL ] BNT: Loaded 3543 existing records from primary storage. [2025-10-16T22:35:03.381746] [INFO ] [MAIN ] BNT: Loaded 3543 primary data records. [2025-10-16T22:35:03.420175] [DEBUG] [LOCAL ] BNL: Loaded 47629 existing records from primary storage. [2025-10-16T22:35:03.439170] [INFO ] [MAIN ] BNL: Loaded 47629 primary data records. [2025-10-16T22:35:03.575317] [DEBUG] [LOCAL ] BNS: Loaded 51872 existing records from primary storage. [2025-10-16T22:35:03.617093] [INFO ] [MAIN ] BNS: Loaded 51872 primary data records. [2025-10-16T22:35:04.488264] [DEBUG] [MAIN ] BNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:04.492574] [INFO ] [MAIN ] BNT: Generated 1807 derivative records from 3543 primary records. [2025-10-16T22:35:04.492845] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-16T22:35:04.508905] [DEBUG] [MAIN ] BNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:04.519961] [INFO ] [MAIN ] BNL: Generated 1807 derivative records from 47629 primary records. [2025-10-16T22:35:04.537299] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-16T22:35:04.538053] [DEBUG] [MAIN ] BNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:04.542021] [INFO ] [MAIN ] BNS: Generated 1807 derivative records from 51872 primary records. [2025-10-16T22:35:04.543571] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-16T22:35:04.565209] [DEBUG] [LOCAL ] BNT: Derivative data saved (1807 records). [2025-10-16T22:35:04.569959] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-16T22:35:04.576638] [DEBUG] [LOCAL ] BNL: Derivative data saved (1807 records). [2025-10-16T22:35:04.579375] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-16T22:35:04.579150] [INFO ] [MAIN ] Derivative Progress: 265/1803 symbols completed. BNT took 1.2s. Estimated remaining: 10m 3s. Rate: 153.2 symbols/min [2025-10-16T22:35:04.586284] [DEBUG] [LOCAL ] BNS: Derivative data saved (1807 records). [2025-10-16T22:35:04.586566] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-16T22:35:04.585916] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:04.586728] [INFO ] [MAIN ] Derivative Progress: 266/1803 symbols completed. BNL took 1.3s. Estimated remaining: 9m 60s. Rate: 153.7 symbols/min [2025-10-16T22:35:04.590295] [INFO ] [MAIN ] Derivative Progress: 267/1803 symbols completed. BNS took 1.3s. Estimated remaining: 9m 57s. Rate: 154.3 symbols/min [2025-10-16T22:35:04.590212] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:04.590796] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:04.617023] [DEBUG] [LOCAL ] BOE: Loaded 18339 existing records from primary storage. [2025-10-16T22:35:04.617253] [INFO ] [MAIN ] BOE: Loaded 18339 primary data records. [2025-10-16T22:35:04.707060] [DEBUG] [LOCAL ] BOC: Loaded 18699 existing records from primary storage. [2025-10-16T22:35:04.738661] [INFO ] [MAIN ] BOC: Loaded 18699 primary data records. [2025-10-16T22:35:04.936550] [DEBUG] [LOCAL ] BOH: Loaded 30879 existing records from primary storage. [2025-10-16T22:35:05.032057] [INFO ] [MAIN ] BOH: Loaded 30879 primary data records. [2025-10-16T22:35:05.610007] [DEBUG] [MAIN ] BOE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:05.612377] [INFO ] [MAIN ] BOE: Generated 1807 derivative records from 18339 primary records. [2025-10-16T22:35:05.612577] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-16T22:35:05.634985] [DEBUG] [MAIN ] BOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:05.646430] [INFO ] [MAIN ] BOC: Generated 1807 derivative records from 18699 primary records. [2025-10-16T22:35:05.645261] [DEBUG] [LOCAL ] BOE: Derivative data saved (1807 records). [2025-10-16T22:35:05.647673] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-16T22:35:05.647896] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-10-16T22:35:05.661823] [INFO ] [MAIN ] Derivative Progress: 268/1803 symbols completed. BOE took 1.1s. Estimated remaining: 10m 1s. Rate: 153.3 symbols/min [2025-10-16T22:35:05.681473] [DEBUG] [MAIN ] BOH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:05.683365] [INFO ] [MAIN ] BOH: Generated 1807 derivative records from 30879 primary records. [2025-10-16T22:35:05.683993] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-16T22:35:05.685913] [DEBUG] [LOCAL ] BOC: Derivative data saved (1807 records). [2025-10-16T22:35:05.693150] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-16T22:35:05.697087] [INFO ] [MAIN ] Derivative Progress: 269/1803 symbols completed. BOC took 1.1s. Estimated remaining: 9m 58s. Rate: 153.8 symbols/min [2025-10-16T22:35:05.704307] [DEBUG] [LOCAL ] BOH: Derivative data saved (1807 records). [2025-10-16T22:35:05.704377] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-16T22:35:05.707215] [INFO ] [MAIN ] Derivative Progress: 270/1803 symbols completed. BOH took 1.1s. Estimated remaining: 9m 56s. Rate: 154.4 symbols/min [2025-10-16T22:35:05.707742] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:05.707669] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:05.707944] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:05.768151] [DEBUG] [LOCAL ] BOND: Loaded 32683 existing records from primary storage. [2025-10-16T22:35:05.768414] [INFO ] [MAIN ] BOND: Loaded 32683 primary data records. [2025-10-16T22:35:05.913018] [DEBUG] [LOCAL ] BORR: Loaded 51498 existing records from primary storage. [2025-10-16T22:35:05.913291] [INFO ] [MAIN ] BORR: Loaded 51498 primary data records. [2025-10-16T22:35:05.912332] [DEBUG] [LOCAL ] BOOT: Loaded 40066 existing records from primary storage. [2025-10-16T22:35:05.913575] [INFO ] [MAIN ] BOOT: Loaded 40066 primary data records. [2025-10-16T22:35:06.804081] [DEBUG] [MAIN ] BOND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:06.804988] [INFO ] [MAIN ] BOND: Generated 1807 derivative records from 32683 primary records. [2025-10-16T22:35:06.805143] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-16T22:35:06.837293] [DEBUG] [MAIN ] BORR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:06.851210] [DEBUG] [MAIN ] BOOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:06.852901] [INFO ] [MAIN ] BORR: Generated 1807 derivative records from 51498 primary records. [2025-10-16T22:35:06.855282] [INFO ] [MAIN ] BOOT: Generated 1807 derivative records from 40066 primary records. [2025-10-16T22:35:06.855591] [DEBUG] [LOCAL ] BOND: Derivative data saved (1807 records). [2025-10-16T22:35:06.855419] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-10-16T22:35:06.856103] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-16T22:35:06.855525] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-16T22:35:06.859506] [INFO ] [MAIN ] Derivative Progress: 271/1803 symbols completed. BOND took 1.2s. Estimated remaining: 9m 60s. Rate: 153.3 symbols/min [2025-10-16T22:35:06.871856] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:06.892440] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1807 records). [2025-10-16T22:35:06.894088] [DEBUG] [LOCAL ] BORR: Derivative data saved (1807 records). [2025-10-16T22:35:06.894322] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-16T22:35:06.894272] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-10-16T22:35:06.897156] [INFO ] [MAIN ] Derivative Progress: 272/1803 symbols completed. BORR took 1.2s. Estimated remaining: 9m 57s. Rate: 153.8 symbols/min [2025-10-16T22:35:06.901010] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:06.901082] [INFO ] [MAIN ] Derivative Progress: 273/1803 symbols completed. BOOT took 1.2s. Estimated remaining: 9m 55s. Rate: 154.3 symbols/min [2025-10-16T22:35:06.901355] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:06.920827] [DEBUG] [LOCAL ] BOW: Loaded 23436 existing records from primary storage. [2025-10-16T22:35:06.921031] [INFO ] [MAIN ] BOW: Loaded 23436 primary data records. [2025-10-16T22:35:07.297906] [DEBUG] [LOCAL ] BP: Loaded 54098 existing records from primary storage. [2025-10-16T22:35:07.298128] [INFO ] [MAIN ] BP: Loaded 54098 primary data records. [2025-10-16T22:35:07.299226] [DEBUG] [LOCAL ] BOX: Loaded 50563 existing records from primary storage. [2025-10-16T22:35:07.336577] [INFO ] [MAIN ] BOX: Loaded 50563 primary data records. [2025-10-16T22:35:07.964957] [DEBUG] [MAIN ] BOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:07.965960] [INFO ] [MAIN ] BOW: Generated 1807 derivative records from 23436 primary records. [2025-10-16T22:35:07.966552] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-16T22:35:07.984752] [DEBUG] [LOCAL ] BOW: Derivative data saved (1807 records). [2025-10-16T22:35:07.985209] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-16T22:35:07.988039] [INFO ] [MAIN ] Derivative Progress: 274/1803 symbols completed. BOW took 1.1s. Estimated remaining: 9m 58s. Rate: 153.3 symbols/min [2025-10-16T22:35:07.988348] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:08.011489] [DEBUG] [MAIN ] BP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:08.013074] [INFO ] [MAIN ] BP: Generated 1807 derivative records from 54098 primary records. [2025-10-16T22:35:08.013206] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-16T22:35:08.027634] [DEBUG] [MAIN ] BOX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:08.039253] [INFO ] [MAIN ] BOX: Generated 1807 derivative records from 50563 primary records. [2025-10-16T22:35:08.042402] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-16T22:35:08.043864] [DEBUG] [LOCAL ] BP: Derivative data saved (1807 records). [2025-10-16T22:35:08.059540] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-10-16T22:35:08.061724] [INFO ] [MAIN ] Derivative Progress: 275/1803 symbols completed. BP took 1.2s. Estimated remaining: 9m 56s. Rate: 153.8 symbols/min [2025-10-16T22:35:08.065493] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:08.071378] [DEBUG] [LOCAL ] BOX: Derivative data saved (1807 records). [2025-10-16T22:35:08.081301] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-10-16T22:35:08.084087] [INFO ] [MAIN ] Derivative Progress: 276/1803 symbols completed. BOX took 1.2s. Estimated remaining: 9m 54s. Rate: 154.3 symbols/min [2025-10-16T22:35:08.084296] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:08.086158] [DEBUG] [LOCAL ] BR: Loaded 35110 existing records from primary storage. [2025-10-16T22:35:08.086266] [INFO ] [MAIN ] BR: Loaded 35110 primary data records. [2025-10-16T22:35:08.293338] [DEBUG] [LOCAL ] BRC: Loaded 18774 existing records from primary storage. [2025-10-16T22:35:08.401189] [INFO ] [MAIN ] BRC: Loaded 18774 primary data records. [2025-10-16T22:35:08.472796] [DEBUG] [LOCAL ] BRBR: Loaded 52076 existing records from primary storage. [2025-10-16T22:35:08.493586] [INFO ] [MAIN ] BRBR: Loaded 52076 primary data records. [2025-10-16T22:35:09.149981] [DEBUG] [MAIN ] BR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:09.151858] [INFO ] [MAIN ] BR: Generated 1807 derivative records from 35110 primary records. [2025-10-16T22:35:09.153731] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-16T22:35:09.171876] [DEBUG] [LOCAL ] BR: Derivative data saved (1807 records). [2025-10-16T22:35:09.172149] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-16T22:35:09.175074] [INFO ] [MAIN ] Derivative Progress: 277/1803 symbols completed. BR took 1.2s. Estimated remaining: 9m 57s. Rate: 153.3 symbols/min [2025-10-16T22:35:09.175284] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:09.218590] [DEBUG] [MAIN ] BRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:09.220041] [INFO ] [MAIN ] BRC: Generated 1807 derivative records from 18774 primary records. [2025-10-16T22:35:09.220219] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-16T22:35:09.219146] [DEBUG] [MAIN ] BRBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:09.222137] [INFO ] [MAIN ] BRBR: Generated 1807 derivative records from 52076 primary records. [2025-10-16T22:35:09.233284] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-16T22:35:09.264186] [DEBUG] [LOCAL ] BRC: Derivative data saved (1807 records). [2025-10-16T22:35:09.264734] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-16T22:35:09.267171] [INFO ] [MAIN ] Derivative Progress: 278/1803 symbols completed. BRC took 1.2s. Estimated remaining: 9m 55s. Rate: 153.7 symbols/min [2025-10-16T22:35:09.268131] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:09.286127] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1807 records). [2025-10-16T22:35:09.287582] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-10-16T22:35:09.290893] [INFO ] [MAIN ] Derivative Progress: 279/1803 symbols completed. BRBR took 1.2s. Estimated remaining: 9m 53s. Rate: 154.2 symbols/min [2025-10-16T22:35:09.291184] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:09.292176] [DEBUG] [LOCAL ] BROS: Loaded 53690 existing records from primary storage. [2025-10-16T22:35:09.292868] [INFO ] [MAIN ] BROS: Loaded 53690 primary data records. [2025-10-16T22:35:09.507102] [DEBUG] [LOCAL ] BSAC: Loaded 33148 existing records from primary storage. [2025-10-16T22:35:09.612583] [INFO ] [MAIN ] BSAC: Loaded 33148 primary data records. [2025-10-16T22:35:09.646737] [DEBUG] [LOCAL ] BRSP: Loaded 37050 existing records from primary storage. [2025-10-16T22:35:09.673892] [INFO ] [MAIN ] BRSP: Loaded 37050 primary data records. [2025-10-16T22:35:10.279904] [DEBUG] [MAIN ] BROS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:10.280919] [INFO ] [MAIN ] BROS: Generated 1807 derivative records from 53690 primary records. [2025-10-16T22:35:10.281201] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-16T22:35:10.300440] [DEBUG] [LOCAL ] BROS: Derivative data saved (1807 records). [2025-10-16T22:35:10.300740] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-16T22:35:10.303256] [INFO ] [MAIN ] Derivative Progress: 280/1803 symbols completed. BROS took 1.1s. Estimated remaining: 9m 56s. Rate: 153.4 symbols/min [2025-10-16T22:35:10.303403] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:10.345862] [DEBUG] [MAIN ] BRSP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:10.346364] [DEBUG] [MAIN ] BSAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:10.348492] [INFO ] [MAIN ] BSAC: Generated 1807 derivative records from 33148 primary records. [2025-10-16T22:35:10.346582] [DEBUG] [LOCAL ] BSL: Loaded 8327 existing records from primary storage. [2025-10-16T22:35:10.348719] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-10-16T22:35:10.347732] [INFO ] [MAIN ] BRSP: Generated 1807 derivative records from 37050 primary records. [2025-10-16T22:35:10.348828] [INFO ] [MAIN ] BSL: Loaded 8327 primary data records. [2025-10-16T22:35:10.348950] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-16T22:35:10.440694] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1807 records). [2025-10-16T22:35:10.446308] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-10-16T22:35:10.475132] [INFO ] [MAIN ] Derivative Progress: 281/1803 symbols completed. BSAC took 1.2s. Estimated remaining: 9m 54s. Rate: 153.7 symbols/min [2025-10-16T22:35:10.481372] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:10.513940] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1807 records). [2025-10-16T22:35:10.535664] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-10-16T22:35:10.545724] [INFO ] [MAIN ] Derivative Progress: 282/1803 symbols completed. BRSP took 1.3s. Estimated remaining: 9m 52s. Rate: 154.1 symbols/min [2025-10-16T22:35:10.562736] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:10.737347] [DEBUG] [LOCAL ] BSM: Loaded 32574 existing records from primary storage. [2025-10-16T22:35:10.737756] [INFO ] [MAIN ] BSM: Loaded 32574 primary data records. [2025-10-16T22:35:10.884304] [DEBUG] [MAIN ] BSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:10.885556] [INFO ] [MAIN ] BSL: Generated 1807 derivative records from 8327 primary records. [2025-10-16T22:35:10.899252] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-10-16T22:35:10.928390] [DEBUG] [LOCAL ] BSX: Loaded 54078 existing records from primary storage. [2025-10-16T22:35:10.952052] [INFO ] [MAIN ] BSX: Loaded 54078 primary data records. [2025-10-16T22:35:11.264182] [DEBUG] [LOCAL ] BSL: Derivative data saved (1807 records). [2025-10-16T22:35:11.297318] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-10-16T22:35:11.406145] [INFO ] [MAIN ] Derivative Progress: 283/1803 symbols completed. BSL took 1.1s. Estimated remaining: 9m 54s. Rate: 153.5 symbols/min [2025-10-16T22:35:11.447132] [DEBUG] [MAIN ] BSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:11.447949] [INFO ] [MAIN ] BSM: Generated 1807 derivative records from 32574 primary records. [2025-10-16T22:35:11.448131] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-10-16T22:35:11.470598] [DEBUG] [LOCAL ] BSM: Derivative data saved (1807 records). [2025-10-16T22:35:11.470997] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-10-16T22:35:11.487239] [INFO ] [MAIN ] Derivative Progress: 284/1803 symbols completed. BSM took 1.0s. Estimated remaining: 9m 52s. Rate: 153.9 symbols/min [2025-10-16T22:35:11.487706] [DEBUG] [MAIN ] BSX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:11.488763] [INFO ] [MAIN ] BSX: Generated 1807 derivative records from 54078 primary records. [2025-10-16T22:35:11.488834] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-10-16T22:35:11.505512] [DEBUG] [LOCAL ] BSX: Derivative data saved (1807 records). [2025-10-16T22:35:11.505635] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-10-16T22:35:11.508502] [INFO ] [MAIN ] Derivative Progress: 285/1803 symbols completed. BSX took 0.9s. Estimated remaining: 9m 50s. Rate: 154.4 symbols/min [2025-10-16T22:35:11.508997] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:11.509579] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:11.510745] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:11.518525] [DEBUG] [LOCAL ] BTA: Loaded 5735 existing records from primary storage. [2025-10-16T22:35:11.518768] [INFO ] [MAIN ] BTA: Loaded 5735 primary data records. [2025-10-16T22:35:11.626380] [DEBUG] [LOCAL ] BTCM: Loaded 17122 existing records from primary storage. [2025-10-16T22:35:11.634940] [INFO ] [MAIN ] BTCM: Loaded 17122 primary data records. [2025-10-16T22:35:12.193599] [DEBUG] [LOCAL ] BTE: Loaded 53118 existing records from primary storage. [2025-10-16T22:35:12.193913] [INFO ] [MAIN ] BTE: Loaded 53118 primary data records. [2025-10-16T22:35:12.597222] [DEBUG] [MAIN ] BTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:12.599484] [INFO ] [MAIN ] BTA: Generated 1807 derivative records from 5735 primary records. [2025-10-16T22:35:12.599944] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-16T22:35:12.618518] [DEBUG] [LOCAL ] BTA: Derivative data saved (1807 records). [2025-10-16T22:35:12.626504] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-16T22:35:12.633685] [INFO ] [MAIN ] Derivative Progress: 286/1803 symbols completed. BTA took 1.1s. Estimated remaining: 9m 53s. Rate: 153.4 symbols/min [2025-10-16T22:35:12.634422] [DEBUG] [MAIN ] BTCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:12.635344] [INFO ] [MAIN ] BTCM: Generated 1807 derivative records from 17122 primary records. [2025-10-16T22:35:12.635592] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-10-16T22:35:12.635854] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:12.653316] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1807 records). [2025-10-16T22:35:12.653469] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-10-16T22:35:12.656324] [INFO ] [MAIN ] Derivative Progress: 287/1803 symbols completed. BTCM took 1.1s. Estimated remaining: 9m 51s. Rate: 153.9 symbols/min [2025-10-16T22:35:12.656530] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:12.682705] [DEBUG] [MAIN ] BTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:12.685793] [INFO ] [MAIN ] BTE: Generated 1807 derivative records from 53118 primary records. [2025-10-16T22:35:12.686002] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-10-16T22:35:12.691438] [DEBUG] [LOCAL ] BTO: Loaded 8975 existing records from primary storage. [2025-10-16T22:35:12.700277] [INFO ] [MAIN ] BTO: Loaded 8975 primary data records. [2025-10-16T22:35:12.861913] [DEBUG] [LOCAL ] BTE: Derivative data saved (1807 records). [2025-10-16T22:35:12.895209] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-10-16T22:35:12.904499] [DEBUG] [LOCAL ] BTI: Loaded 53986 existing records from primary storage. [2025-10-16T22:35:12.923348] [INFO ] [MAIN ] Derivative Progress: 288/1803 symbols completed. BTE took 1.4s. Estimated remaining: 9m 50s. Rate: 154.1 symbols/min [2025-10-16T22:35:12.928731] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:12.923509] [INFO ] [MAIN ] BTI: Loaded 53986 primary data records. [2025-10-16T22:35:13.407360] [DEBUG] [MAIN ] BTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:13.408473] [INFO ] [MAIN ] BTO: Generated 1807 derivative records from 8975 primary records. [2025-10-16T22:35:13.409889] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-16T22:35:13.409999] [DEBUG] [LOCAL ] BTU: Loaded 53714 existing records from primary storage. [2025-10-16T22:35:13.410899] [INFO ] [MAIN ] BTU: Loaded 53714 primary data records. [2025-10-16T22:35:13.534085] [DEBUG] [LOCAL ] BTO: Derivative data saved (1807 records). [2025-10-16T22:35:13.534353] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-16T22:35:13.536725] [INFO ] [MAIN ] Derivative Progress: 289/1803 symbols completed. BTO took 0.9s. Estimated remaining: 9m 51s. Rate: 153.8 symbols/min [2025-10-16T22:35:13.537115] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:13.754892] [DEBUG] [MAIN ] BTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:13.764011] [INFO ] [MAIN ] BTI: Generated 1807 derivative records from 53986 primary records. [2025-10-16T22:35:13.764882] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-16T22:35:13.764543] [DEBUG] [LOCAL ] BTZ: Loaded 22717 existing records from primary storage. [2025-10-16T22:35:13.766960] [INFO ] [MAIN ] BTZ: Loaded 22717 primary data records. [2025-10-16T22:35:13.840325] [DEBUG] [LOCAL ] BTI: Derivative data saved (1807 records). [2025-10-16T22:35:13.849545] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-10-16T22:35:13.870504] [INFO ] [MAIN ] Derivative Progress: 290/1803 symbols completed. BTI took 1.2s. Estimated remaining: 9m 50s. Rate: 153.8 symbols/min [2025-10-16T22:35:13.883077] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:14.117345] [DEBUG] [MAIN ] BTU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:14.132023] [INFO ] [MAIN ] BTU: Generated 1807 derivative records from 53714 primary records. [2025-10-16T22:35:14.132386] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-10-16T22:35:14.176972] [DEBUG] [LOCAL ] BUD: Loaded 52981 existing records from primary storage. [2025-10-16T22:35:14.177993] [INFO ] [MAIN ] BUD: Loaded 52981 primary data records. [2025-10-16T22:35:14.175120] [DEBUG] [LOCAL ] BTU: Derivative data saved (1807 records). [2025-10-16T22:35:14.178942] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-10-16T22:35:14.201996] [INFO ] [MAIN ] Derivative Progress: 291/1803 symbols completed. BTU took 1.3s. Estimated remaining: 9m 49s. Rate: 153.9 symbols/min [2025-10-16T22:35:14.217441] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:14.269572] [DEBUG] [MAIN ] BTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:14.285930] [INFO ] [MAIN ] BTZ: Generated 1807 derivative records from 22717 primary records. [2025-10-16T22:35:14.293677] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-16T22:35:14.373734] [DEBUG] [LOCAL ] BUI: Loaded 12010 existing records from primary storage. [2025-10-16T22:35:14.392213] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1807 records). [2025-10-16T22:35:14.400163] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-16T22:35:14.409738] [INFO ] [MAIN ] BUI: Loaded 12010 primary data records. [2025-10-16T22:35:14.501474] [INFO ] [MAIN ] Derivative Progress: 292/1803 symbols completed. BTZ took 1.0s. Estimated remaining: 9m 49s. Rate: 154.0 symbols/min [2025-10-16T22:35:14.535685] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:14.871613] [DEBUG] [MAIN ] BUD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:14.873180] [INFO ] [MAIN ] BUD: Generated 1807 derivative records from 52981 primary records. [2025-10-16T22:35:14.873534] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-16T22:35:14.898922] [DEBUG] [LOCAL ] BUR: Loaded 45717 existing records from primary storage. [2025-10-16T22:35:14.899369] [INFO ] [MAIN ] BUR: Loaded 45717 primary data records. [2025-10-16T22:35:14.981565] [DEBUG] [LOCAL ] BUD: Derivative data saved (1807 records). [2025-10-16T22:35:14.997632] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-16T22:35:15.034117] [INFO ] [MAIN ] Derivative Progress: 293/1803 symbols completed. BUD took 1.2s. Estimated remaining: 9m 49s. Rate: 153.8 symbols/min [2025-10-16T22:35:15.020847] [DEBUG] [MAIN ] BUI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:15.039530] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:15.045861] [INFO ] [MAIN ] BUI: Generated 1807 derivative records from 12010 primary records. [2025-10-16T22:35:15.046004] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-16T22:35:15.229781] [DEBUG] [LOCAL ] BUI: Derivative data saved (1807 records). [2025-10-16T22:35:15.230948] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-10-16T22:35:15.233218] [INFO ] [MAIN ] Derivative Progress: 294/1803 symbols completed. BUI took 1.0s. Estimated remaining: 9m 48s. Rate: 154.1 symbols/min [2025-10-16T22:35:15.233564] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:15.267877] [DEBUG] [LOCAL ] BUXX: Loaded 15455 existing records from primary storage. [2025-10-16T22:35:15.268267] [INFO ] [MAIN ] BUXX: Loaded 15455 primary data records. [2025-10-16T22:35:15.292812] [DEBUG] [MAIN ] BUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:15.315402] [INFO ] [MAIN ] BUR: Generated 1807 derivative records from 45717 primary records. [2025-10-16T22:35:15.328801] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-16T22:35:15.417518] [DEBUG] [LOCAL ] BURL: Loaded 46016 existing records from primary storage. [2025-10-16T22:35:15.419189] [INFO ] [MAIN ] BURL: Loaded 46016 primary data records. [2025-10-16T22:35:15.604468] [DEBUG] [LOCAL ] BUR: Derivative data saved (1807 records). [2025-10-16T22:35:15.704723] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-16T22:35:15.726956] [INFO ] [MAIN ] Derivative Progress: 295/1803 symbols completed. BUR took 1.2s. Estimated remaining: 9m 48s. Rate: 154.0 symbols/min [2025-10-16T22:35:15.743418] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:15.999966] [DEBUG] [MAIN ] BUXX: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:35:15.999560] [DEBUG] [LOCAL ] BV: Loaded 38827 existing records from primary storage. [2025-10-16T22:35:16.001109] [INFO ] [MAIN ] BV: Loaded 38827 primary data records. [2025-10-16T22:35:16.001033] [INFO ] [MAIN ] BUXX: Generated 1806 derivative records from 15455 primary records. [2025-10-16T22:35:16.001279] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-10-16T22:35:16.206549] [DEBUG] [MAIN ] BURL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:16.291371] [INFO ] [MAIN ] BURL: Generated 1807 derivative records from 46016 primary records. [2025-10-16T22:35:16.327344] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1806 records). [2025-10-16T22:35:16.327450] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-10-16T22:35:16.329575] [INFO ] [MAIN ] Derivative Progress: 296/1803 symbols completed. BUXX took 1.1s. Estimated remaining: 9m 48s. Rate: 153.7 symbols/min [2025-10-16T22:35:16.327269] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-16T22:35:16.330720] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:16.348412] [DEBUG] [LOCAL ] BURL: Derivative data saved (1807 records). [2025-10-16T22:35:16.348829] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-16T22:35:16.351669] [INFO ] [MAIN ] Derivative Progress: 297/1803 symbols completed. BURL took 1.3s. Estimated remaining: 9m 46s. Rate: 154.2 symbols/min [2025-10-16T22:35:16.351918] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:16.386791] [DEBUG] [MAIN ] BV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:16.406294] [INFO ] [MAIN ] BV: Generated 1807 derivative records from 38827 primary records. [2025-10-16T22:35:16.407555] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-10-16T22:35:16.409135] [DEBUG] [LOCAL ] BVN: Loaded 44679 existing records from primary storage. [2025-10-16T22:35:16.409290] [INFO ] [MAIN ] BVN: Loaded 44679 primary data records. [2025-10-16T22:35:16.479914] [DEBUG] [LOCAL ] BV: Derivative data saved (1807 records). [2025-10-16T22:35:16.534886] [DEBUG] [LOCAL ] BW: Loaded 40868 existing records from primary storage. [2025-10-16T22:35:16.534349] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-10-16T22:35:16.541276] [INFO ] [MAIN ] Derivative Progress: 298/1803 symbols completed. BV took 0.8s. Estimated remaining: 9m 45s. Rate: 154.4 symbols/min [2025-10-16T22:35:16.538070] [INFO ] [MAIN ] BW: Loaded 40868 primary data records. [2025-10-16T22:35:17.096569] [DEBUG] [MAIN ] BW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:17.096399] [DEBUG] [MAIN ] BVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:17.097868] [INFO ] [MAIN ] BVN: Generated 1807 derivative records from 44679 primary records. [2025-10-16T22:35:17.097312] [INFO ] [MAIN ] BW: Generated 1807 derivative records from 40868 primary records. [2025-10-16T22:35:17.097975] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-10-16T22:35:17.098035] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-16T22:35:17.125920] [DEBUG] [LOCAL ] BW: Derivative data saved (1807 records). [2025-10-16T22:35:17.126448] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-10-16T22:35:17.128733] [INFO ] [MAIN ] Derivative Progress: 299/1803 symbols completed. BW took 0.8s. Estimated remaining: 9m 45s. Rate: 154.2 symbols/min [2025-10-16T22:35:17.131806] [DEBUG] [LOCAL ] BVN: Derivative data saved (1807 records). [2025-10-16T22:35:17.131869] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-10-16T22:35:17.133687] [INFO ] [MAIN ] Derivative Progress: 300/1803 symbols completed. BVN took 0.8s. Estimated remaining: 9m 43s. Rate: 154.7 symbols/min [2025-10-16T22:35:17.134042] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:17.134148] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:17.134091] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:17.160618] [DEBUG] [LOCAL ] BWG: Loaded 12662 existing records from primary storage. [2025-10-16T22:35:17.160890] [INFO ] [MAIN ] BWG: Loaded 12662 primary data records. [2025-10-16T22:35:17.266326] [DEBUG] [LOCAL ] BWLP: Loaded 32486 existing records from primary storage. [2025-10-16T22:35:17.277708] [INFO ] [MAIN ] BWLP: Loaded 32486 primary data records. [2025-10-16T22:35:17.787507] [DEBUG] [LOCAL ] BWA: Loaded 52519 existing records from primary storage. [2025-10-16T22:35:17.801760] [INFO ] [MAIN ] BWA: Loaded 52519 primary data records. [2025-10-16T22:35:18.132087] [DEBUG] [MAIN ] BWG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:18.134431] [INFO ] [MAIN ] BWG: Generated 1807 derivative records from 12662 primary records. [2025-10-16T22:35:18.134973] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-16T22:35:18.155670] [DEBUG] [LOCAL ] BWG: Derivative data saved (1807 records). [2025-10-16T22:35:18.156034] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-16T22:35:18.166044] [INFO ] [MAIN ] Derivative Progress: 301/1803 symbols completed. BWG took 1.0s. Estimated remaining: 9m 46s. Rate: 153.8 symbols/min [2025-10-16T22:35:18.166332] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:18.172388] [DEBUG] [MAIN ] BWLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:18.173271] [INFO ] [MAIN ] BWLP: Generated 1807 derivative records from 32486 primary records. [2025-10-16T22:35:18.173372] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-16T22:35:18.198544] [DEBUG] [LOCAL ] BWMX: Loaded 7843 existing records from primary storage. [2025-10-16T22:35:18.198310] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1807 records). [2025-10-16T22:35:18.198709] [INFO ] [MAIN ] BWMX: Loaded 7843 primary data records. [2025-10-16T22:35:18.210786] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-16T22:35:18.213271] [INFO ] [MAIN ] Derivative Progress: 302/1803 symbols completed. BWLP took 1.1s. Estimated remaining: 9m 44s. Rate: 154.3 symbols/min [2025-10-16T22:35:18.234292] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:18.234614] [DEBUG] [MAIN ] BWA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:18.257727] [INFO ] [MAIN ] BWA: Generated 1807 derivative records from 52519 primary records. [2025-10-16T22:35:18.269714] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-16T22:35:18.356830] [DEBUG] [LOCAL ] BWNB: Loaded 4220 existing records from primary storage. [2025-10-16T22:35:18.374881] [INFO ] [MAIN ] BWNB: Loaded 4220 primary data records. [2025-10-16T22:35:18.374949] [DEBUG] [LOCAL ] BWA: Derivative data saved (1807 records). [2025-10-16T22:35:18.410674] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-16T22:35:18.444747] [INFO ] [MAIN ] Derivative Progress: 303/1803 symbols completed. BWA took 1.3s. Estimated remaining: 9m 43s. Rate: 154.5 symbols/min [2025-10-16T22:35:18.595798] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:18.841757] [DEBUG] [LOCAL ] BWSN: Loaded 5203 existing records from primary storage. [2025-10-16T22:35:18.855865] [INFO ] [MAIN ] BWSN: Loaded 5203 primary data records. [2025-10-16T22:35:19.198850] [DEBUG] [MAIN ] BWMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:19.200266] [INFO ] [MAIN ] BWMX: Generated 1807 derivative records from 7843 primary records. [2025-10-16T22:35:19.200494] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-10-16T22:35:19.219548] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1807 records). [2025-10-16T22:35:19.221130] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-10-16T22:35:19.224853] [INFO ] [MAIN ] Derivative Progress: 304/1803 symbols completed. BWMX took 1.1s. Estimated remaining: 9m 44s. Rate: 154.0 symbols/min [2025-10-16T22:35:19.225398] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:19.239318] [DEBUG] [MAIN ] BWNB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:19.240277] [INFO ] [MAIN ] BWNB: Generated 1807 derivative records from 4220 primary records. [2025-10-16T22:35:19.240619] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-16T22:35:19.255561] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1807 records). [2025-10-16T22:35:19.256680] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-16T22:35:19.259990] [INFO ] [MAIN ] Derivative Progress: 305/1803 symbols completed. BWNB took 1.0s. Estimated remaining: 9m 42s. Rate: 154.4 symbols/min [2025-10-16T22:35:19.260995] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:19.279257] [DEBUG] [MAIN ] BWSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:19.281167] [INFO ] [MAIN ] BWSN: Generated 1807 derivative records from 5203 primary records. [2025-10-16T22:35:19.281597] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-16T22:35:19.309330] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1807 records). [2025-10-16T22:35:19.309499] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-16T22:35:19.312524] [INFO ] [MAIN ] Derivative Progress: 306/1803 symbols completed. BWSN took 0.7s. Estimated remaining: 9m 40s. Rate: 154.9 symbols/min [2025-10-16T22:35:19.312899] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:19.347322] [DEBUG] [LOCAL ] BWXT: Loaded 47497 existing records from primary storage. [2025-10-16T22:35:19.347561] [INFO ] [MAIN ] BWXT: Loaded 47497 primary data records. [2025-10-16T22:35:19.426334] [DEBUG] [LOCAL ] BXC: Loaded 13714 existing records from primary storage. [2025-10-16T22:35:19.464370] [INFO ] [MAIN ] BXC: Loaded 13714 primary data records. [2025-10-16T22:35:19.477477] [DEBUG] [LOCAL ] BX: Loaded 53873 existing records from primary storage. [2025-10-16T22:35:19.477679] [INFO ] [MAIN ] BX: Loaded 53873 primary data records. [2025-10-16T22:35:20.349463] [DEBUG] [MAIN ] BWXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:20.350247] [INFO ] [MAIN ] BWXT: Generated 1807 derivative records from 47497 primary records. [2025-10-16T22:35:20.350726] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-16T22:35:20.368285] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1807 records). [2025-10-16T22:35:20.368482] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-16T22:35:20.374296] [INFO ] [MAIN ] Derivative Progress: 307/1803 symbols completed. BWXT took 1.1s. Estimated remaining: 9m 43s. Rate: 154.0 symbols/min [2025-10-16T22:35:20.375278] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:20.401739] [DEBUG] [MAIN ] BXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:20.402125] [DEBUG] [MAIN ] BX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:20.403126] [INFO ] [MAIN ] BXC: Generated 1807 derivative records from 13714 primary records. [2025-10-16T22:35:20.404064] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-10-16T22:35:20.403976] [INFO ] [MAIN ] BX: Generated 1807 derivative records from 53873 primary records. [2025-10-16T22:35:20.404603] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-10-16T22:35:20.433563] [DEBUG] [LOCAL ] BXC: Derivative data saved (1807 records). [2025-10-16T22:35:20.433880] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-10-16T22:35:20.440090] [INFO ] [MAIN ] Derivative Progress: 308/1803 symbols completed. BXC took 1.1s. Estimated remaining: 9m 41s. Rate: 154.4 symbols/min [2025-10-16T22:35:20.440399] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:20.444000] [DEBUG] [LOCAL ] BX: Derivative data saved (1807 records). [2025-10-16T22:35:20.444218] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-10-16T22:35:20.446716] [INFO ] [MAIN ] Derivative Progress: 309/1803 symbols completed. BX took 1.2s. Estimated remaining: 9m 39s. Rate: 154.9 symbols/min [2025-10-16T22:35:20.446969] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:20.502876] [DEBUG] [LOCAL ] BXMX: Loaded 19610 existing records from primary storage. [2025-10-16T22:35:20.502985] [INFO ] [MAIN ] BXMX: Loaded 19610 primary data records. [2025-10-16T22:35:20.617461] [DEBUG] [LOCAL ] BXMT: Loaded 47685 existing records from primary storage. [2025-10-16T22:35:20.631096] [INFO ] [MAIN ] BXMT: Loaded 47685 primary data records. [2025-10-16T22:35:20.938550] [DEBUG] [LOCAL ] BXP: Loaded 50256 existing records from primary storage. [2025-10-16T22:35:20.939128] [INFO ] [MAIN ] BXP: Loaded 50256 primary data records. [2025-10-16T22:35:21.480634] [DEBUG] [MAIN ] BXMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:21.482289] [INFO ] [MAIN ] BXMX: Generated 1807 derivative records from 19610 primary records. [2025-10-16T22:35:21.483388] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-16T22:35:21.513989] [DEBUG] [MAIN ] BXMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:21.515271] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1807 records). [2025-10-16T22:35:21.515534] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-10-16T22:35:21.516255] [INFO ] [MAIN ] BXMT: Generated 1807 derivative records from 47685 primary records. [2025-10-16T22:35:21.516450] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-10-16T22:35:21.518799] [INFO ] [MAIN ] Derivative Progress: 310/1803 symbols completed. BXMX took 1.1s. Estimated remaining: 9m 42s. Rate: 154.0 symbols/min [2025-10-16T22:35:21.519119] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:21.539157] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1807 records). [2025-10-16T22:35:21.539419] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-10-16T22:35:21.541910] [INFO ] [MAIN ] Derivative Progress: 311/1803 symbols completed. BXMT took 1.2s. Estimated remaining: 9m 39s. Rate: 154.5 symbols/min [2025-10-16T22:35:21.542215] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:21.555936] [DEBUG] [MAIN ] BXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:21.556633] [INFO ] [MAIN ] BXP: Generated 1807 derivative records from 50256 primary records. [2025-10-16T22:35:21.556751] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-16T22:35:21.573105] [DEBUG] [LOCAL ] BXP: Derivative data saved (1807 records). [2025-10-16T22:35:21.573337] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-10-16T22:35:21.576090] [INFO ] [MAIN ] Derivative Progress: 312/1803 symbols completed. BXP took 1.1s. Estimated remaining: 9m 37s. Rate: 154.9 symbols/min [2025-10-16T22:35:21.576351] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:21.601954] [DEBUG] [LOCAL ] BY: Loaded 21987 existing records from primary storage. [2025-10-16T22:35:21.602171] [INFO ] [MAIN ] BY: Loaded 21987 primary data records. [2025-10-16T22:35:21.731552] [DEBUG] [LOCAL ] BXSL: Loaded 48504 existing records from primary storage. [2025-10-16T22:35:21.737580] [INFO ] [MAIN ] BXSL: Loaded 48504 primary data records. [2025-10-16T22:35:22.049825] [DEBUG] [LOCAL ] BYD: Loaded 45233 existing records from primary storage. [2025-10-16T22:35:22.055694] [INFO ] [MAIN ] BYD: Loaded 45233 primary data records. [2025-10-16T22:35:22.607601] [DEBUG] [MAIN ] BY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:22.609213] [INFO ] [MAIN ] BY: Generated 1807 derivative records from 21987 primary records. [2025-10-16T22:35:22.609874] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-16T22:35:22.623162] [DEBUG] [MAIN ] BXSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:22.624318] [INFO ] [MAIN ] BXSL: Generated 1807 derivative records from 48504 primary records. [2025-10-16T22:35:22.624685] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-10-16T22:35:22.652078] [DEBUG] [LOCAL ] BY: Derivative data saved (1807 records). [2025-10-16T22:35:22.652665] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-10-16T22:35:22.654921] [INFO ] [MAIN ] Derivative Progress: 313/1803 symbols completed. BY took 1.1s. Estimated remaining: 9m 40s. Rate: 154.1 symbols/min [2025-10-16T22:35:22.659244] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1807 records). [2025-10-16T22:35:22.659422] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-10-16T22:35:22.661766] [INFO ] [MAIN ] Derivative Progress: 314/1803 symbols completed. BXSL took 1.1s. Estimated remaining: 9m 38s. Rate: 154.6 symbols/min [2025-10-16T22:35:22.676293] [DEBUG] [MAIN ] BYD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:22.676913] [INFO ] [MAIN ] BYD: Generated 1807 derivative records from 45233 primary records. [2025-10-16T22:35:22.676994] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-16T22:35:22.692017] [DEBUG] [LOCAL ] BYD: Derivative data saved (1807 records). [2025-10-16T22:35:22.692076] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-16T22:35:22.694678] [INFO ] [MAIN ] Derivative Progress: 315/1803 symbols completed. BYD took 1.1s. Estimated remaining: 9m 36s. Rate: 155.0 symbols/min [2025-10-16T22:35:22.695255] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:22.695371] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:22.695766] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:22.711248] [DEBUG] [LOCAL ] BYM: Loaded 11798 existing records from primary storage. [2025-10-16T22:35:22.711468] [INFO ] [MAIN ] BYM: Loaded 11798 primary data records. [2025-10-16T22:35:22.854103] [DEBUG] [LOCAL ] BZH: Loaded 32633 existing records from primary storage. [2025-10-16T22:35:22.864709] [INFO ] [MAIN ] BZH: Loaded 32633 primary data records. [2025-10-16T22:35:23.150956] [DEBUG] [LOCAL ] C: Loaded 54130 existing records from primary storage. [2025-10-16T22:35:23.167675] [INFO ] [MAIN ] C: Loaded 54130 primary data records. [2025-10-16T22:35:23.696106] [DEBUG] [MAIN ] BYM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:23.697781] [INFO ] [MAIN ] BYM: Generated 1807 derivative records from 11798 primary records. [2025-10-16T22:35:23.698950] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-16T22:35:23.725548] [DEBUG] [LOCAL ] BYM: Derivative data saved (1807 records). [2025-10-16T22:35:23.726107] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-16T22:35:23.729268] [INFO ] [MAIN ] Derivative Progress: 316/1803 symbols completed. BYM took 1.0s. Estimated remaining: 9m 39s. Rate: 154.2 symbols/min [2025-10-16T22:35:23.741672] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:23.742768] [DEBUG] [MAIN ] BZH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:23.743785] [INFO ] [MAIN ] BZH: Generated 1807 derivative records from 32633 primary records. [2025-10-16T22:35:23.744829] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-16T22:35:23.780148] [DEBUG] [LOCAL ] BZH: Derivative data saved (1807 records). [2025-10-16T22:35:23.781428] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-16T22:35:23.783417] [INFO ] [MAIN ] Derivative Progress: 317/1803 symbols completed. BZH took 1.1s. Estimated remaining: 9m 37s. Rate: 154.6 symbols/min [2025-10-16T22:35:23.783843] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:23.784258] [DEBUG] [MAIN ] C: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:23.785438] [INFO ] [MAIN ] C: Generated 1807 derivative records from 54130 primary records. [2025-10-16T22:35:23.785740] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-10-16T22:35:23.824916] [DEBUG] [LOCAL ] C: Derivative data saved (1807 records). [2025-10-16T22:35:23.823182] [DEBUG] [LOCAL ] CAAP: Loaded 20020 existing records from primary storage. [2025-10-16T22:35:23.825078] [INFO ] [MAIN ] CAAP: Loaded 20020 primary data records. [2025-10-16T22:35:23.825287] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-10-16T22:35:23.865366] [INFO ] [MAIN ] Derivative Progress: 318/1803 symbols completed. C took 1.2s. Estimated remaining: 9m 35s. Rate: 155.0 symbols/min [2025-10-16T22:35:23.912098] [DEBUG] [LOCAL ] CABO: Loaded 16869 existing records from primary storage. [2025-10-16T22:35:23.927613] [INFO ] [MAIN ] CABO: Loaded 16869 primary data records. [2025-10-16T22:35:23.911767] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:24.545531] [DEBUG] [LOCAL ] CADE: Loaded 49873 existing records from primary storage. [2025-10-16T22:35:24.547309] [INFO ] [MAIN ] CADE: Loaded 49873 primary data records. [2025-10-16T22:35:24.592064] [DEBUG] [MAIN ] CAAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:24.645522] [INFO ] [MAIN ] CAAP: Generated 1807 derivative records from 20020 primary records. [2025-10-16T22:35:24.676898] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-16T22:35:24.776366] [DEBUG] [MAIN ] CABO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:24.803829] [INFO ] [MAIN ] CABO: Generated 1807 derivative records from 16869 primary records. [2025-10-16T22:35:24.810780] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-16T22:35:24.822342] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1807 records). [2025-10-16T22:35:24.867743] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-16T22:35:24.906694] [DEBUG] [LOCAL ] CABO: Derivative data saved (1807 records). [2025-10-16T22:35:24.906937] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-16T22:35:24.886779] [INFO ] [MAIN ] Derivative Progress: 319/1803 symbols completed. CAAP took 1.1s. Estimated remaining: 9m 37s. Rate: 154.2 symbols/min [2025-10-16T22:35:24.951219] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:24.979071] [INFO ] [MAIN ] Derivative Progress: 320/1803 symbols completed. CABO took 1.2s. Estimated remaining: 9m 36s. Rate: 154.6 symbols/min [2025-10-16T22:35:24.983964] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:25.107251] [DEBUG] [LOCAL ] CAF: Loaded 3501 existing records from primary storage. [2025-10-16T22:35:25.107530] [INFO ] [MAIN ] CAF: Loaded 3501 primary data records. [2025-10-16T22:35:25.322624] [DEBUG] [LOCAL ] CAE: Loaded 39534 existing records from primary storage. [2025-10-16T22:35:25.398626] [INFO ] [MAIN ] CAE: Loaded 39534 primary data records. [2025-10-16T22:35:25.915443] [DEBUG] [MAIN ] CADE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:25.916217] [INFO ] [MAIN ] CADE: Generated 1807 derivative records from 49873 primary records. [2025-10-16T22:35:25.916303] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-16T22:35:25.939270] [DEBUG] [LOCAL ] CADE: Derivative data saved (1807 records). [2025-10-16T22:35:25.939803] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-16T22:35:25.942343] [INFO ] [MAIN ] Derivative Progress: 321/1803 symbols completed. CADE took 2.0s. Estimated remaining: 9m 38s. Rate: 153.9 symbols/min [2025-10-16T22:35:25.943119] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:25.964876] [DEBUG] [MAIN ] CAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:25.965833] [INFO ] [MAIN ] CAF: Generated 1807 derivative records from 3501 primary records. [2025-10-16T22:35:25.966484] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-10-16T22:35:25.982559] [DEBUG] [LOCAL ] CAF: Derivative data saved (1807 records). [2025-10-16T22:35:25.985757] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-10-16T22:35:25.988568] [INFO ] [MAIN ] Derivative Progress: 322/1803 symbols completed. CAF took 1.0s. Estimated remaining: 9m 36s. Rate: 154.3 symbols/min [2025-10-16T22:35:25.989279] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:26.004198] [DEBUG] [MAIN ] CAE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:26.005104] [INFO ] [MAIN ] CAE: Generated 1807 derivative records from 39534 primary records. [2025-10-16T22:35:26.005288] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-16T22:35:26.036841] [DEBUG] [LOCAL ] CAE: Derivative data saved (1807 records). [2025-10-16T22:35:26.037190] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-16T22:35:26.040224] [INFO ] [MAIN ] Derivative Progress: 323/1803 symbols completed. CAE took 1.1s. Estimated remaining: 9m 34s. Rate: 154.7 symbols/min [2025-10-16T22:35:26.040717] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:26.060109] [DEBUG] [LOCAL ] CAG: Loaded 54055 existing records from primary storage. [2025-10-16T22:35:26.060465] [INFO ] [MAIN ] CAG: Loaded 54055 primary data records. [2025-10-16T22:35:26.395023] [DEBUG] [LOCAL ] CAH: Loaded 51839 existing records from primary storage. [2025-10-16T22:35:26.395307] [INFO ] [MAIN ] CAH: Loaded 51839 primary data records. [2025-10-16T22:35:26.500249] [DEBUG] [LOCAL ] CAL: Loaded 43267 existing records from primary storage. [2025-10-16T22:35:26.515932] [INFO ] [MAIN ] CAL: Loaded 43267 primary data records. [2025-10-16T22:35:27.090754] [DEBUG] [MAIN ] CAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:27.092229] [INFO ] [MAIN ] CAG: Generated 1807 derivative records from 54055 primary records. [2025-10-16T22:35:27.092714] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-16T22:35:27.112223] [DEBUG] [LOCAL ] CAG: Derivative data saved (1807 records). [2025-10-16T22:35:27.112500] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-16T22:35:27.114857] [INFO ] [MAIN ] Derivative Progress: 324/1803 symbols completed. CAG took 1.2s. Estimated remaining: 9m 37s. Rate: 153.9 symbols/min [2025-10-16T22:35:27.115030] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:27.135719] [DEBUG] [MAIN ] CAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:27.136455] [INFO ] [MAIN ] CAH: Generated 1807 derivative records from 51839 primary records. [2025-10-16T22:35:27.136754] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-16T22:35:27.166362] [DEBUG] [MAIN ] CAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:27.167739] [INFO ] [MAIN ] CAL: Generated 1807 derivative records from 43267 primary records. [2025-10-16T22:35:27.177444] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-16T22:35:27.187984] [DEBUG] [LOCAL ] CAH: Derivative data saved (1807 records). [2025-10-16T22:35:27.191690] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-16T22:35:27.194261] [INFO ] [MAIN ] Derivative Progress: 325/1803 symbols completed. CAH took 1.2s. Estimated remaining: 9m 35s. Rate: 154.2 symbols/min [2025-10-16T22:35:27.194916] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:27.210666] [DEBUG] [LOCAL ] CAL: Derivative data saved (1807 records). [2025-10-16T22:35:27.210820] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-16T22:35:27.211387] [DEBUG] [LOCAL ] CALX: Loaded 37885 existing records from primary storage. [2025-10-16T22:35:27.214178] [INFO ] [MAIN ] Derivative Progress: 326/1803 symbols completed. CAL took 1.2s. Estimated remaining: 9m 33s. Rate: 154.7 symbols/min [2025-10-16T22:35:27.214312] [INFO ] [MAIN ] CALX: Loaded 37885 primary data records. [2025-10-16T22:35:27.214463] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:27.350863] [DEBUG] [LOCAL ] CANG: Loaded 27143 existing records from primary storage. [2025-10-16T22:35:27.350786] [DEBUG] [LOCAL ] CAPL: Loaded 5684 existing records from primary storage. [2025-10-16T22:35:27.366553] [INFO ] [MAIN ] CANG: Loaded 27143 primary data records. [2025-10-16T22:35:27.366495] [INFO ] [MAIN ] CAPL: Loaded 5684 primary data records. [2025-10-16T22:35:28.193341] [DEBUG] [MAIN ] CALX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:28.194139] [INFO ] [MAIN ] CALX: Generated 1807 derivative records from 37885 primary records. [2025-10-16T22:35:28.194402] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-16T22:35:28.211356] [DEBUG] [LOCAL ] CALX: Derivative data saved (1807 records). [2025-10-16T22:35:28.211706] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-16T22:35:28.213628] [INFO ] [MAIN ] Derivative Progress: 327/1803 symbols completed. CALX took 1.1s. Estimated remaining: 9m 35s. Rate: 153.9 symbols/min [2025-10-16T22:35:28.214059] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:28.232532] [DEBUG] [MAIN ] CAPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:28.235087] [INFO ] [MAIN ] CAPL: Generated 1807 derivative records from 5684 primary records. [2025-10-16T22:35:28.235382] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-16T22:35:28.264003] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1807 records). [2025-10-16T22:35:28.255868] [DEBUG] [MAIN ] CANG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:28.264921] [INFO ] [MAIN ] CANG: Generated 1807 derivative records from 27143 primary records. [2025-10-16T22:35:28.265141] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-16T22:35:28.265200] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-16T22:35:28.268086] [INFO ] [MAIN ] Derivative Progress: 328/1803 symbols completed. CAPL took 1.1s. Estimated remaining: 9m 33s. Rate: 154.3 symbols/min [2025-10-16T22:35:28.284271] [DEBUG] [LOCAL ] CANG: Derivative data saved (1807 records). [2025-10-16T22:35:28.284416] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-10-16T22:35:28.287046] [INFO ] [MAIN ] Derivative Progress: 329/1803 symbols completed. CANG took 1.1s. Estimated remaining: 9m 31s. Rate: 154.8 symbols/min [2025-10-16T22:35:28.323791] [DEBUG] [LOCAL ] CARR: Loaded 53992 existing records from primary storage. [2025-10-16T22:35:28.323943] [INFO ] [MAIN ] CARR: Loaded 53992 primary data records. [2025-10-16T22:35:28.628061] [DEBUG] [MAIN ] CARR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:28.628744] [INFO ] [MAIN ] CARR: Generated 1807 derivative records from 53992 primary records. [2025-10-16T22:35:28.628808] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-16T22:35:28.643750] [DEBUG] [LOCAL ] CARR: Derivative data saved (1807 records). [2025-10-16T22:35:28.643813] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-16T22:35:28.645741] [INFO ] [MAIN ] Derivative Progress: 330/1803 symbols completed. CARR took 0.4s. Estimated remaining: 9m 31s. Rate: 154.8 symbols/min [2025-10-16T22:35:28.646367] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:28.646430] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:28.646263] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:28.657497] [DEBUG] [LOCAL ] CATO: Loaded 6736 existing records from primary storage. [2025-10-16T22:35:28.657754] [INFO ] [MAIN ] CATO: Loaded 6736 primary data records. [2025-10-16T22:35:28.902746] [DEBUG] [LOCAL ] CARS: Loaded 40101 existing records from primary storage. [2025-10-16T22:35:29.021788] [INFO ] [MAIN ] CARS: Loaded 40101 primary data records. [2025-10-16T22:35:29.152419] [DEBUG] [LOCAL ] CAT: Loaded 53348 existing records from primary storage. [2025-10-16T22:35:29.152822] [INFO ] [MAIN ] CAT: Loaded 53348 primary data records. [2025-10-16T22:35:29.686472] [DEBUG] [MAIN ] CATO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:29.689035] [INFO ] [MAIN ] CATO: Generated 1807 derivative records from 6736 primary records. [2025-10-16T22:35:29.689522] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-16T22:35:29.709770] [DEBUG] [LOCAL ] CATO: Derivative data saved (1807 records). [2025-10-16T22:35:29.710272] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-16T22:35:29.712781] [INFO ] [MAIN ] Derivative Progress: 331/1803 symbols completed. CATO took 1.1s. Estimated remaining: 9m 33s. Rate: 154.0 symbols/min [2025-10-16T22:35:29.714366] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:29.734887] [DEBUG] [MAIN ] CARS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:29.738774] [INFO ] [MAIN ] CARS: Generated 1807 derivative records from 40101 primary records. [2025-10-16T22:35:29.739937] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-16T22:35:29.764930] [DEBUG] [MAIN ] CAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:29.769615] [INFO ] [MAIN ] CAT: Generated 1807 derivative records from 53348 primary records. [2025-10-16T22:35:29.769862] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-16T22:35:29.803620] [DEBUG] [LOCAL ] CARS: Derivative data saved (1807 records). [2025-10-16T22:35:29.804328] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-16T22:35:29.806964] [INFO ] [MAIN ] Derivative Progress: 332/1803 symbols completed. CARS took 1.2s. Estimated remaining: 9m 32s. Rate: 154.4 symbols/min [2025-10-16T22:35:29.807206] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:29.810740] [DEBUG] [LOCAL ] CAT: Derivative data saved (1807 records). [2025-10-16T22:35:29.811034] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-16T22:35:29.813805] [INFO ] [MAIN ] Derivative Progress: 333/1803 symbols completed. CAT took 1.2s. Estimated remaining: 9m 30s. Rate: 154.8 symbols/min [2025-10-16T22:35:29.814790] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:29.830930] [DEBUG] [LOCAL ] CAVA: Loaded 53956 existing records from primary storage. [2025-10-16T22:35:29.831210] [INFO ] [MAIN ] CAVA: Loaded 53956 primary data records. [2025-10-16T22:35:29.941043] [DEBUG] [LOCAL ] CBAN: Loaded 10553 existing records from primary storage. [2025-10-16T22:35:29.944508] [INFO ] [MAIN ] CBAN: Loaded 10553 primary data records. [2025-10-16T22:35:30.292959] [DEBUG] [LOCAL ] CB: Loaded 50327 existing records from primary storage. [2025-10-16T22:35:30.329459] [INFO ] [MAIN ] CB: Loaded 50327 primary data records. [2025-10-16T22:35:30.880256] [DEBUG] [MAIN ] CAVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:30.885097] [INFO ] [MAIN ] CAVA: Generated 1807 derivative records from 53956 primary records. [2025-10-16T22:35:30.885750] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-10-16T22:35:30.915740] [DEBUG] [MAIN ] CBAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:30.916899] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1807 records). [2025-10-16T22:35:30.918422] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-10-16T22:35:30.921564] [INFO ] [MAIN ] Derivative Progress: 334/1803 symbols completed. CAVA took 1.2s. Estimated remaining: 9m 32s. Rate: 154.0 symbols/min [2025-10-16T22:35:30.917970] [INFO ] [MAIN ] CBAN: Generated 1807 derivative records from 10553 primary records. [2025-10-16T22:35:30.922068] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-16T22:35:30.922196] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:30.949638] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1807 records). [2025-10-16T22:35:30.949946] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-16T22:35:30.952553] [INFO ] [MAIN ] Derivative Progress: 335/1803 symbols completed. CBAN took 1.1s. Estimated remaining: 9m 31s. Rate: 154.4 symbols/min [2025-10-16T22:35:30.952935] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:30.972844] [DEBUG] [LOCAL ] CBL: Loaded 16377 existing records from primary storage. [2025-10-16T22:35:30.972440] [DEBUG] [MAIN ] CB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:30.974628] [INFO ] [MAIN ] CB: Generated 1807 derivative records from 50327 primary records. [2025-10-16T22:35:30.974803] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-16T22:35:30.974866] [INFO ] [MAIN ] CBL: Loaded 16377 primary data records. [2025-10-16T22:35:30.978851] [DEBUG] [LOCAL ] CBNA: Loaded 2936 existing records from primary storage. [2025-10-16T22:35:31.026339] [INFO ] [MAIN ] CBNA: Loaded 2936 primary data records. [2025-10-16T22:35:31.142884] [DEBUG] [LOCAL ] CB: Derivative data saved (1807 records). [2025-10-16T22:35:31.176506] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-16T22:35:31.184518] [INFO ] [MAIN ] Derivative Progress: 336/1803 symbols completed. CB took 1.4s. Estimated remaining: 9m 29s. Rate: 154.6 symbols/min [2025-10-16T22:35:31.208133] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:31.694231] [DEBUG] [LOCAL ] CBRE: Loaded 50735 existing records from primary storage. [2025-10-16T22:35:31.694773] [INFO ] [MAIN ] CBRE: Loaded 50735 primary data records. [2025-10-16T22:35:31.727993] [DEBUG] [MAIN ] CBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:31.737340] [INFO ] [MAIN ] CBL: Generated 1807 derivative records from 16377 primary records. [2025-10-16T22:35:31.754262] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-16T22:35:31.853258] [DEBUG] [LOCAL ] CBL: Derivative data saved (1807 records). [2025-10-16T22:35:31.872035] [DEBUG] [MAIN ] CBNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:31.882485] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-16T22:35:31.888564] [INFO ] [MAIN ] CBNA: Generated 1807 derivative records from 2936 primary records. [2025-10-16T22:35:31.891328] [INFO ] [MAIN ] Derivative Progress: 337/1803 symbols completed. CBL took 1.0s. Estimated remaining: 9m 30s. Rate: 154.2 symbols/min [2025-10-16T22:35:31.888701] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-16T22:35:31.897571] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:32.114292] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1807 records). [2025-10-16T22:35:32.114511] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-16T22:35:32.116955] [INFO ] [MAIN ] Derivative Progress: 338/1803 symbols completed. CBNA took 1.2s. Estimated remaining: 9m 29s. Rate: 154.4 symbols/min [2025-10-16T22:35:32.117439] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:32.157942] [DEBUG] [LOCAL ] CBT: Loaded 31366 existing records from primary storage. [2025-10-16T22:35:32.158543] [INFO ] [MAIN ] CBT: Loaded 31366 primary data records. [2025-10-16T22:35:32.226716] [DEBUG] [LOCAL ] CBU: Loaded 22932 existing records from primary storage. [2025-10-16T22:35:32.260768] [INFO ] [MAIN ] CBU: Loaded 22932 primary data records. [2025-10-16T22:35:32.398680] [DEBUG] [MAIN ] CBRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:32.460388] [INFO ] [MAIN ] CBRE: Generated 1807 derivative records from 50735 primary records. [2025-10-16T22:35:32.611341] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-16T22:35:32.881843] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1807 records). [2025-10-16T22:35:32.890397] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-16T22:35:32.893335] [INFO ] [MAIN ] Derivative Progress: 339/1803 symbols completed. CBRE took 1.7s. Estimated remaining: 9m 31s. Rate: 153.9 symbols/min [2025-10-16T22:35:32.893631] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:32.923696] [DEBUG] [MAIN ] CBT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:32.935291] [INFO ] [MAIN ] CBT: Generated 1807 derivative records from 31366 primary records. [2025-10-16T22:35:32.937008] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-16T22:35:32.987189] [DEBUG] [LOCAL ] CBZ: Loaded 34513 existing records from primary storage. [2025-10-16T22:35:32.985512] [DEBUG] [MAIN ] CBU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:32.987392] [INFO ] [MAIN ] CBZ: Loaded 34513 primary data records. [2025-10-16T22:35:32.988612] [INFO ] [MAIN ] CBU: Generated 1807 derivative records from 22932 primary records. [2025-10-16T22:35:32.985672] [DEBUG] [LOCAL ] CBT: Derivative data saved (1807 records). [2025-10-16T22:35:32.988807] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-16T22:35:32.988927] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-16T22:35:32.993332] [INFO ] [MAIN ] Derivative Progress: 340/1803 symbols completed. CBT took 1.1s. Estimated remaining: 9m 29s. Rate: 154.3 symbols/min [2025-10-16T22:35:33.047863] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:33.205551] [DEBUG] [LOCAL ] CBU: Derivative data saved (1807 records). [2025-10-16T22:35:33.312610] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-16T22:35:33.323802] [INFO ] [MAIN ] Derivative Progress: 341/1803 symbols completed. CBU took 1.2s. Estimated remaining: 9m 28s. Rate: 154.3 symbols/min [2025-10-16T22:35:33.324778] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:33.383691] [DEBUG] [LOCAL ] CC: Loaded 53400 existing records from primary storage. [2025-10-16T22:35:33.384401] [INFO ] [MAIN ] CC: Loaded 53400 primary data records. [2025-10-16T22:35:33.384309] [DEBUG] [MAIN ] CBZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:33.406410] [INFO ] [MAIN ] CBZ: Generated 1807 derivative records from 34513 primary records. [2025-10-16T22:35:33.421944] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-16T22:35:33.594730] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1807 records). [2025-10-16T22:35:33.616138] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-16T22:35:33.722124] [INFO ] [MAIN ] Derivative Progress: 342/1803 symbols completed. CBZ took 0.8s. Estimated remaining: 9m 28s. Rate: 154.3 symbols/min [2025-10-16T22:35:33.736574] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:33.739872] [DEBUG] [LOCAL ] CCI: Loaded 53506 existing records from primary storage. [2025-10-16T22:35:33.740876] [INFO ] [MAIN ] CCI: Loaded 53506 primary data records. [2025-10-16T22:35:33.877218] [DEBUG] [LOCAL ] CCIF: Loaded 15625 existing records from primary storage. [2025-10-16T22:35:33.919798] [INFO ] [MAIN ] CCIF: Loaded 15625 primary data records. [2025-10-16T22:35:34.277548] [DEBUG] [MAIN ] CC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:34.397550] [INFO ] [MAIN ] CC: Generated 1807 derivative records from 53400 primary records. [2025-10-16T22:35:34.397731] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-16T22:35:34.421324] [DEBUG] [LOCAL ] CC: Derivative data saved (1807 records). [2025-10-16T22:35:34.424127] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-16T22:35:34.426907] [INFO ] [MAIN ] Derivative Progress: 343/1803 symbols completed. CC took 1.4s. Estimated remaining: 9m 29s. Rate: 154.0 symbols/min [2025-10-16T22:35:34.440370] [DEBUG] [MAIN ] CCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:34.441402] [INFO ] [MAIN ] CCI: Generated 1807 derivative records from 53506 primary records. [2025-10-16T22:35:34.441796] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-16T22:35:34.461715] [DEBUG] [LOCAL ] CCI: Derivative data saved (1807 records). [2025-10-16T22:35:34.461878] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-16T22:35:34.464858] [INFO ] [MAIN ] Derivative Progress: 344/1803 symbols completed. CCI took 1.1s. Estimated remaining: 9m 27s. Rate: 154.4 symbols/min [2025-10-16T22:35:34.477192] [DEBUG] [MAIN ] CCIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:34.477856] [INFO ] [MAIN ] CCIF: Generated 1807 derivative records from 15625 primary records. [2025-10-16T22:35:34.477919] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-16T22:35:34.492519] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1807 records). [2025-10-16T22:35:34.492577] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-16T22:35:34.495122] [INFO ] [MAIN ] Derivative Progress: 345/1803 symbols completed. CCIF took 0.8s. Estimated remaining: 9m 25s. Rate: 154.8 symbols/min [2025-10-16T22:35:34.495628] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:34.495889] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:34.495992] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:34.605803] [DEBUG] [LOCAL ] CCK: Loaded 46797 existing records from primary storage. [2025-10-16T22:35:34.606163] [INFO ] [MAIN ] CCK: Loaded 46797 primary data records. [2025-10-16T22:35:34.607000] [DEBUG] [LOCAL ] CCL: Loaded 54190 existing records from primary storage. [2025-10-16T22:35:34.620485] [DEBUG] [LOCAL ] CCJ: Loaded 54078 existing records from primary storage. [2025-10-16T22:35:34.618625] [INFO ] [MAIN ] CCL: Loaded 54190 primary data records. [2025-10-16T22:35:34.646080] [INFO ] [MAIN ] CCJ: Loaded 54078 primary data records. [2025-10-16T22:35:35.614076] [DEBUG] [MAIN ] CCK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:35.640752] [DEBUG] [MAIN ] CCJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:35.640423] [INFO ] [MAIN ] CCK: Generated 1807 derivative records from 46797 primary records. [2025-10-16T22:35:35.641469] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-16T22:35:35.641343] [DEBUG] [MAIN ] CCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:35.643067] [INFO ] [MAIN ] CCJ: Generated 1807 derivative records from 54078 primary records. [2025-10-16T22:35:35.643921] [INFO ] [MAIN ] CCL: Generated 1807 derivative records from 54190 primary records. [2025-10-16T22:35:35.644374] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-16T22:35:35.644287] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-16T22:35:35.677091] [DEBUG] [LOCAL ] CCK: Derivative data saved (1807 records). [2025-10-16T22:35:35.679475] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-16T22:35:35.688673] [INFO ] [MAIN ] Derivative Progress: 346/1803 symbols completed. CCK took 1.2s. Estimated remaining: 9m 28s. Rate: 153.9 symbols/min [2025-10-16T22:35:35.689366] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:35.696834] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1807 records). [2025-10-16T22:35:35.699662] [DEBUG] [LOCAL ] CCL: Derivative data saved (1807 records). [2025-10-16T22:35:35.700029] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-16T22:35:35.699939] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-16T22:35:35.702596] [INFO ] [MAIN ] Derivative Progress: 347/1803 symbols completed. CCJ took 1.2s. Estimated remaining: 9m 26s. Rate: 154.3 symbols/min [2025-10-16T22:35:35.705524] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:35.706063] [INFO ] [MAIN ] Derivative Progress: 348/1803 symbols completed. CCL took 1.2s. Estimated remaining: 9m 24s. Rate: 154.7 symbols/min [2025-10-16T22:35:35.706245] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:35.717952] [DEBUG] [LOCAL ] CCRD: Loaded 9580 existing records from primary storage. [2025-10-16T22:35:35.718161] [INFO ] [MAIN ] CCRD: Loaded 9580 primary data records. [2025-10-16T22:35:35.913560] [DEBUG] [LOCAL ] CCS: Loaded 30488 existing records from primary storage. [2025-10-16T22:35:35.914587] [DEBUG] [LOCAL ] CCO: Loaded 48741 existing records from primary storage. [2025-10-16T22:35:36.040918] [INFO ] [MAIN ] CCO: Loaded 48741 primary data records. [2025-10-16T22:35:35.931459] [INFO ] [MAIN ] CCS: Loaded 30488 primary data records. [2025-10-16T22:35:36.702448] [DEBUG] [MAIN ] CCRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:36.703494] [INFO ] [MAIN ] CCRD: Generated 1807 derivative records from 9580 primary records. [2025-10-16T22:35:36.704456] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-16T22:35:36.722621] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1807 records). [2025-10-16T22:35:36.722864] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-16T22:35:36.724807] [INFO ] [MAIN ] Derivative Progress: 349/1803 symbols completed. CCRD took 1.0s. Estimated remaining: 9m 26s. Rate: 154.0 symbols/min [2025-10-16T22:35:36.725612] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:36.754762] [DEBUG] [MAIN ] CCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:36.761513] [INFO ] [MAIN ] CCS: Generated 1807 derivative records from 30488 primary records. [2025-10-16T22:35:36.761610] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-16T22:35:36.760848] [DEBUG] [MAIN ] CCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:36.763240] [INFO ] [MAIN ] CCO: Generated 1807 derivative records from 48741 primary records. [2025-10-16T22:35:36.779087] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-16T22:35:36.804256] [DEBUG] [LOCAL ] CCU: Loaded 22447 existing records from primary storage. [2025-10-16T22:35:36.803442] [DEBUG] [LOCAL ] CCO: Derivative data saved (1807 records). [2025-10-16T22:35:36.804608] [INFO ] [MAIN ] CCU: Loaded 22447 primary data records. [2025-10-16T22:35:36.805307] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-16T22:35:36.829620] [INFO ] [MAIN ] Derivative Progress: 350/1803 symbols completed. CCO took 1.1s. Estimated remaining: 9m 25s. Rate: 154.3 symbols/min [2025-10-16T22:35:36.841484] [DEBUG] [LOCAL ] CCS: Derivative data saved (1807 records). [2025-10-16T22:35:36.846738] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-16T22:35:36.866299] [INFO ] [MAIN ] Derivative Progress: 351/1803 symbols completed. CCS took 1.2s. Estimated remaining: 9m 23s. Rate: 154.7 symbols/min [2025-10-16T22:35:36.853531] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:36.893471] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:36.979021] [DEBUG] [LOCAL ] CDLR: Loaded 10199 existing records from primary storage. [2025-10-16T22:35:36.999330] [INFO ] [MAIN ] CDLR: Loaded 10199 primary data records. [2025-10-16T22:35:37.334903] [DEBUG] [LOCAL ] CDE: Loaded 54033 existing records from primary storage. [2025-10-16T22:35:37.360130] [INFO ] [MAIN ] CDE: Loaded 54033 primary data records. [2025-10-16T22:35:37.801477] [DEBUG] [MAIN ] CCU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:37.803819] [INFO ] [MAIN ] CCU: Generated 1807 derivative records from 22447 primary records. [2025-10-16T22:35:37.805710] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-16T22:35:37.835231] [DEBUG] [LOCAL ] CCU: Derivative data saved (1807 records). [2025-10-16T22:35:37.836147] [DEBUG] [MAIN ] CDLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:37.837406] [INFO ] [MAIN ] CDLR: Generated 1807 derivative records from 10199 primary records. [2025-10-16T22:35:37.837740] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-16T22:35:37.835579] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-16T22:35:37.839678] [INFO ] [MAIN ] Derivative Progress: 352/1803 symbols completed. CCU took 1.1s. Estimated remaining: 9m 25s. Rate: 154.1 symbols/min [2025-10-16T22:35:37.839944] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:37.857604] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1807 records). [2025-10-16T22:35:37.857954] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-16T22:35:37.860889] [INFO ] [MAIN ] Derivative Progress: 353/1803 symbols completed. CDLR took 1.0s. Estimated remaining: 9m 23s. Rate: 154.5 symbols/min [2025-10-16T22:35:37.861110] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:37.879304] [DEBUG] [MAIN ] CDE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:37.880014] [INFO ] [MAIN ] CDE: Generated 1807 derivative records from 54033 primary records. [2025-10-16T22:35:37.880124] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-16T22:35:37.910023] [DEBUG] [LOCAL ] CDE: Derivative data saved (1807 records). [2025-10-16T22:35:37.910221] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-16T22:35:37.912748] [INFO ] [MAIN ] Derivative Progress: 354/1803 symbols completed. CDE took 1.1s. Estimated remaining: 9m 21s. Rate: 154.9 symbols/min [2025-10-16T22:35:37.913053] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:37.923091] [DEBUG] [LOCAL ] CDRE: Loaded 25091 existing records from primary storage. [2025-10-16T22:35:37.923877] [INFO ] [MAIN ] CDRE: Loaded 25091 primary data records. [2025-10-16T22:35:37.972405] [DEBUG] [LOCAL ] CDP: Loaded 42851 existing records from primary storage. [2025-10-16T22:35:38.000164] [INFO ] [MAIN ] CDP: Loaded 42851 primary data records. [2025-10-16T22:35:38.562348] [DEBUG] [LOCAL ] CE: Loaded 51713 existing records from primary storage. [2025-10-16T22:35:38.563006] [INFO ] [MAIN ] CE: Loaded 51713 primary data records. [2025-10-16T22:35:38.934823] [DEBUG] [MAIN ] CDRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:38.943708] [INFO ] [MAIN ] CDRE: Generated 1807 derivative records from 25091 primary records. [2025-10-16T22:35:38.949175] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-16T22:35:38.949097] [DEBUG] [MAIN ] CDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:38.951076] [INFO ] [MAIN ] CDP: Generated 1807 derivative records from 42851 primary records. [2025-10-16T22:35:38.951247] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-16T22:35:38.981453] [DEBUG] [LOCAL ] CDP: Derivative data saved (1807 records). [2025-10-16T22:35:38.982063] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1807 records). [2025-10-16T22:35:38.981638] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-16T22:35:38.984902] [INFO ] [MAIN ] Derivative Progress: 355/1803 symbols completed. CDP took 1.1s. Estimated remaining: 9m 24s. Rate: 154.1 symbols/min [2025-10-16T22:35:38.982351] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-16T22:35:38.987158] [INFO ] [MAIN ] Derivative Progress: 356/1803 symbols completed. CDRE took 1.1s. Estimated remaining: 9m 22s. Rate: 154.5 symbols/min [2025-10-16T22:35:38.987069] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:38.987577] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:39.008908] [DEBUG] [LOCAL ] CEE: Loaded 5411 existing records from primary storage. [2025-10-16T22:35:39.009462] [INFO ] [MAIN ] CEE: Loaded 5411 primary data records. [2025-10-16T22:35:39.009396] [DEBUG] [MAIN ] CE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:39.030606] [INFO ] [MAIN ] CE: Generated 1807 derivative records from 51713 primary records. [2025-10-16T22:35:39.052450] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-16T22:35:39.188691] [DEBUG] [LOCAL ] CE: Derivative data saved (1807 records). [2025-10-16T22:35:39.217356] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-16T22:35:39.331135] [INFO ] [MAIN ] Derivative Progress: 357/1803 symbols completed. CE took 1.4s. Estimated remaining: 9m 21s. Rate: 154.6 symbols/min [2025-10-16T22:35:39.346014] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:39.362497] [DEBUG] [LOCAL ] CF: Loaded 52532 existing records from primary storage. [2025-10-16T22:35:39.362627] [INFO ] [MAIN ] CF: Loaded 52532 primary data records. [2025-10-16T22:35:39.705208] [DEBUG] [MAIN ] CEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:39.706814] [INFO ] [MAIN ] CEE: Generated 1807 derivative records from 5411 primary records. [2025-10-16T22:35:39.707190] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-16T22:35:39.724261] [DEBUG] [LOCAL ] CEE: Derivative data saved (1807 records). [2025-10-16T22:35:39.724827] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-10-16T22:35:39.743320] [INFO ] [MAIN ] Derivative Progress: 358/1803 symbols completed. CEE took 0.8s. Estimated remaining: 9m 21s. Rate: 154.6 symbols/min [2025-10-16T22:35:39.745192] [DEBUG] [LOCAL ] CFG: Loaded 54013 existing records from primary storage. [2025-10-16T22:35:39.745373] [INFO ] [MAIN ] CFG: Loaded 54013 primary data records. [2025-10-16T22:35:39.944669] [DEBUG] [MAIN ] CF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:40.059417] [INFO ] [MAIN ] CF: Generated 1807 derivative records from 52532 primary records. [2025-10-16T22:35:40.060220] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-16T22:35:40.078286] [DEBUG] [LOCAL ] CF: Derivative data saved (1807 records). [2025-10-16T22:35:40.078592] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-10-16T22:35:40.080923] [INFO ] [MAIN ] Derivative Progress: 359/1803 symbols completed. CF took 1.1s. Estimated remaining: 9m 20s. Rate: 154.6 symbols/min [2025-10-16T22:35:40.100451] [DEBUG] [MAIN ] CFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:40.101135] [INFO ] [MAIN ] CFG: Generated 1807 derivative records from 54013 primary records. [2025-10-16T22:35:40.101196] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-16T22:35:40.116313] [DEBUG] [LOCAL ] CFG: Derivative data saved (1807 records). [2025-10-16T22:35:40.116426] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-16T22:35:40.118490] [INFO ] [MAIN ] Derivative Progress: 360/1803 symbols completed. CFG took 0.8s. Estimated remaining: 9m 19s. Rate: 155.0 symbols/min [2025-10-16T22:35:40.119211] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:40.119158] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:40.119442] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:40.126331] [DEBUG] [LOCAL ] CGV: Loaded 1404 existing records from primary storage. [2025-10-16T22:35:40.126563] [INFO ] [MAIN ] CGV: Loaded 1404 primary data records. [2025-10-16T22:35:40.477550] [DEBUG] [LOCAL ] CFR: Loaded 32885 existing records from primary storage. [2025-10-16T22:35:40.488811] [INFO ] [MAIN ] CFR: Loaded 32885 primary data records. [2025-10-16T22:35:40.512503] [DEBUG] [LOCAL ] CGAU: Loaded 43931 existing records from primary storage. [2025-10-16T22:35:40.529564] [INFO ] [MAIN ] CGAU: Loaded 43931 primary data records. [2025-10-16T22:35:41.198814] [DEBUG] [MAIN ] CGV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:35:41.201027] [INFO ] [MAIN ] CGV: Generated 1806 derivative records from 1404 primary records. [2025-10-16T22:35:41.201421] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-16T22:35:41.219517] [DEBUG] [LOCAL ] CGV: Derivative data saved (1806 records). [2025-10-16T22:35:41.220512] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-16T22:35:41.222924] [INFO ] [MAIN ] Derivative Progress: 361/1803 symbols completed. CGV took 1.1s. Estimated remaining: 9m 21s. Rate: 154.2 symbols/min [2025-10-16T22:35:41.223402] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:41.252434] [DEBUG] [MAIN ] CFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:41.255246] [INFO ] [MAIN ] CFR: Generated 1807 derivative records from 32885 primary records. [2025-10-16T22:35:41.255479] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-10-16T22:35:41.290889] [DEBUG] [LOCAL ] CFR: Derivative data saved (1807 records). [2025-10-16T22:35:41.291460] [DEBUG] [MAIN ] CGAU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:41.292533] [DEBUG] [LOCAL ] CHCT: Loaded 24391 existing records from primary storage. [2025-10-16T22:35:41.292175] [INFO ] [MAIN ] CGAU: Generated 1807 derivative records from 43931 primary records. [2025-10-16T22:35:41.291171] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-10-16T22:35:41.294991] [INFO ] [MAIN ] Derivative Progress: 362/1803 symbols completed. CFR took 1.2s. Estimated remaining: 9m 19s. Rate: 154.6 symbols/min [2025-10-16T22:35:41.295117] [INFO ] [MAIN ] CHCT: Loaded 24391 primary data records. [2025-10-16T22:35:41.295360] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-16T22:35:41.295214] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:41.427135] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1807 records). [2025-10-16T22:35:41.464208] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-16T22:35:41.490267] [INFO ] [MAIN ] Derivative Progress: 363/1803 symbols completed. CGAU took 1.4s. Estimated remaining: 9m 18s. Rate: 154.8 symbols/min [2025-10-16T22:35:41.604317] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:41.664363] [DEBUG] [LOCAL ] CHE: Loaded 15454 existing records from primary storage. [2025-10-16T22:35:41.663981] [DEBUG] [LOCAL ] CHD: Loaded 52698 existing records from primary storage. [2025-10-16T22:35:41.664610] [INFO ] [MAIN ] CHE: Loaded 15454 primary data records. [2025-10-16T22:35:41.676006] [INFO ] [MAIN ] CHD: Loaded 52698 primary data records. [2025-10-16T22:35:41.884407] [DEBUG] [MAIN ] CHCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:41.937396] [INFO ] [MAIN ] CHCT: Generated 1807 derivative records from 24391 primary records. [2025-10-16T22:35:42.010476] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-10-16T22:35:42.293760] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1807 records). [2025-10-16T22:35:42.294244] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-10-16T22:35:42.296500] [INFO ] [MAIN ] Derivative Progress: 364/1803 symbols completed. CHCT took 1.1s. Estimated remaining: 9m 20s. Rate: 154.3 symbols/min [2025-10-16T22:35:42.297097] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:42.322841] [DEBUG] [MAIN ] CHE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:42.335203] [DEBUG] [MAIN ] CHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:42.336547] [INFO ] [MAIN ] CHD: Generated 1807 derivative records from 52698 primary records. [2025-10-16T22:35:42.335934] [INFO ] [MAIN ] CHE: Generated 1807 derivative records from 15454 primary records. [2025-10-16T22:35:42.336734] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-16T22:35:42.337176] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-16T22:35:42.362695] [DEBUG] [LOCAL ] CHE: Derivative data saved (1807 records). [2025-10-16T22:35:42.371059] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-16T22:35:42.373533] [INFO ] [MAIN ] Derivative Progress: 365/1803 symbols completed. CHE took 0.8s. Estimated remaining: 9m 18s. Rate: 154.6 symbols/min [2025-10-16T22:35:42.376754] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:42.380728] [DEBUG] [LOCAL ] CHD: Derivative data saved (1807 records). [2025-10-16T22:35:42.380912] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-16T22:35:42.383045] [INFO ] [MAIN ] Derivative Progress: 366/1803 symbols completed. CHD took 1.1s. Estimated remaining: 9m 16s. Rate: 155.1 symbols/min [2025-10-16T22:35:42.383329] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:42.400290] [DEBUG] [LOCAL ] CHGG: Loaded 48094 existing records from primary storage. [2025-10-16T22:35:42.403194] [INFO ] [MAIN ] CHGG: Loaded 48094 primary data records. [2025-10-16T22:35:42.403417] [DEBUG] [LOCAL ] CHN: Loaded 5044 existing records from primary storage. [2025-10-16T22:35:42.403522] [INFO ] [MAIN ] CHN: Loaded 5044 primary data records. [2025-10-16T22:35:42.773443] [DEBUG] [LOCAL ] CHH: Loaded 32689 existing records from primary storage. [2025-10-16T22:35:43.050437] [INFO ] [MAIN ] CHH: Loaded 32689 primary data records. [2025-10-16T22:35:43.415714] [DEBUG] [MAIN ] CHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:43.415437] [DEBUG] [MAIN ] CHGG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:43.416607] [INFO ] [MAIN ] CHGG: Generated 1807 derivative records from 48094 primary records. [2025-10-16T22:35:43.417180] [INFO ] [MAIN ] CHN: Generated 1807 derivative records from 5044 primary records. [2025-10-16T22:35:43.417369] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-16T22:35:43.417438] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-10-16T22:35:43.447861] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1807 records). [2025-10-16T22:35:43.448730] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-10-16T22:35:43.451959] [INFO ] [MAIN ] Derivative Progress: 367/1803 symbols completed. CHGG took 1.2s. Estimated remaining: 9m 18s. Rate: 154.3 symbols/min [2025-10-16T22:35:43.452360] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:43.452897] [DEBUG] [LOCAL ] CHN: Derivative data saved (1807 records). [2025-10-16T22:35:43.453221] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-10-16T22:35:43.455165] [INFO ] [MAIN ] Derivative Progress: 368/1803 symbols completed. CHN took 1.1s. Estimated remaining: 9m 16s. Rate: 154.7 symbols/min [2025-10-16T22:35:43.455671] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:43.472736] [DEBUG] [MAIN ] CHH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:43.473416] [INFO ] [MAIN ] CHH: Generated 1807 derivative records from 32689 primary records. [2025-10-16T22:35:43.473494] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-16T22:35:43.489333] [DEBUG] [LOCAL ] CHH: Derivative data saved (1807 records). [2025-10-16T22:35:43.493746] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-16T22:35:43.496138] [INFO ] [MAIN ] Derivative Progress: 369/1803 symbols completed. CHH took 1.1s. Estimated remaining: 9m 15s. Rate: 155.1 symbols/min [2025-10-16T22:35:43.496414] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:43.509220] [DEBUG] [LOCAL ] CHT: Loaded 19654 existing records from primary storage. [2025-10-16T22:35:43.509345] [INFO ] [MAIN ] CHT: Loaded 19654 primary data records. [2025-10-16T22:35:43.720961] [DEBUG] [LOCAL ] CHWY: Loaded 54045 existing records from primary storage. [2025-10-16T22:35:43.834493] [INFO ] [MAIN ] CHWY: Loaded 54045 primary data records. [2025-10-16T22:35:43.977429] [DEBUG] [LOCAL ] CI: Loaded 50066 existing records from primary storage. [2025-10-16T22:35:43.993604] [INFO ] [MAIN ] CI: Loaded 50066 primary data records. [2025-10-16T22:35:44.498736] [DEBUG] [MAIN ] CHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:44.500216] [INFO ] [MAIN ] CHT: Generated 1807 derivative records from 19654 primary records. [2025-10-16T22:35:44.500430] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-10-16T22:35:44.519110] [DEBUG] [LOCAL ] CHT: Derivative data saved (1807 records). [2025-10-16T22:35:44.519360] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-10-16T22:35:44.521410] [INFO ] [MAIN ] Derivative Progress: 370/1803 symbols completed. CHT took 1.1s. Estimated remaining: 9m 17s. Rate: 154.4 symbols/min [2025-10-16T22:35:44.521603] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:44.535298] [DEBUG] [MAIN ] CHWY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:44.536120] [INFO ] [MAIN ] CHWY: Generated 1807 derivative records from 54045 primary records. [2025-10-16T22:35:44.536229] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-10-16T22:35:44.558578] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1807 records). [2025-10-16T22:35:44.565382] [DEBUG] [LOCAL ] CIA: Loaded 16720 existing records from primary storage. [2025-10-16T22:35:44.564444] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-10-16T22:35:44.567712] [INFO ] [MAIN ] CIA: Loaded 16720 primary data records. [2025-10-16T22:35:44.567612] [INFO ] [MAIN ] Derivative Progress: 371/1803 symbols completed. CHWY took 1.1s. Estimated remaining: 9m 15s. Rate: 154.8 symbols/min [2025-10-16T22:35:44.590208] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:44.727142] [DEBUG] [MAIN ] CI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:44.745269] [INFO ] [MAIN ] CI: Generated 1807 derivative records from 50066 primary records. [2025-10-16T22:35:44.769168] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-10-16T22:35:44.951881] [DEBUG] [LOCAL ] CI: Derivative data saved (1807 records). [2025-10-16T22:35:44.953636] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-10-16T22:35:44.956478] [INFO ] [MAIN ] Derivative Progress: 372/1803 symbols completed. CI took 1.5s. Estimated remaining: 9m 15s. Rate: 154.8 symbols/min [2025-10-16T22:35:44.956837] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:44.958044] [DEBUG] [LOCAL ] CIB: Loaded 30684 existing records from primary storage. [2025-10-16T22:35:44.958691] [INFO ] [MAIN ] CIB: Loaded 30684 primary data records. [2025-10-16T22:35:45.285513] [DEBUG] [MAIN ] CIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:45.286919] [INFO ] [MAIN ] CIA: Generated 1807 derivative records from 16720 primary records. [2025-10-16T22:35:45.303366] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-16T22:35:45.316152] [DEBUG] [LOCAL ] CIEN: Loaded 52535 existing records from primary storage. [2025-10-16T22:35:45.321067] [INFO ] [MAIN ] CIEN: Loaded 52535 primary data records. [2025-10-16T22:35:45.334888] [DEBUG] [LOCAL ] CIA: Derivative data saved (1807 records). [2025-10-16T22:35:45.394232] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-16T22:35:45.408696] [INFO ] [MAIN ] Derivative Progress: 373/1803 symbols completed. CIA took 0.9s. Estimated remaining: 9m 15s. Rate: 154.7 symbols/min [2025-10-16T22:35:45.521831] [DEBUG] [MAIN ] CIB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:45.634404] [INFO ] [MAIN ] CIB: Generated 1807 derivative records from 30684 primary records. [2025-10-16T22:35:45.634983] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-10-16T22:35:45.652333] [DEBUG] [LOCAL ] CIB: Derivative data saved (1807 records). [2025-10-16T22:35:45.652836] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-10-16T22:35:45.655129] [INFO ] [MAIN ] Derivative Progress: 374/1803 symbols completed. CIB took 1.1s. Estimated remaining: 9m 14s. Rate: 154.9 symbols/min [2025-10-16T22:35:45.674316] [DEBUG] [MAIN ] CIEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:45.674920] [INFO ] [MAIN ] CIEN: Generated 1807 derivative records from 52535 primary records. [2025-10-16T22:35:45.674981] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-10-16T22:35:45.689838] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1807 records). [2025-10-16T22:35:45.689901] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-10-16T22:35:45.691948] [INFO ] [MAIN ] Derivative Progress: 375/1803 symbols completed. CIEN took 0.7s. Estimated remaining: 9m 12s. Rate: 155.2 symbols/min [2025-10-16T22:35:45.692610] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:45.692935] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:45.692496] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:45.699683] [DEBUG] [LOCAL ] CIF: Loaded 4057 existing records from primary storage. [2025-10-16T22:35:45.699985] [INFO ] [MAIN ] CIF: Loaded 4057 primary data records. [2025-10-16T22:35:45.808703] [DEBUG] [LOCAL ] CII: Loaded 15443 existing records from primary storage. [2025-10-16T22:35:45.819542] [INFO ] [MAIN ] CII: Loaded 15443 primary data records. [2025-10-16T22:35:45.964227] [DEBUG] [LOCAL ] CIM: Loaded 37990 existing records from primary storage. [2025-10-16T22:35:46.002769] [INFO ] [MAIN ] CIM: Loaded 37990 primary data records. [2025-10-16T22:35:46.719356] [DEBUG] [MAIN ] CIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:46.720585] [INFO ] [MAIN ] CIF: Generated 1807 derivative records from 4057 primary records. [2025-10-16T22:35:46.720730] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-16T22:35:46.752860] [DEBUG] [MAIN ] CII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:46.755424] [INFO ] [MAIN ] CII: Generated 1807 derivative records from 15443 primary records. [2025-10-16T22:35:46.756694] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-16T22:35:46.758608] [DEBUG] [LOCAL ] CIF: Derivative data saved (1807 records). [2025-10-16T22:35:46.761214] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-16T22:35:46.763591] [INFO ] [MAIN ] Derivative Progress: 376/1803 symbols completed. CIF took 1.1s. Estimated remaining: 9m 14s. Rate: 154.5 symbols/min [2025-10-16T22:35:46.773561] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:46.786560] [DEBUG] [MAIN ] CIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:46.787726] [INFO ] [MAIN ] CIM: Generated 1807 derivative records from 37990 primary records. [2025-10-16T22:35:46.787911] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-10-16T22:35:46.798060] [DEBUG] [LOCAL ] CII: Derivative data saved (1807 records). [2025-10-16T22:35:46.798548] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-10-16T22:35:46.808406] [INFO ] [MAIN ] Derivative Progress: 377/1803 symbols completed. CII took 1.1s. Estimated remaining: 9m 12s. Rate: 154.9 symbols/min [2025-10-16T22:35:46.812615] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:46.817226] [DEBUG] [LOCAL ] CIM: Derivative data saved (1807 records). [2025-10-16T22:35:46.820011] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-10-16T22:35:46.819925] [DEBUG] [LOCAL ] CIMN: Loaded 2780 existing records from primary storage. [2025-10-16T22:35:46.823071] [INFO ] [MAIN ] Derivative Progress: 378/1803 symbols completed. CIM took 1.1s. Estimated remaining: 9m 11s. Rate: 155.3 symbols/min [2025-10-16T22:35:46.824149] [INFO ] [MAIN ] CIMN: Loaded 2780 primary data records. [2025-10-16T22:35:46.823352] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:46.953521] [DEBUG] [LOCAL ] CINT: Loaded 20157 existing records from primary storage. [2025-10-16T22:35:46.965422] [INFO ] [MAIN ] CINT: Loaded 20157 primary data records. [2025-10-16T22:35:47.493548] [DEBUG] [LOCAL ] CIVI: Loaded 53088 existing records from primary storage. [2025-10-16T22:35:47.499174] [INFO ] [MAIN ] CIVI: Loaded 53088 primary data records. [2025-10-16T22:35:47.830998] [DEBUG] [MAIN ] CIMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:47.833594] [INFO ] [MAIN ] CIMN: Generated 1807 derivative records from 2780 primary records. [2025-10-16T22:35:47.833791] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-10-16T22:35:47.857520] [DEBUG] [MAIN ] CINT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:47.861573] [INFO ] [MAIN ] CINT: Generated 1807 derivative records from 20157 primary records. [2025-10-16T22:35:47.862477] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1807 records). [2025-10-16T22:35:47.862204] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-10-16T22:35:47.862578] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-10-16T22:35:47.865638] [INFO ] [MAIN ] Derivative Progress: 379/1803 symbols completed. CIMN took 1.1s. Estimated remaining: 9m 13s. Rate: 154.6 symbols/min [2025-10-16T22:35:47.866785] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:47.882508] [DEBUG] [LOCAL ] CINT: Derivative data saved (1807 records). [2025-10-16T22:35:47.882822] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-10-16T22:35:47.885084] [INFO ] [MAIN ] Derivative Progress: 380/1803 symbols completed. CINT took 1.1s. Estimated remaining: 9m 11s. Rate: 155.0 symbols/min [2025-10-16T22:35:47.885396] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:47.902956] [DEBUG] [MAIN ] CIVI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:47.903699] [INFO ] [MAIN ] CIVI: Generated 1807 derivative records from 53088 primary records. [2025-10-16T22:35:47.903823] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-16T22:35:47.941008] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1807 records). [2025-10-16T22:35:47.941147] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-16T22:35:47.943726] [INFO ] [MAIN ] Derivative Progress: 381/1803 symbols completed. CIVI took 1.1s. Estimated remaining: 9m 9s. Rate: 155.3 symbols/min [2025-10-16T22:35:47.943958] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:47.959458] [DEBUG] [LOCAL ] CLB: Loaded 33709 existing records from primary storage. [2025-10-16T22:35:47.974317] [INFO ] [MAIN ] CLB: Loaded 33709 primary data records. [2025-10-16T22:35:47.995632] [DEBUG] [LOCAL ] CL: Loaded 54039 existing records from primary storage. [2025-10-16T22:35:48.037702] [INFO ] [MAIN ] CL: Loaded 54039 primary data records. [2025-10-16T22:35:48.132586] [DEBUG] [LOCAL ] CLDT: Loaded 25627 existing records from primary storage. [2025-10-16T22:35:48.186136] [INFO ] [MAIN ] CLDT: Loaded 25627 primary data records. [2025-10-16T22:35:48.939055] [DEBUG] [MAIN ] CLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:48.941245] [INFO ] [MAIN ] CLB: Generated 1807 derivative records from 33709 primary records. [2025-10-16T22:35:48.942130] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-16T22:35:48.971847] [DEBUG] [LOCAL ] CLB: Derivative data saved (1807 records). [2025-10-16T22:35:48.972319] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-10-16T22:35:48.972613] [DEBUG] [MAIN ] CL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:48.975732] [INFO ] [MAIN ] CL: Generated 1807 derivative records from 54039 primary records. [2025-10-16T22:35:48.975943] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-10-16T22:35:48.974870] [INFO ] [MAIN ] Derivative Progress: 382/1803 symbols completed. CLB took 1.1s. Estimated remaining: 9m 11s. Rate: 154.6 symbols/min [2025-10-16T22:35:48.976960] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:48.994189] [DEBUG] [LOCAL ] CL: Derivative data saved (1807 records). [2025-10-16T22:35:48.994344] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-10-16T22:35:48.997425] [INFO ] [MAIN ] Derivative Progress: 383/1803 symbols completed. CL took 1.1s. Estimated remaining: 9m 10s. Rate: 155.0 symbols/min [2025-10-16T22:35:48.997966] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:49.014391] [DEBUG] [MAIN ] CLDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:49.015172] [INFO ] [MAIN ] CLDT: Generated 1807 derivative records from 25627 primary records. [2025-10-16T22:35:49.015366] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-16T22:35:49.038795] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1807 records). [2025-10-16T22:35:49.039224] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-16T22:35:49.053850] [INFO ] [MAIN ] Derivative Progress: 384/1803 symbols completed. CLDT took 1.1s. Estimated remaining: 9m 8s. Rate: 155.4 symbols/min [2025-10-16T22:35:49.054148] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:49.068731] [DEBUG] [LOCAL ] CLH: Loaded 28054 existing records from primary storage. [2025-10-16T22:35:49.069061] [INFO ] [MAIN ] CLH: Loaded 28054 primary data records. [2025-10-16T22:35:49.189614] [DEBUG] [LOCAL ] CLF: Loaded 54131 existing records from primary storage. [2025-10-16T22:35:49.190477] [INFO ] [MAIN ] CLF: Loaded 54131 primary data records. [2025-10-16T22:35:49.609215] [DEBUG] [LOCAL ] CLS: Loaded 53972 existing records from primary storage. [2025-10-16T22:35:49.727970] [INFO ] [MAIN ] CLS: Loaded 53972 primary data records. [2025-10-16T22:35:50.077869] [DEBUG] [MAIN ] CLH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:50.079021] [INFO ] [MAIN ] CLH: Generated 1807 derivative records from 28054 primary records. [2025-10-16T22:35:50.081193] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-16T22:35:50.113450] [DEBUG] [MAIN ] CLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:50.117883] [INFO ] [MAIN ] CLF: Generated 1807 derivative records from 54131 primary records. [2025-10-16T22:35:50.118270] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-16T22:35:50.121028] [DEBUG] [LOCAL ] CLH: Derivative data saved (1807 records). [2025-10-16T22:35:50.121365] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-16T22:35:50.125252] [INFO ] [MAIN ] Derivative Progress: 385/1803 symbols completed. CLH took 1.1s. Estimated remaining: 9m 10s. Rate: 154.7 symbols/min [2025-10-16T22:35:50.132808] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:50.142428] [DEBUG] [LOCAL ] CLF: Derivative data saved (1807 records). [2025-10-16T22:35:50.142734] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-10-16T22:35:50.146989] [INFO ] [MAIN ] Derivative Progress: 386/1803 symbols completed. CLF took 1.2s. Estimated remaining: 9m 8s. Rate: 155.0 symbols/min [2025-10-16T22:35:50.147314] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:50.164666] [DEBUG] [MAIN ] CLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:50.165531] [INFO ] [MAIN ] CLS: Generated 1807 derivative records from 53972 primary records. [2025-10-16T22:35:50.165783] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-10-16T22:35:50.200416] [DEBUG] [LOCAL ] CLS: Derivative data saved (1807 records). [2025-10-16T22:35:50.200613] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-10-16T22:35:50.203074] [INFO ] [MAIN ] Derivative Progress: 387/1803 symbols completed. CLS took 1.1s. Estimated remaining: 9m 7s. Rate: 155.4 symbols/min [2025-10-16T22:35:50.203262] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:50.213828] [DEBUG] [LOCAL ] CLW: Loaded 21658 existing records from primary storage. [2025-10-16T22:35:50.214143] [INFO ] [MAIN ] CLW: Loaded 21658 primary data records. [2025-10-16T22:35:50.264337] [DEBUG] [LOCAL ] CLVT: Loaded 52319 existing records from primary storage. [2025-10-16T22:35:50.291225] [INFO ] [MAIN ] CLVT: Loaded 52319 primary data records. [2025-10-16T22:35:50.898555] [DEBUG] [LOCAL ] CM: Loaded 49077 existing records from primary storage. [2025-10-16T22:35:50.913824] [INFO ] [MAIN ] CM: Loaded 49077 primary data records. [2025-10-16T22:35:51.233754] [DEBUG] [MAIN ] CLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:51.235401] [INFO ] [MAIN ] CLW: Generated 1807 derivative records from 21658 primary records. [2025-10-16T22:35:51.235854] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-16T22:35:51.253245] [DEBUG] [LOCAL ] CLW: Derivative data saved (1807 records). [2025-10-16T22:35:51.254354] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-16T22:35:51.257027] [INFO ] [MAIN ] Derivative Progress: 388/1803 symbols completed. CLW took 1.1s. Estimated remaining: 9m 9s. Rate: 154.7 symbols/min [2025-10-16T22:35:51.272203] [DEBUG] [MAIN ] CLVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:51.273013] [INFO ] [MAIN ] CLVT: Generated 1807 derivative records from 52319 primary records. [2025-10-16T22:35:51.273095] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-16T22:35:51.289792] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1807 records). [2025-10-16T22:35:51.290090] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-10-16T22:35:51.294489] [INFO ] [MAIN ] Derivative Progress: 389/1803 symbols completed. CLVT took 1.2s. Estimated remaining: 9m 7s. Rate: 155.0 symbols/min [2025-10-16T22:35:51.307778] [DEBUG] [MAIN ] CM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:51.308358] [INFO ] [MAIN ] CM: Generated 1807 derivative records from 49077 primary records. [2025-10-16T22:35:51.308420] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-16T22:35:51.323196] [DEBUG] [LOCAL ] CM: Derivative data saved (1807 records). [2025-10-16T22:35:51.323261] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-16T22:35:51.325859] [INFO ] [MAIN ] Derivative Progress: 390/1803 symbols completed. CM took 1.1s. Estimated remaining: 9m 6s. Rate: 155.4 symbols/min [2025-10-16T22:35:51.326361] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:51.326484] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:51.327022] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:51.358701] [DEBUG] [LOCAL ] CMBT: Loaded 26529 existing records from primary storage. [2025-10-16T22:35:51.369007] [INFO ] [MAIN ] CMBT: Loaded 26529 primary data records. [2025-10-16T22:35:51.490300] [DEBUG] [LOCAL ] CMC: Loaded 45871 existing records from primary storage. [2025-10-16T22:35:51.495779] [INFO ] [MAIN ] CMC: Loaded 45871 primary data records. [2025-10-16T22:35:51.678220] [DEBUG] [LOCAL ] CMA: Loaded 50512 existing records from primary storage. [2025-10-16T22:35:51.809367] [INFO ] [MAIN ] CMA: Loaded 50512 primary data records. [2025-10-16T22:35:52.357437] [DEBUG] [MAIN ] CMBT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:52.360551] [INFO ] [MAIN ] CMBT: Generated 1807 derivative records from 26529 primary records. [2025-10-16T22:35:52.361575] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-16T22:35:52.388064] [DEBUG] [MAIN ] CMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:52.390982] [INFO ] [MAIN ] CMC: Generated 1807 derivative records from 45871 primary records. [2025-10-16T22:35:52.391552] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-16T22:35:52.394859] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1807 records). [2025-10-16T22:35:52.394998] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-16T22:35:52.397674] [INFO ] [MAIN ] Derivative Progress: 391/1803 symbols completed. CMBT took 1.1s. Estimated remaining: 9m 8s. Rate: 154.7 symbols/min [2025-10-16T22:35:52.405190] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:52.426138] [DEBUG] [LOCAL ] CMC: Derivative data saved (1807 records). [2025-10-16T22:35:52.426634] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-16T22:35:52.429552] [INFO ] [MAIN ] Derivative Progress: 392/1803 symbols completed. CMC took 1.1s. Estimated remaining: 9m 6s. Rate: 155.1 symbols/min [2025-10-16T22:35:52.426965] [DEBUG] [MAIN ] CMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:52.429754] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:52.431048] [INFO ] [MAIN ] CMA: Generated 1807 derivative records from 50512 primary records. [2025-10-16T22:35:52.431332] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-10-16T22:35:52.450860] [DEBUG] [LOCAL ] CMA: Derivative data saved (1807 records). [2025-10-16T22:35:52.451063] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-10-16T22:35:52.453386] [INFO ] [MAIN ] Derivative Progress: 393/1803 symbols completed. CMA took 1.1s. Estimated remaining: 9m 4s. Rate: 155.4 symbols/min [2025-10-16T22:35:52.453638] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:52.521017] [DEBUG] [LOCAL ] CMG: Loaded 54111 existing records from primary storage. [2025-10-16T22:35:52.521744] [DEBUG] [LOCAL ] CMI: Loaded 42011 existing records from primary storage. [2025-10-16T22:35:52.522025] [INFO ] [MAIN ] CMG: Loaded 54111 primary data records. [2025-10-16T22:35:52.522271] [INFO ] [MAIN ] CMI: Loaded 42011 primary data records. [2025-10-16T22:35:52.670220] [DEBUG] [LOCAL ] CMP: Loaded 36020 existing records from primary storage. [2025-10-16T22:35:52.693376] [INFO ] [MAIN ] CMP: Loaded 36020 primary data records. [2025-10-16T22:35:53.535752] [DEBUG] [MAIN ] CMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:53.537091] [INFO ] [MAIN ] CMI: Generated 1807 derivative records from 42011 primary records. [2025-10-16T22:35:53.537436] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-16T22:35:53.551902] [DEBUG] [MAIN ] CMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:53.567930] [INFO ] [MAIN ] CMG: Generated 1807 derivative records from 54111 primary records. [2025-10-16T22:35:53.569076] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-10-16T22:35:53.597479] [DEBUG] [LOCAL ] CMI: Derivative data saved (1807 records). [2025-10-16T22:35:53.597988] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-16T22:35:53.597823] [DEBUG] [MAIN ] CMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:53.601673] [INFO ] [MAIN ] CMP: Generated 1807 derivative records from 36020 primary records. [2025-10-16T22:35:53.602464] [DEBUG] [LOCAL ] CMG: Derivative data saved (1807 records). [2025-10-16T22:35:53.602628] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-16T22:35:53.605058] [INFO ] [MAIN ] Derivative Progress: 394/1803 symbols completed. CMI took 1.2s. Estimated remaining: 9m 7s. Rate: 154.7 symbols/min [2025-10-16T22:35:53.605427] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-10-16T22:35:53.605789] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:53.609151] [INFO ] [MAIN ] Derivative Progress: 395/1803 symbols completed. CMG took 1.2s. Estimated remaining: 9m 5s. Rate: 155.1 symbols/min [2025-10-16T22:35:53.616591] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:53.628023] [DEBUG] [LOCAL ] CMP: Derivative data saved (1807 records). [2025-10-16T22:35:53.628098] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-16T22:35:53.630602] [INFO ] [MAIN ] Derivative Progress: 396/1803 symbols completed. CMP took 1.2s. Estimated remaining: 9m 3s. Rate: 155.4 symbols/min [2025-10-16T22:35:53.631170] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:53.682927] [DEBUG] [LOCAL ] CMRE: Loaded 36175 existing records from primary storage. [2025-10-16T22:35:53.683120] [INFO ] [MAIN ] CMRE: Loaded 36175 primary data records. [2025-10-16T22:35:53.683874] [DEBUG] [LOCAL ] CMPO: Loaded 39076 existing records from primary storage. [2025-10-16T22:35:53.695778] [INFO ] [MAIN ] CMPO: Loaded 39076 primary data records. [2025-10-16T22:35:54.065505] [DEBUG] [LOCAL ] CMS: Loaded 52994 existing records from primary storage. [2025-10-16T22:35:54.216454] [INFO ] [MAIN ] CMS: Loaded 52994 primary data records. [2025-10-16T22:35:54.726957] [DEBUG] [MAIN ] CMRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:54.730017] [INFO ] [MAIN ] CMRE: Generated 1807 derivative records from 36175 primary records. [2025-10-16T22:35:54.730603] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-16T22:35:54.745566] [DEBUG] [MAIN ] CMPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:54.746410] [INFO ] [MAIN ] CMPO: Generated 1807 derivative records from 39076 primary records. [2025-10-16T22:35:54.746711] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-16T22:35:54.773538] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1807 records). [2025-10-16T22:35:54.777439] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-16T22:35:54.779592] [INFO ] [MAIN ] Derivative Progress: 397/1803 symbols completed. CMRE took 1.2s. Estimated remaining: 9m 5s. Rate: 154.7 symbols/min [2025-10-16T22:35:54.781087] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:54.789486] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1807 records). [2025-10-16T22:35:54.794214] [DEBUG] [LOCAL ] CMSA: Loaded 3562 existing records from primary storage. [2025-10-16T22:35:54.794412] [INFO ] [MAIN ] CMSA: Loaded 3562 primary data records. [2025-10-16T22:35:54.793989] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-16T22:35:54.802175] [INFO ] [MAIN ] Derivative Progress: 398/1803 symbols completed. CMPO took 1.2s. Estimated remaining: 9m 4s. Rate: 155.0 symbols/min [2025-10-16T22:35:54.855760] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:54.884834] [DEBUG] [MAIN ] CMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:54.897157] [INFO ] [MAIN ] CMS: Generated 1807 derivative records from 52994 primary records. [2025-10-16T22:35:54.902528] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-10-16T22:35:54.947727] [DEBUG] [LOCAL ] CMS: Derivative data saved (1807 records). [2025-10-16T22:35:54.959259] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-10-16T22:35:55.001077] [INFO ] [MAIN ] Derivative Progress: 399/1803 symbols completed. CMS took 1.4s. Estimated remaining: 9m 3s. Rate: 155.2 symbols/min [2025-10-16T22:35:55.007876] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:55.029417] [DEBUG] [LOCAL ] CMSC: Loaded 4906 existing records from primary storage. [2025-10-16T22:35:55.034123] [INFO ] [MAIN ] CMSC: Loaded 4906 primary data records. [2025-10-16T22:35:55.235841] [DEBUG] [LOCAL ] CMSD: Loaded 7871 existing records from primary storage. [2025-10-16T22:35:55.254295] [INFO ] [MAIN ] CMSD: Loaded 7871 primary data records. [2025-10-16T22:35:55.767388] [DEBUG] [MAIN ] CMSA: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:35:55.768211] [INFO ] [MAIN ] CMSA: Generated 1806 derivative records from 3562 primary records. [2025-10-16T22:35:55.768403] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-10-16T22:35:55.787026] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1806 records). [2025-10-16T22:35:55.787757] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-10-16T22:35:55.789932] [INFO ] [MAIN ] Derivative Progress: 400/1803 symbols completed. CMSA took 1.0s. Estimated remaining: 9m 4s. Rate: 154.8 symbols/min [2025-10-16T22:35:55.790240] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:55.804583] [DEBUG] [MAIN ] CMSC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:55.805384] [INFO ] [MAIN ] CMSC: Generated 1807 derivative records from 4906 primary records. [2025-10-16T22:35:55.805591] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-16T22:35:55.835698] [DEBUG] [MAIN ] CMSD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:55.837488] [INFO ] [MAIN ] CMSD: Generated 1807 derivative records from 7871 primary records. [2025-10-16T22:35:55.837847] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-16T22:35:55.838597] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1807 records). [2025-10-16T22:35:55.839095] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-16T22:35:55.841415] [INFO ] [MAIN ] Derivative Progress: 401/1803 symbols completed. CMSC took 1.0s. Estimated remaining: 9m 2s. Rate: 155.1 symbols/min [2025-10-16T22:35:55.841833] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:55.865053] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1807 records). [2025-10-16T22:35:55.865356] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-16T22:35:55.867991] [INFO ] [MAIN ] Derivative Progress: 402/1803 symbols completed. CMSD took 0.9s. Estimated remaining: 9m 1s. Rate: 155.5 symbols/min [2025-10-16T22:35:55.868267] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:55.885507] [DEBUG] [LOCAL ] CMU: Loaded 6366 existing records from primary storage. [2025-10-16T22:35:55.882535] [DEBUG] [LOCAL ] CMTG: Loaded 36073 existing records from primary storage. [2025-10-16T22:35:55.885772] [INFO ] [MAIN ] CMU: Loaded 6366 primary data records. [2025-10-16T22:35:55.885705] [INFO ] [MAIN ] CMTG: Loaded 36073 primary data records. [2025-10-16T22:35:56.240091] [DEBUG] [LOCAL ] CNA: Loaded 33156 existing records from primary storage. [2025-10-16T22:35:56.365730] [INFO ] [MAIN ] CNA: Loaded 33156 primary data records. [2025-10-16T22:35:56.865303] [DEBUG] [MAIN ] CMTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:56.871966] [INFO ] [MAIN ] CMTG: Generated 1807 derivative records from 36073 primary records. [2025-10-16T22:35:56.872216] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-16T22:35:56.870884] [DEBUG] [MAIN ] CMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:56.874285] [INFO ] [MAIN ] CMU: Generated 1807 derivative records from 6366 primary records. [2025-10-16T22:35:56.874572] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-10-16T22:35:56.908824] [DEBUG] [LOCAL ] CMU: Derivative data saved (1807 records). [2025-10-16T22:35:56.911212] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-10-16T22:35:56.914162] [INFO ] [MAIN ] Derivative Progress: 403/1803 symbols completed. CMU took 1.1s. Estimated remaining: 9m 2s. Rate: 154.8 symbols/min [2025-10-16T22:35:56.917324] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1807 records). [2025-10-16T22:35:56.917474] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-16T22:35:56.919963] [INFO ] [MAIN ] Derivative Progress: 404/1803 symbols completed. CMTG took 1.1s. Estimated remaining: 9m 1s. Rate: 155.2 symbols/min [2025-10-16T22:35:56.932419] [DEBUG] [MAIN ] CNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:56.933048] [INFO ] [MAIN ] CNA: Generated 1807 derivative records from 33156 primary records. [2025-10-16T22:35:56.933110] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-16T22:35:56.948022] [DEBUG] [LOCAL ] CNA: Derivative data saved (1807 records). [2025-10-16T22:35:56.948082] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-10-16T22:35:56.950720] [INFO ] [MAIN ] Derivative Progress: 405/1803 symbols completed. CNA took 1.1s. Estimated remaining: 8m 59s. Rate: 155.6 symbols/min [2025-10-16T22:35:56.951514] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:56.951672] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:56.951452] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:56.968042] [DEBUG] [LOCAL ] CNF: Loaded 10646 existing records from primary storage. [2025-10-16T22:35:56.968287] [INFO ] [MAIN ] CNF: Loaded 10646 primary data records. [2025-10-16T22:35:57.311448] [DEBUG] [LOCAL ] CNC: Loaded 54160 existing records from primary storage. [2025-10-16T22:35:57.311904] [INFO ] [MAIN ] CNC: Loaded 54160 primary data records. [2025-10-16T22:35:57.402020] [DEBUG] [LOCAL ] CNI: Loaded 52078 existing records from primary storage. [2025-10-16T22:35:57.426289] [INFO ] [MAIN ] CNI: Loaded 52078 primary data records. [2025-10-16T22:35:57.982124] [DEBUG] [MAIN ] CNF: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:35:57.984136] [INFO ] [MAIN ] CNF: Generated 1806 derivative records from 10646 primary records. [2025-10-16T22:35:57.984444] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-10-16T22:35:58.001931] [DEBUG] [LOCAL ] CNF: Derivative data saved (1806 records). [2025-10-16T22:35:58.002236] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-10-16T22:35:58.005810] [INFO ] [MAIN ] Derivative Progress: 406/1803 symbols completed. CNF took 1.1s. Estimated remaining: 9m 1s. Rate: 154.9 symbols/min [2025-10-16T22:35:58.007214] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:58.023261] [DEBUG] [MAIN ] CNC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:35:58.024358] [INFO ] [MAIN ] CNC: Generated 1806 derivative records from 54160 primary records. [2025-10-16T22:35:58.024571] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-16T22:35:58.056080] [DEBUG] [MAIN ] CNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:58.059047] [INFO ] [MAIN ] CNI: Generated 1807 derivative records from 52078 primary records. [2025-10-16T22:35:58.059416] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-16T22:35:58.060596] [DEBUG] [LOCAL ] CNC: Derivative data saved (1806 records). [2025-10-16T22:35:58.061231] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-16T22:35:58.063681] [INFO ] [MAIN ] Derivative Progress: 407/1803 symbols completed. CNC took 1.1s. Estimated remaining: 8m 60s. Rate: 155.2 symbols/min [2025-10-16T22:35:58.079308] [DEBUG] [LOCAL ] CNI: Derivative data saved (1807 records). [2025-10-16T22:35:58.079734] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-16T22:35:58.079459] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:58.082464] [INFO ] [MAIN ] Derivative Progress: 408/1803 symbols completed. CNI took 1.1s. Estimated remaining: 8m 58s. Rate: 155.6 symbols/min [2025-10-16T22:35:58.082616] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:58.128020] [DEBUG] [LOCAL ] CNK: Loaded 53289 existing records from primary storage. [2025-10-16T22:35:58.128269] [INFO ] [MAIN ] CNK: Loaded 53289 primary data records. [2025-10-16T22:35:58.247712] [DEBUG] [LOCAL ] CNMD: Loaded 32319 existing records from primary storage. [2025-10-16T22:35:58.259811] [INFO ] [MAIN ] CNMD: Loaded 32319 primary data records. [2025-10-16T22:35:58.477601] [DEBUG] [LOCAL ] CNM: Loaded 51414 existing records from primary storage. [2025-10-16T22:35:58.591420] [INFO ] [MAIN ] CNM: Loaded 51414 primary data records. [2025-10-16T22:35:59.186254] [DEBUG] [MAIN ] CNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:59.188064] [INFO ] [MAIN ] CNK: Generated 1807 derivative records from 53289 primary records. [2025-10-16T22:35:59.188622] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-10-16T22:35:59.209770] [DEBUG] [LOCAL ] CNK: Derivative data saved (1807 records). [2025-10-16T22:35:59.210186] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-10-16T22:35:59.213317] [INFO ] [MAIN ] Derivative Progress: 409/1803 symbols completed. CNK took 1.2s. Estimated remaining: 9m 0s. Rate: 154.9 symbols/min [2025-10-16T22:35:59.213728] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:59.235148] [DEBUG] [MAIN ] CNMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:59.236562] [INFO ] [MAIN ] CNMD: Generated 1807 derivative records from 32319 primary records. [2025-10-16T22:35:59.236915] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-16T22:35:59.254857] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1807 records). [2025-10-16T22:35:59.255214] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-10-16T22:35:59.258000] [INFO ] [MAIN ] Derivative Progress: 410/1803 symbols completed. CNMD took 1.2s. Estimated remaining: 8m 59s. Rate: 155.2 symbols/min [2025-10-16T22:35:59.258465] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:59.275781] [DEBUG] [MAIN ] CNM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:35:59.276618] [INFO ] [MAIN ] CNM: Generated 1807 derivative records from 51414 primary records. [2025-10-16T22:35:59.285591] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-10-16T22:35:59.301997] [DEBUG] [LOCAL ] CNM: Derivative data saved (1807 records). [2025-10-16T22:35:59.302271] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-10-16T22:35:59.305545] [INFO ] [MAIN ] Derivative Progress: 411/1803 symbols completed. CNM took 1.2s. Estimated remaining: 8m 57s. Rate: 155.5 symbols/min [2025-10-16T22:35:59.305826] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:35:59.318398] [DEBUG] [LOCAL ] CNNE: Loaded 36234 existing records from primary storage. [2025-10-16T22:35:59.318732] [INFO ] [MAIN ] CNNE: Loaded 36234 primary data records. [2025-10-16T22:35:59.485044] [DEBUG] [LOCAL ] CNO: Loaded 40958 existing records from primary storage. [2025-10-16T22:35:59.501674] [INFO ] [MAIN ] CNO: Loaded 40958 primary data records. [2025-10-16T22:35:59.828563] [DEBUG] [LOCAL ] CNP: Loaded 53869 existing records from primary storage. [2025-10-16T22:35:59.845358] [INFO ] [MAIN ] CNP: Loaded 53869 primary data records. [2025-10-16T22:36:00.353124] [DEBUG] [MAIN ] CNNE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:00.354676] [INFO ] [MAIN ] CNNE: Generated 1807 derivative records from 36234 primary records. [2025-10-16T22:36:00.354969] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-10-16T22:36:00.372578] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1807 records). [2025-10-16T22:36:00.374755] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-10-16T22:36:00.378223] [INFO ] [MAIN ] Derivative Progress: 412/1803 symbols completed. CNNE took 1.2s. Estimated remaining: 8m 59s. Rate: 154.9 symbols/min [2025-10-16T22:36:00.379715] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:00.394218] [DEBUG] [MAIN ] CNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:00.395116] [INFO ] [MAIN ] CNO: Generated 1807 derivative records from 40958 primary records. [2025-10-16T22:36:00.395446] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-16T22:36:00.416129] [DEBUG] [LOCAL ] CNO: Derivative data saved (1807 records). [2025-10-16T22:36:00.417043] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-16T22:36:00.419803] [INFO ] [MAIN ] Derivative Progress: 413/1803 symbols completed. CNO took 1.2s. Estimated remaining: 8m 57s. Rate: 155.2 symbols/min [2025-10-16T22:36:00.420193] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:00.433844] [DEBUG] [MAIN ] CNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:00.434574] [INFO ] [MAIN ] CNP: Generated 1807 derivative records from 53869 primary records. [2025-10-16T22:36:00.434759] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-16T22:36:00.464929] [DEBUG] [LOCAL ] CNP: Derivative data saved (1807 records). [2025-10-16T22:36:00.469830] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-16T22:36:00.472361] [INFO ] [MAIN ] Derivative Progress: 414/1803 symbols completed. CNP took 1.2s. Estimated remaining: 8m 56s. Rate: 155.5 symbols/min [2025-10-16T22:36:00.472664] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:00.482852] [DEBUG] [LOCAL ] CNS: Loaded 21369 existing records from primary storage. [2025-10-16T22:36:00.483057] [INFO ] [MAIN ] CNS: Loaded 21369 primary data records. [2025-10-16T22:36:00.574015] [DEBUG] [LOCAL ] CNQ: Loaded 53972 existing records from primary storage. [2025-10-16T22:36:00.591308] [INFO ] [MAIN ] CNQ: Loaded 53972 primary data records. [2025-10-16T22:36:01.182191] [DEBUG] [LOCAL ] CNX: Loaded 51742 existing records from primary storage. [2025-10-16T22:36:01.183717] [INFO ] [MAIN ] CNX: Loaded 51742 primary data records. [2025-10-16T22:36:01.537175] [DEBUG] [MAIN ] CNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:01.538269] [INFO ] [MAIN ] CNS: Generated 1807 derivative records from 21369 primary records. [2025-10-16T22:36:01.538443] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-10-16T22:36:01.557967] [DEBUG] [LOCAL ] CNS: Derivative data saved (1807 records). [2025-10-16T22:36:01.558757] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-10-16T22:36:01.563002] [INFO ] [MAIN ] Derivative Progress: 415/1803 symbols completed. CNS took 1.1s. Estimated remaining: 8m 58s. Rate: 154.8 symbols/min [2025-10-16T22:36:01.566495] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:01.582634] [DEBUG] [MAIN ] CNQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:01.583993] [INFO ] [MAIN ] CNQ: Generated 1807 derivative records from 53972 primary records. [2025-10-16T22:36:01.584063] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-16T22:36:01.606237] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1807 records). [2025-10-16T22:36:01.606616] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-16T22:36:01.610031] [INFO ] [MAIN ] Derivative Progress: 416/1803 symbols completed. CNQ took 1.2s. Estimated remaining: 8m 56s. Rate: 155.2 symbols/min [2025-10-16T22:36:01.610799] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:01.662384] [DEBUG] [MAIN ] CNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:01.663927] [INFO ] [MAIN ] CNX: Generated 1807 derivative records from 51742 primary records. [2025-10-16T22:36:01.664155] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-10-16T22:36:01.665760] [DEBUG] [LOCAL ] CODI: Loaded 41807 existing records from primary storage. [2025-10-16T22:36:01.667120] [INFO ] [MAIN ] CODI: Loaded 41807 primary data records. [2025-10-16T22:36:01.715364] [DEBUG] [LOCAL ] CNX: Derivative data saved (1807 records). [2025-10-16T22:36:01.752444] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-10-16T22:36:01.770226] [INFO ] [MAIN ] Derivative Progress: 417/1803 symbols completed. CNX took 1.3s. Estimated remaining: 8m 55s. Rate: 155.4 symbols/min [2025-10-16T22:36:01.792174] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:02.027714] [DEBUG] [LOCAL ] COF: Loaded 54012 existing records from primary storage. [2025-10-16T22:36:02.028075] [INFO ] [MAIN ] COF: Loaded 54012 primary data records. [2025-10-16T22:36:02.369961] [DEBUG] [LOCAL ] COLD: Loaded 52781 existing records from primary storage. [2025-10-16T22:36:02.370516] [INFO ] [MAIN ] COLD: Loaded 52781 primary data records. [2025-10-16T22:36:02.549502] [DEBUG] [MAIN ] CODI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:02.561065] [INFO ] [MAIN ] CODI: Generated 1807 derivative records from 41807 primary records. [2025-10-16T22:36:02.588569] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-16T22:36:02.732353] [DEBUG] [LOCAL ] CODI: Derivative data saved (1807 records). [2025-10-16T22:36:02.732947] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-10-16T22:36:02.735562] [INFO ] [MAIN ] Derivative Progress: 418/1803 symbols completed. CODI took 1.2s. Estimated remaining: 8m 57s. Rate: 154.8 symbols/min [2025-10-16T22:36:02.756279] [DEBUG] [MAIN ] COF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:02.757407] [INFO ] [MAIN ] COF: Generated 1807 derivative records from 54012 primary records. [2025-10-16T22:36:02.757532] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-16T22:36:02.776751] [DEBUG] [LOCAL ] COF: Derivative data saved (1807 records). [2025-10-16T22:36:02.777060] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-16T22:36:02.779680] [INFO ] [MAIN ] Derivative Progress: 419/1803 symbols completed. COF took 1.2s. Estimated remaining: 8m 55s. Rate: 155.2 symbols/min [2025-10-16T22:36:02.797327] [DEBUG] [MAIN ] COLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:02.798123] [INFO ] [MAIN ] COLD: Generated 1807 derivative records from 52781 primary records. [2025-10-16T22:36:02.798215] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-10-16T22:36:02.814084] [DEBUG] [LOCAL ] COLD: Derivative data saved (1807 records). [2025-10-16T22:36:02.814158] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-10-16T22:36:02.817712] [INFO ] [MAIN ] Derivative Progress: 420/1803 symbols completed. COLD took 1.0s. Estimated remaining: 8m 54s. Rate: 155.5 symbols/min [2025-10-16T22:36:02.818230] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:02.818332] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:02.818510] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:02.851496] [DEBUG] [LOCAL ] COOK: Loaded 25126 existing records from primary storage. [2025-10-16T22:36:02.851824] [INFO ] [MAIN ] COOK: Loaded 25126 primary data records. [2025-10-16T22:36:02.994515] [DEBUG] [LOCAL ] CON: Loaded 39243 existing records from primary storage. [2025-10-16T22:36:02.999512] [INFO ] [MAIN ] CON: Loaded 39243 primary data records. [2025-10-16T22:36:03.185617] [DEBUG] [LOCAL ] COMP: Loaded 53796 existing records from primary storage. [2025-10-16T22:36:03.234069] [INFO ] [MAIN ] COMP: Loaded 53796 primary data records. [2025-10-16T22:36:03.950215] [DEBUG] [MAIN ] CON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:03.951508] [INFO ] [MAIN ] CON: Generated 1807 derivative records from 39243 primary records. [2025-10-16T22:36:03.951611] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-10-16T22:36:03.952866] [DEBUG] [MAIN ] COOK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:03.953501] [INFO ] [MAIN ] COOK: Generated 1807 derivative records from 25126 primary records. [2025-10-16T22:36:03.961292] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-16T22:36:03.970896] [DEBUG] [LOCAL ] CON: Derivative data saved (1807 records). [2025-10-16T22:36:03.971017] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-10-16T22:36:03.974109] [INFO ] [MAIN ] Derivative Progress: 421/1803 symbols completed. CON took 1.2s. Estimated remaining: 8m 56s. Rate: 154.8 symbols/min [2025-10-16T22:36:03.982125] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:03.994572] [DEBUG] [LOCAL ] COOK: Derivative data saved (1807 records). [2025-10-16T22:36:03.995372] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-16T22:36:03.998544] [INFO ] [MAIN ] Derivative Progress: 422/1803 symbols completed. COOK took 1.2s. Estimated remaining: 8m 54s. Rate: 155.1 symbols/min [2025-10-16T22:36:03.999145] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:04.014591] [DEBUG] [MAIN ] COMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:04.016124] [INFO ] [MAIN ] COMP: Generated 1807 derivative records from 53796 primary records. [2025-10-16T22:36:04.016422] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-10-16T22:36:04.034823] [DEBUG] [LOCAL ] COMP: Derivative data saved (1807 records). [2025-10-16T22:36:04.035170] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-10-16T22:36:04.038359] [INFO ] [MAIN ] Derivative Progress: 423/1803 symbols completed. COMP took 1.2s. Estimated remaining: 8m 53s. Rate: 155.4 symbols/min [2025-10-16T22:36:04.039353] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:04.106233] [DEBUG] [LOCAL ] COP: Loaded 54117 existing records from primary storage. [2025-10-16T22:36:04.107600] [INFO ] [MAIN ] COP: Loaded 54117 primary data records. [2025-10-16T22:36:04.113495] [DEBUG] [LOCAL ] COR: Loaded 46937 existing records from primary storage. [2025-10-16T22:36:04.113685] [INFO ] [MAIN ] COR: Loaded 46937 primary data records. [2025-10-16T22:36:04.322810] [DEBUG] [LOCAL ] COTY: Loaded 53658 existing records from primary storage. [2025-10-16T22:36:04.346599] [INFO ] [MAIN ] COTY: Loaded 53658 primary data records. [2025-10-16T22:36:05.193695] [DEBUG] [MAIN ] COP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:05.195226] [INFO ] [MAIN ] COP: Generated 1807 derivative records from 54117 primary records. [2025-10-16T22:36:05.210807] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-10-16T22:36:05.212697] [DEBUG] [MAIN ] COR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:05.237373] [INFO ] [MAIN ] COR: Generated 1807 derivative records from 46937 primary records. [2025-10-16T22:36:05.241967] [DEBUG] [LOCAL ] COP: Derivative data saved (1807 records). [2025-10-16T22:36:05.242103] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-10-16T22:36:05.242591] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-10-16T22:36:05.245994] [INFO ] [MAIN ] Derivative Progress: 424/1803 symbols completed. COP took 1.3s. Estimated remaining: 8m 55s. Rate: 154.7 symbols/min [2025-10-16T22:36:05.243134] [DEBUG] [MAIN ] COTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:05.248042] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:05.247913] [INFO ] [MAIN ] COTY: Generated 1807 derivative records from 53658 primary records. [2025-10-16T22:36:05.260396] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-10-16T22:36:05.264772] [DEBUG] [LOCAL ] COR: Derivative data saved (1807 records). [2025-10-16T22:36:05.265737] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-10-16T22:36:05.269758] [INFO ] [MAIN ] Derivative Progress: 425/1803 symbols completed. COR took 1.3s. Estimated remaining: 8m 53s. Rate: 155.0 symbols/min [2025-10-16T22:36:05.276941] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:05.287016] [DEBUG] [LOCAL ] COTY: Derivative data saved (1807 records). [2025-10-16T22:36:05.287173] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-10-16T22:36:05.289937] [INFO ] [MAIN ] Derivative Progress: 426/1803 symbols completed. COTY took 1.3s. Estimated remaining: 8m 52s. Rate: 155.4 symbols/min [2025-10-16T22:36:05.290166] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:05.324361] [DEBUG] [LOCAL ] CPA: Loaded 28578 existing records from primary storage. [2025-10-16T22:36:05.324576] [INFO ] [MAIN ] CPA: Loaded 28578 primary data records. [2025-10-16T22:36:05.565331] [DEBUG] [LOCAL ] CP: Loaded 53628 existing records from primary storage. [2025-10-16T22:36:05.528269] [DEBUG] [LOCAL ] COUR: Loaded 49681 existing records from primary storage. [2025-10-16T22:36:05.565694] [INFO ] [MAIN ] COUR: Loaded 49681 primary data records. [2025-10-16T22:36:05.571377] [INFO ] [MAIN ] CP: Loaded 53628 primary data records. [2025-10-16T22:36:06.345410] [DEBUG] [MAIN ] CPA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:06.347700] [INFO ] [MAIN ] CPA: Generated 1807 derivative records from 28578 primary records. [2025-10-16T22:36:06.348051] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-10-16T22:36:06.370941] [DEBUG] [LOCAL ] CPA: Derivative data saved (1807 records). [2025-10-16T22:36:06.387907] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-10-16T22:36:06.388390] [DEBUG] [MAIN ] COUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:06.389559] [INFO ] [MAIN ] COUR: Generated 1807 derivative records from 49681 primary records. [2025-10-16T22:36:06.389926] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-16T22:36:06.392881] [INFO ] [MAIN ] Derivative Progress: 427/1803 symbols completed. CPA took 1.1s. Estimated remaining: 8m 54s. Rate: 154.7 symbols/min [2025-10-16T22:36:06.408515] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:06.413360] [DEBUG] [LOCAL ] COUR: Derivative data saved (1807 records). [2025-10-16T22:36:06.414611] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-10-16T22:36:06.417477] [INFO ] [MAIN ] Derivative Progress: 428/1803 symbols completed. COUR took 1.2s. Estimated remaining: 8m 52s. Rate: 155.0 symbols/min [2025-10-16T22:36:06.425672] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:06.431769] [DEBUG] [MAIN ] CP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:06.432587] [INFO ] [MAIN ] CP: Generated 1807 derivative records from 53628 primary records. [2025-10-16T22:36:06.432683] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-16T22:36:06.449918] [DEBUG] [LOCAL ] CP: Derivative data saved (1807 records). [2025-10-16T22:36:06.450099] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-10-16T22:36:06.452752] [INFO ] [MAIN ] Derivative Progress: 429/1803 symbols completed. CP took 1.2s. Estimated remaining: 8m 51s. Rate: 155.3 symbols/min [2025-10-16T22:36:06.453086] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:06.475087] [DEBUG] [LOCAL ] CPF: Loaded 15396 existing records from primary storage. [2025-10-16T22:36:06.475244] [INFO ] [MAIN ] CPF: Loaded 15396 primary data records. [2025-10-16T22:36:06.601263] [DEBUG] [LOCAL ] CPK: Loaded 14061 existing records from primary storage. [2025-10-16T22:36:06.627738] [INFO ] [MAIN ] CPK: Loaded 14061 primary data records. [2025-10-16T22:36:06.629173] [DEBUG] [LOCAL ] CPAY: Loaded 30724 existing records from primary storage. [2025-10-16T22:36:06.677502] [INFO ] [MAIN ] CPAY: Loaded 30724 primary data records. [2025-10-16T22:36:07.509843] [DEBUG] [MAIN ] CPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:07.511601] [INFO ] [MAIN ] CPF: Generated 1807 derivative records from 15396 primary records. [2025-10-16T22:36:07.511723] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-16T22:36:07.530855] [DEBUG] [LOCAL ] CPF: Derivative data saved (1807 records). [2025-10-16T22:36:07.532010] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-10-16T22:36:07.534383] [INFO ] [MAIN ] Derivative Progress: 430/1803 symbols completed. CPF took 1.1s. Estimated remaining: 8m 53s. Rate: 154.7 symbols/min [2025-10-16T22:36:07.535583] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:07.551443] [DEBUG] [MAIN ] CPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:07.552627] [INFO ] [MAIN ] CPK: Generated 1807 derivative records from 14061 primary records. [2025-10-16T22:36:07.552783] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-16T22:36:07.572490] [DEBUG] [LOCAL ] CPK: Derivative data saved (1807 records). [2025-10-16T22:36:07.572799] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-16T22:36:07.576998] [INFO ] [MAIN ] Derivative Progress: 431/1803 symbols completed. CPK took 1.1s. Estimated remaining: 8m 51s. Rate: 155.0 symbols/min [2025-10-16T22:36:07.577805] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:07.600683] [DEBUG] [MAIN ] CPAY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:07.601411] [INFO ] [MAIN ] CPAY: Generated 1807 derivative records from 30724 primary records. [2025-10-16T22:36:07.601520] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-16T22:36:07.618931] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1807 records). [2025-10-16T22:36:07.619193] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-16T22:36:07.621921] [INFO ] [MAIN ] Derivative Progress: 432/1803 symbols completed. CPAY took 1.2s. Estimated remaining: 8m 50s. Rate: 155.3 symbols/min [2025-10-16T22:36:07.622078] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:07.680055] [DEBUG] [LOCAL ] CPNG: Loaded 54069 existing records from primary storage. [2025-10-16T22:36:07.680482] [INFO ] [MAIN ] CPNG: Loaded 54069 primary data records. [2025-10-16T22:36:07.830148] [DEBUG] [LOCAL ] CPT: Loaded 44888 existing records from primary storage. [2025-10-16T22:36:07.831806] [INFO ] [MAIN ] CPT: Loaded 44888 primary data records. [2025-10-16T22:36:07.831195] [DEBUG] [LOCAL ] CPRI: Loaded 52846 existing records from primary storage. [2025-10-16T22:36:07.873734] [INFO ] [MAIN ] CPRI: Loaded 52846 primary data records. [2025-10-16T22:36:08.703844] [DEBUG] [MAIN ] CPNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:08.719384] [INFO ] [MAIN ] CPNG: Generated 1807 derivative records from 54069 primary records. [2025-10-16T22:36:08.720281] [DEBUG] [MAIN ] CPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:08.721461] [INFO ] [MAIN ] CPT: Generated 1807 derivative records from 44888 primary records. [2025-10-16T22:36:08.721735] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-16T22:36:08.720538] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-10-16T22:36:08.757317] [DEBUG] [LOCAL ] CPT: Derivative data saved (1807 records). [2025-10-16T22:36:08.763729] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-16T22:36:08.767113] [INFO ] [MAIN ] Derivative Progress: 433/1803 symbols completed. CPT took 1.1s. Estimated remaining: 8m 52s. Rate: 154.6 symbols/min [2025-10-16T22:36:08.770016] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1807 records). [2025-10-16T22:36:08.783758] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-10-16T22:36:08.783627] [DEBUG] [MAIN ] CPRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:08.787706] [INFO ] [MAIN ] Derivative Progress: 434/1803 symbols completed. CPNG took 1.3s. Estimated remaining: 8m 50s. Rate: 155.0 symbols/min [2025-10-16T22:36:08.788747] [INFO ] [MAIN ] CPRI: Generated 1807 derivative records from 52846 primary records. [2025-10-16T22:36:08.789113] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-16T22:36:08.804723] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1807 records). [2025-10-16T22:36:08.804789] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-16T22:36:08.807612] [INFO ] [MAIN ] Derivative Progress: 435/1803 symbols completed. CPRI took 1.2s. Estimated remaining: 8m 48s. Rate: 155.3 symbols/min [2025-10-16T22:36:08.808274] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:08.808780] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:08.808126] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:08.826515] [DEBUG] [LOCAL ] CRBD: Loaded 8956 existing records from primary storage. [2025-10-16T22:36:08.826883] [INFO ] [MAIN ] CRBD: Loaded 8956 primary data records. [2025-10-16T22:36:08.953737] [DEBUG] [LOCAL ] CR: Loaded 24311 existing records from primary storage. [2025-10-16T22:36:08.969955] [INFO ] [MAIN ] CR: Loaded 24311 primary data records. [2025-10-16T22:36:09.194261] [DEBUG] [LOCAL ] CRBG: Loaded 52976 existing records from primary storage. [2025-10-16T22:36:09.210229] [INFO ] [MAIN ] CRBG: Loaded 52976 primary data records. [2025-10-16T22:36:09.957111] [DEBUG] [MAIN ] CRBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:09.958916] [INFO ] [MAIN ] CRBD: Generated 1807 derivative records from 8956 primary records. [2025-10-16T22:36:09.959053] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-16T22:36:09.995042] [DEBUG] [MAIN ] CR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:09.995704] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1807 records). [2025-10-16T22:36:09.996684] [INFO ] [MAIN ] CR: Generated 1807 derivative records from 24311 primary records. [2025-10-16T22:36:09.996970] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-16T22:36:09.996895] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-16T22:36:09.999320] [INFO ] [MAIN ] Derivative Progress: 436/1803 symbols completed. CRBD took 1.2s. Estimated remaining: 8m 51s. Rate: 154.6 symbols/min [2025-10-16T22:36:10.002247] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:10.031669] [DEBUG] [MAIN ] CRBG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:10.033238] [INFO ] [MAIN ] CRBG: Generated 1807 derivative records from 52976 primary records. [2025-10-16T22:36:10.035241] [DEBUG] [LOCAL ] CR: Derivative data saved (1807 records). [2025-10-16T22:36:10.033893] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-16T22:36:10.036122] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-16T22:36:10.038790] [INFO ] [MAIN ] Derivative Progress: 437/1803 symbols completed. CR took 1.2s. Estimated remaining: 8m 49s. Rate: 154.9 symbols/min [2025-10-16T22:36:10.039041] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:10.055086] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1807 records). [2025-10-16T22:36:10.055232] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-16T22:36:10.058279] [INFO ] [MAIN ] Derivative Progress: 438/1803 symbols completed. CRBG took 1.2s. Estimated remaining: 8m 48s. Rate: 155.2 symbols/min [2025-10-16T22:36:10.058885] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:10.090085] [DEBUG] [LOCAL ] CRC: Loaded 44395 existing records from primary storage. [2025-10-16T22:36:10.091054] [INFO ] [MAIN ] CRC: Loaded 44395 primary data records. [2025-10-16T22:36:10.272524] [DEBUG] [LOCAL ] CRGY: Loaded 52897 existing records from primary storage. [2025-10-16T22:36:10.278535] [INFO ] [MAIN ] CRGY: Loaded 52897 primary data records. [2025-10-16T22:36:10.557027] [DEBUG] [LOCAL ] CRH: Loaded 53831 existing records from primary storage. [2025-10-16T22:36:10.579677] [INFO ] [MAIN ] CRH: Loaded 53831 primary data records. [2025-10-16T22:36:11.097081] [DEBUG] [MAIN ] CRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:11.098155] [INFO ] [MAIN ] CRC: Generated 1807 derivative records from 44395 primary records. [2025-10-16T22:36:11.098341] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-16T22:36:11.116823] [DEBUG] [LOCAL ] CRC: Derivative data saved (1807 records). [2025-10-16T22:36:11.117099] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-16T22:36:11.119988] [INFO ] [MAIN ] Derivative Progress: 439/1803 symbols completed. CRC took 1.1s. Estimated remaining: 8m 49s. Rate: 154.6 symbols/min [2025-10-16T22:36:11.120450] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:11.139415] [DEBUG] [MAIN ] CRGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:11.140411] [INFO ] [MAIN ] CRGY: Generated 1807 derivative records from 52897 primary records. [2025-10-16T22:36:11.140639] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-16T22:36:11.164103] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1807 records). [2025-10-16T22:36:11.165019] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-16T22:36:11.168079] [INFO ] [MAIN ] Derivative Progress: 440/1803 symbols completed. CRGY took 1.1s. Estimated remaining: 8m 48s. Rate: 154.9 symbols/min [2025-10-16T22:36:11.169376] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:11.184005] [DEBUG] [MAIN ] CRH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:11.195456] [INFO ] [MAIN ] CRH: Generated 1807 derivative records from 53831 primary records. [2025-10-16T22:36:11.195549] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-16T22:36:11.225886] [DEBUG] [LOCAL ] CRH: Derivative data saved (1807 records). [2025-10-16T22:36:11.227280] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-10-16T22:36:11.230498] [INFO ] [MAIN ] Derivative Progress: 441/1803 symbols completed. CRH took 1.2s. Estimated remaining: 8m 46s. Rate: 155.2 symbols/min [2025-10-16T22:36:11.230917] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:11.232029] [DEBUG] [LOCAL ] CRI: Loaded 50021 existing records from primary storage. [2025-10-16T22:36:11.232283] [INFO ] [MAIN ] CRI: Loaded 50021 primary data records. [2025-10-16T22:36:11.438007] [DEBUG] [LOCAL ] CRK: Loaded 52635 existing records from primary storage. [2025-10-16T22:36:11.563994] [INFO ] [MAIN ] CRK: Loaded 52635 primary data records. [2025-10-16T22:36:11.742984] [DEBUG] [LOCAL ] CRM: Loaded 54160 existing records from primary storage. [2025-10-16T22:36:11.767069] [INFO ] [MAIN ] CRM: Loaded 54160 primary data records. [2025-10-16T22:36:12.259857] [DEBUG] [MAIN ] CRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:12.261465] [INFO ] [MAIN ] CRI: Generated 1807 derivative records from 50021 primary records. [2025-10-16T22:36:12.261701] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-16T22:36:12.281583] [DEBUG] [LOCAL ] CRI: Derivative data saved (1807 records). [2025-10-16T22:36:12.283440] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-16T22:36:12.293793] [INFO ] [MAIN ] Derivative Progress: 442/1803 symbols completed. CRI took 1.2s. Estimated remaining: 8m 48s. Rate: 154.6 symbols/min [2025-10-16T22:36:12.299666] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:12.300021] [DEBUG] [MAIN ] CRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:12.301535] [INFO ] [MAIN ] CRK: Generated 1807 derivative records from 52635 primary records. [2025-10-16T22:36:12.301703] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-16T22:36:12.335469] [DEBUG] [LOCAL ] CRK: Derivative data saved (1807 records). [2025-10-16T22:36:12.341565] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-10-16T22:36:12.341389] [DEBUG] [MAIN ] CRM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:12.342398] [INFO ] [MAIN ] CRM: Generated 1807 derivative records from 54160 primary records. [2025-10-16T22:36:12.345319] [INFO ] [MAIN ] Derivative Progress: 443/1803 symbols completed. CRK took 1.2s. Estimated remaining: 8m 47s. Rate: 154.9 symbols/min [2025-10-16T22:36:12.345448] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-16T22:36:12.346408] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:12.372207] [DEBUG] [LOCAL ] CRM: Derivative data saved (1807 records). [2025-10-16T22:36:12.372412] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-16T22:36:12.375049] [INFO ] [MAIN ] Derivative Progress: 444/1803 symbols completed. CRM took 1.1s. Estimated remaining: 8m 45s. Rate: 155.2 symbols/min [2025-10-16T22:36:12.375971] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:12.390985] [DEBUG] [LOCAL ] CSAN: Loaded 42492 existing records from primary storage. [2025-10-16T22:36:12.391291] [INFO ] [MAIN ] CSAN: Loaded 42492 primary data records. [2025-10-16T22:36:12.514930] [DEBUG] [LOCAL ] CSR: Loaded 13529 existing records from primary storage. [2025-10-16T22:36:12.520761] [INFO ] [MAIN ] CSR: Loaded 13529 primary data records. [2025-10-16T22:36:12.621904] [DEBUG] [LOCAL ] CSL: Loaded 31764 existing records from primary storage. [2025-10-16T22:36:12.666776] [INFO ] [MAIN ] CSL: Loaded 31764 primary data records. [2025-10-16T22:36:13.434035] [DEBUG] [MAIN ] CSAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:13.442874] [INFO ] [MAIN ] CSAN: Generated 1807 derivative records from 42492 primary records. [2025-10-16T22:36:13.443096] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-16T22:36:13.449004] [DEBUG] [MAIN ] CSR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:13.457221] [INFO ] [MAIN ] CSR: Generated 1807 derivative records from 13529 primary records. [2025-10-16T22:36:13.457317] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-16T22:36:13.475502] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1807 records). [2025-10-16T22:36:13.478946] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-16T22:36:13.482638] [INFO ] [MAIN ] Derivative Progress: 445/1803 symbols completed. CSAN took 1.2s. Estimated remaining: 8m 47s. Rate: 154.6 symbols/min [2025-10-16T22:36:13.482977] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:13.500875] [DEBUG] [MAIN ] CSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:13.501681] [DEBUG] [LOCAL ] CSR: Derivative data saved (1807 records). [2025-10-16T22:36:13.502494] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-16T22:36:13.505277] [INFO ] [MAIN ] Derivative Progress: 446/1803 symbols completed. CSR took 1.1s. Estimated remaining: 8m 46s. Rate: 154.9 symbols/min [2025-10-16T22:36:13.502413] [INFO ] [MAIN ] CSL: Generated 1807 derivative records from 31764 primary records. [2025-10-16T22:36:13.505444] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:13.505730] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-16T22:36:13.526445] [DEBUG] [LOCAL ] CSL: Derivative data saved (1807 records). [2025-10-16T22:36:13.526719] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-16T22:36:13.529865] [INFO ] [MAIN ] Derivative Progress: 447/1803 symbols completed. CSL took 1.2s. Estimated remaining: 8m 44s. Rate: 155.2 symbols/min [2025-10-16T22:36:13.530273] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:13.546422] [DEBUG] [LOCAL ] CSV: Loaded 12746 existing records from primary storage. [2025-10-16T22:36:13.546612] [INFO ] [MAIN ] CSV: Loaded 12746 primary data records. [2025-10-16T22:36:13.654572] [DEBUG] [LOCAL ] CTBB: Loaded 6801 existing records from primary storage. [2025-10-16T22:36:13.671790] [INFO ] [MAIN ] CTBB: Loaded 6801 primary data records. [2025-10-16T22:36:13.672540] [DEBUG] [LOCAL ] CSTM: Loaded 47940 existing records from primary storage. [2025-10-16T22:36:13.714183] [INFO ] [MAIN ] CSTM: Loaded 47940 primary data records. [2025-10-16T22:36:14.510019] [DEBUG] [MAIN ] CSV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:14.511143] [INFO ] [MAIN ] CSV: Generated 1807 derivative records from 12746 primary records. [2025-10-16T22:36:14.511730] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-16T22:36:14.545567] [DEBUG] [LOCAL ] CSV: Derivative data saved (1807 records). [2025-10-16T22:36:14.558137] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-16T22:36:14.545905] [DEBUG] [MAIN ] CTBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:14.559436] [DEBUG] [MAIN ] CSTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:14.562078] [INFO ] [MAIN ] Derivative Progress: 448/1803 symbols completed. CSV took 1.1s. Estimated remaining: 8m 46s. Rate: 154.7 symbols/min [2025-10-16T22:36:14.559233] [INFO ] [MAIN ] CTBB: Generated 1807 derivative records from 6801 primary records. [2025-10-16T22:36:14.562861] [INFO ] [MAIN ] CSTM: Generated 1807 derivative records from 47940 primary records. [2025-10-16T22:36:14.563200] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-10-16T22:36:14.562948] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-16T22:36:14.593701] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1807 records). [2025-10-16T22:36:14.593142] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1807 records). [2025-10-16T22:36:14.593854] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-10-16T22:36:14.593930] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-10-16T22:36:14.596078] [INFO ] [MAIN ] Derivative Progress: 449/1803 symbols completed. CSTM took 1.1s. Estimated remaining: 8m 44s. Rate: 155.0 symbols/min [2025-10-16T22:36:14.599083] [INFO ] [MAIN ] Derivative Progress: 450/1803 symbols completed. CTBB took 1.1s. Estimated remaining: 8m 43s. Rate: 155.3 symbols/min [2025-10-16T22:36:14.599446] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:14.599507] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:14.599987] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:14.611542] [DEBUG] [LOCAL ] CTDD: Loaded 5483 existing records from primary storage. [2025-10-16T22:36:14.612188] [INFO ] [MAIN ] CTDD: Loaded 5483 primary data records. [2025-10-16T22:36:14.737554] [DEBUG] [LOCAL ] CTO: Loaded 27883 existing records from primary storage. [2025-10-16T22:36:14.743214] [INFO ] [MAIN ] CTO: Loaded 27883 primary data records. [2025-10-16T22:36:15.121321] [DEBUG] [LOCAL ] CTRA: Loaded 54038 existing records from primary storage. [2025-10-16T22:36:15.150918] [INFO ] [MAIN ] CTRA: Loaded 54038 primary data records. [2025-10-16T22:36:15.659340] [DEBUG] [MAIN ] CTDD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:36:15.660262] [INFO ] [MAIN ] CTDD: Generated 1806 derivative records from 5483 primary records. [2025-10-16T22:36:15.660607] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-16T22:36:15.689312] [DEBUG] [MAIN ] CTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:15.691473] [INFO ] [MAIN ] CTO: Generated 1807 derivative records from 27883 primary records. [2025-10-16T22:36:15.691709] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-10-16T22:36:15.697058] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1806 records). [2025-10-16T22:36:15.705689] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-10-16T22:36:15.708817] [INFO ] [MAIN ] Derivative Progress: 451/1803 symbols completed. CTDD took 1.1s. Estimated remaining: 8m 44s. Rate: 154.7 symbols/min [2025-10-16T22:36:15.711784] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:15.716323] [DEBUG] [LOCAL ] CTO: Derivative data saved (1807 records). [2025-10-16T22:36:15.716676] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-10-16T22:36:15.727696] [INFO ] [MAIN ] Derivative Progress: 452/1803 symbols completed. CTO took 1.1s. Estimated remaining: 8m 43s. Rate: 155.0 symbols/min [2025-10-16T22:36:15.733334] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:15.734315] [DEBUG] [MAIN ] CTRA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:15.735144] [INFO ] [MAIN ] CTRA: Generated 1807 derivative records from 54038 primary records. [2025-10-16T22:36:15.735208] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-16T22:36:15.756419] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1807 records). [2025-10-16T22:36:15.756577] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-16T22:36:15.759024] [INFO ] [MAIN ] Derivative Progress: 453/1803 symbols completed. CTRA took 1.2s. Estimated remaining: 8m 42s. Rate: 155.3 symbols/min [2025-10-16T22:36:15.759254] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:15.767300] [DEBUG] [LOCAL ] CTS: Loaded 19832 existing records from primary storage. [2025-10-16T22:36:15.767431] [INFO ] [MAIN ] CTS: Loaded 19832 primary data records. [2025-10-16T22:36:16.094355] [DEBUG] [LOCAL ] CUBI: Loaded 27422 existing records from primary storage. [2025-10-16T22:36:16.107920] [INFO ] [MAIN ] CUBI: Loaded 27422 primary data records. [2025-10-16T22:36:16.129978] [DEBUG] [LOCAL ] CUBE: Loaded 51290 existing records from primary storage. [2025-10-16T22:36:16.140140] [INFO ] [MAIN ] CUBE: Loaded 51290 primary data records. [2025-10-16T22:36:16.734594] [DEBUG] [MAIN ] CTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:16.736704] [INFO ] [MAIN ] CTS: Generated 1807 derivative records from 19832 primary records. [2025-10-16T22:36:16.737034] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-16T22:36:16.753309] [DEBUG] [LOCAL ] CTS: Derivative data saved (1807 records). [2025-10-16T22:36:16.753565] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-16T22:36:16.756018] [INFO ] [MAIN ] Derivative Progress: 454/1803 symbols completed. CTS took 1.0s. Estimated remaining: 8m 43s. Rate: 154.8 symbols/min [2025-10-16T22:36:16.756274] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:16.783576] [DEBUG] [MAIN ] CUBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:16.788694] [DEBUG] [MAIN ] CUBE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:16.789431] [INFO ] [MAIN ] CUBI: Generated 1807 derivative records from 27422 primary records. [2025-10-16T22:36:16.790088] [INFO ] [MAIN ] CUBE: Generated 1807 derivative records from 51290 primary records. [2025-10-16T22:36:16.790158] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-16T22:36:16.790272] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-16T22:36:16.818369] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1807 records). [2025-10-16T22:36:16.819405] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-10-16T22:36:16.822799] [INFO ] [MAIN ] Derivative Progress: 455/1803 symbols completed. CUBE took 1.1s. Estimated remaining: 8m 42s. Rate: 155.1 symbols/min [2025-10-16T22:36:16.823208] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:16.839316] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1807 records). [2025-10-16T22:36:16.839454] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-10-16T22:36:16.841932] [INFO ] [MAIN ] Derivative Progress: 456/1803 symbols completed. CUBI took 1.1s. Estimated remaining: 8m 40s. Rate: 155.4 symbols/min [2025-10-16T22:36:16.842275] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:16.847063] [DEBUG] [LOCAL ] CULP: Loaded 2930 existing records from primary storage. [2025-10-16T22:36:16.847211] [INFO ] [MAIN ] CULP: Loaded 2930 primary data records. [2025-10-16T22:36:16.966624] [DEBUG] [LOCAL ] CUK: Loaded 51433 existing records from primary storage. [2025-10-16T22:36:16.981081] [INFO ] [MAIN ] CUK: Loaded 51433 primary data records. [2025-10-16T22:36:17.262090] [DEBUG] [LOCAL ] CURB: Loaded 33087 existing records from primary storage. [2025-10-16T22:36:17.275930] [INFO ] [MAIN ] CURB: Loaded 33087 primary data records. [2025-10-16T22:36:17.915479] [DEBUG] [MAIN ] CULP: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:36:17.916880] [INFO ] [MAIN ] CULP: Generated 1806 derivative records from 2930 primary records. [2025-10-16T22:36:17.918351] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-10-16T22:36:17.939307] [DEBUG] [LOCAL ] CULP: Derivative data saved (1806 records). [2025-10-16T22:36:17.939833] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-10-16T22:36:17.952228] [INFO ] [MAIN ] Derivative Progress: 457/1803 symbols completed. CULP took 1.1s. Estimated remaining: 8m 42s. Rate: 154.7 symbols/min [2025-10-16T22:36:17.958587] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:17.958348] [DEBUG] [MAIN ] CUK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:17.960585] [INFO ] [MAIN ] CUK: Generated 1807 derivative records from 51433 primary records. [2025-10-16T22:36:17.973259] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-16T22:36:17.974000] [DEBUG] [MAIN ] CURB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:17.976601] [INFO ] [MAIN ] CURB: Generated 1807 derivative records from 33087 primary records. [2025-10-16T22:36:17.977310] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-10-16T22:36:17.998544] [DEBUG] [LOCAL ] CUK: Derivative data saved (1807 records). [2025-10-16T22:36:17.999130] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-16T22:36:18.002365] [INFO ] [MAIN ] Derivative Progress: 458/1803 symbols completed. CUK took 1.2s. Estimated remaining: 8m 41s. Rate: 155.0 symbols/min [2025-10-16T22:36:18.002899] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:18.019293] [DEBUG] [LOCAL ] CURB: Derivative data saved (1807 records). [2025-10-16T22:36:18.019518] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-10-16T22:36:18.022571] [INFO ] [MAIN ] Derivative Progress: 459/1803 symbols completed. CURB took 1.2s. Estimated remaining: 8m 39s. Rate: 155.4 symbols/min [2025-10-16T22:36:18.022955] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:18.085209] [DEBUG] [LOCAL ] CUZ: Loaded 50005 existing records from primary storage. [2025-10-16T22:36:18.085387] [INFO ] [MAIN ] CUZ: Loaded 50005 primary data records. [2025-10-16T22:36:18.206682] [DEBUG] [LOCAL ] CVE: Loaded 53952 existing records from primary storage. [2025-10-16T22:36:18.225855] [INFO ] [MAIN ] CVE: Loaded 53952 primary data records. [2025-10-16T22:36:18.297907] [DEBUG] [LOCAL ] CVI: Loaded 47001 existing records from primary storage. [2025-10-16T22:36:18.310525] [INFO ] [MAIN ] CVI: Loaded 47001 primary data records. [2025-10-16T22:36:19.057131] [DEBUG] [MAIN ] CUZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:19.058370] [INFO ] [MAIN ] CUZ: Generated 1807 derivative records from 50005 primary records. [2025-10-16T22:36:19.061383] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-16T22:36:19.093119] [DEBUG] [MAIN ] CVI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:19.094898] [INFO ] [MAIN ] CVI: Generated 1807 derivative records from 47001 primary records. [2025-10-16T22:36:19.108866] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-10-16T22:36:19.103933] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1807 records). [2025-10-16T22:36:19.109969] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-16T22:36:19.112271] [INFO ] [MAIN ] Derivative Progress: 460/1803 symbols completed. CUZ took 1.2s. Estimated remaining: 8m 41s. Rate: 154.8 symbols/min [2025-10-16T22:36:19.112464] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:19.109905] [DEBUG] [MAIN ] CVE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:19.113966] [INFO ] [MAIN ] CVE: Generated 1807 derivative records from 53952 primary records. [2025-10-16T22:36:19.114139] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-10-16T22:36:19.150066] [DEBUG] [LOCAL ] CVI: Derivative data saved (1807 records). [2025-10-16T22:36:19.150431] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-10-16T22:36:19.153300] [INFO ] [MAIN ] Derivative Progress: 461/1803 symbols completed. CVI took 1.1s. Estimated remaining: 8m 39s. Rate: 155.1 symbols/min [2025-10-16T22:36:19.154313] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:19.161167] [DEBUG] [LOCAL ] CVE: Derivative data saved (1807 records). [2025-10-16T22:36:19.161515] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-10-16T22:36:19.164826] [INFO ] [MAIN ] Derivative Progress: 462/1803 symbols completed. CVE took 1.2s. Estimated remaining: 8m 38s. Rate: 155.4 symbols/min [2025-10-16T22:36:19.165458] [DEBUG] [LOCAL ] CVLG: Loaded 15699 existing records from primary storage. [2025-10-16T22:36:19.165603] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:19.165964] [INFO ] [MAIN ] CVLG: Loaded 15699 primary data records. [2025-10-16T22:36:19.560420] [DEBUG] [LOCAL ] CVS: Loaded 54084 existing records from primary storage. [2025-10-16T22:36:19.561326] [INFO ] [MAIN ] CVS: Loaded 54084 primary data records. [2025-10-16T22:36:19.713793] [DEBUG] [LOCAL ] CVX: Loaded 54150 existing records from primary storage. [2025-10-16T22:36:19.737371] [INFO ] [MAIN ] CVX: Loaded 54150 primary data records. [2025-10-16T22:36:20.200999] [DEBUG] [MAIN ] CVLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:20.201970] [INFO ] [MAIN ] CVLG: Generated 1807 derivative records from 15699 primary records. [2025-10-16T22:36:20.202276] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-10-16T22:36:20.221213] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1807 records). [2025-10-16T22:36:20.221897] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-10-16T22:36:20.224056] [INFO ] [MAIN ] Derivative Progress: 463/1803 symbols completed. CVLG took 1.1s. Estimated remaining: 8m 39s. Rate: 154.8 symbols/min [2025-10-16T22:36:20.242263] [DEBUG] [MAIN ] CVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:20.243039] [INFO ] [MAIN ] CVS: Generated 1807 derivative records from 54084 primary records. [2025-10-16T22:36:20.243218] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-16T22:36:20.260455] [DEBUG] [LOCAL ] CVS: Derivative data saved (1807 records). [2025-10-16T22:36:20.261399] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-16T22:36:20.264906] [INFO ] [MAIN ] Derivative Progress: 464/1803 symbols completed. CVS took 1.1s. Estimated remaining: 8m 38s. Rate: 155.1 symbols/min [2025-10-16T22:36:20.278283] [DEBUG] [MAIN ] CVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:20.278927] [INFO ] [MAIN ] CVX: Generated 1807 derivative records from 54150 primary records. [2025-10-16T22:36:20.279001] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-10-16T22:36:20.294675] [DEBUG] [LOCAL ] CVX: Derivative data saved (1807 records). [2025-10-16T22:36:20.294739] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-10-16T22:36:20.297567] [INFO ] [MAIN ] Derivative Progress: 465/1803 symbols completed. CVX took 1.1s. Estimated remaining: 8m 37s. Rate: 155.4 symbols/min [2025-10-16T22:36:20.298121] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:20.298325] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:20.298076] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:20.389366] [DEBUG] [LOCAL ] CWH: Loaded 51694 existing records from primary storage. [2025-10-16T22:36:20.389990] [INFO ] [MAIN ] CWH: Loaded 51694 primary data records. [2025-10-16T22:36:20.390682] [DEBUG] [LOCAL ] CWEN: Loaded 45638 existing records from primary storage. [2025-10-16T22:36:20.429233] [INFO ] [MAIN ] CWEN: Loaded 45638 primary data records. [2025-10-16T22:36:20.546248] [DEBUG] [LOCAL ] CWAN: Loaded 53002 existing records from primary storage. [2025-10-16T22:36:20.558286] [INFO ] [MAIN ] CWAN: Loaded 53002 primary data records. [2025-10-16T22:36:21.418867] [DEBUG] [MAIN ] CWH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:21.422301] [INFO ] [MAIN ] CWH: Generated 1807 derivative records from 51694 primary records. [2025-10-16T22:36:21.422441] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-10-16T22:36:21.457556] [DEBUG] [MAIN ] CWEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:21.458089] [DEBUG] [MAIN ] CWAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:21.458829] [INFO ] [MAIN ] CWAN: Generated 1807 derivative records from 53002 primary records. [2025-10-16T22:36:21.459534] [INFO ] [MAIN ] CWEN: Generated 1807 derivative records from 45638 primary records. [2025-10-16T22:36:21.463329] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-10-16T22:36:21.468015] [DEBUG] [LOCAL ] CWH: Derivative data saved (1807 records). [2025-10-16T22:36:21.468669] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-10-16T22:36:21.468100] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-16T22:36:21.470770] [INFO ] [MAIN ] Derivative Progress: 466/1803 symbols completed. CWH took 1.2s. Estimated remaining: 8m 38s. Rate: 154.7 symbols/min [2025-10-16T22:36:21.478637] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:21.502745] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1807 records). [2025-10-16T22:36:21.503833] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-10-16T22:36:21.507042] [INFO ] [MAIN ] Derivative Progress: 467/1803 symbols completed. CWEN took 1.2s. Estimated remaining: 8m 37s. Rate: 155.0 symbols/min [2025-10-16T22:36:21.507507] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1807 records). [2025-10-16T22:36:21.507637] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-10-16T22:36:21.507741] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:21.510860] [INFO ] [MAIN ] Derivative Progress: 468/1803 symbols completed. CWAN took 1.2s. Estimated remaining: 8m 36s. Rate: 155.4 symbols/min [2025-10-16T22:36:21.511275] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:21.520763] [DEBUG] [LOCAL ] CXE: Loaded 6167 existing records from primary storage. [2025-10-16T22:36:21.531120] [INFO ] [MAIN ] CXE: Loaded 6167 primary data records. [2025-10-16T22:36:21.682044] [DEBUG] [LOCAL ] CWK: Loaded 49995 existing records from primary storage. [2025-10-16T22:36:21.710110] [INFO ] [MAIN ] CWK: Loaded 49995 primary data records. [2025-10-16T22:36:21.726136] [DEBUG] [LOCAL ] CWT: Loaded 28331 existing records from primary storage. [2025-10-16T22:36:21.832184] [INFO ] [MAIN ] CWT: Loaded 28331 primary data records. [2025-10-16T22:36:22.582311] [DEBUG] [MAIN ] CXE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:22.583395] [INFO ] [MAIN ] CXE: Generated 1807 derivative records from 6167 primary records. [2025-10-16T22:36:22.583495] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-16T22:36:22.616167] [DEBUG] [MAIN ] CWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:22.617046] [DEBUG] [LOCAL ] CXE: Derivative data saved (1807 records). [2025-10-16T22:36:22.617321] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-16T22:36:22.619304] [INFO ] [MAIN ] Derivative Progress: 469/1803 symbols completed. CXE took 1.1s. Estimated remaining: 8m 37s. Rate: 154.7 symbols/min [2025-10-16T22:36:22.619670] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:22.620600] [INFO ] [MAIN ] CWK: Generated 1807 derivative records from 49995 primary records. [2025-10-16T22:36:22.620918] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-16T22:36:22.640851] [DEBUG] [LOCAL ] CWK: Derivative data saved (1807 records). [2025-10-16T22:36:22.642473] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-16T22:36:22.645750] [INFO ] [MAIN ] Derivative Progress: 470/1803 symbols completed. CWK took 1.2s. Estimated remaining: 8m 36s. Rate: 155.0 symbols/min [2025-10-16T22:36:22.646053] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:22.667009] [DEBUG] [MAIN ] CWT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:22.668392] [INFO ] [MAIN ] CWT: Generated 1807 derivative records from 28331 primary records. [2025-10-16T22:36:22.668636] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-10-16T22:36:22.689579] [DEBUG] [LOCAL ] CWT: Derivative data saved (1807 records). [2025-10-16T22:36:22.689841] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-10-16T22:36:22.692471] [INFO ] [MAIN ] Derivative Progress: 471/1803 symbols completed. CWT took 1.2s. Estimated remaining: 8m 35s. Rate: 155.3 symbols/min [2025-10-16T22:36:22.704228] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:22.740016] [DEBUG] [LOCAL ] CXT: Loaded 31299 existing records from primary storage. [2025-10-16T22:36:22.741182] [INFO ] [MAIN ] CXT: Loaded 31299 primary data records. [2025-10-16T22:36:22.741054] [DEBUG] [LOCAL ] CXM: Loaded 47906 existing records from primary storage. [2025-10-16T22:36:22.746701] [INFO ] [MAIN ] CXM: Loaded 47906 primary data records. [2025-10-16T22:36:23.077354] [DEBUG] [LOCAL ] CXW: Loaded 44193 existing records from primary storage. [2025-10-16T22:36:23.379171] [INFO ] [MAIN ] CXW: Loaded 44193 primary data records. [2025-10-16T22:36:23.798322] [DEBUG] [MAIN ] CXM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:23.816202] [INFO ] [MAIN ] CXM: Generated 1807 derivative records from 47906 primary records. [2025-10-16T22:36:23.816584] [DEBUG] [MAIN ] CXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:23.816943] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-16T22:36:23.818958] [INFO ] [MAIN ] CXT: Generated 1807 derivative records from 31299 primary records. [2025-10-16T22:36:23.819484] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-16T22:36:23.837407] [DEBUG] [LOCAL ] CXM: Derivative data saved (1807 records). [2025-10-16T22:36:23.846696] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-16T22:36:23.849615] [INFO ] [MAIN ] Derivative Progress: 472/1803 symbols completed. CXM took 1.2s. Estimated remaining: 8m 36s. Rate: 154.7 symbols/min [2025-10-16T22:36:23.858553] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:23.858412] [DEBUG] [LOCAL ] CXT: Derivative data saved (1807 records). [2025-10-16T22:36:23.859487] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-16T22:36:23.862591] [INFO ] [MAIN ] Derivative Progress: 473/1803 symbols completed. CXT took 1.2s. Estimated remaining: 8m 35s. Rate: 155.0 symbols/min [2025-10-16T22:36:23.863250] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:23.882749] [DEBUG] [MAIN ] CXW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:23.883601] [INFO ] [MAIN ] CXW: Generated 1807 derivative records from 44193 primary records. [2025-10-16T22:36:23.883808] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-16T22:36:23.902452] [DEBUG] [LOCAL ] CXW: Derivative data saved (1807 records). [2025-10-16T22:36:23.902594] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-16T22:36:23.905460] [INFO ] [MAIN ] Derivative Progress: 474/1803 symbols completed. CXW took 1.2s. Estimated remaining: 8m 34s. Rate: 155.3 symbols/min [2025-10-16T22:36:23.905838] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:23.943860] [DEBUG] [LOCAL ] CYH: Loaded 48083 existing records from primary storage. [2025-10-16T22:36:23.964401] [INFO ] [MAIN ] CYH: Loaded 48083 primary data records. [2025-10-16T22:36:23.964784] [DEBUG] [LOCAL ] DAC: Loaded 12709 existing records from primary storage. [2025-10-16T22:36:23.978695] [INFO ] [MAIN ] DAC: Loaded 12709 primary data records. [2025-10-16T22:36:24.162781] [DEBUG] [LOCAL ] D: Loaded 54036 existing records from primary storage. [2025-10-16T22:36:24.200006] [INFO ] [MAIN ] D: Loaded 54036 primary data records. [2025-10-16T22:36:25.038160] [DEBUG] [MAIN ] CYH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:25.037702] [DEBUG] [MAIN ] DAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:25.039172] [INFO ] [MAIN ] DAC: Generated 1807 derivative records from 12709 primary records. [2025-10-16T22:36:25.039346] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-16T22:36:25.040584] [INFO ] [MAIN ] CYH: Generated 1807 derivative records from 48083 primary records. [2025-10-16T22:36:25.040695] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-16T22:36:25.070341] [DEBUG] [LOCAL ] DAC: Derivative data saved (1807 records). [2025-10-16T22:36:25.074234] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-16T22:36:25.076891] [INFO ] [MAIN ] Derivative Progress: 475/1803 symbols completed. DAC took 1.2s. Estimated remaining: 8m 35s. Rate: 154.6 symbols/min [2025-10-16T22:36:25.074899] [DEBUG] [LOCAL ] CYH: Derivative data saved (1807 records). [2025-10-16T22:36:25.090526] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-16T22:36:25.094173] [INFO ] [MAIN ] Derivative Progress: 476/1803 symbols completed. CYH took 1.2s. Estimated remaining: 8m 34s. Rate: 154.9 symbols/min [2025-10-16T22:36:25.094384] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:25.093699] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:25.094091] [DEBUG] [MAIN ] D: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:25.095728] [INFO ] [MAIN ] D: Generated 1807 derivative records from 54036 primary records. [2025-10-16T22:36:25.095936] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-10-16T22:36:25.114614] [DEBUG] [LOCAL ] D: Derivative data saved (1807 records). [2025-10-16T22:36:25.114780] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-10-16T22:36:25.117550] [INFO ] [MAIN ] Derivative Progress: 477/1803 symbols completed. D took 1.3s. Estimated remaining: 8m 32s. Rate: 155.2 symbols/min [2025-10-16T22:36:25.117898] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:25.181215] [DEBUG] [LOCAL ] DAR: Loaded 52380 existing records from primary storage. [2025-10-16T22:36:25.195036] [INFO ] [MAIN ] DAR: Loaded 52380 primary data records. [2025-10-16T22:36:25.339070] [DEBUG] [LOCAL ] DAL: Loaded 54143 existing records from primary storage. [2025-10-16T22:36:25.346483] [DEBUG] [LOCAL ] DB: Loaded 52892 existing records from primary storage. [2025-10-16T22:36:25.339373] [INFO ] [MAIN ] DAL: Loaded 54143 primary data records. [2025-10-16T22:36:25.357064] [INFO ] [MAIN ] DB: Loaded 52892 primary data records. [2025-10-16T22:36:26.242339] [DEBUG] [MAIN ] DAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:26.243299] [INFO ] [MAIN ] DAR: Generated 1807 derivative records from 52380 primary records. [2025-10-16T22:36:26.243670] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-16T22:36:26.266027] [DEBUG] [LOCAL ] DAR: Derivative data saved (1807 records). [2025-10-16T22:36:26.266330] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-16T22:36:26.269231] [INFO ] [MAIN ] Derivative Progress: 478/1803 symbols completed. DAR took 1.2s. Estimated remaining: 8m 34s. Rate: 154.6 symbols/min [2025-10-16T22:36:26.283861] [DEBUG] [MAIN ] DAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:26.284860] [INFO ] [MAIN ] DAL: Generated 1807 derivative records from 54143 primary records. [2025-10-16T22:36:26.285017] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-16T22:36:26.305803] [DEBUG] [MAIN ] DB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:26.310435] [INFO ] [MAIN ] DB: Generated 1807 derivative records from 52892 primary records. [2025-10-16T22:36:26.311539] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-16T22:36:26.315164] [DEBUG] [LOCAL ] DAL: Derivative data saved (1807 records). [2025-10-16T22:36:26.315258] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-16T22:36:26.317900] [INFO ] [MAIN ] Derivative Progress: 479/1803 symbols completed. DAL took 1.2s. Estimated remaining: 8m 33s. Rate: 154.9 symbols/min [2025-10-16T22:36:26.335769] [DEBUG] [LOCAL ] DB: Derivative data saved (1807 records). [2025-10-16T22:36:26.335853] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-16T22:36:26.338463] [INFO ] [MAIN ] Derivative Progress: 480/1803 symbols completed. DB took 1.2s. Estimated remaining: 8m 31s. Rate: 155.2 symbols/min [2025-10-16T22:36:26.338842] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:26.338939] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:26.339551] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:26.352015] [DEBUG] [LOCAL ] DBL: Loaded 9490 existing records from primary storage. [2025-10-16T22:36:26.352264] [INFO ] [MAIN ] DBL: Loaded 9490 primary data records. [2025-10-16T22:36:26.710490] [DEBUG] [LOCAL ] DD: Loaded 53314 existing records from primary storage. [2025-10-16T22:36:26.712263] [DEBUG] [LOCAL ] DBI: Loaded 44191 existing records from primary storage. [2025-10-16T22:36:26.713354] [INFO ] [MAIN ] DD: Loaded 53314 primary data records. [2025-10-16T22:36:26.718846] [INFO ] [MAIN ] DBI: Loaded 44191 primary data records. [2025-10-16T22:36:27.361172] [DEBUG] [MAIN ] DBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:27.362692] [INFO ] [MAIN ] DBL: Generated 1807 derivative records from 9490 primary records. [2025-10-16T22:36:27.363094] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-10-16T22:36:27.381271] [DEBUG] [LOCAL ] DBL: Derivative data saved (1807 records). [2025-10-16T22:36:27.381852] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-10-16T22:36:27.384275] [INFO ] [MAIN ] Derivative Progress: 481/1803 symbols completed. DBL took 1.0s. Estimated remaining: 8m 33s. Rate: 154.6 symbols/min [2025-10-16T22:36:27.384561] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:27.404501] [DEBUG] [MAIN ] DD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:36:27.405269] [INFO ] [MAIN ] DD: Generated 1806 derivative records from 53314 primary records. [2025-10-16T22:36:27.405395] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-10-16T22:36:27.445442] [DEBUG] [MAIN ] DBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:27.446350] [DEBUG] [LOCAL ] DD: Derivative data saved (1806 records). [2025-10-16T22:36:27.446468] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-10-16T22:36:27.447176] [INFO ] [MAIN ] DBI: Generated 1807 derivative records from 44191 primary records. [2025-10-16T22:36:27.447272] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-16T22:36:27.449110] [INFO ] [MAIN ] Derivative Progress: 482/1803 symbols completed. DD took 1.1s. Estimated remaining: 8m 32s. Rate: 154.9 symbols/min [2025-10-16T22:36:27.450392] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:27.473867] [DEBUG] [LOCAL ] DDL: Loaded 37285 existing records from primary storage. [2025-10-16T22:36:27.474801] [INFO ] [MAIN ] DDL: Loaded 37285 primary data records. [2025-10-16T22:36:27.567502] [DEBUG] [LOCAL ] DDS: Loaded 12801 existing records from primary storage. [2025-10-16T22:36:27.573044] [INFO ] [MAIN ] DDS: Loaded 12801 primary data records. [2025-10-16T22:36:27.590603] [DEBUG] [LOCAL ] DBI: Derivative data saved (1807 records). [2025-10-16T22:36:27.627188] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-16T22:36:27.659296] [INFO ] [MAIN ] Derivative Progress: 483/1803 symbols completed. DBI took 1.3s. Estimated remaining: 8m 31s. Rate: 155.1 symbols/min [2025-10-16T22:36:27.689949] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:27.971617] [DEBUG] [LOCAL ] DDT: Loaded 2095 existing records from primary storage. [2025-10-16T22:36:28.002418] [INFO ] [MAIN ] DDT: Loaded 2095 primary data records. [2025-10-16T22:36:28.438860] [DEBUG] [MAIN ] DDL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:28.453132] [INFO ] [MAIN ] DDL: Generated 1807 derivative records from 37285 primary records. [2025-10-16T22:36:28.451890] [DEBUG] [MAIN ] DDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:28.453338] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-16T22:36:28.454272] [INFO ] [MAIN ] DDS: Generated 1807 derivative records from 12801 primary records. [2025-10-16T22:36:28.455021] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-10-16T22:36:28.487234] [DEBUG] [LOCAL ] DDS: Derivative data saved (1807 records). [2025-10-16T22:36:28.486135] [DEBUG] [LOCAL ] DDL: Derivative data saved (1807 records). [2025-10-16T22:36:28.487596] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-10-16T22:36:28.487447] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-10-16T22:36:28.490164] [INFO ] [MAIN ] Derivative Progress: 484/1803 symbols completed. DDS took 1.0s. Estimated remaining: 8m 32s. Rate: 154.7 symbols/min [2025-10-16T22:36:28.493107] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:28.493491] [INFO ] [MAIN ] Derivative Progress: 485/1803 symbols completed. DDL took 1.1s. Estimated remaining: 8m 30s. Rate: 155.0 symbols/min [2025-10-16T22:36:28.494109] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:28.510594] [DEBUG] [MAIN ] DDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:28.511368] [INFO ] [MAIN ] DDT: Generated 1807 derivative records from 2095 primary records. [2025-10-16T22:36:28.511518] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-10-16T22:36:28.525365] [DEBUG] [LOCAL ] DDT: Derivative data saved (1807 records). [2025-10-16T22:36:28.525523] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-10-16T22:36:28.528353] [INFO ] [MAIN ] Derivative Progress: 486/1803 symbols completed. DDT took 0.8s. Estimated remaining: 8m 29s. Rate: 155.3 symbols/min [2025-10-16T22:36:28.528781] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:28.578161] [DEBUG] [LOCAL ] DEC: Loaded 30584 existing records from primary storage. [2025-10-16T22:36:28.579261] [INFO ] [MAIN ] DEC: Loaded 30584 primary data records. [2025-10-16T22:36:28.579121] [DEBUG] [LOCAL ] DE: Loaded 48037 existing records from primary storage. [2025-10-16T22:36:28.600149] [INFO ] [MAIN ] DE: Loaded 48037 primary data records. [2025-10-16T22:36:28.966355] [DEBUG] [LOCAL ] DECK: Loaded 53687 existing records from primary storage. [2025-10-16T22:36:29.191830] [INFO ] [MAIN ] DECK: Loaded 53687 primary data records. [2025-10-16T22:36:29.573250] [DEBUG] [MAIN ] DEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:29.587270] [DEBUG] [MAIN ] DE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:29.588049] [INFO ] [MAIN ] DEC: Generated 1807 derivative records from 30584 primary records. [2025-10-16T22:36:29.589286] [INFO ] [MAIN ] DE: Generated 1807 derivative records from 48037 primary records. [2025-10-16T22:36:29.589379] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-16T22:36:29.588307] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-10-16T22:36:29.620312] [DEBUG] [LOCAL ] DE: Derivative data saved (1807 records). [2025-10-16T22:36:29.621319] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-16T22:36:29.622379] [DEBUG] [LOCAL ] DEC: Derivative data saved (1807 records). [2025-10-16T22:36:29.624364] [INFO ] [MAIN ] Derivative Progress: 487/1803 symbols completed. DE took 1.1s. Estimated remaining: 8m 30s. Rate: 154.7 symbols/min [2025-10-16T22:36:29.624764] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:29.624596] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-10-16T22:36:29.627946] [INFO ] [MAIN ] Derivative Progress: 488/1803 symbols completed. DEC took 1.1s. Estimated remaining: 8m 29s. Rate: 155.0 symbols/min [2025-10-16T22:36:29.628244] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:29.644695] [DEBUG] [MAIN ] DECK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:29.645389] [INFO ] [MAIN ] DECK: Generated 1807 derivative records from 53687 primary records. [2025-10-16T22:36:29.645535] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-10-16T22:36:29.661857] [DEBUG] [LOCAL ] DECK: Derivative data saved (1807 records). [2025-10-16T22:36:29.661940] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-10-16T22:36:29.665037] [INFO ] [MAIN ] Derivative Progress: 489/1803 symbols completed. DECK took 1.1s. Estimated remaining: 8m 28s. Rate: 155.3 symbols/min [2025-10-16T22:36:29.665341] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:29.707682] [DEBUG] [LOCAL ] DFIN: Loaded 22789 existing records from primary storage. [2025-10-16T22:36:29.721087] [INFO ] [MAIN ] DFIN: Loaded 22789 primary data records. [2025-10-16T22:36:29.755628] [DEBUG] [LOCAL ] DEI: Loaded 48658 existing records from primary storage. [2025-10-16T22:36:29.761123] [INFO ] [MAIN ] DEI: Loaded 48658 primary data records. [2025-10-16T22:36:29.941597] [DEBUG] [LOCAL ] DEO: Loaded 49588 existing records from primary storage. [2025-10-16T22:36:29.963501] [INFO ] [MAIN ] DEO: Loaded 49588 primary data records. [2025-10-16T22:36:30.657301] [DEBUG] [MAIN ] DFIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:30.658929] [INFO ] [MAIN ] DFIN: Generated 1807 derivative records from 22789 primary records. [2025-10-16T22:36:30.659451] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-10-16T22:36:30.675946] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1807 records). [2025-10-16T22:36:30.676122] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-10-16T22:36:30.678976] [INFO ] [MAIN ] Derivative Progress: 490/1803 symbols completed. DFIN took 1.0s. Estimated remaining: 8m 29s. Rate: 154.8 symbols/min [2025-10-16T22:36:30.679150] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:30.696955] [DEBUG] [MAIN ] DEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:30.697850] [INFO ] [MAIN ] DEO: Generated 1807 derivative records from 49588 primary records. [2025-10-16T22:36:30.709982] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-10-16T22:36:30.710195] [DEBUG] [MAIN ] DEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:30.714122] [INFO ] [MAIN ] DEI: Generated 1807 derivative records from 48658 primary records. [2025-10-16T22:36:30.714453] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-10-16T22:36:30.743028] [DEBUG] [LOCAL ] DFP: Loaded 11238 existing records from primary storage. [2025-10-16T22:36:30.745225] [INFO ] [MAIN ] DFP: Loaded 11238 primary data records. [2025-10-16T22:36:30.790954] [DEBUG] [LOCAL ] DEI: Derivative data saved (1807 records). [2025-10-16T22:36:30.803152] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-10-16T22:36:30.805557] [INFO ] [MAIN ] Derivative Progress: 491/1803 symbols completed. DEI took 1.2s. Estimated remaining: 8m 28s. Rate: 155.0 symbols/min [2025-10-16T22:36:30.819714] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:30.832127] [DEBUG] [LOCAL ] DEO: Derivative data saved (1807 records). [2025-10-16T22:36:30.837473] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-10-16T22:36:30.845623] [INFO ] [MAIN ] Derivative Progress: 492/1803 symbols completed. DEO took 1.2s. Estimated remaining: 8m 27s. Rate: 155.3 symbols/min [2025-10-16T22:36:30.859839] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:31.118298] [DEBUG] [LOCAL ] DG: Loaded 53667 existing records from primary storage. [2025-10-16T22:36:31.131523] [INFO ] [MAIN ] DG: Loaded 53667 primary data records. [2025-10-16T22:36:31.133106] [DEBUG] [MAIN ] DFP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:31.133957] [INFO ] [MAIN ] DFP: Generated 1807 derivative records from 11238 primary records. [2025-10-16T22:36:31.146185] [DEBUG] [LOCAL ] DGX: Loaded 44978 existing records from primary storage. [2025-10-16T22:36:31.165738] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-10-16T22:36:31.172064] [INFO ] [MAIN ] DGX: Loaded 44978 primary data records. [2025-10-16T22:36:31.269953] [DEBUG] [LOCAL ] DFP: Derivative data saved (1807 records). [2025-10-16T22:36:31.281705] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-10-16T22:36:31.310555] [INFO ] [MAIN ] Derivative Progress: 493/1803 symbols completed. DFP took 0.6s. Estimated remaining: 8m 26s. Rate: 155.2 symbols/min [2025-10-16T22:36:31.805281] [DEBUG] [MAIN ] DGX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:31.806200] [INFO ] [MAIN ] DGX: Generated 1807 derivative records from 44978 primary records. [2025-10-16T22:36:31.819012] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-10-16T22:36:31.818926] [DEBUG] [MAIN ] DG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:31.820434] [INFO ] [MAIN ] DG: Generated 1807 derivative records from 53667 primary records. [2025-10-16T22:36:31.820754] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-10-16T22:36:31.844428] [DEBUG] [LOCAL ] DGX: Derivative data saved (1807 records). [2025-10-16T22:36:31.848370] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-10-16T22:36:31.850837] [INFO ] [MAIN ] Derivative Progress: 494/1803 symbols completed. DGX took 1.0s. Estimated remaining: 8m 26s. Rate: 155.1 symbols/min [2025-10-16T22:36:31.854952] [DEBUG] [LOCAL ] DG: Derivative data saved (1807 records). [2025-10-16T22:36:31.855031] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-10-16T22:36:31.856999] [INFO ] [MAIN ] Derivative Progress: 495/1803 symbols completed. DG took 1.0s. Estimated remaining: 8m 25s. Rate: 155.4 symbols/min [2025-10-16T22:36:31.857388] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:31.857623] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:31.857512] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:31.882157] [DEBUG] [LOCAL ] DHF: Loaded 21169 existing records from primary storage. [2025-10-16T22:36:31.882389] [INFO ] [MAIN ] DHF: Loaded 21169 primary data records. [2025-10-16T22:36:32.098913] [DEBUG] [LOCAL ] DHI: Loaded 53756 existing records from primary storage. [2025-10-16T22:36:32.104805] [INFO ] [MAIN ] DHI: Loaded 53756 primary data records. [2025-10-16T22:36:32.267124] [DEBUG] [LOCAL ] DHR: Loaded 53768 existing records from primary storage. [2025-10-16T22:36:32.288972] [INFO ] [MAIN ] DHR: Loaded 53768 primary data records. [2025-10-16T22:36:33.094446] [DEBUG] [MAIN ] DHF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:33.096379] [INFO ] [MAIN ] DHF: Generated 1807 derivative records from 21169 primary records. [2025-10-16T22:36:33.096918] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-10-16T22:36:33.122002] [DEBUG] [LOCAL ] DHF: Derivative data saved (1807 records). [2025-10-16T22:36:33.122631] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-10-16T22:36:33.139366] [INFO ] [MAIN ] Derivative Progress: 496/1803 symbols completed. DHF took 1.3s. Estimated remaining: 8m 27s. Rate: 154.7 symbols/min [2025-10-16T22:36:33.136863] [DEBUG] [MAIN ] DHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:33.139742] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:33.141001] [INFO ] [MAIN ] DHI: Generated 1807 derivative records from 53756 primary records. [2025-10-16T22:36:33.141278] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-10-16T22:36:33.194315] [DEBUG] [LOCAL ] DHX: Loaded 13573 existing records from primary storage. [2025-10-16T22:36:33.196815] [INFO ] [MAIN ] DHX: Loaded 13573 primary data records. [2025-10-16T22:36:33.196338] [DEBUG] [MAIN ] DHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:33.198010] [INFO ] [MAIN ] DHR: Generated 1807 derivative records from 53768 primary records. [2025-10-16T22:36:33.204350] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-10-16T22:36:33.214623] [DEBUG] [LOCAL ] DHI: Derivative data saved (1807 records). [2025-10-16T22:36:33.257598] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-10-16T22:36:33.313603] [INFO ] [MAIN ] Derivative Progress: 497/1803 symbols completed. DHI took 1.5s. Estimated remaining: 8m 26s. Rate: 154.9 symbols/min [2025-10-16T22:36:33.316894] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:33.428812] [DEBUG] [LOCAL ] DHR: Derivative data saved (1807 records). [2025-10-16T22:36:33.558809] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-10-16T22:36:33.562590] [INFO ] [MAIN ] Derivative Progress: 498/1803 symbols completed. DHR took 1.7s. Estimated remaining: 8m 25s. Rate: 155.0 symbols/min [2025-10-16T22:36:33.563166] [DEBUG] [LOCAL ] DIAX: Loaded 13091 existing records from primary storage. [2025-10-16T22:36:33.563606] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:33.563855] [INFO ] [MAIN ] DIAX: Loaded 13091 primary data records. [2025-10-16T22:36:33.932981] [DEBUG] [LOCAL ] DIN: Loaded 37519 existing records from primary storage. [2025-10-16T22:36:33.934816] [INFO ] [MAIN ] DIN: Loaded 37519 primary data records. [2025-10-16T22:36:34.053175] [DEBUG] [MAIN ] DHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:34.054321] [INFO ] [MAIN ] DHX: Generated 1807 derivative records from 13573 primary records. [2025-10-16T22:36:34.054502] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-10-16T22:36:34.260508] [DEBUG] [LOCAL ] DHX: Derivative data saved (1807 records). [2025-10-16T22:36:34.261628] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-10-16T22:36:34.264004] [INFO ] [MAIN ] Derivative Progress: 499/1803 symbols completed. DHX took 1.1s. Estimated remaining: 8m 26s. Rate: 154.7 symbols/min [2025-10-16T22:36:34.264434] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:34.284852] [DEBUG] [MAIN ] DIAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:34.286635] [INFO ] [MAIN ] DIAX: Generated 1807 derivative records from 13091 primary records. [2025-10-16T22:36:34.286768] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-10-16T22:36:34.307364] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1807 records). [2025-10-16T22:36:34.307855] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-10-16T22:36:34.310340] [INFO ] [MAIN ] Derivative Progress: 500/1803 symbols completed. DIAX took 1.0s. Estimated remaining: 8m 24s. Rate: 155.0 symbols/min [2025-10-16T22:36:34.310671] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:34.343826] [DEBUG] [MAIN ] DIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:34.345029] [INFO ] [MAIN ] DIN: Generated 1807 derivative records from 37519 primary records. [2025-10-16T22:36:34.345245] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-16T22:36:34.379371] [DEBUG] [LOCAL ] DIN: Derivative data saved (1807 records). [2025-10-16T22:36:34.379711] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-10-16T22:36:34.382248] [INFO ] [MAIN ] Derivative Progress: 501/1803 symbols completed. DIN took 0.8s. Estimated remaining: 8m 23s. Rate: 155.3 symbols/min [2025-10-16T22:36:34.383430] [DEBUG] [LOCAL ] DINO: Loaded 53216 existing records from primary storage. [2025-10-16T22:36:34.383692] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:34.397896] [INFO ] [MAIN ] DINO: Loaded 53216 primary data records. [2025-10-16T22:36:34.585782] [DEBUG] [LOCAL ] DIS: Loaded 54178 existing records from primary storage. [2025-10-16T22:36:34.616839] [INFO ] [MAIN ] DIS: Loaded 54178 primary data records. [2025-10-16T22:36:34.854984] [DEBUG] [LOCAL ] DK: Loaded 49758 existing records from primary storage. [2025-10-16T22:36:34.866520] [INFO ] [MAIN ] DK: Loaded 49758 primary data records. [2025-10-16T22:36:35.381496] [DEBUG] [MAIN ] DINO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:35.382565] [INFO ] [MAIN ] DINO: Generated 1807 derivative records from 53216 primary records. [2025-10-16T22:36:35.383048] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-10-16T22:36:35.407253] [DEBUG] [LOCAL ] DINO: Derivative data saved (1807 records). [2025-10-16T22:36:35.407416] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-10-16T22:36:35.409796] [INFO ] [MAIN ] Derivative Progress: 502/1803 symbols completed. DINO took 1.1s. Estimated remaining: 8m 24s. Rate: 154.7 symbols/min [2025-10-16T22:36:35.418122] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:35.424164] [DEBUG] [MAIN ] DIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:35.425128] [INFO ] [MAIN ] DIS: Generated 1807 derivative records from 54178 primary records. [2025-10-16T22:36:35.425467] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-10-16T22:36:35.445299] [DEBUG] [LOCAL ] DIS: Derivative data saved (1807 records). [2025-10-16T22:36:35.445574] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-10-16T22:36:35.447879] [INFO ] [MAIN ] Derivative Progress: 503/1803 symbols completed. DIS took 1.1s. Estimated remaining: 8m 23s. Rate: 155.0 symbols/min [2025-10-16T22:36:35.449292] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:35.465220] [DEBUG] [MAIN ] DK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:35.465869] [INFO ] [MAIN ] DK: Generated 1807 derivative records from 49758 primary records. [2025-10-16T22:36:35.466072] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-10-16T22:36:35.493908] [DEBUG] [LOCAL ] DK: Derivative data saved (1807 records). [2025-10-16T22:36:35.494116] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-10-16T22:36:35.504186] [INFO ] [MAIN ] Derivative Progress: 504/1803 symbols completed. DK took 1.1s. Estimated remaining: 8m 22s. Rate: 155.3 symbols/min [2025-10-16T22:36:35.504466] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:35.518880] [DEBUG] [LOCAL ] DLB: Loaded 32489 existing records from primary storage. [2025-10-16T22:36:35.521266] [INFO ] [MAIN ] DLB: Loaded 32489 primary data records. [2025-10-16T22:36:35.584620] [DEBUG] [LOCAL ] DLNG: Loaded 6230 existing records from primary storage. [2025-10-16T22:36:35.611520] [INFO ] [MAIN ] DLNG: Loaded 6230 primary data records. [2025-10-16T22:36:35.619363] [DEBUG] [LOCAL ] DKS: Loaded 50058 existing records from primary storage. [2025-10-16T22:36:35.667907] [INFO ] [MAIN ] DKS: Loaded 50058 primary data records. [2025-10-16T22:36:36.551007] [DEBUG] [MAIN ] DLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:36.552049] [INFO ] [MAIN ] DLB: Generated 1807 derivative records from 32489 primary records. [2025-10-16T22:36:36.552743] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-10-16T22:36:36.574436] [DEBUG] [LOCAL ] DLB: Derivative data saved (1807 records). [2025-10-16T22:36:36.575026] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-10-16T22:36:36.577148] [INFO ] [MAIN ] Derivative Progress: 505/1803 symbols completed. DLB took 1.1s. Estimated remaining: 8m 23s. Rate: 154.7 symbols/min [2025-10-16T22:36:36.577457] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:36.592241] [DEBUG] [MAIN ] DLNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:36.594607] [INFO ] [MAIN ] DLNG: Generated 1807 derivative records from 6230 primary records. [2025-10-16T22:36:36.594836] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-10-16T22:36:36.615485] [DEBUG] [MAIN ] DKS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:36.624048] [INFO ] [MAIN ] DKS: Generated 1807 derivative records from 50058 primary records. [2025-10-16T22:36:36.624248] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-10-16T22:36:36.624162] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1807 records). [2025-10-16T22:36:36.625309] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-10-16T22:36:36.636096] [INFO ] [MAIN ] Derivative Progress: 506/1803 symbols completed. DLNG took 1.1s. Estimated remaining: 8m 22s. Rate: 155.0 symbols/min [2025-10-16T22:36:36.640785] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:36.645300] [DEBUG] [LOCAL ] DKS: Derivative data saved (1807 records). [2025-10-16T22:36:36.645501] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-10-16T22:36:36.648108] [INFO ] [MAIN ] Derivative Progress: 507/1803 symbols completed. DKS took 1.2s. Estimated remaining: 8m 21s. Rate: 155.3 symbols/min [2025-10-16T22:36:36.648727] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:36.688059] [DEBUG] [LOCAL ] DLY: Loaded 20735 existing records from primary storage. [2025-10-16T22:36:36.701611] [INFO ] [MAIN ] DLY: Loaded 20735 primary data records. [2025-10-16T22:36:36.722936] [DEBUG] [LOCAL ] DLR: Loaded 51052 existing records from primary storage. [2025-10-16T22:36:36.732977] [DEBUG] [LOCAL ] DLX: Loaded 28520 existing records from primary storage. [2025-10-16T22:36:36.732407] [INFO ] [MAIN ] DLR: Loaded 51052 primary data records. [2025-10-16T22:36:36.795164] [INFO ] [MAIN ] DLX: Loaded 28520 primary data records. [2025-10-16T22:36:37.712071] [DEBUG] [MAIN ] DLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:37.711824] [DEBUG] [MAIN ] DLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:37.713839] [INFO ] [MAIN ] DLR: Generated 1807 derivative records from 51052 primary records. [2025-10-16T22:36:37.713231] [INFO ] [MAIN ] DLY: Generated 1807 derivative records from 20735 primary records. [2025-10-16T22:36:37.714017] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-10-16T22:36:37.714102] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-16T22:36:37.758783] [DEBUG] [LOCAL ] DLY: Derivative data saved (1807 records). [2025-10-16T22:36:37.759123] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-10-16T22:36:37.762373] [INFO ] [MAIN ] Derivative Progress: 508/1803 symbols completed. DLY took 1.1s. Estimated remaining: 8m 22s. Rate: 154.7 symbols/min [2025-10-16T22:36:37.763811] [DEBUG] [LOCAL ] DLR: Derivative data saved (1807 records). [2025-10-16T22:36:37.763908] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-16T22:36:37.765879] [INFO ] [MAIN ] Derivative Progress: 509/1803 symbols completed. DLR took 1.2s. Estimated remaining: 8m 21s. Rate: 155.0 symbols/min [2025-10-16T22:36:37.757632] [DEBUG] [MAIN ] DLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:37.766829] [INFO ] [MAIN ] DLX: Generated 1807 derivative records from 28520 primary records. [2025-10-16T22:36:37.766951] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-16T22:36:37.782495] [DEBUG] [LOCAL ] DLX: Derivative data saved (1807 records). [2025-10-16T22:36:37.782580] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-10-16T22:36:37.785400] [INFO ] [MAIN ] Derivative Progress: 510/1803 symbols completed. DLX took 1.1s. Estimated remaining: 8m 20s. Rate: 155.3 symbols/min [2025-10-16T22:36:37.785874] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:37.785802] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:37.786045] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:37.794604] [DEBUG] [LOCAL ] DMA: Loaded 4772 existing records from primary storage. [2025-10-16T22:36:37.794811] [INFO ] [MAIN ] DMA: Loaded 4772 primary data records. [2025-10-16T22:36:37.871754] [DEBUG] [LOCAL ] DMO: Loaded 9999 existing records from primary storage. [2025-10-16T22:36:37.889533] [INFO ] [MAIN ] DMO: Loaded 9999 primary data records. [2025-10-16T22:36:38.303505] [DEBUG] [LOCAL ] DNA: Loaded 48954 existing records from primary storage. [2025-10-16T22:36:38.405451] [INFO ] [MAIN ] DNA: Loaded 48954 primary data records. [2025-10-16T22:36:38.762060] [DEBUG] [MAIN ] DMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:38.761317] [DEBUG] [MAIN ] DMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:38.763040] [INFO ] [MAIN ] DMO: Generated 1807 derivative records from 9999 primary records. [2025-10-16T22:36:38.763787] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-10-16T22:36:38.763627] [INFO ] [MAIN ] DMA: Generated 1807 derivative records from 4772 primary records. [2025-10-16T22:36:38.763946] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-16T22:36:38.789076] [DEBUG] [LOCAL ] DMO: Derivative data saved (1807 records). [2025-10-16T22:36:38.789353] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-10-16T22:36:38.794185] [INFO ] [MAIN ] Derivative Progress: 511/1803 symbols completed. DMO took 1.0s. Estimated remaining: 8m 21s. Rate: 154.8 symbols/min [2025-10-16T22:36:38.798185] [DEBUG] [LOCAL ] DMA: Derivative data saved (1807 records). [2025-10-16T22:36:38.798595] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-10-16T22:36:38.798495] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:38.801224] [INFO ] [MAIN ] Derivative Progress: 512/1803 symbols completed. DMA took 1.0s. Estimated remaining: 8m 19s. Rate: 155.1 symbols/min [2025-10-16T22:36:38.801661] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:38.825448] [DEBUG] [MAIN ] DNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:38.826329] [INFO ] [MAIN ] DNA: Generated 1807 derivative records from 48954 primary records. [2025-10-16T22:36:38.828736] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-10-16T22:36:38.865214] [DEBUG] [LOCAL ] DNA: Derivative data saved (1807 records). [2025-10-16T22:36:38.865340] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-10-16T22:36:38.868120] [INFO ] [MAIN ] Derivative Progress: 513/1803 symbols completed. DNA took 1.1s. Estimated remaining: 8m 18s. Rate: 155.4 symbols/min [2025-10-16T22:36:38.878694] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:38.879831] [DEBUG] [LOCAL ] DNP: Loaded 33479 existing records from primary storage. [2025-10-16T22:36:38.880024] [INFO ] [MAIN ] DNP: Loaded 33479 primary data records. [2025-10-16T22:36:38.975365] [DEBUG] [LOCAL ] DNOW: Loaded 44124 existing records from primary storage. [2025-10-16T22:36:38.987606] [INFO ] [MAIN ] DNOW: Loaded 44124 primary data records. [2025-10-16T22:36:39.421065] [DEBUG] [LOCAL ] DOC: Loaded 53944 existing records from primary storage. [2025-10-16T22:36:39.549937] [INFO ] [MAIN ] DOC: Loaded 53944 primary data records. [2025-10-16T22:36:39.951992] [DEBUG] [MAIN ] DNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:39.953945] [INFO ] [MAIN ] DNP: Generated 1807 derivative records from 33479 primary records. [2025-10-16T22:36:39.954419] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-16T22:36:39.974354] [DEBUG] [LOCAL ] DNP: Derivative data saved (1807 records). [2025-10-16T22:36:39.975857] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-10-16T22:36:39.978630] [INFO ] [MAIN ] Derivative Progress: 514/1803 symbols completed. DNP took 1.2s. Estimated remaining: 8m 20s. Rate: 154.8 symbols/min [2025-10-16T22:36:39.981052] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:39.996037] [DEBUG] [MAIN ] DNOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:39.998217] [INFO ] [MAIN ] DNOW: Generated 1807 derivative records from 44124 primary records. [2025-10-16T22:36:39.998590] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-16T22:36:40.015894] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1807 records). [2025-10-16T22:36:40.016158] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-10-16T22:36:40.018681] [INFO ] [MAIN ] Derivative Progress: 515/1803 symbols completed. DNOW took 1.2s. Estimated remaining: 8m 18s. Rate: 155.1 symbols/min [2025-10-16T22:36:40.019304] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:40.036603] [DEBUG] [MAIN ] DOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:40.037343] [INFO ] [MAIN ] DOC: Generated 1807 derivative records from 53944 primary records. [2025-10-16T22:36:40.037576] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-16T22:36:40.068010] [DEBUG] [LOCAL ] DOC: Derivative data saved (1807 records). [2025-10-16T22:36:40.068388] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-16T22:36:40.071335] [INFO ] [MAIN ] Derivative Progress: 516/1803 symbols completed. DOC took 1.2s. Estimated remaining: 8m 17s. Rate: 155.3 symbols/min [2025-10-16T22:36:40.071763] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:40.103150] [DEBUG] [LOCAL ] DOCN: Loaded 51421 existing records from primary storage. [2025-10-16T22:36:40.103449] [INFO ] [MAIN ] DOCN: Loaded 51421 primary data records. [2025-10-16T22:36:40.241591] [DEBUG] [LOCAL ] DOCS: Loaded 51081 existing records from primary storage. [2025-10-16T22:36:40.242252] [INFO ] [MAIN ] DOCS: Loaded 51081 primary data records. [2025-10-16T22:36:40.475546] [DEBUG] [LOCAL ] DOLE: Loaded 39478 existing records from primary storage. [2025-10-16T22:36:40.577519] [INFO ] [MAIN ] DOLE: Loaded 39478 primary data records. [2025-10-16T22:36:41.076860] [DEBUG] [MAIN ] DOCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:41.078716] [INFO ] [MAIN ] DOCN: Generated 1807 derivative records from 51421 primary records. [2025-10-16T22:36:41.079013] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-16T22:36:41.111177] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1807 records). [2025-10-16T22:36:41.111785] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-16T22:36:41.111978] [DEBUG] [MAIN ] DOCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:41.112697] [INFO ] [MAIN ] DOCS: Generated 1807 derivative records from 51081 primary records. [2025-10-16T22:36:41.114846] [INFO ] [MAIN ] Derivative Progress: 517/1803 symbols completed. DOCN took 1.1s. Estimated remaining: 8m 18s. Rate: 154.8 symbols/min [2025-10-16T22:36:41.112893] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-10-16T22:36:41.115531] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:41.135338] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1807 records). [2025-10-16T22:36:41.135521] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-10-16T22:36:41.138034] [INFO ] [MAIN ] Derivative Progress: 518/1803 symbols completed. DOCS took 1.1s. Estimated remaining: 8m 17s. Rate: 155.1 symbols/min [2025-10-16T22:36:41.152174] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:41.152834] [DEBUG] [MAIN ] DOLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:41.153862] [INFO ] [MAIN ] DOLE: Generated 1807 derivative records from 39478 primary records. [2025-10-16T22:36:41.153951] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-10-16T22:36:41.181980] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1807 records). [2025-10-16T22:36:41.182274] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-10-16T22:36:41.184617] [INFO ] [MAIN ] Derivative Progress: 519/1803 symbols completed. DOLE took 1.1s. Estimated remaining: 8m 16s. Rate: 155.4 symbols/min [2025-10-16T22:36:41.184944] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:41.201198] [DEBUG] [LOCAL ] DOUG: Loaded 34428 existing records from primary storage. [2025-10-16T22:36:41.201340] [INFO ] [MAIN ] DOUG: Loaded 34428 primary data records. [2025-10-16T22:36:41.355957] [DEBUG] [LOCAL ] DOV: Loaded 45966 existing records from primary storage. [2025-10-16T22:36:41.356571] [INFO ] [MAIN ] DOV: Loaded 45966 primary data records. [2025-10-16T22:36:41.774915] [DEBUG] [LOCAL ] DOW: Loaded 54123 existing records from primary storage. [2025-10-16T22:36:41.928694] [INFO ] [MAIN ] DOW: Loaded 54123 primary data records. [2025-10-16T22:36:42.246922] [DEBUG] [MAIN ] DOUG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:42.248291] [INFO ] [MAIN ] DOUG: Generated 1807 derivative records from 34428 primary records. [2025-10-16T22:36:42.248525] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-16T22:36:42.269538] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1807 records). [2025-10-16T22:36:42.271615] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-16T22:36:42.274278] [INFO ] [MAIN ] Derivative Progress: 520/1803 symbols completed. DOUG took 1.2s. Estimated remaining: 8m 17s. Rate: 154.8 symbols/min [2025-10-16T22:36:42.274592] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:42.289562] [DEBUG] [MAIN ] DOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:42.290284] [INFO ] [MAIN ] DOV: Generated 1807 derivative records from 45966 primary records. [2025-10-16T22:36:42.290476] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-16T22:36:42.322681] [DEBUG] [LOCAL ] DOV: Derivative data saved (1807 records). [2025-10-16T22:36:42.327976] [DEBUG] [MAIN ] DOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:42.327621] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-10-16T22:36:42.328720] [INFO ] [MAIN ] DOW: Generated 1807 derivative records from 54123 primary records. [2025-10-16T22:36:42.337008] [DEBUG] [LOCAL ] DPG: Loaded 13660 existing records from primary storage. [2025-10-16T22:36:42.336597] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-10-16T22:36:42.336498] [INFO ] [MAIN ] Derivative Progress: 521/1803 symbols completed. DOV took 1.2s. Estimated remaining: 8m 16s. Rate: 155.1 symbols/min [2025-10-16T22:36:42.337856] [INFO ] [MAIN ] DPG: Loaded 13660 primary data records. [2025-10-16T22:36:42.337790] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:42.438702] [DEBUG] [LOCAL ] DOW: Derivative data saved (1807 records). [2025-10-16T22:36:42.457600] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-10-16T22:36:42.461474] [INFO ] [MAIN ] Derivative Progress: 522/1803 symbols completed. DOW took 1.3s. Estimated remaining: 8m 15s. Rate: 155.3 symbols/min [2025-10-16T22:36:42.466771] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:42.723794] [DEBUG] [LOCAL ] DSM: Loaded 14194 existing records from primary storage. [2025-10-16T22:36:42.723961] [INFO ] [MAIN ] DSM: Loaded 14194 primary data records. [2025-10-16T22:36:42.832986] [DEBUG] [LOCAL ] DQ: Loaded 44086 existing records from primary storage. [2025-10-16T22:36:42.838305] [INFO ] [MAIN ] DQ: Loaded 44086 primary data records. [2025-10-16T22:36:43.371079] [DEBUG] [MAIN ] DPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:43.372573] [INFO ] [MAIN ] DPG: Generated 1807 derivative records from 13660 primary records. [2025-10-16T22:36:43.372796] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-16T22:36:43.407609] [DEBUG] [LOCAL ] DPG: Derivative data saved (1807 records). [2025-10-16T22:36:43.412926] [DEBUG] [MAIN ] DSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:43.413931] [INFO ] [MAIN ] DSM: Generated 1807 derivative records from 14194 primary records. [2025-10-16T22:36:43.413106] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-10-16T22:36:43.414025] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-10-16T22:36:43.417278] [INFO ] [MAIN ] Derivative Progress: 523/1803 symbols completed. DPG took 1.1s. Estimated remaining: 8m 16s. Rate: 154.8 symbols/min [2025-10-16T22:36:43.445818] [DEBUG] [LOCAL ] DSM: Derivative data saved (1807 records). [2025-10-16T22:36:43.446439] [DEBUG] [MAIN ] DQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:43.446519] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-10-16T22:36:43.447147] [INFO ] [MAIN ] DQ: Generated 1807 derivative records from 44086 primary records. [2025-10-16T22:36:43.449694] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-10-16T22:36:43.449579] [INFO ] [MAIN ] Derivative Progress: 524/1803 symbols completed. DSM took 1.0s. Estimated remaining: 8m 15s. Rate: 155.1 symbols/min [2025-10-16T22:36:43.465327] [DEBUG] [LOCAL ] DQ: Derivative data saved (1807 records). [2025-10-16T22:36:43.465388] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-10-16T22:36:43.467681] [INFO ] [MAIN ] Derivative Progress: 525/1803 symbols completed. DQ took 1.1s. Estimated remaining: 8m 13s. Rate: 155.4 symbols/min [2025-10-16T22:36:43.468221] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:43.468511] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:43.468161] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:43.499980] [DEBUG] [LOCAL ] DSX: Loaded 24160 existing records from primary storage. [2025-10-16T22:36:43.500125] [INFO ] [MAIN ] DSX: Loaded 24160 primary data records. [2025-10-16T22:36:43.544312] [DEBUG] [LOCAL ] DSU: Loaded 23202 existing records from primary storage. [2025-10-16T22:36:43.585622] [INFO ] [MAIN ] DSU: Loaded 23202 primary data records. [2025-10-16T22:36:43.841031] [DEBUG] [LOCAL ] DT: Loaded 53331 existing records from primary storage. [2025-10-16T22:36:43.977534] [INFO ] [MAIN ] DT: Loaded 53331 primary data records. [2025-10-16T22:36:44.516348] [DEBUG] [MAIN ] DSX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:44.518299] [INFO ] [MAIN ] DSX: Generated 1807 derivative records from 24160 primary records. [2025-10-16T22:36:44.518403] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-10-16T22:36:44.536855] [DEBUG] [LOCAL ] DSX: Derivative data saved (1807 records). [2025-10-16T22:36:44.537095] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-10-16T22:36:44.540044] [INFO ] [MAIN ] Derivative Progress: 526/1803 symbols completed. DSX took 1.1s. Estimated remaining: 8m 15s. Rate: 154.9 symbols/min [2025-10-16T22:36:44.540400] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:44.555311] [DEBUG] [MAIN ] DSU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:44.556542] [INFO ] [MAIN ] DSU: Generated 1807 derivative records from 23202 primary records. [2025-10-16T22:36:44.556667] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-16T22:36:44.572133] [DEBUG] [LOCAL ] DTB: Loaded 5017 existing records from primary storage. [2025-10-16T22:36:44.573730] [INFO ] [MAIN ] DTB: Loaded 5017 primary data records. [2025-10-16T22:36:44.647493] [DEBUG] [LOCAL ] DSU: Derivative data saved (1807 records). [2025-10-16T22:36:44.646322] [DEBUG] [MAIN ] DT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:44.656128] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-10-16T22:36:44.671009] [INFO ] [MAIN ] DT: Generated 1807 derivative records from 53331 primary records. [2025-10-16T22:36:44.664073] [INFO ] [MAIN ] Derivative Progress: 527/1803 symbols completed. DSU took 1.2s. Estimated remaining: 8m 14s. Rate: 155.1 symbols/min [2025-10-16T22:36:44.681381] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-10-16T22:36:44.681621] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:44.740227] [DEBUG] [LOCAL ] DT: Derivative data saved (1807 records). [2025-10-16T22:36:44.752623] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-10-16T22:36:44.763749] [INFO ] [MAIN ] Derivative Progress: 528/1803 symbols completed. DT took 1.3s. Estimated remaining: 8m 13s. Rate: 155.3 symbols/min [2025-10-16T22:36:44.763966] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:44.956714] [DEBUG] [MAIN ] DTB: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:36:44.957840] [INFO ] [MAIN ] DTB: Generated 1806 derivative records from 5017 primary records. [2025-10-16T22:36:44.968682] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-10-16T22:36:44.991341] [DEBUG] [LOCAL ] DTM: Loaded 44243 existing records from primary storage. [2025-10-16T22:36:44.992956] [INFO ] [MAIN ] DTM: Loaded 44243 primary data records. [2025-10-16T22:36:44.999303] [DEBUG] [LOCAL ] DTE: Loaded 47720 existing records from primary storage. [2025-10-16T22:36:45.004842] [INFO ] [MAIN ] DTE: Loaded 47720 primary data records. [2025-10-16T22:36:45.019033] [DEBUG] [LOCAL ] DTB: Derivative data saved (1806 records). [2025-10-16T22:36:45.019337] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-10-16T22:36:45.068473] [INFO ] [MAIN ] Derivative Progress: 529/1803 symbols completed. DTB took 0.5s. Estimated remaining: 8m 12s. Rate: 155.4 symbols/min [2025-10-16T22:36:45.106274] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:45.336721] [DEBUG] [LOCAL ] DTW: Loaded 4840 existing records from primary storage. [2025-10-16T22:36:45.363733] [INFO ] [MAIN ] DTW: Loaded 4840 primary data records. [2025-10-16T22:36:46.016295] [DEBUG] [MAIN ] DTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:46.017403] [INFO ] [MAIN ] DTE: Generated 1807 derivative records from 47720 primary records. [2025-10-16T22:36:46.017784] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-10-16T22:36:46.048491] [DEBUG] [LOCAL ] DTE: Derivative data saved (1807 records). [2025-10-16T22:36:46.048929] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-10-16T22:36:46.045925] [DEBUG] [MAIN ] DTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:46.050685] [INFO ] [MAIN ] DTM: Generated 1807 derivative records from 44243 primary records. [2025-10-16T22:36:46.054304] [INFO ] [MAIN ] Derivative Progress: 530/1803 symbols completed. DTE took 1.4s. Estimated remaining: 8m 13s. Rate: 154.9 symbols/min [2025-10-16T22:36:46.054494] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:46.054684] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-10-16T22:36:46.069433] [DEBUG] [MAIN ] DTW: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:36:46.077380] [INFO ] [MAIN ] DTW: Generated 1806 derivative records from 4840 primary records. [2025-10-16T22:36:46.078749] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-10-16T22:36:46.085854] [DEBUG] [LOCAL ] DTM: Derivative data saved (1807 records). [2025-10-16T22:36:46.086327] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-10-16T22:36:46.088632] [INFO ] [MAIN ] Derivative Progress: 531/1803 symbols completed. DTM took 1.3s. Estimated remaining: 8m 12s. Rate: 155.2 symbols/min [2025-10-16T22:36:46.089099] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:46.104049] [DEBUG] [LOCAL ] DTW: Derivative data saved (1806 records). [2025-10-16T22:36:46.104347] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-10-16T22:36:46.107199] [INFO ] [MAIN ] Derivative Progress: 532/1803 symbols completed. DTW took 1.0s. Estimated remaining: 8m 11s. Rate: 155.4 symbols/min [2025-10-16T22:36:46.107601] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:46.115230] [DEBUG] [LOCAL ] DUKB: Loaded 6305 existing records from primary storage. [2025-10-16T22:36:46.115683] [INFO ] [MAIN ] DUKB: Loaded 6305 primary data records. [2025-10-16T22:36:46.446936] [DEBUG] [LOCAL ] DUK: Loaded 53827 existing records from primary storage. [2025-10-16T22:36:46.447323] [INFO ] [MAIN ] DUK: Loaded 53827 primary data records. [2025-10-16T22:36:46.572152] [DEBUG] [LOCAL ] DV: Loaded 51681 existing records from primary storage. [2025-10-16T22:36:46.578700] [INFO ] [MAIN ] DV: Loaded 51681 primary data records. [2025-10-16T22:36:47.100690] [DEBUG] [MAIN ] DUKB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:47.101468] [INFO ] [MAIN ] DUKB: Generated 1807 derivative records from 6305 primary records. [2025-10-16T22:36:47.101872] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-10-16T22:36:47.125302] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1807 records). [2025-10-16T22:36:47.125417] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-10-16T22:36:47.127987] [INFO ] [MAIN ] Derivative Progress: 533/1803 symbols completed. DUKB took 1.0s. Estimated remaining: 8m 12s. Rate: 155.0 symbols/min [2025-10-16T22:36:47.128151] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:47.148019] [DEBUG] [MAIN ] DUK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:47.148961] [INFO ] [MAIN ] DUK: Generated 1807 derivative records from 53827 primary records. [2025-10-16T22:36:47.149321] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-10-16T22:36:47.168097] [DEBUG] [LOCAL ] DUK: Derivative data saved (1807 records). [2025-10-16T22:36:47.171785] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-10-16T22:36:47.173724] [INFO ] [MAIN ] Derivative Progress: 534/1803 symbols completed. DUK took 1.1s. Estimated remaining: 8m 11s. Rate: 155.2 symbols/min [2025-10-16T22:36:47.183411] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:47.196942] [DEBUG] [MAIN ] DV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:47.197711] [INFO ] [MAIN ] DV: Generated 1807 derivative records from 51681 primary records. [2025-10-16T22:36:47.197982] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-16T22:36:47.214024] [DEBUG] [LOCAL ] DV: Derivative data saved (1807 records). [2025-10-16T22:36:47.214944] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-16T22:36:47.217496] [INFO ] [MAIN ] Derivative Progress: 535/1803 symbols completed. DV took 1.1s. Estimated remaining: 8m 9s. Rate: 155.5 symbols/min [2025-10-16T22:36:47.217867] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:47.231782] [DEBUG] [LOCAL ] DVA: Loaded 41337 existing records from primary storage. [2025-10-16T22:36:47.232082] [INFO ] [MAIN ] DVA: Loaded 41337 primary data records. [2025-10-16T22:36:47.586404] [DEBUG] [LOCAL ] DVN: Loaded 54089 existing records from primary storage. [2025-10-16T22:36:47.587852] [INFO ] [MAIN ] DVN: Loaded 54089 primary data records. [2025-10-16T22:36:47.588700] [DEBUG] [LOCAL ] DXC: Loaded 50260 existing records from primary storage. [2025-10-16T22:36:47.611284] [INFO ] [MAIN ] DXC: Loaded 50260 primary data records. [2025-10-16T22:36:48.269178] [DEBUG] [MAIN ] DVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:48.270696] [INFO ] [MAIN ] DVA: Generated 1807 derivative records from 41337 primary records. [2025-10-16T22:36:48.270940] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-16T22:36:48.290011] [DEBUG] [LOCAL ] DVA: Derivative data saved (1807 records). [2025-10-16T22:36:48.290470] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-10-16T22:36:48.292759] [INFO ] [MAIN ] Derivative Progress: 536/1803 symbols completed. DVA took 1.2s. Estimated remaining: 8m 11s. Rate: 155.0 symbols/min [2025-10-16T22:36:48.293346] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:48.324435] [DEBUG] [MAIN ] DXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:48.330926] [INFO ] [MAIN ] DXC: Generated 1807 derivative records from 50260 primary records. [2025-10-16T22:36:48.331018] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-10-16T22:36:48.330125] [DEBUG] [MAIN ] DVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:48.332056] [INFO ] [MAIN ] DVN: Generated 1807 derivative records from 54089 primary records. [2025-10-16T22:36:48.332199] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-10-16T22:36:48.365827] [DEBUG] [LOCAL ] DXC: Derivative data saved (1807 records). [2025-10-16T22:36:48.367253] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-10-16T22:36:48.372910] [INFO ] [MAIN ] Derivative Progress: 537/1803 symbols completed. DXC took 1.2s. Estimated remaining: 8m 9s. Rate: 155.2 symbols/min [2025-10-16T22:36:48.374772] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:48.390422] [DEBUG] [LOCAL ] DXYZ: Loaded 37483 existing records from primary storage. [2025-10-16T22:36:48.391376] [DEBUG] [LOCAL ] DVN: Derivative data saved (1807 records). [2025-10-16T22:36:48.391573] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-10-16T22:36:48.391701] [INFO ] [MAIN ] DXYZ: Loaded 37483 primary data records. [2025-10-16T22:36:48.394025] [INFO ] [MAIN ] Derivative Progress: 538/1803 symbols completed. DVN took 1.2s. Estimated remaining: 8m 8s. Rate: 155.5 symbols/min [2025-10-16T22:36:48.707886] [DEBUG] [LOCAL ] DY: Loaded 28641 existing records from primary storage. [2025-10-16T22:36:48.708101] [INFO ] [MAIN ] DY: Loaded 28641 primary data records. [2025-10-16T22:36:49.031117] [DEBUG] [MAIN ] DXYZ: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:36:49.032066] [INFO ] [MAIN ] DXYZ: Generated 1806 derivative records from 37483 primary records. [2025-10-16T22:36:49.032175] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-16T22:36:49.050013] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1806 records). [2025-10-16T22:36:49.050192] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-16T22:36:49.052391] [INFO ] [MAIN ] Derivative Progress: 539/1803 symbols completed. DXYZ took 0.8s. Estimated remaining: 8m 8s. Rate: 155.3 symbols/min [2025-10-16T22:36:49.071806] [DEBUG] [MAIN ] DY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:49.072458] [INFO ] [MAIN ] DY: Generated 1807 derivative records from 28641 primary records. [2025-10-16T22:36:49.072519] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-16T22:36:49.087666] [DEBUG] [LOCAL ] DY: Derivative data saved (1807 records). [2025-10-16T22:36:49.087741] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-10-16T22:36:49.089815] [INFO ] [MAIN ] Derivative Progress: 540/1803 symbols completed. DY took 0.7s. Estimated remaining: 8m 7s. Rate: 155.5 symbols/min [2025-10-16T22:36:49.090318] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:49.090232] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:49.090860] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:49.099447] [DEBUG] [LOCAL ] EAI: Loaded 3998 existing records from primary storage. [2025-10-16T22:36:49.099582] [INFO ] [MAIN ] EAI: Loaded 3998 primary data records. [2025-10-16T22:36:49.320194] [DEBUG] [LOCAL ] E: Loaded 33514 existing records from primary storage. [2025-10-16T22:36:49.347308] [DEBUG] [LOCAL ] EAF: Loaded 41935 existing records from primary storage. [2025-10-16T22:36:49.347407] [INFO ] [MAIN ] E: Loaded 33514 primary data records. [2025-10-16T22:36:49.466201] [INFO ] [MAIN ] EAF: Loaded 41935 primary data records. [2025-10-16T22:36:50.134239] [DEBUG] [MAIN ] EAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:50.135371] [INFO ] [MAIN ] EAI: Generated 1807 derivative records from 3998 primary records. [2025-10-16T22:36:50.135469] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-10-16T22:36:50.152446] [DEBUG] [LOCAL ] EAI: Derivative data saved (1807 records). [2025-10-16T22:36:50.152804] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-10-16T22:36:50.154864] [INFO ] [MAIN ] Derivative Progress: 541/1803 symbols completed. EAI took 1.1s. Estimated remaining: 8m 8s. Rate: 155.0 symbols/min [2025-10-16T22:36:50.155284] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:50.172544] [DEBUG] [MAIN ] E: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:50.173369] [INFO ] [MAIN ] E: Generated 1807 derivative records from 33514 primary records. [2025-10-16T22:36:50.173666] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-10-16T22:36:50.209076] [DEBUG] [MAIN ] EAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:50.210575] [INFO ] [MAIN ] EAF: Generated 1807 derivative records from 41935 primary records. [2025-10-16T22:36:50.210762] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-10-16T22:36:50.222328] [DEBUG] [LOCAL ] EARN: Loaded 28794 existing records from primary storage. [2025-10-16T22:36:50.234961] [INFO ] [MAIN ] EARN: Loaded 28794 primary data records. [2025-10-16T22:36:50.248929] [DEBUG] [LOCAL ] E: Derivative data saved (1807 records). [2025-10-16T22:36:50.249038] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-10-16T22:36:50.251722] [INFO ] [MAIN ] Derivative Progress: 542/1803 symbols completed. E took 1.2s. Estimated remaining: 8m 7s. Rate: 155.2 symbols/min [2025-10-16T22:36:50.261299] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:50.334346] [DEBUG] [LOCAL ] EAF: Derivative data saved (1807 records). [2025-10-16T22:36:50.349729] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-10-16T22:36:50.355678] [INFO ] [MAIN ] Derivative Progress: 543/1803 symbols completed. EAF took 1.3s. Estimated remaining: 8m 6s. Rate: 155.4 symbols/min [2025-10-16T22:36:50.378240] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:50.590087] [DEBUG] [LOCAL ] EAT: Loaded 50215 existing records from primary storage. [2025-10-16T22:36:50.590798] [INFO ] [MAIN ] EAT: Loaded 50215 primary data records. [2025-10-16T22:36:50.696220] [DEBUG] [LOCAL ] EBR: Loaded 43627 existing records from primary storage. [2025-10-16T22:36:50.708101] [INFO ] [MAIN ] EBR: Loaded 43627 primary data records. [2025-10-16T22:36:51.121051] [DEBUG] [MAIN ] EARN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:51.236321] [INFO ] [MAIN ] EARN: Generated 1807 derivative records from 28794 primary records. [2025-10-16T22:36:51.237835] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-10-16T22:36:51.256198] [DEBUG] [LOCAL ] EARN: Derivative data saved (1807 records). [2025-10-16T22:36:51.257908] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-10-16T22:36:51.260361] [INFO ] [MAIN ] Derivative Progress: 544/1803 symbols completed. EARN took 1.1s. Estimated remaining: 8m 7s. Rate: 155.1 symbols/min [2025-10-16T22:36:51.261091] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:51.283118] [DEBUG] [MAIN ] EAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:51.283961] [INFO ] [MAIN ] EAT: Generated 1807 derivative records from 50215 primary records. [2025-10-16T22:36:51.284101] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-10-16T22:36:51.329126] [DEBUG] [LOCAL ] EAT: Derivative data saved (1807 records). [2025-10-16T22:36:51.328123] [DEBUG] [MAIN ] EBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:51.330075] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-10-16T22:36:51.330009] [INFO ] [MAIN ] EBR: Generated 1807 derivative records from 43627 primary records. [2025-10-16T22:36:51.330235] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-16T22:36:51.332549] [INFO ] [MAIN ] Derivative Progress: 545/1803 symbols completed. EAT took 1.1s. Estimated remaining: 8m 6s. Rate: 155.3 symbols/min [2025-10-16T22:36:51.333070] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:51.364072] [DEBUG] [LOCAL ] EBS: Loaded 47095 existing records from primary storage. [2025-10-16T22:36:51.365440] [INFO ] [MAIN ] EBS: Loaded 47095 primary data records. [2025-10-16T22:36:51.388950] [DEBUG] [LOCAL ] EBR: Derivative data saved (1807 records). [2025-10-16T22:36:51.400104] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-16T22:36:51.414871] [INFO ] [MAIN ] Derivative Progress: 546/1803 symbols completed. EBR took 1.0s. Estimated remaining: 8m 5s. Rate: 155.5 symbols/min [2025-10-16T22:36:51.441381] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:51.761495] [DEBUG] [LOCAL ] EC: Loaded 49335 existing records from primary storage. [2025-10-16T22:36:51.762350] [INFO ] [MAIN ] EC: Loaded 49335 primary data records. [2025-10-16T22:36:51.823503] [DEBUG] [LOCAL ] ECC: Loaded 43644 existing records from primary storage. [2025-10-16T22:36:51.865458] [INFO ] [MAIN ] ECC: Loaded 43644 primary data records. [2025-10-16T22:36:52.416786] [DEBUG] [MAIN ] EBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:52.418329] [INFO ] [MAIN ] EBS: Generated 1807 derivative records from 47095 primary records. [2025-10-16T22:36:52.418614] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-10-16T22:36:52.435870] [DEBUG] [LOCAL ] EBS: Derivative data saved (1807 records). [2025-10-16T22:36:52.436509] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-10-16T22:36:52.439261] [INFO ] [MAIN ] Derivative Progress: 547/1803 symbols completed. EBS took 1.2s. Estimated remaining: 8m 6s. Rate: 155.0 symbols/min [2025-10-16T22:36:52.439622] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:52.459071] [DEBUG] [MAIN ] EC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:52.459952] [INFO ] [MAIN ] EC: Generated 1807 derivative records from 49335 primary records. [2025-10-16T22:36:52.460149] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-10-16T22:36:52.499986] [DEBUG] [MAIN ] ECC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:52.501803] [INFO ] [MAIN ] ECC: Generated 1807 derivative records from 43644 primary records. [2025-10-16T22:36:52.502257] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-16T22:36:52.502363] [DEBUG] [LOCAL ] EC: Derivative data saved (1807 records). [2025-10-16T22:36:52.503139] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-10-16T22:36:52.505585] [INFO ] [MAIN ] Derivative Progress: 548/1803 symbols completed. EC took 1.2s. Estimated remaining: 8m 5s. Rate: 155.3 symbols/min [2025-10-16T22:36:52.506076] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:52.529780] [DEBUG] [LOCAL ] ECG: Loaded 33440 existing records from primary storage. [2025-10-16T22:36:52.531501] [INFO ] [MAIN ] ECG: Loaded 33440 primary data records. [2025-10-16T22:36:52.572775] [DEBUG] [LOCAL ] ECC: Derivative data saved (1807 records). [2025-10-16T22:36:52.604737] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-10-16T22:36:52.614071] [INFO ] [MAIN ] Derivative Progress: 549/1803 symbols completed. ECC took 1.2s. Estimated remaining: 8m 4s. Rate: 155.5 symbols/min [2025-10-16T22:36:52.614252] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:52.868415] [DEBUG] [LOCAL ] ECL: Loaded 47037 existing records from primary storage. [2025-10-16T22:36:52.868618] [INFO ] [MAIN ] ECL: Loaded 47037 primary data records. [2025-10-16T22:36:52.867460] [DEBUG] [LOCAL ] ECO: Loaded 18306 existing records from primary storage. [2025-10-16T22:36:52.889808] [INFO ] [MAIN ] ECO: Loaded 18306 primary data records. [2025-10-16T22:36:53.491032] [DEBUG] [MAIN ] ECG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:53.491969] [INFO ] [MAIN ] ECG: Generated 1807 derivative records from 33440 primary records. [2025-10-16T22:36:53.492435] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-16T22:36:53.516626] [DEBUG] [LOCAL ] ECG: Derivative data saved (1807 records). [2025-10-16T22:36:53.516916] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-10-16T22:36:53.520084] [INFO ] [MAIN ] Derivative Progress: 550/1803 symbols completed. ECG took 1.1s. Estimated remaining: 8m 5s. Rate: 155.1 symbols/min [2025-10-16T22:36:53.520443] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:53.542995] [DEBUG] [MAIN ] ECL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:53.552546] [INFO ] [MAIN ] ECL: Generated 1807 derivative records from 47037 primary records. [2025-10-16T22:36:53.558114] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-16T22:36:53.558484] [DEBUG] [MAIN ] ECO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:53.567845] [INFO ] [MAIN ] ECO: Generated 1807 derivative records from 18306 primary records. [2025-10-16T22:36:53.572491] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-16T22:36:53.587726] [DEBUG] [LOCAL ] ECL: Derivative data saved (1807 records). [2025-10-16T22:36:53.588215] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-16T22:36:53.591337] [INFO ] [MAIN ] Derivative Progress: 551/1803 symbols completed. ECL took 1.1s. Estimated remaining: 8m 4s. Rate: 155.3 symbols/min [2025-10-16T22:36:53.591499] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:53.608013] [DEBUG] [LOCAL ] ECO: Derivative data saved (1807 records). [2025-10-16T22:36:53.608492] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-16T22:36:53.611078] [INFO ] [MAIN ] Derivative Progress: 552/1803 symbols completed. ECO took 1.0s. Estimated remaining: 8m 2s. Rate: 155.6 symbols/min [2025-10-16T22:36:53.611371] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:53.630457] [DEBUG] [LOCAL ] ECVT: Loaded 43630 existing records from primary storage. [2025-10-16T22:36:53.630902] [INFO ] [MAIN ] ECVT: Loaded 43630 primary data records. [2025-10-16T22:36:53.755490] [DEBUG] [LOCAL ] EDD: Loaded 27000 existing records from primary storage. [2025-10-16T22:36:53.769732] [INFO ] [MAIN ] EDD: Loaded 27000 primary data records. [2025-10-16T22:36:53.892589] [DEBUG] [LOCAL ] ED: Loaded 53052 existing records from primary storage. [2025-10-16T22:36:53.936748] [INFO ] [MAIN ] ED: Loaded 53052 primary data records. [2025-10-16T22:36:54.690825] [DEBUG] [MAIN ] EDD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:54.704176] [INFO ] [MAIN ] EDD: Generated 1807 derivative records from 27000 primary records. [2025-10-16T22:36:54.704949] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-16T22:36:54.704869] [DEBUG] [MAIN ] ECVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:54.706703] [INFO ] [MAIN ] ECVT: Generated 1807 derivative records from 43630 primary records. [2025-10-16T22:36:54.707180] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-10-16T22:36:54.735494] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1807 records). [2025-10-16T22:36:54.736779] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-10-16T22:36:54.739788] [INFO ] [MAIN ] Derivative Progress: 553/1803 symbols completed. ECVT took 1.2s. Estimated remaining: 8m 4s. Rate: 155.1 symbols/min [2025-10-16T22:36:54.754952] [DEBUG] [MAIN ] ED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:54.756290] [INFO ] [MAIN ] ED: Generated 1807 derivative records from 53052 primary records. [2025-10-16T22:36:54.756620] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-16T22:36:54.757624] [DEBUG] [LOCAL ] EDD: Derivative data saved (1807 records). [2025-10-16T22:36:54.757932] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-10-16T22:36:54.760209] [INFO ] [MAIN ] Derivative Progress: 554/1803 symbols completed. EDD took 1.1s. Estimated remaining: 8m 2s. Rate: 155.3 symbols/min [2025-10-16T22:36:54.774995] [DEBUG] [LOCAL ] ED: Derivative data saved (1807 records). [2025-10-16T22:36:54.775057] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-16T22:36:54.777958] [INFO ] [MAIN ] Derivative Progress: 555/1803 symbols completed. ED took 1.2s. Estimated remaining: 8m 1s. Rate: 155.6 symbols/min [2025-10-16T22:36:54.778504] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:54.778425] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:54.778664] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:54.801201] [DEBUG] [LOCAL ] EDF: Loaded 13171 existing records from primary storage. [2025-10-16T22:36:54.807467] [INFO ] [MAIN ] EDF: Loaded 13171 primary data records. [2025-10-16T22:36:54.807873] [DEBUG] [LOCAL ] EDN: Loaded 19176 existing records from primary storage. [2025-10-16T22:36:54.829568] [INFO ] [MAIN ] EDN: Loaded 19176 primary data records. [2025-10-16T22:36:55.217543] [DEBUG] [LOCAL ] EDU: Loaded 45172 existing records from primary storage. [2025-10-16T22:36:55.230803] [INFO ] [MAIN ] EDU: Loaded 45172 primary data records. [2025-10-16T22:36:55.854372] [DEBUG] [MAIN ] EDF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:55.855600] [INFO ] [MAIN ] EDF: Generated 1807 derivative records from 13171 primary records. [2025-10-16T22:36:55.855907] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-10-16T22:36:55.889895] [DEBUG] [MAIN ] EDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:55.893027] [DEBUG] [LOCAL ] EDF: Derivative data saved (1807 records). [2025-10-16T22:36:55.891961] [INFO ] [MAIN ] EDN: Generated 1807 derivative records from 19176 primary records. [2025-10-16T22:36:55.893210] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-10-16T22:36:55.893306] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-16T22:36:55.896121] [INFO ] [MAIN ] Derivative Progress: 556/1803 symbols completed. EDF took 1.1s. Estimated remaining: 8m 3s. Rate: 155.1 symbols/min [2025-10-16T22:36:55.896795] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:55.922146] [DEBUG] [MAIN ] EDU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:55.923989] [INFO ] [MAIN ] EDU: Generated 1807 derivative records from 45172 primary records. [2025-10-16T22:36:55.924349] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-16T22:36:55.947120] [DEBUG] [LOCAL ] EEX: Loaded 10294 existing records from primary storage. [2025-10-16T22:36:55.947740] [INFO ] [MAIN ] EEX: Loaded 10294 primary data records. [2025-10-16T22:36:55.950444] [DEBUG] [LOCAL ] EDN: Derivative data saved (1807 records). [2025-10-16T22:36:55.981475] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-16T22:36:55.996842] [INFO ] [MAIN ] Derivative Progress: 557/1803 symbols completed. EDN took 1.2s. Estimated remaining: 8m 1s. Rate: 155.3 symbols/min [2025-10-16T22:36:56.030114] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:56.041634] [DEBUG] [LOCAL ] EDU: Derivative data saved (1807 records). [2025-10-16T22:36:56.051727] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-16T22:36:56.067268] [INFO ] [MAIN ] Derivative Progress: 558/1803 symbols completed. EDU took 1.3s. Estimated remaining: 8m 0s. Rate: 155.5 symbols/min [2025-10-16T22:36:56.073020] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:56.283448] [DEBUG] [LOCAL ] EFR: Loaded 15165 existing records from primary storage. [2025-10-16T22:36:56.294967] [INFO ] [MAIN ] EFR: Loaded 15165 primary data records. [2025-10-16T22:36:56.435348] [DEBUG] [LOCAL ] EFC: Loaded 46757 existing records from primary storage. [2025-10-16T22:36:56.457331] [INFO ] [MAIN ] EFC: Loaded 46757 primary data records. [2025-10-16T22:36:56.793300] [DEBUG] [MAIN ] EEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:56.857205] [INFO ] [MAIN ] EEX: Generated 1807 derivative records from 10294 primary records. [2025-10-16T22:36:56.965986] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-10-16T22:36:56.999638] [DEBUG] [LOCAL ] EEX: Derivative data saved (1807 records). [2025-10-16T22:36:57.012186] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-10-16T22:36:57.014432] [INFO ] [MAIN ] Derivative Progress: 559/1803 symbols completed. EEX took 1.1s. Estimated remaining: 8m 1s. Rate: 155.1 symbols/min [2025-10-16T22:36:57.014585] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:57.015800] [DEBUG] [MAIN ] EFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:57.016623] [INFO ] [MAIN ] EFR: Generated 1807 derivative records from 15165 primary records. [2025-10-16T22:36:57.017255] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-16T22:36:57.047234] [DEBUG] [LOCAL ] EFR: Derivative data saved (1807 records). [2025-10-16T22:36:57.047516] [DEBUG] [LOCAL ] EFT: Loaded 13160 existing records from primary storage. [2025-10-16T22:36:57.047795] [INFO ] [MAIN ] EFT: Loaded 13160 primary data records. [2025-10-16T22:36:57.047996] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-16T22:36:57.051407] [INFO ] [MAIN ] Derivative Progress: 560/1803 symbols completed. EFR took 1.0s. Estimated remaining: 8m 0s. Rate: 155.3 symbols/min [2025-10-16T22:36:57.071883] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:57.170038] [DEBUG] [MAIN ] EFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:57.209513] [INFO ] [MAIN ] EFC: Generated 1807 derivative records from 46757 primary records. [2025-10-16T22:36:57.242031] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-10-16T22:36:57.392739] [DEBUG] [LOCAL ] EFC: Derivative data saved (1807 records). [2025-10-16T22:36:57.392982] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-10-16T22:36:57.396145] [INFO ] [MAIN ] Derivative Progress: 561/1803 symbols completed. EFC took 1.4s. Estimated remaining: 7m 60s. Rate: 155.4 symbols/min [2025-10-16T22:36:57.397760] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:57.416728] [DEBUG] [LOCAL ] EFX: Loaded 45004 existing records from primary storage. [2025-10-16T22:36:57.417019] [INFO ] [MAIN ] EFX: Loaded 45004 primary data records. [2025-10-16T22:36:57.566670] [DEBUG] [MAIN ] EFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:57.567435] [INFO ] [MAIN ] EFT: Generated 1807 derivative records from 13160 primary records. [2025-10-16T22:36:57.567604] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-10-16T22:36:57.667857] [DEBUG] [LOCAL ] EFXT: Loaded 29940 existing records from primary storage. [2025-10-16T22:36:57.667026] [DEBUG] [LOCAL ] EFT: Derivative data saved (1807 records). [2025-10-16T22:36:57.810993] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-10-16T22:36:57.693678] [INFO ] [MAIN ] EFXT: Loaded 29940 primary data records. [2025-10-16T22:36:57.821265] [INFO ] [MAIN ] Derivative Progress: 562/1803 symbols completed. EFT took 0.8s. Estimated remaining: 7m 59s. Rate: 155.3 symbols/min [2025-10-16T22:36:57.853157] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:58.138184] [DEBUG] [LOCAL ] EG: Loaded 27993 existing records from primary storage. [2025-10-16T22:36:58.142275] [INFO ] [MAIN ] EG: Loaded 27993 primary data records. [2025-10-16T22:36:58.209942] [DEBUG] [MAIN ] EFX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:58.242131] [INFO ] [MAIN ] EFX: Generated 1807 derivative records from 45004 primary records. [2025-10-16T22:36:58.255538] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-10-16T22:36:58.350225] [DEBUG] [LOCAL ] EFX: Derivative data saved (1807 records). [2025-10-16T22:36:58.449864] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-10-16T22:36:58.467074] [INFO ] [MAIN ] Derivative Progress: 563/1803 symbols completed. EFX took 1.4s. Estimated remaining: 7m 59s. Rate: 155.2 symbols/min [2025-10-16T22:36:58.468505] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:58.486229] [DEBUG] [MAIN ] EFXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:58.487373] [INFO ] [MAIN ] EFXT: Generated 1807 derivative records from 29940 primary records. [2025-10-16T22:36:58.487576] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-16T22:36:58.506721] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1807 records). [2025-10-16T22:36:58.507113] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-10-16T22:36:58.509405] [INFO ] [MAIN ] Derivative Progress: 564/1803 symbols completed. EFXT took 1.1s. Estimated remaining: 7m 58s. Rate: 155.4 symbols/min [2025-10-16T22:36:58.509778] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:58.529367] [DEBUG] [MAIN ] EG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:58.543735] [INFO ] [MAIN ] EG: Generated 1807 derivative records from 27993 primary records. [2025-10-16T22:36:58.543974] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-16T22:36:58.586223] [DEBUG] [LOCAL ] EG: Derivative data saved (1807 records). [2025-10-16T22:36:58.586128] [DEBUG] [LOCAL ] EGO: Loaded 52116 existing records from primary storage. [2025-10-16T22:36:58.595083] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-10-16T22:36:58.595229] [INFO ] [MAIN ] EGO: Loaded 52116 primary data records. [2025-10-16T22:36:58.597816] [INFO ] [MAIN ] Derivative Progress: 565/1803 symbols completed. EG took 0.7s. Estimated remaining: 7m 57s. Rate: 155.6 symbols/min [2025-10-16T22:36:58.598136] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:58.598762] [DEBUG] [LOCAL ] EGP: Loaded 30655 existing records from primary storage. [2025-10-16T22:36:58.630182] [INFO ] [MAIN ] EGP: Loaded 30655 primary data records. [2025-10-16T22:36:59.209251] [DEBUG] [LOCAL ] EGY: Loaded 41864 existing records from primary storage. [2025-10-16T22:36:59.210038] [INFO ] [MAIN ] EGY: Loaded 41864 primary data records. [2025-10-16T22:36:59.550724] [DEBUG] [MAIN ] EGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:59.552468] [INFO ] [MAIN ] EGO: Generated 1807 derivative records from 52116 primary records. [2025-10-16T22:36:59.552759] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-16T22:36:59.551362] [DEBUG] [MAIN ] EGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:59.554197] [INFO ] [MAIN ] EGP: Generated 1807 derivative records from 30655 primary records. [2025-10-16T22:36:59.554327] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-16T22:36:59.587359] [DEBUG] [LOCAL ] EGP: Derivative data saved (1807 records). [2025-10-16T22:36:59.587485] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-10-16T22:36:59.589994] [INFO ] [MAIN ] Derivative Progress: 566/1803 symbols completed. EGP took 1.1s. Estimated remaining: 7m 58s. Rate: 155.2 symbols/min [2025-10-16T22:36:59.591891] [DEBUG] [LOCAL ] EGO: Derivative data saved (1807 records). [2025-10-16T22:36:59.590717] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:59.592080] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-10-16T22:36:59.594477] [INFO ] [MAIN ] Derivative Progress: 567/1803 symbols completed. EGO took 1.1s. Estimated remaining: 7m 57s. Rate: 155.5 symbols/min [2025-10-16T22:36:59.595417] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:36:59.613590] [DEBUG] [MAIN ] EGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:36:59.614331] [INFO ] [MAIN ] EGY: Generated 1807 derivative records from 41864 primary records. [2025-10-16T22:36:59.614575] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-10-16T22:36:59.630899] [DEBUG] [LOCAL ] EGY: Derivative data saved (1807 records). [2025-10-16T22:36:59.631081] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-10-16T22:36:59.633606] [INFO ] [MAIN ] Derivative Progress: 568/1803 symbols completed. EGY took 1.0s. Estimated remaining: 7m 56s. Rate: 155.7 symbols/min [2025-10-16T22:36:59.662060] [DEBUG] [LOCAL ] EHAB: Loaded 29476 existing records from primary storage. [2025-10-16T22:36:59.662181] [INFO ] [MAIN ] EHAB: Loaded 29476 primary data records. [2025-10-16T22:36:59.784203] [DEBUG] [LOCAL ] EHC: Loaded 41314 existing records from primary storage. [2025-10-16T22:36:59.799987] [INFO ] [MAIN ] EHC: Loaded 41314 primary data records. [2025-10-16T22:37:00.323328] [DEBUG] [MAIN ] EHAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:00.324171] [INFO ] [MAIN ] EHAB: Generated 1807 derivative records from 29476 primary records. [2025-10-16T22:37:00.324451] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-10-16T22:37:00.341499] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1807 records). [2025-10-16T22:37:00.342295] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-10-16T22:37:00.345091] [INFO ] [MAIN ] Derivative Progress: 569/1803 symbols completed. EHAB took 0.8s. Estimated remaining: 7m 56s. Rate: 155.5 symbols/min [2025-10-16T22:37:00.357815] [DEBUG] [MAIN ] EHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:00.358446] [INFO ] [MAIN ] EHC: Generated 1807 derivative records from 41314 primary records. [2025-10-16T22:37:00.358510] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-16T22:37:00.374229] [DEBUG] [LOCAL ] EHC: Derivative data saved (1807 records). [2025-10-16T22:37:00.374286] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-10-16T22:37:00.376800] [INFO ] [MAIN ] Derivative Progress: 570/1803 symbols completed. EHC took 0.8s. Estimated remaining: 7m 55s. Rate: 155.7 symbols/min [2025-10-16T22:37:00.377304] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:00.377228] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:00.377451] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:00.391180] [DEBUG] [LOCAL ] EHI: Loaded 10710 existing records from primary storage. [2025-10-16T22:37:00.391451] [INFO ] [MAIN ] EHI: Loaded 10710 primary data records. [2025-10-16T22:37:00.500195] [DEBUG] [LOCAL ] EIC: Loaded 23019 existing records from primary storage. [2025-10-16T22:37:00.516913] [INFO ] [MAIN ] EIC: Loaded 23019 primary data records. [2025-10-16T22:37:00.564727] [DEBUG] [LOCAL ] EIG: Loaded 20357 existing records from primary storage. [2025-10-16T22:37:00.580205] [INFO ] [MAIN ] EIG: Loaded 20357 primary data records. [2025-10-16T22:37:01.330601] [DEBUG] [MAIN ] EHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:01.331667] [INFO ] [MAIN ] EHI: Generated 1807 derivative records from 10710 primary records. [2025-10-16T22:37:01.331789] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-16T22:37:01.348782] [DEBUG] [LOCAL ] EHI: Derivative data saved (1807 records). [2025-10-16T22:37:01.348925] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-10-16T22:37:01.351028] [INFO ] [MAIN ] Derivative Progress: 571/1803 symbols completed. EHI took 1.0s. Estimated remaining: 7m 56s. Rate: 155.3 symbols/min [2025-10-16T22:37:01.351349] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:01.368839] [DEBUG] [MAIN ] EIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:01.369570] [INFO ] [MAIN ] EIC: Generated 1807 derivative records from 23019 primary records. [2025-10-16T22:37:01.369786] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-10-16T22:37:01.402266] [DEBUG] [MAIN ] EIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:01.404671] [INFO ] [MAIN ] EIG: Generated 1807 derivative records from 20357 primary records. [2025-10-16T22:37:01.406024] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-16T22:37:01.406123] [DEBUG] [LOCAL ] EIC: Derivative data saved (1807 records). [2025-10-16T22:37:01.406751] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-10-16T22:37:01.409426] [INFO ] [MAIN ] Derivative Progress: 572/1803 symbols completed. EIC took 1.0s. Estimated remaining: 7m 55s. Rate: 155.5 symbols/min [2025-10-16T22:37:01.409847] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:01.425607] [DEBUG] [LOCAL ] EIG: Derivative data saved (1807 records). [2025-10-16T22:37:01.425915] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-16T22:37:01.441216] [INFO ] [MAIN ] Derivative Progress: 573/1803 symbols completed. EIG took 1.1s. Estimated remaining: 7m 54s. Rate: 155.8 symbols/min [2025-10-16T22:37:01.442716] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:01.464844] [DEBUG] [LOCAL ] EIX: Loaded 53763 existing records from primary storage. [2025-10-16T22:37:01.465985] [INFO ] [MAIN ] EIX: Loaded 53763 primary data records. [2025-10-16T22:37:01.859612] [DEBUG] [LOCAL ] EL: Loaded 53766 existing records from primary storage. [2025-10-16T22:37:01.858539] [DEBUG] [LOCAL ] ELAN: Loaded 53690 existing records from primary storage. [2025-10-16T22:37:01.860769] [INFO ] [MAIN ] ELAN: Loaded 53690 primary data records. [2025-10-16T22:37:01.860891] [INFO ] [MAIN ] EL: Loaded 53766 primary data records. [2025-10-16T22:37:02.470987] [DEBUG] [MAIN ] EIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:02.471987] [INFO ] [MAIN ] EIX: Generated 1807 derivative records from 53763 primary records. [2025-10-16T22:37:02.472086] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-10-16T22:37:02.489758] [DEBUG] [LOCAL ] EIX: Derivative data saved (1807 records). [2025-10-16T22:37:02.490188] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-10-16T22:37:02.493346] [INFO ] [MAIN ] Derivative Progress: 574/1803 symbols completed. EIX took 1.1s. Estimated remaining: 7m 55s. Rate: 155.3 symbols/min [2025-10-16T22:37:02.493623] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:02.503983] [DEBUG] [LOCAL ] ELC: Loaded 3525 existing records from primary storage. [2025-10-16T22:37:02.504980] [INFO ] [MAIN ] ELC: Loaded 3525 primary data records. [2025-10-16T22:37:02.572712] [DEBUG] [MAIN ] ELAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:02.584874] [DEBUG] [MAIN ] EL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:02.599375] [INFO ] [MAIN ] ELAN: Generated 1807 derivative records from 53690 primary records. [2025-10-16T22:37:02.612349] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-16T22:37:02.607134] [INFO ] [MAIN ] EL: Generated 1807 derivative records from 53766 primary records. [2025-10-16T22:37:02.618251] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-16T22:37:02.678862] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1807 records). [2025-10-16T22:37:02.683070] [DEBUG] [LOCAL ] EL: Derivative data saved (1807 records). [2025-10-16T22:37:02.683384] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-16T22:37:02.696311] [INFO ] [MAIN ] Derivative Progress: 575/1803 symbols completed. ELAN took 1.3s. Estimated remaining: 7m 54s. Rate: 155.5 symbols/min [2025-10-16T22:37:02.688618] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-10-16T22:37:02.747130] [INFO ] [MAIN ] Derivative Progress: 576/1803 symbols completed. EL took 1.3s. Estimated remaining: 7m 53s. Rate: 155.7 symbols/min [2025-10-16T22:37:02.721009] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:02.750680] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:02.894617] [DEBUG] [LOCAL ] ELP: Loaded 25881 existing records from primary storage. [2025-10-16T22:37:02.894907] [INFO ] [MAIN ] ELP: Loaded 25881 primary data records. [2025-10-16T22:37:02.943560] [DEBUG] [MAIN ] ELC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:02.944479] [INFO ] [MAIN ] ELC: Generated 1807 derivative records from 3525 primary records. [2025-10-16T22:37:02.951717] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-10-16T22:37:03.239200] [DEBUG] [LOCAL ] ELF: Loaded 52376 existing records from primary storage. [2025-10-16T22:37:03.253153] [INFO ] [MAIN ] ELF: Loaded 52376 primary data records. [2025-10-16T22:37:03.311812] [DEBUG] [LOCAL ] ELC: Derivative data saved (1807 records). [2025-10-16T22:37:03.334714] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-10-16T22:37:03.353519] [INFO ] [MAIN ] Derivative Progress: 577/1803 symbols completed. ELC took 0.9s. Estimated remaining: 7m 53s. Rate: 155.5 symbols/min [2025-10-16T22:37:03.361691] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:03.621883] [DEBUG] [MAIN ] ELP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:03.623090] [INFO ] [MAIN ] ELP: Generated 1807 derivative records from 25881 primary records. [2025-10-16T22:37:03.623516] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-10-16T22:37:03.652114] [DEBUG] [LOCAL ] ELP: Derivative data saved (1807 records). [2025-10-16T22:37:03.652254] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-10-16T22:37:03.654683] [INFO ] [MAIN ] Derivative Progress: 578/1803 symbols completed. ELP took 0.9s. Estimated remaining: 7m 52s. Rate: 155.6 symbols/min [2025-10-16T22:37:03.655042] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:03.671679] [DEBUG] [LOCAL ] ELS: Loaded 50226 existing records from primary storage. [2025-10-16T22:37:03.672044] [INFO ] [MAIN ] ELS: Loaded 50226 primary data records. [2025-10-16T22:37:03.837790] [DEBUG] [MAIN ] ELF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:03.974807] [INFO ] [MAIN ] ELF: Generated 1807 derivative records from 52376 primary records. [2025-10-16T22:37:03.990363] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-10-16T22:37:04.041384] [DEBUG] [LOCAL ] ELV: Loaded 51042 existing records from primary storage. [2025-10-16T22:37:04.042183] [INFO ] [MAIN ] ELV: Loaded 51042 primary data records. [2025-10-16T22:37:04.042918] [DEBUG] [LOCAL ] ELF: Derivative data saved (1807 records). [2025-10-16T22:37:04.078705] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-10-16T22:37:04.087926] [INFO ] [MAIN ] Derivative Progress: 579/1803 symbols completed. ELF took 1.4s. Estimated remaining: 7m 52s. Rate: 155.6 symbols/min [2025-10-16T22:37:04.099899] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:04.358446] [DEBUG] [LOCAL ] EMD: Loaded 21065 existing records from primary storage. [2025-10-16T22:37:04.359047] [INFO ] [MAIN ] EMD: Loaded 21065 primary data records. [2025-10-16T22:37:04.408757] [DEBUG] [MAIN ] ELS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:04.418007] [INFO ] [MAIN ] ELS: Generated 1807 derivative records from 50226 primary records. [2025-10-16T22:37:04.430400] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-10-16T22:37:04.549776] [DEBUG] [LOCAL ] ELS: Derivative data saved (1807 records). [2025-10-16T22:37:04.678268] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-10-16T22:37:04.689704] [INFO ] [MAIN ] Derivative Progress: 580/1803 symbols completed. ELS took 1.3s. Estimated remaining: 7m 52s. Rate: 155.4 symbols/min [2025-10-16T22:37:04.690176] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:04.708786] [DEBUG] [MAIN ] ELV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:04.710068] [INFO ] [MAIN ] ELV: Generated 1807 derivative records from 51042 primary records. [2025-10-16T22:37:04.710269] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-10-16T22:37:04.727505] [DEBUG] [LOCAL ] ELV: Derivative data saved (1807 records). [2025-10-16T22:37:04.727815] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-10-16T22:37:04.729919] [INFO ] [MAIN ] Derivative Progress: 581/1803 symbols completed. ELV took 1.1s. Estimated remaining: 7m 51s. Rate: 155.6 symbols/min [2025-10-16T22:37:04.730543] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:04.745874] [DEBUG] [LOCAL ] EMF: Loaded 3235 existing records from primary storage. [2025-10-16T22:37:04.746349] [INFO ] [MAIN ] EMF: Loaded 3235 primary data records. [2025-10-16T22:37:04.864307] [DEBUG] [LOCAL ] EME: Loaded 31206 existing records from primary storage. [2025-10-16T22:37:04.865939] [INFO ] [MAIN ] EME: Loaded 31206 primary data records. [2025-10-16T22:37:04.993710] [DEBUG] [MAIN ] EMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:05.043686] [INFO ] [MAIN ] EMD: Generated 1807 derivative records from 21065 primary records. [2025-10-16T22:37:05.179184] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-10-16T22:37:05.395179] [DEBUG] [LOCAL ] EMD: Derivative data saved (1807 records). [2025-10-16T22:37:05.395800] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-10-16T22:37:05.398592] [INFO ] [MAIN ] Derivative Progress: 582/1803 symbols completed. EMD took 1.3s. Estimated remaining: 7m 51s. Rate: 155.4 symbols/min [2025-10-16T22:37:05.398911] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:05.423808] [DEBUG] [MAIN ] EMF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:05.424462] [INFO ] [MAIN ] EMF: Generated 1807 derivative records from 3235 primary records. [2025-10-16T22:37:05.424843] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-16T22:37:05.442193] [DEBUG] [LOCAL ] EMF: Derivative data saved (1807 records). [2025-10-16T22:37:05.443399] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-16T22:37:05.445411] [INFO ] [MAIN ] Derivative Progress: 583/1803 symbols completed. EMF took 0.7s. Estimated remaining: 7m 50s. Rate: 155.7 symbols/min [2025-10-16T22:37:05.473749] [DEBUG] [MAIN ] EME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:05.474521] [INFO ] [MAIN ] EME: Generated 1807 derivative records from 31206 primary records. [2025-10-16T22:37:05.474595] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-10-16T22:37:05.495481] [DEBUG] [LOCAL ] EME: Derivative data saved (1807 records). [2025-10-16T22:37:05.496285] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-10-16T22:37:05.511883] [INFO ] [MAIN ] Derivative Progress: 584/1803 symbols completed. EME took 0.8s. Estimated remaining: 7m 49s. Rate: 155.9 symbols/min [2025-10-16T22:37:05.513183] [DEBUG] [LOCAL ] EMN: Loaded 51134 existing records from primary storage. [2025-10-16T22:37:05.513261] [INFO ] [MAIN ] EMN: Loaded 51134 primary data records. [2025-10-16T22:37:05.838068] [DEBUG] [MAIN ] EMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:05.838712] [INFO ] [MAIN ] EMN: Generated 1807 derivative records from 51134 primary records. [2025-10-16T22:37:05.838775] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-16T22:37:05.853742] [DEBUG] [LOCAL ] EMN: Derivative data saved (1807 records). [2025-10-16T22:37:05.853798] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-10-16T22:37:05.856264] [INFO ] [MAIN ] Derivative Progress: 585/1803 symbols completed. EMN took 0.5s. Estimated remaining: 7m 49s. Rate: 155.9 symbols/min [2025-10-16T22:37:05.856907] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:05.857114] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:05.857020] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:05.864618] [DEBUG] [LOCAL ] EMP: Loaded 3045 existing records from primary storage. [2025-10-16T22:37:05.864844] [INFO ] [MAIN ] EMP: Loaded 3045 primary data records. [2025-10-16T22:37:05.950386] [DEBUG] [LOCAL ] EMO: Loaded 13368 existing records from primary storage. [2025-10-16T22:37:05.977871] [INFO ] [MAIN ] EMO: Loaded 13368 primary data records. [2025-10-16T22:37:06.503632] [DEBUG] [LOCAL ] EMR: Loaded 53592 existing records from primary storage. [2025-10-16T22:37:06.503936] [INFO ] [MAIN ] EMR: Loaded 53592 primary data records. [2025-10-16T22:37:06.822961] [DEBUG] [MAIN ] EMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:06.823688] [INFO ] [MAIN ] EMP: Generated 1807 derivative records from 3045 primary records. [2025-10-16T22:37:06.823953] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-10-16T22:37:06.850308] [DEBUG] [LOCAL ] EMP: Derivative data saved (1807 records). [2025-10-16T22:37:06.855409] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-10-16T22:37:06.855858] [DEBUG] [MAIN ] EMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:06.856570] [INFO ] [MAIN ] EMO: Generated 1807 derivative records from 13368 primary records. [2025-10-16T22:37:06.862763] [INFO ] [MAIN ] Derivative Progress: 586/1803 symbols completed. EMP took 1.0s. Estimated remaining: 7m 50s. Rate: 155.5 symbols/min [2025-10-16T22:37:06.862944] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-10-16T22:37:06.863081] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:06.881918] [DEBUG] [LOCAL ] EMO: Derivative data saved (1807 records). [2025-10-16T22:37:06.882133] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-10-16T22:37:06.884462] [INFO ] [MAIN ] Derivative Progress: 587/1803 symbols completed. EMO took 1.0s. Estimated remaining: 7m 48s. Rate: 155.8 symbols/min [2025-10-16T22:37:06.884624] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:06.904613] [DEBUG] [MAIN ] EMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:06.905336] [INFO ] [MAIN ] EMR: Generated 1807 derivative records from 53592 primary records. [2025-10-16T22:37:06.905539] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-10-16T22:37:06.922394] [DEBUG] [LOCAL ] EMR: Derivative data saved (1807 records). [2025-10-16T22:37:06.935333] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-10-16T22:37:06.938144] [INFO ] [MAIN ] Derivative Progress: 588/1803 symbols completed. EMR took 1.1s. Estimated remaining: 7m 47s. Rate: 156.0 symbols/min [2025-10-16T22:37:06.945718] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:06.950162] [DEBUG] [LOCAL ] ENO: Loaded 1865 existing records from primary storage. [2025-10-16T22:37:06.950370] [INFO ] [MAIN ] ENO: Loaded 1865 primary data records. [2025-10-16T22:37:07.084520] [DEBUG] [LOCAL ] ENIC: Loaded 36937 existing records from primary storage. [2025-10-16T22:37:07.085910] [DEBUG] [LOCAL ] ENB: Loaded 53902 existing records from primary storage. [2025-10-16T22:37:07.086264] [INFO ] [MAIN ] ENIC: Loaded 36937 primary data records. [2025-10-16T22:37:07.086354] [INFO ] [MAIN ] ENB: Loaded 53902 primary data records. [2025-10-16T22:37:07.938480] [DEBUG] [MAIN ] ENO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:07.939762] [INFO ] [MAIN ] ENO: Generated 1807 derivative records from 1865 primary records. [2025-10-16T22:37:07.939983] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-10-16T22:37:07.957629] [DEBUG] [LOCAL ] ENO: Derivative data saved (1807 records). [2025-10-16T22:37:07.959410] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-10-16T22:37:07.961559] [INFO ] [MAIN ] Derivative Progress: 589/1803 symbols completed. ENO took 1.0s. Estimated remaining: 7m 48s. Rate: 155.5 symbols/min [2025-10-16T22:37:07.961952] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:07.987964] [DEBUG] [MAIN ] ENIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:07.987675] [DEBUG] [MAIN ] ENB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:07.988911] [INFO ] [MAIN ] ENB: Generated 1807 derivative records from 53902 primary records. [2025-10-16T22:37:07.989508] [INFO ] [MAIN ] ENIC: Generated 1807 derivative records from 36937 primary records. [2025-10-16T22:37:07.989737] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-10-16T22:37:07.989572] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-16T22:37:08.026539] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1807 records). [2025-10-16T22:37:08.026280] [DEBUG] [LOCAL ] ENB: Derivative data saved (1807 records). [2025-10-16T22:37:08.026818] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-10-16T22:37:08.030094] [INFO ] [MAIN ] Derivative Progress: 590/1803 symbols completed. ENIC took 1.1s. Estimated remaining: 7m 47s. Rate: 155.8 symbols/min [2025-10-16T22:37:08.030440] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-10-16T22:37:08.030368] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:08.033841] [INFO ] [MAIN ] Derivative Progress: 591/1803 symbols completed. ENB took 1.2s. Estimated remaining: 7m 46s. Rate: 156.0 symbols/min [2025-10-16T22:37:08.034846] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:08.075796] [DEBUG] [LOCAL ] ENOV: Loaded 45134 existing records from primary storage. [2025-10-16T22:37:08.090953] [INFO ] [MAIN ] ENOV: Loaded 45134 primary data records. [2025-10-16T22:37:08.208709] [DEBUG] [LOCAL ] ENS: Loaded 29991 existing records from primary storage. [2025-10-16T22:37:08.216494] [INFO ] [MAIN ] ENS: Loaded 29991 primary data records. [2025-10-16T22:37:08.220495] [DEBUG] [LOCAL ] ENR: Loaded 44023 existing records from primary storage. [2025-10-16T22:37:08.220806] [INFO ] [MAIN ] ENR: Loaded 44023 primary data records. [2025-10-16T22:37:09.085305] [DEBUG] [MAIN ] ENOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:09.086598] [INFO ] [MAIN ] ENOV: Generated 1807 derivative records from 45134 primary records. [2025-10-16T22:37:09.086966] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-10-16T22:37:09.105761] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1807 records). [2025-10-16T22:37:09.106279] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-10-16T22:37:09.109934] [INFO ] [MAIN ] Derivative Progress: 592/1803 symbols completed. ENOV took 1.1s. Estimated remaining: 7m 47s. Rate: 155.6 symbols/min [2025-10-16T22:37:09.111369] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:09.125557] [DEBUG] [MAIN ] ENR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:09.128312] [INFO ] [MAIN ] ENR: Generated 1807 derivative records from 44023 primary records. [2025-10-16T22:37:09.128582] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-16T22:37:09.164730] [DEBUG] [LOCAL ] ENR: Derivative data saved (1807 records). [2025-10-16T22:37:09.164932] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-16T22:37:09.163483] [DEBUG] [MAIN ] ENS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:09.167230] [INFO ] [MAIN ] Derivative Progress: 593/1803 symbols completed. ENR took 1.1s. Estimated remaining: 7m 46s. Rate: 155.8 symbols/min [2025-10-16T22:37:09.167497] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:09.168849] [INFO ] [MAIN ] ENS: Generated 1807 derivative records from 29991 primary records. [2025-10-16T22:37:09.168993] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-10-16T22:37:09.191284] [DEBUG] [LOCAL ] ENVA: Loaded 25627 existing records from primary storage. [2025-10-16T22:37:09.193494] [INFO ] [MAIN ] ENVA: Loaded 25627 primary data records. [2025-10-16T22:37:09.254403] [DEBUG] [LOCAL ] ENS: Derivative data saved (1807 records). [2025-10-16T22:37:09.270442] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-10-16T22:37:09.305150] [INFO ] [MAIN ] Derivative Progress: 594/1803 symbols completed. ENS took 1.3s. Estimated remaining: 7m 45s. Rate: 155.9 symbols/min [2025-10-16T22:37:09.309327] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:09.557281] [DEBUG] [LOCAL ] EOI: Loaded 10738 existing records from primary storage. [2025-10-16T22:37:09.557531] [INFO ] [MAIN ] EOI: Loaded 10738 primary data records. [2025-10-16T22:37:09.630782] [DEBUG] [LOCAL ] EOG: Loaded 53763 existing records from primary storage. [2025-10-16T22:37:09.646195] [INFO ] [MAIN ] EOG: Loaded 53763 primary data records. [2025-10-16T22:37:10.203622] [DEBUG] [MAIN ] ENVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:10.204923] [INFO ] [MAIN ] ENVA: Generated 1807 derivative records from 25627 primary records. [2025-10-16T22:37:10.205301] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-16T22:37:10.223432] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1807 records). [2025-10-16T22:37:10.223724] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-16T22:37:10.225905] [INFO ] [MAIN ] Derivative Progress: 595/1803 symbols completed. ENVA took 1.1s. Estimated remaining: 7m 46s. Rate: 155.6 symbols/min [2025-10-16T22:37:10.226205] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:10.244206] [DEBUG] [MAIN ] EOI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:10.245285] [INFO ] [MAIN ] EOI: Generated 1807 derivative records from 10738 primary records. [2025-10-16T22:37:10.245458] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-16T22:37:10.274033] [DEBUG] [LOCAL ] EOI: Derivative data saved (1807 records). [2025-10-16T22:37:10.274337] [DEBUG] [LOCAL ] EOS: Loaded 15236 existing records from primary storage. [2025-10-16T22:37:10.274605] [INFO ] [MAIN ] EOS: Loaded 15236 primary data records. [2025-10-16T22:37:10.274694] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-16T22:37:10.277091] [INFO ] [MAIN ] Derivative Progress: 596/1803 symbols completed. EOI took 1.0s. Estimated remaining: 7m 45s. Rate: 155.8 symbols/min [2025-10-16T22:37:10.277460] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:10.354446] [DEBUG] [MAIN ] EOG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:10.396148] [INFO ] [MAIN ] EOG: Generated 1807 derivative records from 53763 primary records. [2025-10-16T22:37:10.396319] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-16T22:37:10.410697] [DEBUG] [LOCAL ] EOT: Loaded 7040 existing records from primary storage. [2025-10-16T22:37:10.415925] [INFO ] [MAIN ] EOT: Loaded 7040 primary data records. [2025-10-16T22:37:10.518781] [DEBUG] [LOCAL ] EOG: Derivative data saved (1807 records). [2025-10-16T22:37:10.545779] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-16T22:37:10.571308] [INFO ] [MAIN ] Derivative Progress: 597/1803 symbols completed. EOG took 1.4s. Estimated remaining: 7m 44s. Rate: 155.9 symbols/min [2025-10-16T22:37:10.603713] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:10.930915] [DEBUG] [LOCAL ] EPAC: Loaded 26765 existing records from primary storage. [2025-10-16T22:37:10.931408] [INFO ] [MAIN ] EPAC: Loaded 26765 primary data records. [2025-10-16T22:37:11.050376] [DEBUG] [MAIN ] EOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:11.051298] [INFO ] [MAIN ] EOS: Generated 1807 derivative records from 15236 primary records. [2025-10-16T22:37:11.051419] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-16T22:37:11.292005] [DEBUG] [LOCAL ] EOS: Derivative data saved (1807 records). [2025-10-16T22:37:11.322547] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-10-16T22:37:11.326056] [INFO ] [MAIN ] Derivative Progress: 598/1803 symbols completed. EOS took 1.1s. Estimated remaining: 7m 45s. Rate: 155.6 symbols/min [2025-10-16T22:37:11.323096] [DEBUG] [MAIN ] EOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:11.327078] [INFO ] [MAIN ] EOT: Generated 1807 derivative records from 7040 primary records. [2025-10-16T22:37:11.327158] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-10-16T22:37:11.344940] [DEBUG] [LOCAL ] EOT: Derivative data saved (1807 records). [2025-10-16T22:37:11.345106] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-10-16T22:37:11.347534] [INFO ] [MAIN ] Derivative Progress: 599/1803 symbols completed. EOT took 1.1s. Estimated remaining: 7m 43s. Rate: 155.9 symbols/min [2025-10-16T22:37:11.366342] [DEBUG] [MAIN ] EPAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:11.366917] [INFO ] [MAIN ] EPAC: Generated 1807 derivative records from 26765 primary records. [2025-10-16T22:37:11.366978] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-10-16T22:37:11.381997] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1807 records). [2025-10-16T22:37:11.382053] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-10-16T22:37:11.384590] [INFO ] [MAIN ] Derivative Progress: 600/1803 symbols completed. EPAC took 0.8s. Estimated remaining: 7m 42s. Rate: 156.1 symbols/min [2025-10-16T22:37:11.385169] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:11.385278] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:11.385430] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:11.472034] [DEBUG] [LOCAL ] EPC: Loaded 40042 existing records from primary storage. [2025-10-16T22:37:11.490276] [INFO ] [MAIN ] EPC: Loaded 40042 primary data records. [2025-10-16T22:37:11.522544] [DEBUG] [LOCAL ] EPD: Loaded 54001 existing records from primary storage. [2025-10-16T22:37:11.534770] [INFO ] [MAIN ] EPD: Loaded 54001 primary data records. [2025-10-16T22:37:11.536390] [DEBUG] [LOCAL ] EPAM: Loaded 39697 existing records from primary storage. [2025-10-16T22:37:11.585472] [INFO ] [MAIN ] EPAM: Loaded 39697 primary data records. [2025-10-16T22:37:12.428266] [DEBUG] [MAIN ] EPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:12.428736] [DEBUG] [MAIN ] EPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:12.429495] [INFO ] [MAIN ] EPD: Generated 1807 derivative records from 54001 primary records. [2025-10-16T22:37:12.430115] [INFO ] [MAIN ] EPC: Generated 1807 derivative records from 40042 primary records. [2025-10-16T22:37:12.430286] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-10-16T22:37:12.430219] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-16T22:37:12.460416] [DEBUG] [LOCAL ] EPC: Derivative data saved (1807 records). [2025-10-16T22:37:12.473383] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-10-16T22:37:12.476627] [DEBUG] [MAIN ] EPAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:12.477634] [INFO ] [MAIN ] EPAM: Generated 1807 derivative records from 39697 primary records. [2025-10-16T22:37:12.476286] [INFO ] [MAIN ] Derivative Progress: 601/1803 symbols completed. EPC took 1.1s. Estimated remaining: 7m 43s. Rate: 155.6 symbols/min [2025-10-16T22:37:12.478491] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:12.478925] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-10-16T22:37:12.479873] [DEBUG] [LOCAL ] EPD: Derivative data saved (1807 records). [2025-10-16T22:37:12.480936] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-10-16T22:37:12.483346] [INFO ] [MAIN ] Derivative Progress: 602/1803 symbols completed. EPD took 1.1s. Estimated remaining: 7m 42s. Rate: 155.9 symbols/min [2025-10-16T22:37:12.491133] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:12.500584] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1807 records). [2025-10-16T22:37:12.500781] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-10-16T22:37:12.503634] [INFO ] [MAIN ] Derivative Progress: 603/1803 symbols completed. EPAM took 1.1s. Estimated remaining: 7m 41s. Rate: 156.1 symbols/min [2025-10-16T22:37:12.503972] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:12.519911] [DEBUG] [LOCAL ] EQBK: Loaded 11396 existing records from primary storage. [2025-10-16T22:37:12.520037] [INFO ] [MAIN ] EQBK: Loaded 11396 primary data records. [2025-10-16T22:37:12.695522] [DEBUG] [LOCAL ] EPR: Loaded 44181 existing records from primary storage. [2025-10-16T22:37:12.689383] [DEBUG] [LOCAL ] EPRT: Loaded 48889 existing records from primary storage. [2025-10-16T22:37:12.717015] [INFO ] [MAIN ] EPR: Loaded 44181 primary data records. [2025-10-16T22:37:12.725685] [INFO ] [MAIN ] EPRT: Loaded 48889 primary data records. [2025-10-16T22:37:13.524002] [DEBUG] [MAIN ] EQBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:13.526142] [INFO ] [MAIN ] EQBK: Generated 1807 derivative records from 11396 primary records. [2025-10-16T22:37:13.526407] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-10-16T22:37:13.548453] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1807 records). [2025-10-16T22:37:13.548830] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-10-16T22:37:13.550767] [INFO ] [MAIN ] Derivative Progress: 604/1803 symbols completed. EQBK took 1.0s. Estimated remaining: 7m 42s. Rate: 155.7 symbols/min [2025-10-16T22:37:13.565486] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:13.567054] [DEBUG] [MAIN ] EPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:13.567826] [INFO ] [MAIN ] EPR: Generated 1807 derivative records from 44181 primary records. [2025-10-16T22:37:13.568010] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-10-16T22:37:13.594455] [DEBUG] [MAIN ] EPRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:13.595995] [INFO ] [MAIN ] EPRT: Generated 1807 derivative records from 48889 primary records. [2025-10-16T22:37:13.596385] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-10-16T22:37:13.607219] [DEBUG] [LOCAL ] EPR: Derivative data saved (1807 records). [2025-10-16T22:37:13.612320] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-10-16T22:37:13.614849] [INFO ] [MAIN ] Derivative Progress: 605/1803 symbols completed. EPR took 1.1s. Estimated remaining: 7m 41s. Rate: 155.9 symbols/min [2025-10-16T22:37:13.615883] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:13.623217] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1807 records). [2025-10-16T22:37:13.623362] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-10-16T22:37:13.626505] [INFO ] [MAIN ] Derivative Progress: 606/1803 symbols completed. EPRT took 1.1s. Estimated remaining: 7m 40s. Rate: 156.1 symbols/min [2025-10-16T22:37:13.626850] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:13.680400] [DEBUG] [LOCAL ] EQH: Loaded 53088 existing records from primary storage. [2025-10-16T22:37:13.680785] [INFO ] [MAIN ] EQH: Loaded 53088 primary data records. [2025-10-16T22:37:13.805314] [DEBUG] [LOCAL ] EQNR: Loaded 53437 existing records from primary storage. [2025-10-16T22:37:13.824637] [INFO ] [MAIN ] EQNR: Loaded 53437 primary data records. [2025-10-16T22:37:14.125118] [DEBUG] [LOCAL ] EQR: Loaded 52109 existing records from primary storage. [2025-10-16T22:37:14.134026] [INFO ] [MAIN ] EQR: Loaded 52109 primary data records. [2025-10-16T22:37:14.649684] [DEBUG] [MAIN ] EQH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:14.650618] [INFO ] [MAIN ] EQH: Generated 1807 derivative records from 53088 primary records. [2025-10-16T22:37:14.651822] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-16T22:37:14.670928] [DEBUG] [LOCAL ] EQH: Derivative data saved (1807 records). [2025-10-16T22:37:14.678934] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-10-16T22:37:14.684193] [DEBUG] [MAIN ] EQNR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:14.686758] [INFO ] [MAIN ] Derivative Progress: 607/1803 symbols completed. EQH took 1.1s. Estimated remaining: 7m 41s. Rate: 155.7 symbols/min [2025-10-16T22:37:14.687564] [INFO ] [MAIN ] EQNR: Generated 1807 derivative records from 53437 primary records. [2025-10-16T22:37:14.687794] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-16T22:37:14.687869] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:14.716389] [DEBUG] [MAIN ] EQR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:14.720786] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1807 records). [2025-10-16T22:37:14.721758] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-10-16T22:37:14.721599] [INFO ] [MAIN ] EQR: Generated 1807 derivative records from 52109 primary records. [2025-10-16T22:37:14.724094] [INFO ] [MAIN ] Derivative Progress: 608/1803 symbols completed. EQNR took 1.1s. Estimated remaining: 7m 40s. Rate: 155.9 symbols/min [2025-10-16T22:37:14.724442] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-16T22:37:14.724379] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:14.747037] [DEBUG] [LOCAL ] EQV: Loaded 2745 existing records from primary storage. [2025-10-16T22:37:14.747913] [INFO ] [MAIN ] EQV: Loaded 2745 primary data records. [2025-10-16T22:37:14.822170] [DEBUG] [LOCAL ] EQR: Derivative data saved (1807 records). [2025-10-16T22:37:14.839175] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-16T22:37:14.872391] [INFO ] [MAIN ] Derivative Progress: 609/1803 symbols completed. EQR took 1.2s. Estimated remaining: 7m 39s. Rate: 156.1 symbols/min [2025-10-16T22:37:14.883508] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:15.094858] [DEBUG] [LOCAL ] EQT: Loaded 54075 existing records from primary storage. [2025-10-16T22:37:15.098456] [INFO ] [MAIN ] EQT: Loaded 54075 primary data records. [2025-10-16T22:37:15.451618] [DEBUG] [LOCAL ] ERJ: Loaded 50694 existing records from primary storage. [2025-10-16T22:37:15.460346] [INFO ] [MAIN ] ERJ: Loaded 50694 primary data records. [2025-10-16T22:37:15.656149] [DEBUG] [MAIN ] EQV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:15.771580] [INFO ] [MAIN ] EQV: Generated 1807 derivative records from 2745 primary records. [2025-10-16T22:37:15.771770] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-16T22:37:15.787567] [DEBUG] [LOCAL ] EQV: Derivative data saved (1807 records). [2025-10-16T22:37:15.788053] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-16T22:37:15.790376] [INFO ] [MAIN ] Derivative Progress: 610/1803 symbols completed. EQV took 1.1s. Estimated remaining: 7m 40s. Rate: 155.7 symbols/min [2025-10-16T22:37:15.790687] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:15.809376] [DEBUG] [MAIN ] EQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:15.810084] [INFO ] [MAIN ] EQT: Generated 1807 derivative records from 54075 primary records. [2025-10-16T22:37:15.810280] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-16T22:37:15.834559] [DEBUG] [LOCAL ] EQT: Derivative data saved (1807 records). [2025-10-16T22:37:15.834857] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-16T22:37:15.837963] [INFO ] [MAIN ] Derivative Progress: 611/1803 symbols completed. EQT took 1.2s. Estimated remaining: 7m 39s. Rate: 155.9 symbols/min [2025-10-16T22:37:15.838326] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:15.851899] [DEBUG] [MAIN ] ERJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:15.852543] [INFO ] [MAIN ] ERJ: Generated 1807 derivative records from 50694 primary records. [2025-10-16T22:37:15.852708] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-16T22:37:15.878256] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1807 records). [2025-10-16T22:37:15.878401] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-16T22:37:15.881121] [INFO ] [MAIN ] Derivative Progress: 612/1803 symbols completed. ERJ took 1.0s. Estimated remaining: 7m 38s. Rate: 156.2 symbols/min [2025-10-16T22:37:15.883354] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:15.897368] [DEBUG] [LOCAL ] ERO: Loaded 42256 existing records from primary storage. [2025-10-16T22:37:15.897706] [INFO ] [MAIN ] ERO: Loaded 42256 primary data records. [2025-10-16T22:37:16.112536] [DEBUG] [LOCAL ] ESAB: Loaded 26243 existing records from primary storage. [2025-10-16T22:37:16.212435] [INFO ] [MAIN ] ESAB: Loaded 26243 primary data records. [2025-10-16T22:37:16.347084] [DEBUG] [LOCAL ] ES: Loaded 53077 existing records from primary storage. [2025-10-16T22:37:16.358040] [INFO ] [MAIN ] ES: Loaded 53077 primary data records. [2025-10-16T22:37:16.856017] [DEBUG] [MAIN ] ERO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:16.857383] [INFO ] [MAIN ] ERO: Generated 1807 derivative records from 42256 primary records. [2025-10-16T22:37:16.857857] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-16T22:37:16.875950] [DEBUG] [LOCAL ] ERO: Derivative data saved (1807 records). [2025-10-16T22:37:16.876188] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-16T22:37:16.878676] [INFO ] [MAIN ] Derivative Progress: 613/1803 symbols completed. ERO took 1.1s. Estimated remaining: 7m 38s. Rate: 155.8 symbols/min [2025-10-16T22:37:16.895539] [DEBUG] [MAIN ] ESAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:16.896829] [INFO ] [MAIN ] ESAB: Generated 1807 derivative records from 26243 primary records. [2025-10-16T22:37:16.896952] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-16T22:37:16.931389] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1807 records). [2025-10-16T22:37:16.931492] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-16T22:37:16.930536] [DEBUG] [MAIN ] ES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:16.933618] [INFO ] [MAIN ] Derivative Progress: 614/1803 symbols completed. ESAB took 1.1s. Estimated remaining: 7m 37s. Rate: 156.0 symbols/min [2025-10-16T22:37:16.934902] [INFO ] [MAIN ] ES: Generated 1807 derivative records from 53077 primary records. [2025-10-16T22:37:16.935225] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-16T22:37:16.952236] [DEBUG] [LOCAL ] ES: Derivative data saved (1807 records). [2025-10-16T22:37:16.952380] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-16T22:37:16.957303] [INFO ] [MAIN ] Derivative Progress: 615/1803 symbols completed. ES took 1.1s. Estimated remaining: 7m 36s. Rate: 156.2 symbols/min [2025-10-16T22:37:16.957981] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:16.958146] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:16.958345] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:16.983265] [DEBUG] [LOCAL ] ESE: Loaded 16630 existing records from primary storage. [2025-10-16T22:37:16.983433] [INFO ] [MAIN ] ESE: Loaded 16630 primary data records. [2025-10-16T22:37:17.231086] [DEBUG] [LOCAL ] ESI: Loaded 51027 existing records from primary storage. [2025-10-16T22:37:17.232200] [DEBUG] [LOCAL ] ESNT: Loaded 38566 existing records from primary storage. [2025-10-16T22:37:17.340721] [INFO ] [MAIN ] ESI: Loaded 51027 primary data records. [2025-10-16T22:37:17.363442] [INFO ] [MAIN ] ESNT: Loaded 38566 primary data records. [2025-10-16T22:37:18.092873] [DEBUG] [MAIN ] ESE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:18.097842] [INFO ] [MAIN ] ESE: Generated 1807 derivative records from 16630 primary records. [2025-10-16T22:37:18.100881] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-16T22:37:18.150315] [DEBUG] [MAIN ] ESNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:18.152015] [INFO ] [MAIN ] ESNT: Generated 1807 derivative records from 38566 primary records. [2025-10-16T22:37:18.153180] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-16T22:37:18.154807] [DEBUG] [MAIN ] ESI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:18.156570] [INFO ] [MAIN ] ESI: Generated 1807 derivative records from 51027 primary records. [2025-10-16T22:37:18.157097] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-16T22:37:18.172301] [DEBUG] [LOCAL ] ESE: Derivative data saved (1807 records). [2025-10-16T22:37:18.173216] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-16T22:37:18.183288] [INFO ] [MAIN ] Derivative Progress: 616/1803 symbols completed. ESE took 1.2s. Estimated remaining: 7m 38s. Rate: 155.7 symbols/min [2025-10-16T22:37:18.185712] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:18.194627] [DEBUG] [LOCAL ] ESI: Derivative data saved (1807 records). [2025-10-16T22:37:18.195739] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-16T22:37:18.196605] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1807 records). [2025-10-16T22:37:18.201093] [INFO ] [MAIN ] Derivative Progress: 617/1803 symbols completed. ESI took 1.2s. Estimated remaining: 7m 36s. Rate: 155.9 symbols/min [2025-10-16T22:37:18.201476] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-16T22:37:18.204285] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:18.204516] [INFO ] [MAIN ] Derivative Progress: 618/1803 symbols completed. ESNT took 1.2s. Estimated remaining: 7m 35s. Rate: 156.2 symbols/min [2025-10-16T22:37:18.204761] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:18.267682] [DEBUG] [LOCAL ] ESRT: Loaded 46834 existing records from primary storage. [2025-10-16T22:37:18.267985] [INFO ] [MAIN ] ESRT: Loaded 46834 primary data records. [2025-10-16T22:37:18.383138] [DEBUG] [LOCAL ] ESS: Loaded 30383 existing records from primary storage. [2025-10-16T22:37:18.399981] [INFO ] [MAIN ] ESS: Loaded 30383 primary data records. [2025-10-16T22:37:18.412259] [DEBUG] [LOCAL ] ESTC: Loaded 50722 existing records from primary storage. [2025-10-16T22:37:18.437409] [INFO ] [MAIN ] ESTC: Loaded 50722 primary data records. [2025-10-16T22:37:19.260820] [DEBUG] [MAIN ] ESRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:19.262574] [INFO ] [MAIN ] ESRT: Generated 1807 derivative records from 46834 primary records. [2025-10-16T22:37:19.263850] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-16T22:37:19.297712] [DEBUG] [MAIN ] ESS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:19.312223] [INFO ] [MAIN ] ESS: Generated 1807 derivative records from 30383 primary records. [2025-10-16T22:37:19.314103] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-16T22:37:19.316081] [DEBUG] [MAIN ] ESTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:19.316549] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1807 records). [2025-10-16T22:37:19.324544] [INFO ] [MAIN ] ESTC: Generated 1807 derivative records from 50722 primary records. [2025-10-16T22:37:19.326266] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-16T22:37:19.326449] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-16T22:37:19.328901] [INFO ] [MAIN ] Derivative Progress: 619/1803 symbols completed. ESRT took 1.1s. Estimated remaining: 7m 36s. Rate: 155.7 symbols/min [2025-10-16T22:37:19.333310] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:19.345789] [DEBUG] [LOCAL ] ESS: Derivative data saved (1807 records). [2025-10-16T22:37:19.355381] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-16T22:37:19.355223] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1807 records). [2025-10-16T22:37:19.358473] [INFO ] [MAIN ] Derivative Progress: 620/1803 symbols completed. ESS took 1.2s. Estimated remaining: 7m 35s. Rate: 155.9 symbols/min [2025-10-16T22:37:19.358688] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:19.359280] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-16T22:37:19.364461] [INFO ] [MAIN ] Derivative Progress: 621/1803 symbols completed. ESTC took 1.2s. Estimated remaining: 7m 34s. Rate: 156.2 symbols/min [2025-10-16T22:37:19.364791] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:19.379965] [DEBUG] [LOCAL ] ETB: Loaded 12026 existing records from primary storage. [2025-10-16T22:37:19.380199] [INFO ] [MAIN ] ETB: Loaded 12026 primary data records. [2025-10-16T22:37:19.747080] [DEBUG] [LOCAL ] ETD: Loaded 27518 existing records from primary storage. [2025-10-16T22:37:19.760796] [INFO ] [MAIN ] ETD: Loaded 27518 primary data records. [2025-10-16T22:37:19.761958] [DEBUG] [LOCAL ] ET: Loaded 54179 existing records from primary storage. [2025-10-16T22:37:19.805425] [INFO ] [MAIN ] ET: Loaded 54179 primary data records. [2025-10-16T22:37:20.390114] [DEBUG] [MAIN ] ETB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:20.391354] [INFO ] [MAIN ] ETB: Generated 1807 derivative records from 12026 primary records. [2025-10-16T22:37:20.391547] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-16T22:37:20.411228] [DEBUG] [LOCAL ] ETB: Derivative data saved (1807 records). [2025-10-16T22:37:20.413352] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-16T22:37:20.417164] [INFO ] [MAIN ] Derivative Progress: 622/1803 symbols completed. ETB took 1.1s. Estimated remaining: 7m 35s. Rate: 155.7 symbols/min [2025-10-16T22:37:20.417677] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:20.436139] [DEBUG] [MAIN ] ETD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:20.437353] [INFO ] [MAIN ] ETD: Generated 1807 derivative records from 27518 primary records. [2025-10-16T22:37:20.437504] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-16T22:37:20.473511] [DEBUG] [MAIN ] ET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:20.480432] [INFO ] [MAIN ] ET: Generated 1807 derivative records from 54179 primary records. [2025-10-16T22:37:20.481126] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-16T22:37:20.483866] [DEBUG] [LOCAL ] ETG: Loaded 16789 existing records from primary storage. [2025-10-16T22:37:20.485050] [DEBUG] [LOCAL ] ETD: Derivative data saved (1807 records). [2025-10-16T22:37:20.485542] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-16T22:37:20.485626] [INFO ] [MAIN ] ETG: Loaded 16789 primary data records. [2025-10-16T22:37:20.510695] [INFO ] [MAIN ] Derivative Progress: 623/1803 symbols completed. ETD took 1.1s. Estimated remaining: 7m 34s. Rate: 155.9 symbols/min [2025-10-16T22:37:20.531033] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:20.541131] [DEBUG] [LOCAL ] ET: Derivative data saved (1807 records). [2025-10-16T22:37:20.541376] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-16T22:37:20.551987] [INFO ] [MAIN ] Derivative Progress: 624/1803 symbols completed. ET took 1.2s. Estimated remaining: 7m 33s. Rate: 156.1 symbols/min [2025-10-16T22:37:20.573508] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:20.666388] [DEBUG] [LOCAL ] ETJ: Loaded 16898 existing records from primary storage. [2025-10-16T22:37:20.707355] [INFO ] [MAIN ] ETJ: Loaded 16898 primary data records. [2025-10-16T22:37:21.086522] [DEBUG] [LOCAL ] ETN: Loaded 53020 existing records from primary storage. [2025-10-16T22:37:21.213637] [INFO ] [MAIN ] ETN: Loaded 53020 primary data records. [2025-10-16T22:37:21.392149] [DEBUG] [MAIN ] ETG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:21.433797] [INFO ] [MAIN ] ETG: Generated 1807 derivative records from 16789 primary records. [2025-10-16T22:37:21.584801] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-10-16T22:37:21.620142] [DEBUG] [LOCAL ] ETG: Derivative data saved (1807 records). [2025-10-16T22:37:21.621834] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-10-16T22:37:21.624611] [INFO ] [MAIN ] Derivative Progress: 625/1803 symbols completed. ETG took 1.2s. Estimated remaining: 7m 34s. Rate: 155.7 symbols/min [2025-10-16T22:37:21.625145] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:21.648480] [DEBUG] [LOCAL ] ETO: Loaded 7024 existing records from primary storage. [2025-10-16T22:37:21.654026] [INFO ] [MAIN ] ETO: Loaded 7024 primary data records. [2025-10-16T22:37:21.677968] [DEBUG] [MAIN ] ETJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:21.698606] [INFO ] [MAIN ] ETJ: Generated 1807 derivative records from 16898 primary records. [2025-10-16T22:37:21.720871] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-16T22:37:21.776250] [DEBUG] [MAIN ] ETN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:21.786926] [INFO ] [MAIN ] ETN: Generated 1807 derivative records from 53020 primary records. [2025-10-16T22:37:21.806960] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-16T22:37:21.811814] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1807 records). [2025-10-16T22:37:21.813297] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-16T22:37:21.821210] [INFO ] [MAIN ] Derivative Progress: 626/1803 symbols completed. ETJ took 1.3s. Estimated remaining: 7m 33s. Rate: 155.8 symbols/min [2025-10-16T22:37:21.821405] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:22.050810] [DEBUG] [LOCAL ] ETN: Derivative data saved (1807 records). [2025-10-16T22:37:22.051962] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-16T22:37:22.056570] [INFO ] [MAIN ] Derivative Progress: 627/1803 symbols completed. ETN took 1.5s. Estimated remaining: 7m 33s. Rate: 155.9 symbols/min [2025-10-16T22:37:22.057390] [INFO ] [MAIN ] ETSY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:22.098897] [DEBUG] [MAIN ] ETO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:22.115158] [INFO ] [MAIN ] ETO: Generated 1807 derivative records from 7024 primary records. [2025-10-16T22:37:22.115440] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-16T22:37:22.133421] [DEBUG] [LOCAL ] ETR: Loaded 53597 existing records from primary storage. [2025-10-16T22:37:22.134858] [INFO ] [MAIN ] ETR: Loaded 53597 primary data records. [2025-10-16T22:37:22.162422] [DEBUG] [LOCAL ] ETO: Derivative data saved (1807 records). [2025-10-16T22:37:22.179179] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-16T22:37:22.215207] [INFO ] [MAIN ] Derivative Progress: 628/1803 symbols completed. ETO took 0.6s. Estimated remaining: 7m 32s. Rate: 156.1 symbols/min [2025-10-16T22:37:22.325250] [DEBUG] [LOCAL ] ETSY: Loaded 53966 existing records from primary storage. [2025-10-16T22:37:22.347287] [INFO ] [MAIN ] ETSY: Loaded 53966 primary data records. [2025-10-16T22:37:22.864919] [DEBUG] [MAIN ] ETR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:22.865894] [INFO ] [MAIN ] ETR: Generated 1807 derivative records from 53597 primary records. [2025-10-16T22:37:22.866244] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-16T22:37:22.884323] [DEBUG] [LOCAL ] ETR: Derivative data saved (1807 records). [2025-10-16T22:37:22.885586] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-10-16T22:37:22.888526] [INFO ] [MAIN ] Derivative Progress: 629/1803 symbols completed. ETR took 1.1s. Estimated remaining: 7m 32s. Rate: 155.9 symbols/min [2025-10-16T22:37:22.903590] [DEBUG] [MAIN ] ETSY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:22.904358] [INFO ] [MAIN ] ETSY: Generated 1807 derivative records from 53966 primary records. [2025-10-16T22:37:22.904425] [DEBUG] [LOCAL ] ETSY: Saving derivative data. [2025-10-16T22:37:22.920382] [DEBUG] [LOCAL ] ETSY: Derivative data saved (1807 records). [2025-10-16T22:37:22.920445] [INFO ] [MAIN ] ETSY: Successfully saved derivative data. [2025-10-16T22:37:22.924302] [INFO ] [MAIN ] Derivative Progress: 630/1803 symbols completed. ETSY took 0.9s. Estimated remaining: 7m 31s. Rate: 156.1 symbols/min [2025-10-16T22:37:22.925096] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:22.926001] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:22.925229] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:22.935758] [DEBUG] [LOCAL ] ETX: Loaded 5276 existing records from primary storage. [2025-10-16T22:37:22.936255] [INFO ] [MAIN ] ETX: Loaded 5276 primary data records. [2025-10-16T22:37:23.109932] [DEBUG] [LOCAL ] ETV: Loaded 22403 existing records from primary storage. [2025-10-16T22:37:23.287613] [INFO ] [MAIN ] ETV: Loaded 22403 primary data records. [2025-10-16T22:37:23.288827] [DEBUG] [LOCAL ] ETW: Loaded 25709 existing records from primary storage. [2025-10-16T22:37:23.290694] [INFO ] [MAIN ] ETW: Loaded 25709 primary data records. [2025-10-16T22:37:23.997464] [DEBUG] [MAIN ] ETX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:23.999229] [INFO ] [MAIN ] ETX: Generated 1807 derivative records from 5276 primary records. [2025-10-16T22:37:23.999637] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-16T22:37:24.021740] [DEBUG] [LOCAL ] ETX: Derivative data saved (1807 records). [2025-10-16T22:37:24.022063] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-10-16T22:37:24.025382] [INFO ] [MAIN ] Derivative Progress: 631/1803 symbols completed. ETX took 1.1s. Estimated remaining: 7m 32s. Rate: 155.6 symbols/min [2025-10-16T22:37:24.025915] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:24.061755] [DEBUG] [MAIN ] ETV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:24.062235] [DEBUG] [MAIN ] ETW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:24.064222] [INFO ] [MAIN ] ETW: Generated 1807 derivative records from 25709 primary records. [2025-10-16T22:37:24.063312] [INFO ] [MAIN ] ETV: Generated 1807 derivative records from 22403 primary records. [2025-10-16T22:37:24.064424] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-16T22:37:24.072321] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-10-16T22:37:24.114361] [DEBUG] [LOCAL ] ETV: Derivative data saved (1807 records). [2025-10-16T22:37:24.114546] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-10-16T22:37:24.113671] [DEBUG] [LOCAL ] ETY: Loaded 23111 existing records from primary storage. [2025-10-16T22:37:24.116307] [INFO ] [MAIN ] ETY: Loaded 23111 primary data records. [2025-10-16T22:37:24.119331] [INFO ] [MAIN ] Derivative Progress: 632/1803 symbols completed. ETV took 1.2s. Estimated remaining: 7m 31s. Rate: 155.8 symbols/min [2025-10-16T22:37:24.119595] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:24.116167] [DEBUG] [LOCAL ] ETW: Derivative data saved (1807 records). [2025-10-16T22:37:24.120088] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-16T22:37:24.147017] [INFO ] [MAIN ] Derivative Progress: 633/1803 symbols completed. ETW took 1.2s. Estimated remaining: 7m 30s. Rate: 156.0 symbols/min [2025-10-16T22:37:24.147494] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:24.307706] [DEBUG] [LOCAL ] EVC: Loaded 18191 existing records from primary storage. [2025-10-16T22:37:24.343188] [INFO ] [MAIN ] EVC: Loaded 18191 primary data records. [2025-10-16T22:37:24.493080] [DEBUG] [LOCAL ] EVEX: Loaded 32729 existing records from primary storage. [2025-10-16T22:37:24.507074] [INFO ] [MAIN ] EVEX: Loaded 32729 primary data records. [2025-10-16T22:37:25.308400] [DEBUG] [MAIN ] ETY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:25.310209] [INFO ] [MAIN ] ETY: Generated 1807 derivative records from 23111 primary records. [2025-10-16T22:37:25.310513] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-10-16T22:37:25.336287] [DEBUG] [LOCAL ] ETY: Derivative data saved (1807 records). [2025-10-16T22:37:25.338363] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-10-16T22:37:25.344711] [INFO ] [MAIN ] Derivative Progress: 634/1803 symbols completed. ETY took 1.3s. Estimated remaining: 7m 31s. Rate: 155.5 symbols/min [2025-10-16T22:37:25.345492] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:25.364340] [DEBUG] [MAIN ] EVC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:25.368307] [INFO ] [MAIN ] EVC: Generated 1807 derivative records from 18191 primary records. [2025-10-16T22:37:25.372432] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-16T22:37:25.391410] [DEBUG] [MAIN ] EVEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:25.393330] [INFO ] [MAIN ] EVEX: Generated 1807 derivative records from 32729 primary records. [2025-10-16T22:37:25.393848] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-16T22:37:25.414390] [DEBUG] [LOCAL ] EVF: Loaded 9864 existing records from primary storage. [2025-10-16T22:37:25.436820] [INFO ] [MAIN ] EVF: Loaded 9864 primary data records. [2025-10-16T22:37:25.516637] [DEBUG] [LOCAL ] EVC: Derivative data saved (1807 records). [2025-10-16T22:37:25.531778] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-16T22:37:25.543488] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1807 records). [2025-10-16T22:37:25.563194] [INFO ] [MAIN ] Derivative Progress: 635/1803 symbols completed. EVC took 1.4s. Estimated remaining: 7m 30s. Rate: 155.6 symbols/min [2025-10-16T22:37:25.601896] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:25.601679] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-16T22:37:25.628876] [INFO ] [MAIN ] Derivative Progress: 636/1803 symbols completed. EVEX took 1.5s. Estimated remaining: 7m 29s. Rate: 155.8 symbols/min [2025-10-16T22:37:25.665858] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:25.851341] [DEBUG] [LOCAL ] EVG: Loaded 5979 existing records from primary storage. [2025-10-16T22:37:25.873554] [INFO ] [MAIN ] EVG: Loaded 5979 primary data records. [2025-10-16T22:37:26.225851] [DEBUG] [LOCAL ] EVH: Loaded 49986 existing records from primary storage. [2025-10-16T22:37:26.229212] [INFO ] [MAIN ] EVH: Loaded 49986 primary data records. [2025-10-16T22:37:26.352081] [DEBUG] [MAIN ] EVF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:26.364016] [INFO ] [MAIN ] EVF: Generated 1807 derivative records from 9864 primary records. [2025-10-16T22:37:26.369437] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-16T22:37:26.566705] [DEBUG] [LOCAL ] EVF: Derivative data saved (1807 records). [2025-10-16T22:37:26.567110] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-16T22:37:26.569384] [INFO ] [MAIN ] Derivative Progress: 637/1803 symbols completed. EVF took 1.2s. Estimated remaining: 7m 30s. Rate: 155.5 symbols/min [2025-10-16T22:37:26.570406] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:26.602297] [DEBUG] [MAIN ] EVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:26.603564] [INFO ] [MAIN ] EVG: Generated 1807 derivative records from 5979 primary records. [2025-10-16T22:37:26.605300] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-16T22:37:26.611207] [DEBUG] [LOCAL ] EVN: Loaded 10839 existing records from primary storage. [2025-10-16T22:37:26.611932] [INFO ] [MAIN ] EVN: Loaded 10839 primary data records. [2025-10-16T22:37:26.739012] [DEBUG] [LOCAL ] EVG: Derivative data saved (1807 records). [2025-10-16T22:37:26.740199] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-16T22:37:26.744126] [INFO ] [MAIN ] Derivative Progress: 638/1803 symbols completed. EVG took 1.1s. Estimated remaining: 7m 29s. Rate: 155.6 symbols/min [2025-10-16T22:37:26.755178] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:26.842424] [DEBUG] [MAIN ] EVH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:26.950011] [INFO ] [MAIN ] EVH: Generated 1807 derivative records from 49986 primary records. [2025-10-16T22:37:26.958962] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-16T22:37:26.986062] [DEBUG] [LOCAL ] EVH: Derivative data saved (1807 records). [2025-10-16T22:37:26.986717] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-16T22:37:26.989743] [INFO ] [MAIN ] Derivative Progress: 639/1803 symbols completed. EVH took 1.3s. Estimated remaining: 7m 29s. Rate: 155.7 symbols/min [2025-10-16T22:37:26.990183] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:27.002718] [DEBUG] [LOCAL ] EVR: Loaded 34630 existing records from primary storage. [2025-10-16T22:37:27.003030] [INFO ] [MAIN ] EVR: Loaded 34630 primary data records. [2025-10-16T22:37:27.126152] [DEBUG] [LOCAL ] EVT: Loaded 16930 existing records from primary storage. [2025-10-16T22:37:27.132171] [INFO ] [MAIN ] EVT: Loaded 16930 primary data records. [2025-10-16T22:37:27.468247] [DEBUG] [MAIN ] EVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:27.502501] [INFO ] [MAIN ] EVN: Generated 1807 derivative records from 10839 primary records. [2025-10-16T22:37:27.506384] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-16T22:37:27.674414] [DEBUG] [LOCAL ] EVN: Derivative data saved (1807 records). [2025-10-16T22:37:27.674822] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-16T22:37:27.677223] [INFO ] [MAIN ] Derivative Progress: 640/1803 symbols completed. EVN took 1.1s. Estimated remaining: 7m 29s. Rate: 155.5 symbols/min [2025-10-16T22:37:27.679527] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:27.715707] [DEBUG] [MAIN ] EVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:27.716815] [INFO ] [MAIN ] EVR: Generated 1807 derivative records from 34630 primary records. [2025-10-16T22:37:27.717063] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-16T22:37:27.756669] [DEBUG] [LOCAL ] EVTC: Loaded 27014 existing records from primary storage. [2025-10-16T22:37:27.758619] [INFO ] [MAIN ] EVTC: Loaded 27014 primary data records. [2025-10-16T22:37:27.758947] [DEBUG] [MAIN ] EVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:27.771918] [INFO ] [MAIN ] EVT: Generated 1807 derivative records from 16930 primary records. [2025-10-16T22:37:27.792789] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-16T22:37:27.799532] [DEBUG] [LOCAL ] EVR: Derivative data saved (1807 records). [2025-10-16T22:37:27.819426] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-16T22:37:27.850871] [INFO ] [MAIN ] Derivative Progress: 641/1803 symbols completed. EVR took 1.1s. Estimated remaining: 7m 28s. Rate: 155.7 symbols/min [2025-10-16T22:37:27.879777] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:27.983594] [DEBUG] [LOCAL ] EVT: Derivative data saved (1807 records). [2025-10-16T22:37:28.137517] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-16T22:37:28.150416] [INFO ] [MAIN ] Derivative Progress: 642/1803 symbols completed. EVT took 1.2s. Estimated remaining: 7m 27s. Rate: 155.7 symbols/min [2025-10-16T22:37:28.160262] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:28.179202] [DEBUG] [LOCAL ] EVTL: Loaded 40675 existing records from primary storage. [2025-10-16T22:37:28.180517] [INFO ] [MAIN ] EVTL: Loaded 40675 primary data records. [2025-10-16T22:37:28.299495] [DEBUG] [LOCAL ] EVTR: Loaded 25015 existing records from primary storage. [2025-10-16T22:37:28.310871] [INFO ] [MAIN ] EVTR: Loaded 25015 primary data records. [2025-10-16T22:37:28.584382] [DEBUG] [MAIN ] EVTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:28.610290] [INFO ] [MAIN ] EVTC: Generated 1807 derivative records from 27014 primary records. [2025-10-16T22:37:28.614729] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-16T22:37:28.833520] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1807 records). [2025-10-16T22:37:28.833864] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-16T22:37:28.836235] [INFO ] [MAIN ] Derivative Progress: 643/1803 symbols completed. EVTC took 1.2s. Estimated remaining: 7m 28s. Rate: 155.5 symbols/min [2025-10-16T22:37:28.859714] [DEBUG] [MAIN ] EVTL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:28.860596] [INFO ] [MAIN ] EVTL: Generated 1807 derivative records from 40675 primary records. [2025-10-16T22:37:28.860824] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-16T22:37:28.883198] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1807 records). [2025-10-16T22:37:28.884480] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-16T22:37:28.886990] [INFO ] [MAIN ] Derivative Progress: 644/1803 symbols completed. EVTL took 1.0s. Estimated remaining: 7m 27s. Rate: 155.7 symbols/min [2025-10-16T22:37:28.901622] [DEBUG] [MAIN ] EVTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:28.902222] [INFO ] [MAIN ] EVTR: Generated 1807 derivative records from 25015 primary records. [2025-10-16T22:37:28.902283] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-16T22:37:28.917575] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1807 records). [2025-10-16T22:37:28.917661] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-16T22:37:28.920406] [INFO ] [MAIN ] Derivative Progress: 645/1803 symbols completed. EVTR took 0.8s. Estimated remaining: 7m 26s. Rate: 155.9 symbols/min [2025-10-16T22:37:28.920833] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:28.921328] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:28.921125] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:28.990830] [DEBUG] [LOCAL ] EXG: Loaded 34277 existing records from primary storage. [2025-10-16T22:37:28.991689] [INFO ] [MAIN ] EXG: Loaded 34277 primary data records. [2025-10-16T22:37:29.029876] [DEBUG] [LOCAL ] EW: Loaded 53793 existing records from primary storage. [2025-10-16T22:37:29.080046] [INFO ] [MAIN ] EW: Loaded 53793 primary data records. [2025-10-16T22:37:29.152523] [DEBUG] [LOCAL ] EXK: Loaded 53561 existing records from primary storage. [2025-10-16T22:37:29.191910] [INFO ] [MAIN ] EXK: Loaded 53561 primary data records. [2025-10-16T22:37:30.128377] [DEBUG] [MAIN ] EXG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:30.130259] [INFO ] [MAIN ] EXG: Generated 1807 derivative records from 34277 primary records. [2025-10-16T22:37:30.130467] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-16T22:37:30.164937] [DEBUG] [MAIN ] EW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:30.168916] [INFO ] [MAIN ] EW: Generated 1807 derivative records from 53793 primary records. [2025-10-16T22:37:30.169178] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-16T22:37:30.167946] [DEBUG] [LOCAL ] EXG: Derivative data saved (1807 records). [2025-10-16T22:37:30.170357] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-16T22:37:30.196833] [INFO ] [MAIN ] Derivative Progress: 646/1803 symbols completed. EXG took 1.3s. Estimated remaining: 7m 27s. Rate: 155.4 symbols/min [2025-10-16T22:37:30.197399] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:30.199620] [DEBUG] [MAIN ] EXK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:30.204525] [INFO ] [MAIN ] EXK: Generated 1807 derivative records from 53561 primary records. [2025-10-16T22:37:30.205177] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-16T22:37:30.224844] [DEBUG] [LOCAL ] EW: Derivative data saved (1807 records). [2025-10-16T22:37:30.225280] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-16T22:37:30.228517] [INFO ] [MAIN ] Derivative Progress: 647/1803 symbols completed. EW took 1.3s. Estimated remaining: 7m 26s. Rate: 155.6 symbols/min [2025-10-16T22:37:30.230125] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:30.234154] [DEBUG] [LOCAL ] EXK: Derivative data saved (1807 records). [2025-10-16T22:37:30.234675] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-16T22:37:30.239550] [INFO ] [MAIN ] Derivative Progress: 648/1803 symbols completed. EXK took 1.3s. Estimated remaining: 7m 25s. Rate: 155.8 symbols/min [2025-10-16T22:37:30.248771] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:30.262616] [DEBUG] [LOCAL ] EXP: Loaded 29802 existing records from primary storage. [2025-10-16T22:37:30.262791] [INFO ] [MAIN ] EXP: Loaded 29802 primary data records. [2025-10-16T22:37:30.591254] [DEBUG] [LOCAL ] EXPD: Loaded 48303 existing records from primary storage. [2025-10-16T22:37:30.591484] [INFO ] [MAIN ] EXPD: Loaded 48303 primary data records. [2025-10-16T22:37:30.720971] [DEBUG] [LOCAL ] EXR: Loaded 45888 existing records from primary storage. [2025-10-16T22:37:30.732364] [INFO ] [MAIN ] EXR: Loaded 45888 primary data records. [2025-10-16T22:37:31.243353] [DEBUG] [MAIN ] EXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:31.245403] [INFO ] [MAIN ] EXP: Generated 1807 derivative records from 29802 primary records. [2025-10-16T22:37:31.246413] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-16T22:37:31.269951] [DEBUG] [LOCAL ] EXP: Derivative data saved (1807 records). [2025-10-16T22:37:31.273601] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-16T22:37:31.290071] [DEBUG] [MAIN ] EXPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:31.289424] [INFO ] [MAIN ] Derivative Progress: 649/1803 symbols completed. EXP took 1.1s. Estimated remaining: 7m 25s. Rate: 155.4 symbols/min [2025-10-16T22:37:31.291220] [INFO ] [MAIN ] EXPD: Generated 1807 derivative records from 48303 primary records. [2025-10-16T22:37:31.290361] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:31.291674] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-16T22:37:31.312250] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1807 records). [2025-10-16T22:37:31.312799] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-16T22:37:31.316067] [INFO ] [MAIN ] Derivative Progress: 650/1803 symbols completed. EXPD took 1.1s. Estimated remaining: 7m 24s. Rate: 155.7 symbols/min [2025-10-16T22:37:31.317392] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:31.332082] [DEBUG] [MAIN ] EXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:31.332832] [INFO ] [MAIN ] EXR: Generated 1807 derivative records from 45888 primary records. [2025-10-16T22:37:31.332938] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-16T22:37:31.351673] [DEBUG] [LOCAL ] EXR: Derivative data saved (1807 records). [2025-10-16T22:37:31.351919] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-16T22:37:31.354878] [INFO ] [MAIN ] Derivative Progress: 651/1803 symbols completed. EXR took 1.1s. Estimated remaining: 7m 23s. Rate: 155.9 symbols/min [2025-10-16T22:37:31.369080] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:31.411595] [DEBUG] [LOCAL ] F: Loaded 54210 existing records from primary storage. [2025-10-16T22:37:31.413228] [INFO ] [MAIN ] F: Loaded 54210 primary data records. [2025-10-16T22:37:31.414200] [DEBUG] [LOCAL ] FAF: Loaded 41803 existing records from primary storage. [2025-10-16T22:37:31.450809] [INFO ] [MAIN ] FAF: Loaded 41803 primary data records. [2025-10-16T22:37:31.810375] [DEBUG] [LOCAL ] FBIN: Loaded 50718 existing records from primary storage. [2025-10-16T22:37:32.067420] [INFO ] [MAIN ] FBIN: Loaded 50718 primary data records. [2025-10-16T22:37:32.410940] [DEBUG] [MAIN ] F: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:32.420418] [INFO ] [MAIN ] F: Generated 1807 derivative records from 54210 primary records. [2025-10-16T22:37:32.420529] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-16T22:37:32.425720] [DEBUG] [MAIN ] FAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:32.426968] [INFO ] [MAIN ] FAF: Generated 1807 derivative records from 41803 primary records. [2025-10-16T22:37:32.427483] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-16T22:37:32.450972] [DEBUG] [LOCAL ] F: Derivative data saved (1807 records). [2025-10-16T22:37:32.454505] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-16T22:37:32.457501] [INFO ] [MAIN ] Derivative Progress: 652/1803 symbols completed. F took 1.2s. Estimated remaining: 7m 24s. Rate: 155.4 symbols/min [2025-10-16T22:37:32.458030] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:32.461612] [DEBUG] [LOCAL ] FAF: Derivative data saved (1807 records). [2025-10-16T22:37:32.462278] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-16T22:37:32.465105] [INFO ] [MAIN ] Derivative Progress: 653/1803 symbols completed. FAF took 1.1s. Estimated remaining: 7m 23s. Rate: 155.7 symbols/min [2025-10-16T22:37:32.465328] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:32.481744] [DEBUG] [MAIN ] FBIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:32.482430] [INFO ] [MAIN ] FBIN: Generated 1807 derivative records from 50718 primary records. [2025-10-16T22:37:32.482616] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-16T22:37:32.507031] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1807 records). [2025-10-16T22:37:32.507189] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-10-16T22:37:32.509742] [INFO ] [MAIN ] Derivative Progress: 654/1803 symbols completed. FBIN took 1.1s. Estimated remaining: 7m 22s. Rate: 155.9 symbols/min [2025-10-16T22:37:32.510054] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:32.522432] [DEBUG] [LOCAL ] FBK: Loaded 27707 existing records from primary storage. [2025-10-16T22:37:32.522692] [INFO ] [MAIN ] FBK: Loaded 27707 primary data records. [2025-10-16T22:37:32.837244] [DEBUG] [LOCAL ] FBP: Loaded 46111 existing records from primary storage. [2025-10-16T22:37:32.851024] [INFO ] [MAIN ] FBP: Loaded 46111 primary data records. [2025-10-16T22:37:32.928404] [DEBUG] [LOCAL ] FBRT: Loaded 35695 existing records from primary storage. [2025-10-16T22:37:32.945946] [INFO ] [MAIN ] FBRT: Loaded 35695 primary data records. [2025-10-16T22:37:33.505626] [DEBUG] [MAIN ] FBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:33.507902] [INFO ] [MAIN ] FBK: Generated 1807 derivative records from 27707 primary records. [2025-10-16T22:37:33.508703] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-16T22:37:33.529499] [DEBUG] [LOCAL ] FBK: Derivative data saved (1807 records). [2025-10-16T22:37:33.529764] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-16T22:37:33.532098] [INFO ] [MAIN ] Derivative Progress: 655/1803 symbols completed. FBK took 1.1s. Estimated remaining: 7m 23s. Rate: 155.5 symbols/min [2025-10-16T22:37:33.532357] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:33.581754] [DEBUG] [LOCAL ] FC: Loaded 14966 existing records from primary storage. [2025-10-16T22:37:33.582076] [INFO ] [MAIN ] FC: Loaded 14966 primary data records. [2025-10-16T22:37:33.581196] [DEBUG] [MAIN ] FBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:33.582472] [DEBUG] [MAIN ] FBRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:33.617798] [INFO ] [MAIN ] FBRT: Generated 1807 derivative records from 35695 primary records. [2025-10-16T22:37:33.605797] [INFO ] [MAIN ] FBP: Generated 1807 derivative records from 46111 primary records. [2025-10-16T22:37:33.618111] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-16T22:37:33.618251] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-16T22:37:33.740314] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1807 records). [2025-10-16T22:37:33.746185] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-10-16T22:37:33.754891] [INFO ] [MAIN ] Derivative Progress: 656/1803 symbols completed. FBRT took 1.2s. Estimated remaining: 7m 22s. Rate: 155.6 symbols/min [2025-10-16T22:37:33.784831] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:33.793510] [DEBUG] [LOCAL ] FBP: Derivative data saved (1807 records). [2025-10-16T22:37:33.816392] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-16T22:37:33.928317] [INFO ] [MAIN ] Derivative Progress: 657/1803 symbols completed. FBP took 1.5s. Estimated remaining: 7m 22s. Rate: 155.7 symbols/min [2025-10-16T22:37:33.937839] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:34.006151] [DEBUG] [LOCAL ] FCN: Loaded 26219 existing records from primary storage. [2025-10-16T22:37:34.015010] [INFO ] [MAIN ] FCN: Loaded 26219 primary data records. [2025-10-16T22:37:34.014858] [DEBUG] [LOCAL ] FCF: Loaded 39657 existing records from primary storage. [2025-10-16T22:37:34.015565] [INFO ] [MAIN ] FCF: Loaded 39657 primary data records. [2025-10-16T22:37:34.039965] [DEBUG] [MAIN ] FC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:34.076294] [INFO ] [MAIN ] FC: Generated 1807 derivative records from 14966 primary records. [2025-10-16T22:37:34.152034] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-16T22:37:34.686009] [DEBUG] [LOCAL ] FC: Derivative data saved (1807 records). [2025-10-16T22:37:34.686294] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-10-16T22:37:34.688708] [INFO ] [MAIN ] Derivative Progress: 658/1803 symbols completed. FC took 1.2s. Estimated remaining: 7m 22s. Rate: 155.5 symbols/min [2025-10-16T22:37:34.713382] [DEBUG] [MAIN ] FCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:34.714519] [INFO ] [MAIN ] FCN: Generated 1807 derivative records from 26219 primary records. [2025-10-16T22:37:34.714769] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-16T22:37:34.733930] [DEBUG] [LOCAL ] FCN: Derivative data saved (1807 records). [2025-10-16T22:37:34.734127] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-16T22:37:34.736395] [INFO ] [MAIN ] Derivative Progress: 659/1803 symbols completed. FCN took 0.8s. Estimated remaining: 7m 21s. Rate: 155.7 symbols/min [2025-10-16T22:37:34.748928] [DEBUG] [MAIN ] FCF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:34.749501] [INFO ] [MAIN ] FCF: Generated 1807 derivative records from 39657 primary records. [2025-10-16T22:37:34.749562] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-10-16T22:37:34.765166] [DEBUG] [LOCAL ] FCF: Derivative data saved (1807 records). [2025-10-16T22:37:34.765227] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-10-16T22:37:34.768062] [INFO ] [MAIN ] Derivative Progress: 660/1803 symbols completed. FCF took 1.0s. Estimated remaining: 7m 20s. Rate: 155.9 symbols/min [2025-10-16T22:37:34.768672] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:34.768809] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:34.768931] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:34.786616] [DEBUG] [LOCAL ] FCT: Loaded 14752 existing records from primary storage. [2025-10-16T22:37:34.787252] [INFO ] [MAIN ] FCT: Loaded 14752 primary data records. [2025-10-16T22:37:34.982214] [DEBUG] [LOCAL ] FCPT: Loaded 37627 existing records from primary storage. [2025-10-16T22:37:34.998427] [INFO ] [MAIN ] FCPT: Loaded 37627 primary data records. [2025-10-16T22:37:35.205097] [DEBUG] [LOCAL ] FCX: Loaded 54091 existing records from primary storage. [2025-10-16T22:37:35.220303] [INFO ] [MAIN ] FCX: Loaded 54091 primary data records. [2025-10-16T22:37:35.798146] [DEBUG] [MAIN ] FCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:35.799760] [INFO ] [MAIN ] FCT: Generated 1807 derivative records from 14752 primary records. [2025-10-16T22:37:35.800595] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-16T22:37:35.818759] [DEBUG] [LOCAL ] FCT: Derivative data saved (1807 records). [2025-10-16T22:37:35.820132] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-16T22:37:35.822671] [INFO ] [MAIN ] Derivative Progress: 661/1803 symbols completed. FCT took 1.1s. Estimated remaining: 7m 21s. Rate: 155.5 symbols/min [2025-10-16T22:37:35.823705] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:35.847943] [DEBUG] [MAIN ] FCPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:35.861464] [INFO ] [MAIN ] FCPT: Generated 1807 derivative records from 37627 primary records. [2025-10-16T22:37:35.861569] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-16T22:37:35.861872] [DEBUG] [MAIN ] FCX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:35.862682] [INFO ] [MAIN ] FCX: Generated 1807 derivative records from 54091 primary records. [2025-10-16T22:37:35.871549] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-16T22:37:35.901753] [DEBUG] [LOCAL ] FCX: Derivative data saved (1807 records). [2025-10-16T22:37:35.902109] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-16T22:37:35.904719] [INFO ] [MAIN ] Derivative Progress: 662/1803 symbols completed. FCX took 1.1s. Estimated remaining: 7m 20s. Rate: 155.7 symbols/min [2025-10-16T22:37:35.913795] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:35.917470] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1807 records). [2025-10-16T22:37:35.917710] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-16T22:37:35.920053] [INFO ] [MAIN ] Derivative Progress: 663/1803 symbols completed. FCPT took 1.2s. Estimated remaining: 7m 19s. Rate: 155.9 symbols/min [2025-10-16T22:37:35.920374] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:35.921164] [DEBUG] [LOCAL ] FDP: Loaded 29961 existing records from primary storage. [2025-10-16T22:37:35.921881] [INFO ] [MAIN ] FDP: Loaded 29961 primary data records. [2025-10-16T22:37:36.111357] [DEBUG] [LOCAL ] FDS: Loaded 27887 existing records from primary storage. [2025-10-16T22:37:36.140599] [INFO ] [MAIN ] FDS: Loaded 27887 primary data records. [2025-10-16T22:37:36.663374] [DEBUG] [LOCAL ] FDX: Loaded 51742 existing records from primary storage. [2025-10-16T22:37:36.664101] [INFO ] [MAIN ] FDX: Loaded 51742 primary data records. [2025-10-16T22:37:37.026742] [DEBUG] [MAIN ] FDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:37.029130] [INFO ] [MAIN ] FDP: Generated 1807 derivative records from 29961 primary records. [2025-10-16T22:37:37.029460] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-16T22:37:37.048882] [DEBUG] [LOCAL ] FDP: Derivative data saved (1807 records). [2025-10-16T22:37:37.051371] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-16T22:37:37.053681] [INFO ] [MAIN ] Derivative Progress: 664/1803 symbols completed. FDP took 1.2s. Estimated remaining: 7m 20s. Rate: 155.4 symbols/min [2025-10-16T22:37:37.053943] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:37.069374] [DEBUG] [MAIN ] FDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:37.070324] [INFO ] [MAIN ] FDS: Generated 1807 derivative records from 27887 primary records. [2025-10-16T22:37:37.070524] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-16T22:37:37.090505] [DEBUG] [LOCAL ] FDS: Derivative data saved (1807 records). [2025-10-16T22:37:37.090805] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-16T22:37:37.094342] [INFO ] [MAIN ] Derivative Progress: 665/1803 symbols completed. FDS took 1.2s. Estimated remaining: 7m 19s. Rate: 155.7 symbols/min [2025-10-16T22:37:37.094536] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:37.113864] [DEBUG] [MAIN ] FDX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:37.114826] [INFO ] [MAIN ] FDX: Generated 1807 derivative records from 51742 primary records. [2025-10-16T22:37:37.115077] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-16T22:37:37.163363] [DEBUG] [LOCAL ] FDX: Derivative data saved (1807 records). [2025-10-16T22:37:37.179189] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-16T22:37:37.184149] [INFO ] [MAIN ] Derivative Progress: 666/1803 symbols completed. FDX took 1.3s. Estimated remaining: 7m 18s. Rate: 155.8 symbols/min [2025-10-16T22:37:37.185301] [DEBUG] [LOCAL ] FE: Loaded 53822 existing records from primary storage. [2025-10-16T22:37:37.185993] [INFO ] [MAIN ] FE: Loaded 53822 primary data records. [2025-10-16T22:37:37.185814] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:37.307431] [DEBUG] [LOCAL ] FERG: Loaded 49121 existing records from primary storage. [2025-10-16T22:37:37.308094] [INFO ] [MAIN ] FERG: Loaded 49121 primary data records. [2025-10-16T22:37:37.471417] [DEBUG] [LOCAL ] FET: Loaded 12940 existing records from primary storage. [2025-10-16T22:37:37.517940] [INFO ] [MAIN ] FET: Loaded 12940 primary data records. [2025-10-16T22:37:38.287623] [DEBUG] [MAIN ] FE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:38.289402] [INFO ] [MAIN ] FE: Generated 1807 derivative records from 53822 primary records. [2025-10-16T22:37:38.290387] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-16T22:37:38.322902] [DEBUG] [MAIN ] FERG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:38.327536] [INFO ] [MAIN ] FERG: Generated 1807 derivative records from 49121 primary records. [2025-10-16T22:37:38.329421] [DEBUG] [LOCAL ] FE: Derivative data saved (1807 records). [2025-10-16T22:37:38.328237] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-16T22:37:38.329744] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-16T22:37:38.332418] [INFO ] [MAIN ] Derivative Progress: 667/1803 symbols completed. FE took 1.3s. Estimated remaining: 7m 19s. Rate: 155.4 symbols/min [2025-10-16T22:37:38.332588] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:38.367779] [DEBUG] [LOCAL ] FERG: Derivative data saved (1807 records). [2025-10-16T22:37:38.368987] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-16T22:37:38.368877] [DEBUG] [MAIN ] FET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:38.371871] [INFO ] [MAIN ] Derivative Progress: 668/1803 symbols completed. FERG took 1.3s. Estimated remaining: 7m 18s. Rate: 155.6 symbols/min [2025-10-16T22:37:38.379756] [INFO ] [MAIN ] FET: Generated 1807 derivative records from 12940 primary records. [2025-10-16T22:37:38.379874] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-16T22:37:38.378713] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:38.407211] [DEBUG] [LOCAL ] FF: Loaded 24506 existing records from primary storage. [2025-10-16T22:37:38.407984] [INFO ] [MAIN ] FF: Loaded 24506 primary data records. [2025-10-16T22:37:38.408986] [DEBUG] [LOCAL ] FET: Derivative data saved (1807 records). [2025-10-16T22:37:38.482495] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-16T22:37:38.477213] [DEBUG] [LOCAL ] FFA: Loaded 5963 existing records from primary storage. [2025-10-16T22:37:38.500147] [INFO ] [MAIN ] FFA: Loaded 5963 primary data records. [2025-10-16T22:37:38.504493] [INFO ] [MAIN ] Derivative Progress: 669/1803 symbols completed. FET took 1.3s. Estimated remaining: 7m 17s. Rate: 155.7 symbols/min [2025-10-16T22:37:38.559258] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:38.919614] [DEBUG] [LOCAL ] FFC: Loaded 16818 existing records from primary storage. [2025-10-16T22:37:39.042697] [INFO ] [MAIN ] FFC: Loaded 16818 primary data records. [2025-10-16T22:37:39.370008] [DEBUG] [MAIN ] FF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:39.371528] [INFO ] [MAIN ] FF: Generated 1807 derivative records from 24506 primary records. [2025-10-16T22:37:39.371633] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-16T22:37:39.396435] [DEBUG] [LOCAL ] FF: Derivative data saved (1807 records). [2025-10-16T22:37:39.396606] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-16T22:37:39.398908] [INFO ] [MAIN ] Derivative Progress: 670/1803 symbols completed. FF took 1.1s. Estimated remaining: 7m 17s. Rate: 155.4 symbols/min [2025-10-16T22:37:39.399433] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:39.423105] [DEBUG] [MAIN ] FFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:39.424714] [INFO ] [MAIN ] FFA: Generated 1807 derivative records from 5963 primary records. [2025-10-16T22:37:39.424961] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-16T22:37:39.463309] [DEBUG] [MAIN ] FFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:39.475954] [INFO ] [MAIN ] FFC: Generated 1807 derivative records from 16818 primary records. [2025-10-16T22:37:39.477798] [DEBUG] [LOCAL ] FFA: Derivative data saved (1807 records). [2025-10-16T22:37:39.478204] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-16T22:37:39.478494] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-16T22:37:39.483780] [INFO ] [MAIN ] Derivative Progress: 671/1803 symbols completed. FFA took 1.1s. Estimated remaining: 7m 16s. Rate: 155.6 symbols/min [2025-10-16T22:37:39.485013] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:39.512588] [DEBUG] [LOCAL ] FFC: Derivative data saved (1807 records). [2025-10-16T22:37:39.513207] [DEBUG] [LOCAL ] FFWM: Loaded 36234 existing records from primary storage. [2025-10-16T22:37:39.513364] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-16T22:37:39.513682] [INFO ] [MAIN ] FFWM: Loaded 36234 primary data records. [2025-10-16T22:37:39.516307] [INFO ] [MAIN ] Derivative Progress: 672/1803 symbols completed. FFC took 1.0s. Estimated remaining: 7m 15s. Rate: 155.8 symbols/min [2025-10-16T22:37:39.527970] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:39.639302] [DEBUG] [LOCAL ] FGN: Loaded 3741 existing records from primary storage. [2025-10-16T22:37:39.644226] [INFO ] [MAIN ] FGN: Loaded 3741 primary data records. [2025-10-16T22:37:39.673878] [DEBUG] [LOCAL ] FG: Loaded 22335 existing records from primary storage. [2025-10-16T22:37:39.709096] [INFO ] [MAIN ] FG: Loaded 22335 primary data records. [2025-10-16T22:37:40.590405] [DEBUG] [MAIN ] FFWM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:40.591776] [INFO ] [MAIN ] FFWM: Generated 1807 derivative records from 36234 primary records. [2025-10-16T22:37:40.592150] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-16T22:37:40.639183] [DEBUG] [MAIN ] FG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:40.641073] [INFO ] [MAIN ] FG: Generated 1807 derivative records from 22335 primary records. [2025-10-16T22:37:40.642054] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-16T22:37:40.642386] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1807 records). [2025-10-16T22:37:40.643593] [DEBUG] [MAIN ] FGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:40.643741] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-16T22:37:40.646141] [INFO ] [MAIN ] Derivative Progress: 673/1803 symbols completed. FFWM took 1.2s. Estimated remaining: 7m 16s. Rate: 155.4 symbols/min [2025-10-16T22:37:40.647182] [INFO ] [MAIN ] FGN: Generated 1807 derivative records from 3741 primary records. [2025-10-16T22:37:40.658552] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-16T22:37:40.663046] [DEBUG] [LOCAL ] FG: Derivative data saved (1807 records). [2025-10-16T22:37:40.663548] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-16T22:37:40.666523] [INFO ] [MAIN ] Derivative Progress: 674/1803 symbols completed. FG took 1.2s. Estimated remaining: 7m 15s. Rate: 155.6 symbols/min [2025-10-16T22:37:40.680541] [DEBUG] [LOCAL ] FGN: Derivative data saved (1807 records). [2025-10-16T22:37:40.680622] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-10-16T22:37:40.683357] [INFO ] [MAIN ] Derivative Progress: 675/1803 symbols completed. FGN took 1.2s. Estimated remaining: 7m 14s. Rate: 155.8 symbols/min [2025-10-16T22:37:40.683867] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:40.683799] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:40.684009] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:40.708394] [DEBUG] [LOCAL ] FICO: Loaded 21912 existing records from primary storage. [2025-10-16T22:37:40.708532] [INFO ] [MAIN ] FICO: Loaded 21912 primary data records. [2025-10-16T22:37:40.894701] [DEBUG] [LOCAL ] FHI: Loaded 40215 existing records from primary storage. [2025-10-16T22:37:40.935416] [INFO ] [MAIN ] FHI: Loaded 40215 primary data records. [2025-10-16T22:37:41.138131] [DEBUG] [LOCAL ] FI: Loaded 53970 existing records from primary storage. [2025-10-16T22:37:41.150204] [INFO ] [MAIN ] FI: Loaded 53970 primary data records. [2025-10-16T22:37:41.694558] [DEBUG] [MAIN ] FICO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:37:41.696319] [INFO ] [MAIN ] FICO: Generated 1806 derivative records from 21912 primary records. [2025-10-16T22:37:41.696548] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-16T22:37:41.720821] [DEBUG] [LOCAL ] FICO: Derivative data saved (1806 records). [2025-10-16T22:37:41.722859] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-16T22:37:41.725782] [INFO ] [MAIN ] Derivative Progress: 676/1803 symbols completed. FICO took 1.0s. Estimated remaining: 7m 15s. Rate: 155.4 symbols/min [2025-10-16T22:37:41.726311] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:41.742314] [DEBUG] [MAIN ] FHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:41.744076] [INFO ] [MAIN ] FHI: Generated 1807 derivative records from 40215 primary records. [2025-10-16T22:37:41.744907] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-16T22:37:41.775402] [DEBUG] [LOCAL ] FHI: Derivative data saved (1807 records). [2025-10-16T22:37:41.775898] [DEBUG] [MAIN ] FI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:41.776075] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-16T22:37:41.778427] [INFO ] [MAIN ] Derivative Progress: 677/1803 symbols completed. FHI took 1.1s. Estimated remaining: 7m 14s. Rate: 155.6 symbols/min [2025-10-16T22:37:41.779446] [INFO ] [MAIN ] FI: Generated 1807 derivative records from 53970 primary records. [2025-10-16T22:37:41.779568] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-16T22:37:41.778679] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:41.797813] [DEBUG] [LOCAL ] FI: Derivative data saved (1807 records). [2025-10-16T22:37:41.797882] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-16T22:37:41.800588] [INFO ] [MAIN ] Derivative Progress: 678/1803 symbols completed. FI took 1.1s. Estimated remaining: 7m 13s. Rate: 155.8 symbols/min [2025-10-16T22:37:41.800849] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:41.821711] [DEBUG] [LOCAL ] FINS: Loaded 8363 existing records from primary storage. [2025-10-16T22:37:41.821929] [INFO ] [MAIN ] FINS: Loaded 8363 primary data records. [2025-10-16T22:37:41.938795] [DEBUG] [LOCAL ] FIGS: Loaded 48947 existing records from primary storage. [2025-10-16T22:37:41.959570] [INFO ] [MAIN ] FIGS: Loaded 48947 primary data records. [2025-10-16T22:37:41.987856] [DEBUG] [LOCAL ] FIHL: Loaded 39714 existing records from primary storage. [2025-10-16T22:37:42.032447] [INFO ] [MAIN ] FIHL: Loaded 39714 primary data records. [2025-10-16T22:37:42.858218] [DEBUG] [MAIN ] FINS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:42.861173] [INFO ] [MAIN ] FINS: Generated 1807 derivative records from 8363 primary records. [2025-10-16T22:37:42.861753] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-16T22:37:42.882577] [DEBUG] [LOCAL ] FINS: Derivative data saved (1807 records). [2025-10-16T22:37:42.883167] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-16T22:37:42.886200] [INFO ] [MAIN ] Derivative Progress: 679/1803 symbols completed. FINS took 1.1s. Estimated remaining: 7m 14s. Rate: 155.4 symbols/min [2025-10-16T22:37:42.894441] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:42.900898] [DEBUG] [MAIN ] FIGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:42.902037] [INFO ] [MAIN ] FIGS: Generated 1807 derivative records from 48947 primary records. [2025-10-16T22:37:42.902407] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-16T22:37:42.921474] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1807 records). [2025-10-16T22:37:42.921816] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-16T22:37:42.924566] [INFO ] [MAIN ] Derivative Progress: 680/1803 symbols completed. FIGS took 1.2s. Estimated remaining: 7m 13s. Rate: 155.6 symbols/min [2025-10-16T22:37:42.925033] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:42.939454] [DEBUG] [MAIN ] FIHL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:42.940561] [INFO ] [MAIN ] FIHL: Generated 1807 derivative records from 39714 primary records. [2025-10-16T22:37:42.940709] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-16T22:37:42.973616] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1807 records). [2025-10-16T22:37:42.973919] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-16T22:37:42.976683] [INFO ] [MAIN ] Derivative Progress: 681/1803 symbols completed. FIHL took 1.2s. Estimated remaining: 7m 12s. Rate: 155.8 symbols/min [2025-10-16T22:37:42.977101] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:42.996717] [DEBUG] [LOCAL ] FINV: Loaded 45609 existing records from primary storage. [2025-10-16T22:37:42.997183] [INFO ] [MAIN ] FINV: Loaded 45609 primary data records. [2025-10-16T22:37:43.195776] [DEBUG] [LOCAL ] FIS: Loaded 53727 existing records from primary storage. [2025-10-16T22:37:43.176975] [DEBUG] [LOCAL ] FIX: Loaded 29033 existing records from primary storage. [2025-10-16T22:37:43.201451] [INFO ] [MAIN ] FIS: Loaded 53727 primary data records. [2025-10-16T22:37:43.201350] [INFO ] [MAIN ] FIX: Loaded 29033 primary data records. [2025-10-16T22:37:43.983609] [DEBUG] [MAIN ] FINV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:43.984736] [INFO ] [MAIN ] FINV: Generated 1807 derivative records from 45609 primary records. [2025-10-16T22:37:43.984847] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-16T22:37:44.005477] [DEBUG] [LOCAL ] FINV: Derivative data saved (1807 records). [2025-10-16T22:37:44.008568] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-16T22:37:44.011440] [INFO ] [MAIN ] Derivative Progress: 682/1803 symbols completed. FINV took 1.1s. Estimated remaining: 7m 13s. Rate: 155.4 symbols/min [2025-10-16T22:37:44.012285] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:44.028061] [DEBUG] [MAIN ] FIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:44.028930] [INFO ] [MAIN ] FIS: Generated 1807 derivative records from 53727 primary records. [2025-10-16T22:37:44.029130] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-16T22:37:44.042395] [DEBUG] [MAIN ] FIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:44.045147] [INFO ] [MAIN ] FIX: Generated 1807 derivative records from 29033 primary records. [2025-10-16T22:37:44.052276] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-16T22:37:44.073150] [DEBUG] [LOCAL ] FLC: Loaded 5440 existing records from primary storage. [2025-10-16T22:37:44.076359] [INFO ] [MAIN ] FLC: Loaded 5440 primary data records. [2025-10-16T22:37:44.077778] [DEBUG] [LOCAL ] FIX: Derivative data saved (1807 records). [2025-10-16T22:37:44.083467] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-16T22:37:44.086922] [INFO ] [MAIN ] Derivative Progress: 683/1803 symbols completed. FIX took 1.1s. Estimated remaining: 7m 12s. Rate: 155.6 symbols/min [2025-10-16T22:37:44.095737] [DEBUG] [LOCAL ] FIS: Derivative data saved (1807 records). [2025-10-16T22:37:44.095862] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-16T22:37:44.106083] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:44.119877] [INFO ] [MAIN ] Derivative Progress: 684/1803 symbols completed. FIS took 1.2s. Estimated remaining: 7m 11s. Rate: 155.8 symbols/min [2025-10-16T22:37:44.125176] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:44.473215] [DEBUG] [LOCAL ] FLNG: Loaded 33918 existing records from primary storage. [2025-10-16T22:37:44.488344] [INFO ] [MAIN ] FLNG: Loaded 33918 primary data records. [2025-10-16T22:37:44.609855] [DEBUG] [LOCAL ] FLG: Loaded 53717 existing records from primary storage. [2025-10-16T22:37:44.614354] [INFO ] [MAIN ] FLG: Loaded 53717 primary data records. [2025-10-16T22:37:45.134208] [DEBUG] [MAIN ] FLC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:45.136169] [INFO ] [MAIN ] FLC: Generated 1807 derivative records from 5440 primary records. [2025-10-16T22:37:45.136605] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-16T22:37:45.157982] [DEBUG] [LOCAL ] FLC: Derivative data saved (1807 records). [2025-10-16T22:37:45.158682] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-16T22:37:45.162141] [INFO ] [MAIN ] Derivative Progress: 685/1803 symbols completed. FLC took 1.1s. Estimated remaining: 7m 12s. Rate: 155.4 symbols/min [2025-10-16T22:37:45.163762] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:45.186127] [DEBUG] [MAIN ] FLNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:45.187198] [INFO ] [MAIN ] FLNG: Generated 1807 derivative records from 33918 primary records. [2025-10-16T22:37:45.188508] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-16T22:37:45.217931] [DEBUG] [MAIN ] FLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:45.220320] [INFO ] [MAIN ] FLG: Generated 1807 derivative records from 53717 primary records. [2025-10-16T22:37:45.220908] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-16T22:37:45.233564] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1807 records). [2025-10-16T22:37:45.240758] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-16T22:37:45.240993] [DEBUG] [LOCAL ] FLG: Derivative data saved (1807 records). [2025-10-16T22:37:45.241101] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-16T22:37:45.244980] [INFO ] [MAIN ] Derivative Progress: 686/1803 symbols completed. FLNG took 1.1s. Estimated remaining: 7m 11s. Rate: 155.6 symbols/min [2025-10-16T22:37:45.248367] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:45.265376] [INFO ] [MAIN ] Derivative Progress: 687/1803 symbols completed. FLG took 1.1s. Estimated remaining: 7m 10s. Rate: 155.8 symbols/min [2025-10-16T22:37:45.266058] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:45.295370] [DEBUG] [LOCAL ] FLO: Loaded 52459 existing records from primary storage. [2025-10-16T22:37:45.295903] [INFO ] [MAIN ] FLO: Loaded 52459 primary data records. [2025-10-16T22:37:45.665046] [DEBUG] [LOCAL ] FLR: Loaded 53630 existing records from primary storage. [2025-10-16T22:37:45.665342] [INFO ] [MAIN ] FLR: Loaded 53630 primary data records. [2025-10-16T22:37:45.678399] [DEBUG] [LOCAL ] FLS: Loaded 50762 existing records from primary storage. [2025-10-16T22:37:45.710705] [INFO ] [MAIN ] FLS: Loaded 50762 primary data records. [2025-10-16T22:37:46.445472] [DEBUG] [MAIN ] FLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:46.447359] [INFO ] [MAIN ] FLO: Generated 1807 derivative records from 52459 primary records. [2025-10-16T22:37:46.448278] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-16T22:37:46.470787] [DEBUG] [LOCAL ] FLO: Derivative data saved (1807 records). [2025-10-16T22:37:46.471473] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-16T22:37:46.476344] [INFO ] [MAIN ] Derivative Progress: 688/1803 symbols completed. FLO took 1.3s. Estimated remaining: 7m 11s. Rate: 155.4 symbols/min [2025-10-16T22:37:46.495059] [DEBUG] [MAIN ] FLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:46.496510] [INFO ] [MAIN ] FLR: Generated 1807 derivative records from 53630 primary records. [2025-10-16T22:37:46.496637] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-16T22:37:46.517235] [DEBUG] [LOCAL ] FLR: Derivative data saved (1807 records). [2025-10-16T22:37:46.530178] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-16T22:37:46.530070] [DEBUG] [MAIN ] FLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:46.533837] [INFO ] [MAIN ] Derivative Progress: 689/1803 symbols completed. FLR took 1.3s. Estimated remaining: 7m 10s. Rate: 155.5 symbols/min [2025-10-16T22:37:46.534749] [INFO ] [MAIN ] FLS: Generated 1807 derivative records from 50762 primary records. [2025-10-16T22:37:46.534854] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-16T22:37:46.550924] [DEBUG] [LOCAL ] FLS: Derivative data saved (1807 records). [2025-10-16T22:37:46.550999] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-16T22:37:46.553669] [INFO ] [MAIN ] Derivative Progress: 690/1803 symbols completed. FLS took 1.3s. Estimated remaining: 7m 9s. Rate: 155.8 symbols/min [2025-10-16T22:37:46.554180] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:46.554369] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:46.555258] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:46.581172] [DEBUG] [LOCAL ] FLXR: Loaded 21214 existing records from primary storage. [2025-10-16T22:37:46.581375] [INFO ] [MAIN ] FLXR: Loaded 21214 primary data records. [2025-10-16T22:37:46.963748] [DEBUG] [LOCAL ] FLUT: Loaded 51111 existing records from primary storage. [2025-10-16T22:37:46.964256] [INFO ] [MAIN ] FLUT: Loaded 51111 primary data records. [2025-10-16T22:37:47.002728] [DEBUG] [LOCAL ] FMC: Loaded 52236 existing records from primary storage. [2025-10-16T22:37:47.026132] [INFO ] [MAIN ] FMC: Loaded 52236 primary data records. [2025-10-16T22:37:47.649608] [DEBUG] [MAIN ] FLXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:47.653268] [INFO ] [MAIN ] FLXR: Generated 1807 derivative records from 21214 primary records. [2025-10-16T22:37:47.653605] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-16T22:37:47.674274] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1807 records). [2025-10-16T22:37:47.674542] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-16T22:37:47.677410] [INFO ] [MAIN ] Derivative Progress: 691/1803 symbols completed. FLXR took 1.1s. Estimated remaining: 7m 10s. Rate: 155.3 symbols/min [2025-10-16T22:37:47.678071] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:47.697394] [DEBUG] [MAIN ] FMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:47.699574] [INFO ] [MAIN ] FMC: Generated 1807 derivative records from 52236 primary records. [2025-10-16T22:37:47.701153] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-16T22:37:47.706352] [DEBUG] [LOCAL ] FMN: Loaded 5497 existing records from primary storage. [2025-10-16T22:37:47.720557] [INFO ] [MAIN ] FMN: Loaded 5497 primary data records. [2025-10-16T22:37:47.739312] [DEBUG] [MAIN ] FLUT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:47.790096] [DEBUG] [LOCAL ] FMC: Derivative data saved (1807 records). [2025-10-16T22:37:47.800097] [INFO ] [MAIN ] FLUT: Generated 1807 derivative records from 51111 primary records. [2025-10-16T22:37:47.816938] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-16T22:37:47.834754] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-16T22:37:47.842203] [INFO ] [MAIN ] Derivative Progress: 692/1803 symbols completed. FMC took 1.3s. Estimated remaining: 7m 9s. Rate: 155.5 symbols/min [2025-10-16T22:37:47.842441] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:47.940578] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1807 records). [2025-10-16T22:37:48.047355] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-16T22:37:48.060061] [INFO ] [MAIN ] Derivative Progress: 693/1803 symbols completed. FLUT took 1.5s. Estimated remaining: 7m 8s. Rate: 155.6 symbols/min [2025-10-16T22:37:48.060706] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:48.093440] [DEBUG] [LOCAL ] FMS: Loaded 30464 existing records from primary storage. [2025-10-16T22:37:48.094199] [INFO ] [MAIN ] FMS: Loaded 30464 primary data records. [2025-10-16T22:37:48.294931] [DEBUG] [LOCAL ] FMX: Loaded 40866 existing records from primary storage. [2025-10-16T22:37:48.303183] [INFO ] [MAIN ] FMX: Loaded 40866 primary data records. [2025-10-16T22:37:48.303504] [DEBUG] [MAIN ] FMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:48.355876] [INFO ] [MAIN ] FMN: Generated 1807 derivative records from 5497 primary records. [2025-10-16T22:37:48.482188] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-16T22:37:48.580894] [DEBUG] [LOCAL ] FMN: Derivative data saved (1807 records). [2025-10-16T22:37:48.644629] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-16T22:37:48.654044] [INFO ] [MAIN ] Derivative Progress: 694/1803 symbols completed. FMN took 1.0s. Estimated remaining: 7m 8s. Rate: 155.4 symbols/min [2025-10-16T22:37:48.813900] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:48.842826] [DEBUG] [LOCAL ] FMY: Loaded 1390 existing records from primary storage. [2025-10-16T22:37:48.843161] [INFO ] [MAIN ] FMY: Loaded 1390 primary data records. [2025-10-16T22:37:48.969489] [DEBUG] [MAIN ] FMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:48.988087] [INFO ] [MAIN ] FMS: Generated 1807 derivative records from 30464 primary records. [2025-10-16T22:37:49.021287] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-16T22:37:49.187167] [DEBUG] [LOCAL ] FMS: Derivative data saved (1807 records). [2025-10-16T22:37:49.187709] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-16T22:37:49.189971] [INFO ] [MAIN ] Derivative Progress: 695/1803 symbols completed. FMS took 1.3s. Estimated remaining: 7m 8s. Rate: 155.3 symbols/min [2025-10-16T22:37:49.190381] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:49.216309] [DEBUG] [MAIN ] FMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:49.217401] [INFO ] [MAIN ] FMX: Generated 1807 derivative records from 40866 primary records. [2025-10-16T22:37:49.217818] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-16T22:37:49.237535] [DEBUG] [LOCAL ] FMX: Derivative data saved (1807 records). [2025-10-16T22:37:49.237869] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-16T22:37:49.242362] [INFO ] [MAIN ] Derivative Progress: 696/1803 symbols completed. FMX took 1.2s. Estimated remaining: 7m 7s. Rate: 155.5 symbols/min [2025-10-16T22:37:49.242586] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:49.270275] [DEBUG] [MAIN ] FMY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:49.271046] [INFO ] [MAIN ] FMY: Generated 1807 derivative records from 1390 primary records. [2025-10-16T22:37:49.271175] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-16T22:37:49.296930] [DEBUG] [LOCAL ] FMY: Derivative data saved (1807 records). [2025-10-16T22:37:49.297056] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-16T22:37:49.301954] [INFO ] [MAIN ] Derivative Progress: 697/1803 symbols completed. FMY took 0.5s. Estimated remaining: 7m 6s. Rate: 155.7 symbols/min [2025-10-16T22:37:49.297882] [DEBUG] [LOCAL ] FN: Loaded 38016 existing records from primary storage. [2025-10-16T22:37:49.302165] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:49.302998] [INFO ] [MAIN ] FN: Loaded 38016 primary data records. [2025-10-16T22:37:49.667412] [DEBUG] [LOCAL ] FNB: Loaded 52986 existing records from primary storage. [2025-10-16T22:37:49.668128] [INFO ] [MAIN ] FNB: Loaded 52986 primary data records. [2025-10-16T22:37:49.790476] [DEBUG] [LOCAL ] FND: Loaded 52517 existing records from primary storage. [2025-10-16T22:37:49.806554] [INFO ] [MAIN ] FND: Loaded 52517 primary data records. [2025-10-16T22:37:50.312603] [DEBUG] [MAIN ] FN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:50.314396] [INFO ] [MAIN ] FN: Generated 1807 derivative records from 38016 primary records. [2025-10-16T22:37:50.314876] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-16T22:37:50.335802] [DEBUG] [LOCAL ] FN: Derivative data saved (1807 records). [2025-10-16T22:37:50.336034] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-16T22:37:50.338385] [INFO ] [MAIN ] Derivative Progress: 698/1803 symbols completed. FN took 1.1s. Estimated remaining: 7m 7s. Rate: 155.4 symbols/min [2025-10-16T22:37:50.338671] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:50.353308] [DEBUG] [MAIN ] FNB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:50.354113] [INFO ] [MAIN ] FNB: Generated 1807 derivative records from 52986 primary records. [2025-10-16T22:37:50.354329] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-16T22:37:50.385873] [DEBUG] [LOCAL ] FNB: Derivative data saved (1807 records). [2025-10-16T22:37:50.386222] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-16T22:37:50.388405] [INFO ] [MAIN ] Derivative Progress: 699/1803 symbols completed. FNB took 1.1s. Estimated remaining: 7m 6s. Rate: 155.5 symbols/min [2025-10-16T22:37:50.388846] [DEBUG] [MAIN ] FND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:50.389672] [INFO ] [MAIN ] FND: Generated 1807 derivative records from 52517 primary records. [2025-10-16T22:37:50.389839] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-16T22:37:50.389952] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:50.406274] [DEBUG] [LOCAL ] FND: Derivative data saved (1807 records). [2025-10-16T22:37:50.406430] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-16T22:37:50.409261] [INFO ] [MAIN ] Derivative Progress: 700/1803 symbols completed. FND took 1.1s. Estimated remaining: 7m 5s. Rate: 155.8 symbols/min [2025-10-16T22:37:50.409471] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:50.434378] [DEBUG] [LOCAL ] FOA: Loaded 13156 existing records from primary storage. [2025-10-16T22:37:50.434535] [INFO ] [MAIN ] FOA: Loaded 13156 primary data records. [2025-10-16T22:37:50.575331] [DEBUG] [LOCAL ] FNF: Loaded 49296 existing records from primary storage. [2025-10-16T22:37:50.586388] [INFO ] [MAIN ] FNF: Loaded 49296 primary data records. [2025-10-16T22:37:50.879406] [DEBUG] [LOCAL ] FNV: Loaded 46507 existing records from primary storage. [2025-10-16T22:37:50.897000] [INFO ] [MAIN ] FNV: Loaded 46507 primary data records. [2025-10-16T22:37:51.438953] [DEBUG] [MAIN ] FOA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:51.440104] [INFO ] [MAIN ] FOA: Generated 1807 derivative records from 13156 primary records. [2025-10-16T22:37:51.440687] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-16T22:37:51.474992] [DEBUG] [MAIN ] FNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:51.475863] [INFO ] [MAIN ] FNF: Generated 1807 derivative records from 49296 primary records. [2025-10-16T22:37:51.475969] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-16T22:37:51.474562] [DEBUG] [LOCAL ] FOA: Derivative data saved (1807 records). [2025-10-16T22:37:51.476082] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-16T22:37:51.479023] [INFO ] [MAIN ] Derivative Progress: 701/1803 symbols completed. FOA took 1.1s. Estimated remaining: 7m 6s. Rate: 155.4 symbols/min [2025-10-16T22:37:51.486690] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:51.496777] [DEBUG] [LOCAL ] FNF: Derivative data saved (1807 records). [2025-10-16T22:37:51.497072] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-16T22:37:51.499230] [INFO ] [MAIN ] Derivative Progress: 702/1803 symbols completed. FNF took 1.2s. Estimated remaining: 7m 5s. Rate: 155.6 symbols/min [2025-10-16T22:37:51.502207] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:51.517563] [DEBUG] [MAIN ] FNV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:51.521621] [DEBUG] [LOCAL ] FOF: Loaded 8657 existing records from primary storage. [2025-10-16T22:37:51.522449] [INFO ] [MAIN ] FNV: Generated 1807 derivative records from 46507 primary records. [2025-10-16T22:37:51.522564] [INFO ] [MAIN ] FOF: Loaded 8657 primary data records. [2025-10-16T22:37:51.522761] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-16T22:37:51.647861] [DEBUG] [LOCAL ] FOR: Loaded 19877 existing records from primary storage. [2025-10-16T22:37:51.657754] [INFO ] [MAIN ] FOR: Loaded 19877 primary data records. [2025-10-16T22:37:51.783733] [DEBUG] [LOCAL ] FNV: Derivative data saved (1807 records). [2025-10-16T22:37:51.934451] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-16T22:37:51.950302] [INFO ] [MAIN ] Derivative Progress: 703/1803 symbols completed. FNV took 1.6s. Estimated remaining: 7m 4s. Rate: 155.5 symbols/min [2025-10-16T22:37:52.177243] [DEBUG] [MAIN ] FOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:52.179701] [INFO ] [MAIN ] FOF: Generated 1807 derivative records from 8657 primary records. [2025-10-16T22:37:52.180175] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-16T22:37:52.212105] [DEBUG] [MAIN ] FOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:52.213861] [INFO ] [MAIN ] FOR: Generated 1807 derivative records from 19877 primary records. [2025-10-16T22:37:52.213954] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-16T22:37:52.216091] [DEBUG] [LOCAL ] FOF: Derivative data saved (1807 records). [2025-10-16T22:37:52.223723] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-16T22:37:52.228487] [INFO ] [MAIN ] Derivative Progress: 704/1803 symbols completed. FOF took 0.7s. Estimated remaining: 7m 4s. Rate: 155.6 symbols/min [2025-10-16T22:37:52.236015] [DEBUG] [LOCAL ] FOR: Derivative data saved (1807 records). [2025-10-16T22:37:52.236104] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-16T22:37:52.238844] [INFO ] [MAIN ] Derivative Progress: 705/1803 symbols completed. FOR took 0.7s. Estimated remaining: 7m 3s. Rate: 155.8 symbols/min [2025-10-16T22:37:52.239352] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:52.239256] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:52.239407] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:52.266400] [DEBUG] [LOCAL ] FPH: Loaded 19484 existing records from primary storage. [2025-10-16T22:37:52.266594] [INFO ] [MAIN ] FPH: Loaded 19484 primary data records. [2025-10-16T22:37:52.312889] [DEBUG] [LOCAL ] FPF: Loaded 19054 existing records from primary storage. [2025-10-16T22:37:52.380232] [INFO ] [MAIN ] FPF: Loaded 19054 primary data records. [2025-10-16T22:37:52.737515] [DEBUG] [LOCAL ] FOUR: Loaded 50101 existing records from primary storage. [2025-10-16T22:37:52.754335] [INFO ] [MAIN ] FOUR: Loaded 50101 primary data records. [2025-10-16T22:37:53.263433] [DEBUG] [MAIN ] FPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:53.264790] [INFO ] [MAIN ] FPH: Generated 1807 derivative records from 19484 primary records. [2025-10-16T22:37:53.265110] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-16T22:37:53.288698] [DEBUG] [LOCAL ] FPH: Derivative data saved (1807 records). [2025-10-16T22:37:53.288911] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-16T22:37:53.291560] [INFO ] [MAIN ] Derivative Progress: 706/1803 symbols completed. FPH took 1.1s. Estimated remaining: 7m 3s. Rate: 155.4 symbols/min [2025-10-16T22:37:53.299831] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:53.305954] [DEBUG] [MAIN ] FPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:53.307077] [INFO ] [MAIN ] FPF: Generated 1807 derivative records from 19054 primary records. [2025-10-16T22:37:53.307309] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-16T22:37:53.327614] [DEBUG] [LOCAL ] FPF: Derivative data saved (1807 records). [2025-10-16T22:37:53.327878] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-16T22:37:53.331849] [INFO ] [MAIN ] Derivative Progress: 707/1803 symbols completed. FPF took 1.1s. Estimated remaining: 7m 3s. Rate: 155.6 symbols/min [2025-10-16T22:37:53.344933] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:53.346052] [DEBUG] [MAIN ] FOUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:53.356364] [INFO ] [MAIN ] FOUR: Generated 1807 derivative records from 50101 primary records. [2025-10-16T22:37:53.356470] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-16T22:37:53.381704] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1807 records). [2025-10-16T22:37:53.381911] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-16T22:37:53.384793] [INFO ] [MAIN ] Derivative Progress: 708/1803 symbols completed. FOUR took 1.1s. Estimated remaining: 7m 2s. Rate: 155.8 symbols/min [2025-10-16T22:37:53.386632] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:53.387684] [DEBUG] [LOCAL ] FPI: Loaded 31623 existing records from primary storage. [2025-10-16T22:37:53.387757] [INFO ] [MAIN ] FPI: Loaded 31623 primary data records. [2025-10-16T22:37:53.559408] [DEBUG] [LOCAL ] FRA: Loaded 14371 existing records from primary storage. [2025-10-16T22:37:53.598857] [INFO ] [MAIN ] FRA: Loaded 14371 primary data records. [2025-10-16T22:37:53.648698] [DEBUG] [LOCAL ] FR: Loaded 46923 existing records from primary storage. [2025-10-16T22:37:53.807487] [INFO ] [MAIN ] FR: Loaded 46923 primary data records. [2025-10-16T22:37:54.499480] [DEBUG] [MAIN ] FPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:54.501239] [INFO ] [MAIN ] FPI: Generated 1807 derivative records from 31623 primary records. [2025-10-16T22:37:54.501691] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-16T22:37:54.521638] [DEBUG] [LOCAL ] FPI: Derivative data saved (1807 records). [2025-10-16T22:37:54.522114] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-16T22:37:54.524275] [INFO ] [MAIN ] Derivative Progress: 709/1803 symbols completed. FPI took 1.2s. Estimated remaining: 7m 2s. Rate: 155.4 symbols/min [2025-10-16T22:37:54.524799] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:54.546189] [DEBUG] [MAIN ] FRA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:54.547304] [INFO ] [MAIN ] FRA: Generated 1807 derivative records from 14371 primary records. [2025-10-16T22:37:54.547410] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-16T22:37:54.568129] [DEBUG] [LOCAL ] FRA: Derivative data saved (1807 records). [2025-10-16T22:37:54.573835] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-16T22:37:54.577717] [INFO ] [MAIN ] Derivative Progress: 710/1803 symbols completed. FRA took 1.2s. Estimated remaining: 7m 2s. Rate: 155.6 symbols/min [2025-10-16T22:37:54.578558] [DEBUG] [LOCAL ] FRGE: Loaded 16223 existing records from primary storage. [2025-10-16T22:37:54.578932] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:54.580889] [INFO ] [MAIN ] FRGE: Loaded 16223 primary data records. [2025-10-16T22:37:54.666323] [DEBUG] [MAIN ] FR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:54.700597] [INFO ] [MAIN ] FR: Generated 1807 derivative records from 46923 primary records. [2025-10-16T22:37:54.711699] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-16T22:37:54.925828] [DEBUG] [LOCAL ] FR: Derivative data saved (1807 records). [2025-10-16T22:37:54.940386] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-16T22:37:54.943423] [INFO ] [MAIN ] Derivative Progress: 711/1803 symbols completed. FR took 1.6s. Estimated remaining: 7m 1s. Rate: 155.6 symbols/min [2025-10-16T22:37:54.944734] [DEBUG] [LOCAL ] FRO: Loaded 52078 existing records from primary storage. [2025-10-16T22:37:54.943710] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:54.945898] [INFO ] [MAIN ] FRO: Loaded 52078 primary data records. [2025-10-16T22:37:55.269360] [DEBUG] [LOCAL ] FRT: Loaded 42000 existing records from primary storage. [2025-10-16T22:37:55.269855] [INFO ] [MAIN ] FRT: Loaded 42000 primary data records. [2025-10-16T22:37:55.294460] [DEBUG] [MAIN ] FRGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:55.322278] [INFO ] [MAIN ] FRGE: Generated 1807 derivative records from 16223 primary records. [2025-10-16T22:37:55.335307] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-16T22:37:55.600782] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1807 records). [2025-10-16T22:37:55.602894] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-16T22:37:55.606750] [INFO ] [MAIN ] Derivative Progress: 712/1803 symbols completed. FRGE took 1.1s. Estimated remaining: 7m 1s. Rate: 155.4 symbols/min [2025-10-16T22:37:55.607838] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:55.623426] [DEBUG] [MAIN ] FRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:55.624578] [INFO ] [MAIN ] FRO: Generated 1807 derivative records from 52078 primary records. [2025-10-16T22:37:55.624839] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-16T22:37:55.643235] [DEBUG] [LOCAL ] FRO: Derivative data saved (1807 records). [2025-10-16T22:37:55.643560] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-16T22:37:55.646512] [INFO ] [MAIN ] Derivative Progress: 713/1803 symbols completed. FRO took 1.1s. Estimated remaining: 7m 0s. Rate: 155.6 symbols/min [2025-10-16T22:37:55.646726] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:55.663124] [DEBUG] [MAIN ] FRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:55.663891] [INFO ] [MAIN ] FRT: Generated 1807 derivative records from 42000 primary records. [2025-10-16T22:37:55.676263] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-16T22:37:55.703849] [DEBUG] [LOCAL ] FSCO: Loaded 38807 existing records from primary storage. [2025-10-16T22:37:55.704545] [INFO ] [MAIN ] FSCO: Loaded 38807 primary data records. [2025-10-16T22:37:55.704943] [DEBUG] [LOCAL ] FRT: Derivative data saved (1807 records). [2025-10-16T22:37:55.726114] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-10-16T22:37:55.745154] [INFO ] [MAIN ] Derivative Progress: 714/1803 symbols completed. FRT took 0.8s. Estimated remaining: 6m 59s. Rate: 155.8 symbols/min [2025-10-16T22:37:55.752735] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:56.042795] [DEBUG] [LOCAL ] FSK: Loaded 49891 existing records from primary storage. [2025-10-16T22:37:56.043057] [INFO ] [MAIN ] FSK: Loaded 49891 primary data records. [2025-10-16T22:37:56.162508] [DEBUG] [LOCAL ] FSLY: Loaded 51707 existing records from primary storage. [2025-10-16T22:37:56.168239] [INFO ] [MAIN ] FSLY: Loaded 51707 primary data records. [2025-10-16T22:37:56.718399] [DEBUG] [MAIN ] FSCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:56.720367] [INFO ] [MAIN ] FSCO: Generated 1807 derivative records from 38807 primary records. [2025-10-16T22:37:56.720932] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-16T22:37:56.754252] [DEBUG] [MAIN ] FSK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:56.755828] [INFO ] [MAIN ] FSK: Generated 1807 derivative records from 49891 primary records. [2025-10-16T22:37:56.756007] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-16T22:37:56.766667] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1807 records). [2025-10-16T22:37:56.774606] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-16T22:37:56.778220] [INFO ] [MAIN ] Derivative Progress: 715/1803 symbols completed. FSCO took 1.2s. Estimated remaining: 7m 0s. Rate: 155.4 symbols/min [2025-10-16T22:37:56.780172] [DEBUG] [LOCAL ] FSK: Derivative data saved (1807 records). [2025-10-16T22:37:56.781330] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-16T22:37:56.780477] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:56.784391] [INFO ] [MAIN ] Derivative Progress: 716/1803 symbols completed. FSK took 1.1s. Estimated remaining: 6m 59s. Rate: 155.6 symbols/min [2025-10-16T22:37:56.785324] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:56.798933] [DEBUG] [MAIN ] FSLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:56.799527] [INFO ] [MAIN ] FSLY: Generated 1807 derivative records from 51707 primary records. [2025-10-16T22:37:56.799592] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-16T22:37:56.816419] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1807 records). [2025-10-16T22:37:56.816626] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-16T22:37:56.819622] [INFO ] [MAIN ] Derivative Progress: 717/1803 symbols completed. FSLY took 1.1s. Estimated remaining: 6m 58s. Rate: 155.8 symbols/min [2025-10-16T22:37:56.819842] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:56.837218] [DEBUG] [LOCAL ] FT: Loaded 6851 existing records from primary storage. [2025-10-16T22:37:56.837631] [INFO ] [MAIN ] FT: Loaded 6851 primary data records. [2025-10-16T22:37:56.965817] [DEBUG] [LOCAL ] FSS: Loaded 33877 existing records from primary storage. [2025-10-16T22:37:56.971524] [INFO ] [MAIN ] FSS: Loaded 33877 primary data records. [2025-10-16T22:37:57.314205] [DEBUG] [LOCAL ] FSM: Loaded 53691 existing records from primary storage. [2025-10-16T22:37:57.342987] [INFO ] [MAIN ] FSM: Loaded 53691 primary data records. [2025-10-16T22:37:57.843249] [DEBUG] [MAIN ] FT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:57.846687] [INFO ] [MAIN ] FT: Generated 1807 derivative records from 6851 primary records. [2025-10-16T22:37:57.846953] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-16T22:37:57.873768] [DEBUG] [MAIN ] FSS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:57.875342] [INFO ] [MAIN ] FSS: Generated 1807 derivative records from 33877 primary records. [2025-10-16T22:37:57.875559] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-16T22:37:57.893721] [DEBUG] [LOCAL ] FT: Derivative data saved (1807 records). [2025-10-16T22:37:57.903357] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-16T22:37:57.911797] [INFO ] [MAIN ] Derivative Progress: 718/1803 symbols completed. FT took 1.1s. Estimated remaining: 6m 59s. Rate: 155.4 symbols/min [2025-10-16T22:37:57.913391] [DEBUG] [MAIN ] FSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:57.915579] [INFO ] [MAIN ] FSM: Generated 1807 derivative records from 53691 primary records. [2025-10-16T22:37:57.915778] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-16T22:37:57.916450] [DEBUG] [LOCAL ] FSS: Derivative data saved (1807 records). [2025-10-16T22:37:57.916891] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-16T22:37:57.918705] [INFO ] [MAIN ] Derivative Progress: 719/1803 symbols completed. FSS took 1.1s. Estimated remaining: 6m 58s. Rate: 155.7 symbols/min [2025-10-16T22:37:57.933551] [DEBUG] [LOCAL ] FSM: Derivative data saved (1807 records). [2025-10-16T22:37:57.933631] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-10-16T22:37:57.937322] [INFO ] [MAIN ] Derivative Progress: 720/1803 symbols completed. FSM took 1.2s. Estimated remaining: 6m 57s. Rate: 155.9 symbols/min [2025-10-16T22:37:57.938171] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:57.938303] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:57.938047] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:57.955949] [DEBUG] [LOCAL ] FTHY: Loaded 12446 existing records from primary storage. [2025-10-16T22:37:57.956102] [INFO ] [MAIN ] FTHY: Loaded 12446 primary data records. [2025-10-16T22:37:58.103994] [DEBUG] [LOCAL ] FTK: Loaded 33095 existing records from primary storage. [2025-10-16T22:37:58.104523] [INFO ] [MAIN ] FTK: Loaded 33095 primary data records. [2025-10-16T22:37:58.302619] [DEBUG] [LOCAL ] FTI: Loaded 53685 existing records from primary storage. [2025-10-16T22:37:58.406136] [INFO ] [MAIN ] FTI: Loaded 53685 primary data records. [2025-10-16T22:37:58.975464] [DEBUG] [MAIN ] FTHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:58.976494] [INFO ] [MAIN ] FTHY: Generated 1807 derivative records from 12446 primary records. [2025-10-16T22:37:58.978248] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-16T22:37:59.013122] [DEBUG] [MAIN ] FTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:59.012294] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1807 records). [2025-10-16T22:37:59.013946] [INFO ] [MAIN ] FTK: Generated 1807 derivative records from 33095 primary records. [2025-10-16T22:37:59.014042] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-16T22:37:59.015394] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-16T22:37:59.018617] [INFO ] [MAIN ] Derivative Progress: 721/1803 symbols completed. FTHY took 1.1s. Estimated remaining: 6m 58s. Rate: 155.5 symbols/min [2025-10-16T22:37:59.025980] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:59.049064] [DEBUG] [LOCAL ] FTK: Derivative data saved (1807 records). [2025-10-16T22:37:59.048580] [DEBUG] [MAIN ] FTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:37:59.049986] [INFO ] [MAIN ] FTI: Generated 1807 derivative records from 53685 primary records. [2025-10-16T22:37:59.050167] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-16T22:37:59.050271] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-16T22:37:59.052847] [INFO ] [MAIN ] Derivative Progress: 722/1803 symbols completed. FTK took 1.1s. Estimated remaining: 6m 57s. Rate: 155.7 symbols/min [2025-10-16T22:37:59.053468] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:59.069953] [DEBUG] [LOCAL ] FTI: Derivative data saved (1807 records). [2025-10-16T22:37:59.070139] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-16T22:37:59.072958] [INFO ] [MAIN ] Derivative Progress: 723/1803 symbols completed. FTI took 1.1s. Estimated remaining: 6m 56s. Rate: 155.9 symbols/min [2025-10-16T22:37:59.073198] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:37:59.077727] [DEBUG] [LOCAL ] FTWO: Loaded 1940 existing records from primary storage. [2025-10-16T22:37:59.087921] [INFO ] [MAIN ] FTWO: Loaded 1940 primary data records. [2025-10-16T22:37:59.201199] [DEBUG] [LOCAL ] FTS: Loaded 42838 existing records from primary storage. [2025-10-16T22:37:59.212160] [INFO ] [MAIN ] FTS: Loaded 42838 primary data records. [2025-10-16T22:37:59.596123] [DEBUG] [LOCAL ] FTV: Loaded 53454 existing records from primary storage. [2025-10-16T22:37:59.605899] [INFO ] [MAIN ] FTV: Loaded 53454 primary data records. [2025-10-16T22:38:00.076534] [DEBUG] [MAIN ] FTWO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:38:00.077863] [INFO ] [MAIN ] FTWO: Generated 1806 derivative records from 1940 primary records. [2025-10-16T22:38:00.078038] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-16T22:38:00.093632] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1806 records). [2025-10-16T22:38:00.097250] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-16T22:38:00.099615] [INFO ] [MAIN ] Derivative Progress: 724/1803 symbols completed. FTWO took 1.0s. Estimated remaining: 6m 56s. Rate: 155.5 symbols/min [2025-10-16T22:38:00.112019] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:00.112666] [DEBUG] [MAIN ] FTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:00.113689] [INFO ] [MAIN ] FTS: Generated 1807 derivative records from 42838 primary records. [2025-10-16T22:38:00.113905] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-16T22:38:00.130604] [DEBUG] [LOCAL ] FTS: Derivative data saved (1807 records). [2025-10-16T22:38:00.131001] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-16T22:38:00.133332] [INFO ] [MAIN ] Derivative Progress: 725/1803 symbols completed. FTS took 1.1s. Estimated remaining: 6m 55s. Rate: 155.7 symbols/min [2025-10-16T22:38:00.133807] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:00.150425] [DEBUG] [MAIN ] FTV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:00.151206] [INFO ] [MAIN ] FTV: Generated 1807 derivative records from 53454 primary records. [2025-10-16T22:38:00.151323] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-16T22:38:00.167228] [DEBUG] [LOCAL ] FTV: Derivative data saved (1807 records). [2025-10-16T22:38:00.167489] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-16T22:38:00.170595] [INFO ] [MAIN ] Derivative Progress: 726/1803 symbols completed. FTV took 1.1s. Estimated remaining: 6m 54s. Rate: 155.9 symbols/min [2025-10-16T22:38:00.184826] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:00.223387] [DEBUG] [LOCAL ] FUBO: Loaded 54108 existing records from primary storage. [2025-10-16T22:38:00.223754] [INFO ] [MAIN ] FUBO: Loaded 54108 primary data records. [2025-10-16T22:38:00.224258] [DEBUG] [LOCAL ] FUL: Loaded 32565 existing records from primary storage. [2025-10-16T22:38:00.224389] [INFO ] [MAIN ] FUL: Loaded 32565 primary data records. [2025-10-16T22:38:00.589745] [DEBUG] [LOCAL ] FUN: Loaded 52299 existing records from primary storage. [2025-10-16T22:38:00.602808] [INFO ] [MAIN ] FUN: Loaded 52299 primary data records. [2025-10-16T22:38:01.210897] [DEBUG] [MAIN ] FUL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:01.213556] [INFO ] [MAIN ] FUL: Generated 1807 derivative records from 32565 primary records. [2025-10-16T22:38:01.213922] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-16T22:38:01.243302] [DEBUG] [LOCAL ] FUL: Derivative data saved (1807 records). [2025-10-16T22:38:01.243537] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-16T22:38:01.242852] [DEBUG] [MAIN ] FUBO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:01.244392] [INFO ] [MAIN ] FUBO: Generated 1807 derivative records from 54108 primary records. [2025-10-16T22:38:01.246810] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-16T22:38:01.246604] [INFO ] [MAIN ] Derivative Progress: 727/1803 symbols completed. FUL took 1.1s. Estimated remaining: 6m 55s. Rate: 155.5 symbols/min [2025-10-16T22:38:01.246944] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:01.279870] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1807 records). [2025-10-16T22:38:01.285083] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-16T22:38:01.285356] [DEBUG] [MAIN ] FUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:01.286161] [INFO ] [MAIN ] FUN: Generated 1807 derivative records from 52299 primary records. [2025-10-16T22:38:01.289486] [INFO ] [MAIN ] Derivative Progress: 728/1803 symbols completed. FUBO took 1.2s. Estimated remaining: 6m 54s. Rate: 155.7 symbols/min [2025-10-16T22:38:01.289736] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-16T22:38:01.291305] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:01.310609] [DEBUG] [LOCAL ] FVR: Loaded 21309 existing records from primary storage. [2025-10-16T22:38:01.312224] [INFO ] [MAIN ] FVR: Loaded 21309 primary data records. [2025-10-16T22:38:01.360946] [DEBUG] [LOCAL ] FUN: Derivative data saved (1807 records). [2025-10-16T22:38:01.383875] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-16T22:38:01.386999] [INFO ] [MAIN ] Derivative Progress: 729/1803 symbols completed. FUN took 1.2s. Estimated remaining: 6m 53s. Rate: 155.9 symbols/min [2025-10-16T22:38:01.387176] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:01.453747] [DEBUG] [LOCAL ] FXED: Loaded 1251 existing records from primary storage. [2025-10-16T22:38:01.522499] [INFO ] [MAIN ] FXED: Loaded 1251 primary data records. [2025-10-16T22:38:01.715399] [DEBUG] [LOCAL ] FVRR: Loaded 40901 existing records from primary storage. [2025-10-16T22:38:01.728551] [INFO ] [MAIN ] FVRR: Loaded 40901 primary data records. [2025-10-16T22:38:02.297009] [DEBUG] [MAIN ] FVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:02.298683] [INFO ] [MAIN ] FVR: Generated 1807 derivative records from 21309 primary records. [2025-10-16T22:38:02.298960] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-16T22:38:02.318574] [DEBUG] [LOCAL ] FVR: Derivative data saved (1807 records). [2025-10-16T22:38:02.319490] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-16T22:38:02.321809] [INFO ] [MAIN ] Derivative Progress: 730/1803 symbols completed. FVR took 1.1s. Estimated remaining: 6m 54s. Rate: 155.6 symbols/min [2025-10-16T22:38:02.322469] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:02.335848] [DEBUG] [MAIN ] FXED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:02.336780] [INFO ] [MAIN ] FXED: Generated 1807 derivative records from 1251 primary records. [2025-10-16T22:38:02.337029] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-16T22:38:02.361962] [DEBUG] [LOCAL ] FXED: Derivative data saved (1807 records). [2025-10-16T22:38:02.367284] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-16T22:38:02.367208] [DEBUG] [MAIN ] FVRR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:02.370621] [INFO ] [MAIN ] Derivative Progress: 731/1803 symbols completed. FXED took 1.0s. Estimated remaining: 6m 53s. Rate: 155.7 symbols/min [2025-10-16T22:38:02.368045] [INFO ] [MAIN ] FVRR: Generated 1807 derivative records from 40901 primary records. [2025-10-16T22:38:02.370837] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-16T22:38:02.370959] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:02.388680] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1807 records). [2025-10-16T22:38:02.388941] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-16T22:38:02.391742] [INFO ] [MAIN ] Derivative Progress: 732/1803 symbols completed. FVRR took 1.1s. Estimated remaining: 6m 52s. Rate: 155.9 symbols/min [2025-10-16T22:38:02.403006] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:02.415423] [DEBUG] [LOCAL ] GAM: Loaded 3940 existing records from primary storage. [2025-10-16T22:38:02.415556] [INFO ] [MAIN ] GAM: Loaded 3940 primary data records. [2025-10-16T22:38:02.524055] [DEBUG] [LOCAL ] GAB: Loaded 27933 existing records from primary storage. [2025-10-16T22:38:02.535913] [INFO ] [MAIN ] GAB: Loaded 27933 primary data records. [2025-10-16T22:38:02.612225] [DEBUG] [LOCAL ] G: Loaded 50433 existing records from primary storage. [2025-10-16T22:38:02.671179] [INFO ] [MAIN ] G: Loaded 50433 primary data records. [2025-10-16T22:38:03.386416] [DEBUG] [MAIN ] GAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:03.387526] [INFO ] [MAIN ] GAM: Generated 1807 derivative records from 3940 primary records. [2025-10-16T22:38:03.387780] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-16T22:38:03.411672] [DEBUG] [MAIN ] GAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:03.414603] [INFO ] [MAIN ] GAB: Generated 1807 derivative records from 27933 primary records. [2025-10-16T22:38:03.415068] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-16T22:38:03.440719] [DEBUG] [LOCAL ] GAM: Derivative data saved (1807 records). [2025-10-16T22:38:03.441785] [DEBUG] [MAIN ] G: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:03.442595] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-16T22:38:03.446994] [INFO ] [MAIN ] G: Generated 1807 derivative records from 50433 primary records. [2025-10-16T22:38:03.447718] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-16T22:38:03.445677] [INFO ] [MAIN ] Derivative Progress: 733/1803 symbols completed. GAM took 1.0s. Estimated remaining: 6m 53s. Rate: 155.6 symbols/min [2025-10-16T22:38:03.462121] [DEBUG] [LOCAL ] GAB: Derivative data saved (1807 records). [2025-10-16T22:38:03.466346] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-16T22:38:03.470305] [INFO ] [MAIN ] Derivative Progress: 734/1803 symbols completed. GAB took 1.1s. Estimated remaining: 6m 52s. Rate: 155.8 symbols/min [2025-10-16T22:38:03.474439] [DEBUG] [LOCAL ] G: Derivative data saved (1807 records). [2025-10-16T22:38:03.474526] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-16T22:38:03.478027] [INFO ] [MAIN ] Derivative Progress: 735/1803 symbols completed. G took 1.2s. Estimated remaining: 6m 51s. Rate: 156.0 symbols/min [2025-10-16T22:38:03.478549] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:03.478499] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:03.479186] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:03.500542] [DEBUG] [LOCAL ] GBAB: Loaded 12918 existing records from primary storage. [2025-10-16T22:38:03.500715] [INFO ] [MAIN ] GBAB: Loaded 12918 primary data records. [2025-10-16T22:38:03.543638] [DEBUG] [LOCAL ] GATX: Loaded 18184 existing records from primary storage. [2025-10-16T22:38:03.578443] [INFO ] [MAIN ] GATX: Loaded 18184 primary data records. [2025-10-16T22:38:04.012904] [DEBUG] [LOCAL ] GAP: Loaded 54043 existing records from primary storage. [2025-10-16T22:38:04.134269] [INFO ] [MAIN ] GAP: Loaded 54043 primary data records. [2025-10-16T22:38:04.527659] [DEBUG] [MAIN ] GBAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:04.529016] [INFO ] [MAIN ] GBAB: Generated 1807 derivative records from 12918 primary records. [2025-10-16T22:38:04.528105] [DEBUG] [MAIN ] GATX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:04.529192] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-16T22:38:04.529798] [INFO ] [MAIN ] GATX: Generated 1807 derivative records from 18184 primary records. [2025-10-16T22:38:04.530197] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-16T22:38:04.560257] [DEBUG] [LOCAL ] GATX: Derivative data saved (1807 records). [2025-10-16T22:38:04.561571] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-16T22:38:04.566752] [INFO ] [MAIN ] Derivative Progress: 736/1803 symbols completed. GATX took 1.1s. Estimated remaining: 6m 51s. Rate: 155.6 symbols/min [2025-10-16T22:38:04.567108] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:04.567609] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1807 records). [2025-10-16T22:38:04.568153] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-16T22:38:04.570734] [INFO ] [MAIN ] Derivative Progress: 737/1803 symbols completed. GBAB took 1.1s. Estimated remaining: 6m 51s. Rate: 155.8 symbols/min [2025-10-16T22:38:04.571068] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:04.588109] [DEBUG] [MAIN ] GAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:04.588873] [INFO ] [MAIN ] GAP: Generated 1807 derivative records from 54043 primary records. [2025-10-16T22:38:04.588983] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-16T22:38:04.606151] [DEBUG] [LOCAL ] GAP: Derivative data saved (1807 records). [2025-10-16T22:38:04.606426] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-16T22:38:04.610881] [INFO ] [MAIN ] Derivative Progress: 738/1803 symbols completed. GAP took 1.1s. Estimated remaining: 6m 50s. Rate: 156.0 symbols/min [2025-10-16T22:38:04.611280] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:04.659914] [DEBUG] [LOCAL ] GBCI: Loaded 41242 existing records from primary storage. [2025-10-16T22:38:04.661344] [INFO ] [MAIN ] GBCI: Loaded 41242 primary data records. [2025-10-16T22:38:04.661242] [DEBUG] [LOCAL ] GBTG: Loaded 40545 existing records from primary storage. [2025-10-16T22:38:04.666996] [INFO ] [MAIN ] GBTG: Loaded 40545 primary data records. [2025-10-16T22:38:04.823786] [DEBUG] [LOCAL ] GBX: Loaded 29120 existing records from primary storage. [2025-10-16T22:38:04.842194] [INFO ] [MAIN ] GBX: Loaded 29120 primary data records. [2025-10-16T22:38:05.644374] [DEBUG] [MAIN ] GBTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:05.642485] [DEBUG] [MAIN ] GBCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:05.645332] [INFO ] [MAIN ] GBCI: Generated 1807 derivative records from 41242 primary records. [2025-10-16T22:38:05.646268] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-16T22:38:05.646149] [INFO ] [MAIN ] GBTG: Generated 1807 derivative records from 40545 primary records. [2025-10-16T22:38:05.647143] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-16T22:38:05.668332] [DEBUG] [MAIN ] GBX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:05.673303] [INFO ] [MAIN ] GBX: Generated 1807 derivative records from 29120 primary records. [2025-10-16T22:38:05.674929] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-16T22:38:05.692451] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1807 records). [2025-10-16T22:38:05.704166] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1807 records). [2025-10-16T22:38:05.703584] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-16T22:38:05.706443] [INFO ] [MAIN ] Derivative Progress: 739/1803 symbols completed. GBTG took 1.1s. Estimated remaining: 6m 50s. Rate: 155.6 symbols/min [2025-10-16T22:38:05.710395] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:05.706536] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-16T22:38:05.713271] [INFO ] [MAIN ] Derivative Progress: 740/1803 symbols completed. GBCI took 1.1s. Estimated remaining: 6m 49s. Rate: 155.8 symbols/min [2025-10-16T22:38:05.714338] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:05.720054] [DEBUG] [LOCAL ] GBX: Derivative data saved (1807 records). [2025-10-16T22:38:05.720235] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-16T22:38:05.723611] [INFO ] [MAIN ] Derivative Progress: 741/1803 symbols completed. GBX took 1.1s. Estimated remaining: 6m 48s. Rate: 156.0 symbols/min [2025-10-16T22:38:05.723988] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:05.781195] [DEBUG] [LOCAL ] GCTS: Loaded 20570 existing records from primary storage. [2025-10-16T22:38:05.782178] [INFO ] [MAIN ] GCTS: Loaded 20570 primary data records. [2025-10-16T22:38:05.782092] [DEBUG] [LOCAL ] GCO: Loaded 23761 existing records from primary storage. [2025-10-16T22:38:05.782325] [INFO ] [MAIN ] GCO: Loaded 23761 primary data records. [2025-10-16T22:38:05.783035] [DEBUG] [LOCAL ] GCI: Loaded 44182 existing records from primary storage. [2025-10-16T22:38:05.882154] [INFO ] [MAIN ] GCI: Loaded 44182 primary data records. [2025-10-16T22:38:06.788858] [DEBUG] [MAIN ] GCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:06.794986] [INFO ] [MAIN ] GCO: Generated 1807 derivative records from 23761 primary records. [2025-10-16T22:38:06.794164] [DEBUG] [MAIN ] GCTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:06.795769] [INFO ] [MAIN ] GCTS: Generated 1807 derivative records from 20570 primary records. [2025-10-16T22:38:06.796002] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-16T22:38:06.796066] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-16T22:38:06.830160] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1807 records). [2025-10-16T22:38:06.845098] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-16T22:38:06.848283] [INFO ] [MAIN ] Derivative Progress: 742/1803 symbols completed. GCTS took 1.1s. Estimated remaining: 6m 49s. Rate: 155.6 symbols/min [2025-10-16T22:38:06.848471] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:06.844947] [DEBUG] [LOCAL ] GCO: Derivative data saved (1807 records). [2025-10-16T22:38:06.848632] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-10-16T22:38:06.849095] [DEBUG] [MAIN ] GCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:06.850771] [INFO ] [MAIN ] GCI: Generated 1807 derivative records from 44182 primary records. [2025-10-16T22:38:06.850904] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-16T22:38:06.853147] [INFO ] [MAIN ] Derivative Progress: 743/1803 symbols completed. GCO took 1.1s. Estimated remaining: 6m 48s. Rate: 155.8 symbols/min [2025-10-16T22:38:06.867716] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:06.884264] [DEBUG] [LOCAL ] GCI: Derivative data saved (1807 records). [2025-10-16T22:38:06.884160] [DEBUG] [LOCAL ] GCV: Loaded 7864 existing records from primary storage. [2025-10-16T22:38:06.884564] [INFO ] [MAIN ] GCV: Loaded 7864 primary data records. [2025-10-16T22:38:06.884741] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-16T22:38:06.893699] [INFO ] [MAIN ] Derivative Progress: 744/1803 symbols completed. GCI took 1.2s. Estimated remaining: 6m 47s. Rate: 156.0 symbols/min [2025-10-16T22:38:06.908864] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:07.250026] [DEBUG] [LOCAL ] GD: Loaded 47051 existing records from primary storage. [2025-10-16T22:38:07.263636] [INFO ] [MAIN ] GD: Loaded 47051 primary data records. [2025-10-16T22:38:07.287290] [DEBUG] [LOCAL ] GDDY: Loaded 50151 existing records from primary storage. [2025-10-16T22:38:07.324024] [INFO ] [MAIN ] GDDY: Loaded 50151 primary data records. [2025-10-16T22:38:07.750009] [DEBUG] [MAIN ] GCV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:07.872611] [INFO ] [MAIN ] GCV: Generated 1807 derivative records from 7864 primary records. [2025-10-16T22:38:07.887003] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-16T22:38:07.907564] [DEBUG] [LOCAL ] GCV: Derivative data saved (1807 records). [2025-10-16T22:38:07.908423] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-16T22:38:07.910961] [INFO ] [MAIN ] Derivative Progress: 745/1803 symbols completed. GCV took 1.1s. Estimated remaining: 6m 48s. Rate: 155.7 symbols/min [2025-10-16T22:38:07.911292] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:07.931131] [DEBUG] [MAIN ] GD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:07.932338] [INFO ] [MAIN ] GD: Generated 1807 derivative records from 47051 primary records. [2025-10-16T22:38:07.935060] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-16T22:38:07.936400] [DEBUG] [LOCAL ] GDIV: Loaded 3621 existing records from primary storage. [2025-10-16T22:38:07.944283] [INFO ] [MAIN ] GDIV: Loaded 3621 primary data records. [2025-10-16T22:38:08.004098] [DEBUG] [LOCAL ] GD: Derivative data saved (1807 records). [2025-10-16T22:38:08.025633] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-16T22:38:08.051664] [INFO ] [MAIN ] Derivative Progress: 746/1803 symbols completed. GD took 1.2s. Estimated remaining: 6m 47s. Rate: 155.8 symbols/min [2025-10-16T22:38:08.062769] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:08.070557] [DEBUG] [MAIN ] GDDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:08.075580] [INFO ] [MAIN ] GDDY: Generated 1807 derivative records from 50151 primary records. [2025-10-16T22:38:08.075739] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-16T22:38:08.119230] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1807 records). [2025-10-16T22:38:08.144476] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-16T22:38:08.147348] [INFO ] [MAIN ] Derivative Progress: 747/1803 symbols completed. GDDY took 1.2s. Estimated remaining: 6m 46s. Rate: 156.0 symbols/min [2025-10-16T22:38:08.181589] [DEBUG] [LOCAL ] GDL: Loaded 2541 existing records from primary storage. [2025-10-16T22:38:08.181874] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:08.223911] [INFO ] [MAIN ] GDL: Loaded 2541 primary data records. [2025-10-16T22:38:08.448861] [DEBUG] [LOCAL ] GDO: Loaded 5863 existing records from primary storage. [2025-10-16T22:38:08.454775] [INFO ] [MAIN ] GDO: Loaded 5863 primary data records. [2025-10-16T22:38:08.957191] [DEBUG] [MAIN ] GDIV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:38:08.959088] [INFO ] [MAIN ] GDIV: Generated 1806 derivative records from 3621 primary records. [2025-10-16T22:38:08.959574] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-16T22:38:08.977055] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1806 records). [2025-10-16T22:38:08.979029] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-16T22:38:08.981852] [INFO ] [MAIN ] Derivative Progress: 748/1803 symbols completed. GDIV took 1.1s. Estimated remaining: 6m 47s. Rate: 155.7 symbols/min [2025-10-16T22:38:08.996564] [DEBUG] [MAIN ] GDL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:08.997376] [INFO ] [MAIN ] GDL: Generated 1807 derivative records from 2541 primary records. [2025-10-16T22:38:08.997518] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-16T22:38:09.013003] [DEBUG] [LOCAL ] GDL: Derivative data saved (1807 records). [2025-10-16T22:38:09.013086] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-16T22:38:09.015796] [INFO ] [MAIN ] Derivative Progress: 749/1803 symbols completed. GDL took 1.0s. Estimated remaining: 6m 46s. Rate: 155.9 symbols/min [2025-10-16T22:38:09.028293] [DEBUG] [MAIN ] GDO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:09.028884] [INFO ] [MAIN ] GDO: Generated 1807 derivative records from 5863 primary records. [2025-10-16T22:38:09.028956] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-16T22:38:09.042759] [DEBUG] [LOCAL ] GDO: Derivative data saved (1807 records). [2025-10-16T22:38:09.042816] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-16T22:38:09.045733] [INFO ] [MAIN ] Derivative Progress: 750/1803 symbols completed. GDO took 0.9s. Estimated remaining: 6m 45s. Rate: 156.1 symbols/min [2025-10-16T22:38:09.046264] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:09.046505] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:09.046417] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:09.067616] [DEBUG] [LOCAL ] GDV: Loaded 19620 existing records from primary storage. [2025-10-16T22:38:09.067799] [INFO ] [MAIN ] GDV: Loaded 19620 primary data records. [2025-10-16T22:38:09.280528] [DEBUG] [LOCAL ] GDOT: Loaded 38078 existing records from primary storage. [2025-10-16T22:38:09.393769] [INFO ] [MAIN ] GDOT: Loaded 38078 primary data records. [2025-10-16T22:38:09.445621] [DEBUG] [LOCAL ] GE: Loaded 54088 existing records from primary storage. [2025-10-16T22:38:09.472318] [INFO ] [MAIN ] GE: Loaded 54088 primary data records. [2025-10-16T22:38:10.022406] [DEBUG] [MAIN ] GDV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:10.023308] [INFO ] [MAIN ] GDV: Generated 1807 derivative records from 19620 primary records. [2025-10-16T22:38:10.023426] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-16T22:38:10.042770] [DEBUG] [LOCAL ] GDV: Derivative data saved (1807 records). [2025-10-16T22:38:10.042961] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-16T22:38:10.045366] [INFO ] [MAIN ] Derivative Progress: 751/1803 symbols completed. GDV took 1.0s. Estimated remaining: 6m 45s. Rate: 155.8 symbols/min [2025-10-16T22:38:10.045620] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:10.064242] [DEBUG] [MAIN ] GDOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:10.076615] [INFO ] [MAIN ] GDOT: Generated 1807 derivative records from 38078 primary records. [2025-10-16T22:38:10.076860] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-16T22:38:10.077459] [DEBUG] [MAIN ] GE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:10.083202] [INFO ] [MAIN ] GE: Generated 1807 derivative records from 54088 primary records. [2025-10-16T22:38:10.083501] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-16T22:38:10.114950] [DEBUG] [LOCAL ] GEF: Loaded 20966 existing records from primary storage. [2025-10-16T22:38:10.116942] [INFO ] [MAIN ] GEF: Loaded 20966 primary data records. [2025-10-16T22:38:10.139681] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1807 records). [2025-10-16T22:38:10.139795] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-16T22:38:10.152929] [INFO ] [MAIN ] Derivative Progress: 752/1803 symbols completed. GDOT took 1.1s. Estimated remaining: 6m 44s. Rate: 155.9 symbols/min [2025-10-16T22:38:10.158436] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:10.203880] [DEBUG] [LOCAL ] GE: Derivative data saved (1807 records). [2025-10-16T22:38:10.224707] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-16T22:38:10.227482] [INFO ] [MAIN ] Derivative Progress: 753/1803 symbols completed. GE took 1.2s. Estimated remaining: 6m 44s. Rate: 156.1 symbols/min [2025-10-16T22:38:10.228075] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:10.462058] [DEBUG] [LOCAL ] GEL: Loaded 31983 existing records from primary storage. [2025-10-16T22:38:10.462342] [INFO ] [MAIN ] GEL: Loaded 31983 primary data records. [2025-10-16T22:38:10.773831] [DEBUG] [LOCAL ] GENI: Loaded 53328 existing records from primary storage. [2025-10-16T22:38:10.787744] [INFO ] [MAIN ] GENI: Loaded 53328 primary data records. [2025-10-16T22:38:10.951893] [DEBUG] [MAIN ] GEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:10.990834] [INFO ] [MAIN ] GEF: Generated 1807 derivative records from 20966 primary records. [2025-10-16T22:38:11.097923] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-16T22:38:11.127453] [DEBUG] [LOCAL ] GEF: Derivative data saved (1807 records). [2025-10-16T22:38:11.127770] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-16T22:38:11.130262] [INFO ] [MAIN ] Derivative Progress: 754/1803 symbols completed. GEF took 1.1s. Estimated remaining: 6m 44s. Rate: 155.8 symbols/min [2025-10-16T22:38:11.130549] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:11.143476] [DEBUG] [MAIN ] GEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:11.144183] [INFO ] [MAIN ] GEL: Generated 1807 derivative records from 31983 primary records. [2025-10-16T22:38:11.145144] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-16T22:38:11.162803] [DEBUG] [LOCAL ] GEL: Derivative data saved (1807 records). [2025-10-16T22:38:11.163160] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-10-16T22:38:11.166351] [INFO ] [MAIN ] Derivative Progress: 755/1803 symbols completed. GEL took 1.0s. Estimated remaining: 6m 43s. Rate: 156.0 symbols/min [2025-10-16T22:38:11.166505] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:11.182125] [DEBUG] [MAIN ] GENI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:11.182995] [INFO ] [MAIN ] GENI: Generated 1807 derivative records from 53328 primary records. [2025-10-16T22:38:11.183214] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-16T22:38:11.213674] [DEBUG] [LOCAL ] GENI: Derivative data saved (1807 records). [2025-10-16T22:38:11.213922] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-16T22:38:11.217720] [INFO ] [MAIN ] Derivative Progress: 756/1803 symbols completed. GENI took 1.0s. Estimated remaining: 6m 42s. Rate: 156.2 symbols/min [2025-10-16T22:38:11.218040] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:11.243907] [DEBUG] [LOCAL ] GEO: Loaded 52187 existing records from primary storage. [2025-10-16T22:38:11.244103] [INFO ] [MAIN ] GEO: Loaded 52187 primary data records. [2025-10-16T22:38:11.366749] [DEBUG] [LOCAL ] GES: Loaded 38584 existing records from primary storage. [2025-10-16T22:38:11.367210] [INFO ] [MAIN ] GES: Loaded 38584 primary data records. [2025-10-16T22:38:11.644577] [DEBUG] [LOCAL ] GETY: Loaded 35351 existing records from primary storage. [2025-10-16T22:38:11.670702] [INFO ] [MAIN ] GETY: Loaded 35351 primary data records. [2025-10-16T22:38:12.250936] [DEBUG] [MAIN ] GEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:12.251954] [INFO ] [MAIN ] GEO: Generated 1807 derivative records from 52187 primary records. [2025-10-16T22:38:12.253365] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-16T22:38:12.273023] [DEBUG] [LOCAL ] GEO: Derivative data saved (1807 records). [2025-10-16T22:38:12.285841] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-16T22:38:12.288296] [INFO ] [MAIN ] Derivative Progress: 757/1803 symbols completed. GEO took 1.2s. Estimated remaining: 6m 43s. Rate: 155.8 symbols/min [2025-10-16T22:38:12.286145] [DEBUG] [MAIN ] GES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:12.289384] [INFO ] [MAIN ] GES: Generated 1807 derivative records from 38584 primary records. [2025-10-16T22:38:12.289846] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-16T22:38:12.289781] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:12.308877] [DEBUG] [LOCAL ] GES: Derivative data saved (1807 records). [2025-10-16T22:38:12.309232] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-16T22:38:12.312361] [INFO ] [MAIN ] Derivative Progress: 758/1803 symbols completed. GES took 1.1s. Estimated remaining: 6m 42s. Rate: 156.0 symbols/min [2025-10-16T22:38:12.313671] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:12.330524] [DEBUG] [MAIN ] GETY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:12.331561] [INFO ] [MAIN ] GETY: Generated 1807 derivative records from 35351 primary records. [2025-10-16T22:38:12.331832] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-16T22:38:12.334991] [DEBUG] [LOCAL ] GF: Loaded 2700 existing records from primary storage. [2025-10-16T22:38:12.335477] [INFO ] [MAIN ] GF: Loaded 2700 primary data records. [2025-10-16T22:38:12.454497] [DEBUG] [LOCAL ] GETY: Derivative data saved (1807 records). [2025-10-16T22:38:12.468220] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-16T22:38:12.510719] [INFO ] [MAIN ] Derivative Progress: 759/1803 symbols completed. GETY took 1.3s. Estimated remaining: 6m 41s. Rate: 156.1 symbols/min [2025-10-16T22:38:12.533555] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:12.702170] [DEBUG] [LOCAL ] GEV: Loaded 53389 existing records from primary storage. [2025-10-16T22:38:12.703805] [INFO ] [MAIN ] GEV: Loaded 53389 primary data records. [2025-10-16T22:38:13.007831] [DEBUG] [LOCAL ] GFF: Loaded 30148 existing records from primary storage. [2025-10-16T22:38:13.022511] [INFO ] [MAIN ] GFF: Loaded 30148 primary data records. [2025-10-16T22:38:13.331291] [DEBUG] [MAIN ] GF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:13.342565] [INFO ] [MAIN ] GF: Generated 1807 derivative records from 2700 primary records. [2025-10-16T22:38:13.343049] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-16T22:38:13.364743] [DEBUG] [LOCAL ] GF: Derivative data saved (1807 records). [2025-10-16T22:38:13.365278] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-16T22:38:13.380527] [INFO ] [MAIN ] Derivative Progress: 760/1803 symbols completed. GF took 1.1s. Estimated remaining: 6m 42s. Rate: 155.8 symbols/min [2025-10-16T22:38:13.381782] [DEBUG] [MAIN ] GEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:13.381907] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:13.383432] [INFO ] [MAIN ] GEV: Generated 1807 derivative records from 53389 primary records. [2025-10-16T22:38:13.383729] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-16T22:38:13.401851] [DEBUG] [LOCAL ] GEV: Derivative data saved (1807 records). [2025-10-16T22:38:13.402137] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-16T22:38:13.404939] [INFO ] [MAIN ] Derivative Progress: 761/1803 symbols completed. GEV took 1.1s. Estimated remaining: 6m 41s. Rate: 156.0 symbols/min [2025-10-16T22:38:13.405322] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:13.424733] [DEBUG] [MAIN ] GFF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:13.425706] [INFO ] [MAIN ] GFF: Generated 1807 derivative records from 30148 primary records. [2025-10-16T22:38:13.425968] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-16T22:38:13.444571] [DEBUG] [LOCAL ] GFF: Derivative data saved (1807 records). [2025-10-16T22:38:13.444924] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-16T22:38:13.447846] [INFO ] [MAIN ] Derivative Progress: 762/1803 symbols completed. GFF took 0.9s. Estimated remaining: 6m 40s. Rate: 156.2 symbols/min [2025-10-16T22:38:13.464140] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:13.495504] [DEBUG] [LOCAL ] GFI: Loaded 53505 existing records from primary storage. [2025-10-16T22:38:13.499794] [DEBUG] [LOCAL ] GFR: Loaded 7789 existing records from primary storage. [2025-10-16T22:38:13.499998] [INFO ] [MAIN ] GFI: Loaded 53505 primary data records. [2025-10-16T22:38:13.500296] [INFO ] [MAIN ] GFR: Loaded 7789 primary data records. [2025-10-16T22:38:13.691925] [DEBUG] [LOCAL ] GFL: Loaded 48000 existing records from primary storage. [2025-10-16T22:38:13.711426] [INFO ] [MAIN ] GFL: Loaded 48000 primary data records. [2025-10-16T22:38:14.530997] [DEBUG] [MAIN ] GFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:14.531259] [DEBUG] [MAIN ] GFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:14.534179] [INFO ] [MAIN ] GFI: Generated 1807 derivative records from 53505 primary records. [2025-10-16T22:38:14.533382] [INFO ] [MAIN ] GFR: Generated 1807 derivative records from 7789 primary records. [2025-10-16T22:38:14.535836] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-16T22:38:14.536618] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-16T22:38:14.570114] [DEBUG] [MAIN ] GFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:14.583170] [DEBUG] [LOCAL ] GFR: Derivative data saved (1807 records). [2025-10-16T22:38:14.581980] [INFO ] [MAIN ] GFL: Generated 1807 derivative records from 48000 primary records. [2025-10-16T22:38:14.583510] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-16T22:38:14.586412] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-16T22:38:14.586303] [INFO ] [MAIN ] Derivative Progress: 763/1803 symbols completed. GFR took 1.1s. Estimated remaining: 6m 40s. Rate: 155.8 symbols/min [2025-10-16T22:38:14.583404] [DEBUG] [LOCAL ] GFI: Derivative data saved (1807 records). [2025-10-16T22:38:14.587513] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-16T22:38:14.598401] [INFO ] [MAIN ] Derivative Progress: 764/1803 symbols completed. GFI took 1.2s. Estimated remaining: 6m 40s. Rate: 156.0 symbols/min [2025-10-16T22:38:14.605410] [DEBUG] [LOCAL ] GFL: Derivative data saved (1807 records). [2025-10-16T22:38:14.605502] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-16T22:38:14.608136] [INFO ] [MAIN ] Derivative Progress: 765/1803 symbols completed. GFL took 1.2s. Estimated remaining: 6m 39s. Rate: 156.2 symbols/min [2025-10-16T22:38:14.608604] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:14.608782] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:14.608725] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:14.626560] [DEBUG] [LOCAL ] GGT: Loaded 14507 existing records from primary storage. [2025-10-16T22:38:14.626779] [INFO ] [MAIN ] GGT: Loaded 14507 primary data records. [2025-10-16T22:38:14.838427] [DEBUG] [LOCAL ] GGG: Loaded 40973 existing records from primary storage. [2025-10-16T22:38:14.958402] [INFO ] [MAIN ] GGG: Loaded 40973 primary data records. [2025-10-16T22:38:14.986214] [DEBUG] [LOCAL ] GGB: Loaded 51854 existing records from primary storage. [2025-10-16T22:38:15.008770] [INFO ] [MAIN ] GGB: Loaded 51854 primary data records. [2025-10-16T22:38:15.609672] [DEBUG] [MAIN ] GGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:15.611154] [INFO ] [MAIN ] GGT: Generated 1807 derivative records from 14507 primary records. [2025-10-16T22:38:15.611500] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-16T22:38:15.629615] [DEBUG] [LOCAL ] GGT: Derivative data saved (1807 records). [2025-10-16T22:38:15.630167] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-16T22:38:15.632524] [INFO ] [MAIN ] Derivative Progress: 766/1803 symbols completed. GGT took 1.0s. Estimated remaining: 6m 39s. Rate: 155.9 symbols/min [2025-10-16T22:38:15.632750] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:15.650465] [DEBUG] [MAIN ] GGG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:15.653435] [DEBUG] [LOCAL ] GGZ: Loaded 2437 existing records from primary storage. [2025-10-16T22:38:15.654233] [INFO ] [MAIN ] GGG: Generated 1807 derivative records from 40973 primary records. [2025-10-16T22:38:15.654333] [INFO ] [MAIN ] GGZ: Loaded 2437 primary data records. [2025-10-16T22:38:15.654495] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-16T22:38:15.800851] [DEBUG] [MAIN ] GGB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:15.813929] [INFO ] [MAIN ] GGB: Generated 1807 derivative records from 51854 primary records. [2025-10-16T22:38:15.829968] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-16T22:38:15.829854] [DEBUG] [LOCAL ] GGG: Derivative data saved (1807 records). [2025-10-16T22:38:15.864298] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-16T22:38:15.881324] [INFO ] [MAIN ] Derivative Progress: 767/1803 symbols completed. GGG took 1.3s. Estimated remaining: 6m 39s. Rate: 155.9 symbols/min [2025-10-16T22:38:16.006341] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:16.028415] [DEBUG] [LOCAL ] GHC: Loaded 2948 existing records from primary storage. [2025-10-16T22:38:16.025795] [DEBUG] [LOCAL ] GGB: Derivative data saved (1807 records). [2025-10-16T22:38:16.028845] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-10-16T22:38:16.028931] [INFO ] [MAIN ] GHC: Loaded 2948 primary data records. [2025-10-16T22:38:16.042455] [INFO ] [MAIN ] Derivative Progress: 768/1803 symbols completed. GGB took 1.4s. Estimated remaining: 6m 38s. Rate: 156.1 symbols/min [2025-10-16T22:38:16.086377] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:16.181020] [DEBUG] [LOCAL ] GHG: Loaded 3303 existing records from primary storage. [2025-10-16T22:38:16.186604] [INFO ] [MAIN ] GHG: Loaded 3303 primary data records. [2025-10-16T22:38:16.572635] [DEBUG] [MAIN ] GGZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:16.690508] [INFO ] [MAIN ] GGZ: Generated 1807 derivative records from 2437 primary records. [2025-10-16T22:38:16.691789] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-16T22:38:16.711498] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1807 records). [2025-10-16T22:38:16.711680] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-16T22:38:16.714071] [INFO ] [MAIN ] Derivative Progress: 769/1803 symbols completed. GGZ took 1.1s. Estimated remaining: 6m 38s. Rate: 155.9 symbols/min [2025-10-16T22:38:16.714543] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:16.733727] [DEBUG] [MAIN ] GHC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:38:16.734821] [INFO ] [MAIN ] GHC: Generated 1806 derivative records from 2948 primary records. [2025-10-16T22:38:16.734911] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-16T22:38:16.758617] [DEBUG] [LOCAL ] GHC: Derivative data saved (1806 records). [2025-10-16T22:38:16.759255] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-16T22:38:16.758920] [DEBUG] [LOCAL ] GHI: Loaded 7465 existing records from primary storage. [2025-10-16T22:38:16.761798] [INFO ] [MAIN ] Derivative Progress: 770/1803 symbols completed. GHC took 0.8s. Estimated remaining: 6m 37s. Rate: 156.1 symbols/min [2025-10-16T22:38:16.761930] [INFO ] [MAIN ] GHI: Loaded 7465 primary data records. [2025-10-16T22:38:16.762069] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:16.811907] [DEBUG] [MAIN ] GHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:16.820180] [INFO ] [MAIN ] GHG: Generated 1807 derivative records from 3303 primary records. [2025-10-16T22:38:16.841039] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-16T22:38:16.898251] [DEBUG] [LOCAL ] GHG: Derivative data saved (1807 records). [2025-10-16T22:38:16.894829] [DEBUG] [LOCAL ] GHLD: Loaded 4312 existing records from primary storage. [2025-10-16T22:38:16.904069] [INFO ] [MAIN ] GHLD: Loaded 4312 primary data records. [2025-10-16T22:38:16.921628] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-16T22:38:16.996826] [INFO ] [MAIN ] Derivative Progress: 771/1803 symbols completed. GHG took 0.9s. Estimated remaining: 6m 37s. Rate: 156.2 symbols/min [2025-10-16T22:38:17.062789] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:17.470829] [DEBUG] [LOCAL ] GHM: Loaded 14491 existing records from primary storage. [2025-10-16T22:38:17.471235] [INFO ] [MAIN ] GHM: Loaded 14491 primary data records. [2025-10-16T22:38:17.742985] [DEBUG] [MAIN ] GHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:17.752496] [INFO ] [MAIN ] GHI: Generated 1807 derivative records from 7465 primary records. [2025-10-16T22:38:17.820136] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-16T22:38:18.018038] [DEBUG] [MAIN ] GHLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:18.019964] [INFO ] [MAIN ] GHLD: Generated 1807 derivative records from 4312 primary records. [2025-10-16T22:38:18.020102] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-16T22:38:18.042917] [DEBUG] [LOCAL ] GHI: Derivative data saved (1807 records). [2025-10-16T22:38:18.046702] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-16T22:38:18.050253] [INFO ] [MAIN ] Derivative Progress: 772/1803 symbols completed. GHI took 1.3s. Estimated remaining: 6m 37s. Rate: 155.8 symbols/min [2025-10-16T22:38:18.051417] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:18.052723] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1807 records). [2025-10-16T22:38:18.052894] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-16T22:38:18.055452] [INFO ] [MAIN ] Derivative Progress: 773/1803 symbols completed. GHLD took 1.3s. Estimated remaining: 6m 36s. Rate: 156.0 symbols/min [2025-10-16T22:38:18.056563] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:18.097061] [DEBUG] [MAIN ] GHM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:18.106984] [INFO ] [MAIN ] GHM: Generated 1807 derivative records from 14491 primary records. [2025-10-16T22:38:18.107696] [DEBUG] [LOCAL ] GHY: Loaded 21076 existing records from primary storage. [2025-10-16T22:38:18.107780] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-16T22:38:18.117879] [INFO ] [MAIN ] GHY: Loaded 21076 primary data records. [2025-10-16T22:38:18.243939] [DEBUG] [LOCAL ] GIB: Loaded 31938 existing records from primary storage. [2025-10-16T22:38:18.255752] [INFO ] [MAIN ] GIB: Loaded 31938 primary data records. [2025-10-16T22:38:18.313671] [DEBUG] [LOCAL ] GHM: Derivative data saved (1807 records). [2025-10-16T22:38:18.371702] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-16T22:38:18.449126] [INFO ] [MAIN ] Derivative Progress: 774/1803 symbols completed. GHM took 1.4s. Estimated remaining: 6m 36s. Rate: 156.0 symbols/min [2025-10-16T22:38:18.572228] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:18.865421] [DEBUG] [LOCAL ] GIC: Loaded 13495 existing records from primary storage. [2025-10-16T22:38:18.865777] [INFO ] [MAIN ] GIC: Loaded 13495 primary data records. [2025-10-16T22:38:19.239367] [DEBUG] [MAIN ] GHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:19.241968] [INFO ] [MAIN ] GHY: Generated 1807 derivative records from 21076 primary records. [2025-10-16T22:38:19.242090] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-16T22:38:19.259686] [DEBUG] [LOCAL ] GHY: Derivative data saved (1807 records). [2025-10-16T22:38:19.259817] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-16T22:38:19.273991] [INFO ] [MAIN ] Derivative Progress: 775/1803 symbols completed. GHY took 1.2s. Estimated remaining: 6m 36s. Rate: 155.8 symbols/min [2025-10-16T22:38:19.275533] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:19.275446] [DEBUG] [MAIN ] GIB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:19.279633] [INFO ] [MAIN ] GIB: Generated 1807 derivative records from 31938 primary records. [2025-10-16T22:38:19.279878] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-16T22:38:19.296963] [DEBUG] [LOCAL ] GIB: Derivative data saved (1807 records). [2025-10-16T22:38:19.298579] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-16T22:38:19.301166] [INFO ] [MAIN ] Derivative Progress: 776/1803 symbols completed. GIB took 1.2s. Estimated remaining: 6m 35s. Rate: 156.0 symbols/min [2025-10-16T22:38:19.301356] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:19.315184] [DEBUG] [MAIN ] GIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:19.316039] [INFO ] [MAIN ] GIC: Generated 1807 derivative records from 13495 primary records. [2025-10-16T22:38:19.316203] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-16T22:38:19.341308] [DEBUG] [LOCAL ] GIC: Derivative data saved (1807 records). [2025-10-16T22:38:19.341564] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-16T22:38:19.344405] [INFO ] [MAIN ] Derivative Progress: 777/1803 symbols completed. GIC took 0.8s. Estimated remaining: 6m 34s. Rate: 156.1 symbols/min [2025-10-16T22:38:19.344721] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:19.362751] [DEBUG] [LOCAL ] GIL: Loaded 44162 existing records from primary storage. [2025-10-16T22:38:19.363151] [INFO ] [MAIN ] GIL: Loaded 44162 primary data records. [2025-10-16T22:38:19.713918] [DEBUG] [LOCAL ] GKOS: Loaded 42824 existing records from primary storage. [2025-10-16T22:38:19.714145] [INFO ] [MAIN ] GKOS: Loaded 42824 primary data records. [2025-10-16T22:38:19.714922] [DEBUG] [LOCAL ] GIS: Loaded 54063 existing records from primary storage. [2025-10-16T22:38:19.736686] [INFO ] [MAIN ] GIS: Loaded 54063 primary data records. [2025-10-16T22:38:20.368744] [DEBUG] [MAIN ] GIL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:20.369549] [INFO ] [MAIN ] GIL: Generated 1807 derivative records from 44162 primary records. [2025-10-16T22:38:20.369764] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-16T22:38:20.388908] [DEBUG] [LOCAL ] GIL: Derivative data saved (1807 records). [2025-10-16T22:38:20.389081] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-16T22:38:20.391505] [INFO ] [MAIN ] Derivative Progress: 778/1803 symbols completed. GIL took 1.1s. Estimated remaining: 6m 35s. Rate: 155.8 symbols/min [2025-10-16T22:38:20.407728] [DEBUG] [MAIN ] GIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:20.408408] [INFO ] [MAIN ] GIS: Generated 1807 derivative records from 54063 primary records. [2025-10-16T22:38:20.408687] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-16T22:38:20.437875] [DEBUG] [MAIN ] GKOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:20.439148] [DEBUG] [LOCAL ] GIS: Derivative data saved (1807 records). [2025-10-16T22:38:20.439875] [INFO ] [MAIN ] GKOS: Generated 1807 derivative records from 42824 primary records. [2025-10-16T22:38:20.439955] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-16T22:38:20.440008] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-16T22:38:20.442567] [INFO ] [MAIN ] Derivative Progress: 779/1803 symbols completed. GIS took 1.1s. Estimated remaining: 6m 34s. Rate: 156.0 symbols/min [2025-10-16T22:38:20.457740] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1807 records). [2025-10-16T22:38:20.457808] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-16T22:38:20.461118] [INFO ] [MAIN ] Derivative Progress: 780/1803 symbols completed. GKOS took 1.1s. Estimated remaining: 6m 33s. Rate: 156.2 symbols/min [2025-10-16T22:38:20.461511] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:20.461616] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:20.461660] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:20.475909] [DEBUG] [LOCAL ] GLP: Loaded 9346 existing records from primary storage. [2025-10-16T22:38:20.476201] [INFO ] [MAIN ] GLP: Loaded 9346 primary data records. [2025-10-16T22:38:20.616246] [DEBUG] [LOCAL ] GL: Loaded 37863 existing records from primary storage. [2025-10-16T22:38:20.640397] [INFO ] [MAIN ] GL: Loaded 37863 primary data records. [2025-10-16T22:38:20.950225] [DEBUG] [LOCAL ] GLOB: Loaded 48330 existing records from primary storage. [2025-10-16T22:38:20.960815] [INFO ] [MAIN ] GLOB: Loaded 48330 primary data records. [2025-10-16T22:38:21.483141] [DEBUG] [MAIN ] GLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:21.484487] [INFO ] [MAIN ] GLP: Generated 1807 derivative records from 9346 primary records. [2025-10-16T22:38:21.484690] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-16T22:38:21.502333] [DEBUG] [LOCAL ] GLP: Derivative data saved (1807 records). [2025-10-16T22:38:21.504252] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-16T22:38:21.507331] [INFO ] [MAIN ] Derivative Progress: 781/1803 symbols completed. GLP took 1.0s. Estimated remaining: 6m 34s. Rate: 155.8 symbols/min [2025-10-16T22:38:21.507936] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:21.521499] [DEBUG] [MAIN ] GL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:21.522284] [INFO ] [MAIN ] GL: Generated 1807 derivative records from 37863 primary records. [2025-10-16T22:38:21.522442] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-16T22:38:21.538938] [DEBUG] [LOCAL ] GL: Derivative data saved (1807 records). [2025-10-16T22:38:21.539071] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-16T22:38:21.541415] [INFO ] [MAIN ] Derivative Progress: 782/1803 symbols completed. GL took 1.1s. Estimated remaining: 6m 33s. Rate: 156.0 symbols/min [2025-10-16T22:38:21.543416] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:21.557974] [DEBUG] [MAIN ] GLOB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:21.558711] [INFO ] [MAIN ] GLOB: Generated 1807 derivative records from 48330 primary records. [2025-10-16T22:38:21.558840] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-16T22:38:21.575192] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1807 records). [2025-10-16T22:38:21.575603] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-16T22:38:21.578602] [INFO ] [MAIN ] Derivative Progress: 783/1803 symbols completed. GLOB took 1.1s. Estimated remaining: 6m 32s. Rate: 156.2 symbols/min [2025-10-16T22:38:21.596985] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:21.632731] [DEBUG] [LOCAL ] GLW: Loaded 54026 existing records from primary storage. [2025-10-16T22:38:21.632993] [INFO ] [MAIN ] GLW: Loaded 54026 primary data records. [2025-10-16T22:38:21.776465] [DEBUG] [LOCAL ] GM: Loaded 54119 existing records from primary storage. [2025-10-16T22:38:21.838347] [INFO ] [MAIN ] GM: Loaded 54119 primary data records. [2025-10-16T22:38:22.083169] [DEBUG] [LOCAL ] GME: Loaded 54171 existing records from primary storage. [2025-10-16T22:38:22.111746] [INFO ] [MAIN ] GME: Loaded 54171 primary data records. [2025-10-16T22:38:22.631896] [DEBUG] [MAIN ] GLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:22.633113] [INFO ] [MAIN ] GLW: Generated 1807 derivative records from 54026 primary records. [2025-10-16T22:38:22.633308] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-16T22:38:22.652846] [DEBUG] [LOCAL ] GLW: Derivative data saved (1807 records). [2025-10-16T22:38:22.654370] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-16T22:38:22.656856] [INFO ] [MAIN ] Derivative Progress: 784/1803 symbols completed. GLW took 1.1s. Estimated remaining: 6m 32s. Rate: 155.8 symbols/min [2025-10-16T22:38:22.657095] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:22.671937] [DEBUG] [MAIN ] GM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:22.673961] [INFO ] [MAIN ] GM: Generated 1807 derivative records from 54119 primary records. [2025-10-16T22:38:22.674208] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-16T22:38:22.695819] [DEBUG] [MAIN ] GME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:22.699150] [INFO ] [MAIN ] GME: Generated 1807 derivative records from 54171 primary records. [2025-10-16T22:38:22.702274] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-16T22:38:22.711455] [DEBUG] [LOCAL ] GM: Derivative data saved (1807 records). [2025-10-16T22:38:22.715244] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-16T22:38:22.717889] [INFO ] [MAIN ] Derivative Progress: 785/1803 symbols completed. GM took 1.2s. Estimated remaining: 6m 32s. Rate: 156.0 symbols/min [2025-10-16T22:38:22.718352] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:22.733174] [DEBUG] [LOCAL ] GME: Derivative data saved (1807 records). [2025-10-16T22:38:22.733353] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-16T22:38:22.736740] [INFO ] [MAIN ] Derivative Progress: 786/1803 symbols completed. GME took 1.1s. Estimated remaining: 6m 31s. Rate: 156.2 symbols/min [2025-10-16T22:38:22.737009] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:22.757778] [DEBUG] [LOCAL ] GMED: Loaded 48602 existing records from primary storage. [2025-10-16T22:38:22.769425] [INFO ] [MAIN ] GMED: Loaded 48602 primary data records. [2025-10-16T22:38:22.885835] [DEBUG] [LOCAL ] GNE: Loaded 18130 existing records from primary storage. [2025-10-16T22:38:22.889077] [INFO ] [MAIN ] GNE: Loaded 18130 primary data records. [2025-10-16T22:38:22.889747] [DEBUG] [LOCAL ] GMRE: Loaded 37278 existing records from primary storage. [2025-10-16T22:38:22.890196] [INFO ] [MAIN ] GMRE: Loaded 37278 primary data records. [2025-10-16T22:38:23.708734] [DEBUG] [MAIN ] GMED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:23.709525] [INFO ] [MAIN ] GMED: Generated 1807 derivative records from 48602 primary records. [2025-10-16T22:38:23.709803] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-16T22:38:23.772721] [DEBUG] [MAIN ] GNE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:23.772174] [DEBUG] [LOCAL ] GMED: Derivative data saved (1807 records). [2025-10-16T22:38:23.773273] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-16T22:38:23.776470] [INFO ] [MAIN ] GNE: Generated 1807 derivative records from 18130 primary records. [2025-10-16T22:38:23.776906] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-16T22:38:23.775515] [INFO ] [MAIN ] Derivative Progress: 787/1803 symbols completed. GMED took 1.1s. Estimated remaining: 6m 31s. Rate: 155.8 symbols/min [2025-10-16T22:38:23.778228] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:23.777407] [DEBUG] [MAIN ] GMRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:23.793482] [INFO ] [MAIN ] GMRE: Generated 1807 derivative records from 37278 primary records. [2025-10-16T22:38:23.795833] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-16T22:38:23.796339] [DEBUG] [LOCAL ] GNE: Derivative data saved (1807 records). [2025-10-16T22:38:23.796929] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-16T22:38:23.799859] [INFO ] [MAIN ] Derivative Progress: 788/1803 symbols completed. GNE took 1.1s. Estimated remaining: 6m 30s. Rate: 156.0 symbols/min [2025-10-16T22:38:23.800354] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:23.815870] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1807 records). [2025-10-16T22:38:23.816089] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-16T22:38:23.819763] [INFO ] [MAIN ] Derivative Progress: 789/1803 symbols completed. GMRE took 1.1s. Estimated remaining: 6m 29s. Rate: 156.2 symbols/min [2025-10-16T22:38:23.820417] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:23.850792] [DEBUG] [LOCAL ] GNK: Loaded 40280 existing records from primary storage. [2025-10-16T22:38:23.863331] [INFO ] [MAIN ] GNK: Loaded 40280 primary data records. [2025-10-16T22:38:24.011921] [DEBUG] [LOCAL ] GNL: Loaded 47059 existing records from primary storage. [2025-10-16T22:38:24.034141] [INFO ] [MAIN ] GNL: Loaded 47059 primary data records. [2025-10-16T22:38:24.251277] [DEBUG] [LOCAL ] GNRC: Loaded 45849 existing records from primary storage. [2025-10-16T22:38:24.273703] [INFO ] [MAIN ] GNRC: Loaded 45849 primary data records. [2025-10-16T22:38:24.856956] [DEBUG] [MAIN ] GNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:24.858563] [INFO ] [MAIN ] GNK: Generated 1807 derivative records from 40280 primary records. [2025-10-16T22:38:24.858855] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-16T22:38:24.877250] [DEBUG] [LOCAL ] GNK: Derivative data saved (1807 records). [2025-10-16T22:38:24.878496] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-16T22:38:24.881245] [INFO ] [MAIN ] Derivative Progress: 790/1803 symbols completed. GNK took 1.1s. Estimated remaining: 6m 30s. Rate: 155.9 symbols/min [2025-10-16T22:38:24.882300] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:24.897927] [DEBUG] [MAIN ] GNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:24.898795] [INFO ] [MAIN ] GNL: Generated 1807 derivative records from 47059 primary records. [2025-10-16T22:38:24.898943] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-16T22:38:24.919448] [DEBUG] [LOCAL ] GNL: Derivative data saved (1807 records). [2025-10-16T22:38:24.923511] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-16T22:38:24.926055] [INFO ] [MAIN ] Derivative Progress: 791/1803 symbols completed. GNL took 1.1s. Estimated remaining: 6m 29s. Rate: 156.0 symbols/min [2025-10-16T22:38:24.923893] [DEBUG] [LOCAL ] GNT: Loaded 8541 existing records from primary storage. [2025-10-16T22:38:24.926350] [INFO ] [MAIN ] GNT: Loaded 8541 primary data records. [2025-10-16T22:38:24.931619] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:24.985484] [DEBUG] [MAIN ] GNRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:25.013732] [INFO ] [MAIN ] GNRC: Generated 1807 derivative records from 45849 primary records. [2025-10-16T22:38:25.031739] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-16T22:38:25.146192] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1807 records). [2025-10-16T22:38:25.146438] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-16T22:38:25.254428] [INFO ] [MAIN ] Derivative Progress: 792/1803 symbols completed. GNRC took 1.4s. Estimated remaining: 6m 29s. Rate: 156.1 symbols/min [2025-10-16T22:38:25.268317] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:25.306238] [DEBUG] [LOCAL ] GNW: Loaded 51779 existing records from primary storage. [2025-10-16T22:38:25.306829] [INFO ] [MAIN ] GNW: Loaded 51779 primary data records. [2025-10-16T22:38:25.440060] [DEBUG] [MAIN ] GNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:25.483044] [INFO ] [MAIN ] GNT: Generated 1807 derivative records from 8541 primary records. [2025-10-16T22:38:25.504226] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-16T22:38:25.648888] [DEBUG] [LOCAL ] GOF: Loaded 42964 existing records from primary storage. [2025-10-16T22:38:25.649696] [INFO ] [MAIN ] GOF: Loaded 42964 primary data records. [2025-10-16T22:38:25.725069] [DEBUG] [LOCAL ] GNT: Derivative data saved (1807 records). [2025-10-16T22:38:25.750376] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-16T22:38:25.784166] [INFO ] [MAIN ] Derivative Progress: 793/1803 symbols completed. GNT took 0.9s. Estimated remaining: 6m 28s. Rate: 156.0 symbols/min [2025-10-16T22:38:26.040215] [DEBUG] [MAIN ] GNW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:26.042042] [INFO ] [MAIN ] GNW: Generated 1807 derivative records from 51779 primary records. [2025-10-16T22:38:26.042293] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-16T22:38:26.061606] [DEBUG] [LOCAL ] GNW: Derivative data saved (1807 records). [2025-10-16T22:38:26.061979] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-16T22:38:26.064737] [INFO ] [MAIN ] Derivative Progress: 794/1803 symbols completed. GNW took 1.1s. Estimated remaining: 6m 28s. Rate: 156.0 symbols/min [2025-10-16T22:38:26.083130] [DEBUG] [MAIN ] GOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:26.083827] [INFO ] [MAIN ] GOF: Generated 1807 derivative records from 42964 primary records. [2025-10-16T22:38:26.083892] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-16T22:38:26.100830] [DEBUG] [LOCAL ] GOF: Derivative data saved (1807 records). [2025-10-16T22:38:26.100902] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-16T22:38:26.103058] [INFO ] [MAIN ] Derivative Progress: 795/1803 symbols completed. GOF took 0.8s. Estimated remaining: 6m 27s. Rate: 156.2 symbols/min [2025-10-16T22:38:26.103446] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:26.103544] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:26.103676] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:26.157004] [DEBUG] [LOCAL ] GOLF: Loaded 31115 existing records from primary storage. [2025-10-16T22:38:26.168842] [INFO ] [MAIN ] GOLF: Loaded 31115 primary data records. [2025-10-16T22:38:26.169903] [DEBUG] [LOCAL ] GOTU: Loaded 37487 existing records from primary storage. [2025-10-16T22:38:26.187738] [INFO ] [MAIN ] GOTU: Loaded 37487 primary data records. [2025-10-16T22:38:26.339445] [DEBUG] [LOCAL ] GOOS: Loaded 44895 existing records from primary storage. [2025-10-16T22:38:26.383290] [INFO ] [MAIN ] GOOS: Loaded 44895 primary data records. [2025-10-16T22:38:27.175425] [DEBUG] [MAIN ] GOLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:27.184064] [INFO ] [MAIN ] GOLF: Generated 1807 derivative records from 31115 primary records. [2025-10-16T22:38:27.189750] [DEBUG] [MAIN ] GOTU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:27.190491] [INFO ] [MAIN ] GOTU: Generated 1807 derivative records from 37487 primary records. [2025-10-16T22:38:27.189425] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-16T22:38:27.190728] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-16T22:38:27.225437] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1807 records). [2025-10-16T22:38:27.226225] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-16T22:38:27.226043] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1807 records). [2025-10-16T22:38:27.229098] [INFO ] [MAIN ] Derivative Progress: 796/1803 symbols completed. GOTU took 1.1s. Estimated remaining: 6m 28s. Rate: 155.8 symbols/min [2025-10-16T22:38:27.241488] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-16T22:38:27.241335] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:27.243672] [INFO ] [MAIN ] Derivative Progress: 797/1803 symbols completed. GOLF took 1.1s. Estimated remaining: 6m 27s. Rate: 156.0 symbols/min [2025-10-16T22:38:27.243969] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:27.245124] [DEBUG] [MAIN ] GOOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:27.245914] [INFO ] [MAIN ] GOOS: Generated 1807 derivative records from 44895 primary records. [2025-10-16T22:38:27.246219] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-16T22:38:27.268535] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1807 records). [2025-10-16T22:38:27.268736] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-16T22:38:27.272798] [INFO ] [MAIN ] Derivative Progress: 798/1803 symbols completed. GOOS took 1.2s. Estimated remaining: 6m 26s. Rate: 156.2 symbols/min [2025-10-16T22:38:27.278494] [DEBUG] [LOCAL ] GPI: Loaded 15026 existing records from primary storage. [2025-10-16T22:38:27.278618] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:27.279182] [INFO ] [MAIN ] GPI: Loaded 15026 primary data records. [2025-10-16T22:38:27.340314] [DEBUG] [LOCAL ] GPJA: Loaded 4213 existing records from primary storage. [2025-10-16T22:38:27.364396] [INFO ] [MAIN ] GPJA: Loaded 4213 primary data records. [2025-10-16T22:38:27.731235] [DEBUG] [LOCAL ] GPC: Loaded 46350 existing records from primary storage. [2025-10-16T22:38:27.739523] [INFO ] [MAIN ] GPC: Loaded 46350 primary data records. [2025-10-16T22:38:28.295043] [DEBUG] [MAIN ] GPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:28.296379] [INFO ] [MAIN ] GPI: Generated 1807 derivative records from 15026 primary records. [2025-10-16T22:38:28.296516] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-16T22:38:28.332124] [DEBUG] [MAIN ] GPJA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:28.335372] [INFO ] [MAIN ] GPJA: Generated 1807 derivative records from 4213 primary records. [2025-10-16T22:38:28.336516] [DEBUG] [LOCAL ] GPI: Derivative data saved (1807 records). [2025-10-16T22:38:28.336239] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-16T22:38:28.337263] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-16T22:38:28.339848] [INFO ] [MAIN ] Derivative Progress: 799/1803 symbols completed. GPI took 1.1s. Estimated remaining: 6m 26s. Rate: 155.9 symbols/min [2025-10-16T22:38:28.340459] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:28.355477] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1807 records). [2025-10-16T22:38:28.355801] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-16T22:38:28.358862] [INFO ] [MAIN ] Derivative Progress: 800/1803 symbols completed. GPJA took 1.1s. Estimated remaining: 6m 26s. Rate: 156.0 symbols/min [2025-10-16T22:38:28.359195] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:28.376935] [DEBUG] [MAIN ] GPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:28.377802] [INFO ] [MAIN ] GPC: Generated 1807 derivative records from 46350 primary records. [2025-10-16T22:38:28.377897] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-16T22:38:28.394505] [DEBUG] [LOCAL ] GPC: Derivative data saved (1807 records). [2025-10-16T22:38:28.394796] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-10-16T22:38:28.397659] [INFO ] [MAIN ] Derivative Progress: 801/1803 symbols completed. GPC took 1.2s. Estimated remaining: 6m 25s. Rate: 156.2 symbols/min [2025-10-16T22:38:28.404962] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:28.417004] [DEBUG] [LOCAL ] GPMT: Loaded 26072 existing records from primary storage. [2025-10-16T22:38:28.430925] [INFO ] [MAIN ] GPMT: Loaded 26072 primary data records. [2025-10-16T22:38:28.565047] [DEBUG] [LOCAL ] GPK: Loaded 53165 existing records from primary storage. [2025-10-16T22:38:28.575611] [INFO ] [MAIN ] GPK: Loaded 53165 primary data records. [2025-10-16T22:38:28.875897] [DEBUG] [LOCAL ] GPN: Loaded 52372 existing records from primary storage. [2025-10-16T22:38:28.881221] [INFO ] [MAIN ] GPN: Loaded 52372 primary data records. [2025-10-16T22:38:29.389276] [DEBUG] [MAIN ] GPMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:29.390570] [INFO ] [MAIN ] GPMT: Generated 1807 derivative records from 26072 primary records. [2025-10-16T22:38:29.390804] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-16T22:38:29.422053] [DEBUG] [MAIN ] GPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:29.423773] [INFO ] [MAIN ] GPK: Generated 1807 derivative records from 53165 primary records. [2025-10-16T22:38:29.424124] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-16T22:38:29.426369] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1807 records). [2025-10-16T22:38:29.426775] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-16T22:38:29.429172] [INFO ] [MAIN ] Derivative Progress: 802/1803 symbols completed. GPMT took 1.1s. Estimated remaining: 6m 25s. Rate: 155.9 symbols/min [2025-10-16T22:38:29.438339] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:29.445942] [DEBUG] [LOCAL ] GPK: Derivative data saved (1807 records). [2025-10-16T22:38:29.446308] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-16T22:38:29.448923] [INFO ] [MAIN ] Derivative Progress: 803/1803 symbols completed. GPK took 1.1s. Estimated remaining: 6m 24s. Rate: 156.1 symbols/min [2025-10-16T22:38:29.449109] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:29.466154] [DEBUG] [MAIN ] GPN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:29.466944] [INFO ] [MAIN ] GPN: Generated 1807 derivative records from 52372 primary records. [2025-10-16T22:38:29.467070] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-16T22:38:29.484049] [DEBUG] [LOCAL ] GPN: Derivative data saved (1807 records). [2025-10-16T22:38:29.484281] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-16T22:38:29.487460] [INFO ] [MAIN ] Derivative Progress: 804/1803 symbols completed. GPN took 1.1s. Estimated remaining: 6m 24s. Rate: 156.3 symbols/min [2025-10-16T22:38:29.487776] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:29.520397] [DEBUG] [LOCAL ] GRBK: Loaded 27274 existing records from primary storage. [2025-10-16T22:38:29.520605] [INFO ] [MAIN ] GRBK: Loaded 27274 primary data records. [2025-10-16T22:38:29.601771] [DEBUG] [LOCAL ] GRC: Loaded 9376 existing records from primary storage. [2025-10-16T22:38:29.613984] [INFO ] [MAIN ] GRC: Loaded 9376 primary data records. [2025-10-16T22:38:29.620048] [DEBUG] [LOCAL ] GPRK: Loaded 40056 existing records from primary storage. [2025-10-16T22:38:29.647528] [INFO ] [MAIN ] GPRK: Loaded 40056 primary data records. [2025-10-16T22:38:30.604512] [DEBUG] [MAIN ] GRBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:30.605591] [INFO ] [MAIN ] GRBK: Generated 1807 derivative records from 27274 primary records. [2025-10-16T22:38:30.606034] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-16T22:38:30.655501] [DEBUG] [MAIN ] GRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:30.655703] [DEBUG] [MAIN ] GPRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:30.656627] [INFO ] [MAIN ] GRC: Generated 1807 derivative records from 9376 primary records. [2025-10-16T22:38:30.655857] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1807 records). [2025-10-16T22:38:30.657096] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-16T22:38:30.657537] [INFO ] [MAIN ] GPRK: Generated 1807 derivative records from 40056 primary records. [2025-10-16T22:38:30.657686] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-16T22:38:30.660886] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-16T22:38:30.660769] [INFO ] [MAIN ] Derivative Progress: 805/1803 symbols completed. GRBK took 1.2s. Estimated remaining: 6m 24s. Rate: 155.9 symbols/min [2025-10-16T22:38:30.662375] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:30.693978] [DEBUG] [LOCAL ] GRC: Derivative data saved (1807 records). [2025-10-16T22:38:30.694170] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-16T22:38:30.697505] [INFO ] [MAIN ] Derivative Progress: 806/1803 symbols completed. GRC took 1.2s. Estimated remaining: 6m 23s. Rate: 156.0 symbols/min [2025-10-16T22:38:30.703513] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:30.705861] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1807 records). [2025-10-16T22:38:30.705956] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-16T22:38:30.709554] [INFO ] [MAIN ] Derivative Progress: 807/1803 symbols completed. GPRK took 1.3s. Estimated remaining: 6m 23s. Rate: 156.2 symbols/min [2025-10-16T22:38:30.710482] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:30.718969] [DEBUG] [LOCAL ] GRDN: Loaded 21092 existing records from primary storage. [2025-10-16T22:38:30.719110] [INFO ] [MAIN ] GRDN: Loaded 21092 primary data records. [2025-10-16T22:38:31.066789] [DEBUG] [LOCAL ] GRND: Loaded 50505 existing records from primary storage. [2025-10-16T22:38:31.067679] [DEBUG] [LOCAL ] GRMN: Loaded 40670 existing records from primary storage. [2025-10-16T22:38:31.067787] [INFO ] [MAIN ] GRMN: Loaded 40670 primary data records. [2025-10-16T22:38:31.067165] [INFO ] [MAIN ] GRND: Loaded 50505 primary data records. [2025-10-16T22:38:31.697534] [DEBUG] [MAIN ] GRDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:31.699078] [INFO ] [MAIN ] GRDN: Generated 1807 derivative records from 21092 primary records. [2025-10-16T22:38:31.699488] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-16T22:38:31.727848] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1807 records). [2025-10-16T22:38:31.741607] [DEBUG] [MAIN ] GRND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:31.742596] [INFO ] [MAIN ] GRND: Generated 1807 derivative records from 50505 primary records. [2025-10-16T22:38:31.741720] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-16T22:38:31.742988] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-16T22:38:31.746833] [INFO ] [MAIN ] Derivative Progress: 808/1803 symbols completed. GRDN took 1.1s. Estimated remaining: 6m 23s. Rate: 155.9 symbols/min [2025-10-16T22:38:31.776871] [DEBUG] [MAIN ] GRMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:31.778469] [INFO ] [MAIN ] GRMN: Generated 1807 derivative records from 40670 primary records. [2025-10-16T22:38:31.778568] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-16T22:38:31.792354] [DEBUG] [LOCAL ] GRND: Derivative data saved (1807 records). [2025-10-16T22:38:31.792897] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-16T22:38:31.795804] [INFO ] [MAIN ] Derivative Progress: 809/1803 symbols completed. GRND took 1.1s. Estimated remaining: 6m 22s. Rate: 156.1 symbols/min [2025-10-16T22:38:31.799396] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1807 records). [2025-10-16T22:38:31.799456] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-16T22:38:31.802158] [INFO ] [MAIN ] Derivative Progress: 810/1803 symbols completed. GRMN took 1.1s. Estimated remaining: 6m 21s. Rate: 156.2 symbols/min [2025-10-16T22:38:31.802497] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:31.802675] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:31.802554] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:31.813362] [DEBUG] [LOCAL ] GRX: Loaded 4828 existing records from primary storage. [2025-10-16T22:38:31.813611] [INFO ] [MAIN ] GRX: Loaded 4828 primary data records. [2025-10-16T22:38:31.860733] [DEBUG] [LOCAL ] GROV: Loaded 8795 existing records from primary storage. [2025-10-16T22:38:31.910512] [INFO ] [MAIN ] GROV: Loaded 8795 primary data records. [2025-10-16T22:38:32.224214] [DEBUG] [LOCAL ] GRNT: Loaded 34222 existing records from primary storage. [2025-10-16T22:38:32.236889] [INFO ] [MAIN ] GRNT: Loaded 34222 primary data records. [2025-10-16T22:38:32.796844] [DEBUG] [MAIN ] GRX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:32.798503] [INFO ] [MAIN ] GRX: Generated 1807 derivative records from 4828 primary records. [2025-10-16T22:38:32.799197] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-16T22:38:32.831619] [DEBUG] [LOCAL ] GRX: Derivative data saved (1807 records). [2025-10-16T22:38:32.832229] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-16T22:38:32.832171] [DEBUG] [MAIN ] GROV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:32.835266] [INFO ] [MAIN ] GROV: Generated 1807 derivative records from 8795 primary records. [2025-10-16T22:38:32.835454] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-16T22:38:32.834465] [INFO ] [MAIN ] Derivative Progress: 811/1803 symbols completed. GRX took 1.0s. Estimated remaining: 6m 22s. Rate: 155.9 symbols/min [2025-10-16T22:38:32.843943] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:32.862846] [DEBUG] [LOCAL ] GROV: Derivative data saved (1807 records). [2025-10-16T22:38:32.863009] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-16T22:38:32.866388] [DEBUG] [MAIN ] GRNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:32.865961] [INFO ] [MAIN ] Derivative Progress: 812/1803 symbols completed. GROV took 1.1s. Estimated remaining: 6m 21s. Rate: 156.1 symbols/min [2025-10-16T22:38:32.866712] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:32.867467] [INFO ] [MAIN ] GRNT: Generated 1807 derivative records from 34222 primary records. [2025-10-16T22:38:32.867937] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-16T22:38:32.883998] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1807 records). [2025-10-16T22:38:32.884120] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-16T22:38:32.886990] [INFO ] [MAIN ] Derivative Progress: 813/1803 symbols completed. GRNT took 1.1s. Estimated remaining: 6m 20s. Rate: 156.3 symbols/min [2025-10-16T22:38:32.887196] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:32.921235] [DEBUG] [LOCAL ] GSBD: Loaded 39923 existing records from primary storage. [2025-10-16T22:38:32.921435] [INFO ] [MAIN ] GSBD: Loaded 39923 primary data records. [2025-10-16T22:38:33.131342] [DEBUG] [LOCAL ] GS: Loaded 52170 existing records from primary storage. [2025-10-16T22:38:33.171774] [INFO ] [MAIN ] GS: Loaded 52170 primary data records. [2025-10-16T22:38:33.370317] [DEBUG] [LOCAL ] GSK: Loaded 53895 existing records from primary storage. [2025-10-16T22:38:33.378673] [INFO ] [MAIN ] GSK: Loaded 53895 primary data records. [2025-10-16T22:38:33.914967] [DEBUG] [MAIN ] GSBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:33.916038] [INFO ] [MAIN ] GSBD: Generated 1807 derivative records from 39923 primary records. [2025-10-16T22:38:33.916453] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-16T22:38:33.934302] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1807 records). [2025-10-16T22:38:33.934551] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-16T22:38:33.937155] [INFO ] [MAIN ] Derivative Progress: 814/1803 symbols completed. GSBD took 1.1s. Estimated remaining: 6m 21s. Rate: 156.0 symbols/min [2025-10-16T22:38:33.937435] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:33.954927] [DEBUG] [MAIN ] GS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:33.955563] [INFO ] [MAIN ] GS: Generated 1807 derivative records from 52170 primary records. [2025-10-16T22:38:33.955709] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-16T22:38:33.974864] [DEBUG] [LOCAL ] GS: Derivative data saved (1807 records). [2025-10-16T22:38:33.975561] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-16T22:38:33.978064] [INFO ] [MAIN ] Derivative Progress: 815/1803 symbols completed. GS took 1.1s. Estimated remaining: 6m 20s. Rate: 156.1 symbols/min [2025-10-16T22:38:33.978532] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:33.999856] [DEBUG] [MAIN ] GSK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:34.000520] [INFO ] [MAIN ] GSK: Generated 1807 derivative records from 53895 primary records. [2025-10-16T22:38:34.000739] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-16T22:38:34.016766] [DEBUG] [LOCAL ] GSK: Derivative data saved (1807 records). [2025-10-16T22:38:34.026271] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-16T22:38:34.029444] [INFO ] [MAIN ] Derivative Progress: 816/1803 symbols completed. GSK took 1.1s. Estimated remaining: 6m 19s. Rate: 156.3 symbols/min [2025-10-16T22:38:34.029742] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:34.031680] [DEBUG] [LOCAL ] GSL: Loaded 33526 existing records from primary storage. [2025-10-16T22:38:34.031989] [INFO ] [MAIN ] GSL: Loaded 33526 primary data records. [2025-10-16T22:38:34.391553] [DEBUG] [LOCAL ] GTES: Loaded 50766 existing records from primary storage. [2025-10-16T22:38:34.392272] [INFO ] [MAIN ] GTES: Loaded 50766 primary data records. [2025-10-16T22:38:34.487409] [DEBUG] [LOCAL ] GTLS: Loaded 43612 existing records from primary storage. [2025-10-16T22:38:34.509298] [INFO ] [MAIN ] GTLS: Loaded 43612 primary data records. [2025-10-16T22:38:35.041627] [DEBUG] [MAIN ] GSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:35.043611] [INFO ] [MAIN ] GSL: Generated 1807 derivative records from 33526 primary records. [2025-10-16T22:38:35.044739] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-16T22:38:35.062251] [DEBUG] [LOCAL ] GSL: Derivative data saved (1807 records). [2025-10-16T22:38:35.062529] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-16T22:38:35.065670] [INFO ] [MAIN ] Derivative Progress: 817/1803 symbols completed. GSL took 1.1s. Estimated remaining: 6m 19s. Rate: 156.0 symbols/min [2025-10-16T22:38:35.066540] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:35.083827] [DEBUG] [MAIN ] GTES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:35.084795] [INFO ] [MAIN ] GTES: Generated 1807 derivative records from 50766 primary records. [2025-10-16T22:38:35.085053] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-16T22:38:35.103100] [DEBUG] [LOCAL ] GTES: Derivative data saved (1807 records). [2025-10-16T22:38:35.103835] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-16T22:38:35.106279] [INFO ] [MAIN ] Derivative Progress: 818/1803 symbols completed. GTES took 1.1s. Estimated remaining: 6m 19s. Rate: 156.1 symbols/min [2025-10-16T22:38:35.106476] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:35.120436] [DEBUG] [MAIN ] GTLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:35.121155] [INFO ] [MAIN ] GTLS: Generated 1807 derivative records from 43612 primary records. [2025-10-16T22:38:35.121359] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-16T22:38:35.148241] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1807 records). [2025-10-16T22:38:35.148365] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-16T22:38:35.151192] [INFO ] [MAIN ] Derivative Progress: 819/1803 symbols completed. GTLS took 1.1s. Estimated remaining: 6m 18s. Rate: 156.3 symbols/min [2025-10-16T22:38:35.151440] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:35.166707] [DEBUG] [LOCAL ] GTN: Loaded 45496 existing records from primary storage. [2025-10-16T22:38:35.175296] [INFO ] [MAIN ] GTN: Loaded 45496 primary data records. [2025-10-16T22:38:35.277841] [DEBUG] [LOCAL ] GUG: Loaded 12217 existing records from primary storage. [2025-10-16T22:38:35.291189] [INFO ] [MAIN ] GUG: Loaded 12217 primary data records. [2025-10-16T22:38:35.331433] [DEBUG] [LOCAL ] GTY: Loaded 30529 existing records from primary storage. [2025-10-16T22:38:35.348840] [INFO ] [MAIN ] GTY: Loaded 30529 primary data records. [2025-10-16T22:38:36.109087] [DEBUG] [MAIN ] GTN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:36.109971] [INFO ] [MAIN ] GTN: Generated 1807 derivative records from 45496 primary records. [2025-10-16T22:38:36.111041] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-16T22:38:36.136785] [DEBUG] [LOCAL ] GTN: Derivative data saved (1807 records). [2025-10-16T22:38:36.143158] [DEBUG] [MAIN ] GUG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:36.143880] [INFO ] [MAIN ] GUG: Generated 1807 derivative records from 12217 primary records. [2025-10-16T22:38:36.144074] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-16T22:38:36.146332] [INFO ] [MAIN ] Derivative Progress: 820/1803 symbols completed. GTN took 1.1s. Estimated remaining: 6m 18s. Rate: 156.0 symbols/min [2025-10-16T22:38:36.146462] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:36.144195] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-16T22:38:36.176215] [DEBUG] [MAIN ] GTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:36.175839] [DEBUG] [LOCAL ] GUG: Derivative data saved (1807 records). [2025-10-16T22:38:36.176415] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-16T22:38:36.180104] [INFO ] [MAIN ] Derivative Progress: 821/1803 symbols completed. GUG took 1.0s. Estimated remaining: 6m 17s. Rate: 156.2 symbols/min [2025-10-16T22:38:36.177141] [INFO ] [MAIN ] GTY: Generated 1807 derivative records from 30529 primary records. [2025-10-16T22:38:36.180344] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:36.184672] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-16T22:38:36.203555] [DEBUG] [LOCAL ] GUT: Loaded 15736 existing records from primary storage. [2025-10-16T22:38:36.203715] [INFO ] [MAIN ] GUT: Loaded 15736 primary data records. [2025-10-16T22:38:36.243363] [DEBUG] [LOCAL ] GTY: Derivative data saved (1807 records). [2025-10-16T22:38:36.262356] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-16T22:38:36.274339] [INFO ] [MAIN ] Derivative Progress: 822/1803 symbols completed. GTY took 1.2s. Estimated remaining: 6m 17s. Rate: 156.3 symbols/min [2025-10-16T22:38:36.279795] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:36.470955] [DEBUG] [LOCAL ] GWH: Loaded 19024 existing records from primary storage. [2025-10-16T22:38:36.555972] [DEBUG] [LOCAL ] GVA: Loaded 32925 existing records from primary storage. [2025-10-16T22:38:36.561346] [INFO ] [MAIN ] GVA: Loaded 32925 primary data records. [2025-10-16T22:38:36.561523] [INFO ] [MAIN ] GWH: Loaded 19024 primary data records. [2025-10-16T22:38:37.195500] [DEBUG] [MAIN ] GUT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:37.196474] [INFO ] [MAIN ] GUT: Generated 1807 derivative records from 15736 primary records. [2025-10-16T22:38:37.196576] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-16T22:38:37.215733] [DEBUG] [LOCAL ] GUT: Derivative data saved (1807 records). [2025-10-16T22:38:37.216259] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-16T22:38:37.218685] [INFO ] [MAIN ] Derivative Progress: 823/1803 symbols completed. GUT took 1.1s. Estimated remaining: 6m 17s. Rate: 156.0 symbols/min [2025-10-16T22:38:37.237877] [DEBUG] [MAIN ] GVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:37.241000] [INFO ] [MAIN ] GVA: Generated 1807 derivative records from 32925 primary records. [2025-10-16T22:38:37.241093] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-16T22:38:37.254989] [DEBUG] [MAIN ] GWH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:37.267344] [INFO ] [MAIN ] GWH: Generated 1807 derivative records from 19024 primary records. [2025-10-16T22:38:37.270226] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-16T22:38:37.274834] [DEBUG] [LOCAL ] GVA: Derivative data saved (1807 records). [2025-10-16T22:38:37.275356] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-16T22:38:37.278476] [INFO ] [MAIN ] Derivative Progress: 824/1803 symbols completed. GVA took 1.1s. Estimated remaining: 6m 16s. Rate: 156.2 symbols/min [2025-10-16T22:38:37.292907] [DEBUG] [LOCAL ] GWH: Derivative data saved (1807 records). [2025-10-16T22:38:37.292974] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-16T22:38:37.295874] [INFO ] [MAIN ] Derivative Progress: 825/1803 symbols completed. GWH took 1.0s. Estimated remaining: 6m 15s. Rate: 156.4 symbols/min [2025-10-16T22:38:37.296305] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:37.296383] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:37.297312] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:37.318736] [DEBUG] [LOCAL ] GWW: Loaded 19681 existing records from primary storage. [2025-10-16T22:38:37.318903] [INFO ] [MAIN ] GWW: Loaded 19681 primary data records. [2025-10-16T22:38:37.457169] [DEBUG] [LOCAL ] GWRE: Loaded 40226 existing records from primary storage. [2025-10-16T22:38:37.457431] [INFO ] [MAIN ] GWRE: Loaded 40226 primary data records. [2025-10-16T22:38:37.773290] [DEBUG] [LOCAL ] GXO: Loaded 47088 existing records from primary storage. [2025-10-16T22:38:37.784251] [INFO ] [MAIN ] GXO: Loaded 47088 primary data records. [2025-10-16T22:38:38.343149] [DEBUG] [MAIN ] GWW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:38.356525] [INFO ] [MAIN ] GWW: Generated 1807 derivative records from 19681 primary records. [2025-10-16T22:38:38.357781] [DEBUG] [MAIN ] GWRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:38.357870] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-16T22:38:38.358924] [INFO ] [MAIN ] GWRE: Generated 1807 derivative records from 40226 primary records. [2025-10-16T22:38:38.359037] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-16T22:38:38.392670] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1807 records). [2025-10-16T22:38:38.400975] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-10-16T22:38:38.406539] [DEBUG] [LOCAL ] GWW: Derivative data saved (1807 records). [2025-10-16T22:38:38.408928] [INFO ] [MAIN ] Derivative Progress: 826/1803 symbols completed. GWRE took 1.1s. Estimated remaining: 6m 16s. Rate: 156.0 symbols/min [2025-10-16T22:38:38.409543] [DEBUG] [MAIN ] GXO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:38.409215] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-16T22:38:38.412566] [INFO ] [MAIN ] Derivative Progress: 827/1803 symbols completed. GWW took 1.1s. Estimated remaining: 6m 15s. Rate: 156.2 symbols/min [2025-10-16T22:38:38.412491] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:38.412925] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:38.414014] [INFO ] [MAIN ] GXO: Generated 1807 derivative records from 47088 primary records. [2025-10-16T22:38:38.414723] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-16T22:38:38.431783] [DEBUG] [LOCAL ] GYLD: Loaded 1553 existing records from primary storage. [2025-10-16T22:38:38.431893] [INFO ] [MAIN ] GYLD: Loaded 1553 primary data records. [2025-10-16T22:38:38.537634] [DEBUG] [LOCAL ] GXO: Derivative data saved (1807 records). [2025-10-16T22:38:38.550381] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-10-16T22:38:38.559597] [INFO ] [MAIN ] Derivative Progress: 828/1803 symbols completed. GXO took 1.3s. Estimated remaining: 6m 14s. Rate: 156.3 symbols/min [2025-10-16T22:38:38.575555] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:38.645958] [DEBUG] [LOCAL ] HAE: Loaded 39700 existing records from primary storage. [2025-10-16T22:38:38.759127] [INFO ] [MAIN ] HAE: Loaded 39700 primary data records. [2025-10-16T22:38:38.952636] [DEBUG] [LOCAL ] HAFN: Loaded 43242 existing records from primary storage. [2025-10-16T22:38:38.976889] [INFO ] [MAIN ] HAFN: Loaded 43242 primary data records. [2025-10-16T22:38:39.416826] [DEBUG] [MAIN ] GYLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:39.418250] [INFO ] [MAIN ] GYLD: Generated 1807 derivative records from 1553 primary records. [2025-10-16T22:38:39.418607] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-16T22:38:39.434984] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1807 records). [2025-10-16T22:38:39.435086] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-10-16T22:38:39.437400] [INFO ] [MAIN ] Derivative Progress: 829/1803 symbols completed. GYLD took 1.0s. Estimated remaining: 6m 14s. Rate: 156.1 symbols/min [2025-10-16T22:38:39.437564] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:39.455707] [DEBUG] [MAIN ] HAE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:39.456449] [INFO ] [MAIN ] HAE: Generated 1807 derivative records from 39700 primary records. [2025-10-16T22:38:39.456691] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-10-16T22:38:39.473934] [DEBUG] [LOCAL ] HAE: Derivative data saved (1807 records). [2025-10-16T22:38:39.474295] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-10-16T22:38:39.477217] [INFO ] [MAIN ] Derivative Progress: 830/1803 symbols completed. HAE took 1.1s. Estimated remaining: 6m 14s. Rate: 156.3 symbols/min [2025-10-16T22:38:39.477431] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:39.495149] [DEBUG] [MAIN ] HAFN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:39.495879] [INFO ] [MAIN ] HAFN: Generated 1807 derivative records from 43242 primary records. [2025-10-16T22:38:39.496097] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-16T22:38:39.511889] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1807 records). [2025-10-16T22:38:39.512116] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-10-16T22:38:39.528882] [INFO ] [MAIN ] Derivative Progress: 831/1803 symbols completed. HAFN took 1.0s. Estimated remaining: 6m 13s. Rate: 156.4 symbols/min [2025-10-16T22:38:39.529082] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:39.560696] [DEBUG] [LOCAL ] HAL: Loaded 54108 existing records from primary storage. [2025-10-16T22:38:39.561016] [INFO ] [MAIN ] HAL: Loaded 54108 primary data records. [2025-10-16T22:38:39.703779] [DEBUG] [LOCAL ] HASI: Loaded 48039 existing records from primary storage. [2025-10-16T22:38:39.709152] [INFO ] [MAIN ] HASI: Loaded 48039 primary data records. [2025-10-16T22:38:40.045593] [DEBUG] [LOCAL ] HAYW: Loaded 49275 existing records from primary storage. [2025-10-16T22:38:40.069304] [INFO ] [MAIN ] HAYW: Loaded 49275 primary data records. [2025-10-16T22:38:40.612676] [DEBUG] [MAIN ] HAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:40.614240] [INFO ] [MAIN ] HAL: Generated 1807 derivative records from 54108 primary records. [2025-10-16T22:38:40.614524] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-16T22:38:40.641964] [DEBUG] [LOCAL ] HAL: Derivative data saved (1807 records). [2025-10-16T22:38:40.646997] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-10-16T22:38:40.649972] [INFO ] [MAIN ] Derivative Progress: 832/1803 symbols completed. HAL took 1.2s. Estimated remaining: 6m 13s. Rate: 156.1 symbols/min [2025-10-16T22:38:40.650474] [DEBUG] [MAIN ] HASI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:40.650755] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:40.651622] [INFO ] [MAIN ] HASI: Generated 1807 derivative records from 48039 primary records. [2025-10-16T22:38:40.652072] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-16T22:38:40.671358] [DEBUG] [LOCAL ] HASI: Derivative data saved (1807 records). [2025-10-16T22:38:40.673294] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-10-16T22:38:40.676955] [INFO ] [MAIN ] Derivative Progress: 833/1803 symbols completed. HASI took 1.2s. Estimated remaining: 6m 13s. Rate: 156.2 symbols/min [2025-10-16T22:38:40.677124] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:40.680487] [DEBUG] [LOCAL ] HBB: Loaded 6511 existing records from primary storage. [2025-10-16T22:38:40.680590] [INFO ] [MAIN ] HBB: Loaded 6511 primary data records. [2025-10-16T22:38:40.772322] [DEBUG] [MAIN ] HAYW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:40.790825] [INFO ] [MAIN ] HAYW: Generated 1807 derivative records from 49275 primary records. [2025-10-16T22:38:40.802531] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-16T22:38:41.032698] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1807 records). [2025-10-16T22:38:41.033804] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-10-16T22:38:41.036599] [INFO ] [MAIN ] Derivative Progress: 834/1803 symbols completed. HAYW took 1.5s. Estimated remaining: 6m 12s. Rate: 156.2 symbols/min [2025-10-16T22:38:41.036866] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:41.058686] [DEBUG] [LOCAL ] HBI: Loaded 53362 existing records from primary storage. [2025-10-16T22:38:41.058928] [INFO ] [MAIN ] HBI: Loaded 53362 primary data records. [2025-10-16T22:38:41.392282] [DEBUG] [LOCAL ] HBM: Loaded 53348 existing records from primary storage. [2025-10-16T22:38:41.392599] [INFO ] [MAIN ] HBM: Loaded 53348 primary data records. [2025-10-16T22:38:41.449223] [DEBUG] [MAIN ] HBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:41.476510] [INFO ] [MAIN ] HBB: Generated 1807 derivative records from 6511 primary records. [2025-10-16T22:38:41.493953] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-10-16T22:38:41.604444] [DEBUG] [LOCAL ] HBB: Derivative data saved (1807 records). [2025-10-16T22:38:41.604578] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-10-16T22:38:41.724288] [INFO ] [MAIN ] Derivative Progress: 835/1803 symbols completed. HBB took 1.1s. Estimated remaining: 6m 12s. Rate: 156.1 symbols/min [2025-10-16T22:38:41.724900] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:41.746010] [DEBUG] [MAIN ] HBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:41.746710] [INFO ] [MAIN ] HBI: Generated 1807 derivative records from 53362 primary records. [2025-10-16T22:38:41.746893] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-16T22:38:41.763959] [DEBUG] [LOCAL ] HBI: Derivative data saved (1807 records). [2025-10-16T22:38:41.764219] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-10-16T22:38:41.769328] [INFO ] [MAIN ] Derivative Progress: 836/1803 symbols completed. HBI took 1.1s. Estimated remaining: 6m 11s. Rate: 156.3 symbols/min [2025-10-16T22:38:41.769671] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:41.793295] [DEBUG] [MAIN ] HBM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:41.794183] [INFO ] [MAIN ] HBM: Generated 1807 derivative records from 53348 primary records. [2025-10-16T22:38:41.794299] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-10-16T22:38:41.811854] [DEBUG] [LOCAL ] HBM: Derivative data saved (1807 records). [2025-10-16T22:38:41.812403] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-10-16T22:38:41.827606] [INFO ] [MAIN ] Derivative Progress: 837/1803 symbols completed. HBM took 0.8s. Estimated remaining: 6m 11s. Rate: 156.4 symbols/min [2025-10-16T22:38:41.827870] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:41.830548] [DEBUG] [LOCAL ] HCA: Loaded 47337 existing records from primary storage. [2025-10-16T22:38:41.830668] [INFO ] [MAIN ] HCA: Loaded 47337 primary data records. [2025-10-16T22:38:42.008242] [DEBUG] [LOCAL ] HCI: Loaded 14289 existing records from primary storage. [2025-10-16T22:38:41.995614] [DEBUG] [LOCAL ] HCC: Loaded 45525 existing records from primary storage. [2025-10-16T22:38:42.041403] [INFO ] [MAIN ] HCI: Loaded 14289 primary data records. [2025-10-16T22:38:42.046786] [INFO ] [MAIN ] HCC: Loaded 45525 primary data records. [2025-10-16T22:38:42.827249] [DEBUG] [MAIN ] HCA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:42.828625] [INFO ] [MAIN ] HCA: Generated 1807 derivative records from 47337 primary records. [2025-10-16T22:38:42.828929] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-16T22:38:42.846925] [DEBUG] [LOCAL ] HCA: Derivative data saved (1807 records). [2025-10-16T22:38:42.846997] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-10-16T22:38:42.849448] [INFO ] [MAIN ] Derivative Progress: 838/1803 symbols completed. HCA took 1.1s. Estimated remaining: 6m 11s. Rate: 156.1 symbols/min [2025-10-16T22:38:42.865253] [DEBUG] [MAIN ] HCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:42.866160] [INFO ] [MAIN ] HCI: Generated 1807 derivative records from 14289 primary records. [2025-10-16T22:38:42.866303] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-16T22:38:42.884330] [DEBUG] [LOCAL ] HCI: Derivative data saved (1807 records). [2025-10-16T22:38:42.884478] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-10-16T22:38:42.887297] [INFO ] [MAIN ] Derivative Progress: 839/1803 symbols completed. HCI took 1.1s. Estimated remaining: 6m 10s. Rate: 156.3 symbols/min [2025-10-16T22:38:42.900039] [DEBUG] [MAIN ] HCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:42.900593] [INFO ] [MAIN ] HCC: Generated 1807 derivative records from 45525 primary records. [2025-10-16T22:38:42.900674] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-16T22:38:42.915828] [DEBUG] [LOCAL ] HCC: Derivative data saved (1807 records). [2025-10-16T22:38:42.915886] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-10-16T22:38:42.918801] [INFO ] [MAIN ] Derivative Progress: 840/1803 symbols completed. HCC took 1.1s. Estimated remaining: 6m 9s. Rate: 156.4 symbols/min [2025-10-16T22:38:42.919190] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:42.919579] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:42.919295] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:43.004372] [DEBUG] [LOCAL ] HE: Loaded 49287 existing records from primary storage. [2025-10-16T22:38:43.005074] [DEBUG] [LOCAL ] HDB: Loaded 52321 existing records from primary storage. [2025-10-16T22:38:43.005217] [INFO ] [MAIN ] HDB: Loaded 52321 primary data records. [2025-10-16T22:38:43.010721] [INFO ] [MAIN ] HE: Loaded 49287 primary data records. [2025-10-16T22:38:43.149703] [DEBUG] [LOCAL ] HD: Loaded 53874 existing records from primary storage. [2025-10-16T22:38:43.190117] [INFO ] [MAIN ] HD: Loaded 53874 primary data records. [2025-10-16T22:38:43.985962] [DEBUG] [MAIN ] HE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:43.987751] [INFO ] [MAIN ] HE: Generated 1807 derivative records from 49287 primary records. [2025-10-16T22:38:43.987969] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-16T22:38:43.986844] [DEBUG] [MAIN ] HDB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:43.989042] [INFO ] [MAIN ] HDB: Generated 1807 derivative records from 52321 primary records. [2025-10-16T22:38:43.989693] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-16T22:38:44.015810] [DEBUG] [LOCAL ] HE: Derivative data saved (1807 records). [2025-10-16T22:38:44.025406] [DEBUG] [LOCAL ] HDB: Derivative data saved (1807 records). [2025-10-16T22:38:44.020973] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-10-16T22:38:44.028288] [INFO ] [MAIN ] Derivative Progress: 841/1803 symbols completed. HE took 1.1s. Estimated remaining: 6m 10s. Rate: 156.1 symbols/min [2025-10-16T22:38:44.028463] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-10-16T22:38:44.028623] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:44.030903] [INFO ] [MAIN ] Derivative Progress: 842/1803 symbols completed. HDB took 1.1s. Estimated remaining: 6m 9s. Rate: 156.3 symbols/min [2025-10-16T22:38:44.031135] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:44.045169] [DEBUG] [MAIN ] HD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:44.046335] [INFO ] [MAIN ] HD: Generated 1807 derivative records from 53874 primary records. [2025-10-16T22:38:44.046437] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-16T22:38:44.063740] [DEBUG] [LOCAL ] HD: Derivative data saved (1807 records). [2025-10-16T22:38:44.066097] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-10-16T22:38:44.069180] [INFO ] [MAIN ] Derivative Progress: 843/1803 symbols completed. HD took 1.1s. Estimated remaining: 6m 8s. Rate: 156.4 symbols/min [2025-10-16T22:38:44.069441] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:44.073730] [DEBUG] [LOCAL ] HEQ: Loaded 6834 existing records from primary storage. [2025-10-16T22:38:44.073953] [INFO ] [MAIN ] HEQ: Loaded 6834 primary data records. [2025-10-16T22:38:44.212036] [DEBUG] [LOCAL ] HEI: Loaded 31397 existing records from primary storage. [2025-10-16T22:38:44.218050] [INFO ] [MAIN ] HEI: Loaded 31397 primary data records. [2025-10-16T22:38:44.436140] [DEBUG] [LOCAL ] HESM: Loaded 48904 existing records from primary storage. [2025-10-16T22:38:44.602460] [INFO ] [MAIN ] HESM: Loaded 48904 primary data records. [2025-10-16T22:38:45.127515] [DEBUG] [MAIN ] HEQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:45.130526] [INFO ] [MAIN ] HEQ: Generated 1807 derivative records from 6834 primary records. [2025-10-16T22:38:45.143254] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-16T22:38:45.144386] [DEBUG] [MAIN ] HEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:45.145559] [INFO ] [MAIN ] HEI: Generated 1807 derivative records from 31397 primary records. [2025-10-16T22:38:45.145930] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-10-16T22:38:45.174414] [DEBUG] [LOCAL ] HEI: Derivative data saved (1807 records). [2025-10-16T22:38:45.174820] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-10-16T22:38:45.178399] [INFO ] [MAIN ] Derivative Progress: 844/1803 symbols completed. HEI took 1.1s. Estimated remaining: 6m 9s. Rate: 156.1 symbols/min [2025-10-16T22:38:45.178916] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:45.183179] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1807 records). [2025-10-16T22:38:45.183456] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-10-16T22:38:45.185418] [INFO ] [MAIN ] Derivative Progress: 845/1803 symbols completed. HEQ took 1.2s. Estimated remaining: 6m 8s. Rate: 156.3 symbols/min [2025-10-16T22:38:45.185793] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:45.206764] [DEBUG] [MAIN ] HESM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:45.207803] [INFO ] [MAIN ] HESM: Generated 1807 derivative records from 48904 primary records. [2025-10-16T22:38:45.213743] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-16T22:38:45.214112] [DEBUG] [LOCAL ] HFRO: Loaded 16982 existing records from primary storage. [2025-10-16T22:38:45.218566] [INFO ] [MAIN ] HFRO: Loaded 16982 primary data records. [2025-10-16T22:38:45.313808] [DEBUG] [LOCAL ] HGER: Loaded 15086 existing records from primary storage. [2025-10-16T22:38:45.324887] [INFO ] [MAIN ] HGER: Loaded 15086 primary data records. [2025-10-16T22:38:45.403875] [DEBUG] [LOCAL ] HESM: Derivative data saved (1807 records). [2025-10-16T22:38:45.424773] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-10-16T22:38:45.448872] [INFO ] [MAIN ] Derivative Progress: 846/1803 symbols completed. HESM took 1.4s. Estimated remaining: 6m 7s. Rate: 156.3 symbols/min [2025-10-16T22:38:45.508715] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:45.886021] [DEBUG] [LOCAL ] HGLB: Loaded 9718 existing records from primary storage. [2025-10-16T22:38:45.886678] [INFO ] [MAIN ] HGLB: Loaded 9718 primary data records. [2025-10-16T22:38:46.266187] [DEBUG] [MAIN ] HFRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:46.275700] [INFO ] [MAIN ] HFRO: Generated 1807 derivative records from 16982 primary records. [2025-10-16T22:38:46.282385] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-16T22:38:46.282926] [DEBUG] [MAIN ] HGER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:46.291618] [INFO ] [MAIN ] HGER: Generated 1807 derivative records from 15086 primary records. [2025-10-16T22:38:46.292072] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-10-16T22:38:46.301281] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1807 records). [2025-10-16T22:38:46.301881] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-10-16T22:38:46.311619] [INFO ] [MAIN ] Derivative Progress: 847/1803 symbols completed. HFRO took 1.1s. Estimated remaining: 6m 7s. Rate: 156.1 symbols/min [2025-10-16T22:38:46.316144] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:46.321129] [DEBUG] [LOCAL ] HGER: Derivative data saved (1807 records). [2025-10-16T22:38:46.321631] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-10-16T22:38:46.325068] [INFO ] [MAIN ] Derivative Progress: 848/1803 symbols completed. HGER took 1.1s. Estimated remaining: 6m 7s. Rate: 156.3 symbols/min [2025-10-16T22:38:46.325689] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:46.349517] [DEBUG] [MAIN ] HGLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:46.355589] [INFO ] [MAIN ] HGLB: Generated 1807 derivative records from 9718 primary records. [2025-10-16T22:38:46.355938] [DEBUG] [LOCAL ] HGTY: Loaded 13424 existing records from primary storage. [2025-10-16T22:38:46.356291] [INFO ] [MAIN ] HGTY: Loaded 13424 primary data records. [2025-10-16T22:38:46.356367] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-16T22:38:46.475753] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1807 records). [2025-10-16T22:38:46.475905] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-10-16T22:38:46.482253] [INFO ] [MAIN ] Derivative Progress: 849/1803 symbols completed. HGLB took 1.0s. Estimated remaining: 6m 6s. Rate: 156.4 symbols/min [2025-10-16T22:38:46.482756] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:46.698506] [DEBUG] [LOCAL ] HGV: Loaded 46673 existing records from primary storage. [2025-10-16T22:38:46.708873] [INFO ] [MAIN ] HGV: Loaded 46673 primary data records. [2025-10-16T22:38:46.796918] [DEBUG] [LOCAL ] HHH: Loaded 33409 existing records from primary storage. [2025-10-16T22:38:46.815127] [INFO ] [MAIN ] HHH: Loaded 33409 primary data records. [2025-10-16T22:38:47.383613] [DEBUG] [MAIN ] HGTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:47.385958] [INFO ] [MAIN ] HGTY: Generated 1807 derivative records from 13424 primary records. [2025-10-16T22:38:47.386270] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-16T22:38:47.404942] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1807 records). [2025-10-16T22:38:47.405363] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-10-16T22:38:47.407609] [INFO ] [MAIN ] Derivative Progress: 850/1803 symbols completed. HGTY took 1.1s. Estimated remaining: 6m 6s. Rate: 156.1 symbols/min [2025-10-16T22:38:47.409012] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:47.432320] [DEBUG] [MAIN ] HGV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:47.433453] [INFO ] [MAIN ] HGV: Generated 1807 derivative records from 46673 primary records. [2025-10-16T22:38:47.446221] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-16T22:38:47.446535] [DEBUG] [MAIN ] HHH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:47.448506] [INFO ] [MAIN ] HHH: Generated 1807 derivative records from 33409 primary records. [2025-10-16T22:38:47.448869] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-16T22:38:47.484874] [DEBUG] [LOCAL ] HGV: Derivative data saved (1807 records). [2025-10-16T22:38:47.496718] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-10-16T22:38:47.502972] [DEBUG] [LOCAL ] HHH: Derivative data saved (1807 records). [2025-10-16T22:38:47.501915] [INFO ] [MAIN ] Derivative Progress: 851/1803 symbols completed. HGV took 1.2s. Estimated remaining: 6m 6s. Rate: 156.3 symbols/min [2025-10-16T22:38:47.503217] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:47.502879] [DEBUG] [LOCAL ] HI: Loaded 36147 existing records from primary storage. [2025-10-16T22:38:47.503455] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-10-16T22:38:47.503568] [INFO ] [MAIN ] HI: Loaded 36147 primary data records. [2025-10-16T22:38:47.507670] [INFO ] [MAIN ] Derivative Progress: 852/1803 symbols completed. HHH took 1.0s. Estimated remaining: 6m 5s. Rate: 156.5 symbols/min [2025-10-16T22:38:47.508024] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:47.824431] [DEBUG] [LOCAL ] HII: Loaded 34070 existing records from primary storage. [2025-10-16T22:38:47.824753] [INFO ] [MAIN ] HII: Loaded 34070 primary data records. [2025-10-16T22:38:47.972892] [DEBUG] [LOCAL ] HIG: Loaded 51580 existing records from primary storage. [2025-10-16T22:38:48.038572] [INFO ] [MAIN ] HIG: Loaded 51580 primary data records. [2025-10-16T22:38:48.507130] [DEBUG] [MAIN ] HI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:48.508827] [INFO ] [MAIN ] HI: Generated 1807 derivative records from 36147 primary records. [2025-10-16T22:38:48.509009] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-16T22:38:48.529325] [DEBUG] [LOCAL ] HI: Derivative data saved (1807 records). [2025-10-16T22:38:48.529851] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-10-16T22:38:48.531861] [INFO ] [MAIN ] Derivative Progress: 853/1803 symbols completed. HI took 1.1s. Estimated remaining: 6m 5s. Rate: 156.1 symbols/min [2025-10-16T22:38:48.547989] [DEBUG] [MAIN ] HII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:48.548933] [INFO ] [MAIN ] HII: Generated 1807 derivative records from 34070 primary records. [2025-10-16T22:38:48.549036] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-16T22:38:48.566250] [DEBUG] [LOCAL ] HII: Derivative data saved (1807 records). [2025-10-16T22:38:48.567035] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-10-16T22:38:48.569602] [INFO ] [MAIN ] Derivative Progress: 854/1803 symbols completed. HII took 1.1s. Estimated remaining: 6m 4s. Rate: 156.3 symbols/min [2025-10-16T22:38:48.581913] [DEBUG] [MAIN ] HIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:48.582433] [INFO ] [MAIN ] HIG: Generated 1807 derivative records from 51580 primary records. [2025-10-16T22:38:48.582491] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-16T22:38:48.597660] [DEBUG] [LOCAL ] HIG: Derivative data saved (1807 records). [2025-10-16T22:38:48.597725] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-10-16T22:38:48.600563] [INFO ] [MAIN ] Derivative Progress: 855/1803 symbols completed. HIG took 1.1s. Estimated remaining: 6m 4s. Rate: 156.5 symbols/min [2025-10-16T22:38:48.600984] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:48.601138] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:48.601077] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:48.637568] [DEBUG] [LOCAL ] HIPO: Loaded 21976 existing records from primary storage. [2025-10-16T22:38:48.638178] [DEBUG] [LOCAL ] HIO: Loaded 24541 existing records from primary storage. [2025-10-16T22:38:48.638342] [INFO ] [MAIN ] HIO: Loaded 24541 primary data records. [2025-10-16T22:38:48.638597] [INFO ] [MAIN ] HIPO: Loaded 21976 primary data records. [2025-10-16T22:38:48.967239] [DEBUG] [LOCAL ] HIMS: Loaded 54207 existing records from primary storage. [2025-10-16T22:38:49.085310] [INFO ] [MAIN ] HIMS: Loaded 54207 primary data records. [2025-10-16T22:38:49.613460] [DEBUG] [MAIN ] HIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:49.616613] [INFO ] [MAIN ] HIO: Generated 1807 derivative records from 24541 primary records. [2025-10-16T22:38:49.616752] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-16T22:38:49.642422] [DEBUG] [MAIN ] HIPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:49.644970] [INFO ] [MAIN ] HIPO: Generated 1807 derivative records from 21976 primary records. [2025-10-16T22:38:49.645756] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-16T22:38:49.646813] [DEBUG] [LOCAL ] HIO: Derivative data saved (1807 records). [2025-10-16T22:38:49.648496] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-10-16T22:38:49.651052] [INFO ] [MAIN ] Derivative Progress: 856/1803 symbols completed. HIO took 1.0s. Estimated remaining: 6m 4s. Rate: 156.2 symbols/min [2025-10-16T22:38:49.651222] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:49.679675] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1807 records). [2025-10-16T22:38:49.679972] [DEBUG] [MAIN ] HIMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:49.680776] [INFO ] [MAIN ] HIMS: Generated 1807 derivative records from 54207 primary records. [2025-10-16T22:38:49.680933] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-16T22:38:49.681001] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-10-16T22:38:49.683952] [INFO ] [MAIN ] Derivative Progress: 857/1803 symbols completed. HIPO took 1.1s. Estimated remaining: 6m 3s. Rate: 156.3 symbols/min [2025-10-16T22:38:49.684557] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:49.700081] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1807 records). [2025-10-16T22:38:49.700459] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-10-16T22:38:49.703504] [INFO ] [MAIN ] Derivative Progress: 858/1803 symbols completed. HIMS took 1.1s. Estimated remaining: 6m 2s. Rate: 156.5 symbols/min [2025-10-16T22:38:49.703734] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:49.733831] [DEBUG] [LOCAL ] HIX: Loaded 20590 existing records from primary storage. [2025-10-16T22:38:49.734556] [INFO ] [MAIN ] HIX: Loaded 20590 primary data records. [2025-10-16T22:38:49.817029] [DEBUG] [LOCAL ] HKD: Loaded 18776 existing records from primary storage. [2025-10-16T22:38:49.858916] [DEBUG] [LOCAL ] HIW: Loaded 44926 existing records from primary storage. [2025-10-16T22:38:49.857670] [INFO ] [MAIN ] HKD: Loaded 18776 primary data records. [2025-10-16T22:38:49.864277] [INFO ] [MAIN ] HIW: Loaded 44926 primary data records. [2025-10-16T22:38:50.729907] [DEBUG] [MAIN ] HIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:50.731306] [INFO ] [MAIN ] HIX: Generated 1807 derivative records from 20590 primary records. [2025-10-16T22:38:50.731757] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-16T22:38:50.753017] [DEBUG] [LOCAL ] HIX: Derivative data saved (1807 records). [2025-10-16T22:38:50.755217] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-10-16T22:38:50.758942] [INFO ] [MAIN ] Derivative Progress: 859/1803 symbols completed. HIX took 1.1s. Estimated remaining: 6m 3s. Rate: 156.2 symbols/min [2025-10-16T22:38:50.759682] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:50.776168] [DEBUG] [MAIN ] HKD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:50.777154] [INFO ] [MAIN ] HKD: Generated 1807 derivative records from 18776 primary records. [2025-10-16T22:38:50.777312] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-16T22:38:50.790922] [DEBUG] [MAIN ] HIW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:50.791975] [INFO ] [MAIN ] HIW: Generated 1807 derivative records from 44926 primary records. [2025-10-16T22:38:50.792286] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-16T22:38:50.815291] [DEBUG] [LOCAL ] HKD: Derivative data saved (1807 records). [2025-10-16T22:38:50.819432] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-10-16T22:38:50.822158] [INFO ] [MAIN ] Derivative Progress: 860/1803 symbols completed. HKD took 1.1s. Estimated remaining: 6m 2s. Rate: 156.3 symbols/min [2025-10-16T22:38:50.822530] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:50.830119] [DEBUG] [LOCAL ] HIW: Derivative data saved (1807 records). [2025-10-16T22:38:50.830295] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-10-16T22:38:50.834247] [INFO ] [MAIN ] Derivative Progress: 861/1803 symbols completed. HIW took 1.2s. Estimated remaining: 6m 1s. Rate: 156.5 symbols/min [2025-10-16T22:38:50.834617] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:50.885559] [DEBUG] [LOCAL ] HLF: Loaded 48878 existing records from primary storage. [2025-10-16T22:38:50.893473] [INFO ] [MAIN ] HLF: Loaded 48878 primary data records. [2025-10-16T22:38:50.977711] [DEBUG] [LOCAL ] HL: Loaded 54065 existing records from primary storage. [2025-10-16T22:38:51.008066] [INFO ] [MAIN ] HL: Loaded 54065 primary data records. [2025-10-16T22:38:51.068608] [DEBUG] [LOCAL ] HLI: Loaded 31106 existing records from primary storage. [2025-10-16T22:38:51.091429] [INFO ] [MAIN ] HLI: Loaded 31106 primary data records. [2025-10-16T22:38:51.848911] [DEBUG] [MAIN ] HLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:51.862803] [INFO ] [MAIN ] HLF: Generated 1807 derivative records from 48878 primary records. [2025-10-16T22:38:51.863554] [DEBUG] [MAIN ] HL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:51.864501] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-16T22:38:51.864413] [INFO ] [MAIN ] HL: Generated 1807 derivative records from 54065 primary records. [2025-10-16T22:38:51.865714] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-16T22:38:51.903286] [DEBUG] [LOCAL ] HLF: Derivative data saved (1807 records). [2025-10-16T22:38:51.908161] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-10-16T22:38:51.912904] [INFO ] [MAIN ] Derivative Progress: 862/1803 symbols completed. HLF took 1.1s. Estimated remaining: 6m 2s. Rate: 156.2 symbols/min [2025-10-16T22:38:51.913484] [DEBUG] [MAIN ] HLI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:51.914581] [INFO ] [MAIN ] HLI: Generated 1807 derivative records from 31106 primary records. [2025-10-16T22:38:51.915785] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:51.915621] [DEBUG] [LOCAL ] HL: Derivative data saved (1807 records). [2025-10-16T22:38:51.915972] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-10-16T22:38:51.916157] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-10-16T22:38:51.920905] [INFO ] [MAIN ] Derivative Progress: 863/1803 symbols completed. HL took 1.2s. Estimated remaining: 6m 1s. Rate: 156.4 symbols/min [2025-10-16T22:38:51.921888] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:51.939703] [DEBUG] [LOCAL ] HLI: Derivative data saved (1807 records). [2025-10-16T22:38:51.939944] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-10-16T22:38:51.942950] [INFO ] [MAIN ] Derivative Progress: 864/1803 symbols completed. HLI took 1.1s. Estimated remaining: 5m 60s. Rate: 156.5 symbols/min [2025-10-16T22:38:51.943188] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:51.979623] [DEBUG] [LOCAL ] HLLY: Loaded 33658 existing records from primary storage. [2025-10-16T22:38:51.987772] [INFO ] [MAIN ] HLLY: Loaded 33658 primary data records. [2025-10-16T22:38:52.031874] [DEBUG] [LOCAL ] HLIO: Loaded 28465 existing records from primary storage. [2025-10-16T22:38:52.064222] [INFO ] [MAIN ] HLIO: Loaded 28465 primary data records. [2025-10-16T22:38:52.490265] [DEBUG] [LOCAL ] HLN: Loaded 53512 existing records from primary storage. [2025-10-16T22:38:52.623910] [INFO ] [MAIN ] HLN: Loaded 53512 primary data records. [2025-10-16T22:38:52.995180] [DEBUG] [MAIN ] HLLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:53.008631] [DEBUG] [MAIN ] HLIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:53.011732] [INFO ] [MAIN ] HLIO: Generated 1807 derivative records from 28465 primary records. [2025-10-16T22:38:53.010873] [INFO ] [MAIN ] HLLY: Generated 1807 derivative records from 33658 primary records. [2025-10-16T22:38:53.011844] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-16T22:38:53.012152] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-16T22:38:53.043545] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1807 records). [2025-10-16T22:38:53.045949] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-10-16T22:38:53.048931] [INFO ] [MAIN ] Derivative Progress: 865/1803 symbols completed. HLIO took 1.1s. Estimated remaining: 6m 0s. Rate: 156.2 symbols/min [2025-10-16T22:38:53.049611] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:53.051593] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1807 records). [2025-10-16T22:38:53.052854] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-10-16T22:38:53.055688] [INFO ] [MAIN ] Derivative Progress: 866/1803 symbols completed. HLLY took 1.1s. Estimated remaining: 5m 60s. Rate: 156.4 symbols/min [2025-10-16T22:38:53.056083] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:53.075163] [DEBUG] [MAIN ] HLN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:53.076179] [INFO ] [MAIN ] HLN: Generated 1807 derivative records from 53512 primary records. [2025-10-16T22:38:53.076403] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-16T22:38:53.097079] [DEBUG] [LOCAL ] HLN: Derivative data saved (1807 records). [2025-10-16T22:38:53.097756] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-10-16T22:38:53.101103] [INFO ] [MAIN ] Derivative Progress: 867/1803 symbols completed. HLN took 1.2s. Estimated remaining: 5m 59s. Rate: 156.5 symbols/min [2025-10-16T22:38:53.101523] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:53.145310] [DEBUG] [LOCAL ] HLT: Loaded 50910 existing records from primary storage. [2025-10-16T22:38:53.145467] [INFO ] [MAIN ] HLT: Loaded 50910 primary data records. [2025-10-16T22:38:53.291572] [DEBUG] [LOCAL ] HLX: Loaded 47821 existing records from primary storage. [2025-10-16T22:38:53.302379] [INFO ] [MAIN ] HLX: Loaded 47821 primary data records. [2025-10-16T22:38:53.533210] [DEBUG] [LOCAL ] HMC: Loaded 46822 existing records from primary storage. [2025-10-16T22:38:53.568639] [INFO ] [MAIN ] HMC: Loaded 46822 primary data records. [2025-10-16T22:38:54.225913] [DEBUG] [MAIN ] HLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:54.230109] [INFO ] [MAIN ] HLT: Generated 1807 derivative records from 50910 primary records. [2025-10-16T22:38:54.230465] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-16T22:38:54.254614] [DEBUG] [MAIN ] HLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:54.262128] [DEBUG] [LOCAL ] HLT: Derivative data saved (1807 records). [2025-10-16T22:38:54.262271] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-10-16T22:38:54.263182] [INFO ] [MAIN ] HLX: Generated 1807 derivative records from 47821 primary records. [2025-10-16T22:38:54.267397] [INFO ] [MAIN ] Derivative Progress: 868/1803 symbols completed. HLT took 1.2s. Estimated remaining: 5m 59s. Rate: 156.2 symbols/min [2025-10-16T22:38:54.268260] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-10-16T22:38:54.282288] [DEBUG] [MAIN ] HMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:54.293700] [INFO ] [MAIN ] HMC: Generated 1807 derivative records from 46822 primary records. [2025-10-16T22:38:54.295064] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-16T22:38:54.298496] [DEBUG] [LOCAL ] HLX: Derivative data saved (1807 records). [2025-10-16T22:38:54.298669] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-10-16T22:38:54.301617] [INFO ] [MAIN ] Derivative Progress: 869/1803 symbols completed. HLX took 1.2s. Estimated remaining: 5m 58s. Rate: 156.3 symbols/min [2025-10-16T22:38:54.316971] [DEBUG] [LOCAL ] HMC: Derivative data saved (1807 records). [2025-10-16T22:38:54.317048] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-10-16T22:38:54.320845] [INFO ] [MAIN ] Derivative Progress: 870/1803 symbols completed. HMC took 1.2s. Estimated remaining: 5m 58s. Rate: 156.5 symbols/min [2025-10-16T22:38:54.321370] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:54.321277] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:54.321569] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:54.360684] [DEBUG] [LOCAL ] HMN: Loaded 23613 existing records from primary storage. [2025-10-16T22:38:54.360982] [INFO ] [MAIN ] HMN: Loaded 23613 primary data records. [2025-10-16T22:38:54.455118] [DEBUG] [LOCAL ] HNI: Loaded 29900 existing records from primary storage. [2025-10-16T22:38:54.490301] [INFO ] [MAIN ] HNI: Loaded 29900 primary data records. [2025-10-16T22:38:54.803016] [DEBUG] [LOCAL ] HMY: Loaded 53556 existing records from primary storage. [2025-10-16T22:38:54.821793] [INFO ] [MAIN ] HMY: Loaded 53556 primary data records. [2025-10-16T22:38:55.318809] [DEBUG] [MAIN ] HMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:55.319729] [INFO ] [MAIN ] HMN: Generated 1807 derivative records from 23613 primary records. [2025-10-16T22:38:55.320223] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-16T22:38:55.338614] [DEBUG] [LOCAL ] HMN: Derivative data saved (1807 records). [2025-10-16T22:38:55.339018] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-10-16T22:38:55.342534] [INFO ] [MAIN ] Derivative Progress: 871/1803 symbols completed. HMN took 1.0s. Estimated remaining: 5m 58s. Rate: 156.2 symbols/min [2025-10-16T22:38:55.343092] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:55.361150] [DEBUG] [MAIN ] HNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:55.362134] [INFO ] [MAIN ] HNI: Generated 1807 derivative records from 29900 primary records. [2025-10-16T22:38:55.362313] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-16T22:38:55.393621] [DEBUG] [MAIN ] HMY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:55.394583] [DEBUG] [LOCAL ] HNI: Derivative data saved (1807 records). [2025-10-16T22:38:55.395337] [INFO ] [MAIN ] HMY: Generated 1807 derivative records from 53556 primary records. [2025-10-16T22:38:55.395456] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-10-16T22:38:55.398133] [INFO ] [MAIN ] Derivative Progress: 872/1803 symbols completed. HNI took 1.1s. Estimated remaining: 5m 57s. Rate: 156.3 symbols/min [2025-10-16T22:38:55.398384] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:55.398519] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-16T22:38:55.427767] [DEBUG] [LOCAL ] HMY: Derivative data saved (1807 records). [2025-10-16T22:38:55.427835] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-10-16T22:38:55.430824] [INFO ] [MAIN ] Derivative Progress: 873/1803 symbols completed. HMY took 1.1s. Estimated remaining: 5m 57s. Rate: 156.5 symbols/min [2025-10-16T22:38:55.431098] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:55.450309] [DEBUG] [LOCAL ] HOG: Loaded 51193 existing records from primary storage. [2025-10-16T22:38:55.450464] [INFO ] [MAIN ] HOG: Loaded 51193 primary data records. [2025-10-16T22:38:55.687152] [DEBUG] [LOCAL ] HOMB: Loaded 44016 existing records from primary storage. [2025-10-16T22:38:55.687499] [INFO ] [MAIN ] HOMB: Loaded 44016 primary data records. [2025-10-16T22:38:55.867038] [DEBUG] [LOCAL ] HOUS: Loaded 45728 existing records from primary storage. [2025-10-16T22:38:55.889621] [INFO ] [MAIN ] HOUS: Loaded 45728 primary data records. [2025-10-16T22:38:56.493603] [DEBUG] [MAIN ] HOG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:56.495488] [INFO ] [MAIN ] HOG: Generated 1807 derivative records from 51193 primary records. [2025-10-16T22:38:56.495862] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-16T22:38:56.514516] [DEBUG] [LOCAL ] HOG: Derivative data saved (1807 records). [2025-10-16T22:38:56.515134] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-10-16T22:38:56.518031] [INFO ] [MAIN ] Derivative Progress: 874/1803 symbols completed. HOG took 1.2s. Estimated remaining: 5m 57s. Rate: 156.2 symbols/min [2025-10-16T22:38:56.519388] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:56.537202] [DEBUG] [MAIN ] HOMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:56.537987] [INFO ] [MAIN ] HOMB: Generated 1807 derivative records from 44016 primary records. [2025-10-16T22:38:56.538295] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-10-16T22:38:56.567092] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1807 records). [2025-10-16T22:38:56.567877] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-10-16T22:38:56.567534] [DEBUG] [LOCAL ] HOV: Loaded 14093 existing records from primary storage. [2025-10-16T22:38:56.578086] [INFO ] [MAIN ] Derivative Progress: 875/1803 symbols completed. HOMB took 1.2s. Estimated remaining: 5m 56s. Rate: 156.3 symbols/min [2025-10-16T22:38:56.582873] [INFO ] [MAIN ] HOV: Loaded 14093 primary data records. [2025-10-16T22:38:56.594903] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:56.596241] [DEBUG] [MAIN ] HOUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:56.622123] [INFO ] [MAIN ] HOUS: Generated 1807 derivative records from 45728 primary records. [2025-10-16T22:38:56.622310] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-16T22:38:56.704750] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1807 records). [2025-10-16T22:38:56.715551] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-10-16T22:38:56.730875] [INFO ] [MAIN ] Derivative Progress: 876/1803 symbols completed. HOUS took 1.3s. Estimated remaining: 5m 56s. Rate: 156.4 symbols/min [2025-10-16T22:38:56.759402] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:56.952136] [DEBUG] [LOCAL ] HP: Loaded 51892 existing records from primary storage. [2025-10-16T22:38:56.952737] [INFO ] [MAIN ] HP: Loaded 51892 primary data records. [2025-10-16T22:38:57.111352] [DEBUG] [MAIN ] HOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:57.151483] [INFO ] [MAIN ] HOV: Generated 1807 derivative records from 14093 primary records. [2025-10-16T22:38:57.167953] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-16T22:38:57.307379] [DEBUG] [LOCAL ] HPE: Loaded 54087 existing records from primary storage. [2025-10-16T22:38:57.331738] [DEBUG] [LOCAL ] HOV: Derivative data saved (1807 records). [2025-10-16T22:38:57.331828] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-10-16T22:38:57.334019] [INFO ] [MAIN ] Derivative Progress: 877/1803 symbols completed. HOV took 0.8s. Estimated remaining: 5m 55s. Rate: 156.3 symbols/min [2025-10-16T22:38:57.330759] [INFO ] [MAIN ] HPE: Loaded 54087 primary data records. [2025-10-16T22:38:57.334300] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:57.459317] [DEBUG] [LOCAL ] HPF: Loaded 7539 existing records from primary storage. [2025-10-16T22:38:57.470167] [INFO ] [MAIN ] HPF: Loaded 7539 primary data records. [2025-10-16T22:38:57.996840] [DEBUG] [MAIN ] HP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:57.998439] [INFO ] [MAIN ] HP: Generated 1807 derivative records from 51892 primary records. [2025-10-16T22:38:57.999824] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-16T22:38:58.023044] [DEBUG] [LOCAL ] HP: Derivative data saved (1807 records). [2025-10-16T22:38:58.023464] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-10-16T22:38:58.028438] [INFO ] [MAIN ] Derivative Progress: 878/1803 symbols completed. HP took 1.4s. Estimated remaining: 5m 55s. Rate: 156.2 symbols/min [2025-10-16T22:38:58.036383] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:58.042321] [DEBUG] [MAIN ] HPE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:58.043498] [INFO ] [MAIN ] HPE: Generated 1807 derivative records from 54087 primary records. [2025-10-16T22:38:58.043773] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-16T22:38:58.066851] [DEBUG] [LOCAL ] HPE: Derivative data saved (1807 records). [2025-10-16T22:38:58.074763] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-10-16T22:38:58.081214] [INFO ] [MAIN ] Derivative Progress: 879/1803 symbols completed. HPE took 1.3s. Estimated remaining: 5m 55s. Rate: 156.3 symbols/min [2025-10-16T22:38:58.081877] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:58.087629] [DEBUG] [MAIN ] HPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:58.089392] [INFO ] [MAIN ] HPF: Generated 1807 derivative records from 7539 primary records. [2025-10-16T22:38:58.089507] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-16T22:38:58.088435] [DEBUG] [LOCAL ] HPI: Loaded 10730 existing records from primary storage. [2025-10-16T22:38:58.090171] [INFO ] [MAIN ] HPI: Loaded 10730 primary data records. [2025-10-16T22:38:58.151054] [DEBUG] [LOCAL ] HPF: Derivative data saved (1807 records). [2025-10-16T22:38:58.163769] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-10-16T22:38:58.180812] [INFO ] [MAIN ] Derivative Progress: 880/1803 symbols completed. HPF took 0.8s. Estimated remaining: 5m 54s. Rate: 156.5 symbols/min [2025-10-16T22:38:58.198299] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:58.517366] [DEBUG] [LOCAL ] HPP: Loaded 51562 existing records from primary storage. [2025-10-16T22:38:58.518834] [INFO ] [MAIN ] HPP: Loaded 51562 primary data records. [2025-10-16T22:38:58.745125] [DEBUG] [LOCAL ] HPQ: Loaded 54059 existing records from primary storage. [2025-10-16T22:38:58.860269] [INFO ] [MAIN ] HPQ: Loaded 54059 primary data records. [2025-10-16T22:38:59.011948] [DEBUG] [MAIN ] HPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:59.019072] [INFO ] [MAIN ] HPI: Generated 1807 derivative records from 10730 primary records. [2025-10-16T22:38:59.069087] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-16T22:38:59.209378] [DEBUG] [LOCAL ] HPI: Derivative data saved (1807 records). [2025-10-16T22:38:59.209807] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-10-16T22:38:59.212187] [INFO ] [MAIN ] Derivative Progress: 881/1803 symbols completed. HPI took 1.2s. Estimated remaining: 5m 54s. Rate: 156.2 symbols/min [2025-10-16T22:38:59.212473] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:59.235761] [DEBUG] [MAIN ] HPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:59.236738] [INFO ] [MAIN ] HPP: Generated 1807 derivative records from 51562 primary records. [2025-10-16T22:38:59.236987] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-16T22:38:59.256477] [DEBUG] [LOCAL ] HPS: Loaded 10382 existing records from primary storage. [2025-10-16T22:38:59.257446] [INFO ] [MAIN ] HPS: Loaded 10382 primary data records. [2025-10-16T22:38:59.257726] [DEBUG] [LOCAL ] HPP: Derivative data saved (1807 records). [2025-10-16T22:38:59.269217] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-10-16T22:38:59.271956] [INFO ] [MAIN ] Derivative Progress: 882/1803 symbols completed. HPP took 1.2s. Estimated remaining: 5m 53s. Rate: 156.3 symbols/min [2025-10-16T22:38:59.297771] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:59.430584] [DEBUG] [MAIN ] HPQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:59.468696] [INFO ] [MAIN ] HPQ: Generated 1807 derivative records from 54059 primary records. [2025-10-16T22:38:59.468874] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-16T22:38:59.615575] [DEBUG] [LOCAL ] HQH: Loaded 26023 existing records from primary storage. [2025-10-16T22:38:59.617078] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1807 records). [2025-10-16T22:38:59.617424] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-10-16T22:38:59.617782] [INFO ] [MAIN ] HQH: Loaded 26023 primary data records. [2025-10-16T22:38:59.621480] [INFO ] [MAIN ] Derivative Progress: 883/1803 symbols completed. HPQ took 1.4s. Estimated remaining: 5m 53s. Rate: 156.3 symbols/min [2025-10-16T22:38:59.933156] [DEBUG] [MAIN ] HPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:59.933955] [INFO ] [MAIN ] HPS: Generated 1807 derivative records from 10382 primary records. [2025-10-16T22:38:59.934975] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-16T22:38:59.951975] [DEBUG] [LOCAL ] HPS: Derivative data saved (1807 records). [2025-10-16T22:38:59.952369] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-10-16T22:38:59.954797] [INFO ] [MAIN ] Derivative Progress: 884/1803 symbols completed. HPS took 0.7s. Estimated remaining: 5m 53s. Rate: 156.4 symbols/min [2025-10-16T22:38:59.973409] [DEBUG] [MAIN ] HQH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:38:59.973978] [INFO ] [MAIN ] HQH: Generated 1807 derivative records from 26023 primary records. [2025-10-16T22:38:59.974038] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-16T22:38:59.989289] [DEBUG] [LOCAL ] HQH: Derivative data saved (1807 records). [2025-10-16T22:38:59.989345] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-10-16T22:38:59.991930] [INFO ] [MAIN ] Derivative Progress: 885/1803 symbols completed. HQH took 0.7s. Estimated remaining: 5m 52s. Rate: 156.5 symbols/min [2025-10-16T22:38:59.992316] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:59.992883] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:38:59.992396] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:00.026240] [DEBUG] [LOCAL ] HQL: Loaded 17085 existing records from primary storage. [2025-10-16T22:39:00.026436] [INFO ] [MAIN ] HQL: Loaded 17085 primary data records. [2025-10-16T22:39:00.245383] [DEBUG] [LOCAL ] HR: Loaded 52488 existing records from primary storage. [2025-10-16T22:39:00.281057] [INFO ] [MAIN ] HR: Loaded 52488 primary data records. [2025-10-16T22:39:00.281861] [DEBUG] [LOCAL ] HRB: Loaded 48745 existing records from primary storage. [2025-10-16T22:39:00.282314] [INFO ] [MAIN ] HRB: Loaded 48745 primary data records. [2025-10-16T22:39:01.109169] [DEBUG] [MAIN ] HQL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:01.111487] [INFO ] [MAIN ] HQL: Generated 1807 derivative records from 17085 primary records. [2025-10-16T22:39:01.111884] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-16T22:39:01.132124] [DEBUG] [LOCAL ] HQL: Derivative data saved (1807 records). [2025-10-16T22:39:01.132367] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-10-16T22:39:01.135198] [INFO ] [MAIN ] Derivative Progress: 886/1803 symbols completed. HQL took 1.1s. Estimated remaining: 5m 52s. Rate: 156.2 symbols/min [2025-10-16T22:39:01.135594] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:01.151520] [DEBUG] [MAIN ] HR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:01.153178] [INFO ] [MAIN ] HR: Generated 1807 derivative records from 52488 primary records. [2025-10-16T22:39:01.153330] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-16T22:39:01.178255] [DEBUG] [MAIN ] HRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:01.183346] [INFO ] [MAIN ] HRB: Generated 1807 derivative records from 48745 primary records. [2025-10-16T22:39:01.183513] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-16T22:39:01.182551] [DEBUG] [LOCAL ] HR: Derivative data saved (1807 records). [2025-10-16T22:39:01.184324] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-10-16T22:39:01.187705] [INFO ] [MAIN ] Derivative Progress: 887/1803 symbols completed. HR took 1.2s. Estimated remaining: 5m 52s. Rate: 156.3 symbols/min [2025-10-16T22:39:01.195151] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:01.211770] [DEBUG] [LOCAL ] HRB: Derivative data saved (1807 records). [2025-10-16T22:39:01.211928] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-10-16T22:39:01.214966] [INFO ] [MAIN ] Derivative Progress: 888/1803 symbols completed. HRB took 1.2s. Estimated remaining: 5m 51s. Rate: 156.5 symbols/min [2025-10-16T22:39:01.215198] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:01.225961] [DEBUG] [LOCAL ] HRI: Loaded 32632 existing records from primary storage. [2025-10-16T22:39:01.226104] [INFO ] [MAIN ] HRI: Loaded 32632 primary data records. [2025-10-16T22:39:01.523336] [DEBUG] [LOCAL ] HRTG: Loaded 34673 existing records from primary storage. [2025-10-16T22:39:01.551083] [INFO ] [MAIN ] HRTG: Loaded 34673 primary data records. [2025-10-16T22:39:01.696391] [DEBUG] [LOCAL ] HRL: Loaded 53516 existing records from primary storage. [2025-10-16T22:39:01.702180] [INFO ] [MAIN ] HRL: Loaded 53516 primary data records. [2025-10-16T22:39:02.282379] [DEBUG] [MAIN ] HRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:02.283984] [INFO ] [MAIN ] HRI: Generated 1807 derivative records from 32632 primary records. [2025-10-16T22:39:02.284789] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-16T22:39:02.303946] [DEBUG] [LOCAL ] HRI: Derivative data saved (1807 records). [2025-10-16T22:39:02.306527] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-10-16T22:39:02.309010] [INFO ] [MAIN ] Derivative Progress: 889/1803 symbols completed. HRI took 1.2s. Estimated remaining: 5m 51s. Rate: 156.2 symbols/min [2025-10-16T22:39:02.309864] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:02.323579] [DEBUG] [MAIN ] HRTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:02.324319] [INFO ] [MAIN ] HRTG: Generated 1807 derivative records from 34673 primary records. [2025-10-16T22:39:02.324468] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-16T22:39:02.350045] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1807 records). [2025-10-16T22:39:02.350497] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-10-16T22:39:02.354507] [INFO ] [MAIN ] Derivative Progress: 890/1803 symbols completed. HRTG took 1.1s. Estimated remaining: 5m 50s. Rate: 156.3 symbols/min [2025-10-16T22:39:02.362430] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:02.382348] [DEBUG] [MAIN ] HRL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:02.383315] [INFO ] [MAIN ] HRL: Generated 1807 derivative records from 53516 primary records. [2025-10-16T22:39:02.383388] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-16T22:39:02.417156] [DEBUG] [LOCAL ] HRL: Derivative data saved (1807 records). [2025-10-16T22:39:02.418837] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-10-16T22:39:02.425446] [DEBUG] [LOCAL ] HSBC: Loaded 51390 existing records from primary storage. [2025-10-16T22:39:02.429549] [INFO ] [MAIN ] HSBC: Loaded 51390 primary data records. [2025-10-16T22:39:02.425843] [DEBUG] [LOCAL ] HSHP: Loaded 14969 existing records from primary storage. [2025-10-16T22:39:02.429389] [INFO ] [MAIN ] Derivative Progress: 891/1803 symbols completed. HRL took 1.2s. Estimated remaining: 5m 50s. Rate: 156.5 symbols/min [2025-10-16T22:39:02.430043] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:02.435343] [INFO ] [MAIN ] HSHP: Loaded 14969 primary data records. [2025-10-16T22:39:03.050394] [DEBUG] [LOCAL ] HSY: Loaded 50818 existing records from primary storage. [2025-10-16T22:39:03.051025] [INFO ] [MAIN ] HSY: Loaded 50818 primary data records. [2025-10-16T22:39:03.386889] [DEBUG] [MAIN ] HSBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:03.388181] [INFO ] [MAIN ] HSBC: Generated 1807 derivative records from 51390 primary records. [2025-10-16T22:39:03.390022] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-10-16T22:39:03.420004] [DEBUG] [MAIN ] HSHP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:03.421961] [INFO ] [MAIN ] HSHP: Generated 1807 derivative records from 14969 primary records. [2025-10-16T22:39:03.422588] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-16T22:39:03.424102] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1807 records). [2025-10-16T22:39:03.424550] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-10-16T22:39:03.440012] [INFO ] [MAIN ] Derivative Progress: 892/1803 symbols completed. HSBC took 1.1s. Estimated remaining: 5m 50s. Rate: 156.2 symbols/min [2025-10-16T22:39:03.440850] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:03.447882] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1807 records). [2025-10-16T22:39:03.448346] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-10-16T22:39:03.452075] [INFO ] [MAIN ] Derivative Progress: 893/1803 symbols completed. HSHP took 1.1s. Estimated remaining: 5m 49s. Rate: 156.4 symbols/min [2025-10-16T22:39:03.452421] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:03.470714] [DEBUG] [MAIN ] HSY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:03.471678] [INFO ] [MAIN ] HSY: Generated 1807 derivative records from 50818 primary records. [2025-10-16T22:39:03.471746] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-16T22:39:03.494722] [DEBUG] [LOCAL ] HSY: Derivative data saved (1807 records). [2025-10-16T22:39:03.494857] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-10-16T22:39:03.498804] [INFO ] [MAIN ] Derivative Progress: 894/1803 symbols completed. HSY took 1.1s. Estimated remaining: 5m 48s. Rate: 156.5 symbols/min [2025-10-16T22:39:03.499143] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:03.498992] [DEBUG] [LOCAL ] HTD: Loaded 14244 existing records from primary storage. [2025-10-16T22:39:03.499549] [INFO ] [MAIN ] HTD: Loaded 14244 primary data records. [2025-10-16T22:39:03.734850] [DEBUG] [LOCAL ] HTH: Loaded 32799 existing records from primary storage. [2025-10-16T22:39:03.739751] [INFO ] [MAIN ] HTH: Loaded 32799 primary data records. [2025-10-16T22:39:03.740686] [DEBUG] [LOCAL ] HTGC: Loaded 48100 existing records from primary storage. [2025-10-16T22:39:03.847702] [INFO ] [MAIN ] HTGC: Loaded 48100 primary data records. [2025-10-16T22:39:04.523167] [DEBUG] [MAIN ] HTD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:04.524746] [INFO ] [MAIN ] HTD: Generated 1807 derivative records from 14244 primary records. [2025-10-16T22:39:04.525079] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-16T22:39:04.545033] [DEBUG] [LOCAL ] HTD: Derivative data saved (1807 records). [2025-10-16T22:39:04.545160] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-10-16T22:39:04.547223] [INFO ] [MAIN ] Derivative Progress: 895/1803 symbols completed. HTD took 1.1s. Estimated remaining: 5m 49s. Rate: 156.2 symbols/min [2025-10-16T22:39:04.547809] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:04.566347] [DEBUG] [MAIN ] HTH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:04.567139] [INFO ] [MAIN ] HTH: Generated 1807 derivative records from 32799 primary records. [2025-10-16T22:39:04.567251] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-10-16T22:39:04.586226] [DEBUG] [LOCAL ] HTH: Derivative data saved (1807 records). [2025-10-16T22:39:04.586406] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-10-16T22:39:04.589849] [INFO ] [MAIN ] Derivative Progress: 896/1803 symbols completed. HTH took 1.1s. Estimated remaining: 5m 48s. Rate: 156.4 symbols/min [2025-10-16T22:39:04.597931] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:04.603842] [DEBUG] [MAIN ] HTGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:04.613374] [INFO ] [MAIN ] HTGC: Generated 1807 derivative records from 48100 primary records. [2025-10-16T22:39:04.613488] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-10-16T22:39:04.629528] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1807 records). [2025-10-16T22:39:04.639539] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-10-16T22:39:04.642474] [INFO ] [MAIN ] Derivative Progress: 897/1803 symbols completed. HTGC took 1.2s. Estimated remaining: 5m 47s. Rate: 156.5 symbols/min [2025-10-16T22:39:04.642730] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:04.644915] [DEBUG] [LOCAL ] HUBB: Loaded 36713 existing records from primary storage. [2025-10-16T22:39:04.645051] [INFO ] [MAIN ] HUBB: Loaded 36713 primary data records. [2025-10-16T22:39:04.853563] [DEBUG] [LOCAL ] HUBS: Loaded 40357 existing records from primary storage. [2025-10-16T22:39:04.856800] [INFO ] [MAIN ] HUBS: Loaded 40357 primary data records. [2025-10-16T22:39:05.148715] [DEBUG] [LOCAL ] HUM: Loaded 49651 existing records from primary storage. [2025-10-16T22:39:05.179103] [INFO ] [MAIN ] HUM: Loaded 49651 primary data records. [2025-10-16T22:39:05.660455] [DEBUG] [MAIN ] HUBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:05.664923] [INFO ] [MAIN ] HUBB: Generated 1807 derivative records from 36713 primary records. [2025-10-16T22:39:05.665377] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-16T22:39:05.693196] [DEBUG] [MAIN ] HUBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:05.697738] [INFO ] [MAIN ] HUBS: Generated 1807 derivative records from 40357 primary records. [2025-10-16T22:39:05.699553] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1807 records). [2025-10-16T22:39:05.699915] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-10-16T22:39:05.703571] [INFO ] [MAIN ] Derivative Progress: 898/1803 symbols completed. HUBB took 1.2s. Estimated remaining: 5m 48s. Rate: 156.2 symbols/min [2025-10-16T22:39:05.699726] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-16T22:39:05.737292] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1807 records). [2025-10-16T22:39:05.737444] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-10-16T22:39:05.736035] [DEBUG] [MAIN ] HUM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:05.740593] [INFO ] [MAIN ] Derivative Progress: 899/1803 symbols completed. HUBS took 1.1s. Estimated remaining: 5m 47s. Rate: 156.4 symbols/min [2025-10-16T22:39:05.741610] [INFO ] [MAIN ] HUM: Generated 1807 derivative records from 49651 primary records. [2025-10-16T22:39:05.741836] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-10-16T22:39:05.757164] [DEBUG] [LOCAL ] HUM: Derivative data saved (1807 records). [2025-10-16T22:39:05.757223] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-10-16T22:39:05.760123] [INFO ] [MAIN ] Derivative Progress: 900/1803 symbols completed. HUM took 1.1s. Estimated remaining: 5m 46s. Rate: 156.5 symbols/min [2025-10-16T22:39:05.760563] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:05.760501] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:05.760780] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:05.783676] [DEBUG] [LOCAL ] HVT: Loaded 15241 existing records from primary storage. [2025-10-16T22:39:05.783927] [INFO ] [MAIN ] HVT: Loaded 15241 primary data records. [2025-10-16T22:39:06.139802] [DEBUG] [LOCAL ] HUYA: Loaded 44168 existing records from primary storage. [2025-10-16T22:39:06.140683] [INFO ] [MAIN ] HUYA: Loaded 44168 primary data records. [2025-10-16T22:39:06.199504] [DEBUG] [LOCAL ] HUN: Loaded 53604 existing records from primary storage. [2025-10-16T22:39:06.233570] [INFO ] [MAIN ] HUN: Loaded 53604 primary data records. [2025-10-16T22:39:06.879991] [DEBUG] [MAIN ] HVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:06.881578] [INFO ] [MAIN ] HVT: Generated 1807 derivative records from 15241 primary records. [2025-10-16T22:39:06.881829] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-16T22:39:06.906094] [DEBUG] [LOCAL ] HVT: Derivative data saved (1807 records). [2025-10-16T22:39:06.906199] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-10-16T22:39:06.909002] [INFO ] [MAIN ] Derivative Progress: 901/1803 symbols completed. HVT took 1.1s. Estimated remaining: 5m 47s. Rate: 156.2 symbols/min [2025-10-16T22:39:06.909342] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:06.941196] [DEBUG] [MAIN ] HUYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:06.942927] [INFO ] [MAIN ] HUYA: Generated 1807 derivative records from 44168 primary records. [2025-10-16T22:39:06.943091] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-16T22:39:06.942075] [DEBUG] [MAIN ] HUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:06.944176] [INFO ] [MAIN ] HUN: Generated 1807 derivative records from 53604 primary records. [2025-10-16T22:39:06.944766] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-16T22:39:06.988179] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1807 records). [2025-10-16T22:39:06.988342] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-10-16T22:39:06.986982] [DEBUG] [LOCAL ] HUN: Derivative data saved (1807 records). [2025-10-16T22:39:06.991035] [INFO ] [MAIN ] Derivative Progress: 902/1803 symbols completed. HUYA took 1.2s. Estimated remaining: 5m 46s. Rate: 156.3 symbols/min [2025-10-16T22:39:06.991212] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-10-16T22:39:06.991396] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:06.994213] [INFO ] [MAIN ] Derivative Progress: 903/1803 symbols completed. HUN took 1.2s. Estimated remaining: 5m 45s. Rate: 156.5 symbols/min [2025-10-16T22:39:06.994630] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:07.019044] [DEBUG] [LOCAL ] HY: Loaded 10116 existing records from primary storage. [2025-10-16T22:39:07.019172] [INFO ] [MAIN ] HY: Loaded 10116 primary data records. [2025-10-16T22:39:07.141518] [DEBUG] [LOCAL ] HWM: Loaded 53180 existing records from primary storage. [2025-10-16T22:39:07.173014] [INFO ] [MAIN ] HWM: Loaded 53180 primary data records. [2025-10-16T22:39:07.465165] [DEBUG] [LOCAL ] HXL: Loaded 46186 existing records from primary storage. [2025-10-16T22:39:07.466156] [INFO ] [MAIN ] HXL: Loaded 46186 primary data records. [2025-10-16T22:39:07.992971] [DEBUG] [MAIN ] HY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:07.993891] [INFO ] [MAIN ] HY: Generated 1807 derivative records from 10116 primary records. [2025-10-16T22:39:07.994155] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-16T22:39:08.013178] [DEBUG] [LOCAL ] HY: Derivative data saved (1807 records). [2025-10-16T22:39:08.025806] [DEBUG] [MAIN ] HWM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:08.026484] [INFO ] [MAIN ] HWM: Generated 1807 derivative records from 53180 primary records. [2025-10-16T22:39:08.026746] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-16T22:39:08.025541] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-10-16T22:39:08.031146] [INFO ] [MAIN ] Derivative Progress: 904/1803 symbols completed. HY took 1.0s. Estimated remaining: 5m 45s. Rate: 156.2 symbols/min [2025-10-16T22:39:08.040401] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:08.047458] [DEBUG] [LOCAL ] HWM: Derivative data saved (1807 records). [2025-10-16T22:39:08.047621] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-10-16T22:39:08.058470] [INFO ] [MAIN ] Derivative Progress: 905/1803 symbols completed. HWM took 1.1s. Estimated remaining: 5m 45s. Rate: 156.3 symbols/min [2025-10-16T22:39:08.064003] [DEBUG] [MAIN ] HXL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:08.063703] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:08.064975] [INFO ] [MAIN ] HXL: Generated 1807 derivative records from 46186 primary records. [2025-10-16T22:39:08.065303] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-16T22:39:08.089070] [DEBUG] [LOCAL ] HYI: Loaded 9891 existing records from primary storage. [2025-10-16T22:39:08.089382] [INFO ] [MAIN ] HYI: Loaded 9891 primary data records. [2025-10-16T22:39:08.089141] [DEBUG] [LOCAL ] HXL: Derivative data saved (1807 records). [2025-10-16T22:39:08.109922] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-10-16T22:39:08.129473] [INFO ] [MAIN ] Derivative Progress: 906/1803 symbols completed. HXL took 1.1s. Estimated remaining: 5m 44s. Rate: 156.5 symbols/min [2025-10-16T22:39:08.157754] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:08.214686] [DEBUG] [LOCAL ] HYT: Loaded 33837 existing records from primary storage. [2025-10-16T22:39:08.233790] [DEBUG] [LOCAL ] HYTR: Loaded 3165 existing records from primary storage. [2025-10-16T22:39:08.226400] [INFO ] [MAIN ] HYT: Loaded 33837 primary data records. [2025-10-16T22:39:08.265295] [INFO ] [MAIN ] HYTR: Loaded 3165 primary data records. [2025-10-16T22:39:09.065915] [DEBUG] [MAIN ] HYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:09.066954] [INFO ] [MAIN ] HYI: Generated 1807 derivative records from 9891 primary records. [2025-10-16T22:39:09.067223] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-16T22:39:09.085072] [DEBUG] [LOCAL ] HYI: Derivative data saved (1807 records). [2025-10-16T22:39:09.086375] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-10-16T22:39:09.088740] [INFO ] [MAIN ] Derivative Progress: 907/1803 symbols completed. HYI took 1.0s. Estimated remaining: 5m 44s. Rate: 156.2 symbols/min [2025-10-16T22:39:09.089852] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:09.106561] [DEBUG] [MAIN ] HYT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:09.107558] [INFO ] [MAIN ] HYT: Generated 1807 derivative records from 33837 primary records. [2025-10-16T22:39:09.107820] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-10-16T22:39:09.128812] [DEBUG] [MAIN ] HYTR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:39:09.134190] [INFO ] [MAIN ] HYTR: Generated 1806 derivative records from 3165 primary records. [2025-10-16T22:39:09.136909] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-16T22:39:09.137931] [DEBUG] [LOCAL ] HYT: Derivative data saved (1807 records). [2025-10-16T22:39:09.138257] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-10-16T22:39:09.141401] [INFO ] [MAIN ] Derivative Progress: 908/1803 symbols completed. HYT took 1.1s. Estimated remaining: 5m 43s. Rate: 156.4 symbols/min [2025-10-16T22:39:09.142632] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:09.156629] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1806 records). [2025-10-16T22:39:09.156844] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-10-16T22:39:09.159844] [INFO ] [MAIN ] Derivative Progress: 909/1803 symbols completed. HYTR took 1.0s. Estimated remaining: 5m 43s. Rate: 156.5 symbols/min [2025-10-16T22:39:09.160066] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:09.175832] [DEBUG] [LOCAL ] IAE: Loaded 6326 existing records from primary storage. [2025-10-16T22:39:09.176106] [INFO ] [MAIN ] IAE: Loaded 6326 primary data records. [2025-10-16T22:39:09.253241] [DEBUG] [LOCAL ] HZO: Loaded 29275 existing records from primary storage. [2025-10-16T22:39:09.287696] [INFO ] [MAIN ] HZO: Loaded 29275 primary data records. [2025-10-16T22:39:09.674867] [DEBUG] [LOCAL ] IAG: Loaded 53878 existing records from primary storage. [2025-10-16T22:39:09.730635] [INFO ] [MAIN ] IAG: Loaded 53878 primary data records. [2025-10-16T22:39:10.357783] [DEBUG] [MAIN ] IAE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:10.359185] [INFO ] [MAIN ] IAE: Generated 1807 derivative records from 6326 primary records. [2025-10-16T22:39:10.359634] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-16T22:39:10.383347] [DEBUG] [LOCAL ] IAE: Derivative data saved (1807 records). [2025-10-16T22:39:10.384188] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-10-16T22:39:10.387098] [INFO ] [MAIN ] Derivative Progress: 910/1803 symbols completed. IAE took 1.2s. Estimated remaining: 5m 43s. Rate: 156.2 symbols/min [2025-10-16T22:39:10.389464] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:10.415490] [DEBUG] [MAIN ] HZO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:10.416703] [INFO ] [MAIN ] HZO: Generated 1807 derivative records from 29275 primary records. [2025-10-16T22:39:10.416834] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-10-16T22:39:10.457857] [DEBUG] [LOCAL ] HZO: Derivative data saved (1807 records). [2025-10-16T22:39:10.458156] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-10-16T22:39:10.461719] [INFO ] [MAIN ] Derivative Progress: 911/1803 symbols completed. HZO took 1.4s. Estimated remaining: 5m 42s. Rate: 156.3 symbols/min [2025-10-16T22:39:10.462208] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:10.482061] [DEBUG] [MAIN ] IAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:10.483078] [INFO ] [MAIN ] IAG: Generated 1807 derivative records from 53878 primary records. [2025-10-16T22:39:10.483265] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-16T22:39:10.517169] [DEBUG] [LOCAL ] IAG: Derivative data saved (1807 records). [2025-10-16T22:39:10.518174] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-16T22:39:10.521828] [INFO ] [MAIN ] Derivative Progress: 912/1803 symbols completed. IAG took 1.4s. Estimated remaining: 5m 42s. Rate: 156.4 symbols/min [2025-10-16T22:39:10.537682] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:10.540692] [DEBUG] [LOCAL ] IBM: Loaded 54023 existing records from primary storage. [2025-10-16T22:39:10.540824] [INFO ] [MAIN ] IBM: Loaded 54023 primary data records. [2025-10-16T22:39:10.906423] [DEBUG] [LOCAL ] IBN: Loaded 53205 existing records from primary storage. [2025-10-16T22:39:10.928581] [INFO ] [MAIN ] IBN: Loaded 53205 primary data records. [2025-10-16T22:39:10.930436] [DEBUG] [LOCAL ] IBP: Loaded 29018 existing records from primary storage. [2025-10-16T22:39:10.962420] [INFO ] [MAIN ] IBP: Loaded 29018 primary data records. [2025-10-16T22:39:11.568128] [DEBUG] [MAIN ] IBM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:11.569939] [INFO ] [MAIN ] IBM: Generated 1807 derivative records from 54023 primary records. [2025-10-16T22:39:11.570460] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-16T22:39:11.588535] [DEBUG] [LOCAL ] IBM: Derivative data saved (1807 records). [2025-10-16T22:39:11.588903] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-16T22:39:11.592333] [INFO ] [MAIN ] Derivative Progress: 913/1803 symbols completed. IBM took 1.2s. Estimated remaining: 5m 42s. Rate: 156.1 symbols/min [2025-10-16T22:39:11.609696] [DEBUG] [MAIN ] IBN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:11.610396] [INFO ] [MAIN ] IBN: Generated 1807 derivative records from 53205 primary records. [2025-10-16T22:39:11.610540] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-16T22:39:11.640241] [DEBUG] [MAIN ] IBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:11.641347] [INFO ] [MAIN ] IBP: Generated 1807 derivative records from 29018 primary records. [2025-10-16T22:39:11.641865] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-16T22:39:11.642812] [DEBUG] [LOCAL ] IBN: Derivative data saved (1807 records). [2025-10-16T22:39:11.643071] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-16T22:39:11.645500] [INFO ] [MAIN ] Derivative Progress: 914/1803 symbols completed. IBN took 1.2s. Estimated remaining: 5m 41s. Rate: 156.3 symbols/min [2025-10-16T22:39:11.660512] [DEBUG] [LOCAL ] IBP: Derivative data saved (1807 records). [2025-10-16T22:39:11.660573] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-10-16T22:39:11.663303] [INFO ] [MAIN ] Derivative Progress: 915/1803 symbols completed. IBP took 1.1s. Estimated remaining: 5m 41s. Rate: 156.5 symbols/min [2025-10-16T22:39:11.663847] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:11.664011] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:11.663961] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:11.721909] [DEBUG] [LOCAL ] ICL: Loaded 38831 existing records from primary storage. [2025-10-16T22:39:11.732574] [INFO ] [MAIN ] ICL: Loaded 38831 primary data records. [2025-10-16T22:39:11.733123] [DEBUG] [LOCAL ] IBTA: Loaded 36892 existing records from primary storage. [2025-10-16T22:39:11.744813] [INFO ] [MAIN ] IBTA: Loaded 36892 primary data records. [2025-10-16T22:39:11.983845] [DEBUG] [LOCAL ] ICE: Loaded 53408 existing records from primary storage. [2025-10-16T22:39:12.031061] [INFO ] [MAIN ] ICE: Loaded 53408 primary data records. [2025-10-16T22:39:12.777294] [DEBUG] [MAIN ] ICL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:12.790916] [DEBUG] [MAIN ] IBTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:12.794214] [INFO ] [MAIN ] IBTA: Generated 1807 derivative records from 36892 primary records. [2025-10-16T22:39:12.794392] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-16T22:39:12.792066] [INFO ] [MAIN ] ICL: Generated 1807 derivative records from 38831 primary records. [2025-10-16T22:39:12.794519] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-16T22:39:12.834442] [DEBUG] [LOCAL ] ICL: Derivative data saved (1807 records). [2025-10-16T22:39:12.835203] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-16T22:39:12.835473] [DEBUG] [MAIN ] ICE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:12.838248] [INFO ] [MAIN ] Derivative Progress: 916/1803 symbols completed. ICL took 1.2s. Estimated remaining: 5m 41s. Rate: 156.1 symbols/min [2025-10-16T22:39:12.839018] [INFO ] [MAIN ] ICE: Generated 1807 derivative records from 53408 primary records. [2025-10-16T22:39:12.839237] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:12.839939] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-16T22:39:12.857547] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1807 records). [2025-10-16T22:39:12.857881] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-16T22:39:12.861178] [INFO ] [MAIN ] Derivative Progress: 917/1803 symbols completed. IBTA took 1.2s. Estimated remaining: 5m 40s. Rate: 156.3 symbols/min [2025-10-16T22:39:12.861573] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:12.864150] [DEBUG] [LOCAL ] ICE: Derivative data saved (1807 records). [2025-10-16T22:39:12.864228] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-16T22:39:12.867105] [INFO ] [MAIN ] Derivative Progress: 918/1803 symbols completed. ICE took 1.2s. Estimated remaining: 5m 39s. Rate: 156.4 symbols/min [2025-10-16T22:39:12.867413] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:12.885907] [DEBUG] [LOCAL ] IDE: Loaded 9225 existing records from primary storage. [2025-10-16T22:39:12.886024] [INFO ] [MAIN ] IDE: Loaded 9225 primary data records. [2025-10-16T22:39:13.011342] [DEBUG] [LOCAL ] IDA: Loaded 32985 existing records from primary storage. [2025-10-16T22:39:13.025608] [INFO ] [MAIN ] IDA: Loaded 32985 primary data records. [2025-10-16T22:39:13.025512] [DEBUG] [LOCAL ] IDT: Loaded 18660 existing records from primary storage. [2025-10-16T22:39:13.025962] [INFO ] [MAIN ] IDT: Loaded 18660 primary data records. [2025-10-16T22:39:13.860097] [DEBUG] [MAIN ] IDE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:13.861410] [INFO ] [MAIN ] IDE: Generated 1807 derivative records from 9225 primary records. [2025-10-16T22:39:13.861870] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-16T22:39:13.887369] [DEBUG] [LOCAL ] IDE: Derivative data saved (1807 records). [2025-10-16T22:39:13.896602] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-16T22:39:13.914864] [DEBUG] [MAIN ] IDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:13.918677] [INFO ] [MAIN ] IDT: Generated 1807 derivative records from 18660 primary records. [2025-10-16T22:39:13.917375] [INFO ] [MAIN ] Derivative Progress: 919/1803 symbols completed. IDE took 1.1s. Estimated remaining: 5m 40s. Rate: 156.1 symbols/min [2025-10-16T22:39:13.919258] [DEBUG] [MAIN ] IDA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:13.919375] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-16T22:39:13.920345] [INFO ] [MAIN ] IDA: Generated 1807 derivative records from 32985 primary records. [2025-10-16T22:39:13.919532] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:13.921496] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-16T22:39:13.948272] [DEBUG] [LOCAL ] IDT: Derivative data saved (1807 records). [2025-10-16T22:39:13.951626] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-16T22:39:13.956149] [INFO ] [MAIN ] Derivative Progress: 920/1803 symbols completed. IDT took 1.1s. Estimated remaining: 5m 39s. Rate: 156.3 symbols/min [2025-10-16T22:39:13.956548] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:13.962596] [DEBUG] [LOCAL ] IDA: Derivative data saved (1807 records). [2025-10-16T22:39:13.962792] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-16T22:39:13.966273] [INFO ] [MAIN ] Derivative Progress: 921/1803 symbols completed. IDA took 1.1s. Estimated remaining: 5m 38s. Rate: 156.5 symbols/min [2025-10-16T22:39:13.966633] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:14.021883] [DEBUG] [LOCAL ] IEX: Loaded 38731 existing records from primary storage. [2025-10-16T22:39:14.020867] [DEBUG] [LOCAL ] IFN: Loaded 18627 existing records from primary storage. [2025-10-16T22:39:14.022152] [INFO ] [MAIN ] IEX: Loaded 38731 primary data records. [2025-10-16T22:39:14.022233] [INFO ] [MAIN ] IFN: Loaded 18627 primary data records. [2025-10-16T22:39:14.245079] [DEBUG] [LOCAL ] IFF: Loaded 51530 existing records from primary storage. [2025-10-16T22:39:14.245361] [INFO ] [MAIN ] IFF: Loaded 51530 primary data records. [2025-10-16T22:39:15.009424] [DEBUG] [MAIN ] IFN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:15.009774] [DEBUG] [MAIN ] IEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:15.011628] [INFO ] [MAIN ] IEX: Generated 1807 derivative records from 38731 primary records. [2025-10-16T22:39:15.010885] [INFO ] [MAIN ] IFN: Generated 1807 derivative records from 18627 primary records. [2025-10-16T22:39:15.011840] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-16T22:39:15.011786] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-16T22:39:15.031012] [DEBUG] [LOCAL ] IFN: Derivative data saved (1807 records). [2025-10-16T22:39:15.053717] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-16T22:39:15.058310] [DEBUG] [LOCAL ] IEX: Derivative data saved (1807 records). [2025-10-16T22:39:15.061584] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-16T22:39:15.061505] [INFO ] [MAIN ] Derivative Progress: 922/1803 symbols completed. IFN took 1.1s. Estimated remaining: 5m 39s. Rate: 156.1 symbols/min [2025-10-16T22:39:15.062337] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:15.064418] [INFO ] [MAIN ] Derivative Progress: 923/1803 symbols completed. IEX took 1.1s. Estimated remaining: 5m 38s. Rate: 156.3 symbols/min [2025-10-16T22:39:15.062111] [DEBUG] [MAIN ] IFF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:15.064762] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:15.065662] [INFO ] [MAIN ] IFF: Generated 1807 derivative records from 51530 primary records. [2025-10-16T22:39:15.065736] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-16T22:39:15.083264] [DEBUG] [LOCAL ] IFF: Derivative data saved (1807 records). [2025-10-16T22:39:15.085424] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-16T22:39:15.088393] [INFO ] [MAIN ] Derivative Progress: 924/1803 symbols completed. IFF took 1.1s. Estimated remaining: 5m 37s. Rate: 156.5 symbols/min [2025-10-16T22:39:15.088765] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:15.094507] [DEBUG] [LOCAL ] IGA: Loaded 10286 existing records from primary storage. [2025-10-16T22:39:15.094742] [INFO ] [MAIN ] IGA: Loaded 10286 primary data records. [2025-10-16T22:39:15.246332] [DEBUG] [LOCAL ] IFS: Loaded 22745 existing records from primary storage. [2025-10-16T22:39:15.246580] [INFO ] [MAIN ] IFS: Loaded 22745 primary data records. [2025-10-16T22:39:15.314042] [DEBUG] [LOCAL ] IGD: Loaded 19512 existing records from primary storage. [2025-10-16T22:39:15.341089] [INFO ] [MAIN ] IGD: Loaded 19512 primary data records. [2025-10-16T22:39:16.116510] [DEBUG] [MAIN ] IGA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:16.117601] [INFO ] [MAIN ] IGA: Generated 1807 derivative records from 10286 primary records. [2025-10-16T22:39:16.118012] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-16T22:39:16.137550] [DEBUG] [LOCAL ] IGA: Derivative data saved (1807 records). [2025-10-16T22:39:16.137626] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-16T22:39:16.139632] [INFO ] [MAIN ] Derivative Progress: 925/1803 symbols completed. IGA took 1.1s. Estimated remaining: 5m 37s. Rate: 156.2 symbols/min [2025-10-16T22:39:16.147578] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:16.153201] [DEBUG] [MAIN ] IFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:16.154358] [INFO ] [MAIN ] IFS: Generated 1807 derivative records from 22745 primary records. [2025-10-16T22:39:16.154552] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-16T22:39:16.186668] [DEBUG] [MAIN ] IGD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:16.186297] [DEBUG] [LOCAL ] IGI: Loaded 4035 existing records from primary storage. [2025-10-16T22:39:16.188510] [INFO ] [MAIN ] IGD: Generated 1807 derivative records from 19512 primary records. [2025-10-16T22:39:16.189686] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-16T22:39:16.190748] [INFO ] [MAIN ] IGI: Loaded 4035 primary data records. [2025-10-16T22:39:16.222795] [DEBUG] [LOCAL ] IFS: Derivative data saved (1807 records). [2025-10-16T22:39:16.249438] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-16T22:39:16.264370] [DEBUG] [LOCAL ] IGD: Derivative data saved (1807 records). [2025-10-16T22:39:16.267242] [INFO ] [MAIN ] Derivative Progress: 926/1803 symbols completed. IFS took 1.2s. Estimated remaining: 5m 37s. Rate: 156.3 symbols/min [2025-10-16T22:39:16.281344] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-16T22:39:16.293682] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:16.296510] [INFO ] [MAIN ] Derivative Progress: 927/1803 symbols completed. IGD took 1.2s. Estimated remaining: 5m 36s. Rate: 156.4 symbols/min [2025-10-16T22:39:16.318239] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:16.537550] [DEBUG] [LOCAL ] IH: Loaded 2814 existing records from primary storage. [2025-10-16T22:39:16.546236] [INFO ] [MAIN ] IH: Loaded 2814 primary data records. [2025-10-16T22:39:16.662027] [DEBUG] [LOCAL ] IGR: Loaded 30626 existing records from primary storage. [2025-10-16T22:39:16.662420] [INFO ] [MAIN ] IGR: Loaded 30626 primary data records. [2025-10-16T22:39:17.194209] [DEBUG] [MAIN ] IGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:17.197333] [INFO ] [MAIN ] IGI: Generated 1807 derivative records from 4035 primary records. [2025-10-16T22:39:17.197478] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-16T22:39:17.213181] [DEBUG] [LOCAL ] IGI: Derivative data saved (1807 records). [2025-10-16T22:39:17.215340] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-16T22:39:17.217555] [INFO ] [MAIN ] Derivative Progress: 928/1803 symbols completed. IGI took 1.1s. Estimated remaining: 5m 36s. Rate: 156.2 symbols/min [2025-10-16T22:39:17.232535] [DEBUG] [MAIN ] IH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:17.233544] [INFO ] [MAIN ] IH: Generated 1807 derivative records from 2814 primary records. [2025-10-16T22:39:17.233744] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-16T22:39:17.247756] [DEBUG] [LOCAL ] IH: Derivative data saved (1807 records). [2025-10-16T22:39:17.248030] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-16T22:39:17.250953] [INFO ] [MAIN ] Derivative Progress: 929/1803 symbols completed. IH took 0.9s. Estimated remaining: 5m 35s. Rate: 156.4 symbols/min [2025-10-16T22:39:17.265858] [DEBUG] [MAIN ] IGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:17.266491] [INFO ] [MAIN ] IGR: Generated 1807 derivative records from 30626 primary records. [2025-10-16T22:39:17.266551] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-16T22:39:17.281240] [DEBUG] [LOCAL ] IGR: Derivative data saved (1807 records). [2025-10-16T22:39:17.281298] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-16T22:39:17.284141] [INFO ] [MAIN ] Derivative Progress: 930/1803 symbols completed. IGR took 1.0s. Estimated remaining: 5m 35s. Rate: 156.5 symbols/min [2025-10-16T22:39:17.284787] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:17.284928] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:17.284702] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:17.296076] [DEBUG] [LOCAL ] IHD: Loaded 7367 existing records from primary storage. [2025-10-16T22:39:17.296274] [INFO ] [MAIN ] IHD: Loaded 7367 primary data records. [2025-10-16T22:39:17.426183] [DEBUG] [LOCAL ] IHG: Loaded 24519 existing records from primary storage. [2025-10-16T22:39:17.426749] [INFO ] [MAIN ] IHG: Loaded 24519 primary data records. [2025-10-16T22:39:17.520050] [DEBUG] [LOCAL ] IHS: Loaded 37894 existing records from primary storage. [2025-10-16T22:39:17.699729] [INFO ] [MAIN ] IHS: Loaded 37894 primary data records. [2025-10-16T22:39:18.270239] [DEBUG] [MAIN ] IHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:18.271366] [INFO ] [MAIN ] IHD: Generated 1807 derivative records from 7367 primary records. [2025-10-16T22:39:18.272433] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-16T22:39:18.288523] [DEBUG] [LOCAL ] IHD: Derivative data saved (1807 records). [2025-10-16T22:39:18.288691] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-16T22:39:18.290739] [INFO ] [MAIN ] Derivative Progress: 931/1803 symbols completed. IHD took 1.0s. Estimated remaining: 5m 35s. Rate: 156.2 symbols/min [2025-10-16T22:39:18.293406] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:18.309498] [DEBUG] [MAIN ] IHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:18.310392] [INFO ] [MAIN ] IHG: Generated 1807 derivative records from 24519 primary records. [2025-10-16T22:39:18.312088] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-16T22:39:18.329785] [DEBUG] [LOCAL ] IIF: Loaded 5612 existing records from primary storage. [2025-10-16T22:39:18.330395] [INFO ] [MAIN ] IIF: Loaded 5612 primary data records. [2025-10-16T22:39:18.395149] [DEBUG] [MAIN ] IHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:18.410072] [INFO ] [MAIN ] IHS: Generated 1807 derivative records from 37894 primary records. [2025-10-16T22:39:18.420667] [DEBUG] [LOCAL ] IHG: Derivative data saved (1807 records). [2025-10-16T22:39:18.434427] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-16T22:39:18.434510] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-16T22:39:18.468569] [INFO ] [MAIN ] Derivative Progress: 932/1803 symbols completed. IHG took 1.2s. Estimated remaining: 5m 34s. Rate: 156.3 symbols/min [2025-10-16T22:39:18.469134] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:18.525002] [DEBUG] [LOCAL ] IHS: Derivative data saved (1807 records). [2025-10-16T22:39:18.565712] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-16T22:39:18.713498] [INFO ] [MAIN ] Derivative Progress: 933/1803 symbols completed. IHS took 1.4s. Estimated remaining: 5m 34s. Rate: 156.4 symbols/min [2025-10-16T22:39:18.722834] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:18.732836] [DEBUG] [LOCAL ] IIIN: Loaded 16246 existing records from primary storage. [2025-10-16T22:39:18.733443] [INFO ] [MAIN ] IIIN: Loaded 16246 primary data records. [2025-10-16T22:39:18.862011] [DEBUG] [LOCAL ] IIM: Loaded 15782 existing records from primary storage. [2025-10-16T22:39:18.862365] [INFO ] [MAIN ] IIM: Loaded 15782 primary data records. [2025-10-16T22:39:19.268344] [DEBUG] [MAIN ] IIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:19.377685] [INFO ] [MAIN ] IIF: Generated 1807 derivative records from 5612 primary records. [2025-10-16T22:39:19.388358] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-16T22:39:19.407818] [DEBUG] [LOCAL ] IIF: Derivative data saved (1807 records). [2025-10-16T22:39:19.408729] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-16T22:39:19.411462] [INFO ] [MAIN ] Derivative Progress: 934/1803 symbols completed. IIF took 1.1s. Estimated remaining: 5m 34s. Rate: 156.3 symbols/min [2025-10-16T22:39:19.411829] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:19.433116] [DEBUG] [MAIN ] IIIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:19.434165] [INFO ] [MAIN ] IIIN: Generated 1807 derivative records from 16246 primary records. [2025-10-16T22:39:19.434542] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-16T22:39:19.459760] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1807 records). [2025-10-16T22:39:19.460530] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-16T22:39:19.463426] [INFO ] [MAIN ] Derivative Progress: 935/1803 symbols completed. IIIN took 1.0s. Estimated remaining: 5m 33s. Rate: 156.4 symbols/min [2025-10-16T22:39:19.473898] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:19.475022] [DEBUG] [LOCAL ] IIPR: Loaded 29694 existing records from primary storage. [2025-10-16T22:39:19.475134] [INFO ] [MAIN ] IIPR: Loaded 29694 primary data records. [2025-10-16T22:39:19.563472] [DEBUG] [MAIN ] IIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:19.588297] [INFO ] [MAIN ] IIM: Generated 1807 derivative records from 15782 primary records. [2025-10-16T22:39:19.600038] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-16T22:39:19.826315] [DEBUG] [LOCAL ] IIM: Derivative data saved (1807 records). [2025-10-16T22:39:19.839462] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-16T22:39:19.842503] [INFO ] [MAIN ] Derivative Progress: 936/1803 symbols completed. IIM took 1.1s. Estimated remaining: 5m 33s. Rate: 156.4 symbols/min [2025-10-16T22:39:19.843236] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:19.844956] [DEBUG] [LOCAL ] IMAX: Loaded 43543 existing records from primary storage. [2025-10-16T22:39:19.846526] [INFO ] [MAIN ] IMAX: Loaded 43543 primary data records. [2025-10-16T22:39:20.175080] [DEBUG] [MAIN ] IIPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:20.176141] [INFO ] [MAIN ] IIPR: Generated 1807 derivative records from 29694 primary records. [2025-10-16T22:39:20.176232] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-16T22:39:20.208088] [DEBUG] [LOCAL ] INFA: Loaded 49327 existing records from primary storage. [2025-10-16T22:39:20.208285] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1807 records). [2025-10-16T22:39:20.208528] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-16T22:39:20.211449] [INFO ] [MAIN ] Derivative Progress: 937/1803 symbols completed. IIPR took 0.8s. Estimated remaining: 5m 32s. Rate: 156.4 symbols/min [2025-10-16T22:39:20.212255] [INFO ] [MAIN ] INFA: Loaded 49327 primary data records. [2025-10-16T22:39:20.212741] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:20.514017] [DEBUG] [MAIN ] IMAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:20.572804] [INFO ] [MAIN ] IMAX: Generated 1807 derivative records from 43543 primary records. [2025-10-16T22:39:20.587845] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-16T22:39:20.618740] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1807 records). [2025-10-16T22:39:20.620017] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-16T22:39:20.622670] [INFO ] [MAIN ] Derivative Progress: 938/1803 symbols completed. IMAX took 1.1s. Estimated remaining: 5m 32s. Rate: 156.4 symbols/min [2025-10-16T22:39:20.623858] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:20.625977] [DEBUG] [LOCAL ] INFY: Loaded 53987 existing records from primary storage. [2025-10-16T22:39:20.626103] [INFO ] [MAIN ] INFY: Loaded 53987 primary data records. [2025-10-16T22:39:20.970546] [DEBUG] [MAIN ] INFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:20.973016] [INFO ] [MAIN ] INFA: Generated 1807 derivative records from 49327 primary records. [2025-10-16T22:39:20.973177] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-16T22:39:20.993490] [DEBUG] [LOCAL ] INFA: Derivative data saved (1807 records). [2025-10-16T22:39:21.010526] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-16T22:39:21.015338] [INFO ] [MAIN ] Derivative Progress: 939/1803 symbols completed. INFA took 1.2s. Estimated remaining: 5m 31s. Rate: 156.4 symbols/min [2025-10-16T22:39:21.015569] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:21.019108] [DEBUG] [LOCAL ] ING: Loaded 51112 existing records from primary storage. [2025-10-16T22:39:21.019800] [INFO ] [MAIN ] ING: Loaded 51112 primary data records. [2025-10-16T22:39:21.206328] [DEBUG] [LOCAL ] INGM: Loaded 28536 existing records from primary storage. [2025-10-16T22:39:21.212454] [INFO ] [MAIN ] INGM: Loaded 28536 primary data records. [2025-10-16T22:39:21.498838] [DEBUG] [MAIN ] INFY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:21.516146] [INFO ] [MAIN ] INFY: Generated 1807 derivative records from 53987 primary records. [2025-10-16T22:39:21.516298] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-16T22:39:21.717899] [DEBUG] [LOCAL ] INFY: Derivative data saved (1807 records). [2025-10-16T22:39:21.719198] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-16T22:39:21.722346] [INFO ] [MAIN ] Derivative Progress: 940/1803 symbols completed. INFY took 1.5s. Estimated remaining: 5m 31s. Rate: 156.2 symbols/min [2025-10-16T22:39:21.724138] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:21.751743] [DEBUG] [MAIN ] ING: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:21.753011] [INFO ] [MAIN ] ING: Generated 1807 derivative records from 51112 primary records. [2025-10-16T22:39:21.753350] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-16T22:39:21.771214] [DEBUG] [LOCAL ] ING: Derivative data saved (1807 records). [2025-10-16T22:39:21.771675] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-10-16T22:39:21.774192] [INFO ] [MAIN ] Derivative Progress: 941/1803 symbols completed. ING took 1.2s. Estimated remaining: 5m 31s. Rate: 156.4 symbols/min [2025-10-16T22:39:21.774476] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:21.798775] [DEBUG] [MAIN ] INGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:21.799458] [INFO ] [MAIN ] INGM: Generated 1807 derivative records from 28536 primary records. [2025-10-16T22:39:21.799579] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-16T22:39:21.819686] [DEBUG] [LOCAL ] INGR: Loaded 34043 existing records from primary storage. [2025-10-16T22:39:21.823422] [INFO ] [MAIN ] INGR: Loaded 34043 primary data records. [2025-10-16T22:39:21.826966] [DEBUG] [LOCAL ] INGM: Derivative data saved (1807 records). [2025-10-16T22:39:21.827167] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-16T22:39:21.850923] [INFO ] [MAIN ] Derivative Progress: 942/1803 symbols completed. INGM took 0.8s. Estimated remaining: 5m 30s. Rate: 156.5 symbols/min [2025-10-16T22:39:21.873457] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:22.025031] [DEBUG] [LOCAL ] INN: Loaded 42104 existing records from primary storage. [2025-10-16T22:39:22.075712] [INFO ] [MAIN ] INN: Loaded 42104 primary data records. [2025-10-16T22:39:22.340469] [DEBUG] [LOCAL ] INSP: Loaded 38596 existing records from primary storage. [2025-10-16T22:39:22.368407] [INFO ] [MAIN ] INSP: Loaded 38596 primary data records. [2025-10-16T22:39:22.880866] [DEBUG] [MAIN ] INGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:22.883165] [INFO ] [MAIN ] INGR: Generated 1807 derivative records from 34043 primary records. [2025-10-16T22:39:22.884018] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-16T22:39:22.901152] [DEBUG] [LOCAL ] INGR: Derivative data saved (1807 records). [2025-10-16T22:39:22.901384] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-16T22:39:22.904572] [INFO ] [MAIN ] Derivative Progress: 943/1803 symbols completed. INGR took 1.2s. Estimated remaining: 5m 30s. Rate: 156.2 symbols/min [2025-10-16T22:39:22.921801] [DEBUG] [MAIN ] INN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:22.922678] [INFO ] [MAIN ] INN: Generated 1807 derivative records from 42104 primary records. [2025-10-16T22:39:22.922791] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-16T22:39:22.941293] [DEBUG] [LOCAL ] INN: Derivative data saved (1807 records). [2025-10-16T22:39:22.942291] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-16T22:39:22.945472] [INFO ] [MAIN ] Derivative Progress: 944/1803 symbols completed. INN took 1.2s. Estimated remaining: 5m 30s. Rate: 156.4 symbols/min [2025-10-16T22:39:22.958341] [DEBUG] [MAIN ] INSP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:22.958959] [INFO ] [MAIN ] INSP: Generated 1807 derivative records from 38596 primary records. [2025-10-16T22:39:22.959021] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-16T22:39:22.973962] [DEBUG] [LOCAL ] INSP: Derivative data saved (1807 records). [2025-10-16T22:39:22.974067] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-16T22:39:22.976957] [INFO ] [MAIN ] Derivative Progress: 945/1803 symbols completed. INSP took 1.1s. Estimated remaining: 5m 29s. Rate: 156.5 symbols/min [2025-10-16T22:39:22.977450] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:22.977631] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:22.977534] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:23.034877] [DEBUG] [LOCAL ] INVX: Loaded 29473 existing records from primary storage. [2025-10-16T22:39:23.035164] [INFO ] [MAIN ] INVX: Loaded 29473 primary data records. [2025-10-16T22:39:23.035819] [DEBUG] [LOCAL ] INSW: Loaded 39916 existing records from primary storage. [2025-10-16T22:39:23.070280] [INFO ] [MAIN ] INSW: Loaded 39916 primary data records. [2025-10-16T22:39:23.274875] [DEBUG] [LOCAL ] INVH: Loaded 53585 existing records from primary storage. [2025-10-16T22:39:23.313845] [INFO ] [MAIN ] INVH: Loaded 53585 primary data records. [2025-10-16T22:39:24.072089] [DEBUG] [MAIN ] INVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:24.086710] [INFO ] [MAIN ] INVX: Generated 1807 derivative records from 29473 primary records. [2025-10-16T22:39:24.087065] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-16T22:39:24.087425] [DEBUG] [MAIN ] INSW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:24.089619] [INFO ] [MAIN ] INSW: Generated 1807 derivative records from 39916 primary records. [2025-10-16T22:39:24.091126] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-16T22:39:24.133703] [DEBUG] [LOCAL ] INSW: Derivative data saved (1807 records). [2025-10-16T22:39:24.152938] [DEBUG] [LOCAL ] INVX: Derivative data saved (1807 records). [2025-10-16T22:39:24.152106] [DEBUG] [MAIN ] INVH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:24.153092] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-16T22:39:24.152481] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-16T22:39:24.153875] [INFO ] [MAIN ] INVH: Generated 1807 derivative records from 53585 primary records. [2025-10-16T22:39:24.154096] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-16T22:39:24.157194] [INFO ] [MAIN ] Derivative Progress: 946/1803 symbols completed. INSW took 1.2s. Estimated remaining: 5m 29s. Rate: 156.2 symbols/min [2025-10-16T22:39:24.160850] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:24.161807] [INFO ] [MAIN ] Derivative Progress: 947/1803 symbols completed. INVX took 1.2s. Estimated remaining: 5m 28s. Rate: 156.4 symbols/min [2025-10-16T22:39:24.169209] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:24.179006] [DEBUG] [LOCAL ] INVH: Derivative data saved (1807 records). [2025-10-16T22:39:24.179128] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-16T22:39:24.182122] [INFO ] [MAIN ] Derivative Progress: 948/1803 symbols completed. INVH took 1.2s. Estimated remaining: 5m 28s. Rate: 156.5 symbols/min [2025-10-16T22:39:24.182364] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:24.269562] [DEBUG] [LOCAL ] IONQ: Loaded 54178 existing records from primary storage. [2025-10-16T22:39:24.271264] [INFO ] [MAIN ] IONQ: Loaded 54178 primary data records. [2025-10-16T22:39:24.272156] [DEBUG] [LOCAL ] IOT: Loaded 53870 existing records from primary storage. [2025-10-16T22:39:24.317437] [INFO ] [MAIN ] IOT: Loaded 53870 primary data records. [2025-10-16T22:39:24.465242] [DEBUG] [LOCAL ] IP: Loaded 53697 existing records from primary storage. [2025-10-16T22:39:24.492677] [INFO ] [MAIN ] IP: Loaded 53697 primary data records. [2025-10-16T22:39:25.278996] [DEBUG] [MAIN ] IONQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:25.281597] [INFO ] [MAIN ] IONQ: Generated 1807 derivative records from 54178 primary records. [2025-10-16T22:39:25.282807] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-16T22:39:25.304662] [DEBUG] [MAIN ] IOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:25.318589] [DEBUG] [MAIN ] IP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:25.325760] [INFO ] [MAIN ] IOT: Generated 1807 derivative records from 53870 primary records. [2025-10-16T22:39:25.326182] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-16T22:39:25.326118] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1807 records). [2025-10-16T22:39:25.327010] [INFO ] [MAIN ] IP: Generated 1807 derivative records from 53697 primary records. [2025-10-16T22:39:25.327514] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-16T22:39:25.327775] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-16T22:39:25.330052] [INFO ] [MAIN ] Derivative Progress: 949/1803 symbols completed. IONQ took 1.2s. Estimated remaining: 5m 28s. Rate: 156.2 symbols/min [2025-10-16T22:39:25.330923] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:25.357907] [DEBUG] [LOCAL ] IP: Derivative data saved (1807 records). [2025-10-16T22:39:25.358115] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-16T22:39:25.365530] [DEBUG] [LOCAL ] IOT: Derivative data saved (1807 records). [2025-10-16T22:39:25.365707] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-16T22:39:25.365448] [INFO ] [MAIN ] Derivative Progress: 950/1803 symbols completed. IP took 1.2s. Estimated remaining: 5m 27s. Rate: 156.3 symbols/min [2025-10-16T22:39:25.368241] [INFO ] [MAIN ] Derivative Progress: 951/1803 symbols completed. IOT took 1.2s. Estimated remaining: 5m 27s. Rate: 156.5 symbols/min [2025-10-16T22:39:25.368426] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:25.368148] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:25.407498] [DEBUG] [LOCAL ] IQI: Loaded 17994 existing records from primary storage. [2025-10-16T22:39:25.407949] [DEBUG] [LOCAL ] IPI: Loaded 21575 existing records from primary storage. [2025-10-16T22:39:25.408204] [INFO ] [MAIN ] IQI: Loaded 17994 primary data records. [2025-10-16T22:39:25.428952] [INFO ] [MAIN ] IPI: Loaded 21575 primary data records. [2025-10-16T22:39:25.702173] [DEBUG] [LOCAL ] IPG: Loaded 53721 existing records from primary storage. [2025-10-16T22:39:25.772222] [INFO ] [MAIN ] IPG: Loaded 53721 primary data records. [2025-10-16T22:39:26.396228] [DEBUG] [MAIN ] IQI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:26.399418] [INFO ] [MAIN ] IQI: Generated 1807 derivative records from 17994 primary records. [2025-10-16T22:39:26.400359] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-16T22:39:26.426360] [DEBUG] [MAIN ] IPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:26.428138] [INFO ] [MAIN ] IPI: Generated 1807 derivative records from 21575 primary records. [2025-10-16T22:39:26.428339] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-16T22:39:26.430815] [DEBUG] [LOCAL ] IQI: Derivative data saved (1807 records). [2025-10-16T22:39:26.438111] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-16T22:39:26.443766] [INFO ] [MAIN ] Derivative Progress: 952/1803 symbols completed. IQI took 1.1s. Estimated remaining: 5m 27s. Rate: 156.2 symbols/min [2025-10-16T22:39:26.444044] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:26.450704] [DEBUG] [LOCAL ] IPI: Derivative data saved (1807 records). [2025-10-16T22:39:26.450862] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-16T22:39:26.453147] [INFO ] [MAIN ] Derivative Progress: 953/1803 symbols completed. IPI took 1.1s. Estimated remaining: 5m 26s. Rate: 156.4 symbols/min [2025-10-16T22:39:26.453343] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:26.466820] [DEBUG] [MAIN ] IPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:26.467557] [INFO ] [MAIN ] IPG: Generated 1807 derivative records from 53721 primary records. [2025-10-16T22:39:26.467725] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-16T22:39:26.484263] [DEBUG] [LOCAL ] IPG: Derivative data saved (1807 records). [2025-10-16T22:39:26.484513] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-16T22:39:26.487288] [INFO ] [MAIN ] Derivative Progress: 954/1803 symbols completed. IPG took 1.2s. Estimated remaining: 5m 25s. Rate: 156.5 symbols/min [2025-10-16T22:39:26.487476] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:26.546845] [DEBUG] [LOCAL ] IQV: Loaded 50425 existing records from primary storage. [2025-10-16T22:39:26.547603] [INFO ] [MAIN ] IQV: Loaded 50425 primary data records. [2025-10-16T22:39:26.643048] [DEBUG] [LOCAL ] IR: Loaded 53164 existing records from primary storage. [2025-10-16T22:39:26.675366] [INFO ] [MAIN ] IR: Loaded 53164 primary data records. [2025-10-16T22:39:26.680293] [DEBUG] [LOCAL ] IRM: Loaded 49463 existing records from primary storage. [2025-10-16T22:39:26.726593] [INFO ] [MAIN ] IRM: Loaded 49463 primary data records. [2025-10-16T22:39:27.532608] [DEBUG] [MAIN ] IQV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:27.535044] [INFO ] [MAIN ] IQV: Generated 1807 derivative records from 50425 primary records. [2025-10-16T22:39:27.535366] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-16T22:39:27.561298] [DEBUG] [MAIN ] IR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:27.574878] [INFO ] [MAIN ] IR: Generated 1807 derivative records from 53164 primary records. [2025-10-16T22:39:27.576702] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-16T22:39:27.575234] [DEBUG] [MAIN ] IRM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:27.583818] [DEBUG] [LOCAL ] IQV: Derivative data saved (1807 records). [2025-10-16T22:39:27.584238] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-16T22:39:27.586432] [INFO ] [MAIN ] Derivative Progress: 955/1803 symbols completed. IQV took 1.1s. Estimated remaining: 5m 26s. Rate: 156.2 symbols/min [2025-10-16T22:39:27.587291] [INFO ] [MAIN ] IRM: Generated 1807 derivative records from 49463 primary records. [2025-10-16T22:39:27.587396] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-16T22:39:27.588524] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:27.612052] [DEBUG] [LOCAL ] IR: Derivative data saved (1807 records). [2025-10-16T22:39:27.613455] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-16T22:39:27.622962] [DEBUG] [LOCAL ] IRM: Derivative data saved (1807 records). [2025-10-16T22:39:27.623182] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-16T22:39:27.616181] [INFO ] [MAIN ] Derivative Progress: 956/1803 symbols completed. IR took 1.2s. Estimated remaining: 5m 25s. Rate: 156.4 symbols/min [2025-10-16T22:39:27.626480] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:27.626561] [INFO ] [MAIN ] Derivative Progress: 957/1803 symbols completed. IRM took 1.1s. Estimated remaining: 5m 24s. Rate: 156.5 symbols/min [2025-10-16T22:39:27.627252] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:27.650460] [DEBUG] [LOCAL ] IRS: Loaded 23269 existing records from primary storage. [2025-10-16T22:39:27.656224] [INFO ] [MAIN ] IRS: Loaded 23269 primary data records. [2025-10-16T22:39:27.656843] [DEBUG] [LOCAL ] ISD: Loaded 15985 existing records from primary storage. [2025-10-16T22:39:27.677886] [INFO ] [MAIN ] ISD: Loaded 15985 primary data records. [2025-10-16T22:39:28.326954] [DEBUG] [LOCAL ] IRT: Loaded 50924 existing records from primary storage. [2025-10-16T22:39:28.327327] [INFO ] [MAIN ] IRT: Loaded 50924 primary data records. [2025-10-16T22:39:28.712557] [DEBUG] [MAIN ] IRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:28.713095] [DEBUG] [MAIN ] ISD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:28.713850] [INFO ] [MAIN ] IRS: Generated 1807 derivative records from 23269 primary records. [2025-10-16T22:39:28.714497] [INFO ] [MAIN ] ISD: Generated 1807 derivative records from 15985 primary records. [2025-10-16T22:39:28.714802] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-16T22:39:28.714634] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-16T22:39:28.745580] [DEBUG] [LOCAL ] IRS: Derivative data saved (1807 records). [2025-10-16T22:39:28.746785] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-16T22:39:28.748950] [INFO ] [MAIN ] Derivative Progress: 958/1803 symbols completed. IRS took 1.2s. Estimated remaining: 5m 25s. Rate: 156.2 symbols/min [2025-10-16T22:39:28.751704] [DEBUG] [LOCAL ] ISD: Derivative data saved (1807 records). [2025-10-16T22:39:28.751893] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-16T22:39:28.754328] [INFO ] [MAIN ] Derivative Progress: 959/1803 symbols completed. ISD took 1.1s. Estimated remaining: 5m 24s. Rate: 156.4 symbols/min [2025-10-16T22:39:28.769971] [DEBUG] [MAIN ] IRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:28.770603] [INFO ] [MAIN ] IRT: Generated 1807 derivative records from 50924 primary records. [2025-10-16T22:39:28.770688] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-16T22:39:28.785944] [DEBUG] [LOCAL ] IRT: Derivative data saved (1807 records). [2025-10-16T22:39:28.786041] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-16T22:39:28.788780] [INFO ] [MAIN ] Derivative Progress: 960/1803 symbols completed. IRT took 1.2s. Estimated remaining: 5m 23s. Rate: 156.5 symbols/min [2025-10-16T22:39:28.789382] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:28.789278] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:28.789210] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:28.844205] [DEBUG] [LOCAL ] ITT: Loaded 32949 existing records from primary storage. [2025-10-16T22:39:28.845419] [INFO ] [MAIN ] ITT: Loaded 32949 primary data records. [2025-10-16T22:39:28.846008] [DEBUG] [LOCAL ] ITGR: Loaded 31563 existing records from primary storage. [2025-10-16T22:39:28.866909] [INFO ] [MAIN ] ITGR: Loaded 31563 primary data records. [2025-10-16T22:39:29.042005] [DEBUG] [LOCAL ] IT: Loaded 42544 existing records from primary storage. [2025-10-16T22:39:29.064022] [INFO ] [MAIN ] IT: Loaded 42544 primary data records. [2025-10-16T22:39:29.809413] [DEBUG] [MAIN ] ITGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:29.809866] [DEBUG] [MAIN ] ITT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:29.811725] [INFO ] [MAIN ] ITT: Generated 1807 derivative records from 32949 primary records. [2025-10-16T22:39:29.810777] [INFO ] [MAIN ] ITGR: Generated 1807 derivative records from 31563 primary records. [2025-10-16T22:39:29.812047] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-16T22:39:29.811973] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-16T22:39:29.826420] [DEBUG] [MAIN ] IT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:29.846189] [INFO ] [MAIN ] IT: Generated 1807 derivative records from 42544 primary records. [2025-10-16T22:39:29.851531] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1807 records). [2025-10-16T22:39:29.857771] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-16T22:39:29.857699] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-16T22:39:29.858813] [DEBUG] [LOCAL ] ITT: Derivative data saved (1807 records). [2025-10-16T22:39:29.861622] [INFO ] [MAIN ] Derivative Progress: 961/1803 symbols completed. ITGR took 1.1s. Estimated remaining: 5m 23s. Rate: 156.2 symbols/min [2025-10-16T22:39:29.861901] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:29.861750] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-16T22:39:29.864628] [INFO ] [MAIN ] Derivative Progress: 962/1803 symbols completed. ITT took 1.1s. Estimated remaining: 5m 23s. Rate: 156.4 symbols/min [2025-10-16T22:39:29.864996] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:29.881796] [DEBUG] [LOCAL ] IT: Derivative data saved (1807 records). [2025-10-16T22:39:29.882034] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-16T22:39:29.884615] [INFO ] [MAIN ] Derivative Progress: 963/1803 symbols completed. IT took 1.1s. Estimated remaining: 5m 22s. Rate: 156.5 symbols/min [2025-10-16T22:39:29.884905] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:29.966889] [DEBUG] [LOCAL ] IVR: Loaded 48437 existing records from primary storage. [2025-10-16T22:39:29.983058] [DEBUG] [LOCAL ] ITW: Loaded 46082 existing records from primary storage. [2025-10-16T22:39:29.984081] [DEBUG] [LOCAL ] ITUB: Loaded 53720 existing records from primary storage. [2025-10-16T22:39:29.984285] [INFO ] [MAIN ] IVR: Loaded 48437 primary data records. [2025-10-16T22:39:29.984596] [INFO ] [MAIN ] ITUB: Loaded 53720 primary data records. [2025-10-16T22:39:30.027080] [INFO ] [MAIN ] ITW: Loaded 46082 primary data records. [2025-10-16T22:39:30.983329] [DEBUG] [MAIN ] ITUB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:30.983990] [DEBUG] [MAIN ] IVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:30.984676] [INFO ] [MAIN ] ITUB: Generated 1807 derivative records from 53720 primary records. [2025-10-16T22:39:30.985492] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-16T22:39:30.986743] [INFO ] [MAIN ] IVR: Generated 1807 derivative records from 48437 primary records. [2025-10-16T22:39:30.987553] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-16T22:39:31.011222] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1807 records). [2025-10-16T22:39:31.024378] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-16T22:39:31.026842] [INFO ] [MAIN ] Derivative Progress: 964/1803 symbols completed. ITUB took 1.2s. Estimated remaining: 5m 22s. Rate: 156.2 symbols/min [2025-10-16T22:39:31.027207] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:31.032635] [DEBUG] [LOCAL ] IVR: Derivative data saved (1807 records). [2025-10-16T22:39:31.033082] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-16T22:39:31.033484] [DEBUG] [MAIN ] ITW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:31.036151] [INFO ] [MAIN ] ITW: Generated 1807 derivative records from 46082 primary records. [2025-10-16T22:39:31.035251] [INFO ] [MAIN ] Derivative Progress: 965/1803 symbols completed. IVR took 1.2s. Estimated remaining: 5m 22s. Rate: 156.4 symbols/min [2025-10-16T22:39:31.036233] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-16T22:39:31.036607] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:31.053130] [DEBUG] [LOCAL ] ITW: Derivative data saved (1807 records). [2025-10-16T22:39:31.053408] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-16T22:39:31.055985] [INFO ] [MAIN ] Derivative Progress: 966/1803 symbols completed. ITW took 1.2s. Estimated remaining: 5m 21s. Rate: 156.5 symbols/min [2025-10-16T22:39:31.056163] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:31.088809] [DEBUG] [LOCAL ] IVT: Loaded 31572 existing records from primary storage. [2025-10-16T22:39:31.088983] [INFO ] [MAIN ] IVT: Loaded 31572 primary data records. [2025-10-16T22:39:31.208516] [DEBUG] [LOCAL ] IX: Loaded 22439 existing records from primary storage. [2025-10-16T22:39:31.211699] [INFO ] [MAIN ] IX: Loaded 22439 primary data records. [2025-10-16T22:39:31.409018] [DEBUG] [LOCAL ] IVZ: Loaded 53506 existing records from primary storage. [2025-10-16T22:39:31.416620] [INFO ] [MAIN ] IVZ: Loaded 53506 primary data records. [2025-10-16T22:39:32.062872] [DEBUG] [MAIN ] IVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:32.064842] [INFO ] [MAIN ] IVT: Generated 1807 derivative records from 31572 primary records. [2025-10-16T22:39:32.064942] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-16T22:39:32.083634] [DEBUG] [LOCAL ] IVT: Derivative data saved (1807 records). [2025-10-16T22:39:32.083842] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-16T22:39:32.085751] [INFO ] [MAIN ] Derivative Progress: 967/1803 symbols completed. IVT took 1.1s. Estimated remaining: 5m 21s. Rate: 156.3 symbols/min [2025-10-16T22:39:32.098712] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:32.100443] [DEBUG] [MAIN ] IX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:32.101566] [INFO ] [MAIN ] IX: Generated 1807 derivative records from 22439 primary records. [2025-10-16T22:39:32.101715] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-16T22:39:32.120183] [DEBUG] [LOCAL ] IX: Derivative data saved (1807 records). [2025-10-16T22:39:32.120418] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-16T22:39:32.122869] [INFO ] [MAIN ] Derivative Progress: 968/1803 symbols completed. IX took 1.1s. Estimated remaining: 5m 20s. Rate: 156.4 symbols/min [2025-10-16T22:39:32.135422] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:32.135790] [DEBUG] [MAIN ] IVZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:32.137031] [INFO ] [MAIN ] IVZ: Generated 1807 derivative records from 53506 primary records. [2025-10-16T22:39:32.137187] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-16T22:39:32.155207] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1807 records). [2025-10-16T22:39:32.164336] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-16T22:39:32.167825] [INFO ] [MAIN ] Derivative Progress: 969/1803 symbols completed. IVZ took 1.1s. Estimated remaining: 5m 20s. Rate: 156.5 symbols/min [2025-10-16T22:39:32.168111] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:32.193593] [DEBUG] [LOCAL ] J: Loaded 40700 existing records from primary storage. [2025-10-16T22:39:32.205689] [INFO ] [MAIN ] J: Loaded 40700 primary data records. [2025-10-16T22:39:32.227373] [DEBUG] [LOCAL ] JBGS: Loaded 42407 existing records from primary storage. [2025-10-16T22:39:32.243433] [INFO ] [MAIN ] JBGS: Loaded 42407 primary data records. [2025-10-16T22:39:32.480389] [DEBUG] [LOCAL ] JBI: Loaded 43293 existing records from primary storage. [2025-10-16T22:39:32.522288] [INFO ] [MAIN ] JBI: Loaded 43293 primary data records. [2025-10-16T22:39:33.194328] [DEBUG] [MAIN ] J: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:33.196461] [INFO ] [MAIN ] J: Generated 1807 derivative records from 40700 primary records. [2025-10-16T22:39:33.197259] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-16T22:39:33.234751] [DEBUG] [MAIN ] JBGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:33.236022] [INFO ] [MAIN ] JBGS: Generated 1807 derivative records from 42407 primary records. [2025-10-16T22:39:33.236469] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-16T22:39:33.239099] [DEBUG] [LOCAL ] J: Derivative data saved (1807 records). [2025-10-16T22:39:33.239199] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-16T22:39:33.241911] [INFO ] [MAIN ] Derivative Progress: 970/1803 symbols completed. J took 1.1s. Estimated remaining: 5m 20s. Rate: 156.2 symbols/min [2025-10-16T22:39:33.243216] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:33.269470] [DEBUG] [MAIN ] JBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:33.271382] [INFO ] [MAIN ] JBI: Generated 1807 derivative records from 43293 primary records. [2025-10-16T22:39:33.272046] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-16T22:39:33.284080] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1807 records). [2025-10-16T22:39:33.291308] [DEBUG] [LOCAL ] JBI: Derivative data saved (1807 records). [2025-10-16T22:39:33.291474] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-16T22:39:33.291689] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-16T22:39:33.294059] [INFO ] [MAIN ] Derivative Progress: 971/1803 symbols completed. JBGS took 1.2s. Estimated remaining: 5m 19s. Rate: 156.4 symbols/min [2025-10-16T22:39:33.297551] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:33.297841] [INFO ] [MAIN ] Derivative Progress: 972/1803 symbols completed. JBI took 1.1s. Estimated remaining: 5m 18s. Rate: 156.5 symbols/min [2025-10-16T22:39:33.297981] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:33.341823] [DEBUG] [LOCAL ] JBL: Loaded 48716 existing records from primary storage. [2025-10-16T22:39:33.342039] [INFO ] [MAIN ] JBL: Loaded 48716 primary data records. [2025-10-16T22:39:33.395292] [DEBUG] [LOCAL ] JBND: Loaded 27187 existing records from primary storage. [2025-10-16T22:39:33.422271] [INFO ] [MAIN ] JBND: Loaded 27187 primary data records. [2025-10-16T22:39:33.801320] [DEBUG] [LOCAL ] JCI: Loaded 53916 existing records from primary storage. [2025-10-16T22:39:33.843842] [INFO ] [MAIN ] JCI: Loaded 53916 primary data records. [2025-10-16T22:39:34.314901] [DEBUG] [MAIN ] JBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:34.316031] [INFO ] [MAIN ] JBL: Generated 1807 derivative records from 48716 primary records. [2025-10-16T22:39:34.316203] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-16T22:39:34.334947] [DEBUG] [LOCAL ] JBL: Derivative data saved (1807 records). [2025-10-16T22:39:34.335083] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-16T22:39:34.337288] [INFO ] [MAIN ] Derivative Progress: 973/1803 symbols completed. JBL took 1.1s. Estimated remaining: 5m 19s. Rate: 156.3 symbols/min [2025-10-16T22:39:34.350190] [DEBUG] [MAIN ] JBND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:34.350885] [INFO ] [MAIN ] JBND: Generated 1807 derivative records from 27187 primary records. [2025-10-16T22:39:34.351029] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-16T22:39:34.368534] [DEBUG] [LOCAL ] JBND: Derivative data saved (1807 records). [2025-10-16T22:39:34.368625] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-16T22:39:34.371002] [INFO ] [MAIN ] Derivative Progress: 974/1803 symbols completed. JBND took 1.1s. Estimated remaining: 5m 18s. Rate: 156.4 symbols/min [2025-10-16T22:39:34.383789] [DEBUG] [MAIN ] JCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:34.384358] [INFO ] [MAIN ] JCI: Generated 1807 derivative records from 53916 primary records. [2025-10-16T22:39:34.384419] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-16T22:39:34.399570] [DEBUG] [LOCAL ] JCI: Derivative data saved (1807 records). [2025-10-16T22:39:34.399629] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-16T22:39:34.402875] [INFO ] [MAIN ] Derivative Progress: 975/1803 symbols completed. JCI took 1.1s. Estimated remaining: 5m 17s. Rate: 156.6 symbols/min [2025-10-16T22:39:34.403709] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:34.404167] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:34.403851] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:34.447257] [DEBUG] [LOCAL ] JFR: Loaded 31245 existing records from primary storage. [2025-10-16T22:39:34.447560] [INFO ] [MAIN ] JFR: Loaded 31245 primary data records. [2025-10-16T22:39:34.587546] [DEBUG] [LOCAL ] JELD: Loaded 46434 existing records from primary storage. [2025-10-16T22:39:34.598571] [INFO ] [MAIN ] JELD: Loaded 46434 primary data records. [2025-10-16T22:39:34.743758] [DEBUG] [LOCAL ] JEF: Loaded 50561 existing records from primary storage. [2025-10-16T22:39:34.899213] [INFO ] [MAIN ] JEF: Loaded 50561 primary data records. [2025-10-16T22:39:35.421886] [DEBUG] [MAIN ] JFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:35.423210] [INFO ] [MAIN ] JFR: Generated 1807 derivative records from 31245 primary records. [2025-10-16T22:39:35.423441] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-16T22:39:35.442483] [DEBUG] [LOCAL ] JFR: Derivative data saved (1807 records). [2025-10-16T22:39:35.442809] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-16T22:39:35.452326] [INFO ] [MAIN ] Derivative Progress: 976/1803 symbols completed. JFR took 1.0s. Estimated remaining: 5m 17s. Rate: 156.3 symbols/min [2025-10-16T22:39:35.457103] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:35.458206] [DEBUG] [MAIN ] JELD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:35.459136] [INFO ] [MAIN ] JELD: Generated 1807 derivative records from 46434 primary records. [2025-10-16T22:39:35.459438] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-16T22:39:35.478463] [DEBUG] [LOCAL ] JELD: Derivative data saved (1807 records). [2025-10-16T22:39:35.478623] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-16T22:39:35.481013] [INFO ] [MAIN ] Derivative Progress: 977/1803 symbols completed. JELD took 1.1s. Estimated remaining: 5m 17s. Rate: 156.4 symbols/min [2025-10-16T22:39:35.481287] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:35.489237] [DEBUG] [LOCAL ] JGH: Loaded 12686 existing records from primary storage. [2025-10-16T22:39:35.489457] [INFO ] [MAIN ] JGH: Loaded 12686 primary data records. [2025-10-16T22:39:35.556188] [DEBUG] [MAIN ] JEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:35.605616] [INFO ] [MAIN ] JEF: Generated 1807 derivative records from 50561 primary records. [2025-10-16T22:39:35.622832] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-16T22:39:35.677300] [DEBUG] [LOCAL ] JEF: Derivative data saved (1807 records). [2025-10-16T22:39:35.725625] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-16T22:39:35.846240] [INFO ] [MAIN ] Derivative Progress: 978/1803 symbols completed. JEF took 1.4s. Estimated remaining: 5m 16s. Rate: 156.4 symbols/min [2025-10-16T22:39:35.846594] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:35.863045] [DEBUG] [LOCAL ] JHG: Loaded 47922 existing records from primary storage. [2025-10-16T22:39:35.864830] [INFO ] [MAIN ] JHG: Loaded 47922 primary data records. [2025-10-16T22:39:35.939933] [DEBUG] [LOCAL ] JHI: Loaded 4106 existing records from primary storage. [2025-10-16T22:39:35.952474] [INFO ] [MAIN ] JHI: Loaded 4106 primary data records. [2025-10-16T22:39:36.615880] [DEBUG] [MAIN ] JGH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:36.617030] [INFO ] [MAIN ] JGH: Generated 1807 derivative records from 12686 primary records. [2025-10-16T22:39:36.617251] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-16T22:39:36.641563] [DEBUG] [LOCAL ] JGH: Derivative data saved (1807 records). [2025-10-16T22:39:36.641760] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-16T22:39:36.643881] [INFO ] [MAIN ] Derivative Progress: 979/1803 symbols completed. JGH took 1.2s. Estimated remaining: 5m 16s. Rate: 156.3 symbols/min [2025-10-16T22:39:36.644239] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:36.662087] [DEBUG] [MAIN ] JHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:36.664880] [DEBUG] [LOCAL ] JHS: Loaded 2944 existing records from primary storage. [2025-10-16T22:39:36.665857] [INFO ] [MAIN ] JHG: Generated 1807 derivative records from 47922 primary records. [2025-10-16T22:39:36.665960] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-16T22:39:36.665124] [INFO ] [MAIN ] JHS: Loaded 2944 primary data records. [2025-10-16T22:39:36.757608] [DEBUG] [LOCAL ] JHG: Derivative data saved (1807 records). [2025-10-16T22:39:36.774907] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-10-16T22:39:36.807627] [INFO ] [MAIN ] Derivative Progress: 980/1803 symbols completed. JHG took 1.3s. Estimated remaining: 5m 16s. Rate: 156.4 symbols/min [2025-10-16T22:39:36.808490] [DEBUG] [MAIN ] JHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:36.808620] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:36.815271] [INFO ] [MAIN ] JHI: Generated 1807 derivative records from 4106 primary records. [2025-10-16T22:39:36.826156] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-16T22:39:37.021196] [DEBUG] [LOCAL ] JHI: Derivative data saved (1807 records). [2025-10-16T22:39:37.021491] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-16T22:39:37.024233] [INFO ] [MAIN ] Derivative Progress: 981/1803 symbols completed. JHI took 1.2s. Estimated remaining: 5m 15s. Rate: 156.4 symbols/min [2025-10-16T22:39:37.024452] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:37.056957] [DEBUG] [LOCAL ] JILL: Loaded 15989 existing records from primary storage. [2025-10-16T22:39:37.057095] [INFO ] [MAIN ] JILL: Loaded 15989 primary data records. [2025-10-16T22:39:37.214402] [DEBUG] [LOCAL ] JHX: Loaded 53550 existing records from primary storage. [2025-10-16T22:39:37.227341] [DEBUG] [MAIN ] JHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:37.237344] [INFO ] [MAIN ] JHS: Generated 1807 derivative records from 2944 primary records. [2025-10-16T22:39:37.266289] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-16T22:39:37.266155] [INFO ] [MAIN ] JHX: Loaded 53550 primary data records. [2025-10-16T22:39:37.488781] [DEBUG] [LOCAL ] JHS: Derivative data saved (1807 records). [2025-10-16T22:39:37.501991] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-16T22:39:37.504234] [INFO ] [MAIN ] Derivative Progress: 982/1803 symbols completed. JHS took 0.9s. Estimated remaining: 5m 15s. Rate: 156.4 symbols/min [2025-10-16T22:39:37.510163] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:37.716942] [DEBUG] [MAIN ] JILL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:37.718215] [INFO ] [MAIN ] JILL: Generated 1807 derivative records from 15989 primary records. [2025-10-16T22:39:37.718322] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-16T22:39:37.735713] [DEBUG] [LOCAL ] JILL: Derivative data saved (1807 records). [2025-10-16T22:39:37.735884] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-16T22:39:37.750085] [INFO ] [MAIN ] Derivative Progress: 983/1803 symbols completed. JILL took 0.7s. Estimated remaining: 5m 14s. Rate: 156.4 symbols/min [2025-10-16T22:39:37.750450] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:37.782304] [DEBUG] [LOCAL ] JKS: Loaded 39945 existing records from primary storage. [2025-10-16T22:39:37.787612] [INFO ] [MAIN ] JKS: Loaded 39945 primary data records. [2025-10-16T22:39:37.788069] [DEBUG] [MAIN ] JHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:37.831445] [INFO ] [MAIN ] JHX: Generated 1807 derivative records from 53550 primary records. [2025-10-16T22:39:37.844118] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-16T22:39:37.932200] [DEBUG] [LOCAL ] JLL: Loaded 31952 existing records from primary storage. [2025-10-16T22:39:37.933365] [INFO ] [MAIN ] JLL: Loaded 31952 primary data records. [2025-10-16T22:39:37.984816] [DEBUG] [LOCAL ] JHX: Derivative data saved (1807 records). [2025-10-16T22:39:37.990064] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-16T22:39:37.999569] [INFO ] [MAIN ] Derivative Progress: 984/1803 symbols completed. JHX took 1.2s. Estimated remaining: 5m 14s. Rate: 156.5 symbols/min [2025-10-16T22:39:37.999771] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:38.115007] [DEBUG] [LOCAL ] JLS: Loaded 4239 existing records from primary storage. [2025-10-16T22:39:38.137906] [INFO ] [MAIN ] JLS: Loaded 4239 primary data records. [2025-10-16T22:39:38.822018] [DEBUG] [MAIN ] JKS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:38.822973] [INFO ] [MAIN ] JKS: Generated 1807 derivative records from 39945 primary records. [2025-10-16T22:39:38.823876] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-16T22:39:38.841536] [DEBUG] [LOCAL ] JKS: Derivative data saved (1807 records). [2025-10-16T22:39:38.841720] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-16T22:39:38.844029] [INFO ] [MAIN ] Derivative Progress: 985/1803 symbols completed. JKS took 1.3s. Estimated remaining: 5m 14s. Rate: 156.3 symbols/min [2025-10-16T22:39:38.844199] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:38.859913] [DEBUG] [MAIN ] JLL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:38.862199] [INFO ] [MAIN ] JLL: Generated 1807 derivative records from 31952 primary records. [2025-10-16T22:39:38.864033] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-16T22:39:38.894143] [DEBUG] [LOCAL ] JLL: Derivative data saved (1807 records). [2025-10-16T22:39:38.893148] [DEBUG] [MAIN ] JLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:38.894306] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-16T22:39:38.895207] [INFO ] [MAIN ] JLS: Generated 1807 derivative records from 4239 primary records. [2025-10-16T22:39:38.897827] [INFO ] [MAIN ] Derivative Progress: 986/1803 symbols completed. JLL took 1.1s. Estimated remaining: 5m 13s. Rate: 156.5 symbols/min [2025-10-16T22:39:38.895379] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-16T22:39:38.899049] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:38.914101] [DEBUG] [LOCAL ] JLS: Derivative data saved (1807 records). [2025-10-16T22:39:38.914282] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-16T22:39:38.916901] [INFO ] [MAIN ] Derivative Progress: 987/1803 symbols completed. JLS took 0.9s. Estimated remaining: 5m 13s. Rate: 156.6 symbols/min [2025-10-16T22:39:38.917246] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:38.951907] [DEBUG] [LOCAL ] JMIA: Loaded 51442 existing records from primary storage. [2025-10-16T22:39:38.952098] [INFO ] [MAIN ] JMIA: Loaded 51442 primary data records. [2025-10-16T22:39:39.123690] [DEBUG] [LOCAL ] JNJ: Loaded 54143 existing records from primary storage. [2025-10-16T22:39:39.175115] [INFO ] [MAIN ] JNJ: Loaded 54143 primary data records. [2025-10-16T22:39:39.366020] [DEBUG] [LOCAL ] JOBY: Loaded 54198 existing records from primary storage. [2025-10-16T22:39:39.387504] [INFO ] [MAIN ] JOBY: Loaded 54198 primary data records. [2025-10-16T22:39:39.941011] [DEBUG] [MAIN ] JMIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:39.942092] [INFO ] [MAIN ] JMIA: Generated 1807 derivative records from 51442 primary records. [2025-10-16T22:39:39.942268] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-16T22:39:39.958933] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1807 records). [2025-10-16T22:39:39.959897] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-16T22:39:39.962579] [INFO ] [MAIN ] Derivative Progress: 988/1803 symbols completed. JMIA took 1.1s. Estimated remaining: 5m 13s. Rate: 156.3 symbols/min [2025-10-16T22:39:39.987705] [DEBUG] [MAIN ] JNJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:39.989014] [INFO ] [MAIN ] JNJ: Generated 1807 derivative records from 54143 primary records. [2025-10-16T22:39:39.989233] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-16T22:39:40.009005] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1807 records). [2025-10-16T22:39:40.009880] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-16T22:39:40.012402] [INFO ] [MAIN ] Derivative Progress: 989/1803 symbols completed. JNJ took 1.1s. Estimated remaining: 5m 12s. Rate: 156.5 symbols/min [2025-10-16T22:39:40.027787] [DEBUG] [MAIN ] JOBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:40.028851] [INFO ] [MAIN ] JOBY: Generated 1807 derivative records from 54198 primary records. [2025-10-16T22:39:40.028950] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-16T22:39:40.046436] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1807 records). [2025-10-16T22:39:40.046541] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-16T22:39:40.049381] [INFO ] [MAIN ] Derivative Progress: 990/1803 symbols completed. JOBY took 1.1s. Estimated remaining: 5m 11s. Rate: 156.6 symbols/min [2025-10-16T22:39:40.049975] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:40.050578] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:40.049875] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:40.059436] [DEBUG] [LOCAL ] JOF: Loaded 6944 existing records from primary storage. [2025-10-16T22:39:40.059739] [INFO ] [MAIN ] JOF: Loaded 6944 primary data records. [2025-10-16T22:39:40.233362] [DEBUG] [LOCAL ] JOE: Loaded 24021 existing records from primary storage. [2025-10-16T22:39:40.252542] [INFO ] [MAIN ] JOE: Loaded 24021 primary data records. [2025-10-16T22:39:40.282468] [DEBUG] [LOCAL ] JPC: Loaded 37494 existing records from primary storage. [2025-10-16T22:39:40.433200] [INFO ] [MAIN ] JPC: Loaded 37494 primary data records. [2025-10-16T22:39:41.087959] [DEBUG] [MAIN ] JOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:41.090426] [INFO ] [MAIN ] JOF: Generated 1807 derivative records from 6944 primary records. [2025-10-16T22:39:41.090868] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-16T22:39:41.107523] [DEBUG] [LOCAL ] JOF: Derivative data saved (1807 records). [2025-10-16T22:39:41.107972] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-16T22:39:41.111836] [INFO ] [MAIN ] Derivative Progress: 991/1803 symbols completed. JOF took 1.1s. Estimated remaining: 5m 12s. Rate: 156.3 symbols/min [2025-10-16T22:39:41.112282] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:41.130628] [DEBUG] [MAIN ] JOE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:41.139387] [INFO ] [MAIN ] JOE: Generated 1807 derivative records from 24021 primary records. [2025-10-16T22:39:41.144270] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-16T22:39:41.145318] [DEBUG] [MAIN ] JPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:41.146805] [INFO ] [MAIN ] JPC: Generated 1807 derivative records from 37494 primary records. [2025-10-16T22:39:41.146981] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-16T22:39:41.174381] [DEBUG] [LOCAL ] JOE: Derivative data saved (1807 records). [2025-10-16T22:39:41.176853] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-16T22:39:41.179224] [DEBUG] [LOCAL ] JPC: Derivative data saved (1807 records). [2025-10-16T22:39:41.181955] [INFO ] [MAIN ] Derivative Progress: 992/1803 symbols completed. JOE took 1.1s. Estimated remaining: 5m 11s. Rate: 156.5 symbols/min [2025-10-16T22:39:41.182433] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:41.182167] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-16T22:39:41.185839] [INFO ] [MAIN ] Derivative Progress: 993/1803 symbols completed. JPC took 1.1s. Estimated remaining: 5m 10s. Rate: 156.6 symbols/min [2025-10-16T22:39:41.186114] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:41.218804] [DEBUG] [LOCAL ] JRI: Loaded 15503 existing records from primary storage. [2025-10-16T22:39:41.218943] [INFO ] [MAIN ] JRI: Loaded 15503 primary data records. [2025-10-16T22:39:41.361981] [DEBUG] [LOCAL ] JQC: Loaded 33945 existing records from primary storage. [2025-10-16T22:39:41.376905] [INFO ] [MAIN ] JQC: Loaded 33945 primary data records. [2025-10-16T22:39:41.376771] [DEBUG] [LOCAL ] JPM: Loaded 54184 existing records from primary storage. [2025-10-16T22:39:41.408244] [INFO ] [MAIN ] JPM: Loaded 54184 primary data records. [2025-10-16T22:39:42.223185] [DEBUG] [MAIN ] JRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:42.226181] [INFO ] [MAIN ] JRI: Generated 1807 derivative records from 15503 primary records. [2025-10-16T22:39:42.226326] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-16T22:39:42.256690] [DEBUG] [LOCAL ] JRI: Derivative data saved (1807 records). [2025-10-16T22:39:42.257567] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-16T22:39:42.259895] [INFO ] [MAIN ] Derivative Progress: 994/1803 symbols completed. JRI took 1.1s. Estimated remaining: 5m 10s. Rate: 156.3 symbols/min [2025-10-16T22:39:42.260458] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:42.260247] [DEBUG] [MAIN ] JQC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:42.269464] [INFO ] [MAIN ] JQC: Generated 1807 derivative records from 33945 primary records. [2025-10-16T22:39:42.274048] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-16T22:39:42.275309] [DEBUG] [MAIN ] JPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:42.276810] [INFO ] [MAIN ] JPM: Generated 1807 derivative records from 54184 primary records. [2025-10-16T22:39:42.285278] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-16T22:39:42.292964] [DEBUG] [LOCAL ] JQC: Derivative data saved (1807 records). [2025-10-16T22:39:42.293075] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-16T22:39:42.295891] [INFO ] [MAIN ] Derivative Progress: 995/1803 symbols completed. JQC took 1.1s. Estimated remaining: 5m 10s. Rate: 156.5 symbols/min [2025-10-16T22:39:42.306892] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:42.315808] [DEBUG] [LOCAL ] JPM: Derivative data saved (1807 records). [2025-10-16T22:39:42.322946] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-16T22:39:42.325573] [INFO ] [MAIN ] Derivative Progress: 996/1803 symbols completed. JPM took 1.2s. Estimated remaining: 5m 9s. Rate: 156.6 symbols/min [2025-10-16T22:39:42.325789] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:42.321290] [DEBUG] [LOCAL ] JRS: Loaded 11746 existing records from primary storage. [2025-10-16T22:39:42.326370] [INFO ] [MAIN ] JRS: Loaded 11746 primary data records. [2025-10-16T22:39:42.687285] [DEBUG] [LOCAL ] JXN: Loaded 45020 existing records from primary storage. [2025-10-16T22:39:42.687851] [INFO ] [MAIN ] JXN: Loaded 45020 primary data records. [2025-10-16T22:39:42.799967] [DEBUG] [LOCAL ] K: Loaded 50804 existing records from primary storage. [2025-10-16T22:39:42.812808] [INFO ] [MAIN ] K: Loaded 50804 primary data records. [2025-10-16T22:39:43.190638] [DEBUG] [MAIN ] JRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:43.213811] [INFO ] [MAIN ] JRS: Generated 1807 derivative records from 11746 primary records. [2025-10-16T22:39:43.330434] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-16T22:39:43.348916] [DEBUG] [LOCAL ] JRS: Derivative data saved (1807 records). [2025-10-16T22:39:43.349896] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-16T22:39:43.352215] [INFO ] [MAIN ] Derivative Progress: 997/1803 symbols completed. JRS took 1.1s. Estimated remaining: 5m 9s. Rate: 156.4 symbols/min [2025-10-16T22:39:43.352816] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:43.382807] [DEBUG] [LOCAL ] KAI: Loaded 13688 existing records from primary storage. [2025-10-16T22:39:43.383204] [DEBUG] [MAIN ] JXN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:43.384126] [INFO ] [MAIN ] JXN: Generated 1807 derivative records from 45020 primary records. [2025-10-16T22:39:43.383478] [INFO ] [MAIN ] KAI: Loaded 13688 primary data records. [2025-10-16T22:39:43.384349] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-16T22:39:43.534226] [DEBUG] [MAIN ] K: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:43.545393] [DEBUG] [LOCAL ] JXN: Derivative data saved (1807 records). [2025-10-16T22:39:43.566919] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-16T22:39:43.558225] [INFO ] [MAIN ] K: Generated 1807 derivative records from 50804 primary records. [2025-10-16T22:39:43.595121] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-16T22:39:43.695543] [INFO ] [MAIN ] Derivative Progress: 998/1803 symbols completed. JXN took 1.4s. Estimated remaining: 5m 9s. Rate: 156.4 symbols/min [2025-10-16T22:39:43.708836] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:43.727524] [DEBUG] [LOCAL ] K: Derivative data saved (1807 records). [2025-10-16T22:39:43.728722] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-16T22:39:43.732540] [INFO ] [MAIN ] Derivative Progress: 999/1803 symbols completed. K took 1.4s. Estimated remaining: 5m 8s. Rate: 156.5 symbols/min [2025-10-16T22:39:43.733284] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:43.778126] [DEBUG] [MAIN ] KAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:43.779423] [INFO ] [MAIN ] KAI: Generated 1807 derivative records from 13688 primary records. [2025-10-16T22:39:43.778635] [DEBUG] [LOCAL ] KB: Loaded 23518 existing records from primary storage. [2025-10-16T22:39:43.779554] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-16T22:39:43.780225] [INFO ] [MAIN ] KB: Loaded 23518 primary data records. [2025-10-16T22:39:43.877817] [DEBUG] [LOCAL ] KAR: Loaded 40339 existing records from primary storage. [2025-10-16T22:39:43.881963] [DEBUG] [LOCAL ] KAI: Derivative data saved (1807 records). [2025-10-16T22:39:43.887261] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-16T22:39:43.887323] [INFO ] [MAIN ] KAR: Loaded 40339 primary data records. [2025-10-16T22:39:43.889725] [INFO ] [MAIN ] Derivative Progress: 1000/1803 symbols completed. KAI took 0.5s. Estimated remaining: 5m 8s. Rate: 156.6 symbols/min [2025-10-16T22:39:43.922913] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:44.452412] [DEBUG] [LOCAL ] KBDC: Loaded 22431 existing records from primary storage. [2025-10-16T22:39:44.462714] [INFO ] [MAIN ] KBDC: Loaded 22431 primary data records. [2025-10-16T22:39:44.778230] [DEBUG] [MAIN ] KB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:44.781447] [INFO ] [MAIN ] KB: Generated 1807 derivative records from 23518 primary records. [2025-10-16T22:39:44.782621] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-16T22:39:44.812190] [DEBUG] [MAIN ] KAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:44.813225] [DEBUG] [LOCAL ] KB: Derivative data saved (1807 records). [2025-10-16T22:39:44.813424] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-16T22:39:44.814181] [INFO ] [MAIN ] KAR: Generated 1807 derivative records from 40339 primary records. [2025-10-16T22:39:44.816435] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-16T22:39:44.816332] [INFO ] [MAIN ] Derivative Progress: 1001/1803 symbols completed. KB took 1.1s. Estimated remaining: 5m 8s. Rate: 156.4 symbols/min [2025-10-16T22:39:44.817610] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:44.834831] [DEBUG] [LOCAL ] KAR: Derivative data saved (1807 records). [2025-10-16T22:39:44.835042] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-16T22:39:44.837500] [INFO ] [MAIN ] Derivative Progress: 1002/1803 symbols completed. KAR took 1.1s. Estimated remaining: 5m 7s. Rate: 156.5 symbols/min [2025-10-16T22:39:44.837677] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:44.856827] [DEBUG] [MAIN ] KBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:44.857497] [INFO ] [MAIN ] KBDC: Generated 1807 derivative records from 22431 primary records. [2025-10-16T22:39:44.857611] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-16T22:39:44.874821] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1807 records). [2025-10-16T22:39:44.885189] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-16T22:39:44.887696] [INFO ] [MAIN ] Derivative Progress: 1003/1803 symbols completed. KBDC took 1.0s. Estimated remaining: 5m 6s. Rate: 156.7 symbols/min [2025-10-16T22:39:44.915211] [DEBUG] [LOCAL ] KBH: Loaded 49212 existing records from primary storage. [2025-10-16T22:39:44.915376] [INFO ] [MAIN ] KBH: Loaded 49212 primary data records. [2025-10-16T22:39:45.033104] [DEBUG] [LOCAL ] KBR: Loaded 48409 existing records from primary storage. [2025-10-16T22:39:45.044116] [INFO ] [MAIN ] KBR: Loaded 48409 primary data records. [2025-10-16T22:39:45.545744] [DEBUG] [MAIN ] KBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:45.546445] [INFO ] [MAIN ] KBH: Generated 1807 derivative records from 49212 primary records. [2025-10-16T22:39:45.546664] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-16T22:39:45.563013] [DEBUG] [LOCAL ] KBH: Derivative data saved (1807 records). [2025-10-16T22:39:45.563277] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-16T22:39:45.565231] [INFO ] [MAIN ] Derivative Progress: 1004/1803 symbols completed. KBH took 0.7s. Estimated remaining: 5m 6s. Rate: 156.5 symbols/min [2025-10-16T22:39:45.580144] [DEBUG] [MAIN ] KBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:45.580754] [INFO ] [MAIN ] KBR: Generated 1807 derivative records from 48409 primary records. [2025-10-16T22:39:45.580816] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-16T22:39:45.595769] [DEBUG] [LOCAL ] KBR: Derivative data saved (1807 records). [2025-10-16T22:39:45.595847] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-16T22:39:45.598388] [INFO ] [MAIN ] Derivative Progress: 1005/1803 symbols completed. KBR took 0.8s. Estimated remaining: 5m 6s. Rate: 156.7 symbols/min [2025-10-16T22:39:45.598938] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:45.599017] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:45.598871] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:45.606374] [DEBUG] [LOCAL ] KEN: Loaded 4721 existing records from primary storage. [2025-10-16T22:39:45.606542] [INFO ] [MAIN ] KEN: Loaded 4721 primary data records. [2025-10-16T22:39:45.915190] [DEBUG] [LOCAL ] KEP: Loaded 32230 existing records from primary storage. [2025-10-16T22:39:45.929535] [INFO ] [MAIN ] KEP: Loaded 32230 primary data records. [2025-10-16T22:39:46.038352] [DEBUG] [LOCAL ] KD: Loaded 52742 existing records from primary storage. [2025-10-16T22:39:46.055687] [INFO ] [MAIN ] KD: Loaded 52742 primary data records. [2025-10-16T22:39:46.635270] [DEBUG] [MAIN ] KEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:46.638229] [INFO ] [MAIN ] KEN: Generated 1807 derivative records from 4721 primary records. [2025-10-16T22:39:46.638610] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-16T22:39:46.659434] [DEBUG] [LOCAL ] KEN: Derivative data saved (1807 records). [2025-10-16T22:39:46.671747] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-16T22:39:46.671988] [DEBUG] [MAIN ] KEP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:46.674333] [INFO ] [MAIN ] Derivative Progress: 1006/1803 symbols completed. KEN took 1.1s. Estimated remaining: 5m 6s. Rate: 156.4 symbols/min [2025-10-16T22:39:46.675412] [INFO ] [MAIN ] KEP: Generated 1807 derivative records from 32230 primary records. [2025-10-16T22:39:46.674693] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:46.675933] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-16T22:39:46.695102] [DEBUG] [LOCAL ] KEP: Derivative data saved (1807 records). [2025-10-16T22:39:46.695340] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-16T22:39:46.697672] [INFO ] [MAIN ] Derivative Progress: 1007/1803 symbols completed. KEP took 1.1s. Estimated remaining: 5m 5s. Rate: 156.6 symbols/min [2025-10-16T22:39:46.710370] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:46.710255] [DEBUG] [MAIN ] KD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:46.711601] [INFO ] [MAIN ] KD: Generated 1807 derivative records from 52742 primary records. [2025-10-16T22:39:46.711838] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-16T22:39:46.736759] [DEBUG] [LOCAL ] KD: Derivative data saved (1807 records). [2025-10-16T22:39:46.736827] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-16T22:39:46.739406] [INFO ] [MAIN ] Derivative Progress: 1008/1803 symbols completed. KD took 1.1s. Estimated remaining: 5m 4s. Rate: 156.7 symbols/min [2025-10-16T22:39:46.739718] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:46.754512] [DEBUG] [LOCAL ] KEX: Loaded 38962 existing records from primary storage. [2025-10-16T22:39:46.767271] [DEBUG] [LOCAL ] KF: Loaded 2377 existing records from primary storage. [2025-10-16T22:39:46.755051] [INFO ] [MAIN ] KEX: Loaded 38962 primary data records. [2025-10-16T22:39:46.767600] [INFO ] [MAIN ] KF: Loaded 2377 primary data records. [2025-10-16T22:39:46.943626] [DEBUG] [LOCAL ] KEYS: Loaded 43613 existing records from primary storage. [2025-10-16T22:39:46.985786] [INFO ] [MAIN ] KEYS: Loaded 43613 primary data records. [2025-10-16T22:39:47.714892] [DEBUG] [MAIN ] KF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:47.717063] [INFO ] [MAIN ] KF: Generated 1807 derivative records from 2377 primary records. [2025-10-16T22:39:47.717161] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-16T22:39:47.751838] [DEBUG] [MAIN ] KEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:47.757477] [INFO ] [MAIN ] KEX: Generated 1807 derivative records from 38962 primary records. [2025-10-16T22:39:47.754923] [DEBUG] [MAIN ] KEYS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:47.758442] [INFO ] [MAIN ] KEYS: Generated 1807 derivative records from 43613 primary records. [2025-10-16T22:39:47.757693] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-16T22:39:47.761365] [DEBUG] [LOCAL ] KF: Derivative data saved (1807 records). [2025-10-16T22:39:47.758666] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-16T22:39:47.761739] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-16T22:39:47.771955] [INFO ] [MAIN ] Derivative Progress: 1009/1803 symbols completed. KF took 1.0s. Estimated remaining: 5m 5s. Rate: 156.4 symbols/min [2025-10-16T22:39:47.772302] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:47.792171] [DEBUG] [LOCAL ] KEX: Derivative data saved (1807 records). [2025-10-16T22:39:47.796241] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1807 records). [2025-10-16T22:39:47.796438] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-16T22:39:47.796494] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-16T22:39:47.799197] [INFO ] [MAIN ] Derivative Progress: 1010/1803 symbols completed. KEYS took 1.1s. Estimated remaining: 5m 4s. Rate: 156.6 symbols/min [2025-10-16T22:39:47.799347] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:47.801956] [INFO ] [MAIN ] Derivative Progress: 1011/1803 symbols completed. KEX took 1.1s. Estimated remaining: 5m 3s. Rate: 156.7 symbols/min [2025-10-16T22:39:47.802627] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:47.824011] [DEBUG] [LOCAL ] KFS: Loaded 8736 existing records from primary storage. [2025-10-16T22:39:47.824195] [INFO ] [MAIN ] KFS: Loaded 8736 primary data records. [2025-10-16T22:39:47.845332] [DEBUG] [LOCAL ] KFRC: Loaded 20719 existing records from primary storage. [2025-10-16T22:39:47.860598] [INFO ] [MAIN ] KFRC: Loaded 20719 primary data records. [2025-10-16T22:39:48.030585] [DEBUG] [LOCAL ] KFY: Loaded 30189 existing records from primary storage. [2025-10-16T22:39:48.062071] [INFO ] [MAIN ] KFY: Loaded 30189 primary data records. [2025-10-16T22:39:48.830984] [DEBUG] [MAIN ] KFS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:39:48.833075] [INFO ] [MAIN ] KFS: Generated 1806 derivative records from 8736 primary records. [2025-10-16T22:39:48.833888] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-16T22:39:48.862253] [DEBUG] [MAIN ] KFRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:48.865244] [INFO ] [MAIN ] KFRC: Generated 1807 derivative records from 20719 primary records. [2025-10-16T22:39:48.867275] [DEBUG] [LOCAL ] KFS: Derivative data saved (1806 records). [2025-10-16T22:39:48.875010] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-16T22:39:48.875108] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-16T22:39:48.881747] [INFO ] [MAIN ] Derivative Progress: 1012/1803 symbols completed. KFS took 1.1s. Estimated remaining: 5m 3s. Rate: 156.4 symbols/min [2025-10-16T22:39:48.883283] [DEBUG] [MAIN ] KFY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:48.882801] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:48.884522] [INFO ] [MAIN ] KFY: Generated 1807 derivative records from 30189 primary records. [2025-10-16T22:39:48.892161] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-16T22:39:48.900962] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1807 records). [2025-10-16T22:39:48.901080] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-16T22:39:48.903713] [INFO ] [MAIN ] Derivative Progress: 1013/1803 symbols completed. KFRC took 1.1s. Estimated remaining: 5m 3s. Rate: 156.6 symbols/min [2025-10-16T22:39:48.915289] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:48.923250] [DEBUG] [LOCAL ] KFY: Derivative data saved (1807 records). [2025-10-16T22:39:48.923548] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-10-16T22:39:48.926967] [INFO ] [MAIN ] Derivative Progress: 1014/1803 symbols completed. KFY took 1.1s. Estimated remaining: 5m 2s. Rate: 156.7 symbols/min [2025-10-16T22:39:48.927346] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:48.976520] [DEBUG] [LOCAL ] KGS: Loaded 46426 existing records from primary storage. [2025-10-16T22:39:48.976736] [INFO ] [MAIN ] KGS: Loaded 46426 primary data records. [2025-10-16T22:39:49.099085] [DEBUG] [LOCAL ] KGC: Loaded 54090 existing records from primary storage. [2025-10-16T22:39:49.145058] [INFO ] [MAIN ] KGC: Loaded 54090 primary data records. [2025-10-16T22:39:49.436533] [DEBUG] [LOCAL ] KIM: Loaded 53394 existing records from primary storage. [2025-10-16T22:39:49.445405] [INFO ] [MAIN ] KIM: Loaded 53394 primary data records. [2025-10-16T22:39:49.983264] [DEBUG] [MAIN ] KGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:49.985604] [INFO ] [MAIN ] KGS: Generated 1807 derivative records from 46426 primary records. [2025-10-16T22:39:49.985884] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-16T22:39:50.006523] [DEBUG] [LOCAL ] KGS: Derivative data saved (1807 records). [2025-10-16T22:39:50.007918] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-16T22:39:50.011635] [INFO ] [MAIN ] Derivative Progress: 1015/1803 symbols completed. KGS took 1.1s. Estimated remaining: 5m 2s. Rate: 156.5 symbols/min [2025-10-16T22:39:50.012205] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:50.025477] [DEBUG] [MAIN ] KGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:50.026216] [INFO ] [MAIN ] KGC: Generated 1807 derivative records from 54090 primary records. [2025-10-16T22:39:50.026396] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-16T22:39:50.048281] [DEBUG] [LOCAL ] KGC: Derivative data saved (1807 records). [2025-10-16T22:39:50.048520] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-16T22:39:50.051196] [INFO ] [MAIN ] Derivative Progress: 1016/1803 symbols completed. KGC took 1.2s. Estimated remaining: 5m 2s. Rate: 156.6 symbols/min [2025-10-16T22:39:50.053107] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:50.074777] [DEBUG] [LOCAL ] KIO: Loaded 21866 existing records from primary storage. [2025-10-16T22:39:50.075106] [DEBUG] [MAIN ] KIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:50.075993] [INFO ] [MAIN ] KIM: Generated 1807 derivative records from 53394 primary records. [2025-10-16T22:39:50.076169] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-16T22:39:50.076098] [INFO ] [MAIN ] KIO: Loaded 21866 primary data records. [2025-10-16T22:39:50.216384] [DEBUG] [LOCAL ] KIM: Derivative data saved (1807 records). [2025-10-16T22:39:50.266707] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-10-16T22:39:50.274597] [INFO ] [MAIN ] Derivative Progress: 1017/1803 symbols completed. KIM took 1.3s. Estimated remaining: 5m 1s. Rate: 156.7 symbols/min [2025-10-16T22:39:50.274951] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:50.452070] [DEBUG] [LOCAL ] KKRS: Loaded 5648 existing records from primary storage. [2025-10-16T22:39:50.452515] [INFO ] [MAIN ] KKRS: Loaded 5648 primary data records. [2025-10-16T22:39:50.584075] [DEBUG] [LOCAL ] KKR: Loaded 53893 existing records from primary storage. [2025-10-16T22:39:50.605188] [INFO ] [MAIN ] KKR: Loaded 53893 primary data records. [2025-10-16T22:39:50.920162] [DEBUG] [MAIN ] KIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:50.948181] [INFO ] [MAIN ] KIO: Generated 1807 derivative records from 21866 primary records. [2025-10-16T22:39:50.994739] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-16T22:39:51.111342] [DEBUG] [LOCAL ] KIO: Derivative data saved (1807 records). [2025-10-16T22:39:51.111483] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-16T22:39:51.114174] [INFO ] [MAIN ] Derivative Progress: 1018/1803 symbols completed. KIO took 1.1s. Estimated remaining: 5m 1s. Rate: 156.5 symbols/min [2025-10-16T22:39:51.131976] [DEBUG] [MAIN ] KKRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:51.132631] [INFO ] [MAIN ] KKRS: Generated 1807 derivative records from 5648 primary records. [2025-10-16T22:39:51.132809] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-16T22:39:51.147972] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1807 records). [2025-10-16T22:39:51.148270] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-16T22:39:51.150584] [INFO ] [MAIN ] Derivative Progress: 1019/1803 symbols completed. KKRS took 0.9s. Estimated remaining: 5m 0s. Rate: 156.6 symbols/min [2025-10-16T22:39:51.165718] [DEBUG] [MAIN ] KKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:51.166249] [INFO ] [MAIN ] KKR: Generated 1807 derivative records from 53893 primary records. [2025-10-16T22:39:51.166309] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-16T22:39:51.181975] [DEBUG] [LOCAL ] KKR: Derivative data saved (1807 records). [2025-10-16T22:39:51.182036] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-16T22:39:51.184553] [INFO ] [MAIN ] Derivative Progress: 1020/1803 symbols completed. KKR took 1.1s. Estimated remaining: 4m 60s. Rate: 156.8 symbols/min [2025-10-16T22:39:51.185019] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:51.184956] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:51.185200] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:51.192824] [DEBUG] [LOCAL ] KMPB: Loaded 3667 existing records from primary storage. [2025-10-16T22:39:51.193149] [INFO ] [MAIN ] KMPB: Loaded 3667 primary data records. [2025-10-16T22:39:51.526790] [DEBUG] [LOCAL ] KLC: Loaded 36757 existing records from primary storage. [2025-10-16T22:39:51.527531] [INFO ] [MAIN ] KLC: Loaded 36757 primary data records. [2025-10-16T22:39:51.646785] [DEBUG] [LOCAL ] KMI: Loaded 54083 existing records from primary storage. [2025-10-16T22:39:51.647033] [INFO ] [MAIN ] KMI: Loaded 54083 primary data records. [2025-10-16T22:39:52.174901] [DEBUG] [MAIN ] KMPB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:52.175853] [INFO ] [MAIN ] KMPB: Generated 1807 derivative records from 3667 primary records. [2025-10-16T22:39:52.176112] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-16T22:39:52.191475] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1807 records). [2025-10-16T22:39:52.191684] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-16T22:39:52.194175] [INFO ] [MAIN ] Derivative Progress: 1021/1803 symbols completed. KMPB took 1.0s. Estimated remaining: 4m 60s. Rate: 156.5 symbols/min [2025-10-16T22:39:52.195737] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:52.212362] [DEBUG] [MAIN ] KLC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:52.213059] [INFO ] [MAIN ] KLC: Generated 1807 derivative records from 36757 primary records. [2025-10-16T22:39:52.213308] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-16T22:39:52.239261] [DEBUG] [LOCAL ] KLC: Derivative data saved (1807 records). [2025-10-16T22:39:52.244765] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-16T22:39:52.244707] [DEBUG] [MAIN ] KMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:52.248345] [INFO ] [MAIN ] Derivative Progress: 1022/1803 symbols completed. KLC took 1.1s. Estimated remaining: 4m 59s. Rate: 156.6 symbols/min [2025-10-16T22:39:52.248523] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:52.249399] [INFO ] [MAIN ] KMI: Generated 1807 derivative records from 54083 primary records. [2025-10-16T22:39:52.249860] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-16T22:39:52.276695] [DEBUG] [LOCAL ] KMI: Derivative data saved (1807 records). [2025-10-16T22:39:52.287714] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-16T22:39:52.292810] [DEBUG] [LOCAL ] KMPR: Loaded 40369 existing records from primary storage. [2025-10-16T22:39:52.291560] [INFO ] [MAIN ] Derivative Progress: 1023/1803 symbols completed. KMI took 1.1s. Estimated remaining: 4m 59s. Rate: 156.8 symbols/min [2025-10-16T22:39:52.293103] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:52.293230] [INFO ] [MAIN ] KMPR: Loaded 40369 primary data records. [2025-10-16T22:39:52.642405] [DEBUG] [LOCAL ] KMT: Loaded 43226 existing records from primary storage. [2025-10-16T22:39:52.642627] [INFO ] [MAIN ] KMT: Loaded 43226 primary data records. [2025-10-16T22:39:52.779948] [DEBUG] [LOCAL ] KMX: Loaded 53667 existing records from primary storage. [2025-10-16T22:39:52.790481] [INFO ] [MAIN ] KMX: Loaded 53667 primary data records. [2025-10-16T22:39:53.265850] [DEBUG] [MAIN ] KMPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:53.268022] [INFO ] [MAIN ] KMPR: Generated 1807 derivative records from 40369 primary records. [2025-10-16T22:39:53.268470] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-16T22:39:53.286052] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1807 records). [2025-10-16T22:39:53.286684] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-16T22:39:53.289638] [INFO ] [MAIN ] Derivative Progress: 1024/1803 symbols completed. KMPR took 1.1s. Estimated remaining: 4m 59s. Rate: 156.5 symbols/min [2025-10-16T22:39:53.289935] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:53.309128] [DEBUG] [MAIN ] KMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:53.310110] [INFO ] [MAIN ] KMT: Generated 1807 derivative records from 43226 primary records. [2025-10-16T22:39:53.310347] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-16T22:39:53.343770] [DEBUG] [LOCAL ] KMT: Derivative data saved (1807 records). [2025-10-16T22:39:53.357748] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-16T22:39:53.360003] [INFO ] [MAIN ] Derivative Progress: 1025/1803 symbols completed. KMT took 1.1s. Estimated remaining: 4m 58s. Rate: 156.6 symbols/min [2025-10-16T22:39:53.360328] [DEBUG] [MAIN ] KMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:53.361352] [INFO ] [MAIN ] KMX: Generated 1807 derivative records from 53667 primary records. [2025-10-16T22:39:53.360525] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:53.361511] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-16T22:39:53.389931] [DEBUG] [LOCAL ] KMX: Derivative data saved (1807 records). [2025-10-16T22:39:53.390136] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-16T22:39:53.393559] [INFO ] [MAIN ] Derivative Progress: 1026/1803 symbols completed. KMX took 1.1s. Estimated remaining: 4m 57s. Rate: 156.8 symbols/min [2025-10-16T22:39:53.390759] [DEBUG] [LOCAL ] KN: Loaded 38866 existing records from primary storage. [2025-10-16T22:39:53.393839] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:53.394983] [INFO ] [MAIN ] KN: Loaded 38866 primary data records. [2025-10-16T22:39:53.528357] [DEBUG] [LOCAL ] KNOP: Loaded 10555 existing records from primary storage. [2025-10-16T22:39:53.534175] [DEBUG] [LOCAL ] KNF: Loaded 36840 existing records from primary storage. [2025-10-16T22:39:53.544577] [INFO ] [MAIN ] KNF: Loaded 36840 primary data records. [2025-10-16T22:39:53.581921] [INFO ] [MAIN ] KNOP: Loaded 10555 primary data records. [2025-10-16T22:39:54.376578] [DEBUG] [MAIN ] KN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:54.377401] [INFO ] [MAIN ] KN: Generated 1807 derivative records from 38866 primary records. [2025-10-16T22:39:54.377630] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-16T22:39:54.394741] [DEBUG] [LOCAL ] KN: Derivative data saved (1807 records). [2025-10-16T22:39:54.394929] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-16T22:39:54.397973] [INFO ] [MAIN ] Derivative Progress: 1027/1803 symbols completed. KN took 1.1s. Estimated remaining: 4m 57s. Rate: 156.5 symbols/min [2025-10-16T22:39:54.398224] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:54.416686] [DEBUG] [MAIN ] KNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:54.425292] [INFO ] [MAIN ] KNF: Generated 1807 derivative records from 36840 primary records. [2025-10-16T22:39:54.425395] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-16T22:39:54.430702] [DEBUG] [MAIN ] KNOP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:54.437014] [INFO ] [MAIN ] KNOP: Generated 1807 derivative records from 10555 primary records. [2025-10-16T22:39:54.445438] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-16T22:39:54.474113] [DEBUG] [LOCAL ] KNSL: Loaded 18656 existing records from primary storage. [2025-10-16T22:39:54.475940] [INFO ] [MAIN ] KNSL: Loaded 18656 primary data records. [2025-10-16T22:39:54.479263] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1807 records). [2025-10-16T22:39:54.479733] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-10-16T22:39:54.482567] [INFO ] [MAIN ] Derivative Progress: 1028/1803 symbols completed. KNOP took 1.1s. Estimated remaining: 4m 57s. Rate: 156.7 symbols/min [2025-10-16T22:39:54.483041] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:54.495315] [DEBUG] [LOCAL ] KNF: Derivative data saved (1807 records). [2025-10-16T22:39:54.515799] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-16T22:39:54.530690] [INFO ] [MAIN ] Derivative Progress: 1029/1803 symbols completed. KNF took 1.2s. Estimated remaining: 4m 56s. Rate: 156.8 symbols/min [2025-10-16T22:39:54.565210] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:54.836991] [DEBUG] [LOCAL ] KNTK: Loaded 47433 existing records from primary storage. [2025-10-16T22:39:54.837419] [INFO ] [MAIN ] KNTK: Loaded 47433 primary data records. [2025-10-16T22:39:54.956798] [DEBUG] [LOCAL ] KNX: Loaded 53005 existing records from primary storage. [2025-10-16T22:39:54.974531] [INFO ] [MAIN ] KNX: Loaded 53005 primary data records. [2025-10-16T22:39:55.092772] [DEBUG] [MAIN ] KNSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:55.258278] [INFO ] [MAIN ] KNSL: Generated 1807 derivative records from 18656 primary records. [2025-10-16T22:39:55.263668] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-16T22:39:55.335912] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1807 records). [2025-10-16T22:39:55.367210] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-16T22:39:55.470339] [INFO ] [MAIN ] Derivative Progress: 1030/1803 symbols completed. KNSL took 1.1s. Estimated remaining: 4m 56s. Rate: 156.6 symbols/min [2025-10-16T22:39:55.476050] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:55.510459] [DEBUG] [MAIN ] KNTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:55.511345] [INFO ] [MAIN ] KNTK: Generated 1807 derivative records from 47433 primary records. [2025-10-16T22:39:55.511636] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-16T22:39:55.530183] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1807 records). [2025-10-16T22:39:55.539612] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-16T22:39:55.541713] [INFO ] [MAIN ] Derivative Progress: 1031/1803 symbols completed. KNTK took 1.1s. Estimated remaining: 4m 56s. Rate: 156.7 symbols/min [2025-10-16T22:39:55.554581] [DEBUG] [MAIN ] KNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:55.554209] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:55.555517] [INFO ] [MAIN ] KNX: Generated 1807 derivative records from 53005 primary records. [2025-10-16T22:39:55.555704] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-16T22:39:55.572458] [DEBUG] [LOCAL ] KNX: Derivative data saved (1807 records). [2025-10-16T22:39:55.572731] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-16T22:39:55.586791] [INFO ] [MAIN ] Derivative Progress: 1032/1803 symbols completed. KNX took 1.0s. Estimated remaining: 4m 55s. Rate: 156.8 symbols/min [2025-10-16T22:39:55.587020] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:55.590207] [DEBUG] [LOCAL ] KODK: Loaded 44120 existing records from primary storage. [2025-10-16T22:39:55.597230] [INFO ] [MAIN ] KODK: Loaded 44120 primary data records. [2025-10-16T22:39:55.718857] [DEBUG] [LOCAL ] KOP: Loaded 17544 existing records from primary storage. [2025-10-16T22:39:55.722797] [DEBUG] [LOCAL ] KOF: Loaded 26812 existing records from primary storage. [2025-10-16T22:39:55.723175] [INFO ] [MAIN ] KOP: Loaded 17544 primary data records. [2025-10-16T22:39:55.723079] [INFO ] [MAIN ] KOF: Loaded 26812 primary data records. [2025-10-16T22:39:56.624204] [DEBUG] [MAIN ] KODK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:56.638902] [INFO ] [MAIN ] KODK: Generated 1807 derivative records from 44120 primary records. [2025-10-16T22:39:56.640088] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-16T22:39:56.641068] [DEBUG] [MAIN ] KOP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:56.654174] [INFO ] [MAIN ] KOP: Generated 1807 derivative records from 17544 primary records. [2025-10-16T22:39:56.666494] [DEBUG] [LOCAL ] KODK: Derivative data saved (1807 records). [2025-10-16T22:39:56.671605] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-16T22:39:56.671855] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-16T22:39:56.672159] [DEBUG] [MAIN ] KOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:56.674853] [INFO ] [MAIN ] Derivative Progress: 1033/1803 symbols completed. KODK took 1.2s. Estimated remaining: 4m 55s. Rate: 156.5 symbols/min [2025-10-16T22:39:56.675758] [INFO ] [MAIN ] KOF: Generated 1807 derivative records from 26812 primary records. [2025-10-16T22:39:56.676572] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-16T22:39:56.704733] [DEBUG] [LOCAL ] KOP: Derivative data saved (1807 records). [2025-10-16T22:39:56.705873] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-16T22:39:56.706854] [DEBUG] [LOCAL ] KOF: Derivative data saved (1807 records). [2025-10-16T22:39:56.712497] [INFO ] [MAIN ] Derivative Progress: 1034/1803 symbols completed. KOP took 1.1s. Estimated remaining: 4m 54s. Rate: 156.7 symbols/min [2025-10-16T22:39:56.712604] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-16T22:39:56.715000] [INFO ] [MAIN ] Derivative Progress: 1035/1803 symbols completed. KOF took 1.2s. Estimated remaining: 4m 54s. Rate: 156.8 symbols/min [2025-10-16T22:39:56.715591] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:56.715519] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:56.715695] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:56.721219] [DEBUG] [LOCAL ] KORE: Loaded 2182 existing records from primary storage. [2025-10-16T22:39:56.721365] [INFO ] [MAIN ] KORE: Loaded 2182 primary data records. [2025-10-16T22:39:57.080126] [DEBUG] [LOCAL ] KOS: Loaded 53487 existing records from primary storage. [2025-10-16T22:39:57.082719] [INFO ] [MAIN ] KOS: Loaded 53487 primary data records. [2025-10-16T22:39:57.119509] [DEBUG] [LOCAL ] KR: Loaded 54070 existing records from primary storage. [2025-10-16T22:39:57.152057] [INFO ] [MAIN ] KR: Loaded 54070 primary data records. [2025-10-16T22:39:57.515462] [DEBUG] [MAIN ] KORE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:57.532561] [INFO ] [MAIN ] KORE: Generated 1807 derivative records from 2182 primary records. [2025-10-16T22:39:57.533357] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-16T22:39:57.714741] [DEBUG] [LOCAL ] KORE: Derivative data saved (1807 records). [2025-10-16T22:39:57.723193] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-10-16T22:39:57.726290] [INFO ] [MAIN ] Derivative Progress: 1036/1803 symbols completed. KORE took 1.0s. Estimated remaining: 4m 54s. Rate: 156.6 symbols/min [2025-10-16T22:39:57.726486] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:57.752861] [DEBUG] [MAIN ] KOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:57.753746] [INFO ] [MAIN ] KOS: Generated 1807 derivative records from 53487 primary records. [2025-10-16T22:39:57.753906] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-16T22:39:57.790944] [DEBUG] [MAIN ] KR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:57.792579] [INFO ] [MAIN ] KR: Generated 1807 derivative records from 54070 primary records. [2025-10-16T22:39:57.792882] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-16T22:39:57.803770] [DEBUG] [LOCAL ] KOS: Derivative data saved (1807 records). [2025-10-16T22:39:57.821043] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-16T22:39:57.824430] [INFO ] [MAIN ] Derivative Progress: 1037/1803 symbols completed. KOS took 1.1s. Estimated remaining: 4m 53s. Rate: 156.7 symbols/min [2025-10-16T22:39:57.825288] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:57.828468] [DEBUG] [LOCAL ] KRC: Loaded 48625 existing records from primary storage. [2025-10-16T22:39:57.829614] [DEBUG] [LOCAL ] KR: Derivative data saved (1807 records). [2025-10-16T22:39:57.829905] [INFO ] [MAIN ] KRC: Loaded 48625 primary data records. [2025-10-16T22:39:57.830026] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-16T22:39:57.844331] [INFO ] [MAIN ] Derivative Progress: 1038/1803 symbols completed. KR took 1.1s. Estimated remaining: 4m 53s. Rate: 156.8 symbols/min [2025-10-16T22:39:57.853827] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:58.164678] [DEBUG] [LOCAL ] KREF: Loaded 38221 existing records from primary storage. [2025-10-16T22:39:58.195279] [INFO ] [MAIN ] KREF: Loaded 38221 primary data records. [2025-10-16T22:39:58.335396] [DEBUG] [LOCAL ] KRG: Loaded 49661 existing records from primary storage. [2025-10-16T22:39:58.368872] [INFO ] [MAIN ] KRG: Loaded 49661 primary data records. [2025-10-16T22:39:58.659850] [DEBUG] [MAIN ] KRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:58.676282] [INFO ] [MAIN ] KRC: Generated 1807 derivative records from 48625 primary records. [2025-10-16T22:39:58.676419] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-16T22:39:58.862785] [DEBUG] [LOCAL ] KRC: Derivative data saved (1807 records). [2025-10-16T22:39:58.863675] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-16T22:39:58.866375] [INFO ] [MAIN ] Derivative Progress: 1039/1803 symbols completed. KRC took 1.1s. Estimated remaining: 4m 53s. Rate: 156.6 symbols/min [2025-10-16T22:39:58.866778] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:58.884843] [DEBUG] [MAIN ] KREF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:58.885942] [INFO ] [MAIN ] KREF: Generated 1807 derivative records from 38221 primary records. [2025-10-16T22:39:58.886095] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-16T22:39:58.902498] [DEBUG] [LOCAL ] KREF: Derivative data saved (1807 records). [2025-10-16T22:39:58.902792] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-16T22:39:58.912173] [INFO ] [MAIN ] Derivative Progress: 1040/1803 symbols completed. KREF took 1.1s. Estimated remaining: 4m 52s. Rate: 156.7 symbols/min [2025-10-16T22:39:58.915401] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:58.939774] [DEBUG] [LOCAL ] KRO: Loaded 26679 existing records from primary storage. [2025-10-16T22:39:58.939177] [DEBUG] [MAIN ] KRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:58.939927] [INFO ] [MAIN ] KRO: Loaded 26679 primary data records. [2025-10-16T22:39:58.940599] [INFO ] [MAIN ] KRG: Generated 1807 derivative records from 49661 primary records. [2025-10-16T22:39:58.940865] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-16T22:39:59.151603] [DEBUG] [LOCAL ] KRP: Loaded 36597 existing records from primary storage. [2025-10-16T22:39:59.157341] [INFO ] [MAIN ] KRP: Loaded 36597 primary data records. [2025-10-16T22:39:59.292437] [DEBUG] [LOCAL ] KRG: Derivative data saved (1807 records). [2025-10-16T22:39:59.304233] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-16T22:39:59.306525] [INFO ] [MAIN ] Derivative Progress: 1041/1803 symbols completed. KRG took 1.5s. Estimated remaining: 4m 52s. Rate: 156.7 symbols/min [2025-10-16T22:39:59.306724] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:59.625232] [DEBUG] [MAIN ] KRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:59.627175] [INFO ] [MAIN ] KRO: Generated 1807 derivative records from 26679 primary records. [2025-10-16T22:39:59.628123] [DEBUG] [LOCAL ] KSS: Loaded 53983 existing records from primary storage. [2025-10-16T22:39:59.627419] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-16T22:39:59.630177] [INFO ] [MAIN ] KSS: Loaded 53983 primary data records. [2025-10-16T22:39:59.707167] [DEBUG] [LOCAL ] KRO: Derivative data saved (1807 records). [2025-10-16T22:39:59.720333] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-16T22:39:59.729163] [INFO ] [MAIN ] Derivative Progress: 1042/1803 symbols completed. KRO took 0.9s. Estimated remaining: 4m 51s. Rate: 156.7 symbols/min [2025-10-16T22:39:59.752891] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:39:59.962621] [DEBUG] [MAIN ] KRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:39:59.963405] [INFO ] [MAIN ] KRP: Generated 1807 derivative records from 36597 primary records. [2025-10-16T22:39:59.963623] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-16T22:39:59.980719] [DEBUG] [LOCAL ] KRP: Derivative data saved (1807 records). [2025-10-16T22:39:59.981007] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-16T22:39:59.983742] [INFO ] [MAIN ] Derivative Progress: 1043/1803 symbols completed. KRP took 1.1s. Estimated remaining: 4m 51s. Rate: 156.8 symbols/min [2025-10-16T22:39:59.984211] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:00.032049] [DEBUG] [MAIN ] KSS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:00.033603] [INFO ] [MAIN ] KSS: Generated 1807 derivative records from 53983 primary records. [2025-10-16T22:40:00.033733] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-16T22:40:00.032813] [DEBUG] [LOCAL ] KT: Loaded 45863 existing records from primary storage. [2025-10-16T22:40:00.034335] [INFO ] [MAIN ] KT: Loaded 45863 primary data records. [2025-10-16T22:40:00.222598] [DEBUG] [LOCAL ] KTB: Loaded 40757 existing records from primary storage. [2025-10-16T22:40:00.232727] [INFO ] [MAIN ] KTB: Loaded 40757 primary data records. [2025-10-16T22:40:00.258477] [DEBUG] [LOCAL ] KSS: Derivative data saved (1807 records). [2025-10-16T22:40:00.263731] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-16T22:40:00.441222] [INFO ] [MAIN ] Derivative Progress: 1044/1803 symbols completed. KSS took 1.0s. Estimated remaining: 4m 51s. Rate: 156.7 symbols/min [2025-10-16T22:40:00.467175] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:00.564508] [DEBUG] [LOCAL ] KTF: Loaded 11841 existing records from primary storage. [2025-10-16T22:40:00.585578] [INFO ] [MAIN ] KTF: Loaded 11841 primary data records. [2025-10-16T22:40:01.052542] [DEBUG] [MAIN ] KT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:01.053358] [INFO ] [MAIN ] KT: Generated 1807 derivative records from 45863 primary records. [2025-10-16T22:40:01.053564] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-16T22:40:01.072566] [DEBUG] [LOCAL ] KT: Derivative data saved (1807 records). [2025-10-16T22:40:01.073300] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-16T22:40:01.075898] [INFO ] [MAIN ] Derivative Progress: 1045/1803 symbols completed. KT took 1.3s. Estimated remaining: 4m 50s. Rate: 156.6 symbols/min [2025-10-16T22:40:01.076159] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:01.090559] [DEBUG] [MAIN ] KTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:01.091443] [INFO ] [MAIN ] KTB: Generated 1807 derivative records from 40757 primary records. [2025-10-16T22:40:01.091577] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-16T22:40:01.123439] [DEBUG] [LOCAL ] KTB: Derivative data saved (1807 records). [2025-10-16T22:40:01.123792] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-16T22:40:01.124058] [DEBUG] [MAIN ] KTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:01.126998] [INFO ] [MAIN ] KTF: Generated 1807 derivative records from 11841 primary records. [2025-10-16T22:40:01.126191] [INFO ] [MAIN ] Derivative Progress: 1046/1803 symbols completed. KTB took 1.1s. Estimated remaining: 4m 50s. Rate: 156.8 symbols/min [2025-10-16T22:40:01.127348] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-16T22:40:01.127221] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:01.143541] [DEBUG] [LOCAL ] KTF: Derivative data saved (1807 records). [2025-10-16T22:40:01.143688] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-16T22:40:01.146282] [INFO ] [MAIN ] Derivative Progress: 1047/1803 symbols completed. KTF took 0.7s. Estimated remaining: 4m 49s. Rate: 156.9 symbols/min [2025-10-16T22:40:01.146507] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:01.195667] [DEBUG] [LOCAL ] KVUE: Loaded 54057 existing records from primary storage. [2025-10-16T22:40:01.195981] [INFO ] [MAIN ] KVUE: Loaded 54057 primary data records. [2025-10-16T22:40:01.344732] [DEBUG] [LOCAL ] KVYO: Loaded 51171 existing records from primary storage. [2025-10-16T22:40:01.464779] [DEBUG] [LOCAL ] KW: Loaded 40783 existing records from primary storage. [2025-10-16T22:40:01.409818] [INFO ] [MAIN ] KVYO: Loaded 51171 primary data records. [2025-10-16T22:40:01.514523] [INFO ] [MAIN ] KW: Loaded 40783 primary data records. [2025-10-16T22:40:02.228988] [DEBUG] [MAIN ] KVUE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:02.230630] [INFO ] [MAIN ] KVUE: Generated 1807 derivative records from 54057 primary records. [2025-10-16T22:40:02.231010] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-16T22:40:02.249926] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1807 records). [2025-10-16T22:40:02.250258] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-16T22:40:02.252613] [INFO ] [MAIN ] Derivative Progress: 1048/1803 symbols completed. KVUE took 1.2s. Estimated remaining: 4m 49s. Rate: 156.6 symbols/min [2025-10-16T22:40:02.268897] [DEBUG] [MAIN ] KVYO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:40:02.269709] [INFO ] [MAIN ] KVYO: Generated 1806 derivative records from 51171 primary records. [2025-10-16T22:40:02.269855] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-16T22:40:02.299615] [DEBUG] [MAIN ] KW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:02.301092] [INFO ] [MAIN ] KW: Generated 1807 derivative records from 40783 primary records. [2025-10-16T22:40:02.302409] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1806 records). [2025-10-16T22:40:02.301868] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-16T22:40:02.302906] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-16T22:40:02.305325] [INFO ] [MAIN ] Derivative Progress: 1049/1803 symbols completed. KVYO took 1.2s. Estimated remaining: 4m 49s. Rate: 156.7 symbols/min [2025-10-16T22:40:02.320063] [DEBUG] [LOCAL ] KW: Derivative data saved (1807 records). [2025-10-16T22:40:02.320155] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-16T22:40:02.322662] [INFO ] [MAIN ] Derivative Progress: 1050/1803 symbols completed. KW took 1.2s. Estimated remaining: 4m 48s. Rate: 156.9 symbols/min [2025-10-16T22:40:02.323157] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:02.323318] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:02.323251] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:02.351277] [DEBUG] [LOCAL ] KWR: Loaded 16172 existing records from primary storage. [2025-10-16T22:40:02.351513] [INFO ] [MAIN ] KWR: Loaded 16172 primary data records. [2025-10-16T22:40:02.449873] [DEBUG] [LOCAL ] KYN: Loaded 30494 existing records from primary storage. [2025-10-16T22:40:02.467315] [INFO ] [MAIN ] KYN: Loaded 30494 primary data records. [2025-10-16T22:40:02.654065] [DEBUG] [LOCAL ] L: Loaded 41525 existing records from primary storage. [2025-10-16T22:40:02.810518] [INFO ] [MAIN ] L: Loaded 41525 primary data records. [2025-10-16T22:40:03.406764] [DEBUG] [MAIN ] KWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:03.408288] [INFO ] [MAIN ] KWR: Generated 1807 derivative records from 16172 primary records. [2025-10-16T22:40:03.408754] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-16T22:40:03.429492] [DEBUG] [LOCAL ] KWR: Derivative data saved (1807 records). [2025-10-16T22:40:03.431077] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-16T22:40:03.433117] [INFO ] [MAIN ] Derivative Progress: 1051/1803 symbols completed. KWR took 1.1s. Estimated remaining: 4m 48s. Rate: 156.6 symbols/min [2025-10-16T22:40:03.433603] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:03.448805] [DEBUG] [MAIN ] KYN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:03.449847] [INFO ] [MAIN ] KYN: Generated 1807 derivative records from 30494 primary records. [2025-10-16T22:40:03.450002] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-16T22:40:03.470551] [DEBUG] [LOCAL ] KYN: Derivative data saved (1807 records). [2025-10-16T22:40:03.477833] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-16T22:40:03.489415] [INFO ] [MAIN ] Derivative Progress: 1052/1803 symbols completed. KYN took 1.2s. Estimated remaining: 4m 47s. Rate: 156.7 symbols/min [2025-10-16T22:40:03.486988] [DEBUG] [MAIN ] L: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:03.490399] [INFO ] [MAIN ] L: Generated 1807 derivative records from 41525 primary records. [2025-10-16T22:40:03.490683] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:03.490579] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-16T22:40:03.521831] [DEBUG] [LOCAL ] L: Derivative data saved (1807 records). [2025-10-16T22:40:03.522053] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-10-16T22:40:03.524609] [INFO ] [MAIN ] Derivative Progress: 1053/1803 symbols completed. L took 1.2s. Estimated remaining: 4m 47s. Rate: 156.9 symbols/min [2025-10-16T22:40:03.525038] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:03.556945] [DEBUG] [LOCAL ] LAD: Loaded 23491 existing records from primary storage. [2025-10-16T22:40:03.558235] [DEBUG] [LOCAL ] LAC: Loaded 52900 existing records from primary storage. [2025-10-16T22:40:03.558479] [INFO ] [MAIN ] LAC: Loaded 52900 primary data records. [2025-10-16T22:40:03.558778] [INFO ] [MAIN ] LAD: Loaded 23491 primary data records. [2025-10-16T22:40:03.876912] [DEBUG] [LOCAL ] LADR: Loaded 39688 existing records from primary storage. [2025-10-16T22:40:04.010241] [INFO ] [MAIN ] LADR: Loaded 39688 primary data records. [2025-10-16T22:40:04.609420] [DEBUG] [MAIN ] LAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:04.610271] [DEBUG] [MAIN ] LAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:04.611838] [INFO ] [MAIN ] LAC: Generated 1807 derivative records from 52900 primary records. [2025-10-16T22:40:04.611197] [INFO ] [MAIN ] LAD: Generated 1807 derivative records from 23491 primary records. [2025-10-16T22:40:04.612056] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-16T22:40:04.612497] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-16T22:40:04.647415] [DEBUG] [LOCAL ] LAD: Derivative data saved (1807 records). [2025-10-16T22:40:04.648870] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-16T22:40:04.650730] [DEBUG] [LOCAL ] LAC: Derivative data saved (1807 records). [2025-10-16T22:40:04.653061] [INFO ] [MAIN ] Derivative Progress: 1054/1803 symbols completed. LAD took 1.2s. Estimated remaining: 4m 47s. Rate: 156.6 symbols/min [2025-10-16T22:40:04.653247] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:04.653389] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-16T22:40:04.656283] [INFO ] [MAIN ] Derivative Progress: 1055/1803 symbols completed. LAC took 1.2s. Estimated remaining: 4m 46s. Rate: 156.7 symbols/min [2025-10-16T22:40:04.656698] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:04.676493] [DEBUG] [LOCAL ] LANV: Loaded 2789 existing records from primary storage. [2025-10-16T22:40:04.676626] [INFO ] [MAIN ] LANV: Loaded 2789 primary data records. [2025-10-16T22:40:04.713611] [DEBUG] [MAIN ] LADR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:04.760197] [INFO ] [MAIN ] LADR: Generated 1807 derivative records from 39688 primary records. [2025-10-16T22:40:04.787800] [DEBUG] [LOCAL ] LAW: Loaded 14781 existing records from primary storage. [2025-10-16T22:40:04.795464] [INFO ] [MAIN ] LAW: Loaded 14781 primary data records. [2025-10-16T22:40:04.798893] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-16T22:40:05.117781] [DEBUG] [LOCAL ] LADR: Derivative data saved (1807 records). [2025-10-16T22:40:05.121325] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-16T22:40:05.125202] [INFO ] [MAIN ] Derivative Progress: 1056/1803 symbols completed. LADR took 1.6s. Estimated remaining: 4m 46s. Rate: 156.7 symbols/min [2025-10-16T22:40:05.141217] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:05.386175] [DEBUG] [MAIN ] LANV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:05.387012] [INFO ] [MAIN ] LANV: Generated 1807 derivative records from 2789 primary records. [2025-10-16T22:40:05.387167] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-16T22:40:05.419781] [DEBUG] [LOCAL ] LAZ: Loaded 44986 existing records from primary storage. [2025-10-16T22:40:05.428669] [DEBUG] [LOCAL ] LANV: Derivative data saved (1807 records). [2025-10-16T22:40:05.434543] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-16T22:40:05.428608] [INFO ] [MAIN ] LAZ: Loaded 44986 primary data records. [2025-10-16T22:40:05.434467] [DEBUG] [MAIN ] LAW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:05.437813] [INFO ] [MAIN ] LAW: Generated 1807 derivative records from 14781 primary records. [2025-10-16T22:40:05.436869] [INFO ] [MAIN ] Derivative Progress: 1057/1803 symbols completed. LANV took 0.8s. Estimated remaining: 4m 46s. Rate: 156.7 symbols/min [2025-10-16T22:40:05.472131] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-16T22:40:05.477397] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:05.678090] [DEBUG] [LOCAL ] LAW: Derivative data saved (1807 records). [2025-10-16T22:40:05.797799] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-16T22:40:05.800607] [INFO ] [MAIN ] Derivative Progress: 1058/1803 symbols completed. LAW took 1.1s. Estimated remaining: 4m 45s. Rate: 156.7 symbols/min [2025-10-16T22:40:05.801041] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:05.817338] [DEBUG] [LOCAL ] LB: Loaded 37609 existing records from primary storage. [2025-10-16T22:40:05.818175] [INFO ] [MAIN ] LB: Loaded 37609 primary data records. [2025-10-16T22:40:06.180839] [DEBUG] [LOCAL ] LBRT: Loaded 53348 existing records from primary storage. [2025-10-16T22:40:06.193265] [INFO ] [MAIN ] LBRT: Loaded 53348 primary data records. [2025-10-16T22:40:06.205061] [DEBUG] [MAIN ] LAZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:06.270874] [INFO ] [MAIN ] LAZ: Generated 1807 derivative records from 44986 primary records. [2025-10-16T22:40:06.281622] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-16T22:40:06.370334] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1807 records). [2025-10-16T22:40:06.538136] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-16T22:40:06.554255] [INFO ] [MAIN ] Derivative Progress: 1059/1803 symbols completed. LAZ took 1.4s. Estimated remaining: 4m 45s. Rate: 156.6 symbols/min [2025-10-16T22:40:06.554908] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:06.575342] [DEBUG] [MAIN ] LB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:06.576711] [INFO ] [MAIN ] LB: Generated 1807 derivative records from 37609 primary records. [2025-10-16T22:40:06.577040] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-16T22:40:06.596428] [DEBUG] [LOCAL ] LB: Derivative data saved (1807 records). [2025-10-16T22:40:06.596739] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-16T22:40:06.599351] [INFO ] [MAIN ] Derivative Progress: 1060/1803 symbols completed. LB took 1.1s. Estimated remaining: 4m 44s. Rate: 156.7 symbols/min [2025-10-16T22:40:06.599690] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:06.628236] [DEBUG] [MAIN ] LBRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:06.629029] [INFO ] [MAIN ] LBRT: Generated 1807 derivative records from 53348 primary records. [2025-10-16T22:40:06.629092] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-10-16T22:40:06.665267] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1807 records). [2025-10-16T22:40:06.661244] [DEBUG] [LOCAL ] LC: Loaded 48551 existing records from primary storage. [2025-10-16T22:40:06.665488] [INFO ] [MAIN ] LC: Loaded 48551 primary data records. [2025-10-16T22:40:06.665626] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-10-16T22:40:06.679059] [INFO ] [MAIN ] Derivative Progress: 1061/1803 symbols completed. LBRT took 0.9s. Estimated remaining: 4m 44s. Rate: 156.8 symbols/min [2025-10-16T22:40:06.710718] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:06.781517] [DEBUG] [LOCAL ] LCII: Loaded 27611 existing records from primary storage. [2025-10-16T22:40:06.802607] [INFO ] [MAIN ] LCII: Loaded 27611 primary data records. [2025-10-16T22:40:07.188116] [DEBUG] [LOCAL ] LDI: Loaded 45194 existing records from primary storage. [2025-10-16T22:40:07.209596] [INFO ] [MAIN ] LDI: Loaded 45194 primary data records. [2025-10-16T22:40:07.642212] [DEBUG] [MAIN ] LC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:07.643877] [INFO ] [MAIN ] LC: Generated 1807 derivative records from 48551 primary records. [2025-10-16T22:40:07.644250] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-16T22:40:07.671244] [DEBUG] [LOCAL ] LC: Derivative data saved (1807 records). [2025-10-16T22:40:07.672792] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-16T22:40:07.675401] [INFO ] [MAIN ] Derivative Progress: 1062/1803 symbols completed. LC took 1.1s. Estimated remaining: 4m 44s. Rate: 156.6 symbols/min [2025-10-16T22:40:07.683382] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:07.689264] [DEBUG] [MAIN ] LCII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:07.690520] [INFO ] [MAIN ] LCII: Generated 1807 derivative records from 27611 primary records. [2025-10-16T22:40:07.690718] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-16T22:40:07.714855] [DEBUG] [LOCAL ] LCII: Derivative data saved (1807 records). [2025-10-16T22:40:07.715232] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-16T22:40:07.717694] [INFO ] [MAIN ] Derivative Progress: 1063/1803 symbols completed. LCII took 1.1s. Estimated remaining: 4m 43s. Rate: 156.7 symbols/min [2025-10-16T22:40:07.731492] [DEBUG] [MAIN ] LDI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:07.732237] [INFO ] [MAIN ] LDI: Generated 1807 derivative records from 45194 primary records. [2025-10-16T22:40:07.732433] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-16T22:40:07.763547] [DEBUG] [LOCAL ] LDI: Derivative data saved (1807 records). [2025-10-16T22:40:07.763729] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-16T22:40:07.766876] [INFO ] [MAIN ] Derivative Progress: 1064/1803 symbols completed. LDI took 1.1s. Estimated remaining: 4m 43s. Rate: 156.9 symbols/min [2025-10-16T22:40:07.784298] [DEBUG] [LOCAL ] LDOS: Loaded 45271 existing records from primary storage. [2025-10-16T22:40:07.784441] [INFO ] [MAIN ] LDOS: Loaded 45271 primary data records. [2025-10-16T22:40:08.090102] [DEBUG] [MAIN ] LDOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:08.090715] [INFO ] [MAIN ] LDOS: Generated 1807 derivative records from 45271 primary records. [2025-10-16T22:40:08.090777] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-16T22:40:08.105908] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1807 records). [2025-10-16T22:40:08.105968] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-16T22:40:08.108079] [INFO ] [MAIN ] Derivative Progress: 1065/1803 symbols completed. LDOS took 0.4s. Estimated remaining: 4m 42s. Rate: 156.9 symbols/min [2025-10-16T22:40:08.108611] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:08.108748] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:08.109310] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:08.127818] [DEBUG] [LOCAL ] LDP: Loaded 12892 existing records from primary storage. [2025-10-16T22:40:08.128077] [INFO ] [MAIN ] LDP: Loaded 12892 primary data records. [2025-10-16T22:40:08.356603] [DEBUG] [LOCAL ] LEA: Loaded 41612 existing records from primary storage. [2025-10-16T22:40:08.496314] [INFO ] [MAIN ] LEA: Loaded 41612 primary data records. [2025-10-16T22:40:08.496143] [DEBUG] [LOCAL ] LEG: Loaded 50533 existing records from primary storage. [2025-10-16T22:40:08.496580] [INFO ] [MAIN ] LEG: Loaded 50533 primary data records. [2025-10-16T22:40:09.124698] [DEBUG] [MAIN ] LDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:09.125712] [INFO ] [MAIN ] LDP: Generated 1807 derivative records from 12892 primary records. [2025-10-16T22:40:09.125920] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-16T22:40:09.143707] [DEBUG] [LOCAL ] LDP: Derivative data saved (1807 records). [2025-10-16T22:40:09.144177] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-16T22:40:09.146629] [INFO ] [MAIN ] Derivative Progress: 1066/1803 symbols completed. LDP took 1.0s. Estimated remaining: 4m 42s. Rate: 156.6 symbols/min [2025-10-16T22:40:09.149278] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:09.164421] [DEBUG] [MAIN ] LEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:09.165202] [INFO ] [MAIN ] LEA: Generated 1807 derivative records from 41612 primary records. [2025-10-16T22:40:09.165358] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-16T22:40:09.197469] [DEBUG] [MAIN ] LEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:09.198571] [DEBUG] [LOCAL ] LEA: Derivative data saved (1807 records). [2025-10-16T22:40:09.199436] [INFO ] [MAIN ] LEG: Generated 1807 derivative records from 50533 primary records. [2025-10-16T22:40:09.199504] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-16T22:40:09.199750] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-16T22:40:09.202079] [INFO ] [MAIN ] Derivative Progress: 1067/1803 symbols completed. LEA took 1.1s. Estimated remaining: 4m 42s. Rate: 156.7 symbols/min [2025-10-16T22:40:09.203396] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:09.219477] [DEBUG] [LOCAL ] LEG: Derivative data saved (1807 records). [2025-10-16T22:40:09.219606] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-16T22:40:09.222041] [INFO ] [MAIN ] Derivative Progress: 1068/1803 symbols completed. LEG took 1.1s. Estimated remaining: 4m 41s. Rate: 156.9 symbols/min [2025-10-16T22:40:09.222323] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:09.249515] [DEBUG] [LOCAL ] LEO: Loaded 16748 existing records from primary storage. [2025-10-16T22:40:09.249701] [INFO ] [MAIN ] LEO: Loaded 16748 primary data records. [2025-10-16T22:40:09.383064] [DEBUG] [LOCAL ] LEN: Loaded 53584 existing records from primary storage. [2025-10-16T22:40:09.399014] [INFO ] [MAIN ] LEN: Loaded 53584 primary data records. [2025-10-16T22:40:09.726268] [DEBUG] [LOCAL ] LEVI: Loaded 52170 existing records from primary storage. [2025-10-16T22:40:09.749462] [INFO ] [MAIN ] LEVI: Loaded 52170 primary data records. [2025-10-16T22:40:10.286735] [DEBUG] [MAIN ] LEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:10.288956] [INFO ] [MAIN ] LEO: Generated 1807 derivative records from 16748 primary records. [2025-10-16T22:40:10.289145] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-16T22:40:10.308823] [DEBUG] [LOCAL ] LEO: Derivative data saved (1807 records). [2025-10-16T22:40:10.309435] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-16T22:40:10.312943] [INFO ] [MAIN ] Derivative Progress: 1069/1803 symbols completed. LEO took 1.1s. Estimated remaining: 4m 41s. Rate: 156.6 symbols/min [2025-10-16T22:40:10.313242] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:10.333568] [DEBUG] [MAIN ] LEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:10.334794] [INFO ] [MAIN ] LEN: Generated 1807 derivative records from 53584 primary records. [2025-10-16T22:40:10.335126] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-16T22:40:10.381572] [DEBUG] [LOCAL ] LFT: Loaded 18440 existing records from primary storage. [2025-10-16T22:40:10.383627] [INFO ] [MAIN ] LFT: Loaded 18440 primary data records. [2025-10-16T22:40:10.384397] [DEBUG] [LOCAL ] LEN: Derivative data saved (1807 records). [2025-10-16T22:40:10.389925] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-16T22:40:10.400277] [INFO ] [MAIN ] Derivative Progress: 1070/1803 symbols completed. LEN took 1.3s. Estimated remaining: 4m 41s. Rate: 156.7 symbols/min [2025-10-16T22:40:10.409941] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:10.389784] [DEBUG] [MAIN ] LEVI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:10.430716] [INFO ] [MAIN ] LEVI: Generated 1807 derivative records from 52170 primary records. [2025-10-16T22:40:10.451001] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-16T22:40:10.517778] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1807 records). [2025-10-16T22:40:10.528303] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-16T22:40:10.536695] [INFO ] [MAIN ] Derivative Progress: 1071/1803 symbols completed. LEVI took 1.3s. Estimated remaining: 4m 40s. Rate: 156.8 symbols/min [2025-10-16T22:40:10.574257] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:10.575123] [DEBUG] [LOCAL ] LGI: Loaded 10147 existing records from primary storage. [2025-10-16T22:40:10.606284] [INFO ] [MAIN ] LGI: Loaded 10147 primary data records. [2025-10-16T22:40:11.050067] [DEBUG] [LOCAL ] LH: Loaded 37792 existing records from primary storage. [2025-10-16T22:40:11.059982] [INFO ] [MAIN ] LH: Loaded 37792 primary data records. [2025-10-16T22:40:11.395080] [DEBUG] [MAIN ] LFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:11.397459] [INFO ] [MAIN ] LFT: Generated 1807 derivative records from 18440 primary records. [2025-10-16T22:40:11.400483] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-16T22:40:11.431507] [DEBUG] [MAIN ] LGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:11.433291] [INFO ] [MAIN ] LGI: Generated 1807 derivative records from 10147 primary records. [2025-10-16T22:40:11.434028] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-16T22:40:11.435497] [DEBUG] [LOCAL ] LFT: Derivative data saved (1807 records). [2025-10-16T22:40:11.435986] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-16T22:40:11.438103] [INFO ] [MAIN ] Derivative Progress: 1072/1803 symbols completed. LFT took 1.1s. Estimated remaining: 4m 40s. Rate: 156.6 symbols/min [2025-10-16T22:40:11.449370] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:11.454901] [DEBUG] [LOCAL ] LGI: Derivative data saved (1807 records). [2025-10-16T22:40:11.455081] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-16T22:40:11.457992] [INFO ] [MAIN ] Derivative Progress: 1073/1803 symbols completed. LGI took 1.0s. Estimated remaining: 4m 39s. Rate: 156.8 symbols/min [2025-10-16T22:40:11.458159] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:11.474258] [DEBUG] [MAIN ] LH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:11.474969] [INFO ] [MAIN ] LH: Generated 1807 derivative records from 37792 primary records. [2025-10-16T22:40:11.475187] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-16T22:40:11.493022] [DEBUG] [LOCAL ] LH: Derivative data saved (1807 records). [2025-10-16T22:40:11.493238] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-16T22:40:11.495782] [INFO ] [MAIN ] Derivative Progress: 1074/1803 symbols completed. LH took 0.9s. Estimated remaining: 4m 39s. Rate: 156.9 symbols/min [2025-10-16T22:40:11.495994] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:11.528443] [DEBUG] [LOCAL ] LII: Loaded 28004 existing records from primary storage. [2025-10-16T22:40:11.528603] [INFO ] [MAIN ] LII: Loaded 28004 primary data records. [2025-10-16T22:40:11.644382] [DEBUG] [LOCAL ] LHX: Loaded 48970 existing records from primary storage. [2025-10-16T22:40:11.648220] [INFO ] [MAIN ] LHX: Loaded 48970 primary data records. [2025-10-16T22:40:11.844327] [DEBUG] [LOCAL ] LION: Loaded 46694 existing records from primary storage. [2025-10-16T22:40:11.988579] [INFO ] [MAIN ] LION: Loaded 46694 primary data records. [2025-10-16T22:40:12.587283] [DEBUG] [MAIN ] LII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:12.588296] [INFO ] [MAIN ] LII: Generated 1807 derivative records from 28004 primary records. [2025-10-16T22:40:12.588398] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-16T22:40:12.620032] [DEBUG] [MAIN ] LHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:12.621709] [INFO ] [MAIN ] LHX: Generated 1807 derivative records from 48970 primary records. [2025-10-16T22:40:12.622004] [DEBUG] [LOCAL ] LII: Derivative data saved (1807 records). [2025-10-16T22:40:12.621917] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-16T22:40:12.622993] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-16T22:40:12.625195] [INFO ] [MAIN ] Derivative Progress: 1075/1803 symbols completed. LII took 1.2s. Estimated remaining: 4m 39s. Rate: 156.6 symbols/min [2025-10-16T22:40:12.632536] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:12.655333] [DEBUG] [LOCAL ] LHX: Derivative data saved (1807 records). [2025-10-16T22:40:12.660315] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-16T22:40:12.666389] [DEBUG] [MAIN ] LION: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:12.666502] [INFO ] [MAIN ] Derivative Progress: 1076/1803 symbols completed. LHX took 1.2s. Estimated remaining: 4m 38s. Rate: 156.7 symbols/min [2025-10-16T22:40:12.670447] [INFO ] [MAIN ] LION: Generated 1807 derivative records from 46694 primary records. [2025-10-16T22:40:12.670699] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:12.669395] [DEBUG] [LOCAL ] LITB: Loaded 4203 existing records from primary storage. [2025-10-16T22:40:12.671587] [INFO ] [MAIN ] LITB: Loaded 4203 primary data records. [2025-10-16T22:40:12.670954] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-16T22:40:12.791544] [DEBUG] [LOCAL ] LION: Derivative data saved (1807 records). [2025-10-16T22:40:12.791853] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-16T22:40:12.802151] [INFO ] [MAIN ] Derivative Progress: 1077/1803 symbols completed. LION took 1.3s. Estimated remaining: 4m 38s. Rate: 156.8 symbols/min [2025-10-16T22:40:12.823235] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:13.043276] [DEBUG] [LOCAL ] LLY: Loaded 53635 existing records from primary storage. [2025-10-16T22:40:13.044379] [INFO ] [MAIN ] LLY: Loaded 53635 primary data records. [2025-10-16T22:40:13.091061] [DEBUG] [MAIN ] LITB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:13.125981] [INFO ] [MAIN ] LITB: Generated 1807 derivative records from 4203 primary records. [2025-10-16T22:40:13.152357] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-16T22:40:13.176178] [DEBUG] [LOCAL ] LMND: Loaded 52452 existing records from primary storage. [2025-10-16T22:40:13.190817] [INFO ] [MAIN ] LMND: Loaded 52452 primary data records. [2025-10-16T22:40:13.225725] [DEBUG] [LOCAL ] LITB: Derivative data saved (1807 records). [2025-10-16T22:40:13.243879] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-10-16T22:40:13.326332] [INFO ] [MAIN ] Derivative Progress: 1078/1803 symbols completed. LITB took 0.7s. Estimated remaining: 4m 37s. Rate: 156.8 symbols/min [2025-10-16T22:40:13.732347] [DEBUG] [MAIN ] LLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:13.733306] [INFO ] [MAIN ] LLY: Generated 1807 derivative records from 53635 primary records. [2025-10-16T22:40:13.733580] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-16T22:40:13.752546] [DEBUG] [LOCAL ] LLY: Derivative data saved (1807 records). [2025-10-16T22:40:13.753923] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-16T22:40:13.757017] [INFO ] [MAIN ] Derivative Progress: 1079/1803 symbols completed. LLY took 1.1s. Estimated remaining: 4m 37s. Rate: 156.8 symbols/min [2025-10-16T22:40:13.770809] [DEBUG] [MAIN ] LMND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:13.771749] [INFO ] [MAIN ] LMND: Generated 1807 derivative records from 52452 primary records. [2025-10-16T22:40:13.771812] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-16T22:40:13.787567] [DEBUG] [LOCAL ] LMND: Derivative data saved (1807 records). [2025-10-16T22:40:13.787729] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-16T22:40:13.789743] [INFO ] [MAIN ] Derivative Progress: 1080/1803 symbols completed. LMND took 1.0s. Estimated remaining: 4m 37s. Rate: 156.9 symbols/min [2025-10-16T22:40:13.790264] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:13.790500] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:13.790437] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:13.801793] [DEBUG] [LOCAL ] LND: Loaded 4994 existing records from primary storage. [2025-10-16T22:40:13.801946] [INFO ] [MAIN ] LND: Loaded 4994 primary data records. [2025-10-16T22:40:14.172182] [DEBUG] [LOCAL ] LMT: Loaded 49981 existing records from primary storage. [2025-10-16T22:40:14.171068] [DEBUG] [LOCAL ] LNC: Loaded 51933 existing records from primary storage. [2025-10-16T22:40:14.173072] [INFO ] [MAIN ] LNC: Loaded 51933 primary data records. [2025-10-16T22:40:14.173370] [INFO ] [MAIN ] LMT: Loaded 49981 primary data records. [2025-10-16T22:40:14.821739] [DEBUG] [MAIN ] LND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:14.822668] [INFO ] [MAIN ] LND: Generated 1807 derivative records from 4994 primary records. [2025-10-16T22:40:14.822901] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-16T22:40:14.841213] [DEBUG] [LOCAL ] LND: Derivative data saved (1807 records). [2025-10-16T22:40:14.842474] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-16T22:40:14.845538] [INFO ] [MAIN ] Derivative Progress: 1081/1803 symbols completed. LND took 1.1s. Estimated remaining: 4m 37s. Rate: 156.6 symbols/min [2025-10-16T22:40:14.846588] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:14.863473] [DEBUG] [MAIN ] LNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:14.864632] [INFO ] [MAIN ] LNC: Generated 1807 derivative records from 51933 primary records. [2025-10-16T22:40:14.877314] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-16T22:40:14.877875] [DEBUG] [MAIN ] LMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:14.880090] [INFO ] [MAIN ] LMT: Generated 1807 derivative records from 49981 primary records. [2025-10-16T22:40:14.887431] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-16T22:40:14.896580] [DEBUG] [LOCAL ] LNC: Derivative data saved (1807 records). [2025-10-16T22:40:14.897396] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-16T22:40:14.900812] [INFO ] [MAIN ] Derivative Progress: 1082/1803 symbols completed. LNC took 1.1s. Estimated remaining: 4m 36s. Rate: 156.8 symbols/min [2025-10-16T22:40:14.912459] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:14.917223] [DEBUG] [LOCAL ] LMT: Derivative data saved (1807 records). [2025-10-16T22:40:14.917302] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-10-16T22:40:14.919478] [INFO ] [MAIN ] Derivative Progress: 1083/1803 symbols completed. LMT took 1.1s. Estimated remaining: 4m 35s. Rate: 156.9 symbols/min [2025-10-16T22:40:14.919849] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:14.944548] [DEBUG] [LOCAL ] LNN: Loaded 11521 existing records from primary storage. [2025-10-16T22:40:14.944853] [INFO ] [MAIN ] LNN: Loaded 11521 primary data records. [2025-10-16T22:40:15.067281] [DEBUG] [LOCAL ] LNG: Loaded 51601 existing records from primary storage. [2025-10-16T22:40:15.103385] [INFO ] [MAIN ] LNG: Loaded 51601 primary data records. [2025-10-16T22:40:15.393687] [DEBUG] [LOCAL ] LOAR: Loaded 42364 existing records from primary storage. [2025-10-16T22:40:15.405773] [INFO ] [MAIN ] LOAR: Loaded 42364 primary data records. [2025-10-16T22:40:15.927906] [DEBUG] [MAIN ] LNN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:15.929036] [INFO ] [MAIN ] LNN: Generated 1807 derivative records from 11521 primary records. [2025-10-16T22:40:15.929519] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-16T22:40:15.950857] [DEBUG] [LOCAL ] LNN: Derivative data saved (1807 records). [2025-10-16T22:40:15.951069] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-16T22:40:15.953345] [INFO ] [MAIN ] Derivative Progress: 1084/1803 symbols completed. LNN took 1.0s. Estimated remaining: 4m 35s. Rate: 156.7 symbols/min [2025-10-16T22:40:15.953691] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:15.968059] [DEBUG] [MAIN ] LNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:15.969054] [INFO ] [MAIN ] LNG: Generated 1807 derivative records from 51601 primary records. [2025-10-16T22:40:15.969178] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-16T22:40:15.998345] [DEBUG] [MAIN ] LOAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:16.008533] [DEBUG] [LOCAL ] LNG: Derivative data saved (1807 records). [2025-10-16T22:40:16.000197] [INFO ] [MAIN ] LOAR: Generated 1807 derivative records from 42364 primary records. [2025-10-16T22:40:16.008769] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-16T22:40:16.010982] [INFO ] [MAIN ] Derivative Progress: 1085/1803 symbols completed. LNG took 1.2s. Estimated remaining: 4m 35s. Rate: 156.8 symbols/min [2025-10-16T22:40:16.011277] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:16.011130] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-16T22:40:16.034991] [DEBUG] [LOCAL ] LOB: Loaded 26949 existing records from primary storage. [2025-10-16T22:40:16.036071] [INFO ] [MAIN ] LOB: Loaded 26949 primary data records. [2025-10-16T22:40:16.039410] [DEBUG] [LOCAL ] LOCL: Loaded 3809 existing records from primary storage. [2025-10-16T22:40:16.053045] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1807 records). [2025-10-16T22:40:16.053223] [INFO ] [MAIN ] LOCL: Loaded 3809 primary data records. [2025-10-16T22:40:16.062798] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-16T22:40:16.095135] [INFO ] [MAIN ] Derivative Progress: 1086/1803 symbols completed. LOAR took 1.2s. Estimated remaining: 4m 34s. Rate: 156.9 symbols/min [2025-10-16T22:40:16.100488] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:16.655964] [DEBUG] [LOCAL ] LOMA: Loaded 32954 existing records from primary storage. [2025-10-16T22:40:16.679443] [INFO ] [MAIN ] LOMA: Loaded 32954 primary data records. [2025-10-16T22:40:17.037522] [DEBUG] [MAIN ] LOCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:17.037962] [DEBUG] [MAIN ] LOB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:17.039071] [INFO ] [MAIN ] LOB: Generated 1807 derivative records from 26949 primary records. [2025-10-16T22:40:17.040118] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-16T22:40:17.040733] [INFO ] [MAIN ] LOCL: Generated 1807 derivative records from 3809 primary records. [2025-10-16T22:40:17.041418] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-16T22:40:17.076755] [DEBUG] [LOCAL ] LOB: Derivative data saved (1807 records). [2025-10-16T22:40:17.076935] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-16T22:40:17.076090] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1807 records). [2025-10-16T22:40:17.079277] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-16T22:40:17.079044] [INFO ] [MAIN ] Derivative Progress: 1087/1803 symbols completed. LOB took 1.1s. Estimated remaining: 4m 34s. Rate: 156.7 symbols/min [2025-10-16T22:40:17.081932] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:17.082204] [INFO ] [MAIN ] Derivative Progress: 1088/1803 symbols completed. LOCL took 1.1s. Estimated remaining: 4m 34s. Rate: 156.8 symbols/min [2025-10-16T22:40:17.082760] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:17.100337] [DEBUG] [MAIN ] LOMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:17.101108] [INFO ] [MAIN ] LOMA: Generated 1807 derivative records from 32954 primary records. [2025-10-16T22:40:17.101258] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-16T22:40:17.118831] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1807 records). [2025-10-16T22:40:17.118981] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-16T22:40:17.121622] [INFO ] [MAIN ] Derivative Progress: 1089/1803 symbols completed. LOMA took 1.0s. Estimated remaining: 4m 33s. Rate: 156.9 symbols/min [2025-10-16T22:40:17.131423] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:17.160282] [DEBUG] [LOCAL ] LPG: Loaded 39877 existing records from primary storage. [2025-10-16T22:40:17.160425] [INFO ] [MAIN ] LPG: Loaded 39877 primary data records. [2025-10-16T22:40:17.297245] [DEBUG] [LOCAL ] LOW: Loaded 53379 existing records from primary storage. [2025-10-16T22:40:17.300082] [INFO ] [MAIN ] LOW: Loaded 53379 primary data records. [2025-10-16T22:40:17.299514] [DEBUG] [LOCAL ] LPL: Loaded 28587 existing records from primary storage. [2025-10-16T22:40:17.300230] [INFO ] [MAIN ] LPL: Loaded 28587 primary data records. [2025-10-16T22:40:18.195610] [DEBUG] [MAIN ] LPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:18.197367] [INFO ] [MAIN ] LPG: Generated 1807 derivative records from 39877 primary records. [2025-10-16T22:40:18.197504] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-16T22:40:18.228222] [DEBUG] [MAIN ] LPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:18.232253] [DEBUG] [LOCAL ] LPG: Derivative data saved (1807 records). [2025-10-16T22:40:18.240561] [INFO ] [MAIN ] LPL: Generated 1807 derivative records from 28587 primary records. [2025-10-16T22:40:18.245221] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-16T22:40:18.247285] [INFO ] [MAIN ] Derivative Progress: 1090/1803 symbols completed. LPG took 1.2s. Estimated remaining: 4m 33s. Rate: 156.7 symbols/min [2025-10-16T22:40:18.247363] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-16T22:40:18.247559] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:18.248085] [DEBUG] [MAIN ] LOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:18.249114] [INFO ] [MAIN ] LOW: Generated 1807 derivative records from 53379 primary records. [2025-10-16T22:40:18.250128] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-16T22:40:18.279227] [DEBUG] [LOCAL ] LPL: Derivative data saved (1807 records). [2025-10-16T22:40:18.279779] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-16T22:40:18.282382] [INFO ] [MAIN ] Derivative Progress: 1091/1803 symbols completed. LPL took 1.2s. Estimated remaining: 4m 32s. Rate: 156.8 symbols/min [2025-10-16T22:40:18.282836] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:18.285556] [DEBUG] [LOCAL ] LOW: Derivative data saved (1807 records). [2025-10-16T22:40:18.285737] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-16T22:40:18.288912] [INFO ] [MAIN ] Derivative Progress: 1092/1803 symbols completed. LOW took 1.2s. Estimated remaining: 4m 32s. Rate: 156.9 symbols/min [2025-10-16T22:40:18.292082] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:18.336841] [DEBUG] [LOCAL ] LPX: Loaded 40611 existing records from primary storage. [2025-10-16T22:40:18.337026] [INFO ] [MAIN ] LPX: Loaded 40611 primary data records. [2025-10-16T22:40:18.461469] [DEBUG] [LOCAL ] LRN: Loaded 39819 existing records from primary storage. [2025-10-16T22:40:18.479522] [INFO ] [MAIN ] LRN: Loaded 39819 primary data records. [2025-10-16T22:40:18.516845] [DEBUG] [LOCAL ] LSPD: Loaded 42885 existing records from primary storage. [2025-10-16T22:40:18.526156] [INFO ] [MAIN ] LSPD: Loaded 42885 primary data records. [2025-10-16T22:40:19.395882] [DEBUG] [MAIN ] LPX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:19.397401] [INFO ] [MAIN ] LPX: Generated 1807 derivative records from 40611 primary records. [2025-10-16T22:40:19.397815] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-16T22:40:19.452007] [DEBUG] [LOCAL ] LPX: Derivative data saved (1807 records). [2025-10-16T22:40:19.453449] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-16T22:40:19.453313] [DEBUG] [MAIN ] LSPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:19.455974] [INFO ] [MAIN ] Derivative Progress: 1093/1803 symbols completed. LPX took 1.2s. Estimated remaining: 4m 32s. Rate: 156.6 symbols/min [2025-10-16T22:40:19.457248] [INFO ] [MAIN ] LSPD: Generated 1807 derivative records from 42885 primary records. [2025-10-16T22:40:19.457959] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-16T22:40:19.477822] [DEBUG] [MAIN ] LRN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:19.491117] [INFO ] [MAIN ] LRN: Generated 1807 derivative records from 39819 primary records. [2025-10-16T22:40:19.492691] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-16T22:40:19.498534] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1807 records). [2025-10-16T22:40:19.498706] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-16T22:40:19.503070] [INFO ] [MAIN ] Derivative Progress: 1094/1803 symbols completed. LSPD took 1.2s. Estimated remaining: 4m 31s. Rate: 156.8 symbols/min [2025-10-16T22:40:19.529066] [DEBUG] [LOCAL ] LRN: Derivative data saved (1807 records). [2025-10-16T22:40:19.529257] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-16T22:40:19.532984] [INFO ] [MAIN ] Derivative Progress: 1095/1803 symbols completed. LRN took 1.3s. Estimated remaining: 4m 31s. Rate: 156.9 symbols/min [2025-10-16T22:40:19.534107] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:19.533935] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:19.534489] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:19.628758] [DEBUG] [LOCAL ] LTM: Loaded 39065 existing records from primary storage. [2025-10-16T22:40:19.629051] [INFO ] [MAIN ] LTM: Loaded 39065 primary data records. [2025-10-16T22:40:19.593814] [DEBUG] [LOCAL ] LTC: Loaded 30810 existing records from primary storage. [2025-10-16T22:40:19.635689] [INFO ] [MAIN ] LTC: Loaded 30810 primary data records. [2025-10-16T22:40:19.806446] [DEBUG] [LOCAL ] LTH: Loaded 52110 existing records from primary storage. [2025-10-16T22:40:19.813367] [INFO ] [MAIN ] LTH: Loaded 52110 primary data records. [2025-10-16T22:40:20.845837] [DEBUG] [MAIN ] LTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:20.846325] [DEBUG] [MAIN ] LTH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:20.847135] [INFO ] [MAIN ] LTM: Generated 1807 derivative records from 39065 primary records. [2025-10-16T22:40:20.847408] [DEBUG] [MAIN ] LTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:20.848074] [INFO ] [MAIN ] LTC: Generated 1807 derivative records from 30810 primary records. [2025-10-16T22:40:20.849539] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-16T22:40:20.849600] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-16T22:40:20.849432] [INFO ] [MAIN ] LTH: Generated 1807 derivative records from 52110 primary records. [2025-10-16T22:40:20.858576] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-16T22:40:20.881947] [DEBUG] [LOCAL ] LTM: Derivative data saved (1807 records). [2025-10-16T22:40:20.883639] [DEBUG] [LOCAL ] LTC: Derivative data saved (1807 records). [2025-10-16T22:40:20.891253] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-16T22:40:20.902014] [INFO ] [MAIN ] Derivative Progress: 1096/1803 symbols completed. LTM took 1.4s. Estimated remaining: 4m 31s. Rate: 156.5 symbols/min [2025-10-16T22:40:20.900002] [DEBUG] [LOCAL ] LTH: Derivative data saved (1807 records). [2025-10-16T22:40:20.902211] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:20.902467] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-16T22:40:20.899871] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-16T22:40:20.906304] [INFO ] [MAIN ] Derivative Progress: 1097/1803 symbols completed. LTH took 1.4s. Estimated remaining: 4m 30s. Rate: 156.7 symbols/min [2025-10-16T22:40:20.911032] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:20.911134] [INFO ] [MAIN ] Derivative Progress: 1098/1803 symbols completed. LTC took 1.4s. Estimated remaining: 4m 30s. Rate: 156.8 symbols/min [2025-10-16T22:40:20.912057] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:20.936487] [DEBUG] [LOCAL ] LUCK: Loaded 24314 existing records from primary storage. [2025-10-16T22:40:20.936628] [INFO ] [MAIN ] LUCK: Loaded 24314 primary data records. [2025-10-16T22:40:21.083494] [DEBUG] [LOCAL ] LU: Loaded 49412 existing records from primary storage. [2025-10-16T22:40:21.089312] [INFO ] [MAIN ] LU: Loaded 49412 primary data records. [2025-10-16T22:40:21.402897] [DEBUG] [LOCAL ] LUMN: Loaded 54036 existing records from primary storage. [2025-10-16T22:40:21.409547] [INFO ] [MAIN ] LUMN: Loaded 54036 primary data records. [2025-10-16T22:40:21.923045] [DEBUG] [MAIN ] LUCK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:21.923940] [INFO ] [MAIN ] LUCK: Generated 1807 derivative records from 24314 primary records. [2025-10-16T22:40:21.925632] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-16T22:40:21.955353] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1807 records). [2025-10-16T22:40:21.956127] [DEBUG] [MAIN ] LU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:21.956235] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-16T22:40:21.956953] [INFO ] [MAIN ] LU: Generated 1807 derivative records from 49412 primary records. [2025-10-16T22:40:21.959280] [INFO ] [MAIN ] Derivative Progress: 1099/1803 symbols completed. LUCK took 1.0s. Estimated remaining: 4m 30s. Rate: 156.6 symbols/min [2025-10-16T22:40:21.959448] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:21.959672] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-16T22:40:21.987758] [DEBUG] [LOCAL ] LU: Derivative data saved (1807 records). [2025-10-16T22:40:21.993068] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-16T22:40:21.992990] [DEBUG] [MAIN ] LUMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:21.995879] [INFO ] [MAIN ] Derivative Progress: 1100/1803 symbols completed. LU took 1.1s. Estimated remaining: 4m 29s. Rate: 156.7 symbols/min [2025-10-16T22:40:21.993803] [INFO ] [MAIN ] LUMN: Generated 1807 derivative records from 54036 primary records. [2025-10-16T22:40:21.996163] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:21.996610] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-16T22:40:22.013184] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1807 records). [2025-10-16T22:40:22.013408] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-16T22:40:22.016010] [INFO ] [MAIN ] Derivative Progress: 1101/1803 symbols completed. LUMN took 1.1s. Estimated remaining: 4m 29s. Rate: 156.8 symbols/min [2025-10-16T22:40:22.016165] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:22.051831] [DEBUG] [LOCAL ] LVWR: Loaded 18520 existing records from primary storage. [2025-10-16T22:40:22.052050] [INFO ] [MAIN ] LVWR: Loaded 18520 primary data records. [2025-10-16T22:40:22.218620] [DEBUG] [LOCAL ] LUV: Loaded 54079 existing records from primary storage. [2025-10-16T22:40:22.395683] [INFO ] [MAIN ] LUV: Loaded 54079 primary data records. [2025-10-16T22:40:22.390404] [DEBUG] [LOCAL ] LVS: Loaded 53960 existing records from primary storage. [2025-10-16T22:40:22.410817] [INFO ] [MAIN ] LVS: Loaded 53960 primary data records. [2025-10-16T22:40:23.063862] [DEBUG] [MAIN ] LVWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:23.065956] [INFO ] [MAIN ] LVWR: Generated 1807 derivative records from 18520 primary records. [2025-10-16T22:40:23.066061] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-16T22:40:23.085254] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1807 records). [2025-10-16T22:40:23.085529] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-16T22:40:23.087888] [INFO ] [MAIN ] Derivative Progress: 1102/1803 symbols completed. LVWR took 1.1s. Estimated remaining: 4m 29s. Rate: 156.6 symbols/min [2025-10-16T22:40:23.088401] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:23.109301] [DEBUG] [MAIN ] LVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:23.111707] [INFO ] [MAIN ] LVS: Generated 1807 derivative records from 53960 primary records. [2025-10-16T22:40:23.113052] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-16T22:40:23.140962] [DEBUG] [MAIN ] LUV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:23.145388] [DEBUG] [LOCAL ] LVS: Derivative data saved (1807 records). [2025-10-16T22:40:23.146785] [INFO ] [MAIN ] LUV: Generated 1807 derivative records from 54079 primary records. [2025-10-16T22:40:23.146957] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-10-16T22:40:23.147071] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-16T22:40:23.149606] [INFO ] [MAIN ] Derivative Progress: 1103/1803 symbols completed. LVS took 1.2s. Estimated remaining: 4m 28s. Rate: 156.7 symbols/min [2025-10-16T22:40:23.164149] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:23.183073] [DEBUG] [LOCAL ] LUV: Derivative data saved (1807 records). [2025-10-16T22:40:23.200996] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-16T22:40:23.204077] [INFO ] [MAIN ] Derivative Progress: 1104/1803 symbols completed. LUV took 1.2s. Estimated remaining: 4m 27s. Rate: 156.8 symbols/min [2025-10-16T22:40:23.205571] [DEBUG] [LOCAL ] LW: Loaded 51587 existing records from primary storage. [2025-10-16T22:40:23.205866] [INFO ] [MAIN ] LW: Loaded 51587 primary data records. [2025-10-16T22:40:23.205789] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:23.284006] [DEBUG] [LOCAL ] LXFR: Loaded 16731 existing records from primary storage. [2025-10-16T22:40:23.295987] [INFO ] [MAIN ] LXFR: Loaded 16731 primary data records. [2025-10-16T22:40:23.850546] [DEBUG] [LOCAL ] LXP: Loaded 51132 existing records from primary storage. [2025-10-16T22:40:23.850763] [INFO ] [MAIN ] LXP: Loaded 51132 primary data records. [2025-10-16T22:40:24.175670] [DEBUG] [MAIN ] LW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:24.177160] [INFO ] [MAIN ] LW: Generated 1807 derivative records from 51587 primary records. [2025-10-16T22:40:24.177379] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-16T22:40:24.196867] [DEBUG] [LOCAL ] LW: Derivative data saved (1807 records). [2025-10-16T22:40:24.197316] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-16T22:40:24.199804] [INFO ] [MAIN ] Derivative Progress: 1105/1803 symbols completed. LW took 1.1s. Estimated remaining: 4m 27s. Rate: 156.6 symbols/min [2025-10-16T22:40:24.200076] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:24.213741] [DEBUG] [MAIN ] LXFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:24.215549] [INFO ] [MAIN ] LXFR: Generated 1807 derivative records from 16731 primary records. [2025-10-16T22:40:24.216021] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-16T22:40:24.233053] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1807 records). [2025-10-16T22:40:24.233357] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-16T22:40:24.236001] [INFO ] [MAIN ] Derivative Progress: 1106/1803 symbols completed. LXFR took 1.1s. Estimated remaining: 4m 27s. Rate: 156.7 symbols/min [2025-10-16T22:40:24.236495] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:24.262166] [DEBUG] [MAIN ] LXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:24.263156] [INFO ] [MAIN ] LXP: Generated 1807 derivative records from 51132 primary records. [2025-10-16T22:40:24.263286] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-16T22:40:24.280073] [DEBUG] [LOCAL ] LXP: Derivative data saved (1807 records). [2025-10-16T22:40:24.289692] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-16T22:40:24.293141] [INFO ] [MAIN ] Derivative Progress: 1107/1803 symbols completed. LXP took 1.1s. Estimated remaining: 4m 26s. Rate: 156.8 symbols/min [2025-10-16T22:40:24.293334] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:24.295561] [DEBUG] [LOCAL ] LXU: Loaded 31987 existing records from primary storage. [2025-10-16T22:40:24.295778] [INFO ] [MAIN ] LXU: Loaded 31987 primary data records. [2025-10-16T22:40:24.666068] [DEBUG] [LOCAL ] LYB: Loaded 54008 existing records from primary storage. [2025-10-16T22:40:24.667210] [INFO ] [MAIN ] LYB: Loaded 54008 primary data records. [2025-10-16T22:40:24.737458] [DEBUG] [LOCAL ] LYG: Loaded 53078 existing records from primary storage. [2025-10-16T22:40:24.759909] [INFO ] [MAIN ] LYG: Loaded 53078 primary data records. [2025-10-16T22:40:25.314458] [DEBUG] [MAIN ] LXU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:25.317136] [INFO ] [MAIN ] LXU: Generated 1807 derivative records from 31987 primary records. [2025-10-16T22:40:25.317283] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-16T22:40:25.335219] [DEBUG] [LOCAL ] LXU: Derivative data saved (1807 records). [2025-10-16T22:40:25.335605] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-16T22:40:25.338065] [INFO ] [MAIN ] Derivative Progress: 1108/1803 symbols completed. LXU took 1.1s. Estimated remaining: 4m 26s. Rate: 156.6 symbols/min [2025-10-16T22:40:25.356799] [DEBUG] [MAIN ] LYB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:25.357748] [INFO ] [MAIN ] LYB: Generated 1807 derivative records from 54008 primary records. [2025-10-16T22:40:25.357855] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-16T22:40:25.390182] [DEBUG] [LOCAL ] LYB: Derivative data saved (1807 records). [2025-10-16T22:40:25.387569] [DEBUG] [MAIN ] LYG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:25.391100] [INFO ] [MAIN ] LYG: Generated 1807 derivative records from 53078 primary records. [2025-10-16T22:40:25.391272] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-16T22:40:25.391196] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-16T22:40:25.393397] [INFO ] [MAIN ] Derivative Progress: 1109/1803 symbols completed. LYB took 1.2s. Estimated remaining: 4m 26s. Rate: 156.7 symbols/min [2025-10-16T22:40:25.408640] [DEBUG] [LOCAL ] LYG: Derivative data saved (1807 records). [2025-10-16T22:40:25.408731] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-16T22:40:25.411809] [INFO ] [MAIN ] Derivative Progress: 1110/1803 symbols completed. LYG took 1.1s. Estimated remaining: 4m 25s. Rate: 156.8 symbols/min [2025-10-16T22:40:25.412357] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:25.412297] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:25.412471] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:25.432504] [DEBUG] [LOCAL ] LZM: Loaded 14661 existing records from primary storage. [2025-10-16T22:40:25.432708] [INFO ] [MAIN ] LZM: Loaded 14661 primary data records. [2025-10-16T22:40:25.599387] [DEBUG] [LOCAL ] LZB: Loaded 35417 existing records from primary storage. [2025-10-16T22:40:25.665150] [INFO ] [MAIN ] LZB: Loaded 35417 primary data records. [2025-10-16T22:40:25.837375] [DEBUG] [LOCAL ] LYV: Loaded 51498 existing records from primary storage. [2025-10-16T22:40:25.859242] [INFO ] [MAIN ] LYV: Loaded 51498 primary data records. [2025-10-16T22:40:26.417247] [DEBUG] [MAIN ] LZM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:26.418801] [INFO ] [MAIN ] LZM: Generated 1807 derivative records from 14661 primary records. [2025-10-16T22:40:26.419000] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-16T22:40:26.437613] [DEBUG] [LOCAL ] LZM: Derivative data saved (1807 records). [2025-10-16T22:40:26.437837] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-16T22:40:26.440804] [INFO ] [MAIN ] Derivative Progress: 1111/1803 symbols completed. LZM took 1.0s. Estimated remaining: 4m 25s. Rate: 156.6 symbols/min [2025-10-16T22:40:26.441485] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:26.457215] [DEBUG] [MAIN ] LZB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:26.470683] [INFO ] [MAIN ] LZB: Generated 1807 derivative records from 35417 primary records. [2025-10-16T22:40:26.471002] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-16T22:40:26.472237] [DEBUG] [MAIN ] LYV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:26.481636] [INFO ] [MAIN ] LYV: Generated 1807 derivative records from 51498 primary records. [2025-10-16T22:40:26.484473] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-16T22:40:26.497220] [DEBUG] [LOCAL ] LZB: Derivative data saved (1807 records). [2025-10-16T22:40:26.501446] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-16T22:40:26.507209] [INFO ] [MAIN ] Derivative Progress: 1112/1803 symbols completed. LZB took 1.1s. Estimated remaining: 4m 25s. Rate: 156.7 symbols/min [2025-10-16T22:40:26.508440] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:26.508547] [DEBUG] [LOCAL ] LYV: Derivative data saved (1807 records). [2025-10-16T22:40:26.509230] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-16T22:40:26.511955] [INFO ] [MAIN ] Derivative Progress: 1113/1803 symbols completed. LYV took 1.1s. Estimated remaining: 4m 24s. Rate: 156.9 symbols/min [2025-10-16T22:40:26.512162] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:26.552829] [DEBUG] [LOCAL ] M: Loaded 53935 existing records from primary storage. [2025-10-16T22:40:26.553155] [INFO ] [MAIN ] M: Loaded 53935 primary data records. [2025-10-16T22:40:26.782560] [DEBUG] [LOCAL ] MA: Loaded 52869 existing records from primary storage. [2025-10-16T22:40:26.812622] [DEBUG] [LOCAL ] MAA: Loaded 43214 existing records from primary storage. [2025-10-16T22:40:26.929316] [INFO ] [MAIN ] MAA: Loaded 43214 primary data records. [2025-10-16T22:40:26.929224] [INFO ] [MAIN ] MA: Loaded 52869 primary data records. [2025-10-16T22:40:27.550385] [DEBUG] [MAIN ] M: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:27.551620] [INFO ] [MAIN ] M: Generated 1807 derivative records from 53935 primary records. [2025-10-16T22:40:27.551905] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-16T22:40:27.571249] [DEBUG] [LOCAL ] M: Derivative data saved (1807 records). [2025-10-16T22:40:27.572281] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-16T22:40:27.586811] [DEBUG] [MAIN ] MAA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:27.591621] [INFO ] [MAIN ] Derivative Progress: 1114/1803 symbols completed. M took 1.2s. Estimated remaining: 4m 24s. Rate: 156.6 symbols/min [2025-10-16T22:40:27.591842] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:27.587767] [INFO ] [MAIN ] MAA: Generated 1807 derivative records from 43214 primary records. [2025-10-16T22:40:27.592304] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-16T22:40:27.621856] [DEBUG] [MAIN ] MA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:27.622955] [DEBUG] [LOCAL ] MAA: Derivative data saved (1807 records). [2025-10-16T22:40:27.623937] [INFO ] [MAIN ] MA: Generated 1807 derivative records from 52869 primary records. [2025-10-16T22:40:27.624087] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-16T22:40:27.624590] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-16T22:40:27.627550] [INFO ] [MAIN ] Derivative Progress: 1115/1803 symbols completed. MAA took 1.1s. Estimated remaining: 4m 23s. Rate: 156.7 symbols/min [2025-10-16T22:40:27.628106] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:27.645630] [DEBUG] [LOCAL ] MA: Derivative data saved (1807 records). [2025-10-16T22:40:27.645952] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-16T22:40:27.648786] [INFO ] [MAIN ] Derivative Progress: 1116/1803 symbols completed. MA took 1.1s. Estimated remaining: 4m 23s. Rate: 156.9 symbols/min [2025-10-16T22:40:27.648956] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:27.693865] [DEBUG] [LOCAL ] MAC: Loaded 50114 existing records from primary storage. [2025-10-16T22:40:27.694112] [INFO ] [MAIN ] MAC: Loaded 50114 primary data records. [2025-10-16T22:40:27.819682] [DEBUG] [LOCAL ] MAGN: Loaded 36411 existing records from primary storage. [2025-10-16T22:40:27.819932] [INFO ] [MAIN ] MAGN: Loaded 36411 primary data records. [2025-10-16T22:40:28.011418] [DEBUG] [LOCAL ] MAIN: Loaded 42123 existing records from primary storage. [2025-10-16T22:40:28.149557] [INFO ] [MAIN ] MAIN: Loaded 42123 primary data records. [2025-10-16T22:40:28.707669] [DEBUG] [MAIN ] MAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:28.709358] [INFO ] [MAIN ] MAC: Generated 1807 derivative records from 50114 primary records. [2025-10-16T22:40:28.710073] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-10-16T22:40:28.730273] [DEBUG] [LOCAL ] MAC: Derivative data saved (1807 records). [2025-10-16T22:40:28.731423] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-10-16T22:40:28.733575] [INFO ] [MAIN ] Derivative Progress: 1117/1803 symbols completed. MAC took 1.1s. Estimated remaining: 4m 23s. Rate: 156.6 symbols/min [2025-10-16T22:40:28.733946] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:28.748722] [DEBUG] [MAIN ] MAGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:28.749694] [INFO ] [MAIN ] MAGN: Generated 1807 derivative records from 36411 primary records. [2025-10-16T22:40:28.749884] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-16T22:40:28.766385] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1807 records). [2025-10-16T22:40:28.767066] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-16T22:40:28.770308] [INFO ] [MAIN ] Derivative Progress: 1118/1803 symbols completed. MAGN took 1.1s. Estimated remaining: 4m 22s. Rate: 156.7 symbols/min [2025-10-16T22:40:28.770546] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:28.786226] [DEBUG] [MAIN ] MAIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:28.786929] [INFO ] [MAIN ] MAIN: Generated 1807 derivative records from 42123 primary records. [2025-10-16T22:40:28.787168] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-16T22:40:28.812742] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1807 records). [2025-10-16T22:40:28.812911] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-16T22:40:28.815522] [INFO ] [MAIN ] Derivative Progress: 1119/1803 symbols completed. MAIN took 1.2s. Estimated remaining: 4m 22s. Rate: 156.8 symbols/min [2025-10-16T22:40:28.815680] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:28.849339] [DEBUG] [LOCAL ] MANU: Loaded 27328 existing records from primary storage. [2025-10-16T22:40:28.849607] [INFO ] [MAIN ] MANU: Loaded 27328 primary data records. [2025-10-16T22:40:28.847191] [DEBUG] [LOCAL ] MAN: Loaded 44417 existing records from primary storage. [2025-10-16T22:40:28.886491] [INFO ] [MAIN ] MAN: Loaded 44417 primary data records. [2025-10-16T22:40:29.368718] [DEBUG] [LOCAL ] MAS: Loaded 52671 existing records from primary storage. [2025-10-16T22:40:29.472513] [INFO ] [MAIN ] MAS: Loaded 52671 primary data records. [2025-10-16T22:40:29.831082] [DEBUG] [MAIN ] MANU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:29.837505] [INFO ] [MAIN ] MANU: Generated 1807 derivative records from 27328 primary records. [2025-10-16T22:40:29.837949] [DEBUG] [MAIN ] MAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:29.838095] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-16T22:40:29.838695] [INFO ] [MAIN ] MAN: Generated 1807 derivative records from 44417 primary records. [2025-10-16T22:40:29.838881] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-16T22:40:29.869446] [DEBUG] [LOCAL ] MAN: Derivative data saved (1807 records). [2025-10-16T22:40:29.872159] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-16T22:40:29.876077] [DEBUG] [LOCAL ] MANU: Derivative data saved (1807 records). [2025-10-16T22:40:29.875513] [INFO ] [MAIN ] Derivative Progress: 1120/1803 symbols completed. MAN took 1.1s. Estimated remaining: 4m 22s. Rate: 156.6 symbols/min [2025-10-16T22:40:29.876260] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:29.876489] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-16T22:40:29.879085] [INFO ] [MAIN ] Derivative Progress: 1121/1803 symbols completed. MANU took 1.1s. Estimated remaining: 4m 21s. Rate: 156.7 symbols/min [2025-10-16T22:40:29.879330] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:29.897345] [DEBUG] [MAIN ] MAS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:29.898089] [INFO ] [MAIN ] MAS: Generated 1807 derivative records from 52671 primary records. [2025-10-16T22:40:29.898292] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-16T22:40:29.915286] [DEBUG] [LOCAL ] MAS: Derivative data saved (1807 records). [2025-10-16T22:40:29.915452] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-16T22:40:29.918740] [INFO ] [MAIN ] Derivative Progress: 1122/1803 symbols completed. MAS took 1.1s. Estimated remaining: 4m 20s. Rate: 156.9 symbols/min [2025-10-16T22:40:29.919105] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:29.959712] [DEBUG] [LOCAL ] MATX: Loaded 32188 existing records from primary storage. [2025-10-16T22:40:29.959926] [INFO ] [MAIN ] MATX: Loaded 32188 primary data records. [2025-10-16T22:40:29.960728] [DEBUG] [LOCAL ] MATV: Loaded 35854 existing records from primary storage. [2025-10-16T22:40:29.965981] [INFO ] [MAIN ] MATV: Loaded 35854 primary data records. [2025-10-16T22:40:30.182973] [DEBUG] [LOCAL ] MAX: Loaded 31247 existing records from primary storage. [2025-10-16T22:40:30.191911] [INFO ] [MAIN ] MAX: Loaded 31247 primary data records. [2025-10-16T22:40:30.959898] [DEBUG] [MAIN ] MATX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:30.962909] [INFO ] [MAIN ] MATX: Generated 1807 derivative records from 32188 primary records. [2025-10-16T22:40:30.963565] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-16T22:40:30.990674] [DEBUG] [MAIN ] MATV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:30.995366] [INFO ] [MAIN ] MATV: Generated 1807 derivative records from 35854 primary records. [2025-10-16T22:40:30.995473] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-16T22:40:30.995684] [DEBUG] [LOCAL ] MATX: Derivative data saved (1807 records). [2025-10-16T22:40:30.996707] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-16T22:40:31.005603] [INFO ] [MAIN ] Derivative Progress: 1123/1803 symbols completed. MATX took 1.1s. Estimated remaining: 4m 21s. Rate: 156.6 symbols/min [2025-10-16T22:40:31.015877] [DEBUG] [LOCAL ] MATV: Derivative data saved (1807 records). [2025-10-16T22:40:31.016033] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-16T22:40:31.018757] [INFO ] [MAIN ] Derivative Progress: 1124/1803 symbols completed. MATV took 1.1s. Estimated remaining: 4m 20s. Rate: 156.7 symbols/min [2025-10-16T22:40:31.031400] [DEBUG] [MAIN ] MAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:31.031974] [INFO ] [MAIN ] MAX: Generated 1807 derivative records from 31247 primary records. [2025-10-16T22:40:31.032034] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-16T22:40:31.047027] [DEBUG] [LOCAL ] MAX: Derivative data saved (1807 records). [2025-10-16T22:40:31.047106] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-16T22:40:31.049980] [INFO ] [MAIN ] Derivative Progress: 1125/1803 symbols completed. MAX took 1.1s. Estimated remaining: 4m 19s. Rate: 156.9 symbols/min [2025-10-16T22:40:31.050411] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:31.050358] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:31.050582] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:31.076511] [DEBUG] [LOCAL ] MBI: Loaded 24511 existing records from primary storage. [2025-10-16T22:40:31.076767] [INFO ] [MAIN ] MBI: Loaded 24511 primary data records. [2025-10-16T22:40:31.250572] [DEBUG] [LOCAL ] MBC: Loaded 44249 existing records from primary storage. [2025-10-16T22:40:31.276767] [DEBUG] [LOCAL ] MC: Loaded 44275 existing records from primary storage. [2025-10-16T22:40:31.276162] [INFO ] [MAIN ] MBC: Loaded 44249 primary data records. [2025-10-16T22:40:31.279852] [INFO ] [MAIN ] MC: Loaded 44275 primary data records. [2025-10-16T22:40:32.063672] [DEBUG] [MAIN ] MBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:32.064784] [INFO ] [MAIN ] MBI: Generated 1807 derivative records from 24511 primary records. [2025-10-16T22:40:32.066303] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-16T22:40:32.084627] [DEBUG] [LOCAL ] MBI: Derivative data saved (1807 records). [2025-10-16T22:40:32.084952] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-16T22:40:32.087017] [INFO ] [MAIN ] Derivative Progress: 1126/1803 symbols completed. MBI took 1.0s. Estimated remaining: 4m 19s. Rate: 156.6 symbols/min [2025-10-16T22:40:32.087388] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:32.110221] [DEBUG] [MAIN ] MBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:32.128109] [INFO ] [MAIN ] MBC: Generated 1807 derivative records from 44249 primary records. [2025-10-16T22:40:32.128244] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-16T22:40:32.129313] [DEBUG] [MAIN ] MC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:32.127311] [DEBUG] [LOCAL ] MCB: Loaded 11454 existing records from primary storage. [2025-10-16T22:40:32.137350] [INFO ] [MAIN ] MCB: Loaded 11454 primary data records. [2025-10-16T22:40:32.137539] [INFO ] [MAIN ] MC: Generated 1807 derivative records from 44275 primary records. [2025-10-16T22:40:32.137707] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-16T22:40:32.151253] [DEBUG] [LOCAL ] MBC: Derivative data saved (1807 records). [2025-10-16T22:40:32.168331] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-16T22:40:32.171279] [INFO ] [MAIN ] Derivative Progress: 1127/1803 symbols completed. MBC took 1.1s. Estimated remaining: 4m 19s. Rate: 156.7 symbols/min [2025-10-16T22:40:32.223245] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:32.270863] [DEBUG] [LOCAL ] MC: Derivative data saved (1807 records). [2025-10-16T22:40:32.271537] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-16T22:40:32.279810] [INFO ] [MAIN ] Derivative Progress: 1128/1803 symbols completed. MC took 1.2s. Estimated remaining: 4m 18s. Rate: 156.8 symbols/min [2025-10-16T22:40:32.290325] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:32.503229] [DEBUG] [LOCAL ] MCI: Loaded 6436 existing records from primary storage. [2025-10-16T22:40:32.504112] [INFO ] [MAIN ] MCI: Loaded 6436 primary data records. [2025-10-16T22:40:32.838037] [DEBUG] [LOCAL ] MCK: Loaded 38825 existing records from primary storage. [2025-10-16T22:40:32.838305] [INFO ] [MAIN ] MCK: Loaded 38825 primary data records. [2025-10-16T22:40:32.999475] [DEBUG] [MAIN ] MCB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:33.037879] [INFO ] [MAIN ] MCB: Generated 1807 derivative records from 11454 primary records. [2025-10-16T22:40:33.150482] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-16T22:40:33.171674] [DEBUG] [LOCAL ] MCB: Derivative data saved (1807 records). [2025-10-16T22:40:33.174333] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-16T22:40:33.177070] [INFO ] [MAIN ] Derivative Progress: 1129/1803 symbols completed. MCB took 1.1s. Estimated remaining: 4m 18s. Rate: 156.7 symbols/min [2025-10-16T22:40:33.177352] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:33.192311] [DEBUG] [MAIN ] MCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:33.193368] [INFO ] [MAIN ] MCI: Generated 1807 derivative records from 6436 primary records. [2025-10-16T22:40:33.193566] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-16T22:40:33.211136] [DEBUG] [LOCAL ] MCI: Derivative data saved (1807 records). [2025-10-16T22:40:33.211544] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-16T22:40:33.214395] [INFO ] [MAIN ] Derivative Progress: 1130/1803 symbols completed. MCI took 1.0s. Estimated remaining: 4m 18s. Rate: 156.8 symbols/min [2025-10-16T22:40:33.214549] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:33.219411] [DEBUG] [LOCAL ] MCN: Loaded 8214 existing records from primary storage. [2025-10-16T22:40:33.219918] [INFO ] [MAIN ] MCN: Loaded 8214 primary data records. [2025-10-16T22:40:33.336331] [DEBUG] [MAIN ] MCK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:33.347671] [INFO ] [MAIN ] MCK: Generated 1807 derivative records from 38825 primary records. [2025-10-16T22:40:33.355539] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-16T22:40:33.552560] [DEBUG] [LOCAL ] MCK: Derivative data saved (1807 records). [2025-10-16T22:40:33.552786] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-16T22:40:33.555327] [INFO ] [MAIN ] Derivative Progress: 1131/1803 symbols completed. MCK took 1.3s. Estimated remaining: 4m 17s. Rate: 156.8 symbols/min [2025-10-16T22:40:33.555636] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:33.574304] [DEBUG] [LOCAL ] MCO: Loaded 39795 existing records from primary storage. [2025-10-16T22:40:33.574518] [INFO ] [MAIN ] MCO: Loaded 39795 primary data records. [2025-10-16T22:40:33.610434] [DEBUG] [LOCAL ] MCR: Loaded 8958 existing records from primary storage. [2025-10-16T22:40:33.634521] [INFO ] [MAIN ] MCR: Loaded 8958 primary data records. [2025-10-16T22:40:34.217158] [DEBUG] [MAIN ] MCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:34.217995] [INFO ] [MAIN ] MCN: Generated 1807 derivative records from 8214 primary records. [2025-10-16T22:40:34.218734] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-16T22:40:34.238046] [DEBUG] [LOCAL ] MCN: Derivative data saved (1807 records). [2025-10-16T22:40:34.238539] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-16T22:40:34.240962] [INFO ] [MAIN ] Derivative Progress: 1132/1803 symbols completed. MCN took 1.1s. Estimated remaining: 4m 17s. Rate: 156.7 symbols/min [2025-10-16T22:40:34.241452] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:34.270151] [DEBUG] [MAIN ] MCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:34.272544] [INFO ] [MAIN ] MCO: Generated 1807 derivative records from 39795 primary records. [2025-10-16T22:40:34.273068] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-16T22:40:34.280612] [DEBUG] [LOCAL ] MCS: Loaded 21302 existing records from primary storage. [2025-10-16T22:40:34.280733] [INFO ] [MAIN ] MCS: Loaded 21302 primary data records. [2025-10-16T22:40:34.347675] [DEBUG] [LOCAL ] MCO: Derivative data saved (1807 records). [2025-10-16T22:40:34.364450] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-16T22:40:34.381046] [INFO ] [MAIN ] Derivative Progress: 1133/1803 symbols completed. MCO took 1.2s. Estimated remaining: 4m 16s. Rate: 156.8 symbols/min [2025-10-16T22:40:34.393878] [DEBUG] [MAIN ] MCR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:34.388135] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:34.399978] [INFO ] [MAIN ] MCR: Generated 1807 derivative records from 8958 primary records. [2025-10-16T22:40:34.417166] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-16T22:40:34.474843] [DEBUG] [LOCAL ] MCR: Derivative data saved (1807 records). [2025-10-16T22:40:34.508166] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-16T22:40:34.549907] [INFO ] [MAIN ] Derivative Progress: 1134/1803 symbols completed. MCR took 1.0s. Estimated remaining: 4m 16s. Rate: 156.9 symbols/min [2025-10-16T22:40:34.606431] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:34.689666] [DEBUG] [LOCAL ] MCY: Loaded 24134 existing records from primary storage. [2025-10-16T22:40:34.690212] [INFO ] [MAIN ] MCY: Loaded 24134 primary data records. [2025-10-16T22:40:35.028740] [DEBUG] [LOCAL ] MD: Loaded 38831 existing records from primary storage. [2025-10-16T22:40:35.031410] [INFO ] [MAIN ] MD: Loaded 38831 primary data records. [2025-10-16T22:40:35.134663] [DEBUG] [MAIN ] MCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:35.159914] [INFO ] [MAIN ] MCS: Generated 1807 derivative records from 21302 primary records. [2025-10-16T22:40:35.160111] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-16T22:40:35.380211] [DEBUG] [LOCAL ] MCS: Derivative data saved (1807 records). [2025-10-16T22:40:35.381061] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-16T22:40:35.383638] [INFO ] [MAIN ] Derivative Progress: 1135/1803 symbols completed. MCS took 1.1s. Estimated remaining: 4m 16s. Rate: 156.7 symbols/min [2025-10-16T22:40:35.383893] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:35.398439] [DEBUG] [MAIN ] MCY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:35.399319] [INFO ] [MAIN ] MCY: Generated 1807 derivative records from 24134 primary records. [2025-10-16T22:40:35.399464] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-16T22:40:35.422581] [DEBUG] [LOCAL ] MCY: Derivative data saved (1807 records). [2025-10-16T22:40:35.418396] [DEBUG] [LOCAL ] MDST: Loaded 6060 existing records from primary storage. [2025-10-16T22:40:35.422841] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-16T22:40:35.423304] [INFO ] [MAIN ] MDST: Loaded 6060 primary data records. [2025-10-16T22:40:35.426002] [INFO ] [MAIN ] Derivative Progress: 1136/1803 symbols completed. MCY took 1.0s. Estimated remaining: 4m 15s. Rate: 156.8 symbols/min [2025-10-16T22:40:35.426313] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:35.620443] [DEBUG] [MAIN ] MD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:35.624458] [INFO ] [MAIN ] MD: Generated 1807 derivative records from 38831 primary records. [2025-10-16T22:40:35.624563] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-16T22:40:35.757255] [DEBUG] [LOCAL ] MD: Derivative data saved (1807 records). [2025-10-16T22:40:35.771093] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-16T22:40:35.774811] [INFO ] [MAIN ] Derivative Progress: 1137/1803 symbols completed. MD took 1.2s. Estimated remaining: 4m 15s. Rate: 156.8 symbols/min [2025-10-16T22:40:35.775277] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:35.803142] [DEBUG] [LOCAL ] MDT: Loaded 54068 existing records from primary storage. [2025-10-16T22:40:35.803530] [INFO ] [MAIN ] MDT: Loaded 54068 primary data records. [2025-10-16T22:40:35.889123] [DEBUG] [MAIN ] MDST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:35.907561] [INFO ] [MAIN ] MDST: Generated 1807 derivative records from 6060 primary records. [2025-10-16T22:40:35.930775] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-16T22:40:36.050091] [DEBUG] [LOCAL ] MDST: Derivative data saved (1807 records). [2025-10-16T22:40:36.162146] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-16T22:40:36.166331] [DEBUG] [LOCAL ] MDU: Loaded 48446 existing records from primary storage. [2025-10-16T22:40:36.166503] [INFO ] [MAIN ] MDU: Loaded 48446 primary data records. [2025-10-16T22:40:36.165032] [INFO ] [MAIN ] Derivative Progress: 1138/1803 symbols completed. MDST took 0.8s. Estimated remaining: 4m 14s. Rate: 156.8 symbols/min [2025-10-16T22:40:36.517469] [DEBUG] [MAIN ] MDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:36.518353] [INFO ] [MAIN ] MDT: Generated 1807 derivative records from 54068 primary records. [2025-10-16T22:40:36.518432] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-16T22:40:36.535113] [DEBUG] [LOCAL ] MDT: Derivative data saved (1807 records). [2025-10-16T22:40:36.535308] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-16T22:40:36.538483] [INFO ] [MAIN ] Derivative Progress: 1139/1803 symbols completed. MDT took 1.1s. Estimated remaining: 4m 14s. Rate: 156.8 symbols/min [2025-10-16T22:40:36.554821] [DEBUG] [MAIN ] MDU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:36.555396] [INFO ] [MAIN ] MDU: Generated 1807 derivative records from 48446 primary records. [2025-10-16T22:40:36.555456] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-16T22:40:36.570784] [DEBUG] [LOCAL ] MDU: Derivative data saved (1807 records). [2025-10-16T22:40:36.570846] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-16T22:40:36.573188] [INFO ] [MAIN ] Derivative Progress: 1140/1803 symbols completed. MDU took 0.8s. Estimated remaining: 4m 13s. Rate: 156.9 symbols/min [2025-10-16T22:40:36.573768] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:36.573876] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:36.574201] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:36.585096] [DEBUG] [LOCAL ] MDV: Loaded 8490 existing records from primary storage. [2025-10-16T22:40:36.585377] [INFO ] [MAIN ] MDV: Loaded 8490 primary data records. [2025-10-16T22:40:36.692138] [DEBUG] [LOCAL ] MEC: Loaded 16519 existing records from primary storage. [2025-10-16T22:40:36.709344] [INFO ] [MAIN ] MEC: Loaded 16519 primary data records. [2025-10-16T22:40:36.709825] [DEBUG] [LOCAL ] MED: Loaded 21369 existing records from primary storage. [2025-10-16T22:40:36.751476] [INFO ] [MAIN ] MED: Loaded 21369 primary data records. [2025-10-16T22:40:37.586345] [DEBUG] [MAIN ] MDV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:37.588569] [INFO ] [MAIN ] MDV: Generated 1807 derivative records from 8490 primary records. [2025-10-16T22:40:37.588718] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-16T22:40:37.612998] [DEBUG] [LOCAL ] MDV: Derivative data saved (1807 records). [2025-10-16T22:40:37.613604] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-16T22:40:37.628464] [INFO ] [MAIN ] Derivative Progress: 1141/1803 symbols completed. MDV took 1.1s. Estimated remaining: 4m 13s. Rate: 156.7 symbols/min [2025-10-16T22:40:37.629515] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:37.629079] [DEBUG] [MAIN ] MEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:37.634038] [INFO ] [MAIN ] MEC: Generated 1807 derivative records from 16519 primary records. [2025-10-16T22:40:37.634328] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-16T22:40:37.656991] [DEBUG] [MAIN ] MED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:37.661614] [INFO ] [MAIN ] MED: Generated 1807 derivative records from 21369 primary records. [2025-10-16T22:40:37.662209] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-16T22:40:37.667317] [DEBUG] [LOCAL ] MEC: Derivative data saved (1807 records). [2025-10-16T22:40:37.668090] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-16T22:40:37.678074] [INFO ] [MAIN ] Derivative Progress: 1142/1803 symbols completed. MEC took 1.1s. Estimated remaining: 4m 13s. Rate: 156.8 symbols/min [2025-10-16T22:40:37.690224] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:37.695216] [DEBUG] [LOCAL ] MED: Derivative data saved (1807 records). [2025-10-16T22:40:37.705185] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-16T22:40:37.708210] [INFO ] [MAIN ] Derivative Progress: 1143/1803 symbols completed. MED took 1.1s. Estimated remaining: 4m 12s. Rate: 157.0 symbols/min [2025-10-16T22:40:37.709726] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:37.709470] [DEBUG] [LOCAL ] MEG: Loaded 31847 existing records from primary storage. [2025-10-16T22:40:37.709899] [INFO ] [MAIN ] MEG: Loaded 31847 primary data records. [2025-10-16T22:40:37.804016] [DEBUG] [LOCAL ] MEGI: Loaded 19957 existing records from primary storage. [2025-10-16T22:40:37.827907] [INFO ] [MAIN ] MEGI: Loaded 19957 primary data records. [2025-10-16T22:40:38.213011] [DEBUG] [LOCAL ] MEI: Loaded 31898 existing records from primary storage. [2025-10-16T22:40:38.232746] [INFO ] [MAIN ] MEI: Loaded 31898 primary data records. [2025-10-16T22:40:38.783204] [DEBUG] [MAIN ] MEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:38.784386] [INFO ] [MAIN ] MEG: Generated 1807 derivative records from 31847 primary records. [2025-10-16T22:40:38.784718] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-16T22:40:38.819752] [DEBUG] [LOCAL ] MEG: Derivative data saved (1807 records). [2025-10-16T22:40:38.818530] [DEBUG] [MAIN ] MEGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:38.819922] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-16T22:40:38.822292] [INFO ] [MAIN ] Derivative Progress: 1144/1803 symbols completed. MEG took 1.2s. Estimated remaining: 4m 12s. Rate: 156.7 symbols/min [2025-10-16T22:40:38.823548] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:38.823441] [INFO ] [MAIN ] MEGI: Generated 1807 derivative records from 19957 primary records. [2025-10-16T22:40:38.824457] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-16T22:40:38.844583] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1807 records). [2025-10-16T22:40:38.846455] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-16T22:40:38.849336] [INFO ] [MAIN ] Derivative Progress: 1145/1803 symbols completed. MEGI took 1.2s. Estimated remaining: 4m 12s. Rate: 156.8 symbols/min [2025-10-16T22:40:38.849592] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:38.865024] [DEBUG] [MAIN ] MEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:38.865933] [INFO ] [MAIN ] MEI: Generated 1807 derivative records from 31898 primary records. [2025-10-16T22:40:38.866162] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-16T22:40:38.899894] [DEBUG] [LOCAL ] MEI: Derivative data saved (1807 records). [2025-10-16T22:40:38.900072] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-16T22:40:38.903028] [INFO ] [MAIN ] Derivative Progress: 1146/1803 symbols completed. MEI took 1.2s. Estimated remaining: 4m 11s. Rate: 156.9 symbols/min [2025-10-16T22:40:38.903329] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:38.923788] [DEBUG] [LOCAL ] MET: Loaded 53706 existing records from primary storage. [2025-10-16T22:40:38.933075] [INFO ] [MAIN ] MET: Loaded 53706 primary data records. [2025-10-16T22:40:38.936309] [DEBUG] [LOCAL ] MFAN: Loaded 4392 existing records from primary storage. [2025-10-16T22:40:38.957109] [INFO ] [MAIN ] MFAN: Loaded 4392 primary data records. [2025-10-16T22:40:39.132562] [DEBUG] [LOCAL ] MFA: Loaded 46093 existing records from primary storage. [2025-10-16T22:40:39.164887] [INFO ] [MAIN ] MFA: Loaded 46093 primary data records. [2025-10-16T22:40:39.916101] [DEBUG] [MAIN ] MET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:39.918625] [INFO ] [MAIN ] MET: Generated 1807 derivative records from 53706 primary records. [2025-10-16T22:40:39.919024] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-16T22:40:39.947818] [DEBUG] [LOCAL ] MET: Derivative data saved (1807 records). [2025-10-16T22:40:39.949022] [DEBUG] [MAIN ] MFAN: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:40:39.949192] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-16T22:40:39.952259] [INFO ] [MAIN ] Derivative Progress: 1147/1803 symbols completed. MET took 1.1s. Estimated remaining: 4m 11s. Rate: 156.7 symbols/min [2025-10-16T22:40:39.953212] [INFO ] [MAIN ] MFAN: Generated 1806 derivative records from 4392 primary records. [2025-10-16T22:40:39.953855] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:39.953729] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-16T22:40:39.973185] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1806 records). [2025-10-16T22:40:39.973478] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-16T22:40:39.976406] [INFO ] [MAIN ] Derivative Progress: 1148/1803 symbols completed. MFAN took 1.1s. Estimated remaining: 4m 11s. Rate: 156.8 symbols/min [2025-10-16T22:40:39.976728] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:39.992923] [DEBUG] [MAIN ] MFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:39.992855] [DEBUG] [LOCAL ] MFAO: Loaded 3992 existing records from primary storage. [2025-10-16T22:40:39.993677] [INFO ] [MAIN ] MFA: Generated 1807 derivative records from 46093 primary records. [2025-10-16T22:40:39.993783] [INFO ] [MAIN ] MFAO: Loaded 3992 primary data records. [2025-10-16T22:40:39.993849] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-16T22:40:40.116489] [DEBUG] [LOCAL ] MFA: Derivative data saved (1807 records). [2025-10-16T22:40:40.117064] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-16T22:40:40.158360] [INFO ] [MAIN ] Derivative Progress: 1149/1803 symbols completed. MFA took 1.3s. Estimated remaining: 4m 10s. Rate: 156.9 symbols/min [2025-10-16T22:40:40.196027] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:40.385090] [DEBUG] [LOCAL ] MFC: Loaded 51434 existing records from primary storage. [2025-10-16T22:40:40.385286] [INFO ] [MAIN ] MFC: Loaded 51434 primary data records. [2025-10-16T22:40:40.738960] [DEBUG] [MAIN ] MFAO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:40:40.741334] [INFO ] [MAIN ] MFAO: Generated 1806 derivative records from 3992 primary records. [2025-10-16T22:40:40.741496] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-16T22:40:40.744077] [DEBUG] [LOCAL ] MFG: Loaded 49867 existing records from primary storage. [2025-10-16T22:40:40.745151] [INFO ] [MAIN ] MFG: Loaded 49867 primary data records. [2025-10-16T22:40:40.848419] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1806 records). [2025-10-16T22:40:40.866130] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-16T22:40:40.874351] [INFO ] [MAIN ] Derivative Progress: 1150/1803 symbols completed. MFAO took 0.9s. Estimated remaining: 4m 10s. Rate: 156.8 symbols/min [2025-10-16T22:40:40.885797] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:41.090056] [DEBUG] [MAIN ] MFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:41.091677] [INFO ] [MAIN ] MFC: Generated 1807 derivative records from 51434 primary records. [2025-10-16T22:40:41.092110] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-16T22:40:41.111562] [DEBUG] [LOCAL ] MFM: Loaded 14665 existing records from primary storage. [2025-10-16T22:40:41.112754] [INFO ] [MAIN ] MFM: Loaded 14665 primary data records. [2025-10-16T22:40:41.190455] [DEBUG] [LOCAL ] MFC: Derivative data saved (1807 records). [2025-10-16T22:40:41.197764] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-16T22:40:41.211463] [INFO ] [MAIN ] Derivative Progress: 1151/1803 symbols completed. MFC took 1.2s. Estimated remaining: 4m 9s. Rate: 156.8 symbols/min [2025-10-16T22:40:41.217579] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:41.311184] [DEBUG] [LOCAL ] MFSG: Loaded 5852 existing records from primary storage. [2025-10-16T22:40:41.433098] [INFO ] [MAIN ] MFSG: Loaded 5852 primary data records. [2025-10-16T22:40:41.564298] [DEBUG] [MAIN ] MFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:41.568579] [INFO ] [MAIN ] MFG: Generated 1807 derivative records from 49867 primary records. [2025-10-16T22:40:41.569483] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-16T22:40:41.782397] [DEBUG] [LOCAL ] MFG: Derivative data saved (1807 records). [2025-10-16T22:40:41.782944] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-16T22:40:41.785568] [INFO ] [MAIN ] Derivative Progress: 1152/1803 symbols completed. MFG took 1.6s. Estimated remaining: 4m 9s. Rate: 156.7 symbols/min [2025-10-16T22:40:41.785805] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:41.804597] [DEBUG] [MAIN ] MFM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:41.805386] [INFO ] [MAIN ] MFM: Generated 1807 derivative records from 14665 primary records. [2025-10-16T22:40:41.805727] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-16T22:40:41.833917] [DEBUG] [LOCAL ] MFM: Derivative data saved (1807 records). [2025-10-16T22:40:41.834619] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-16T22:40:41.834274] [DEBUG] [LOCAL ] MFSI: Loaded 12301 existing records from primary storage. [2025-10-16T22:40:41.837521] [INFO ] [MAIN ] Derivative Progress: 1153/1803 symbols completed. MFM took 1.0s. Estimated remaining: 4m 9s. Rate: 156.8 symbols/min [2025-10-16T22:40:41.837773] [INFO ] [MAIN ] MFSI: Loaded 12301 primary data records. [2025-10-16T22:40:41.954747] [DEBUG] [MAIN ] MFSG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:41.961056] [INFO ] [MAIN ] MFSG: Generated 1807 derivative records from 5852 primary records. [2025-10-16T22:40:41.966256] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-16T22:40:42.041442] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1807 records). [2025-10-16T22:40:42.046739] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-16T22:40:42.049686] [INFO ] [MAIN ] Derivative Progress: 1154/1803 symbols completed. MFSG took 0.8s. Estimated remaining: 4m 8s. Rate: 156.9 symbols/min [2025-10-16T22:40:42.190326] [DEBUG] [MAIN ] MFSI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:40:42.190958] [INFO ] [MAIN ] MFSI: Generated 1806 derivative records from 12301 primary records. [2025-10-16T22:40:42.191021] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-16T22:40:42.206128] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1806 records). [2025-10-16T22:40:42.206187] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-16T22:40:42.208473] [INFO ] [MAIN ] Derivative Progress: 1155/1803 symbols completed. MFSI took 0.4s. Estimated remaining: 4m 8s. Rate: 157.0 symbols/min [2025-10-16T22:40:42.209259] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:42.209428] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:42.209156] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:42.216803] [DEBUG] [LOCAL ] MFSV: Loaded 2875 existing records from primary storage. [2025-10-16T22:40:42.216966] [INFO ] [MAIN ] MFSV: Loaded 2875 primary data records. [2025-10-16T22:40:42.341395] [DEBUG] [LOCAL ] MG: Loaded 15959 existing records from primary storage. [2025-10-16T22:40:42.358977] [INFO ] [MAIN ] MG: Loaded 15959 primary data records. [2025-10-16T22:40:42.717705] [DEBUG] [LOCAL ] MGA: Loaded 50889 existing records from primary storage. [2025-10-16T22:40:42.728381] [INFO ] [MAIN ] MGA: Loaded 50889 primary data records. [2025-10-16T22:40:43.222970] [DEBUG] [MAIN ] MFSV: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-16T22:40:43.224637] [INFO ] [MAIN ] MFSV: Generated 1805 derivative records from 2875 primary records. [2025-10-16T22:40:43.225434] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-16T22:40:43.241236] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1805 records). [2025-10-16T22:40:43.241407] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-16T22:40:43.244052] [INFO ] [MAIN ] Derivative Progress: 1156/1803 symbols completed. MFSV took 1.0s. Estimated remaining: 4m 8s. Rate: 156.8 symbols/min [2025-10-16T22:40:43.244416] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:43.266290] [DEBUG] [LOCAL ] MGF: Loaded 4176 existing records from primary storage. [2025-10-16T22:40:43.263189] [DEBUG] [MAIN ] MG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:43.266696] [INFO ] [MAIN ] MGF: Loaded 4176 primary data records. [2025-10-16T22:40:43.279042] [INFO ] [MAIN ] MG: Generated 1807 derivative records from 15959 primary records. [2025-10-16T22:40:43.279285] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-16T22:40:43.391844] [DEBUG] [LOCAL ] MG: Derivative data saved (1807 records). [2025-10-16T22:40:43.398745] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-16T22:40:43.427987] [INFO ] [MAIN ] Derivative Progress: 1157/1803 symbols completed. MG took 1.2s. Estimated remaining: 4m 7s. Rate: 156.8 symbols/min [2025-10-16T22:40:43.459888] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:43.606091] [DEBUG] [MAIN ] MGA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:43.619593] [INFO ] [MAIN ] MGA: Generated 1807 derivative records from 50889 primary records. [2025-10-16T22:40:43.619786] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-16T22:40:43.643982] [DEBUG] [LOCAL ] MGA: Derivative data saved (1807 records). [2025-10-16T22:40:43.644145] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-16T22:40:43.647518] [INFO ] [MAIN ] Derivative Progress: 1158/1803 symbols completed. MGA took 1.4s. Estimated remaining: 4m 7s. Rate: 156.9 symbols/min [2025-10-16T22:40:43.648307] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:43.674736] [DEBUG] [LOCAL ] MGR: Loaded 5641 existing records from primary storage. [2025-10-16T22:40:43.674882] [INFO ] [MAIN ] MGR: Loaded 5641 primary data records. [2025-10-16T22:40:43.823524] [DEBUG] [LOCAL ] MGM: Loaded 53997 existing records from primary storage. [2025-10-16T22:40:43.816733] [DEBUG] [MAIN ] MGF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:43.828810] [INFO ] [MAIN ] MGM: Loaded 53997 primary data records. [2025-10-16T22:40:43.839992] [INFO ] [MAIN ] MGF: Generated 1807 derivative records from 4176 primary records. [2025-10-16T22:40:43.871847] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-16T22:40:44.145471] [DEBUG] [LOCAL ] MGF: Derivative data saved (1807 records). [2025-10-16T22:40:44.149040] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-16T22:40:44.151770] [INFO ] [MAIN ] Derivative Progress: 1159/1803 symbols completed. MGF took 0.9s. Estimated remaining: 4m 6s. Rate: 156.8 symbols/min [2025-10-16T22:40:44.157335] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:44.245350] [DEBUG] [LOCAL ] MGRB: Loaded 4045 existing records from primary storage. [2025-10-16T22:40:44.404722] [INFO ] [MAIN ] MGRB: Loaded 4045 primary data records. [2025-10-16T22:40:44.735727] [DEBUG] [MAIN ] MGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:44.736963] [INFO ] [MAIN ] MGR: Generated 1807 derivative records from 5641 primary records. [2025-10-16T22:40:44.737705] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-16T22:40:44.760713] [DEBUG] [LOCAL ] MGR: Derivative data saved (1807 records). [2025-10-16T22:40:44.773164] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-16T22:40:44.776051] [INFO ] [MAIN ] Derivative Progress: 1160/1803 symbols completed. MGR took 1.1s. Estimated remaining: 4m 6s. Rate: 156.8 symbols/min [2025-10-16T22:40:44.777447] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:44.778156] [DEBUG] [MAIN ] MGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:44.779302] [INFO ] [MAIN ] MGM: Generated 1807 derivative records from 53997 primary records. [2025-10-16T22:40:44.779489] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-16T22:40:44.796178] [DEBUG] [LOCAL ] MGRD: Loaded 2246 existing records from primary storage. [2025-10-16T22:40:44.796795] [INFO ] [MAIN ] MGRD: Loaded 2246 primary data records. [2025-10-16T22:40:44.824375] [DEBUG] [LOCAL ] MGM: Derivative data saved (1807 records). [2025-10-16T22:40:44.830167] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-16T22:40:44.832566] [INFO ] [MAIN ] Derivative Progress: 1161/1803 symbols completed. MGM took 1.4s. Estimated remaining: 4m 6s. Rate: 156.9 symbols/min [2025-10-16T22:40:44.833065] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:44.944712] [DEBUG] [MAIN ] MGRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:44.954145] [INFO ] [MAIN ] MGRB: Generated 1807 derivative records from 4045 primary records. [2025-10-16T22:40:44.964802] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-16T22:40:44.959520] [DEBUG] [LOCAL ] MGRE: Loaded 6594 existing records from primary storage. [2025-10-16T22:40:45.034439] [INFO ] [MAIN ] MGRE: Loaded 6594 primary data records. [2025-10-16T22:40:45.218202] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1807 records). [2025-10-16T22:40:45.218365] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-16T22:40:45.238996] [INFO ] [MAIN ] Derivative Progress: 1162/1803 symbols completed. MGRB took 1.1s. Estimated remaining: 4m 5s. Rate: 156.9 symbols/min [2025-10-16T22:40:45.239301] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:45.590579] [DEBUG] [LOCAL ] MGY: Loaded 52803 existing records from primary storage. [2025-10-16T22:40:45.589858] [DEBUG] [MAIN ] MGRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:45.591403] [INFO ] [MAIN ] MGRD: Generated 1807 derivative records from 2246 primary records. [2025-10-16T22:40:45.592934] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-16T22:40:45.591939] [INFO ] [MAIN ] MGY: Loaded 52803 primary data records. [2025-10-16T22:40:45.676188] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1807 records). [2025-10-16T22:40:45.693335] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-16T22:40:45.701942] [INFO ] [MAIN ] Derivative Progress: 1163/1803 symbols completed. MGRD took 0.9s. Estimated remaining: 4m 5s. Rate: 156.8 symbols/min [2025-10-16T22:40:45.713337] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:45.924385] [DEBUG] [LOCAL ] MHD: Loaded 12286 existing records from primary storage. [2025-10-16T22:40:45.933637] [INFO ] [MAIN ] MHD: Loaded 12286 primary data records. [2025-10-16T22:40:45.957934] [DEBUG] [MAIN ] MGRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:45.966933] [INFO ] [MAIN ] MGRE: Generated 1807 derivative records from 6594 primary records. [2025-10-16T22:40:45.972249] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-16T22:40:46.091050] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1807 records). [2025-10-16T22:40:46.097012] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-16T22:40:46.105907] [INFO ] [MAIN ] Derivative Progress: 1164/1803 symbols completed. MGRE took 1.3s. Estimated remaining: 4m 4s. Rate: 156.8 symbols/min [2025-10-16T22:40:46.111274] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:46.366508] [DEBUG] [LOCAL ] MHF: Loaded 9009 existing records from primary storage. [2025-10-16T22:40:46.366722] [INFO ] [MAIN ] MHF: Loaded 9009 primary data records. [2025-10-16T22:40:46.546861] [DEBUG] [MAIN ] MGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:46.573198] [INFO ] [MAIN ] MGY: Generated 1807 derivative records from 52803 primary records. [2025-10-16T22:40:46.579680] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-16T22:40:46.715307] [DEBUG] [LOCAL ] MGY: Derivative data saved (1807 records). [2025-10-16T22:40:46.715556] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-16T22:40:46.718046] [INFO ] [MAIN ] Derivative Progress: 1165/1803 symbols completed. MGY took 1.5s. Estimated remaining: 4m 4s. Rate: 156.7 symbols/min [2025-10-16T22:40:46.718594] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:46.743542] [DEBUG] [MAIN ] MHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:46.744751] [INFO ] [MAIN ] MHD: Generated 1807 derivative records from 12286 primary records. [2025-10-16T22:40:46.745022] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-16T22:40:46.767018] [DEBUG] [LOCAL ] MHD: Derivative data saved (1807 records). [2025-10-16T22:40:46.776239] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-16T22:40:46.779053] [INFO ] [MAIN ] Derivative Progress: 1166/1803 symbols completed. MHD took 1.1s. Estimated remaining: 4m 4s. Rate: 156.9 symbols/min [2025-10-16T22:40:46.791896] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:46.792446] [DEBUG] [MAIN ] MHF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:46.793229] [INFO ] [MAIN ] MHF: Generated 1807 derivative records from 9009 primary records. [2025-10-16T22:40:46.793365] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-16T22:40:46.821768] [DEBUG] [LOCAL ] MHF: Derivative data saved (1807 records). [2025-10-16T22:40:46.821956] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-16T22:40:46.824925] [INFO ] [MAIN ] Derivative Progress: 1167/1803 symbols completed. MHF took 0.7s. Estimated remaining: 4m 3s. Rate: 157.0 symbols/min [2025-10-16T22:40:46.826271] [DEBUG] [LOCAL ] MHK: Loaded 42422 existing records from primary storage. [2025-10-16T22:40:46.826414] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:46.829800] [INFO ] [MAIN ] MHK: Loaded 42422 primary data records. [2025-10-16T22:40:46.830334] [DEBUG] [LOCAL ] MHN: Loaded 7527 existing records from primary storage. [2025-10-16T22:40:46.851054] [INFO ] [MAIN ] MHN: Loaded 7527 primary data records. [2025-10-16T22:40:47.161208] [DEBUG] [LOCAL ] MHO: Loaded 23951 existing records from primary storage. [2025-10-16T22:40:47.238151] [INFO ] [MAIN ] MHO: Loaded 23951 primary data records. [2025-10-16T22:40:47.779251] [DEBUG] [MAIN ] MHK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:47.792123] [INFO ] [MAIN ] MHK: Generated 1807 derivative records from 42422 primary records. [2025-10-16T22:40:47.792508] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-16T22:40:47.794087] [DEBUG] [MAIN ] MHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:47.795344] [INFO ] [MAIN ] MHN: Generated 1807 derivative records from 7527 primary records. [2025-10-16T22:40:47.795566] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-16T22:40:47.819522] [DEBUG] [LOCAL ] MHK: Derivative data saved (1807 records). [2025-10-16T22:40:47.824693] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-16T22:40:47.830046] [INFO ] [MAIN ] Derivative Progress: 1168/1803 symbols completed. MHK took 1.1s. Estimated remaining: 4m 3s. Rate: 156.8 symbols/min [2025-10-16T22:40:47.831775] [DEBUG] [LOCAL ] MHN: Derivative data saved (1807 records). [2025-10-16T22:40:47.831989] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-16T22:40:47.834560] [INFO ] [MAIN ] Derivative Progress: 1169/1803 symbols completed. MHN took 1.0s. Estimated remaining: 4m 2s. Rate: 156.9 symbols/min [2025-10-16T22:40:47.849214] [DEBUG] [MAIN ] MHO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:47.849840] [INFO ] [MAIN ] MHO: Generated 1807 derivative records from 23951 primary records. [2025-10-16T22:40:47.849907] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-16T22:40:47.864997] [DEBUG] [LOCAL ] MHO: Derivative data saved (1807 records). [2025-10-16T22:40:47.865054] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-16T22:40:47.867708] [INFO ] [MAIN ] Derivative Progress: 1170/1803 symbols completed. MHO took 1.0s. Estimated remaining: 4m 2s. Rate: 157.0 symbols/min [2025-10-16T22:40:47.868106] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:47.868347] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:47.868299] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:47.873366] [DEBUG] [LOCAL ] MITP: Loaded 2328 existing records from primary storage. [2025-10-16T22:40:47.873454] [INFO ] [MAIN ] MITP: Loaded 2328 primary data records. [2025-10-16T22:40:47.988345] [DEBUG] [LOCAL ] MIN: Loaded 14021 existing records from primary storage. [2025-10-16T22:40:48.004502] [INFO ] [MAIN ] MIN: Loaded 14021 primary data records. [2025-10-16T22:40:48.388237] [DEBUG] [LOCAL ] MIR: Loaded 51674 existing records from primary storage. [2025-10-16T22:40:48.388471] [INFO ] [MAIN ] MIR: Loaded 51674 primary data records. [2025-10-16T22:40:48.859300] [DEBUG] [MAIN ] MITP: Filtered 6966 bins outside market hours, 7762 incomplete bins [2025-10-16T22:40:48.860581] [INFO ] [MAIN ] MITP: Generated 1804 derivative records from 2328 primary records. [2025-10-16T22:40:48.861134] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-16T22:40:48.876354] [DEBUG] [LOCAL ] MITP: Derivative data saved (1804 records). [2025-10-16T22:40:48.877338] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-10-16T22:40:48.881096] [INFO ] [MAIN ] Derivative Progress: 1171/1803 symbols completed. MITP took 1.0s. Estimated remaining: 4m 2s. Rate: 156.8 symbols/min [2025-10-16T22:40:48.882312] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:48.897312] [DEBUG] [MAIN ] MIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:48.898159] [INFO ] [MAIN ] MIN: Generated 1807 derivative records from 14021 primary records. [2025-10-16T22:40:48.898678] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-16T22:40:48.928325] [DEBUG] [MAIN ] MIR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:48.935852] [INFO ] [MAIN ] MIR: Generated 1807 derivative records from 51674 primary records. [2025-10-16T22:40:48.936608] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-16T22:40:48.937140] [DEBUG] [LOCAL ] MIN: Derivative data saved (1807 records). [2025-10-16T22:40:48.937263] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-16T22:40:48.940341] [INFO ] [MAIN ] Derivative Progress: 1172/1803 symbols completed. MIN took 1.1s. Estimated remaining: 4m 1s. Rate: 156.9 symbols/min [2025-10-16T22:40:48.940924] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:48.961231] [DEBUG] [LOCAL ] MITT: Loaded 22805 existing records from primary storage. [2025-10-16T22:40:48.961710] [INFO ] [MAIN ] MITT: Loaded 22805 primary data records. [2025-10-16T22:40:49.039092] [DEBUG] [LOCAL ] MIY: Loaded 6309 existing records from primary storage. [2025-10-16T22:40:49.039443] [INFO ] [MAIN ] MIY: Loaded 6309 primary data records. [2025-10-16T22:40:49.119221] [DEBUG] [LOCAL ] MIR: Derivative data saved (1807 records). [2025-10-16T22:40:49.140992] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-16T22:40:49.181164] [INFO ] [MAIN ] Derivative Progress: 1173/1803 symbols completed. MIR took 1.3s. Estimated remaining: 4m 1s. Rate: 157.0 symbols/min [2025-10-16T22:40:49.250502] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:49.615426] [DEBUG] [MAIN ] MITT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:49.616291] [INFO ] [MAIN ] MITT: Generated 1807 derivative records from 22805 primary records. [2025-10-16T22:40:49.616826] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-16T22:40:49.662898] [DEBUG] [MAIN ] MIY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:49.664524] [INFO ] [MAIN ] MIY: Generated 1807 derivative records from 6309 primary records. [2025-10-16T22:40:49.665805] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-16T22:40:49.665662] [DEBUG] [LOCAL ] MITT: Derivative data saved (1807 records). [2025-10-16T22:40:49.665991] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-16T22:40:49.667055] [DEBUG] [LOCAL ] MKC: Loaded 52909 existing records from primary storage. [2025-10-16T22:40:49.667389] [INFO ] [MAIN ] MKC: Loaded 52909 primary data records. [2025-10-16T22:40:49.670212] [INFO ] [MAIN ] Derivative Progress: 1174/1803 symbols completed. MITT took 0.8s. Estimated remaining: 4m 1s. Rate: 156.9 symbols/min [2025-10-16T22:40:49.675833] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:49.824767] [DEBUG] [LOCAL ] MIY: Derivative data saved (1807 records). [2025-10-16T22:40:49.857687] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-16T22:40:49.874367] [INFO ] [MAIN ] Derivative Progress: 1175/1803 symbols completed. MIY took 0.9s. Estimated remaining: 4m 0s. Rate: 157.0 symbols/min [2025-10-16T22:40:49.874608] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:50.008353] [DEBUG] [LOCAL ] MKL: Loaded 34376 existing records from primary storage. [2025-10-16T22:40:50.009264] [INFO ] [MAIN ] MKL: Loaded 34376 primary data records. [2025-10-16T22:40:50.391370] [DEBUG] [LOCAL ] MLI: Loaded 43798 existing records from primary storage. [2025-10-16T22:40:50.391633] [INFO ] [MAIN ] MLI: Loaded 43798 primary data records. [2025-10-16T22:40:50.535132] [DEBUG] [MAIN ] MKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:50.541166] [INFO ] [MAIN ] MKC: Generated 1807 derivative records from 52909 primary records. [2025-10-16T22:40:50.592471] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-16T22:40:50.731431] [DEBUG] [LOCAL ] MKC: Derivative data saved (1807 records). [2025-10-16T22:40:50.731824] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-16T22:40:50.747392] [INFO ] [MAIN ] Derivative Progress: 1176/1803 symbols completed. MKC took 1.5s. Estimated remaining: 3m 60s. Rate: 156.8 symbols/min [2025-10-16T22:40:50.747860] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:50.748341] [DEBUG] [MAIN ] MKL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:50.749195] [INFO ] [MAIN ] MKL: Generated 1807 derivative records from 34376 primary records. [2025-10-16T22:40:50.750000] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-16T22:40:50.768878] [DEBUG] [LOCAL ] MKL: Derivative data saved (1807 records). [2025-10-16T22:40:50.768993] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-16T22:40:50.771632] [INFO ] [MAIN ] Derivative Progress: 1177/1803 symbols completed. MKL took 1.1s. Estimated remaining: 3m 59s. Rate: 156.9 symbols/min [2025-10-16T22:40:50.771917] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:50.796848] [DEBUG] [MAIN ] MLI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:50.797629] [INFO ] [MAIN ] MLI: Generated 1807 derivative records from 43798 primary records. [2025-10-16T22:40:50.797724] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-16T22:40:50.827441] [DEBUG] [LOCAL ] MLM: Loaded 29440 existing records from primary storage. [2025-10-16T22:40:50.829345] [DEBUG] [LOCAL ] MLI: Derivative data saved (1807 records). [2025-10-16T22:40:50.829439] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-16T22:40:50.828326] [INFO ] [MAIN ] MLM: Loaded 29440 primary data records. [2025-10-16T22:40:50.831821] [INFO ] [MAIN ] Derivative Progress: 1178/1803 symbols completed. MLI took 1.0s. Estimated remaining: 3m 59s. Rate: 157.0 symbols/min [2025-10-16T22:40:50.832157] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:50.948674] [DEBUG] [LOCAL ] MLNK: Loaded 27069 existing records from primary storage. [2025-10-16T22:40:50.948164] [DEBUG] [LOCAL ] MLP: Loaded 3090 existing records from primary storage. [2025-10-16T22:40:50.948849] [INFO ] [MAIN ] MLNK: Loaded 27069 primary data records. [2025-10-16T22:40:50.949230] [INFO ] [MAIN ] MLP: Loaded 3090 primary data records. [2025-10-16T22:40:51.756242] [DEBUG] [MAIN ] MLM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:51.757229] [INFO ] [MAIN ] MLM: Generated 1807 derivative records from 29440 primary records. [2025-10-16T22:40:51.757518] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-16T22:40:51.788899] [DEBUG] [MAIN ] MLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:51.802994] [INFO ] [MAIN ] MLP: Generated 1807 derivative records from 3090 primary records. [2025-10-16T22:40:51.803561] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-16T22:40:51.804635] [DEBUG] [MAIN ] MLNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:51.805120] [DEBUG] [LOCAL ] MLM: Derivative data saved (1807 records). [2025-10-16T22:40:51.805230] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-16T22:40:51.812244] [INFO ] [MAIN ] MLNK: Generated 1807 derivative records from 27069 primary records. [2025-10-16T22:40:51.815111] [INFO ] [MAIN ] Derivative Progress: 1179/1803 symbols completed. MLM took 1.1s. Estimated remaining: 3m 59s. Rate: 156.8 symbols/min [2025-10-16T22:40:51.819220] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:51.819608] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-16T22:40:51.838262] [DEBUG] [LOCAL ] MLP: Derivative data saved (1807 records). [2025-10-16T22:40:51.838599] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-16T22:40:51.841306] [INFO ] [MAIN ] Derivative Progress: 1180/1803 symbols completed. MLP took 1.0s. Estimated remaining: 3m 58s. Rate: 157.0 symbols/min [2025-10-16T22:40:51.842207] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:51.846084] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1807 records). [2025-10-16T22:40:51.846193] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-10-16T22:40:51.848734] [INFO ] [MAIN ] Derivative Progress: 1181/1803 symbols completed. MLNK took 1.1s. Estimated remaining: 3m 58s. Rate: 157.1 symbols/min [2025-10-16T22:40:51.848963] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:51.855200] [DEBUG] [LOCAL ] MLR: Loaded 12546 existing records from primary storage. [2025-10-16T22:40:51.855514] [INFO ] [MAIN ] MLR: Loaded 12546 primary data records. [2025-10-16T22:40:51.974330] [DEBUG] [LOCAL ] MMD: Loaded 10974 existing records from primary storage. [2025-10-16T22:40:51.975195] [INFO ] [MAIN ] MMD: Loaded 10974 primary data records. [2025-10-16T22:40:51.980750] [DEBUG] [LOCAL ] MMI: Loaded 15671 existing records from primary storage. [2025-10-16T22:40:52.016812] [INFO ] [MAIN ] MMI: Loaded 15671 primary data records. [2025-10-16T22:40:52.810252] [DEBUG] [MAIN ] MLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:52.811155] [INFO ] [MAIN ] MLR: Generated 1807 derivative records from 12546 primary records. [2025-10-16T22:40:52.811410] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-16T22:40:52.829915] [DEBUG] [LOCAL ] MLR: Derivative data saved (1807 records). [2025-10-16T22:40:52.830317] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-16T22:40:52.833543] [INFO ] [MAIN ] Derivative Progress: 1182/1803 symbols completed. MLR took 1.0s. Estimated remaining: 3m 58s. Rate: 156.9 symbols/min [2025-10-16T22:40:52.842035] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:52.848238] [DEBUG] [MAIN ] MMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:52.848968] [INFO ] [MAIN ] MMD: Generated 1807 derivative records from 10974 primary records. [2025-10-16T22:40:52.849132] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-16T22:40:52.873822] [DEBUG] [MAIN ] MMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:52.876260] [INFO ] [MAIN ] MMI: Generated 1807 derivative records from 15671 primary records. [2025-10-16T22:40:52.876775] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-16T22:40:52.878952] [DEBUG] [LOCAL ] MMD: Derivative data saved (1807 records). [2025-10-16T22:40:52.879032] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-16T22:40:52.881770] [INFO ] [MAIN ] Derivative Progress: 1183/1803 symbols completed. MMD took 1.0s. Estimated remaining: 3m 57s. Rate: 157.0 symbols/min [2025-10-16T22:40:52.896579] [DEBUG] [LOCAL ] MMI: Derivative data saved (1807 records). [2025-10-16T22:40:52.896739] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-16T22:40:52.899502] [INFO ] [MAIN ] Derivative Progress: 1184/1803 symbols completed. MMI took 1.1s. Estimated remaining: 3m 56s. Rate: 157.1 symbols/min [2025-10-16T22:40:52.942203] [DEBUG] [LOCAL ] MMM: Loaded 53503 existing records from primary storage. [2025-10-16T22:40:52.942349] [INFO ] [MAIN ] MMM: Loaded 53503 primary data records. [2025-10-16T22:40:53.244294] [DEBUG] [MAIN ] MMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:53.244940] [INFO ] [MAIN ] MMM: Generated 1807 derivative records from 53503 primary records. [2025-10-16T22:40:53.245034] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-16T22:40:53.260282] [DEBUG] [LOCAL ] MMM: Derivative data saved (1807 records). [2025-10-16T22:40:53.260354] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-16T22:40:53.263269] [INFO ] [MAIN ] Derivative Progress: 1185/1803 symbols completed. MMM took 0.4s. Estimated remaining: 3m 56s. Rate: 157.1 symbols/min [2025-10-16T22:40:53.263876] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:53.263978] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:53.264131] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:53.276212] [DEBUG] [LOCAL ] MMT: Loaded 10392 existing records from primary storage. [2025-10-16T22:40:53.276514] [INFO ] [MAIN ] MMT: Loaded 10392 primary data records. [2025-10-16T22:40:53.369913] [DEBUG] [LOCAL ] MMU: Loaded 16691 existing records from primary storage. [2025-10-16T22:40:53.381021] [INFO ] [MAIN ] MMU: Loaded 16691 primary data records. [2025-10-16T22:40:53.497914] [DEBUG] [LOCAL ] MMS: Loaded 34018 existing records from primary storage. [2025-10-16T22:40:53.552869] [INFO ] [MAIN ] MMS: Loaded 34018 primary data records. [2025-10-16T22:40:54.284275] [DEBUG] [MAIN ] MMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:54.286450] [INFO ] [MAIN ] MMT: Generated 1807 derivative records from 10392 primary records. [2025-10-16T22:40:54.286593] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-16T22:40:54.306631] [DEBUG] [MAIN ] MMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:54.307463] [INFO ] [MAIN ] MMU: Generated 1807 derivative records from 16691 primary records. [2025-10-16T22:40:54.312137] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-16T22:40:54.335401] [DEBUG] [LOCAL ] MMT: Derivative data saved (1807 records). [2025-10-16T22:40:54.335865] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-16T22:40:54.338712] [INFO ] [MAIN ] Derivative Progress: 1186/1803 symbols completed. MMT took 1.1s. Estimated remaining: 3m 56s. Rate: 156.9 symbols/min [2025-10-16T22:40:54.336187] [DEBUG] [LOCAL ] MMU: Derivative data saved (1807 records). [2025-10-16T22:40:54.352408] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-16T22:40:54.352554] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:54.355333] [INFO ] [MAIN ] Derivative Progress: 1187/1803 symbols completed. MMU took 1.1s. Estimated remaining: 3m 55s. Rate: 157.0 symbols/min [2025-10-16T22:40:54.356874] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:54.356728] [DEBUG] [MAIN ] MMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:54.358772] [INFO ] [MAIN ] MMS: Generated 1807 derivative records from 34018 primary records. [2025-10-16T22:40:54.358844] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-16T22:40:54.376529] [DEBUG] [LOCAL ] MMS: Derivative data saved (1807 records). [2025-10-16T22:40:54.376791] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-16T22:40:54.379574] [INFO ] [MAIN ] Derivative Progress: 1188/1803 symbols completed. MMS took 1.1s. Estimated remaining: 3m 55s. Rate: 157.1 symbols/min [2025-10-16T22:40:54.379781] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:54.405067] [DEBUG] [LOCAL ] MNR: Loaded 25091 existing records from primary storage. [2025-10-16T22:40:54.405193] [INFO ] [MAIN ] MNR: Loaded 25091 primary data records. [2025-10-16T22:40:54.619605] [DEBUG] [LOCAL ] MNSO: Loaded 44550 existing records from primary storage. [2025-10-16T22:40:54.726794] [INFO ] [MAIN ] MNSO: Loaded 44550 primary data records. [2025-10-16T22:40:54.818831] [DEBUG] [LOCAL ] MOD: Loaded 45085 existing records from primary storage. [2025-10-16T22:40:54.836441] [INFO ] [MAIN ] MOD: Loaded 45085 primary data records. [2025-10-16T22:40:55.381921] [DEBUG] [MAIN ] MNR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:55.383010] [INFO ] [MAIN ] MNR: Generated 1807 derivative records from 25091 primary records. [2025-10-16T22:40:55.383210] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-16T22:40:55.400233] [DEBUG] [LOCAL ] MNR: Derivative data saved (1807 records). [2025-10-16T22:40:55.401451] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-16T22:40:55.404130] [INFO ] [MAIN ] Derivative Progress: 1189/1803 symbols completed. MNR took 1.1s. Estimated remaining: 3m 55s. Rate: 156.9 symbols/min [2025-10-16T22:40:55.405289] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:55.420732] [DEBUG] [MAIN ] MNSO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:55.422868] [INFO ] [MAIN ] MNSO: Generated 1807 derivative records from 44550 primary records. [2025-10-16T22:40:55.423093] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-16T22:40:55.444934] [DEBUG] [MAIN ] MOD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:55.451401] [INFO ] [MAIN ] MOD: Generated 1807 derivative records from 45085 primary records. [2025-10-16T22:40:55.451495] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-16T22:40:55.452613] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1807 records). [2025-10-16T22:40:55.453296] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-16T22:40:55.455498] [INFO ] [MAIN ] Derivative Progress: 1190/1803 symbols completed. MNSO took 1.1s. Estimated remaining: 3m 54s. Rate: 157.0 symbols/min [2025-10-16T22:40:55.455962] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:55.472425] [DEBUG] [LOCAL ] MOD: Derivative data saved (1807 records). [2025-10-16T22:40:55.472523] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-16T22:40:55.475255] [INFO ] [MAIN ] Derivative Progress: 1191/1803 symbols completed. MOD took 1.1s. Estimated remaining: 3m 54s. Rate: 157.2 symbols/min [2025-10-16T22:40:55.475686] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:55.518165] [DEBUG] [LOCAL ] MODG: Loaded 51962 existing records from primary storage. [2025-10-16T22:40:55.518366] [INFO ] [MAIN ] MODG: Loaded 51962 primary data records. [2025-10-16T22:40:55.633454] [DEBUG] [LOCAL ] MOH: Loaded 42970 existing records from primary storage. [2025-10-16T22:40:55.644365] [INFO ] [MAIN ] MOH: Loaded 42970 primary data records. [2025-10-16T22:40:55.989136] [DEBUG] [LOCAL ] MOS: Loaded 53898 existing records from primary storage. [2025-10-16T22:40:56.011719] [INFO ] [MAIN ] MOS: Loaded 53898 primary data records. [2025-10-16T22:40:56.521704] [DEBUG] [MAIN ] MODG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:56.523018] [INFO ] [MAIN ] MODG: Generated 1807 derivative records from 51962 primary records. [2025-10-16T22:40:56.523419] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-16T22:40:56.542798] [DEBUG] [LOCAL ] MODG: Derivative data saved (1807 records). [2025-10-16T22:40:56.546096] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-16T22:40:56.548732] [INFO ] [MAIN ] Derivative Progress: 1192/1803 symbols completed. MODG took 1.1s. Estimated remaining: 3m 54s. Rate: 156.9 symbols/min [2025-10-16T22:40:56.549033] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:56.563626] [DEBUG] [MAIN ] MOH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:56.564890] [INFO ] [MAIN ] MOH: Generated 1807 derivative records from 42970 primary records. [2025-10-16T22:40:56.564972] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-16T22:40:56.604214] [DEBUG] [MAIN ] MOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:56.611808] [INFO ] [MAIN ] MOS: Generated 1807 derivative records from 53898 primary records. [2025-10-16T22:40:56.612575] [DEBUG] [LOCAL ] MOH: Derivative data saved (1807 records). [2025-10-16T22:40:56.613698] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-16T22:40:56.613861] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-10-16T22:40:56.616282] [INFO ] [MAIN ] Derivative Progress: 1193/1803 symbols completed. MOH took 1.2s. Estimated remaining: 3m 53s. Rate: 157.0 symbols/min [2025-10-16T22:40:56.617452] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:56.618622] [DEBUG] [LOCAL ] MOV: Loaded 21798 existing records from primary storage. [2025-10-16T22:40:56.627588] [INFO ] [MAIN ] MOV: Loaded 21798 primary data records. [2025-10-16T22:40:56.695089] [DEBUG] [LOCAL ] MPA: Loaded 5378 existing records from primary storage. [2025-10-16T22:40:56.717156] [INFO ] [MAIN ] MPA: Loaded 5378 primary data records. [2025-10-16T22:40:56.780135] [DEBUG] [LOCAL ] MOS: Derivative data saved (1807 records). [2025-10-16T22:40:56.818368] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-16T22:40:56.868220] [INFO ] [MAIN ] Derivative Progress: 1194/1803 symbols completed. MOS took 1.4s. Estimated remaining: 3m 53s. Rate: 157.1 symbols/min [2025-10-16T22:40:56.887905] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:57.096574] [DEBUG] [LOCAL ] MPV: Loaded 4676 existing records from primary storage. [2025-10-16T22:40:57.134701] [INFO ] [MAIN ] MPV: Loaded 4676 primary data records. [2025-10-16T22:40:57.584569] [DEBUG] [MAIN ] MOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:57.589678] [INFO ] [MAIN ] MOV: Generated 1807 derivative records from 21798 primary records. [2025-10-16T22:40:57.589894] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-16T22:40:57.619750] [DEBUG] [LOCAL ] MOV: Derivative data saved (1807 records). [2025-10-16T22:40:57.618224] [DEBUG] [MAIN ] MPA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:57.620955] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-10-16T22:40:57.623313] [INFO ] [MAIN ] Derivative Progress: 1195/1803 symbols completed. MOV took 1.1s. Estimated remaining: 3m 52s. Rate: 156.9 symbols/min [2025-10-16T22:40:57.620865] [INFO ] [MAIN ] MPA: Generated 1807 derivative records from 5378 primary records. [2025-10-16T22:40:57.624223] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-16T22:40:57.623696] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:57.643357] [DEBUG] [LOCAL ] MPA: Derivative data saved (1807 records). [2025-10-16T22:40:57.643452] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-16T22:40:57.646473] [INFO ] [MAIN ] Derivative Progress: 1196/1803 symbols completed. MPA took 1.0s. Estimated remaining: 3m 52s. Rate: 157.1 symbols/min [2025-10-16T22:40:57.651979] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:57.662448] [DEBUG] [MAIN ] MPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:57.663318] [INFO ] [MAIN ] MPV: Generated 1807 derivative records from 4676 primary records. [2025-10-16T22:40:57.664627] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-16T22:40:57.683496] [DEBUG] [LOCAL ] MPX: Loaded 4074 existing records from primary storage. [2025-10-16T22:40:57.683759] [INFO ] [MAIN ] MPX: Loaded 4074 primary data records. [2025-10-16T22:40:57.695501] [DEBUG] [LOCAL ] MPV: Derivative data saved (1807 records). [2025-10-16T22:40:57.720110] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-10-16T22:40:57.755066] [INFO ] [MAIN ] Derivative Progress: 1197/1803 symbols completed. MPV took 0.9s. Estimated remaining: 3m 51s. Rate: 157.2 symbols/min [2025-10-16T22:40:57.787557] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:58.037843] [DEBUG] [LOCAL ] MPW: Loaded 53886 existing records from primary storage. [2025-10-16T22:40:58.038173] [INFO ] [MAIN ] MPW: Loaded 53886 primary data records. [2025-10-16T22:40:58.073856] [DEBUG] [LOCAL ] MQT: Loaded 8377 existing records from primary storage. [2025-10-16T22:40:58.086240] [INFO ] [MAIN ] MQT: Loaded 8377 primary data records. [2025-10-16T22:40:58.660190] [DEBUG] [MAIN ] MPX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:58.662439] [INFO ] [MAIN ] MPX: Generated 1807 derivative records from 4074 primary records. [2025-10-16T22:40:58.664941] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-10-16T22:40:58.684789] [DEBUG] [LOCAL ] MPX: Derivative data saved (1807 records). [2025-10-16T22:40:58.685196] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-10-16T22:40:58.688855] [INFO ] [MAIN ] Derivative Progress: 1198/1803 symbols completed. MPX took 1.0s. Estimated remaining: 3m 51s. Rate: 157.0 symbols/min [2025-10-16T22:40:58.703822] [DEBUG] [MAIN ] MPW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:58.704583] [INFO ] [MAIN ] MPW: Generated 1807 derivative records from 53886 primary records. [2025-10-16T22:40:58.704787] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-10-16T22:40:58.722491] [DEBUG] [LOCAL ] MPW: Derivative data saved (1807 records). [2025-10-16T22:40:58.722584] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-10-16T22:40:58.725674] [INFO ] [MAIN ] Derivative Progress: 1199/1803 symbols completed. MPW took 1.1s. Estimated remaining: 3m 51s. Rate: 157.1 symbols/min [2025-10-16T22:40:58.738428] [DEBUG] [MAIN ] MQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:58.739017] [INFO ] [MAIN ] MQT: Generated 1807 derivative records from 8377 primary records. [2025-10-16T22:40:58.739080] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-16T22:40:58.753575] [DEBUG] [LOCAL ] MQT: Derivative data saved (1807 records). [2025-10-16T22:40:58.753633] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-10-16T22:40:58.756535] [INFO ] [MAIN ] Derivative Progress: 1200/1803 symbols completed. MQT took 1.0s. Estimated remaining: 3m 50s. Rate: 157.2 symbols/min [2025-10-16T22:40:58.757075] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:58.757200] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:58.757278] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:58.779774] [DEBUG] [LOCAL ] MSD: Loaded 16669 existing records from primary storage. [2025-10-16T22:40:58.784186] [INFO ] [MAIN ] MSD: Loaded 16669 primary data records. [2025-10-16T22:40:58.783955] [DEBUG] [LOCAL ] MSB: Loaded 7883 existing records from primary storage. [2025-10-16T22:40:58.837587] [DEBUG] [LOCAL ] MTD: Loaded 15539 existing records from primary storage. [2025-10-16T22:40:58.832097] [INFO ] [MAIN ] MSB: Loaded 7883 primary data records. [2025-10-16T22:40:58.870113] [INFO ] [MAIN ] MTD: Loaded 15539 primary data records. [2025-10-16T22:40:59.781576] [DEBUG] [MAIN ] MSD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:59.782408] [INFO ] [MAIN ] MSD: Generated 1807 derivative records from 16669 primary records. [2025-10-16T22:40:59.782730] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-10-16T22:40:59.801969] [DEBUG] [LOCAL ] MSD: Derivative data saved (1807 records). [2025-10-16T22:40:59.803141] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-10-16T22:40:59.806833] [INFO ] [MAIN ] Derivative Progress: 1201/1803 symbols completed. MSD took 1.0s. Estimated remaining: 3m 50s. Rate: 157.0 symbols/min [2025-10-16T22:40:59.807119] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:59.828451] [DEBUG] [MAIN ] MSB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:59.833725] [INFO ] [MAIN ] MSB: Generated 1807 derivative records from 7883 primary records. [2025-10-16T22:40:59.833977] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-10-16T22:40:59.835704] [DEBUG] [MAIN ] MTD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:40:59.847069] [INFO ] [MAIN ] MTD: Generated 1807 derivative records from 15539 primary records. [2025-10-16T22:40:59.854060] [DEBUG] [LOCAL ] MSB: Derivative data saved (1807 records). [2025-10-16T22:40:59.854220] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-10-16T22:40:59.849805] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-10-16T22:40:59.856978] [INFO ] [MAIN ] Derivative Progress: 1202/1803 symbols completed. MSB took 1.1s. Estimated remaining: 3m 50s. Rate: 157.1 symbols/min [2025-10-16T22:40:59.858449] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:40:59.870552] [DEBUG] [LOCAL ] MUA: Loaded 11602 existing records from primary storage. [2025-10-16T22:40:59.871997] [INFO ] [MAIN ] MUA: Loaded 11602 primary data records. [2025-10-16T22:40:59.974781] [DEBUG] [LOCAL ] MTD: Derivative data saved (1807 records). [2025-10-16T22:40:59.990095] [DEBUG] [LOCAL ] MUE: Loaded 12115 existing records from primary storage. [2025-10-16T22:40:59.990207] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-10-16T22:40:59.990318] [INFO ] [MAIN ] MUE: Loaded 12115 primary data records. [2025-10-16T22:40:59.993163] [INFO ] [MAIN ] Derivative Progress: 1203/1803 symbols completed. MTD took 1.2s. Estimated remaining: 3m 49s. Rate: 157.2 symbols/min [2025-10-16T22:41:00.034823] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:00.344783] [DEBUG] [LOCAL ] MVF: Loaded 12832 existing records from primary storage. [2025-10-16T22:41:00.371950] [INFO ] [MAIN ] MVF: Loaded 12832 primary data records. [2025-10-16T22:41:00.811748] [DEBUG] [MAIN ] MUA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:00.813966] [INFO ] [MAIN ] MUA: Generated 1807 derivative records from 11602 primary records. [2025-10-16T22:41:00.814280] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-10-16T22:41:00.835076] [DEBUG] [MAIN ] MUE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:00.842628] [DEBUG] [LOCAL ] MUA: Derivative data saved (1807 records). [2025-10-16T22:41:00.844311] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-10-16T22:41:00.843448] [INFO ] [MAIN ] MUE: Generated 1807 derivative records from 12115 primary records. [2025-10-16T22:41:00.844413] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-16T22:41:00.847502] [INFO ] [MAIN ] Derivative Progress: 1204/1803 symbols completed. MUA took 1.0s. Estimated remaining: 3m 49s. Rate: 157.0 symbols/min [2025-10-16T22:41:00.847788] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:00.873137] [DEBUG] [LOCAL ] MVT: Loaded 10069 existing records from primary storage. [2025-10-16T22:41:00.874010] [DEBUG] [LOCAL ] MUE: Derivative data saved (1807 records). [2025-10-16T22:41:00.874807] [INFO ] [MAIN ] MVT: Loaded 10069 primary data records. [2025-10-16T22:41:00.875158] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-10-16T22:41:00.877686] [INFO ] [MAIN ] Derivative Progress: 1205/1803 symbols completed. MUE took 1.0s. Estimated remaining: 3m 48s. Rate: 157.1 symbols/min [2025-10-16T22:41:00.877850] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:00.929208] [DEBUG] [MAIN ] MVF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:00.963043] [INFO ] [MAIN ] MVF: Generated 1807 derivative records from 12832 primary records. [2025-10-16T22:41:00.986166] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-10-16T22:41:01.061277] [DEBUG] [LOCAL ] MX: Loaded 22465 existing records from primary storage. [2025-10-16T22:41:01.102241] [INFO ] [MAIN ] MX: Loaded 22465 primary data records. [2025-10-16T22:41:01.254392] [DEBUG] [LOCAL ] MVF: Derivative data saved (1807 records). [2025-10-16T22:41:01.278721] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-10-16T22:41:01.308269] [INFO ] [MAIN ] Derivative Progress: 1206/1803 symbols completed. MVF took 1.3s. Estimated remaining: 3m 48s. Rate: 157.1 symbols/min [2025-10-16T22:41:01.332635] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:01.533485] [DEBUG] [LOCAL ] MXF: Loaded 5645 existing records from primary storage. [2025-10-16T22:41:01.533631] [INFO ] [MAIN ] MXF: Loaded 5645 primary data records. [2025-10-16T22:41:01.885911] [DEBUG] [MAIN ] MVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:01.895787] [INFO ] [MAIN ] MVT: Generated 1807 derivative records from 10069 primary records. [2025-10-16T22:41:01.896183] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-16T22:41:01.914379] [DEBUG] [LOCAL ] MVT: Derivative data saved (1807 records). [2025-10-16T22:41:01.916261] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-10-16T22:41:01.918582] [INFO ] [MAIN ] Derivative Progress: 1207/1803 symbols completed. MVT took 1.1s. Estimated remaining: 3m 48s. Rate: 157.0 symbols/min [2025-10-16T22:41:01.919562] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:01.937788] [DEBUG] [MAIN ] MX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:01.939011] [INFO ] [MAIN ] MX: Generated 1807 derivative records from 22465 primary records. [2025-10-16T22:41:01.939331] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-10-16T22:41:01.955476] [DEBUG] [LOCAL ] MYN: Loaded 9866 existing records from primary storage. [2025-10-16T22:41:01.959003] [INFO ] [MAIN ] MYN: Loaded 9866 primary data records. [2025-10-16T22:41:01.997085] [DEBUG] [LOCAL ] MX: Derivative data saved (1807 records). [2025-10-16T22:41:01.997350] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-10-16T22:41:02.028818] [INFO ] [MAIN ] Derivative Progress: 1208/1803 symbols completed. MX took 1.2s. Estimated remaining: 3m 47s. Rate: 157.1 symbols/min [2025-10-16T22:41:02.040977] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:02.274360] [DEBUG] [MAIN ] MXF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:02.283859] [INFO ] [MAIN ] MXF: Generated 1807 derivative records from 5645 primary records. [2025-10-16T22:41:02.284035] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-10-16T22:41:02.299437] [DEBUG] [LOCAL ] MXF: Derivative data saved (1807 records). [2025-10-16T22:41:02.300318] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-10-16T22:41:02.303801] [INFO ] [MAIN ] Derivative Progress: 1209/1803 symbols completed. MXF took 1.0s. Estimated remaining: 3m 47s. Rate: 157.2 symbols/min [2025-10-16T22:41:02.304336] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:02.320358] [DEBUG] [LOCAL ] NAZ: Loaded 2683 existing records from primary storage. [2025-10-16T22:41:02.320820] [INFO ] [MAIN ] NAZ: Loaded 2683 primary data records. [2025-10-16T22:41:02.411949] [DEBUG] [LOCAL ] NAT: Loaded 49601 existing records from primary storage. [2025-10-16T22:41:02.447503] [INFO ] [MAIN ] NAT: Loaded 49601 primary data records. [2025-10-16T22:41:02.638178] [DEBUG] [MAIN ] MYN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:02.743527] [INFO ] [MAIN ] MYN: Generated 1807 derivative records from 9866 primary records. [2025-10-16T22:41:02.765186] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-16T22:41:02.979559] [DEBUG] [LOCAL ] MYN: Derivative data saved (1807 records). [2025-10-16T22:41:02.980235] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-10-16T22:41:02.982406] [INFO ] [MAIN ] Derivative Progress: 1210/1803 symbols completed. MYN took 1.1s. Estimated remaining: 3m 47s. Rate: 157.1 symbols/min [2025-10-16T22:41:02.982681] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:02.996862] [DEBUG] [LOCAL ] NBB: Loaded 9114 existing records from primary storage. [2025-10-16T22:41:02.997339] [INFO ] [MAIN ] NBB: Loaded 9114 primary data records. [2025-10-16T22:41:03.164875] [DEBUG] [MAIN ] NAZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:03.194888] [INFO ] [MAIN ] NAZ: Generated 1807 derivative records from 2683 primary records. [2025-10-16T22:41:03.306926] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-16T22:41:03.321061] [DEBUG] [MAIN ] NAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:03.328311] [INFO ] [MAIN ] NAT: Generated 1807 derivative records from 49601 primary records. [2025-10-16T22:41:03.328474] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-10-16T22:41:03.353751] [DEBUG] [LOCAL ] NAT: Derivative data saved (1807 records). [2025-10-16T22:41:03.354625] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1807 records). [2025-10-16T22:41:03.355769] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-10-16T22:41:03.355596] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-10-16T22:41:03.359463] [INFO ] [MAIN ] Derivative Progress: 1211/1803 symbols completed. NAZ took 1.1s. Estimated remaining: 3m 46s. Rate: 157.1 symbols/min [2025-10-16T22:41:03.360029] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:03.362974] [INFO ] [MAIN ] Derivative Progress: 1212/1803 symbols completed. NAT took 1.3s. Estimated remaining: 3m 46s. Rate: 157.2 symbols/min [2025-10-16T22:41:03.364486] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:03.369512] [DEBUG] [LOCAL ] NC: Loaded 1982 existing records from primary storage. [2025-10-16T22:41:03.369701] [INFO ] [MAIN ] NC: Loaded 1982 primary data records. [2025-10-16T22:41:03.478782] [DEBUG] [LOCAL ] NCA: Loaded 10015 existing records from primary storage. [2025-10-16T22:41:03.485300] [INFO ] [MAIN ] NCA: Loaded 10015 primary data records. [2025-10-16T22:41:03.638394] [DEBUG] [MAIN ] NBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:03.811990] [INFO ] [MAIN ] NBB: Generated 1807 derivative records from 9114 primary records. [2025-10-16T22:41:03.820296] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-16T22:41:04.011933] [DEBUG] [LOCAL ] NBB: Derivative data saved (1807 records). [2025-10-16T22:41:04.027525] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-10-16T22:41:04.030166] [INFO ] [MAIN ] Derivative Progress: 1213/1803 symbols completed. NBB took 1.0s. Estimated remaining: 3m 45s. Rate: 157.1 symbols/min [2025-10-16T22:41:04.054524] [DEBUG] [MAIN ] NC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:41:04.055326] [INFO ] [MAIN ] NC: Generated 1806 derivative records from 1982 primary records. [2025-10-16T22:41:04.055406] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-10-16T22:41:04.083077] [DEBUG] [LOCAL ] NC: Derivative data saved (1806 records). [2025-10-16T22:41:04.082701] [DEBUG] [MAIN ] NCA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:04.083817] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-10-16T22:41:04.083760] [INFO ] [MAIN ] NCA: Generated 1807 derivative records from 10015 primary records. [2025-10-16T22:41:04.083929] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-16T22:41:04.086964] [INFO ] [MAIN ] Derivative Progress: 1214/1803 symbols completed. NC took 0.7s. Estimated remaining: 3m 45s. Rate: 157.2 symbols/min [2025-10-16T22:41:04.101611] [DEBUG] [LOCAL ] NCA: Derivative data saved (1807 records). [2025-10-16T22:41:04.101703] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-10-16T22:41:04.104426] [INFO ] [MAIN ] Derivative Progress: 1215/1803 symbols completed. NCA took 0.7s. Estimated remaining: 3m 44s. Rate: 157.3 symbols/min [2025-10-16T22:41:04.104951] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:04.104815] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:04.104888] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:04.119399] [DEBUG] [LOCAL ] NEXA: Loaded 5326 existing records from primary storage. [2025-10-16T22:41:04.119671] [INFO ] [MAIN ] NEXA: Loaded 5326 primary data records. [2025-10-16T22:41:04.211021] [DEBUG] [LOCAL ] NCV: Loaded 14028 existing records from primary storage. [2025-10-16T22:41:04.216673] [DEBUG] [LOCAL ] NCZ: Loaded 12477 existing records from primary storage. [2025-10-16T22:41:04.222434] [INFO ] [MAIN ] NCV: Loaded 14028 primary data records. [2025-10-16T22:41:04.253682] [INFO ] [MAIN ] NCZ: Loaded 12477 primary data records. [2025-10-16T22:41:05.061621] [DEBUG] [MAIN ] NCZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:05.067986] [INFO ] [MAIN ] NCZ: Generated 1807 derivative records from 12477 primary records. [2025-10-16T22:41:05.067280] [DEBUG] [MAIN ] NEXA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:05.068887] [INFO ] [MAIN ] NEXA: Generated 1807 derivative records from 5326 primary records. [2025-10-16T22:41:05.068095] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-16T22:41:05.069182] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-10-16T22:41:05.083151] [DEBUG] [MAIN ] NCV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:05.083927] [INFO ] [MAIN ] NCV: Generated 1807 derivative records from 14028 primary records. [2025-10-16T22:41:05.084034] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-10-16T22:41:05.109476] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1807 records). [2025-10-16T22:41:05.116685] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-10-16T22:41:05.119553] [INFO ] [MAIN ] Derivative Progress: 1216/1803 symbols completed. NEXA took 1.0s. Estimated remaining: 3m 44s. Rate: 157.1 symbols/min [2025-10-16T22:41:05.120176] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:05.131763] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1807 records). [2025-10-16T22:41:05.132627] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-10-16T22:41:05.135367] [INFO ] [MAIN ] Derivative Progress: 1217/1803 symbols completed. NCZ took 1.0s. Estimated remaining: 3m 44s. Rate: 157.2 symbols/min [2025-10-16T22:41:05.136990] [DEBUG] [LOCAL ] NCV: Derivative data saved (1807 records). [2025-10-16T22:41:05.137114] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-10-16T22:41:05.140029] [INFO ] [MAIN ] Derivative Progress: 1218/1803 symbols completed. NCV took 1.0s. Estimated remaining: 3m 43s. Rate: 157.4 symbols/min [2025-10-16T22:41:05.140228] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:05.136477] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:05.161875] [DEBUG] [LOCAL ] NGS: Loaded 11249 existing records from primary storage. [2025-10-16T22:41:05.162006] [INFO ] [MAIN ] NGS: Loaded 11249 primary data records. [2025-10-16T22:41:05.222639] [DEBUG] [LOCAL ] NIE: Loaded 11965 existing records from primary storage. [2025-10-16T22:41:05.257251] [DEBUG] [LOCAL ] NGL: Loaded 30150 existing records from primary storage. [2025-10-16T22:41:05.245054] [INFO ] [MAIN ] NIE: Loaded 11965 primary data records. [2025-10-16T22:41:05.262698] [INFO ] [MAIN ] NGL: Loaded 30150 primary data records. [2025-10-16T22:41:06.128332] [DEBUG] [MAIN ] NGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:06.129236] [INFO ] [MAIN ] NGS: Generated 1807 derivative records from 11249 primary records. [2025-10-16T22:41:06.129796] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-10-16T22:41:06.162441] [DEBUG] [MAIN ] NGL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:06.165101] [INFO ] [MAIN ] NGL: Generated 1807 derivative records from 30150 primary records. [2025-10-16T22:41:06.165936] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-10-16T22:41:06.179503] [DEBUG] [LOCAL ] NGS: Derivative data saved (1807 records). [2025-10-16T22:41:06.179668] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-10-16T22:41:06.182118] [INFO ] [MAIN ] Derivative Progress: 1219/1803 symbols completed. NGS took 1.0s. Estimated remaining: 3m 43s. Rate: 157.1 symbols/min [2025-10-16T22:41:06.182544] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:06.190939] [DEBUG] [MAIN ] NIE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:06.196304] [INFO ] [MAIN ] NIE: Generated 1807 derivative records from 11965 primary records. [2025-10-16T22:41:06.196490] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-16T22:41:06.213790] [DEBUG] [LOCAL ] NGL: Derivative data saved (1807 records). [2025-10-16T22:41:06.217057] [DEBUG] [LOCAL ] NIM: Loaded 3564 existing records from primary storage. [2025-10-16T22:41:06.217450] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-10-16T22:41:06.217385] [INFO ] [MAIN ] NIM: Loaded 3564 primary data records. [2025-10-16T22:41:06.220946] [INFO ] [MAIN ] Derivative Progress: 1220/1803 symbols completed. NGL took 1.1s. Estimated remaining: 3m 42s. Rate: 157.3 symbols/min [2025-10-16T22:41:06.221623] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:06.282784] [DEBUG] [LOCAL ] NIE: Derivative data saved (1807 records). [2025-10-16T22:41:06.309107] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-10-16T22:41:06.334401] [INFO ] [MAIN ] Derivative Progress: 1221/1803 symbols completed. NIE took 1.2s. Estimated remaining: 3m 42s. Rate: 157.4 symbols/min [2025-10-16T22:41:06.358883] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:06.547845] [DEBUG] [LOCAL ] NINE: Loaded 28660 existing records from primary storage. [2025-10-16T22:41:06.548264] [INFO ] [MAIN ] NINE: Loaded 28660 primary data records. [2025-10-16T22:41:06.917460] [DEBUG] [LOCAL ] NIO: Loaded 54192 existing records from primary storage. [2025-10-16T22:41:06.917963] [INFO ] [MAIN ] NIO: Loaded 54192 primary data records. [2025-10-16T22:41:07.051989] [DEBUG] [MAIN ] NIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:07.282815] [INFO ] [MAIN ] NIM: Generated 1807 derivative records from 3564 primary records. [2025-10-16T22:41:07.304502] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-10-16T22:41:07.324757] [DEBUG] [LOCAL ] NIM: Derivative data saved (1807 records). [2025-10-16T22:41:07.325622] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-10-16T22:41:07.328381] [INFO ] [MAIN ] Derivative Progress: 1222/1803 symbols completed. NIM took 1.1s. Estimated remaining: 3m 42s. Rate: 157.1 symbols/min [2025-10-16T22:41:07.328849] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:07.343247] [DEBUG] [MAIN ] NINE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:07.344113] [INFO ] [MAIN ] NINE: Generated 1807 derivative records from 28660 primary records. [2025-10-16T22:41:07.344449] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-10-16T22:41:07.370863] [DEBUG] [LOCAL ] NKX: Loaded 13736 existing records from primary storage. [2025-10-16T22:41:07.372488] [INFO ] [MAIN ] NKX: Loaded 13736 primary data records. [2025-10-16T22:41:07.394690] [DEBUG] [LOCAL ] NINE: Derivative data saved (1807 records). [2025-10-16T22:41:07.467865] [DEBUG] [MAIN ] NIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:07.416940] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-10-16T22:41:07.499363] [INFO ] [MAIN ] NIO: Generated 1807 derivative records from 54192 primary records. [2025-10-16T22:41:07.499581] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-10-16T22:41:07.498233] [INFO ] [MAIN ] Derivative Progress: 1223/1803 symbols completed. NINE took 1.3s. Estimated remaining: 3m 41s. Rate: 157.2 symbols/min [2025-10-16T22:41:07.500216] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:07.598565] [DEBUG] [LOCAL ] NIO: Derivative data saved (1807 records). [2025-10-16T22:41:07.605770] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-10-16T22:41:07.608424] [INFO ] [MAIN ] Derivative Progress: 1224/1803 symbols completed. NIO took 1.2s. Estimated remaining: 3m 41s. Rate: 157.3 symbols/min [2025-10-16T22:41:07.720526] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:07.741745] [DEBUG] [LOCAL ] NMAI: Loaded 12951 existing records from primary storage. [2025-10-16T22:41:07.741868] [INFO ] [MAIN ] NMAI: Loaded 12951 primary data records. [2025-10-16T22:41:07.877970] [DEBUG] [LOCAL ] NMG: Loaded 11020 existing records from primary storage. [2025-10-16T22:41:07.891021] [INFO ] [MAIN ] NMG: Loaded 11020 primary data records. [2025-10-16T22:41:08.361273] [DEBUG] [MAIN ] NKX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:08.363248] [INFO ] [MAIN ] NKX: Generated 1807 derivative records from 13736 primary records. [2025-10-16T22:41:08.364117] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-10-16T22:41:08.386350] [DEBUG] [LOCAL ] NKX: Derivative data saved (1807 records). [2025-10-16T22:41:08.386820] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-10-16T22:41:08.390437] [INFO ] [MAIN ] Derivative Progress: 1225/1803 symbols completed. NKX took 1.1s. Estimated remaining: 3m 41s. Rate: 157.2 symbols/min [2025-10-16T22:41:08.392011] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:08.409478] [DEBUG] [MAIN ] NMAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:08.410354] [INFO ] [MAIN ] NMAI: Generated 1807 derivative records from 12951 primary records. [2025-10-16T22:41:08.410504] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-10-16T22:41:08.415962] [DEBUG] [LOCAL ] NMI: Loaded 4065 existing records from primary storage. [2025-10-16T22:41:08.417056] [INFO ] [MAIN ] NMI: Loaded 4065 primary data records. [2025-10-16T22:41:08.479122] [DEBUG] [MAIN ] NMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:08.518995] [INFO ] [MAIN ] NMG: Generated 1807 derivative records from 11020 primary records. [2025-10-16T22:41:08.508754] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1807 records). [2025-10-16T22:41:08.531991] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-10-16T22:41:08.551832] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-10-16T22:41:08.545027] [INFO ] [MAIN ] Derivative Progress: 1226/1803 symbols completed. NMAI took 1.0s. Estimated remaining: 3m 40s. Rate: 157.3 symbols/min [2025-10-16T22:41:08.564683] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:08.782976] [DEBUG] [LOCAL ] NMG: Derivative data saved (1807 records). [2025-10-16T22:41:08.784512] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-10-16T22:41:08.787773] [INFO ] [MAIN ] Derivative Progress: 1227/1803 symbols completed. NMG took 1.1s. Estimated remaining: 3m 40s. Rate: 157.3 symbols/min [2025-10-16T22:41:08.798165] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:08.814376] [DEBUG] [LOCAL ] NMR: Loaded 35856 existing records from primary storage. [2025-10-16T22:41:08.817322] [DEBUG] [LOCAL ] NMS: Loaded 2924 existing records from primary storage. [2025-10-16T22:41:08.817838] [INFO ] [MAIN ] NMS: Loaded 2924 primary data records. [2025-10-16T22:41:08.817735] [INFO ] [MAIN ] NMR: Loaded 35856 primary data records. [2025-10-16T22:41:09.172706] [DEBUG] [MAIN ] NMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:09.301799] [INFO ] [MAIN ] NMI: Generated 1807 derivative records from 4065 primary records. [2025-10-16T22:41:09.312696] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-16T22:41:09.536804] [DEBUG] [LOCAL ] NMI: Derivative data saved (1807 records). [2025-10-16T22:41:09.537388] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-10-16T22:41:09.540169] [INFO ] [MAIN ] Derivative Progress: 1228/1803 symbols completed. NMI took 1.1s. Estimated remaining: 3m 40s. Rate: 157.2 symbols/min [2025-10-16T22:41:09.564576] [DEBUG] [MAIN ] NMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:09.566097] [INFO ] [MAIN ] NMR: Generated 1807 derivative records from 35856 primary records. [2025-10-16T22:41:09.566808] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-10-16T22:41:09.592000] [DEBUG] [MAIN ] NMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:09.593421] [INFO ] [MAIN ] NMS: Generated 1807 derivative records from 2924 primary records. [2025-10-16T22:41:09.593749] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-16T22:41:09.608317] [DEBUG] [LOCAL ] NMR: Derivative data saved (1807 records). [2025-10-16T22:41:09.609139] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-10-16T22:41:09.612167] [INFO ] [MAIN ] Derivative Progress: 1229/1803 symbols completed. NMR took 1.0s. Estimated remaining: 3m 39s. Rate: 157.3 symbols/min [2025-10-16T22:41:09.615871] [DEBUG] [LOCAL ] NMS: Derivative data saved (1807 records). [2025-10-16T22:41:09.615952] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-10-16T22:41:09.619778] [INFO ] [MAIN ] Derivative Progress: 1230/1803 symbols completed. NMS took 0.8s. Estimated remaining: 3m 38s. Rate: 157.4 symbols/min [2025-10-16T22:41:09.620170] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:09.620320] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:09.620229] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:09.635147] [DEBUG] [LOCAL ] NNY: Loaded 5723 existing records from primary storage. [2025-10-16T22:41:09.632494] [DEBUG] [LOCAL ] NMT: Loaded 2854 existing records from primary storage. [2025-10-16T22:41:09.635340] [INFO ] [MAIN ] NNY: Loaded 5723 primary data records. [2025-10-16T22:41:09.635407] [INFO ] [MAIN ] NMT: Loaded 2854 primary data records. [2025-10-16T22:41:09.690062] [DEBUG] [LOCAL ] NNI: Loaded 10533 existing records from primary storage. [2025-10-16T22:41:09.735236] [INFO ] [MAIN ] NNI: Loaded 10533 primary data records. [2025-10-16T22:41:10.563101] [DEBUG] [MAIN ] NMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:10.568270] [DEBUG] [MAIN ] NNY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:10.568968] [INFO ] [MAIN ] NMT: Generated 1807 derivative records from 2854 primary records. [2025-10-16T22:41:10.569749] [INFO ] [MAIN ] NNY: Generated 1807 derivative records from 5723 primary records. [2025-10-16T22:41:10.569882] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-16T22:41:10.570172] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-16T22:41:10.594147] [DEBUG] [LOCAL ] NNY: Derivative data saved (1807 records). [2025-10-16T22:41:10.600158] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-10-16T22:41:10.600496] [DEBUG] [LOCAL ] NMT: Derivative data saved (1807 records). [2025-10-16T22:41:10.603075] [INFO ] [MAIN ] Derivative Progress: 1231/1803 symbols completed. NNY took 1.0s. Estimated remaining: 3m 38s. Rate: 157.2 symbols/min [2025-10-16T22:41:10.610769] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:10.600689] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-10-16T22:41:10.618151] [INFO ] [MAIN ] Derivative Progress: 1232/1803 symbols completed. NMT took 1.0s. Estimated remaining: 3m 38s. Rate: 157.3 symbols/min [2025-10-16T22:41:10.618785] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:10.619574] [DEBUG] [MAIN ] NNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:10.620344] [INFO ] [MAIN ] NNI: Generated 1807 derivative records from 10533 primary records. [2025-10-16T22:41:10.620524] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-10-16T22:41:10.636557] [DEBUG] [LOCAL ] NNI: Derivative data saved (1807 records). [2025-10-16T22:41:10.636725] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-10-16T22:41:10.639608] [INFO ] [MAIN ] Derivative Progress: 1233/1803 symbols completed. NNI took 1.0s. Estimated remaining: 3m 37s. Rate: 157.4 symbols/min [2025-10-16T22:41:10.639845] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:10.651758] [DEBUG] [LOCAL ] NPFD: Loaded 10130 existing records from primary storage. [2025-10-16T22:41:10.652023] [INFO ] [MAIN ] NPFD: Loaded 10130 primary data records. [2025-10-16T22:41:10.821418] [DEBUG] [LOCAL ] NOTE: Loaded 40633 existing records from primary storage. [2025-10-16T22:41:10.832477] [DEBUG] [LOCAL ] NOK: Loaded 54012 existing records from primary storage. [2025-10-16T22:41:10.850561] [INFO ] [MAIN ] NOTE: Loaded 40633 primary data records. [2025-10-16T22:41:10.837715] [INFO ] [MAIN ] NOK: Loaded 54012 primary data records. [2025-10-16T22:41:11.769117] [DEBUG] [MAIN ] NPFD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:11.770876] [INFO ] [MAIN ] NPFD: Generated 1807 derivative records from 10130 primary records. [2025-10-16T22:41:11.771457] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-10-16T22:41:11.802375] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1807 records). [2025-10-16T22:41:11.841336] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-10-16T22:41:11.854236] [INFO ] [MAIN ] Derivative Progress: 1234/1803 symbols completed. NPFD took 1.2s. Estimated remaining: 3m 37s. Rate: 157.2 symbols/min [2025-10-16T22:41:11.851053] [DEBUG] [MAIN ] NOTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:11.855676] [DEBUG] [MAIN ] NOK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:11.856831] [INFO ] [MAIN ] NOK: Generated 1807 derivative records from 54012 primary records. [2025-10-16T22:41:11.858300] [INFO ] [MAIN ] NOTE: Generated 1807 derivative records from 40633 primary records. [2025-10-16T22:41:11.858505] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-10-16T22:41:11.858676] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-10-16T22:41:11.855128] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:11.886972] [DEBUG] [LOCAL ] NOK: Derivative data saved (1807 records). [2025-10-16T22:41:11.888332] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-10-16T22:41:11.903068] [INFO ] [MAIN ] Derivative Progress: 1235/1803 symbols completed. NOK took 1.3s. Estimated remaining: 3m 37s. Rate: 157.3 symbols/min [2025-10-16T22:41:11.916889] [DEBUG] [LOCAL ] NPK: Loaded 8494 existing records from primary storage. [2025-10-16T22:41:11.917364] [INFO ] [MAIN ] NPK: Loaded 8494 primary data records. [2025-10-16T22:41:11.914089] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:11.946820] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1807 records). [2025-10-16T22:41:11.959953] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-10-16T22:41:11.969966] [INFO ] [MAIN ] Derivative Progress: 1236/1803 symbols completed. NOTE took 1.4s. Estimated remaining: 3m 36s. Rate: 157.4 symbols/min [2025-10-16T22:41:11.970406] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:11.974876] [DEBUG] [LOCAL ] NPV: Loaded 5385 existing records from primary storage. [2025-10-16T22:41:11.975356] [INFO ] [MAIN ] NPV: Loaded 5385 primary data records. [2025-10-16T22:41:12.190380] [DEBUG] [LOCAL ] NQP: Loaded 9287 existing records from primary storage. [2025-10-16T22:41:12.267439] [INFO ] [MAIN ] NQP: Loaded 9287 primary data records. [2025-10-16T22:41:13.060574] [DEBUG] [MAIN ] NPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:13.067547] [DEBUG] [MAIN ] NPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:13.067239] [INFO ] [MAIN ] NPK: Generated 1807 derivative records from 8494 primary records. [2025-10-16T22:41:13.068333] [INFO ] [MAIN ] NPV: Generated 1807 derivative records from 5385 primary records. [2025-10-16T22:41:13.068559] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-16T22:41:13.067737] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-10-16T22:41:13.099870] [DEBUG] [LOCAL ] NPK: Derivative data saved (1807 records). [2025-10-16T22:41:13.101014] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-10-16T22:41:13.103264] [INFO ] [MAIN ] Derivative Progress: 1237/1803 symbols completed. NPK took 1.2s. Estimated remaining: 3m 36s. Rate: 157.1 symbols/min [2025-10-16T22:41:13.103870] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:13.119924] [DEBUG] [LOCAL ] NPV: Derivative data saved (1807 records). [2025-10-16T22:41:13.120253] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-10-16T22:41:13.120539] [DEBUG] [MAIN ] NQP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:13.124218] [INFO ] [MAIN ] NQP: Generated 1807 derivative records from 9287 primary records. [2025-10-16T22:41:13.123448] [INFO ] [MAIN ] Derivative Progress: 1238/1803 symbols completed. NPV took 1.2s. Estimated remaining: 3m 36s. Rate: 157.3 symbols/min [2025-10-16T22:41:13.124393] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-10-16T22:41:13.125165] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:13.140453] [DEBUG] [LOCAL ] NQP: Derivative data saved (1807 records). [2025-10-16T22:41:13.140684] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-10-16T22:41:13.143596] [INFO ] [MAIN ] Derivative Progress: 1239/1803 symbols completed. NQP took 1.2s. Estimated remaining: 3m 35s. Rate: 157.4 symbols/min [2025-10-16T22:41:13.143902] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:13.160115] [DEBUG] [LOCAL ] NREF: Loaded 7915 existing records from primary storage. [2025-10-16T22:41:13.160421] [INFO ] [MAIN ] NREF: Loaded 7915 primary data records. [2025-10-16T22:41:13.251793] [DEBUG] [LOCAL ] NRDY: Loaded 32903 existing records from primary storage. [2025-10-16T22:41:13.273842] [INFO ] [MAIN ] NRDY: Loaded 32903 primary data records. [2025-10-16T22:41:13.627117] [DEBUG] [LOCAL ] NRGV: Loaded 44137 existing records from primary storage. [2025-10-16T22:41:13.643128] [INFO ] [MAIN ] NRGV: Loaded 44137 primary data records. [2025-10-16T22:41:14.150817] [DEBUG] [MAIN ] NREF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:14.152279] [INFO ] [MAIN ] NREF: Generated 1807 derivative records from 7915 primary records. [2025-10-16T22:41:14.159953] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-10-16T22:41:14.166347] [DEBUG] [MAIN ] NRDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:14.178381] [INFO ] [MAIN ] NRDY: Generated 1807 derivative records from 32903 primary records. [2025-10-16T22:41:14.182709] [DEBUG] [LOCAL ] NREF: Derivative data saved (1807 records). [2025-10-16T22:41:14.179794] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-10-16T22:41:14.182874] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-10-16T22:41:14.186088] [INFO ] [MAIN ] Derivative Progress: 1240/1803 symbols completed. NREF took 1.1s. Estimated remaining: 3m 35s. Rate: 157.2 symbols/min [2025-10-16T22:41:14.187704] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:14.219208] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1807 records). [2025-10-16T22:41:14.219889] [DEBUG] [MAIN ] NRGV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:14.220722] [INFO ] [MAIN ] NRGV: Generated 1807 derivative records from 44137 primary records. [2025-10-16T22:41:14.220021] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-10-16T22:41:14.223423] [INFO ] [MAIN ] Derivative Progress: 1241/1803 symbols completed. NRDY took 1.1s. Estimated remaining: 3m 34s. Rate: 157.3 symbols/min [2025-10-16T22:41:14.223583] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:14.223768] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-10-16T22:41:14.227182] [DEBUG] [LOCAL ] NRP: Loaded 4218 existing records from primary storage. [2025-10-16T22:41:14.228065] [INFO ] [MAIN ] NRP: Loaded 4218 primary data records. [2025-10-16T22:41:14.280064] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1807 records). [2025-10-16T22:41:14.299139] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-10-16T22:41:14.324570] [DEBUG] [LOCAL ] NRT: Loaded 4958 existing records from primary storage. [2025-10-16T22:41:14.333444] [INFO ] [MAIN ] Derivative Progress: 1242/1803 symbols completed. NRGV took 1.2s. Estimated remaining: 3m 34s. Rate: 157.4 symbols/min [2025-10-16T22:41:14.344202] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:14.352134] [INFO ] [MAIN ] NRT: Loaded 4958 primary data records. [2025-10-16T22:41:14.673834] [DEBUG] [LOCAL ] NUV: Loaded 23972 existing records from primary storage. [2025-10-16T22:41:14.685132] [INFO ] [MAIN ] NUV: Loaded 23972 primary data records. [2025-10-16T22:41:15.175964] [DEBUG] [MAIN ] NRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:15.177531] [INFO ] [MAIN ] NRP: Generated 1807 derivative records from 4218 primary records. [2025-10-16T22:41:15.177735] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-10-16T22:41:15.192379] [DEBUG] [MAIN ] NRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:15.199157] [INFO ] [MAIN ] NRT: Generated 1807 derivative records from 4958 primary records. [2025-10-16T22:41:15.203105] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-10-16T22:41:15.207009] [DEBUG] [LOCAL ] NRP: Derivative data saved (1807 records). [2025-10-16T22:41:15.207839] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-10-16T22:41:15.216084] [INFO ] [MAIN ] Derivative Progress: 1243/1803 symbols completed. NRP took 1.0s. Estimated remaining: 3m 34s. Rate: 157.2 symbols/min [2025-10-16T22:41:15.224275] [DEBUG] [LOCAL ] NRT: Derivative data saved (1807 records). [2025-10-16T22:41:15.224341] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-10-16T22:41:15.227076] [INFO ] [MAIN ] Derivative Progress: 1244/1803 symbols completed. NRT took 1.0s. Estimated remaining: 3m 33s. Rate: 157.3 symbols/min [2025-10-16T22:41:15.241703] [DEBUG] [MAIN ] NUV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:15.242208] [INFO ] [MAIN ] NUV: Generated 1807 derivative records from 23972 primary records. [2025-10-16T22:41:15.242267] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-16T22:41:15.256949] [DEBUG] [LOCAL ] NUV: Derivative data saved (1807 records). [2025-10-16T22:41:15.257005] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-10-16T22:41:15.259808] [INFO ] [MAIN ] Derivative Progress: 1245/1803 symbols completed. NUV took 0.9s. Estimated remaining: 3m 33s. Rate: 157.4 symbols/min [2025-10-16T22:41:15.260216] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:15.260316] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:15.260572] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:15.270011] [DEBUG] [LOCAL ] NUW: Loaded 6785 existing records from primary storage. [2025-10-16T22:41:15.270263] [INFO ] [MAIN ] NUW: Loaded 6785 primary data records. [2025-10-16T22:41:15.386838] [DEBUG] [LOCAL ] NVR: Loaded 18674 existing records from primary storage. [2025-10-16T22:41:15.392691] [INFO ] [MAIN ] NVR: Loaded 18674 primary data records. [2025-10-16T22:41:15.831955] [DEBUG] [LOCAL ] NUVB: Loaded 51956 existing records from primary storage. [2025-10-16T22:41:15.832723] [INFO ] [MAIN ] NUVB: Loaded 51956 primary data records. [2025-10-16T22:41:16.278108] [DEBUG] [MAIN ] NUW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:16.279598] [INFO ] [MAIN ] NUW: Generated 1807 derivative records from 6785 primary records. [2025-10-16T22:41:16.280051] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-10-16T22:41:16.304563] [DEBUG] [LOCAL ] NUW: Derivative data saved (1807 records). [2025-10-16T22:41:16.312592] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-10-16T22:41:16.320130] [INFO ] [MAIN ] Derivative Progress: 1246/1803 symbols completed. NUW took 1.1s. Estimated remaining: 3m 33s. Rate: 157.2 symbols/min [2025-10-16T22:41:16.320483] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:16.320841] [DEBUG] [MAIN ] NVR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:41:16.321812] [INFO ] [MAIN ] NVR: Generated 1806 derivative records from 18674 primary records. [2025-10-16T22:41:16.322731] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-10-16T22:41:16.340846] [DEBUG] [LOCAL ] NVR: Derivative data saved (1806 records). [2025-10-16T22:41:16.341725] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-10-16T22:41:16.345056] [INFO ] [MAIN ] Derivative Progress: 1247/1803 symbols completed. NVR took 1.1s. Estimated remaining: 3m 32s. Rate: 157.3 symbols/min [2025-10-16T22:41:16.348396] [DEBUG] [LOCAL ] NXC: Loaded 4147 existing records from primary storage. [2025-10-16T22:41:16.345275] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:16.348702] [INFO ] [MAIN ] NXC: Loaded 4147 primary data records. [2025-10-16T22:41:16.447390] [DEBUG] [MAIN ] NUVB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:16.453406] [INFO ] [MAIN ] NUVB: Generated 1807 derivative records from 51956 primary records. [2025-10-16T22:41:16.458694] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-10-16T22:41:16.503340] [DEBUG] [LOCAL ] NXDT: Loaded 15151 existing records from primary storage. [2025-10-16T22:41:16.512768] [INFO ] [MAIN ] NXDT: Loaded 15151 primary data records. [2025-10-16T22:41:16.615120] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1807 records). [2025-10-16T22:41:16.781042] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-10-16T22:41:16.800611] [INFO ] [MAIN ] Derivative Progress: 1248/1803 symbols completed. NUVB took 1.5s. Estimated remaining: 3m 32s. Rate: 157.3 symbols/min [2025-10-16T22:41:16.809959] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:17.053929] [DEBUG] [MAIN ] NXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:17.069450] [INFO ] [MAIN ] NXC: Generated 1807 derivative records from 4147 primary records. [2025-10-16T22:41:17.070056] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-16T22:41:17.071490] [DEBUG] [LOCAL ] NXE: Loaded 53434 existing records from primary storage. [2025-10-16T22:41:17.071596] [INFO ] [MAIN ] NXE: Loaded 53434 primary data records. [2025-10-16T22:41:17.203222] [DEBUG] [LOCAL ] NXC: Derivative data saved (1807 records). [2025-10-16T22:41:17.203901] [DEBUG] [MAIN ] NXDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:17.242275] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-10-16T22:41:17.260259] [INFO ] [MAIN ] NXDT: Generated 1807 derivative records from 15151 primary records. [2025-10-16T22:41:17.281419] [INFO ] [MAIN ] Derivative Progress: 1249/1803 symbols completed. NXC took 1.0s. Estimated remaining: 3m 31s. Rate: 157.3 symbols/min [2025-10-16T22:41:17.279147] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-10-16T22:41:17.432032] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:17.448839] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1807 records). [2025-10-16T22:41:17.449776] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-10-16T22:41:17.452731] [INFO ] [MAIN ] Derivative Progress: 1250/1803 symbols completed. NXDT took 1.1s. Estimated remaining: 3m 31s. Rate: 157.3 symbols/min [2025-10-16T22:41:17.453094] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:17.463188] [DEBUG] [LOCAL ] NXG: Loaded 10561 existing records from primary storage. [2025-10-16T22:41:17.463600] [INFO ] [MAIN ] NXG: Loaded 10561 primary data records. [2025-10-16T22:41:17.465724] [DEBUG] [LOCAL ] NXN: Loaded 2271 existing records from primary storage. [2025-10-16T22:41:17.471120] [INFO ] [MAIN ] NXN: Loaded 2271 primary data records. [2025-10-16T22:41:17.956050] [DEBUG] [MAIN ] NXE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:17.979884] [INFO ] [MAIN ] NXE: Generated 1807 derivative records from 53434 primary records. [2025-10-16T22:41:18.078026] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-10-16T22:41:18.106555] [DEBUG] [LOCAL ] NXE: Derivative data saved (1807 records). [2025-10-16T22:41:18.107818] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-10-16T22:41:18.110351] [INFO ] [MAIN ] Derivative Progress: 1251/1803 symbols completed. NXE took 1.3s. Estimated remaining: 3m 31s. Rate: 157.2 symbols/min [2025-10-16T22:41:18.110826] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:18.126369] [DEBUG] [LOCAL ] NXP: Loaded 12378 existing records from primary storage. [2025-10-16T22:41:18.129708] [INFO ] [MAIN ] NXP: Loaded 12378 primary data records. [2025-10-16T22:41:18.231800] [DEBUG] [MAIN ] NXN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:18.232254] [DEBUG] [MAIN ] NXG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:18.243937] [INFO ] [MAIN ] NXN: Generated 1807 derivative records from 2271 primary records. [2025-10-16T22:41:18.249630] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-16T22:41:18.243348] [INFO ] [MAIN ] NXG: Generated 1807 derivative records from 10561 primary records. [2025-10-16T22:41:18.260253] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-10-16T22:41:18.334359] [DEBUG] [LOCAL ] NXN: Derivative data saved (1807 records). [2025-10-16T22:41:18.340858] [DEBUG] [LOCAL ] NXG: Derivative data saved (1807 records). [2025-10-16T22:41:18.340074] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-10-16T22:41:18.372782] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-10-16T22:41:18.367496] [INFO ] [MAIN ] Derivative Progress: 1252/1803 symbols completed. NXN took 0.9s. Estimated remaining: 3m 30s. Rate: 157.3 symbols/min [2025-10-16T22:41:18.476211] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:18.481392] [INFO ] [MAIN ] Derivative Progress: 1253/1803 symbols completed. NXG took 1.0s. Estimated remaining: 3m 30s. Rate: 157.4 symbols/min [2025-10-16T22:41:18.490420] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:18.502529] [DEBUG] [LOCAL ] OCFT: Loaded 7370 existing records from primary storage. [2025-10-16T22:41:18.502955] [INFO ] [MAIN ] OCFT: Loaded 7370 primary data records. [2025-10-16T22:41:18.564398] [DEBUG] [LOCAL ] ODC: Loaded 8619 existing records from primary storage. [2025-10-16T22:41:18.590909] [INFO ] [MAIN ] ODC: Loaded 8619 primary data records. [2025-10-16T22:41:19.182501] [DEBUG] [MAIN ] NXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:19.184247] [INFO ] [MAIN ] NXP: Generated 1807 derivative records from 12378 primary records. [2025-10-16T22:41:19.184812] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-16T22:41:19.202344] [DEBUG] [LOCAL ] NXP: Derivative data saved (1807 records). [2025-10-16T22:41:19.202552] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-10-16T22:41:19.205056] [INFO ] [MAIN ] Derivative Progress: 1254/1803 symbols completed. NXP took 1.1s. Estimated remaining: 3m 29s. Rate: 157.3 symbols/min [2025-10-16T22:41:19.205387] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:19.238373] [DEBUG] [MAIN ] OCFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:19.251327] [INFO ] [MAIN ] OCFT: Generated 1807 derivative records from 7370 primary records. [2025-10-16T22:41:19.251705] [DEBUG] [MAIN ] ODC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:19.251830] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-10-16T22:41:19.253106] [INFO ] [MAIN ] ODC: Generated 1807 derivative records from 8619 primary records. [2025-10-16T22:41:19.253549] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-10-16T22:41:19.286868] [DEBUG] [LOCAL ] ODC: Derivative data saved (1807 records). [2025-10-16T22:41:19.287929] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-10-16T22:41:19.289119] [DEBUG] [LOCAL ] ODV: Loaded 29311 existing records from primary storage. [2025-10-16T22:41:19.292481] [INFO ] [MAIN ] Derivative Progress: 1255/1803 symbols completed. ODC took 0.8s. Estimated remaining: 3m 29s. Rate: 157.4 symbols/min [2025-10-16T22:41:19.292932] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:19.293318] [INFO ] [MAIN ] ODV: Loaded 29311 primary data records. [2025-10-16T22:41:19.316458] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1807 records). [2025-10-16T22:41:19.350681] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-10-16T22:41:19.385019] [INFO ] [MAIN ] Derivative Progress: 1256/1803 symbols completed. OCFT took 0.9s. Estimated remaining: 3m 28s. Rate: 157.5 symbols/min [2025-10-16T22:41:19.391239] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:19.625854] [DEBUG] [LOCAL ] OLP: Loaded 10204 existing records from primary storage. [2025-10-16T22:41:19.627442] [INFO ] [MAIN ] OLP: Loaded 10204 primary data records. [2025-10-16T22:41:19.693694] [DEBUG] [LOCAL ] OIS: Loaded 40306 existing records from primary storage. [2025-10-16T22:41:19.710974] [INFO ] [MAIN ] OIS: Loaded 40306 primary data records. [2025-10-16T22:41:20.250870] [DEBUG] [MAIN ] ODV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:20.251866] [INFO ] [MAIN ] ODV: Generated 1807 derivative records from 29311 primary records. [2025-10-16T22:41:20.251981] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-10-16T22:41:20.271469] [DEBUG] [LOCAL ] ODV: Derivative data saved (1807 records). [2025-10-16T22:41:20.271903] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-10-16T22:41:20.274296] [INFO ] [MAIN ] Derivative Progress: 1257/1803 symbols completed. ODV took 1.1s. Estimated remaining: 3m 28s. Rate: 157.3 symbols/min [2025-10-16T22:41:20.274603] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:20.292994] [DEBUG] [MAIN ] OLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:20.295792] [INFO ] [MAIN ] OLP: Generated 1807 derivative records from 10204 primary records. [2025-10-16T22:41:20.296013] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-10-16T22:41:20.316633] [DEBUG] [LOCAL ] ONIT: Loaded 7694 existing records from primary storage. [2025-10-16T22:41:20.317148] [INFO ] [MAIN ] ONIT: Loaded 7694 primary data records. [2025-10-16T22:41:20.316381] [DEBUG] [LOCAL ] OLP: Derivative data saved (1807 records). [2025-10-16T22:41:20.317329] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-10-16T22:41:20.331137] [INFO ] [MAIN ] Derivative Progress: 1258/1803 symbols completed. OLP took 0.9s. Estimated remaining: 3m 28s. Rate: 157.4 symbols/min [2025-10-16T22:41:20.448866] [DEBUG] [MAIN ] OIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:20.465176] [INFO ] [MAIN ] OIS: Generated 1807 derivative records from 40306 primary records. [2025-10-16T22:41:20.479827] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-10-16T22:41:20.664947] [DEBUG] [LOCAL ] OIS: Derivative data saved (1807 records). [2025-10-16T22:41:20.665516] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-10-16T22:41:20.668485] [INFO ] [MAIN ] Derivative Progress: 1259/1803 symbols completed. OIS took 1.4s. Estimated remaining: 3m 27s. Rate: 157.4 symbols/min [2025-10-16T22:41:20.687482] [DEBUG] [MAIN ] ONIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:20.688076] [INFO ] [MAIN ] ONIT: Generated 1807 derivative records from 7694 primary records. [2025-10-16T22:41:20.688137] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-10-16T22:41:20.703442] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1807 records). [2025-10-16T22:41:20.703504] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-10-16T22:41:20.706007] [INFO ] [MAIN ] Derivative Progress: 1260/1803 symbols completed. ONIT took 0.4s. Estimated remaining: 3m 27s. Rate: 157.5 symbols/min [2025-10-16T22:41:20.706387] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:20.706492] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:20.706602] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:20.742510] [DEBUG] [LOCAL ] OPAD: Loaded 25408 existing records from primary storage. [2025-10-16T22:41:20.742867] [DEBUG] [LOCAL ] ONTF: Loaded 22800 existing records from primary storage. [2025-10-16T22:41:20.749501] [INFO ] [MAIN ] ONTF: Loaded 22800 primary data records. [2025-10-16T22:41:20.749598] [INFO ] [MAIN ] OPAD: Loaded 25408 primary data records. [2025-10-16T22:41:20.965895] [DEBUG] [LOCAL ] ONL: Loaded 29741 existing records from primary storage. [2025-10-16T22:41:20.971559] [INFO ] [MAIN ] ONL: Loaded 29741 primary data records. [2025-10-16T22:41:21.736843] [DEBUG] [MAIN ] OPAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:21.737379] [DEBUG] [MAIN ] ONTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:21.738231] [INFO ] [MAIN ] OPAD: Generated 1807 derivative records from 25408 primary records. [2025-10-16T22:41:21.738334] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-10-16T22:41:21.739007] [INFO ] [MAIN ] ONTF: Generated 1807 derivative records from 22800 primary records. [2025-10-16T22:41:21.739670] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-10-16T22:41:21.768903] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1807 records). [2025-10-16T22:41:21.770369] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-10-16T22:41:21.773453] [INFO ] [MAIN ] Derivative Progress: 1261/1803 symbols completed. ONTF took 1.1s. Estimated remaining: 3m 27s. Rate: 157.3 symbols/min [2025-10-16T22:41:21.773888] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:21.788038] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1807 records). [2025-10-16T22:41:21.788495] [DEBUG] [MAIN ] ONL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:21.789537] [INFO ] [MAIN ] ONL: Generated 1807 derivative records from 29741 primary records. [2025-10-16T22:41:21.789686] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-10-16T22:41:21.789729] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-10-16T22:41:21.792205] [INFO ] [MAIN ] Derivative Progress: 1262/1803 symbols completed. OPAD took 1.1s. Estimated remaining: 3m 26s. Rate: 157.4 symbols/min [2025-10-16T22:41:21.793232] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:21.816679] [DEBUG] [LOCAL ] OPP: Loaded 12432 existing records from primary storage. [2025-10-16T22:41:21.817837] [INFO ] [MAIN ] OPP: Loaded 12432 primary data records. [2025-10-16T22:41:21.891135] [DEBUG] [LOCAL ] ONL: Derivative data saved (1807 records). [2025-10-16T22:41:21.913844] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-10-16T22:41:21.934497] [INFO ] [MAIN ] Derivative Progress: 1263/1803 symbols completed. ONL took 1.2s. Estimated remaining: 3m 26s. Rate: 157.5 symbols/min [2025-10-16T22:41:21.938251] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:22.190272] [DEBUG] [LOCAL ] ORC: Loaded 52895 existing records from primary storage. [2025-10-16T22:41:22.190563] [INFO ] [MAIN ] ORC: Loaded 52895 primary data records. [2025-10-16T22:41:22.310877] [DEBUG] [LOCAL ] ORN: Loaded 31147 existing records from primary storage. [2025-10-16T22:41:22.320911] [INFO ] [MAIN ] ORN: Loaded 31147 primary data records. [2025-10-16T22:41:22.834194] [DEBUG] [MAIN ] OPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:22.837211] [INFO ] [MAIN ] OPP: Generated 1807 derivative records from 12432 primary records. [2025-10-16T22:41:22.837454] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-16T22:41:22.854486] [DEBUG] [LOCAL ] OPP: Derivative data saved (1807 records). [2025-10-16T22:41:22.854846] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-10-16T22:41:22.857611] [INFO ] [MAIN ] Derivative Progress: 1264/1803 symbols completed. OPP took 1.1s. Estimated remaining: 3m 26s. Rate: 157.3 symbols/min [2025-10-16T22:41:22.861995] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:22.877823] [DEBUG] [MAIN ] ORC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:22.878872] [INFO ] [MAIN ] ORC: Generated 1807 derivative records from 52895 primary records. [2025-10-16T22:41:22.879061] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-10-16T22:41:22.899812] [DEBUG] [LOCAL ] ORC: Derivative data saved (1807 records). [2025-10-16T22:41:22.904952] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-10-16T22:41:22.905266] [DEBUG] [LOCAL ] OWLT: Loaded 9470 existing records from primary storage. [2025-10-16T22:41:22.906029] [INFO ] [MAIN ] OWLT: Loaded 9470 primary data records. [2025-10-16T22:41:22.908527] [INFO ] [MAIN ] Derivative Progress: 1265/1803 symbols completed. ORC took 1.1s. Estimated remaining: 3m 25s. Rate: 157.4 symbols/min [2025-10-16T22:41:22.945683] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:22.988540] [DEBUG] [MAIN ] ORN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:23.006426] [INFO ] [MAIN ] ORN: Generated 1807 derivative records from 31147 primary records. [2025-10-16T22:41:23.012207] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-10-16T22:41:23.300793] [DEBUG] [LOCAL ] PACK: Loaded 32206 existing records from primary storage. [2025-10-16T22:41:23.299493] [DEBUG] [LOCAL ] ORN: Derivative data saved (1807 records). [2025-10-16T22:41:23.301362] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-10-16T22:41:23.304464] [INFO ] [MAIN ] Derivative Progress: 1266/1803 symbols completed. ORN took 1.4s. Estimated remaining: 3m 25s. Rate: 157.4 symbols/min [2025-10-16T22:41:23.305203] [INFO ] [MAIN ] PACK: Loaded 32206 primary data records. [2025-10-16T22:41:23.305134] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:23.385192] [DEBUG] [LOCAL ] PAI: Loaded 2788 existing records from primary storage. [2025-10-16T22:41:23.395694] [INFO ] [MAIN ] PAI: Loaded 2788 primary data records. [2025-10-16T22:41:23.942677] [DEBUG] [MAIN ] OWLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:23.953943] [INFO ] [MAIN ] OWLT: Generated 1807 derivative records from 9470 primary records. [2025-10-16T22:41:23.954586] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-10-16T22:41:23.972551] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1807 records). [2025-10-16T22:41:23.973806] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-10-16T22:41:23.976303] [INFO ] [MAIN ] Derivative Progress: 1267/1803 symbols completed. OWLT took 1.1s. Estimated remaining: 3m 24s. Rate: 157.3 symbols/min [2025-10-16T22:41:23.976985] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:23.990223] [DEBUG] [LOCAL ] PCF: Loaded 9109 existing records from primary storage. [2025-10-16T22:41:23.990500] [INFO ] [MAIN ] PCF: Loaded 9109 primary data records. [2025-10-16T22:41:24.048112] [DEBUG] [MAIN ] PACK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:24.070439] [INFO ] [MAIN ] PACK: Generated 1807 derivative records from 32206 primary records. [2025-10-16T22:41:24.070626] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-10-16T22:41:24.175472] [DEBUG] [MAIN ] PAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:24.195341] [DEBUG] [LOCAL ] PACK: Derivative data saved (1807 records). [2025-10-16T22:41:24.185849] [INFO ] [MAIN ] PAI: Generated 1807 derivative records from 2788 primary records. [2025-10-16T22:41:24.195926] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-16T22:41:24.195510] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-10-16T22:41:24.215516] [INFO ] [MAIN ] Derivative Progress: 1268/1803 symbols completed. PACK took 1.3s. Estimated remaining: 3m 24s. Rate: 157.4 symbols/min [2025-10-16T22:41:24.338694] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:24.355030] [DEBUG] [LOCAL ] PAI: Derivative data saved (1807 records). [2025-10-16T22:41:24.356572] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-10-16T22:41:24.359710] [INFO ] [MAIN ] Derivative Progress: 1269/1803 symbols completed. PAI took 1.1s. Estimated remaining: 3m 24s. Rate: 157.4 symbols/min [2025-10-16T22:41:24.361957] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:24.367715] [DEBUG] [LOCAL ] PCM: Loaded 6846 existing records from primary storage. [2025-10-16T22:41:24.368637] [INFO ] [MAIN ] PCM: Loaded 6846 primary data records. [2025-10-16T22:41:24.456796] [DEBUG] [LOCAL ] PCQ: Loaded 12281 existing records from primary storage. [2025-10-16T22:41:24.478594] [INFO ] [MAIN ] PCQ: Loaded 12281 primary data records. [2025-10-16T22:41:24.789786] [DEBUG] [MAIN ] PCF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:24.796576] [INFO ] [MAIN ] PCF: Generated 1807 derivative records from 9109 primary records. [2025-10-16T22:41:24.802287] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-16T22:41:25.062406] [DEBUG] [LOCAL ] PCF: Derivative data saved (1807 records). [2025-10-16T22:41:25.063984] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-10-16T22:41:25.066570] [INFO ] [MAIN ] Derivative Progress: 1270/1803 symbols completed. PCF took 1.1s. Estimated remaining: 3m 23s. Rate: 157.3 symbols/min [2025-10-16T22:41:25.066744] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:25.098731] [DEBUG] [LOCAL ] PDS: Loaded 17319 existing records from primary storage. [2025-10-16T22:41:25.098287] [DEBUG] [MAIN ] PCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:25.099722] [INFO ] [MAIN ] PDS: Loaded 17319 primary data records. [2025-10-16T22:41:25.112774] [INFO ] [MAIN ] PCM: Generated 1807 derivative records from 6846 primary records. [2025-10-16T22:41:25.122278] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-16T22:41:25.200896] [DEBUG] [MAIN ] PCQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:25.229796] [INFO ] [MAIN ] PCQ: Generated 1807 derivative records from 12281 primary records. [2025-10-16T22:41:25.230906] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-16T22:41:25.287352] [DEBUG] [LOCAL ] PCM: Derivative data saved (1807 records). [2025-10-16T22:41:25.319891] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-10-16T22:41:25.325970] [INFO ] [MAIN ] Derivative Progress: 1271/1803 symbols completed. PCM took 1.0s. Estimated remaining: 3m 23s. Rate: 157.4 symbols/min [2025-10-16T22:41:25.330503] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:25.442146] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1807 records). [2025-10-16T22:41:25.442265] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-10-16T22:41:25.453615] [INFO ] [MAIN ] Derivative Progress: 1272/1803 symbols completed. PCQ took 1.1s. Estimated remaining: 3m 22s. Rate: 157.5 symbols/min [2025-10-16T22:41:25.454037] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:25.472404] [DEBUG] [LOCAL ] PEO: Loaded 11228 existing records from primary storage. [2025-10-16T22:41:25.472605] [INFO ] [MAIN ] PEO: Loaded 11228 primary data records. [2025-10-16T22:41:25.563729] [DEBUG] [LOCAL ] PDT: Loaded 17679 existing records from primary storage. [2025-10-16T22:41:25.569255] [INFO ] [MAIN ] PDT: Loaded 17679 primary data records. [2025-10-16T22:41:25.945340] [DEBUG] [MAIN ] PDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:25.980209] [INFO ] [MAIN ] PDS: Generated 1807 derivative records from 17319 primary records. [2025-10-16T22:41:25.982751] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-10-16T22:41:26.120408] [DEBUG] [LOCAL ] PDS: Derivative data saved (1807 records). [2025-10-16T22:41:26.120595] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-10-16T22:41:26.123227] [INFO ] [MAIN ] Derivative Progress: 1273/1803 symbols completed. PDS took 1.1s. Estimated remaining: 3m 22s. Rate: 157.4 symbols/min [2025-10-16T22:41:26.147816] [DEBUG] [MAIN ] PEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:26.148738] [INFO ] [MAIN ] PEO: Generated 1807 derivative records from 11228 primary records. [2025-10-16T22:41:26.148941] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-10-16T22:41:26.179095] [DEBUG] [LOCAL ] PEO: Derivative data saved (1807 records). [2025-10-16T22:41:26.178864] [DEBUG] [MAIN ] PDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:26.179280] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-10-16T22:41:26.179979] [INFO ] [MAIN ] PDT: Generated 1807 derivative records from 17679 primary records. [2025-10-16T22:41:26.182801] [INFO ] [MAIN ] Derivative Progress: 1274/1803 symbols completed. PEO took 0.7s. Estimated remaining: 3m 22s. Rate: 157.5 symbols/min [2025-10-16T22:41:26.182915] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-16T22:41:26.198545] [DEBUG] [LOCAL ] PDT: Derivative data saved (1807 records). [2025-10-16T22:41:26.198605] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-10-16T22:41:26.201203] [INFO ] [MAIN ] Derivative Progress: 1275/1803 symbols completed. PDT took 0.9s. Estimated remaining: 3m 21s. Rate: 157.6 symbols/min [2025-10-16T22:41:26.201674] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:26.201787] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:26.201953] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:26.213818] [DEBUG] [LOCAL ] PFD: Loaded 5434 existing records from primary storage. [2025-10-16T22:41:26.214126] [INFO ] [MAIN ] PFD: Loaded 5434 primary data records. [2025-10-16T22:41:26.287954] [DEBUG] [LOCAL ] PERF: Loaded 14465 existing records from primary storage. [2025-10-16T22:41:26.310129] [INFO ] [MAIN ] PERF: Loaded 14465 primary data records. [2025-10-16T22:41:26.321183] [DEBUG] [LOCAL ] PFL: Loaded 14464 existing records from primary storage. [2025-10-16T22:41:26.446927] [INFO ] [MAIN ] PFL: Loaded 14464 primary data records. [2025-10-16T22:41:27.192469] [DEBUG] [MAIN ] PFD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:27.193797] [INFO ] [MAIN ] PFD: Generated 1807 derivative records from 5434 primary records. [2025-10-16T22:41:27.194023] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-10-16T22:41:27.226405] [DEBUG] [LOCAL ] PFD: Derivative data saved (1807 records). [2025-10-16T22:41:27.226629] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-10-16T22:41:27.225891] [DEBUG] [MAIN ] PERF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:27.227705] [INFO ] [MAIN ] PERF: Generated 1807 derivative records from 14465 primary records. [2025-10-16T22:41:27.230548] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-10-16T22:41:27.230337] [INFO ] [MAIN ] Derivative Progress: 1276/1803 symbols completed. PFD took 1.0s. Estimated remaining: 3m 21s. Rate: 157.4 symbols/min [2025-10-16T22:41:27.230890] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:27.261681] [DEBUG] [MAIN ] PFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:27.261858] [DEBUG] [LOCAL ] PERF: Derivative data saved (1807 records). [2025-10-16T22:41:27.262532] [INFO ] [MAIN ] PFL: Generated 1807 derivative records from 14464 primary records. [2025-10-16T22:41:27.261940] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-10-16T22:41:27.265351] [INFO ] [MAIN ] Derivative Progress: 1277/1803 symbols completed. PERF took 1.1s. Estimated remaining: 3m 20s. Rate: 157.5 symbols/min [2025-10-16T22:41:27.265754] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-16T22:41:27.265593] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:27.295832] [DEBUG] [LOCAL ] PFL: Derivative data saved (1807 records). [2025-10-16T22:41:27.296359] [DEBUG] [LOCAL ] PFN: Loaded 22569 existing records from primary storage. [2025-10-16T22:41:27.296555] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-10-16T22:41:27.296685] [INFO ] [MAIN ] PFN: Loaded 22569 primary data records. [2025-10-16T22:41:27.299514] [INFO ] [MAIN ] Derivative Progress: 1278/1803 symbols completed. PFL took 1.1s. Estimated remaining: 3m 20s. Rate: 157.6 symbols/min [2025-10-16T22:41:27.302979] [DEBUG] [LOCAL ] PFO: Loaded 6121 existing records from primary storage. [2025-10-16T22:41:27.303222] [INFO ] [MAIN ] PFO: Loaded 6121 primary data records. [2025-10-16T22:41:27.302746] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:27.507974] [DEBUG] [LOCAL ] PGP: Loaded 5735 existing records from primary storage. [2025-10-16T22:41:27.525253] [INFO ] [MAIN ] PGP: Loaded 5735 primary data records. [2025-10-16T22:41:28.243230] [DEBUG] [MAIN ] PFN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:28.256292] [INFO ] [MAIN ] PFN: Generated 1807 derivative records from 22569 primary records. [2025-10-16T22:41:28.256576] [DEBUG] [MAIN ] PFO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:28.256714] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-16T22:41:28.257525] [INFO ] [MAIN ] PFO: Generated 1807 derivative records from 6121 primary records. [2025-10-16T22:41:28.258342] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-16T22:41:28.289202] [DEBUG] [LOCAL ] PFO: Derivative data saved (1807 records). [2025-10-16T22:41:28.290420] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-10-16T22:41:28.294119] [INFO ] [MAIN ] Derivative Progress: 1279/1803 symbols completed. PFO took 1.0s. Estimated remaining: 3m 20s. Rate: 157.4 symbols/min [2025-10-16T22:41:28.294284] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:28.301899] [DEBUG] [LOCAL ] PFN: Derivative data saved (1807 records). [2025-10-16T22:41:28.302381] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-10-16T22:41:28.309936] [INFO ] [MAIN ] Derivative Progress: 1280/1803 symbols completed. PFN took 1.1s. Estimated remaining: 3m 19s. Rate: 157.5 symbols/min [2025-10-16T22:41:28.310449] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:28.310890] [DEBUG] [MAIN ] PGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:28.311684] [INFO ] [MAIN ] PGP: Generated 1807 derivative records from 5735 primary records. [2025-10-16T22:41:28.311800] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-16T22:41:28.327170] [DEBUG] [LOCAL ] PGP: Derivative data saved (1807 records). [2025-10-16T22:41:28.327371] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-10-16T22:41:28.331035] [INFO ] [MAIN ] Derivative Progress: 1281/1803 symbols completed. PGP took 1.0s. Estimated remaining: 3m 19s. Rate: 157.6 symbols/min [2025-10-16T22:41:28.331278] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:28.335612] [DEBUG] [LOCAL ] PGZ: Loaded 5570 existing records from primary storage. [2025-10-16T22:41:28.335847] [INFO ] [MAIN ] PGZ: Loaded 5570 primary data records. [2025-10-16T22:41:28.457425] [DEBUG] [LOCAL ] PHI: Loaded 15302 existing records from primary storage. [2025-10-16T22:41:28.458023] [INFO ] [MAIN ] PHI: Loaded 15302 primary data records. [2025-10-16T22:41:28.560627] [DEBUG] [LOCAL ] PGRE: Loaded 47344 existing records from primary storage. [2025-10-16T22:41:28.619423] [INFO ] [MAIN ] PGRE: Loaded 47344 primary data records. [2025-10-16T22:41:29.308533] [DEBUG] [MAIN ] PGZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:29.309634] [INFO ] [MAIN ] PGZ: Generated 1807 derivative records from 5570 primary records. [2025-10-16T22:41:29.309760] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-16T22:41:29.340978] [DEBUG] [MAIN ] PHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:29.342476] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1807 records). [2025-10-16T22:41:29.343589] [INFO ] [MAIN ] PHI: Generated 1807 derivative records from 15302 primary records. [2025-10-16T22:41:29.343893] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-10-16T22:41:29.343804] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-10-16T22:41:29.346314] [INFO ] [MAIN ] Derivative Progress: 1282/1803 symbols completed. PGZ took 1.0s. Estimated remaining: 3m 19s. Rate: 157.4 symbols/min [2025-10-16T22:41:29.347414] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:29.376910] [DEBUG] [MAIN ] PGRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:29.378843] [INFO ] [MAIN ] PGRE: Generated 1807 derivative records from 47344 primary records. [2025-10-16T22:41:29.379682] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-10-16T22:41:29.380105] [DEBUG] [LOCAL ] PHI: Derivative data saved (1807 records). [2025-10-16T22:41:29.380679] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-10-16T22:41:29.383405] [INFO ] [MAIN ] Derivative Progress: 1283/1803 symbols completed. PHI took 1.1s. Estimated remaining: 3m 18s. Rate: 157.5 symbols/min [2025-10-16T22:41:29.384138] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:29.416359] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1807 records). [2025-10-16T22:41:29.416866] [DEBUG] [LOCAL ] PHK: Loaded 26928 existing records from primary storage. [2025-10-16T22:41:29.417004] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-10-16T22:41:29.419994] [INFO ] [MAIN ] Derivative Progress: 1284/1803 symbols completed. PGRE took 1.1s. Estimated remaining: 3m 18s. Rate: 157.7 symbols/min [2025-10-16T22:41:29.417059] [INFO ] [MAIN ] PHK: Loaded 26928 primary data records. [2025-10-16T22:41:29.423257] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:29.422986] [DEBUG] [LOCAL ] PIM: Loaded 4868 existing records from primary storage. [2025-10-16T22:41:29.459592] [INFO ] [MAIN ] PIM: Loaded 4868 primary data records. [2025-10-16T22:41:29.734311] [DEBUG] [LOCAL ] PINE: Loaded 14493 existing records from primary storage. [2025-10-16T22:41:29.744828] [INFO ] [MAIN ] PINE: Loaded 14493 primary data records. [2025-10-16T22:41:30.402864] [DEBUG] [MAIN ] PHK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:30.404839] [INFO ] [MAIN ] PHK: Generated 1807 derivative records from 26928 primary records. [2025-10-16T22:41:30.405303] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-10-16T22:41:30.427952] [DEBUG] [MAIN ] PIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:30.429143] [INFO ] [MAIN ] PIM: Generated 1807 derivative records from 4868 primary records. [2025-10-16T22:41:30.429224] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-16T22:41:30.454234] [DEBUG] [LOCAL ] PHK: Derivative data saved (1807 records). [2025-10-16T22:41:30.457143] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-10-16T22:41:30.468746] [INFO ] [MAIN ] Derivative Progress: 1285/1803 symbols completed. PHK took 1.1s. Estimated remaining: 3m 17s. Rate: 157.4 symbols/min [2025-10-16T22:41:30.475830] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:30.478849] [DEBUG] [LOCAL ] PIM: Derivative data saved (1807 records). [2025-10-16T22:41:30.479517] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-10-16T22:41:30.483115] [INFO ] [MAIN ] Derivative Progress: 1286/1803 symbols completed. PIM took 1.1s. Estimated remaining: 3m 17s. Rate: 157.6 symbols/min [2025-10-16T22:41:30.483357] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:30.479938] [DEBUG] [MAIN ] PINE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:30.484765] [INFO ] [MAIN ] PINE: Generated 1807 derivative records from 14493 primary records. [2025-10-16T22:41:30.485056] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-10-16T22:41:30.517602] [DEBUG] [LOCAL ] PKE: Loaded 14192 existing records from primary storage. [2025-10-16T22:41:30.518359] [INFO ] [MAIN ] PKE: Loaded 14192 primary data records. [2025-10-16T22:41:30.549324] [DEBUG] [LOCAL ] PINE: Derivative data saved (1807 records). [2025-10-16T22:41:30.587703] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-10-16T22:41:30.624258] [INFO ] [MAIN ] Derivative Progress: 1287/1803 symbols completed. PINE took 1.2s. Estimated remaining: 3m 16s. Rate: 157.6 symbols/min [2025-10-16T22:41:30.630430] [DEBUG] [LOCAL ] PML: Loaded 22039 existing records from primary storage. [2025-10-16T22:41:30.630591] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:30.630828] [INFO ] [MAIN ] PML: Loaded 22039 primary data records. [2025-10-16T22:41:30.869833] [DEBUG] [LOCAL ] PMM: Loaded 10272 existing records from primary storage. [2025-10-16T22:41:30.886002] [INFO ] [MAIN ] PMM: Loaded 10272 primary data records. [2025-10-16T22:41:31.584873] [DEBUG] [MAIN ] PKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:31.586257] [INFO ] [MAIN ] PKE: Generated 1807 derivative records from 14192 primary records. [2025-10-16T22:41:31.586512] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-10-16T22:41:31.608542] [DEBUG] [LOCAL ] PKE: Derivative data saved (1807 records). [2025-10-16T22:41:31.612400] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-10-16T22:41:31.615180] [INFO ] [MAIN ] Derivative Progress: 1288/1803 symbols completed. PKE took 1.1s. Estimated remaining: 3m 16s. Rate: 157.4 symbols/min [2025-10-16T22:41:31.629086] [DEBUG] [MAIN ] PML: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:31.642695] [INFO ] [MAIN ] PML: Generated 1807 derivative records from 22039 primary records. [2025-10-16T22:41:31.643126] [DEBUG] [MAIN ] PMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:31.643322] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-16T22:41:31.644571] [INFO ] [MAIN ] PMM: Generated 1807 derivative records from 10272 primary records. [2025-10-16T22:41:31.645017] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-16T22:41:31.675181] [DEBUG] [LOCAL ] PMM: Derivative data saved (1807 records). [2025-10-16T22:41:31.674406] [DEBUG] [LOCAL ] PML: Derivative data saved (1807 records). [2025-10-16T22:41:31.675451] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-10-16T22:41:31.675369] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-10-16T22:41:31.678424] [INFO ] [MAIN ] Derivative Progress: 1289/1803 symbols completed. PML took 1.2s. Estimated remaining: 3m 16s. Rate: 157.5 symbols/min [2025-10-16T22:41:31.681850] [INFO ] [MAIN ] Derivative Progress: 1290/1803 symbols completed. PMM took 1.1s. Estimated remaining: 3m 15s. Rate: 157.7 symbols/min [2025-10-16T22:41:31.682461] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:31.682291] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:31.682385] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:31.695838] [DEBUG] [LOCAL ] PNI: Loaded 6853 existing records from primary storage. [2025-10-16T22:41:31.700705] [INFO ] [MAIN ] PNI: Loaded 6853 primary data records. [2025-10-16T22:41:31.700793] [DEBUG] [LOCAL ] PMO: Loaded 9927 existing records from primary storage. [2025-10-16T22:41:31.753468] [INFO ] [MAIN ] PMO: Loaded 9927 primary data records. [2025-10-16T22:41:32.009899] [DEBUG] [LOCAL ] PNNT: Loaded 33703 existing records from primary storage. [2025-10-16T22:41:32.040506] [INFO ] [MAIN ] PNNT: Loaded 33703 primary data records. [2025-10-16T22:41:32.798119] [DEBUG] [MAIN ] PNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:32.799450] [INFO ] [MAIN ] PNI: Generated 1807 derivative records from 6853 primary records. [2025-10-16T22:41:32.799843] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-10-16T22:41:32.832931] [DEBUG] [LOCAL ] PNI: Derivative data saved (1807 records). [2025-10-16T22:41:32.833432] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-10-16T22:41:32.836177] [INFO ] [MAIN ] Derivative Progress: 1291/1803 symbols completed. PNI took 1.2s. Estimated remaining: 3m 15s. Rate: 157.4 symbols/min [2025-10-16T22:41:32.836466] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:32.836932] [DEBUG] [MAIN ] PMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:32.840207] [INFO ] [MAIN ] PMO: Generated 1807 derivative records from 9927 primary records. [2025-10-16T22:41:32.841147] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-16T22:41:32.865662] [DEBUG] [MAIN ] PNNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:32.868324] [INFO ] [MAIN ] PNNT: Generated 1807 derivative records from 33703 primary records. [2025-10-16T22:41:32.868725] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-10-16T22:41:32.887678] [DEBUG] [LOCAL ] PMO: Derivative data saved (1807 records). [2025-10-16T22:41:32.887894] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-10-16T22:41:32.891196] [INFO ] [MAIN ] Derivative Progress: 1292/1803 symbols completed. PMO took 1.2s. Estimated remaining: 3m 15s. Rate: 157.5 symbols/min [2025-10-16T22:41:32.892297] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:32.902570] [DEBUG] [LOCAL ] PPT: Loaded 19948 existing records from primary storage. [2025-10-16T22:41:32.903520] [INFO ] [MAIN ] PPT: Loaded 19948 primary data records. [2025-10-16T22:41:32.925249] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1807 records). [2025-10-16T22:41:32.949735] [DEBUG] [LOCAL ] PRCS: Loaded 2807 existing records from primary storage. [2025-10-16T22:41:32.949523] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-10-16T22:41:32.964713] [INFO ] [MAIN ] Derivative Progress: 1293/1803 symbols completed. PNNT took 1.3s. Estimated remaining: 3m 14s. Rate: 157.6 symbols/min [2025-10-16T22:41:32.978754] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:32.964834] [INFO ] [MAIN ] PRCS: Loaded 2807 primary data records. [2025-10-16T22:41:33.107281] [DEBUG] [LOCAL ] PRH: Loaded 4774 existing records from primary storage. [2025-10-16T22:41:33.122970] [INFO ] [MAIN ] PRH: Loaded 4774 primary data records. [2025-10-16T22:41:33.931780] [DEBUG] [MAIN ] PPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:33.933025] [INFO ] [MAIN ] PPT: Generated 1807 derivative records from 19948 primary records. [2025-10-16T22:41:33.933441] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-16T22:41:33.974502] [DEBUG] [LOCAL ] PPT: Derivative data saved (1807 records). [2025-10-16T22:41:33.975509] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-10-16T22:41:33.978126] [INFO ] [MAIN ] Derivative Progress: 1294/1803 symbols completed. PPT took 1.1s. Estimated remaining: 3m 14s. Rate: 157.4 symbols/min [2025-10-16T22:41:33.990461] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:33.975405] [DEBUG] [MAIN ] PRCS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:41:33.991942] [DEBUG] [MAIN ] PRH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:33.994351] [INFO ] [MAIN ] PRH: Generated 1807 derivative records from 4774 primary records. [2025-10-16T22:41:33.994540] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-10-16T22:41:33.993110] [INFO ] [MAIN ] PRCS: Generated 1806 derivative records from 2807 primary records. [2025-10-16T22:41:33.995083] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-16T22:41:34.023155] [DEBUG] [LOCAL ] PRT: Loaded 5190 existing records from primary storage. [2025-10-16T22:41:34.027729] [INFO ] [MAIN ] PRT: Loaded 5190 primary data records. [2025-10-16T22:41:34.029127] [DEBUG] [LOCAL ] PRH: Derivative data saved (1807 records). [2025-10-16T22:41:34.035588] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-10-16T22:41:34.046041] [INFO ] [MAIN ] Derivative Progress: 1295/1803 symbols completed. PRH took 1.1s. Estimated remaining: 3m 14s. Rate: 157.5 symbols/min [2025-10-16T22:41:34.056305] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:34.056156] [DEBUG] [LOCAL ] PRCS: Derivative data saved (1806 records). [2025-10-16T22:41:34.056985] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-10-16T22:41:34.071183] [INFO ] [MAIN ] Derivative Progress: 1296/1803 symbols completed. PRCS took 1.2s. Estimated remaining: 3m 13s. Rate: 157.6 symbols/min [2025-10-16T22:41:34.071469] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:34.162375] [DEBUG] [LOCAL ] PSBD: Loaded 8195 existing records from primary storage. [2025-10-16T22:41:34.201723] [INFO ] [MAIN ] PSBD: Loaded 8195 primary data records. [2025-10-16T22:41:34.178110] [DEBUG] [LOCAL ] PSF: Loaded 7022 existing records from primary storage. [2025-10-16T22:41:34.210418] [INFO ] [MAIN ] PSF: Loaded 7022 primary data records. [2025-10-16T22:41:35.047667] [DEBUG] [MAIN ] PRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:35.048526] [INFO ] [MAIN ] PRT: Generated 1807 derivative records from 5190 primary records. [2025-10-16T22:41:35.048911] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-10-16T22:41:35.068557] [DEBUG] [LOCAL ] PRT: Derivative data saved (1807 records). [2025-10-16T22:41:35.080757] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-10-16T22:41:35.088816] [DEBUG] [MAIN ] PSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:35.096308] [INFO ] [MAIN ] Derivative Progress: 1297/1803 symbols completed. PRT took 1.1s. Estimated remaining: 3m 13s. Rate: 157.4 symbols/min [2025-10-16T22:41:35.097222] [INFO ] [MAIN ] PSF: Generated 1807 derivative records from 7022 primary records. [2025-10-16T22:41:35.097727] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-16T22:41:35.097889] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:35.098282] [DEBUG] [MAIN ] PSBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:35.100420] [INFO ] [MAIN ] PSBD: Generated 1807 derivative records from 8195 primary records. [2025-10-16T22:41:35.100632] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-10-16T22:41:35.130053] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1807 records). [2025-10-16T22:41:35.131051] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-10-16T22:41:35.135593] [INFO ] [MAIN ] Derivative Progress: 1298/1803 symbols completed. PSBD took 1.1s. Estimated remaining: 3m 12s. Rate: 157.5 symbols/min [2025-10-16T22:41:35.146420] [DEBUG] [LOCAL ] PSF: Derivative data saved (1807 records). [2025-10-16T22:41:35.146259] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:35.147051] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-10-16T22:41:35.150266] [INFO ] [MAIN ] Derivative Progress: 1299/1803 symbols completed. PSF took 1.1s. Estimated remaining: 3m 12s. Rate: 157.6 symbols/min [2025-10-16T22:41:35.150756] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:35.157035] [DEBUG] [LOCAL ] PVL: Loaded 4738 existing records from primary storage. [2025-10-16T22:41:35.157234] [INFO ] [MAIN ] PVL: Loaded 4738 primary data records. [2025-10-16T22:41:35.254020] [DEBUG] [LOCAL ] PSQH: Loaded 35783 existing records from primary storage. [2025-10-16T22:41:35.273628] [INFO ] [MAIN ] PSQH: Loaded 35783 primary data records. [2025-10-16T22:41:35.501112] [DEBUG] [LOCAL ] QD: Loaded 27656 existing records from primary storage. [2025-10-16T22:41:35.621433] [INFO ] [MAIN ] QD: Loaded 27656 primary data records. [2025-10-16T22:41:36.155355] [DEBUG] [MAIN ] PVL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:36.156377] [INFO ] [MAIN ] PVL: Generated 1807 derivative records from 4738 primary records. [2025-10-16T22:41:36.156868] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-10-16T22:41:36.179191] [DEBUG] [LOCAL ] PVL: Derivative data saved (1807 records). [2025-10-16T22:41:36.192104] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-10-16T22:41:36.192373] [DEBUG] [MAIN ] PSQH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:36.195346] [INFO ] [MAIN ] Derivative Progress: 1300/1803 symbols completed. PVL took 1.0s. Estimated remaining: 3m 12s. Rate: 157.4 symbols/min [2025-10-16T22:41:36.196566] [INFO ] [MAIN ] PSQH: Generated 1807 derivative records from 35783 primary records. [2025-10-16T22:41:36.195807] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:36.196860] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-10-16T22:41:36.236047] [DEBUG] [MAIN ] QD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:36.236138] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1807 records). [2025-10-16T22:41:36.237094] [INFO ] [MAIN ] QD: Generated 1807 derivative records from 27656 primary records. [2025-10-16T22:41:36.237322] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-10-16T22:41:36.237250] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-10-16T22:41:36.240845] [INFO ] [MAIN ] Derivative Progress: 1301/1803 symbols completed. PSQH took 1.1s. Estimated remaining: 3m 11s. Rate: 157.5 symbols/min [2025-10-16T22:41:36.250204] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:36.266230] [DEBUG] [LOCAL ] QD: Derivative data saved (1807 records). [2025-10-16T22:41:36.265216] [DEBUG] [LOCAL ] QUAD: Loaded 23460 existing records from primary storage. [2025-10-16T22:41:36.266480] [INFO ] [MAIN ] QUAD: Loaded 23460 primary data records. [2025-10-16T22:41:36.266633] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-10-16T22:41:36.283010] [INFO ] [MAIN ] Derivative Progress: 1302/1803 symbols completed. QD took 1.1s. Estimated remaining: 3m 11s. Rate: 157.7 symbols/min [2025-10-16T22:41:36.301044] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:36.331848] [DEBUG] [LOCAL ] QVCD: Loaded 4721 existing records from primary storage. [2025-10-16T22:41:36.343471] [INFO ] [MAIN ] QVCD: Loaded 4721 primary data records. [2025-10-16T22:41:36.507704] [DEBUG] [LOCAL ] RBOT: Loaded 6150 existing records from primary storage. [2025-10-16T22:41:36.553850] [INFO ] [MAIN ] RBOT: Loaded 6150 primary data records. [2025-10-16T22:41:37.288153] [DEBUG] [MAIN ] QUAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:37.289495] [INFO ] [MAIN ] QUAD: Generated 1807 derivative records from 23460 primary records. [2025-10-16T22:41:37.289822] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-10-16T22:41:37.303620] [DEBUG] [MAIN ] QVCD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:37.312962] [INFO ] [MAIN ] QVCD: Generated 1807 derivative records from 4721 primary records. [2025-10-16T22:41:37.313063] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-10-16T22:41:37.337437] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1807 records). [2025-10-16T22:41:37.338366] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-10-16T22:41:37.341425] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1807 records). [2025-10-16T22:41:37.344290] [INFO ] [MAIN ] Derivative Progress: 1303/1803 symbols completed. QUAD took 1.1s. Estimated remaining: 3m 11s. Rate: 157.4 symbols/min [2025-10-16T22:41:37.344692] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-10-16T22:41:37.361018] [INFO ] [MAIN ] Derivative Progress: 1304/1803 symbols completed. QVCD took 1.1s. Estimated remaining: 3m 10s. Rate: 157.6 symbols/min [2025-10-16T22:41:37.361520] [DEBUG] [MAIN ] RBOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:37.362433] [INFO ] [MAIN ] RBOT: Generated 1807 derivative records from 6150 primary records. [2025-10-16T22:41:37.362500] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-10-16T22:41:37.376363] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1807 records). [2025-10-16T22:41:37.376431] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-10-16T22:41:37.379741] [INFO ] [MAIN ] Derivative Progress: 1305/1803 symbols completed. RBOT took 1.1s. Estimated remaining: 3m 10s. Rate: 157.7 symbols/min [2025-10-16T22:41:37.380202] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:37.380414] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:37.380335] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:37.399420] [DEBUG] [LOCAL ] RCS: Loaded 12406 existing records from primary storage. [2025-10-16T22:41:37.399935] [INFO ] [MAIN ] RCS: Loaded 12406 primary data records. [2025-10-16T22:41:37.551309] [DEBUG] [LOCAL ] RERE: Loaded 41810 existing records from primary storage. [2025-10-16T22:41:37.555730] [INFO ] [MAIN ] RERE: Loaded 41810 primary data records. [2025-10-16T22:41:37.735267] [DEBUG] [LOCAL ] RC: Loaded 49268 existing records from primary storage. [2025-10-16T22:41:37.844386] [INFO ] [MAIN ] RC: Loaded 49268 primary data records. [2025-10-16T22:41:38.408526] [DEBUG] [MAIN ] RCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:38.409576] [INFO ] [MAIN ] RCS: Generated 1807 derivative records from 12406 primary records. [2025-10-16T22:41:38.409832] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-16T22:41:38.443060] [DEBUG] [LOCAL ] RCS: Derivative data saved (1807 records). [2025-10-16T22:41:38.443193] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-10-16T22:41:38.442577] [DEBUG] [MAIN ] RERE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:38.444174] [INFO ] [MAIN ] RERE: Generated 1807 derivative records from 41810 primary records. [2025-10-16T22:41:38.446937] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-10-16T22:41:38.446739] [INFO ] [MAIN ] Derivative Progress: 1306/1803 symbols completed. RCS took 1.1s. Estimated remaining: 3m 9s. Rate: 157.4 symbols/min [2025-10-16T22:41:38.447844] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:38.479537] [DEBUG] [MAIN ] RC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:38.480243] [DEBUG] [LOCAL ] RERE: Derivative data saved (1807 records). [2025-10-16T22:41:38.481141] [INFO ] [MAIN ] RC: Generated 1807 derivative records from 49268 primary records. [2025-10-16T22:41:38.481405] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-10-16T22:41:38.481260] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-10-16T22:41:38.484500] [INFO ] [MAIN ] Derivative Progress: 1307/1803 symbols completed. RERE took 1.1s. Estimated remaining: 3m 9s. Rate: 157.6 symbols/min [2025-10-16T22:41:38.485354] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:38.501024] [DEBUG] [LOCAL ] RC: Derivative data saved (1807 records). [2025-10-16T22:41:38.501219] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-10-16T22:41:38.504173] [INFO ] [MAIN ] Derivative Progress: 1308/1803 symbols completed. RC took 1.1s. Estimated remaining: 3m 8s. Rate: 157.7 symbols/min [2025-10-16T22:41:38.516068] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:38.522579] [DEBUG] [LOCAL ] RFI: Loaded 10479 existing records from primary storage. [2025-10-16T22:41:38.522791] [INFO ] [MAIN ] RFI: Loaded 10479 primary data records. [2025-10-16T22:41:38.642585] [DEBUG] [LOCAL ] RES: Loaded 47297 existing records from primary storage. [2025-10-16T22:41:38.646284] [INFO ] [MAIN ] RES: Loaded 47297 primary data records. [2025-10-16T22:41:38.680007] [DEBUG] [LOCAL ] RFL: Loaded 11494 existing records from primary storage. [2025-10-16T22:41:38.701025] [INFO ] [MAIN ] RFL: Loaded 11494 primary data records. [2025-10-16T22:41:39.526423] [DEBUG] [MAIN ] RFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:39.527501] [INFO ] [MAIN ] RFI: Generated 1807 derivative records from 10479 primary records. [2025-10-16T22:41:39.528074] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-16T22:41:39.559241] [DEBUG] [LOCAL ] RFI: Derivative data saved (1807 records). [2025-10-16T22:41:39.563615] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-10-16T22:41:39.566518] [INFO ] [MAIN ] Derivative Progress: 1309/1803 symbols completed. RFI took 1.1s. Estimated remaining: 3m 8s. Rate: 157.5 symbols/min [2025-10-16T22:41:39.567349] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:39.567190] [DEBUG] [MAIN ] RES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:39.581631] [INFO ] [MAIN ] RES: Generated 1807 derivative records from 47297 primary records. [2025-10-16T22:41:39.583328] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-10-16T22:41:39.583173] [DEBUG] [MAIN ] RFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:39.596333] [INFO ] [MAIN ] RFL: Generated 1807 derivative records from 11494 primary records. [2025-10-16T22:41:39.594163] [DEBUG] [LOCAL ] RFM: Loaded 4179 existing records from primary storage. [2025-10-16T22:41:39.599384] [INFO ] [MAIN ] RFM: Loaded 4179 primary data records. [2025-10-16T22:41:39.611520] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-10-16T22:41:39.730116] [DEBUG] [LOCAL ] RES: Derivative data saved (1807 records). [2025-10-16T22:41:39.730527] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-10-16T22:41:39.744171] [INFO ] [MAIN ] Derivative Progress: 1310/1803 symbols completed. RES took 1.3s. Estimated remaining: 3m 8s. Rate: 157.5 symbols/min [2025-10-16T22:41:39.744254] [DEBUG] [LOCAL ] RFL: Derivative data saved (1807 records). [2025-10-16T22:41:39.744514] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:39.744737] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-10-16T22:41:39.753132] [INFO ] [MAIN ] Derivative Progress: 1311/1803 symbols completed. RFL took 1.2s. Estimated remaining: 3m 7s. Rate: 157.6 symbols/min [2025-10-16T22:41:39.753286] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:39.925082] [DEBUG] [LOCAL ] RGT: Loaded 2778 existing records from primary storage. [2025-10-16T22:41:39.925739] [INFO ] [MAIN ] RGT: Loaded 2778 primary data records. [2025-10-16T22:41:39.941920] [DEBUG] [LOCAL ] RFMZ: Loaded 8815 existing records from primary storage. [2025-10-16T22:41:39.951845] [INFO ] [MAIN ] RFMZ: Loaded 8815 primary data records. [2025-10-16T22:41:40.607500] [DEBUG] [MAIN ] RFM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:40.609074] [INFO ] [MAIN ] RFM: Generated 1807 derivative records from 4179 primary records. [2025-10-16T22:41:40.609258] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-10-16T22:41:40.627132] [DEBUG] [LOCAL ] RFM: Derivative data saved (1807 records). [2025-10-16T22:41:40.627518] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-10-16T22:41:40.629839] [INFO ] [MAIN ] Derivative Progress: 1312/1803 symbols completed. RFM took 1.1s. Estimated remaining: 3m 7s. Rate: 157.5 symbols/min [2025-10-16T22:41:40.630123] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:40.663877] [DEBUG] [MAIN ] RGT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:41:40.664157] [DEBUG] [MAIN ] RFMZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:40.665564] [INFO ] [MAIN ] RGT: Generated 1806 derivative records from 2778 primary records. [2025-10-16T22:41:40.665734] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-16T22:41:40.664974] [INFO ] [MAIN ] RFMZ: Generated 1807 derivative records from 8815 primary records. [2025-10-16T22:41:40.666384] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-10-16T22:41:40.707965] [DEBUG] [LOCAL ] RGT: Derivative data saved (1806 records). [2025-10-16T22:41:40.708868] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-10-16T22:41:40.711755] [INFO ] [MAIN ] Derivative Progress: 1313/1803 symbols completed. RGT took 1.0s. Estimated remaining: 3m 7s. Rate: 157.6 symbols/min [2025-10-16T22:41:40.712235] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:40.715105] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1807 records). [2025-10-16T22:41:40.715206] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-10-16T22:41:40.718589] [INFO ] [MAIN ] Derivative Progress: 1314/1803 symbols completed. RFMZ took 1.0s. Estimated remaining: 3m 6s. Rate: 157.7 symbols/min [2025-10-16T22:41:40.719576] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:40.740125] [DEBUG] [LOCAL ] RIG: Loaded 54065 existing records from primary storage. [2025-10-16T22:41:40.740457] [INFO ] [MAIN ] RIG: Loaded 54065 primary data records. [2025-10-16T22:41:40.782856] [DEBUG] [LOCAL ] RLTY: Loaded 11237 existing records from primary storage. [2025-10-16T22:41:40.816511] [INFO ] [MAIN ] RLTY: Loaded 11237 primary data records. [2025-10-16T22:41:41.399395] [DEBUG] [LOCAL ] RLX: Loaded 48456 existing records from primary storage. [2025-10-16T22:41:41.399695] [INFO ] [MAIN ] RLX: Loaded 48456 primary data records. [2025-10-16T22:41:41.754893] [DEBUG] [MAIN ] RIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:41.764253] [INFO ] [MAIN ] RIG: Generated 1807 derivative records from 54065 primary records. [2025-10-16T22:41:41.765679] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-10-16T22:41:41.795912] [DEBUG] [MAIN ] RLTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:41.798004] [INFO ] [MAIN ] RLTY: Generated 1807 derivative records from 11237 primary records. [2025-10-16T22:41:41.798608] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-10-16T22:41:41.812152] [DEBUG] [LOCAL ] RIG: Derivative data saved (1807 records). [2025-10-16T22:41:41.812296] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-10-16T22:41:41.816027] [INFO ] [MAIN ] Derivative Progress: 1315/1803 symbols completed. RIG took 1.2s. Estimated remaining: 3m 6s. Rate: 157.5 symbols/min [2025-10-16T22:41:41.819303] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:41.822368] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1807 records). [2025-10-16T22:41:41.822490] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-10-16T22:41:41.825215] [INFO ] [MAIN ] Derivative Progress: 1316/1803 symbols completed. RLTY took 1.1s. Estimated remaining: 3m 5s. Rate: 157.6 symbols/min [2025-10-16T22:41:41.825554] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:41.834797] [DEBUG] [LOCAL ] RM: Loaded 7602 existing records from primary storage. [2025-10-16T22:41:41.835304] [INFO ] [MAIN ] RM: Loaded 7602 primary data records. [2025-10-16T22:41:41.849613] [DEBUG] [LOCAL ] RMMZ: Loaded 4814 existing records from primary storage. [2025-10-16T22:41:41.882622] [INFO ] [MAIN ] RMMZ: Loaded 4814 primary data records. [2025-10-16T22:41:42.034029] [DEBUG] [MAIN ] RLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:42.067193] [INFO ] [MAIN ] RLX: Generated 1807 derivative records from 48456 primary records. [2025-10-16T22:41:42.077555] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-10-16T22:41:42.512191] [DEBUG] [LOCAL ] RLX: Derivative data saved (1807 records). [2025-10-16T22:41:42.512738] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-10-16T22:41:42.515342] [INFO ] [MAIN ] Derivative Progress: 1317/1803 symbols completed. RLX took 1.8s. Estimated remaining: 3m 5s. Rate: 157.5 symbols/min [2025-10-16T22:41:42.515838] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:42.537301] [DEBUG] [LOCAL ] RMT: Loaded 17675 existing records from primary storage. [2025-10-16T22:41:42.538140] [INFO ] [MAIN ] RMT: Loaded 17675 primary data records. [2025-10-16T22:41:42.702677] [DEBUG] [MAIN ] RM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:42.733055] [INFO ] [MAIN ] RM: Generated 1807 derivative records from 7602 primary records. [2025-10-16T22:41:42.733431] [DEBUG] [MAIN ] RMMZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:42.755729] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-10-16T22:41:42.909517] [INFO ] [MAIN ] RMMZ: Generated 1807 derivative records from 4814 primary records. [2025-10-16T22:41:42.927585] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-10-16T22:41:42.957803] [DEBUG] [LOCAL ] RM: Derivative data saved (1807 records). [2025-10-16T22:41:42.958808] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-10-16T22:41:42.961587] [INFO ] [MAIN ] Derivative Progress: 1318/1803 symbols completed. RM took 1.1s. Estimated remaining: 3m 5s. Rate: 157.5 symbols/min [2025-10-16T22:41:42.967790] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1807 records). [2025-10-16T22:41:42.967927] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-10-16T22:41:42.970918] [INFO ] [MAIN ] Derivative Progress: 1319/1803 symbols completed. RMMZ took 1.1s. Estimated remaining: 3m 4s. Rate: 157.6 symbols/min [2025-10-16T22:41:42.990199] [DEBUG] [MAIN ] RMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:42.990854] [INFO ] [MAIN ] RMT: Generated 1807 derivative records from 17675 primary records. [2025-10-16T22:41:42.990919] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-16T22:41:43.006526] [DEBUG] [LOCAL ] RMT: Derivative data saved (1807 records). [2025-10-16T22:41:43.006627] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-10-16T22:41:43.009402] [INFO ] [MAIN ] Derivative Progress: 1320/1803 symbols completed. RMT took 0.5s. Estimated remaining: 3m 4s. Rate: 157.7 symbols/min [2025-10-16T22:41:43.010030] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:43.009947] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:43.010117] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:43.018101] [DEBUG] [LOCAL ] RSF: Loaded 4342 existing records from primary storage. [2025-10-16T22:41:43.018289] [INFO ] [MAIN ] RSF: Loaded 4342 primary data records. [2025-10-16T22:41:43.140969] [DEBUG] [LOCAL ] RNP: Loaded 16282 existing records from primary storage. [2025-10-16T22:41:43.145938] [INFO ] [MAIN ] RNP: Loaded 16282 primary data records. [2025-10-16T22:41:43.145855] [DEBUG] [LOCAL ] RPT: Loaded 19230 existing records from primary storage. [2025-10-16T22:41:43.158167] [INFO ] [MAIN ] RPT: Loaded 19230 primary data records. [2025-10-16T22:41:43.985859] [DEBUG] [MAIN ] RSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:43.987583] [INFO ] [MAIN ] RSF: Generated 1807 derivative records from 4342 primary records. [2025-10-16T22:41:43.987712] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-16T22:41:44.007105] [DEBUG] [LOCAL ] RSF: Derivative data saved (1807 records). [2025-10-16T22:41:44.007958] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-10-16T22:41:44.010456] [INFO ] [MAIN ] Derivative Progress: 1321/1803 symbols completed. RSF took 1.0s. Estimated remaining: 3m 4s. Rate: 157.5 symbols/min [2025-10-16T22:41:44.010614] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:44.028440] [DEBUG] [MAIN ] RPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:44.029432] [INFO ] [MAIN ] RPT: Generated 1807 derivative records from 19230 primary records. [2025-10-16T22:41:44.042146] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-10-16T22:41:44.042430] [DEBUG] [MAIN ] RNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:44.050931] [INFO ] [MAIN ] RNP: Generated 1807 derivative records from 16282 primary records. [2025-10-16T22:41:44.051063] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-16T22:41:44.089602] [DEBUG] [LOCAL ] RPT: Derivative data saved (1807 records). [2025-10-16T22:41:44.093172] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-10-16T22:41:44.097358] [INFO ] [MAIN ] Derivative Progress: 1322/1803 symbols completed. RPT took 1.1s. Estimated remaining: 3m 3s. Rate: 157.6 symbols/min [2025-10-16T22:41:44.094105] [DEBUG] [LOCAL ] RSKD: Loaded 33696 existing records from primary storage. [2025-10-16T22:41:44.097607] [INFO ] [MAIN ] RSKD: Loaded 33696 primary data records. [2025-10-16T22:41:44.097735] [DEBUG] [LOCAL ] RNP: Derivative data saved (1807 records). [2025-10-16T22:41:44.097900] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-10-16T22:41:44.101236] [INFO ] [MAIN ] Derivative Progress: 1323/1803 symbols completed. RNP took 1.1s. Estimated remaining: 3m 3s. Rate: 157.7 symbols/min [2025-10-16T22:41:44.101080] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:44.113301] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:44.228888] [DEBUG] [LOCAL ] RZC: Loaded 6691 existing records from primary storage. [2025-10-16T22:41:44.254772] [INFO ] [MAIN ] RZC: Loaded 6691 primary data records. [2025-10-16T22:41:44.538324] [DEBUG] [LOCAL ] RWT: Loaded 41041 existing records from primary storage. [2025-10-16T22:41:44.544945] [INFO ] [MAIN ] RWT: Loaded 41041 primary data records. [2025-10-16T22:41:45.125059] [DEBUG] [MAIN ] RSKD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:45.125902] [INFO ] [MAIN ] RSKD: Generated 1807 derivative records from 33696 primary records. [2025-10-16T22:41:45.126193] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-10-16T22:41:45.149489] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1807 records). [2025-10-16T22:41:45.151956] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-10-16T22:41:45.155416] [INFO ] [MAIN ] Derivative Progress: 1324/1803 symbols completed. RSKD took 1.1s. Estimated remaining: 3m 2s. Rate: 157.5 symbols/min [2025-10-16T22:41:45.155994] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:45.171138] [DEBUG] [MAIN ] RZC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:45.172108] [INFO ] [MAIN ] RZC: Generated 1807 derivative records from 6691 primary records. [2025-10-16T22:41:45.172453] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-16T22:41:45.188664] [DEBUG] [LOCAL ] RZC: Derivative data saved (1807 records). [2025-10-16T22:41:45.189136] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-16T22:41:45.191843] [INFO ] [MAIN ] Derivative Progress: 1325/1803 symbols completed. RZC took 1.1s. Estimated remaining: 3m 2s. Rate: 157.6 symbols/min [2025-10-16T22:41:45.192149] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:45.209174] [DEBUG] [MAIN ] RWT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:45.210056] [INFO ] [MAIN ] RWT: Generated 1807 derivative records from 41041 primary records. [2025-10-16T22:41:45.210341] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-10-16T22:41:45.226235] [DEBUG] [LOCAL ] RWT: Derivative data saved (1807 records). [2025-10-16T22:41:45.226381] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-10-16T22:41:45.229414] [INFO ] [MAIN ] Derivative Progress: 1326/1803 symbols completed. RWT took 1.1s. Estimated remaining: 3m 1s. Rate: 157.7 symbols/min [2025-10-16T22:41:45.229665] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:45.263789] [DEBUG] [LOCAL ] SABA: Loaded 9369 existing records from primary storage. [2025-10-16T22:41:45.264029] [INFO ] [MAIN ] SABA: Loaded 9369 primary data records. [2025-10-16T22:41:45.397456] [DEBUG] [LOCAL ] SA: Loaded 44726 existing records from primary storage. [2025-10-16T22:41:45.420234] [DEBUG] [LOCAL ] S: Loaded 53926 existing records from primary storage. [2025-10-16T22:41:45.415017] [INFO ] [MAIN ] SA: Loaded 44726 primary data records. [2025-10-16T22:41:45.438060] [INFO ] [MAIN ] S: Loaded 53926 primary data records. [2025-10-16T22:41:46.219267] [DEBUG] [MAIN ] SABA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:46.220735] [INFO ] [MAIN ] SABA: Generated 1807 derivative records from 9369 primary records. [2025-10-16T22:41:46.221352] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-16T22:41:46.240919] [DEBUG] [LOCAL ] SABA: Derivative data saved (1807 records). [2025-10-16T22:41:46.241464] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-16T22:41:46.243686] [INFO ] [MAIN ] Derivative Progress: 1327/1803 symbols completed. SABA took 1.0s. Estimated remaining: 3m 1s. Rate: 157.5 symbols/min [2025-10-16T22:41:46.243944] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:46.257978] [DEBUG] [MAIN ] S: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:46.259030] [INFO ] [MAIN ] S: Generated 1807 derivative records from 53926 primary records. [2025-10-16T22:41:46.261671] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-16T22:41:46.290677] [DEBUG] [MAIN ] SA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:46.291491] [DEBUG] [LOCAL ] S: Derivative data saved (1807 records). [2025-10-16T22:41:46.292265] [INFO ] [MAIN ] SA: Generated 1807 derivative records from 44726 primary records. [2025-10-16T22:41:46.292483] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-16T22:41:46.292623] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-16T22:41:46.295505] [INFO ] [MAIN ] Derivative Progress: 1328/1803 symbols completed. S took 1.1s. Estimated remaining: 3m 1s. Rate: 157.6 symbols/min [2025-10-16T22:41:46.296132] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:46.320786] [DEBUG] [LOCAL ] SA: Derivative data saved (1807 records). [2025-10-16T22:41:46.320919] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-16T22:41:46.323871] [INFO ] [MAIN ] Derivative Progress: 1329/1803 symbols completed. SA took 1.1s. Estimated remaining: 3m 0s. Rate: 157.7 symbols/min [2025-10-16T22:41:46.324265] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:46.340596] [DEBUG] [LOCAL ] SAFE: Loaded 30601 existing records from primary storage. [2025-10-16T22:41:46.340885] [INFO ] [MAIN ] SAFE: Loaded 30601 primary data records. [2025-10-16T22:41:46.433595] [DEBUG] [LOCAL ] SAH: Loaded 21345 existing records from primary storage. [2025-10-16T22:41:46.458253] [INFO ] [MAIN ] SAH: Loaded 21345 primary data records. [2025-10-16T22:41:46.479697] [DEBUG] [LOCAL ] SAM: Loaded 21519 existing records from primary storage. [2025-10-16T22:41:46.514983] [INFO ] [MAIN ] SAM: Loaded 21519 primary data records. [2025-10-16T22:41:47.335610] [DEBUG] [MAIN ] SAFE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:47.336875] [INFO ] [MAIN ] SAFE: Generated 1807 derivative records from 30601 primary records. [2025-10-16T22:41:47.338045] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-16T22:41:47.370994] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1807 records). [2025-10-16T22:41:47.380191] [DEBUG] [MAIN ] SAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:47.380379] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-16T22:41:47.389415] [INFO ] [MAIN ] Derivative Progress: 1330/1803 symbols completed. SAFE took 1.1s. Estimated remaining: 3m 0s. Rate: 157.5 symbols/min [2025-10-16T22:41:47.389750] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:47.391299] [INFO ] [MAIN ] SAM: Generated 1807 derivative records from 21519 primary records. [2025-10-16T22:41:47.391538] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-16T22:41:47.393012] [DEBUG] [MAIN ] SAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:47.401485] [INFO ] [MAIN ] SAH: Generated 1807 derivative records from 21345 primary records. [2025-10-16T22:41:47.409809] [DEBUG] [LOCAL ] SAM: Derivative data saved (1807 records). [2025-10-16T22:41:47.410168] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-16T22:41:47.410077] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-16T22:41:47.413126] [INFO ] [MAIN ] Derivative Progress: 1331/1803 symbols completed. SAM took 1.1s. Estimated remaining: 2m 60s. Rate: 157.6 symbols/min [2025-10-16T22:41:47.413327] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:47.439127] [DEBUG] [LOCAL ] SAH: Derivative data saved (1807 records). [2025-10-16T22:41:47.439426] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-16T22:41:47.442957] [INFO ] [MAIN ] Derivative Progress: 1332/1803 symbols completed. SAH took 1.1s. Estimated remaining: 2m 59s. Rate: 157.7 symbols/min [2025-10-16T22:41:47.443427] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:47.496490] [DEBUG] [LOCAL ] SAN: Loaded 53355 existing records from primary storage. [2025-10-16T22:41:47.496772] [INFO ] [MAIN ] SAN: Loaded 53355 primary data records. [2025-10-16T22:41:47.637767] [DEBUG] [LOCAL ] SAND: Loaded 52246 existing records from primary storage. [2025-10-16T22:41:47.639074] [INFO ] [MAIN ] SAND: Loaded 52246 primary data records. [2025-10-16T22:41:47.832288] [DEBUG] [LOCAL ] SAP: Loaded 50240 existing records from primary storage. [2025-10-16T22:41:47.943169] [INFO ] [MAIN ] SAP: Loaded 50240 primary data records. [2025-10-16T22:41:48.487577] [DEBUG] [MAIN ] SAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:48.488886] [INFO ] [MAIN ] SAN: Generated 1807 derivative records from 53355 primary records. [2025-10-16T22:41:48.489923] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-16T22:41:48.519217] [DEBUG] [MAIN ] SAND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:48.520321] [INFO ] [MAIN ] SAND: Generated 1807 derivative records from 52246 primary records. [2025-10-16T22:41:48.520605] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-10-16T22:41:48.534959] [DEBUG] [LOCAL ] SAN: Derivative data saved (1807 records). [2025-10-16T22:41:48.540952] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-16T22:41:48.548705] [INFO ] [MAIN ] Derivative Progress: 1333/1803 symbols completed. SAN took 1.2s. Estimated remaining: 2m 59s. Rate: 157.5 symbols/min [2025-10-16T22:41:48.551546] [DEBUG] [LOCAL ] SAND: Derivative data saved (1807 records). [2025-10-16T22:41:48.552619] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-10-16T22:41:48.557714] [INFO ] [MAIN ] Derivative Progress: 1334/1803 symbols completed. SAND took 1.1s. Estimated remaining: 2m 59s. Rate: 157.6 symbols/min [2025-10-16T22:41:48.570356] [DEBUG] [MAIN ] SAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:48.571031] [INFO ] [MAIN ] SAP: Generated 1807 derivative records from 50240 primary records. [2025-10-16T22:41:48.571094] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-16T22:41:48.586514] [DEBUG] [LOCAL ] SAP: Derivative data saved (1807 records). [2025-10-16T22:41:48.586575] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-16T22:41:48.589132] [INFO ] [MAIN ] Derivative Progress: 1335/1803 symbols completed. SAP took 1.1s. Estimated remaining: 2m 58s. Rate: 157.7 symbols/min [2025-10-16T22:41:48.589784] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:48.589726] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:48.589939] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:48.620739] [DEBUG] [LOCAL ] SAR: Loaded 17353 existing records from primary storage. [2025-10-16T22:41:48.620968] [INFO ] [MAIN ] SAR: Loaded 17353 primary data records. [2025-10-16T22:41:48.749815] [DEBUG] [LOCAL ] SB: Loaded 33128 existing records from primary storage. [2025-10-16T22:41:48.783858] [INFO ] [MAIN ] SB: Loaded 33128 primary data records. [2025-10-16T22:41:48.839101] [DEBUG] [LOCAL ] SARO: Loaded 48715 existing records from primary storage. [2025-10-16T22:41:48.920177] [INFO ] [MAIN ] SARO: Loaded 48715 primary data records. [2025-10-16T22:41:49.622888] [DEBUG] [MAIN ] SAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:49.623892] [INFO ] [MAIN ] SAR: Generated 1807 derivative records from 17353 primary records. [2025-10-16T22:41:49.623988] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-16T22:41:49.675945] [DEBUG] [LOCAL ] SAR: Derivative data saved (1807 records). [2025-10-16T22:41:49.676676] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-16T22:41:49.679045] [INFO ] [MAIN ] Derivative Progress: 1336/1803 symbols completed. SAR took 1.1s. Estimated remaining: 2m 58s. Rate: 157.5 symbols/min [2025-10-16T22:41:49.679275] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:49.679717] [DEBUG] [MAIN ] SARO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:49.676466] [DEBUG] [MAIN ] SB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:49.680938] [INFO ] [MAIN ] SARO: Generated 1807 derivative records from 48715 primary records. [2025-10-16T22:41:49.681682] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-16T22:41:49.681609] [INFO ] [MAIN ] SB: Generated 1807 derivative records from 33128 primary records. [2025-10-16T22:41:49.682787] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-16T22:41:49.709902] [DEBUG] [LOCAL ] SARO: Derivative data saved (1807 records). [2025-10-16T22:41:49.714248] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-16T22:41:49.714173] [DEBUG] [LOCAL ] SB: Derivative data saved (1807 records). [2025-10-16T22:41:49.714491] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-16T22:41:49.717629] [INFO ] [MAIN ] Derivative Progress: 1337/1803 symbols completed. SB took 1.1s. Estimated remaining: 2m 57s. Rate: 157.6 symbols/min [2025-10-16T22:41:49.720558] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:49.720626] [INFO ] [MAIN ] Derivative Progress: 1338/1803 symbols completed. SARO took 1.1s. Estimated remaining: 2m 57s. Rate: 157.7 symbols/min [2025-10-16T22:41:49.721345] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:49.733400] [DEBUG] [LOCAL ] SBI: Loaded 7626 existing records from primary storage. [2025-10-16T22:41:49.733674] [INFO ] [MAIN ] SBI: Loaded 7626 primary data records. [2025-10-16T22:41:49.787095] [DEBUG] [LOCAL ] SBR: Loaded 7854 existing records from primary storage. [2025-10-16T22:41:49.809587] [INFO ] [MAIN ] SBR: Loaded 7854 primary data records. [2025-10-16T22:41:49.930105] [DEBUG] [LOCAL ] SBH: Loaded 50242 existing records from primary storage. [2025-10-16T22:41:49.951410] [INFO ] [MAIN ] SBH: Loaded 50242 primary data records. [2025-10-16T22:41:50.754666] [DEBUG] [MAIN ] SBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:50.756927] [INFO ] [MAIN ] SBR: Generated 1807 derivative records from 7854 primary records. [2025-10-16T22:41:50.770234] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-16T22:41:50.772381] [DEBUG] [MAIN ] SBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:50.773809] [INFO ] [MAIN ] SBI: Generated 1807 derivative records from 7626 primary records. [2025-10-16T22:41:50.773937] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-16T22:41:50.816293] [DEBUG] [MAIN ] SBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:50.818380] [DEBUG] [LOCAL ] SBR: Derivative data saved (1807 records). [2025-10-16T22:41:50.819191] [INFO ] [MAIN ] SBH: Generated 1807 derivative records from 50242 primary records. [2025-10-16T22:41:50.817560] [DEBUG] [LOCAL ] SBI: Derivative data saved (1807 records). [2025-10-16T22:41:50.819339] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-16T22:41:50.819772] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-16T22:41:50.819432] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-16T22:41:50.822025] [INFO ] [MAIN ] Derivative Progress: 1339/1803 symbols completed. SBI took 1.1s. Estimated remaining: 2m 57s. Rate: 157.5 symbols/min [2025-10-16T22:41:50.825337] [INFO ] [MAIN ] Derivative Progress: 1340/1803 symbols completed. SBR took 1.1s. Estimated remaining: 2m 56s. Rate: 157.6 symbols/min [2025-10-16T22:41:50.825968] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:50.825239] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:50.845089] [DEBUG] [LOCAL ] SBH: Derivative data saved (1807 records). [2025-10-16T22:41:50.845308] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-16T22:41:50.848060] [INFO ] [MAIN ] Derivative Progress: 1341/1803 symbols completed. SBH took 1.2s. Estimated remaining: 2m 56s. Rate: 157.7 symbols/min [2025-10-16T22:41:50.848416] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:50.860421] [DEBUG] [LOCAL ] SBSI: Loaded 15054 existing records from primary storage. [2025-10-16T22:41:50.860589] [INFO ] [MAIN ] SBSI: Loaded 15054 primary data records. [2025-10-16T22:41:51.215141] [DEBUG] [LOCAL ] SBS: Loaded 49699 existing records from primary storage. [2025-10-16T22:41:51.215922] [INFO ] [MAIN ] SBS: Loaded 49699 primary data records. [2025-10-16T22:41:51.337794] [DEBUG] [LOCAL ] SBSW: Loaded 53562 existing records from primary storage. [2025-10-16T22:41:51.338025] [INFO ] [MAIN ] SBSW: Loaded 53562 primary data records. [2025-10-16T22:41:51.863039] [DEBUG] [MAIN ] SBSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:51.864554] [INFO ] [MAIN ] SBSI: Generated 1807 derivative records from 15054 primary records. [2025-10-16T22:41:51.865253] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-16T22:41:51.881784] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1807 records). [2025-10-16T22:41:51.881965] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-16T22:41:51.884759] [INFO ] [MAIN ] Derivative Progress: 1342/1803 symbols completed. SBSI took 1.1s. Estimated remaining: 2m 56s. Rate: 157.5 symbols/min [2025-10-16T22:41:51.885511] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:51.906392] [DEBUG] [MAIN ] SBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:51.907238] [INFO ] [MAIN ] SBS: Generated 1807 derivative records from 49699 primary records. [2025-10-16T22:41:51.907458] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-16T22:41:51.939804] [DEBUG] [LOCAL ] SBS: Derivative data saved (1807 records). [2025-10-16T22:41:51.940692] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-16T22:41:51.942879] [INFO ] [MAIN ] Derivative Progress: 1343/1803 symbols completed. SBS took 1.1s. Estimated remaining: 2m 55s. Rate: 157.6 symbols/min [2025-10-16T22:41:51.940599] [DEBUG] [MAIN ] SBSW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:51.943784] [INFO ] [MAIN ] SBSW: Generated 1807 derivative records from 53562 primary records. [2025-10-16T22:41:51.944000] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-16T22:41:51.944111] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:51.971968] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1807 records). [2025-10-16T22:41:51.972074] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-16T22:41:51.974748] [INFO ] [MAIN ] Derivative Progress: 1344/1803 symbols completed. SBSW took 1.1s. Estimated remaining: 2m 55s. Rate: 157.7 symbols/min [2025-10-16T22:41:51.977988] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:51.999319] [DEBUG] [LOCAL ] SCD: Loaded 13499 existing records from primary storage. [2025-10-16T22:41:51.999595] [INFO ] [MAIN ] SCD: Loaded 13499 primary data records. [2025-10-16T22:41:52.000333] [DEBUG] [LOCAL ] SCCO: Loaded 49968 existing records from primary storage. [2025-10-16T22:41:52.023375] [INFO ] [MAIN ] SCCO: Loaded 49968 primary data records. [2025-10-16T22:41:52.656623] [DEBUG] [LOCAL ] SCHW: Loaded 54075 existing records from primary storage. [2025-10-16T22:41:52.681093] [INFO ] [MAIN ] SCHW: Loaded 54075 primary data records. [2025-10-16T22:41:53.019434] [DEBUG] [MAIN ] SCD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:53.018785] [DEBUG] [MAIN ] SCCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:53.020322] [INFO ] [MAIN ] SCD: Generated 1807 derivative records from 13499 primary records. [2025-10-16T22:41:53.021349] [INFO ] [MAIN ] SCCO: Generated 1807 derivative records from 49968 primary records. [2025-10-16T22:41:53.021591] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-16T22:41:53.021698] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-16T22:41:53.047253] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1807 records). [2025-10-16T22:41:53.047626] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-16T22:41:53.050529] [INFO ] [MAIN ] Derivative Progress: 1345/1803 symbols completed. SCCO took 1.2s. Estimated remaining: 2m 54s. Rate: 157.5 symbols/min [2025-10-16T22:41:53.056386] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:53.057944] [DEBUG] [LOCAL ] SCD: Derivative data saved (1807 records). [2025-10-16T22:41:53.059127] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-16T22:41:53.062909] [INFO ] [MAIN ] Derivative Progress: 1346/1803 symbols completed. SCD took 1.1s. Estimated remaining: 2m 54s. Rate: 157.6 symbols/min [2025-10-16T22:41:53.063874] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:53.077534] [DEBUG] [MAIN ] SCHW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:53.078208] [INFO ] [MAIN ] SCHW: Generated 1807 derivative records from 54075 primary records. [2025-10-16T22:41:53.078560] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-16T22:41:53.099166] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1807 records). [2025-10-16T22:41:53.099297] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-16T22:41:53.101929] [INFO ] [MAIN ] Derivative Progress: 1347/1803 symbols completed. SCHW took 1.1s. Estimated remaining: 2m 53s. Rate: 157.7 symbols/min [2025-10-16T22:41:53.102231] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:53.108535] [DEBUG] [LOCAL ] SCL: Loaded 15067 existing records from primary storage. [2025-10-16T22:41:53.108700] [INFO ] [MAIN ] SCL: Loaded 15067 primary data records. [2025-10-16T22:41:53.322763] [DEBUG] [LOCAL ] SCM: Loaded 20377 existing records from primary storage. [2025-10-16T22:41:53.323815] [DEBUG] [LOCAL ] SCI: Loaded 46821 existing records from primary storage. [2025-10-16T22:41:53.423849] [INFO ] [MAIN ] SCM: Loaded 20377 primary data records. [2025-10-16T22:41:53.423739] [INFO ] [MAIN ] SCI: Loaded 46821 primary data records. [2025-10-16T22:41:54.070020] [DEBUG] [MAIN ] SCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:54.072088] [INFO ] [MAIN ] SCL: Generated 1807 derivative records from 15067 primary records. [2025-10-16T22:41:54.072475] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-16T22:41:54.089896] [DEBUG] [LOCAL ] SCL: Derivative data saved (1807 records). [2025-10-16T22:41:54.090141] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-16T22:41:54.092452] [INFO ] [MAIN ] Derivative Progress: 1348/1803 symbols completed. SCL took 1.0s. Estimated remaining: 2m 53s. Rate: 157.6 symbols/min [2025-10-16T22:41:54.110465] [DEBUG] [MAIN ] SCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:54.111338] [INFO ] [MAIN ] SCM: Generated 1807 derivative records from 20377 primary records. [2025-10-16T22:41:54.123321] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-16T22:41:54.123574] [DEBUG] [MAIN ] SCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:54.124750] [INFO ] [MAIN ] SCI: Generated 1807 derivative records from 46821 primary records. [2025-10-16T22:41:54.124979] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-16T22:41:54.154204] [DEBUG] [LOCAL ] SCI: Derivative data saved (1807 records). [2025-10-16T22:41:54.155312] [DEBUG] [LOCAL ] SCM: Derivative data saved (1807 records). [2025-10-16T22:41:54.155273] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-16T22:41:54.158690] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-16T22:41:54.158609] [INFO ] [MAIN ] Derivative Progress: 1349/1803 symbols completed. SCI took 1.1s. Estimated remaining: 2m 53s. Rate: 157.7 symbols/min [2025-10-16T22:41:54.162045] [INFO ] [MAIN ] Derivative Progress: 1350/1803 symbols completed. SCM took 1.1s. Estimated remaining: 2m 52s. Rate: 157.8 symbols/min [2025-10-16T22:41:54.162505] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:54.162586] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:54.163318] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:54.176302] [DEBUG] [LOCAL ] SDHC: Loaded 10427 existing records from primary storage. [2025-10-16T22:41:54.176534] [INFO ] [MAIN ] SDHC: Loaded 10427 primary data records. [2025-10-16T22:41:54.410176] [DEBUG] [LOCAL ] SCS: Loaded 43846 existing records from primary storage. [2025-10-16T22:41:54.410342] [INFO ] [MAIN ] SCS: Loaded 43846 primary data records. [2025-10-16T22:41:54.388996] [DEBUG] [LOCAL ] SD: Loaded 28900 existing records from primary storage. [2025-10-16T22:41:54.546910] [INFO ] [MAIN ] SD: Loaded 28900 primary data records. [2025-10-16T22:41:55.175094] [DEBUG] [MAIN ] SDHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:55.176978] [INFO ] [MAIN ] SDHC: Generated 1807 derivative records from 10427 primary records. [2025-10-16T22:41:55.178026] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-16T22:41:55.197190] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1807 records). [2025-10-16T22:41:55.197506] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-16T22:41:55.199569] [INFO ] [MAIN ] Derivative Progress: 1351/1803 symbols completed. SDHC took 1.0s. Estimated remaining: 2m 52s. Rate: 157.6 symbols/min [2025-10-16T22:41:55.199921] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:55.221594] [DEBUG] [MAIN ] SCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:55.223508] [INFO ] [MAIN ] SCS: Generated 1807 derivative records from 43846 primary records. [2025-10-16T22:41:55.229556] [DEBUG] [LOCAL ] SDHY: Loaded 11120 existing records from primary storage. [2025-10-16T22:41:55.229702] [INFO ] [MAIN ] SDHY: Loaded 11120 primary data records. [2025-10-16T22:41:55.229787] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-16T22:41:55.338099] [DEBUG] [LOCAL ] SCS: Derivative data saved (1807 records). [2025-10-16T22:41:55.332909] [DEBUG] [MAIN ] SD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:55.356711] [INFO ] [MAIN ] SD: Generated 1807 derivative records from 28900 primary records. [2025-10-16T22:41:55.359878] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-16T22:41:55.359925] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-16T22:41:55.362871] [INFO ] [MAIN ] Derivative Progress: 1352/1803 symbols completed. SCS took 1.2s. Estimated remaining: 2m 52s. Rate: 157.6 symbols/min [2025-10-16T22:41:55.369190] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:55.574815] [DEBUG] [LOCAL ] SD: Derivative data saved (1807 records). [2025-10-16T22:41:55.575069] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-16T22:41:55.577827] [INFO ] [MAIN ] Derivative Progress: 1353/1803 symbols completed. SD took 1.4s. Estimated remaining: 2m 51s. Rate: 157.7 symbols/min [2025-10-16T22:41:55.578669] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:55.612800] [DEBUG] [LOCAL ] SDRL: Loaded 41849 existing records from primary storage. [2025-10-16T22:41:55.613348] [INFO ] [MAIN ] SDRL: Loaded 41849 primary data records. [2025-10-16T22:41:55.747024] [DEBUG] [MAIN ] SDHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:55.764212] [INFO ] [MAIN ] SDHY: Generated 1807 derivative records from 11120 primary records. [2025-10-16T22:41:55.775503] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-16T22:41:55.842056] [DEBUG] [LOCAL ] SE: Loaded 53692 existing records from primary storage. [2025-10-16T22:41:55.941449] [INFO ] [MAIN ] SE: Loaded 53692 primary data records. [2025-10-16T22:41:56.007212] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1807 records). [2025-10-16T22:41:56.035174] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-16T22:41:56.060407] [INFO ] [MAIN ] Derivative Progress: 1354/1803 symbols completed. SDHY took 0.9s. Estimated remaining: 2m 51s. Rate: 157.7 symbols/min [2025-10-16T22:41:56.088829] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:56.303154] [DEBUG] [MAIN ] SDRL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:56.303994] [INFO ] [MAIN ] SDRL: Generated 1807 derivative records from 41849 primary records. [2025-10-16T22:41:56.304332] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-16T22:41:56.346585] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1807 records). [2025-10-16T22:41:56.346898] [DEBUG] [MAIN ] SE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:56.347702] [INFO ] [MAIN ] SE: Generated 1807 derivative records from 53692 primary records. [2025-10-16T22:41:56.347941] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-10-16T22:41:56.347874] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-16T22:41:56.351637] [INFO ] [MAIN ] Derivative Progress: 1355/1803 symbols completed. SDRL took 1.0s. Estimated remaining: 2m 50s. Rate: 157.7 symbols/min [2025-10-16T22:41:56.352242] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:56.379960] [DEBUG] [LOCAL ] SEE: Loaded 48569 existing records from primary storage. [2025-10-16T22:41:56.381066] [INFO ] [MAIN ] SEE: Loaded 48569 primary data records. [2025-10-16T22:41:56.395291] [DEBUG] [LOCAL ] SE: Derivative data saved (1807 records). [2025-10-16T22:41:56.420512] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-10-16T22:41:56.422959] [INFO ] [MAIN ] Derivative Progress: 1356/1803 symbols completed. SE took 0.8s. Estimated remaining: 2m 50s. Rate: 157.8 symbols/min [2025-10-16T22:41:56.427410] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:56.501917] [DEBUG] [LOCAL ] SEG: Loaded 12910 existing records from primary storage. [2025-10-16T22:41:56.529579] [INFO ] [MAIN ] SEG: Loaded 12910 primary data records. [2025-10-16T22:41:56.954417] [DEBUG] [LOCAL ] SEI: Loaded 50322 existing records from primary storage. [2025-10-16T22:41:56.961092] [INFO ] [MAIN ] SEI: Loaded 50322 primary data records. [2025-10-16T22:41:57.438282] [DEBUG] [MAIN ] SEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:57.439969] [INFO ] [MAIN ] SEE: Generated 1807 derivative records from 48569 primary records. [2025-10-16T22:41:57.440295] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-16T22:41:57.466246] [DEBUG] [LOCAL ] SEE: Derivative data saved (1807 records). [2025-10-16T22:41:57.466619] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-16T22:41:57.470001] [INFO ] [MAIN ] Derivative Progress: 1357/1803 symbols completed. SEE took 1.4s. Estimated remaining: 2m 50s. Rate: 157.6 symbols/min [2025-10-16T22:41:57.470408] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:57.486701] [DEBUG] [MAIN ] SEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:57.487910] [INFO ] [MAIN ] SEG: Generated 1807 derivative records from 12910 primary records. [2025-10-16T22:41:57.488030] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-16T22:41:57.506618] [DEBUG] [LOCAL ] SEG: Derivative data saved (1807 records). [2025-10-16T22:41:57.506822] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-16T22:41:57.510296] [INFO ] [MAIN ] Derivative Progress: 1358/1803 symbols completed. SEG took 1.2s. Estimated remaining: 2m 49s. Rate: 157.7 symbols/min [2025-10-16T22:41:57.510471] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:57.530705] [DEBUG] [MAIN ] SEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:57.531621] [INFO ] [MAIN ] SEI: Generated 1807 derivative records from 50322 primary records. [2025-10-16T22:41:57.531774] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-16T22:41:57.549162] [DEBUG] [LOCAL ] SEI: Derivative data saved (1807 records). [2025-10-16T22:41:57.549384] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-16T22:41:57.555718] [INFO ] [MAIN ] Derivative Progress: 1359/1803 symbols completed. SEI took 1.1s. Estimated remaining: 2m 49s. Rate: 157.8 symbols/min [2025-10-16T22:41:57.568620] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:57.611485] [DEBUG] [LOCAL ] SEMR: Loaded 42385 existing records from primary storage. [2025-10-16T22:41:57.614293] [DEBUG] [LOCAL ] SEM: Loaded 43497 existing records from primary storage. [2025-10-16T22:41:57.614529] [INFO ] [MAIN ] SEM: Loaded 43497 primary data records. [2025-10-16T22:41:57.614620] [INFO ] [MAIN ] SEMR: Loaded 42385 primary data records. [2025-10-16T22:41:57.968057] [DEBUG] [LOCAL ] SES: Loaded 51968 existing records from primary storage. [2025-10-16T22:41:57.994536] [INFO ] [MAIN ] SES: Loaded 51968 primary data records. [2025-10-16T22:41:58.749416] [DEBUG] [MAIN ] SEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:58.752606] [INFO ] [MAIN ] SEM: Generated 1807 derivative records from 43497 primary records. [2025-10-16T22:41:58.753366] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-16T22:41:58.783247] [DEBUG] [MAIN ] SEMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:58.786737] [INFO ] [MAIN ] SEMR: Generated 1807 derivative records from 42385 primary records. [2025-10-16T22:41:58.786844] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-16T22:41:58.807706] [DEBUG] [LOCAL ] SEM: Derivative data saved (1807 records). [2025-10-16T22:41:58.809010] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-16T22:41:58.811705] [INFO ] [MAIN ] Derivative Progress: 1360/1803 symbols completed. SEM took 1.3s. Estimated remaining: 2m 49s. Rate: 157.5 symbols/min [2025-10-16T22:41:58.811946] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1807 records). [2025-10-16T22:41:58.814607] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-16T22:41:58.815701] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:58.820413] [INFO ] [MAIN ] Derivative Progress: 1361/1803 symbols completed. SEMR took 1.3s. Estimated remaining: 2m 48s. Rate: 157.6 symbols/min [2025-10-16T22:41:58.821107] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:58.837544] [DEBUG] [MAIN ] SES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:58.838938] [INFO ] [MAIN ] SES: Generated 1807 derivative records from 51968 primary records. [2025-10-16T22:41:58.839132] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-16T22:41:58.843338] [DEBUG] [LOCAL ] SFB: Loaded 3845 existing records from primary storage. [2025-10-16T22:41:58.844466] [INFO ] [MAIN ] SFB: Loaded 3845 primary data records. [2025-10-16T22:41:58.952952] [DEBUG] [LOCAL ] SES: Derivative data saved (1807 records). [2025-10-16T22:41:58.990472] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-16T22:41:58.994943] [INFO ] [MAIN ] Derivative Progress: 1362/1803 symbols completed. SES took 1.4s. Estimated remaining: 2m 48s. Rate: 157.7 symbols/min [2025-10-16T22:41:58.995597] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:41:59.217240] [DEBUG] [LOCAL ] SF: Loaded 41866 existing records from primary storage. [2025-10-16T22:41:59.218152] [INFO ] [MAIN ] SF: Loaded 41866 primary data records. [2025-10-16T22:41:59.370901] [DEBUG] [LOCAL ] SFBS: Loaded 21365 existing records from primary storage. [2025-10-16T22:41:59.381852] [INFO ] [MAIN ] SFBS: Loaded 21365 primary data records. [2025-10-16T22:41:59.923427] [DEBUG] [MAIN ] SFB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:59.924718] [INFO ] [MAIN ] SFB: Generated 1807 derivative records from 3845 primary records. [2025-10-16T22:41:59.924917] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-16T22:41:59.945080] [DEBUG] [LOCAL ] SFB: Derivative data saved (1807 records). [2025-10-16T22:41:59.945226] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-16T22:41:59.948401] [INFO ] [MAIN ] Derivative Progress: 1363/1803 symbols completed. SFB took 1.1s. Estimated remaining: 2m 48s. Rate: 157.5 symbols/min [2025-10-16T22:41:59.967938] [DEBUG] [MAIN ] SF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:41:59.968971] [INFO ] [MAIN ] SF: Generated 1807 derivative records from 41866 primary records. [2025-10-16T22:41:59.969174] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-16T22:41:59.987387] [DEBUG] [LOCAL ] SF: Derivative data saved (1807 records). [2025-10-16T22:41:59.987836] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-16T22:41:59.991503] [INFO ] [MAIN ] Derivative Progress: 1364/1803 symbols completed. SF took 1.2s. Estimated remaining: 2m 47s. Rate: 157.6 symbols/min [2025-10-16T22:42:00.008401] [DEBUG] [MAIN ] SFBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:00.009219] [INFO ] [MAIN ] SFBS: Generated 1807 derivative records from 21365 primary records. [2025-10-16T22:42:00.009288] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-16T22:42:00.026256] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1807 records). [2025-10-16T22:42:00.026453] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-16T22:42:00.030573] [INFO ] [MAIN ] Derivative Progress: 1365/1803 symbols completed. SFBS took 1.0s. Estimated remaining: 2m 47s. Rate: 157.7 symbols/min [2025-10-16T22:42:00.031495] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:00.031978] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:00.031367] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:00.076790] [DEBUG] [LOCAL ] SFL: Loaded 45689 existing records from primary storage. [2025-10-16T22:42:00.077227] [INFO ] [MAIN ] SFL: Loaded 45689 primary data records. [2025-10-16T22:42:00.303123] [DEBUG] [LOCAL ] SG: Loaded 53883 existing records from primary storage. [2025-10-16T22:42:00.301150] [DEBUG] [LOCAL ] SGHC: Loaded 47394 existing records from primary storage. [2025-10-16T22:42:00.315508] [INFO ] [MAIN ] SG: Loaded 53883 primary data records. [2025-10-16T22:42:00.315411] [INFO ] [MAIN ] SGHC: Loaded 47394 primary data records. [2025-10-16T22:42:01.199310] [DEBUG] [MAIN ] SFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:01.200969] [INFO ] [MAIN ] SFL: Generated 1807 derivative records from 45689 primary records. [2025-10-16T22:42:01.201571] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-16T22:42:01.226814] [DEBUG] [LOCAL ] SFL: Derivative data saved (1807 records). [2025-10-16T22:42:01.227267] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-16T22:42:01.230805] [INFO ] [MAIN ] Derivative Progress: 1366/1803 symbols completed. SFL took 1.2s. Estimated remaining: 2m 47s. Rate: 157.5 symbols/min [2025-10-16T22:42:01.231308] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:01.269421] [DEBUG] [MAIN ] SGHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:01.270123] [DEBUG] [MAIN ] SG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:01.271362] [INFO ] [MAIN ] SGHC: Generated 1807 derivative records from 47394 primary records. [2025-10-16T22:42:01.273550] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-16T22:42:01.275500] [INFO ] [MAIN ] SG: Generated 1807 derivative records from 53883 primary records. [2025-10-16T22:42:01.275635] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-16T22:42:01.292924] [DEBUG] [LOCAL ] SGU: Loaded 6613 existing records from primary storage. [2025-10-16T22:42:01.301617] [INFO ] [MAIN ] SGU: Loaded 6613 primary data records. [2025-10-16T22:42:01.322561] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1807 records). [2025-10-16T22:42:01.343570] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-16T22:42:01.366758] [INFO ] [MAIN ] Derivative Progress: 1367/1803 symbols completed. SGHC took 1.3s. Estimated remaining: 2m 46s. Rate: 157.5 symbols/min [2025-10-16T22:42:01.391141] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:01.442020] [DEBUG] [LOCAL ] SG: Derivative data saved (1807 records). [2025-10-16T22:42:01.458790] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-16T22:42:01.512864] [INFO ] [MAIN ] Derivative Progress: 1368/1803 symbols completed. SG took 1.5s. Estimated remaining: 2m 46s. Rate: 157.6 symbols/min [2025-10-16T22:42:01.559475] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:01.687189] [DEBUG] [MAIN ] SGU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:01.702771] [DEBUG] [LOCAL ] SHCO: Loaded 25733 existing records from primary storage. [2025-10-16T22:42:01.702187] [INFO ] [MAIN ] SGU: Generated 1807 derivative records from 6613 primary records. [2025-10-16T22:42:01.702940] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-16T22:42:01.703017] [INFO ] [MAIN ] SHCO: Loaded 25733 primary data records. [2025-10-16T22:42:01.733364] [DEBUG] [LOCAL ] SHAK: Loaded 49173 existing records from primary storage. [2025-10-16T22:42:01.758864] [INFO ] [MAIN ] SHAK: Loaded 49173 primary data records. [2025-10-16T22:42:01.932322] [DEBUG] [LOCAL ] SGU: Derivative data saved (1807 records). [2025-10-16T22:42:01.984922] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-16T22:42:02.008546] [INFO ] [MAIN ] Derivative Progress: 1369/1803 symbols completed. SGU took 0.8s. Estimated remaining: 2m 45s. Rate: 157.6 symbols/min [2025-10-16T22:42:02.009179] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:02.375825] [DEBUG] [MAIN ] SHCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:02.376567] [INFO ] [MAIN ] SHCO: Generated 1807 derivative records from 25733 primary records. [2025-10-16T22:42:02.377483] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-16T22:42:02.409017] [DEBUG] [LOCAL ] SHEL: Loaded 54063 existing records from primary storage. [2025-10-16T22:42:02.417426] [INFO ] [MAIN ] SHEL: Loaded 54063 primary data records. [2025-10-16T22:42:02.435123] [DEBUG] [MAIN ] SHAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:02.446526] [INFO ] [MAIN ] SHAK: Generated 1807 derivative records from 49173 primary records. [2025-10-16T22:42:02.447147] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1807 records). [2025-10-16T22:42:02.447217] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-16T22:42:02.493449] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-10-16T22:42:02.516818] [INFO ] [MAIN ] Derivative Progress: 1370/1803 symbols completed. SHCO took 1.0s. Estimated remaining: 2m 45s. Rate: 157.5 symbols/min [2025-10-16T22:42:02.548473] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:02.554601] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1807 records). [2025-10-16T22:42:02.560683] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-16T22:42:02.563230] [INFO ] [MAIN ] Derivative Progress: 1371/1803 symbols completed. SHAK took 1.2s. Estimated remaining: 2m 44s. Rate: 157.6 symbols/min [2025-10-16T22:42:02.579150] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:02.819518] [DEBUG] [LOCAL ] SHG: Loaded 26746 existing records from primary storage. [2025-10-16T22:42:02.819716] [INFO ] [MAIN ] SHG: Loaded 26746 primary data records. [2025-10-16T22:42:02.989129] [DEBUG] [LOCAL ] SHO: Loaded 49749 existing records from primary storage. [2025-10-16T22:42:03.020563] [INFO ] [MAIN ] SHO: Loaded 49749 primary data records. [2025-10-16T22:42:03.057072] [DEBUG] [MAIN ] SHEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:03.187465] [INFO ] [MAIN ] SHEL: Generated 1807 derivative records from 54063 primary records. [2025-10-16T22:42:03.220260] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-16T22:42:03.304966] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1807 records). [2025-10-16T22:42:03.316140] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-16T22:42:03.329859] [INFO ] [MAIN ] Derivative Progress: 1372/1803 symbols completed. SHEL took 1.3s. Estimated remaining: 2m 44s. Rate: 157.5 symbols/min [2025-10-16T22:42:03.348747] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:03.519118] [DEBUG] [LOCAL ] SHOC: Loaded 3264 existing records from primary storage. [2025-10-16T22:42:03.519503] [INFO ] [MAIN ] SHOC: Loaded 3264 primary data records. [2025-10-16T22:42:03.879760] [DEBUG] [MAIN ] SHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:03.888210] [INFO ] [MAIN ] SHG: Generated 1807 derivative records from 26746 primary records. [2025-10-16T22:42:03.900232] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-16T22:42:03.926070] [DEBUG] [LOCAL ] SHG: Derivative data saved (1807 records). [2025-10-16T22:42:03.927170] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-16T22:42:03.931566] [INFO ] [MAIN ] Derivative Progress: 1373/1803 symbols completed. SHG took 1.4s. Estimated remaining: 2m 44s. Rate: 157.5 symbols/min [2025-10-16T22:42:03.932561] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:03.950854] [DEBUG] [MAIN ] SHO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:03.951897] [INFO ] [MAIN ] SHO: Generated 1807 derivative records from 49749 primary records. [2025-10-16T22:42:03.952393] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-16T22:42:03.975381] [DEBUG] [LOCAL ] SHO: Derivative data saved (1807 records). [2025-10-16T22:42:03.975925] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-16T22:42:03.978532] [INFO ] [MAIN ] Derivative Progress: 1374/1803 symbols completed. SHO took 1.4s. Estimated remaining: 2m 43s. Rate: 157.6 symbols/min [2025-10-16T22:42:03.979011] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:03.997455] [DEBUG] [MAIN ] SHOC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:42:03.998674] [INFO ] [MAIN ] SHOC: Generated 1806 derivative records from 3264 primary records. [2025-10-16T22:42:04.012217] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-16T22:42:04.039291] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1806 records). [2025-10-16T22:42:04.040477] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-16T22:42:04.057982] [INFO ] [MAIN ] Derivative Progress: 1375/1803 symbols completed. SHOC took 0.7s. Estimated remaining: 2m 43s. Rate: 157.7 symbols/min [2025-10-16T22:42:04.058435] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:04.061117] [DEBUG] [LOCAL ] SHW: Loaded 50744 existing records from primary storage. [2025-10-16T22:42:04.061489] [INFO ] [MAIN ] SHW: Loaded 50744 primary data records. [2025-10-16T22:42:04.150109] [DEBUG] [LOCAL ] SID: Loaded 43016 existing records from primary storage. [2025-10-16T22:42:04.186117] [INFO ] [MAIN ] SID: Loaded 43016 primary data records. [2025-10-16T22:42:04.479383] [DEBUG] [LOCAL ] SIG: Loaded 45983 existing records from primary storage. [2025-10-16T22:42:04.498368] [INFO ] [MAIN ] SIG: Loaded 45983 primary data records. [2025-10-16T22:42:05.375760] [DEBUG] [MAIN ] SID: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:05.384946] [INFO ] [MAIN ] SID: Generated 1807 derivative records from 43016 primary records. [2025-10-16T22:42:05.390268] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-16T22:42:05.390842] [DEBUG] [MAIN ] SHW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:05.392836] [INFO ] [MAIN ] SHW: Generated 1807 derivative records from 50744 primary records. [2025-10-16T22:42:05.393775] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-16T22:42:05.420054] [DEBUG] [LOCAL ] SID: Derivative data saved (1807 records). [2025-10-16T22:42:05.424370] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-16T22:42:05.430816] [INFO ] [MAIN ] Derivative Progress: 1376/1803 symbols completed. SID took 1.5s. Estimated remaining: 2m 43s. Rate: 157.4 symbols/min [2025-10-16T22:42:05.431214] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:05.441561] [DEBUG] [LOCAL ] SHW: Derivative data saved (1807 records). [2025-10-16T22:42:05.447693] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-16T22:42:05.447997] [DEBUG] [MAIN ] SIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:05.449172] [INFO ] [MAIN ] SIG: Generated 1807 derivative records from 45983 primary records. [2025-10-16T22:42:05.452159] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-16T22:42:05.451846] [INFO ] [MAIN ] Derivative Progress: 1377/1803 symbols completed. SHW took 1.5s. Estimated remaining: 2m 42s. Rate: 157.5 symbols/min [2025-10-16T22:42:05.453256] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:05.477680] [DEBUG] [LOCAL ] SIG: Derivative data saved (1807 records). [2025-10-16T22:42:05.477979] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-16T22:42:05.480358] [INFO ] [MAIN ] Derivative Progress: 1378/1803 symbols completed. SIG took 1.4s. Estimated remaining: 2m 42s. Rate: 157.6 symbols/min [2025-10-16T22:42:05.490506] [DEBUG] [LOCAL ] SII: Loaded 24193 existing records from primary storage. [2025-10-16T22:42:05.490680] [INFO ] [MAIN ] SII: Loaded 24193 primary data records. [2025-10-16T22:42:05.666670] [DEBUG] [LOCAL ] SILA: Loaded 30693 existing records from primary storage. [2025-10-16T22:42:05.668680] [INFO ] [MAIN ] SILA: Loaded 30693 primary data records. [2025-10-16T22:42:06.154362] [DEBUG] [MAIN ] SII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:06.155393] [INFO ] [MAIN ] SII: Generated 1807 derivative records from 24193 primary records. [2025-10-16T22:42:06.155756] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-16T22:42:06.171949] [DEBUG] [LOCAL ] SII: Derivative data saved (1807 records). [2025-10-16T22:42:06.172101] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-16T22:42:06.174146] [INFO ] [MAIN ] Derivative Progress: 1379/1803 symbols completed. SII took 0.7s. Estimated remaining: 2m 42s. Rate: 157.5 symbols/min [2025-10-16T22:42:06.189845] [DEBUG] [MAIN ] SILA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:06.190502] [INFO ] [MAIN ] SILA: Generated 1807 derivative records from 30693 primary records. [2025-10-16T22:42:06.190563] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-16T22:42:06.205870] [DEBUG] [LOCAL ] SILA: Derivative data saved (1807 records). [2025-10-16T22:42:06.205982] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-16T22:42:06.208508] [INFO ] [MAIN ] Derivative Progress: 1380/1803 symbols completed. SILA took 0.8s. Estimated remaining: 2m 41s. Rate: 157.6 symbols/min [2025-10-16T22:42:06.208972] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:06.209163] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:06.209055] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:06.266527] [DEBUG] [LOCAL ] SITC: Loaded 42145 existing records from primary storage. [2025-10-16T22:42:06.276023] [INFO ] [MAIN ] SITC: Loaded 42145 primary data records. [2025-10-16T22:42:06.288987] [DEBUG] [LOCAL ] SITE: Loaded 35881 existing records from primary storage. [2025-10-16T22:42:06.333224] [INFO ] [MAIN ] SITE: Loaded 35881 primary data records. [2025-10-16T22:42:06.403123] [DEBUG] [LOCAL ] SJM: Loaded 50509 existing records from primary storage. [2025-10-16T22:42:06.436248] [INFO ] [MAIN ] SJM: Loaded 50509 primary data records. [2025-10-16T22:42:07.287266] [DEBUG] [MAIN ] SITC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:07.294451] [INFO ] [MAIN ] SITC: Generated 1807 derivative records from 42145 primary records. [2025-10-16T22:42:07.294789] [DEBUG] [MAIN ] SITE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:07.295474] [INFO ] [MAIN ] SITE: Generated 1807 derivative records from 35881 primary records. [2025-10-16T22:42:07.294917] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-16T22:42:07.295567] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-16T22:42:07.325460] [DEBUG] [LOCAL ] SITE: Derivative data saved (1807 records). [2025-10-16T22:42:07.333919] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-16T22:42:07.342005] [INFO ] [MAIN ] Derivative Progress: 1381/1803 symbols completed. SITE took 1.1s. Estimated remaining: 2m 41s. Rate: 157.4 symbols/min [2025-10-16T22:42:07.342359] [DEBUG] [MAIN ] SJM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:07.343406] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:07.344202] [INFO ] [MAIN ] SJM: Generated 1807 derivative records from 50509 primary records. [2025-10-16T22:42:07.345106] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-16T22:42:07.355770] [DEBUG] [LOCAL ] SITC: Derivative data saved (1807 records). [2025-10-16T22:42:07.357116] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-16T22:42:07.362580] [INFO ] [MAIN ] Derivative Progress: 1382/1803 symbols completed. SITC took 1.2s. Estimated remaining: 2m 40s. Rate: 157.5 symbols/min [2025-10-16T22:42:07.366710] [DEBUG] [LOCAL ] SJM: Derivative data saved (1807 records). [2025-10-16T22:42:07.365862] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:07.366961] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-16T22:42:07.369902] [INFO ] [MAIN ] Derivative Progress: 1383/1803 symbols completed. SJM took 1.2s. Estimated remaining: 2m 40s. Rate: 157.6 symbols/min [2025-10-16T22:42:07.370272] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:07.391950] [DEBUG] [LOCAL ] SKIL: Loaded 6699 existing records from primary storage. [2025-10-16T22:42:07.393467] [DEBUG] [LOCAL ] SJT: Loaded 22722 existing records from primary storage. [2025-10-16T22:42:07.393632] [INFO ] [MAIN ] SJT: Loaded 22722 primary data records. [2025-10-16T22:42:07.393539] [INFO ] [MAIN ] SKIL: Loaded 6699 primary data records. [2025-10-16T22:42:07.802405] [DEBUG] [LOCAL ] SKE: Loaded 37259 existing records from primary storage. [2025-10-16T22:42:08.021758] [INFO ] [MAIN ] SKE: Loaded 37259 primary data records. [2025-10-16T22:42:08.378689] [DEBUG] [MAIN ] SKIL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:08.388011] [INFO ] [MAIN ] SKIL: Generated 1807 derivative records from 6699 primary records. [2025-10-16T22:42:08.393021] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-16T22:42:08.394368] [DEBUG] [MAIN ] SJT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:08.395226] [INFO ] [MAIN ] SJT: Generated 1807 derivative records from 22722 primary records. [2025-10-16T22:42:08.395319] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-16T22:42:08.423907] [DEBUG] [LOCAL ] SJT: Derivative data saved (1807 records). [2025-10-16T22:42:08.424458] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-16T22:42:08.427116] [INFO ] [MAIN ] Derivative Progress: 1384/1803 symbols completed. SJT took 1.1s. Estimated remaining: 2m 40s. Rate: 157.4 symbols/min [2025-10-16T22:42:08.428163] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:08.430714] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1807 records). [2025-10-16T22:42:08.431709] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-16T22:42:08.434328] [INFO ] [MAIN ] Derivative Progress: 1385/1803 symbols completed. SKIL took 1.1s. Estimated remaining: 2m 39s. Rate: 157.5 symbols/min [2025-10-16T22:42:08.434535] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:08.451037] [DEBUG] [MAIN ] SKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:08.451902] [INFO ] [MAIN ] SKE: Generated 1807 derivative records from 37259 primary records. [2025-10-16T22:42:08.452148] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-16T22:42:08.466482] [DEBUG] [LOCAL ] SKLZ: Loaded 11665 existing records from primary storage. [2025-10-16T22:42:08.473820] [DEBUG] [LOCAL ] SKE: Derivative data saved (1807 records). [2025-10-16T22:42:08.473922] [INFO ] [MAIN ] SKLZ: Loaded 11665 primary data records. [2025-10-16T22:42:08.474100] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-16T22:42:08.507323] [INFO ] [MAIN ] Derivative Progress: 1386/1803 symbols completed. SKE took 1.1s. Estimated remaining: 2m 39s. Rate: 157.6 symbols/min [2025-10-16T22:42:08.525396] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:08.690572] [DEBUG] [LOCAL ] SKM: Loaded 35553 existing records from primary storage. [2025-10-16T22:42:08.691151] [INFO ] [MAIN ] SKM: Loaded 35553 primary data records. [2025-10-16T22:42:09.010967] [DEBUG] [LOCAL ] SKT: Loaded 42837 existing records from primary storage. [2025-10-16T22:42:09.034462] [INFO ] [MAIN ] SKT: Loaded 42837 primary data records. [2025-10-16T22:42:09.528533] [DEBUG] [MAIN ] SKLZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:09.539120] [INFO ] [MAIN ] SKLZ: Generated 1807 derivative records from 11665 primary records. [2025-10-16T22:42:09.539536] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-16T22:42:09.561173] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1807 records). [2025-10-16T22:42:09.563484] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-16T22:42:09.565749] [INFO ] [MAIN ] Derivative Progress: 1387/1803 symbols completed. SKLZ took 1.1s. Estimated remaining: 2m 39s. Rate: 157.4 symbols/min [2025-10-16T22:42:09.566084] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:09.581932] [DEBUG] [MAIN ] SKM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:09.582888] [INFO ] [MAIN ] SKM: Generated 1807 derivative records from 35553 primary records. [2025-10-16T22:42:09.583170] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-16T22:42:09.601572] [DEBUG] [LOCAL ] SKM: Derivative data saved (1807 records). [2025-10-16T22:42:09.602109] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-10-16T22:42:09.604489] [INFO ] [MAIN ] Derivative Progress: 1388/1803 symbols completed. SKM took 1.2s. Estimated remaining: 2m 38s. Rate: 157.5 symbols/min [2025-10-16T22:42:09.604731] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:09.622043] [DEBUG] [MAIN ] SKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:09.632464] [INFO ] [MAIN ] SKT: Generated 1807 derivative records from 42837 primary records. [2025-10-16T22:42:09.632681] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-16T22:42:09.656844] [DEBUG] [LOCAL ] SKYH: Loaded 16341 existing records from primary storage. [2025-10-16T22:42:09.670334] [INFO ] [MAIN ] SKYH: Loaded 16341 primary data records. [2025-10-16T22:42:09.683781] [DEBUG] [LOCAL ] SKT: Derivative data saved (1807 records). [2025-10-16T22:42:09.690396] [DEBUG] [LOCAL ] SKY: Loaded 38776 existing records from primary storage. [2025-10-16T22:42:09.710519] [INFO ] [MAIN ] SKY: Loaded 38776 primary data records. [2025-10-16T22:42:09.729260] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-16T22:42:09.759423] [INFO ] [MAIN ] Derivative Progress: 1389/1803 symbols completed. SKT took 1.2s. Estimated remaining: 2m 38s. Rate: 157.5 symbols/min [2025-10-16T22:42:09.854177] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:10.397136] [DEBUG] [MAIN ] SKYH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:10.422270] [INFO ] [MAIN ] SKYH: Generated 1807 derivative records from 16341 primary records. [2025-10-16T22:42:10.422423] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-16T22:42:10.426514] [DEBUG] [LOCAL ] SLB: Loaded 54087 existing records from primary storage. [2025-10-16T22:42:10.427290] [INFO ] [MAIN ] SLB: Loaded 54087 primary data records. [2025-10-16T22:42:10.450550] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1807 records). [2025-10-16T22:42:10.491443] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-16T22:42:10.518499] [INFO ] [MAIN ] Derivative Progress: 1390/1803 symbols completed. SKYH took 0.9s. Estimated remaining: 2m 37s. Rate: 157.4 symbols/min [2025-10-16T22:42:10.541051] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:10.541912] [DEBUG] [MAIN ] SKY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:10.567242] [INFO ] [MAIN ] SKY: Generated 1807 derivative records from 38776 primary records. [2025-10-16T22:42:10.584119] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-16T22:42:10.804777] [DEBUG] [LOCAL ] SKY: Derivative data saved (1807 records). [2025-10-16T22:42:10.810863] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-10-16T22:42:10.813530] [INFO ] [MAIN ] Derivative Progress: 1391/1803 symbols completed. SKY took 1.2s. Estimated remaining: 2m 37s. Rate: 157.5 symbols/min [2025-10-16T22:42:10.813763] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:10.847213] [DEBUG] [LOCAL ] SLF: Loaded 39052 existing records from primary storage. [2025-10-16T22:42:10.847532] [INFO ] [MAIN ] SLF: Loaded 39052 primary data records. [2025-10-16T22:42:11.196155] [DEBUG] [LOCAL ] SLG: Loaded 45971 existing records from primary storage. [2025-10-16T22:42:11.197672] [INFO ] [MAIN ] SLG: Loaded 45971 primary data records. [2025-10-16T22:42:11.291483] [DEBUG] [MAIN ] SLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:11.315781] [INFO ] [MAIN ] SLB: Generated 1807 derivative records from 54087 primary records. [2025-10-16T22:42:11.319888] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-10-16T22:42:11.577175] [DEBUG] [LOCAL ] SLB: Derivative data saved (1807 records). [2025-10-16T22:42:11.577341] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-10-16T22:42:11.579209] [INFO ] [MAIN ] Derivative Progress: 1392/1803 symbols completed. SLB took 1.7s. Estimated remaining: 2m 37s. Rate: 157.3 symbols/min [2025-10-16T22:42:11.579566] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:11.600573] [DEBUG] [MAIN ] SLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:11.601882] [INFO ] [MAIN ] SLF: Generated 1807 derivative records from 39052 primary records. [2025-10-16T22:42:11.602126] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-16T22:42:11.619239] [DEBUG] [LOCAL ] SLF: Derivative data saved (1807 records). [2025-10-16T22:42:11.619707] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-16T22:42:11.622025] [INFO ] [MAIN ] Derivative Progress: 1393/1803 symbols completed. SLF took 1.1s. Estimated remaining: 2m 36s. Rate: 157.4 symbols/min [2025-10-16T22:42:11.653334] [DEBUG] [MAIN ] SLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:11.654256] [INFO ] [MAIN ] SLG: Generated 1807 derivative records from 45971 primary records. [2025-10-16T22:42:11.654337] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-16T22:42:11.683269] [DEBUG] [LOCAL ] SLGN: Loaded 41193 existing records from primary storage. [2025-10-16T22:42:11.684041] [INFO ] [MAIN ] SLGN: Loaded 41193 primary data records. [2025-10-16T22:42:11.789176] [DEBUG] [LOCAL ] SLG: Derivative data saved (1807 records). [2025-10-16T22:42:11.789551] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-16T22:42:11.797854] [INFO ] [MAIN ] Derivative Progress: 1394/1803 symbols completed. SLG took 1.0s. Estimated remaining: 2m 36s. Rate: 157.5 symbols/min [2025-10-16T22:42:12.000017] [DEBUG] [MAIN ] SLGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:12.000621] [INFO ] [MAIN ] SLGN: Generated 1807 derivative records from 41193 primary records. [2025-10-16T22:42:12.000706] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-16T22:42:12.016046] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1807 records). [2025-10-16T22:42:12.016103] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-16T22:42:12.018223] [INFO ] [MAIN ] Derivative Progress: 1395/1803 symbols completed. SLGN took 0.4s. Estimated remaining: 2m 35s. Rate: 157.6 symbols/min [2025-10-16T22:42:12.018852] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:12.018763] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:12.019099] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:12.075957] [DEBUG] [LOCAL ] SLVM: Loaded 28003 existing records from primary storage. [2025-10-16T22:42:12.089267] [INFO ] [MAIN ] SLVM: Loaded 28003 primary data records. [2025-10-16T22:42:12.140224] [DEBUG] [LOCAL ] SM: Loaded 52766 existing records from primary storage. [2025-10-16T22:42:12.148530] [DEBUG] [LOCAL ] SLQT: Loaded 43838 existing records from primary storage. [2025-10-16T22:42:12.160710] [INFO ] [MAIN ] SLQT: Loaded 43838 primary data records. [2025-10-16T22:42:12.169297] [INFO ] [MAIN ] SM: Loaded 52766 primary data records. [2025-10-16T22:42:13.044159] [DEBUG] [MAIN ] SLVM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:13.044934] [INFO ] [MAIN ] SLVM: Generated 1807 derivative records from 28003 primary records. [2025-10-16T22:42:13.045200] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-16T22:42:13.066179] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1807 records). [2025-10-16T22:42:13.067021] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-16T22:42:13.069084] [INFO ] [MAIN ] Derivative Progress: 1396/1803 symbols completed. SLVM took 1.0s. Estimated remaining: 2m 35s. Rate: 157.4 symbols/min [2025-10-16T22:42:13.069487] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:13.091052] [DEBUG] [MAIN ] SLQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:13.096765] [INFO ] [MAIN ] SLQT: Generated 1807 derivative records from 43838 primary records. [2025-10-16T22:42:13.097089] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-16T22:42:13.097351] [DEBUG] [MAIN ] SM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:13.100530] [INFO ] [MAIN ] SM: Generated 1807 derivative records from 52766 primary records. [2025-10-16T22:42:13.100944] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-16T22:42:13.131209] [DEBUG] [LOCAL ] SM: Derivative data saved (1807 records). [2025-10-16T22:42:13.133524] [DEBUG] [LOCAL ] SMBK: Loaded 8308 existing records from primary storage. [2025-10-16T22:42:13.131812] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-16T22:42:13.133929] [INFO ] [MAIN ] SMBK: Loaded 8308 primary data records. [2025-10-16T22:42:13.137482] [INFO ] [MAIN ] Derivative Progress: 1397/1803 symbols completed. SM took 1.1s. Estimated remaining: 2m 35s. Rate: 157.4 symbols/min [2025-10-16T22:42:13.144103] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:13.143994] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1807 records). [2025-10-16T22:42:13.144364] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-16T22:42:13.153186] [INFO ] [MAIN ] Derivative Progress: 1398/1803 symbols completed. SLQT took 1.1s. Estimated remaining: 2m 34s. Rate: 157.6 symbols/min [2025-10-16T22:42:13.163217] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:13.302885] [DEBUG] [LOCAL ] SMC: Loaded 11307 existing records from primary storage. [2025-10-16T22:42:13.343228] [INFO ] [MAIN ] SMC: Loaded 11307 primary data records. [2025-10-16T22:42:13.698698] [DEBUG] [LOCAL ] SMFG: Loaded 48740 existing records from primary storage. [2025-10-16T22:42:13.807219] [INFO ] [MAIN ] SMFG: Loaded 48740 primary data records. [2025-10-16T22:42:14.134852] [DEBUG] [MAIN ] SMBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:14.136131] [INFO ] [MAIN ] SMBK: Generated 1807 derivative records from 8308 primary records. [2025-10-16T22:42:14.136674] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-16T22:42:14.158322] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1807 records). [2025-10-16T22:42:14.159992] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-16T22:42:14.162127] [INFO ] [MAIN ] Derivative Progress: 1399/1803 symbols completed. SMBK took 1.1s. Estimated remaining: 2m 34s. Rate: 157.4 symbols/min [2025-10-16T22:42:14.162566] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:14.178608] [DEBUG] [MAIN ] SMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:14.179635] [INFO ] [MAIN ] SMC: Generated 1807 derivative records from 11307 primary records. [2025-10-16T22:42:14.179941] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-16T22:42:14.197218] [DEBUG] [LOCAL ] SMC: Derivative data saved (1807 records). [2025-10-16T22:42:14.198396] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-16T22:42:14.201799] [INFO ] [MAIN ] Derivative Progress: 1400/1803 symbols completed. SMC took 1.1s. Estimated remaining: 2m 34s. Rate: 157.5 symbols/min [2025-10-16T22:42:14.203503] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:14.217809] [DEBUG] [MAIN ] SMFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:14.218563] [INFO ] [MAIN ] SMFG: Generated 1807 derivative records from 48740 primary records. [2025-10-16T22:42:14.218785] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-16T22:42:14.247746] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1807 records). [2025-10-16T22:42:14.254251] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-16T22:42:14.256557] [INFO ] [MAIN ] Derivative Progress: 1401/1803 symbols completed. SMFG took 1.1s. Estimated remaining: 2m 33s. Rate: 157.6 symbols/min [2025-10-16T22:42:14.253362] [DEBUG] [LOCAL ] SMHI: Loaded 13165 existing records from primary storage. [2025-10-16T22:42:14.256758] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:14.268381] [INFO ] [MAIN ] SMHI: Loaded 13165 primary data records. [2025-10-16T22:42:14.282034] [DEBUG] [LOCAL ] SMG: Loaded 43649 existing records from primary storage. [2025-10-16T22:42:14.302200] [INFO ] [MAIN ] SMG: Loaded 43649 primary data records. [2025-10-16T22:42:14.552928] [DEBUG] [LOCAL ] SMP: Loaded 18960 existing records from primary storage. [2025-10-16T22:42:14.618077] [INFO ] [MAIN ] SMP: Loaded 18960 primary data records. [2025-10-16T22:42:15.280121] [DEBUG] [MAIN ] SMHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:15.282516] [INFO ] [MAIN ] SMHI: Generated 1807 derivative records from 13165 primary records. [2025-10-16T22:42:15.283047] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-16T22:42:15.312856] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1807 records). [2025-10-16T22:42:15.313087] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-16T22:42:15.309912] [DEBUG] [MAIN ] SMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:15.313991] [INFO ] [MAIN ] SMG: Generated 1807 derivative records from 43649 primary records. [2025-10-16T22:42:15.314089] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-16T22:42:15.317316] [INFO ] [MAIN ] Derivative Progress: 1402/1803 symbols completed. SMHI took 1.1s. Estimated remaining: 2m 33s. Rate: 157.4 symbols/min [2025-10-16T22:42:15.319092] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:15.336391] [DEBUG] [LOCAL ] SMG: Derivative data saved (1807 records). [2025-10-16T22:42:15.336534] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-16T22:42:15.338992] [INFO ] [MAIN ] Derivative Progress: 1403/1803 symbols completed. SMG took 1.2s. Estimated remaining: 2m 32s. Rate: 157.5 symbols/min [2025-10-16T22:42:15.339241] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:15.352828] [DEBUG] [MAIN ] SMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:15.353545] [INFO ] [MAIN ] SMP: Generated 1807 derivative records from 18960 primary records. [2025-10-16T22:42:15.353683] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-16T22:42:15.372531] [DEBUG] [LOCAL ] SMP: Derivative data saved (1807 records). [2025-10-16T22:42:15.372749] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-10-16T22:42:15.375059] [INFO ] [MAIN ] Derivative Progress: 1404/1803 symbols completed. SMP took 1.1s. Estimated remaining: 2m 32s. Rate: 157.6 symbols/min [2025-10-16T22:42:15.375300] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:15.451555] [DEBUG] [LOCAL ] SMR: Loaded 54189 existing records from primary storage. [2025-10-16T22:42:15.453029] [DEBUG] [LOCAL ] SMWB: Loaded 32395 existing records from primary storage. [2025-10-16T22:42:15.453356] [INFO ] [MAIN ] SMR: Loaded 54189 primary data records. [2025-10-16T22:42:15.453539] [INFO ] [MAIN ] SMWB: Loaded 32395 primary data records. [2025-10-16T22:42:15.476729] [DEBUG] [LOCAL ] SMRT: Loaded 44269 existing records from primary storage. [2025-10-16T22:42:15.526800] [INFO ] [MAIN ] SMRT: Loaded 44269 primary data records. [2025-10-16T22:42:16.415351] [DEBUG] [MAIN ] SMWB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:16.416122] [DEBUG] [MAIN ] SMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:16.417423] [INFO ] [MAIN ] SMWB: Generated 1807 derivative records from 32395 primary records. [2025-10-16T22:42:16.418478] [INFO ] [MAIN ] SMR: Generated 1807 derivative records from 54189 primary records. [2025-10-16T22:42:16.418776] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-16T22:42:16.432185] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-10-16T22:42:16.443277] [DEBUG] [MAIN ] SMRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:16.447401] [INFO ] [MAIN ] SMRT: Generated 1807 derivative records from 44269 primary records. [2025-10-16T22:42:16.447727] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-16T22:42:16.478615] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1807 records). [2025-10-16T22:42:16.480048] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-16T22:42:16.483197] [INFO ] [MAIN ] Derivative Progress: 1405/1803 symbols completed. SMWB took 1.1s. Estimated remaining: 2m 32s. Rate: 157.4 symbols/min [2025-10-16T22:42:16.486736] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:16.490478] [DEBUG] [LOCAL ] SMR: Derivative data saved (1807 records). [2025-10-16T22:42:16.491785] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-10-16T22:42:16.495361] [INFO ] [MAIN ] Derivative Progress: 1406/1803 symbols completed. SMR took 1.2s. Estimated remaining: 2m 31s. Rate: 157.5 symbols/min [2025-10-16T22:42:16.496898] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:16.498282] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1807 records). [2025-10-16T22:42:16.498351] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-16T22:42:16.501737] [INFO ] [MAIN ] Derivative Progress: 1407/1803 symbols completed. SMRT took 1.2s. Estimated remaining: 2m 31s. Rate: 157.6 symbols/min [2025-10-16T22:42:16.501888] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:16.531478] [DEBUG] [LOCAL ] SNA: Loaded 26111 existing records from primary storage. [2025-10-16T22:42:16.545585] [INFO ] [MAIN ] SNA: Loaded 26111 primary data records. [2025-10-16T22:42:16.704954] [DEBUG] [LOCAL ] SN: Loaded 50370 existing records from primary storage. [2025-10-16T22:42:16.763710] [INFO ] [MAIN ] SN: Loaded 50370 primary data records. [2025-10-16T22:42:16.750943] [DEBUG] [LOCAL ] SNAP: Loaded 54186 existing records from primary storage. [2025-10-16T22:42:16.808620] [INFO ] [MAIN ] SNAP: Loaded 54186 primary data records. [2025-10-16T22:42:17.644704] [DEBUG] [MAIN ] SNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:17.646220] [INFO ] [MAIN ] SNA: Generated 1807 derivative records from 26111 primary records. [2025-10-16T22:42:17.646350] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-16T22:42:17.675693] [DEBUG] [LOCAL ] SNA: Derivative data saved (1807 records). [2025-10-16T22:42:17.675982] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-10-16T22:42:17.679885] [INFO ] [MAIN ] Derivative Progress: 1408/1803 symbols completed. SNA took 1.2s. Estimated remaining: 2m 31s. Rate: 157.3 symbols/min [2025-10-16T22:42:17.696507] [DEBUG] [MAIN ] SN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:17.697351] [INFO ] [MAIN ] SN: Generated 1807 derivative records from 50370 primary records. [2025-10-16T22:42:17.697591] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-16T22:42:17.727772] [DEBUG] [MAIN ] SNAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:17.729690] [DEBUG] [LOCAL ] SN: Derivative data saved (1807 records). [2025-10-16T22:42:17.729613] [INFO ] [MAIN ] SNAP: Generated 1807 derivative records from 54186 primary records. [2025-10-16T22:42:17.729790] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-16T22:42:17.729928] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-16T22:42:17.732713] [INFO ] [MAIN ] Derivative Progress: 1409/1803 symbols completed. SN took 1.2s. Estimated remaining: 2m 30s. Rate: 157.4 symbols/min [2025-10-16T22:42:17.748148] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1807 records). [2025-10-16T22:42:17.748232] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-16T22:42:17.751588] [INFO ] [MAIN ] Derivative Progress: 1410/1803 symbols completed. SNAP took 1.2s. Estimated remaining: 2m 30s. Rate: 157.5 symbols/min [2025-10-16T22:42:17.752149] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:17.752066] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:17.752299] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:17.760985] [DEBUG] [LOCAL ] SNDA: Loaded 4504 existing records from primary storage. [2025-10-16T22:42:17.761136] [INFO ] [MAIN ] SNDA: Loaded 4504 primary data records. [2025-10-16T22:42:18.101119] [DEBUG] [LOCAL ] SNN: Loaded 44635 existing records from primary storage. [2025-10-16T22:42:18.101319] [INFO ] [MAIN ] SNN: Loaded 44635 primary data records. [2025-10-16T22:42:18.101984] [DEBUG] [LOCAL ] SNDR: Loaded 41893 existing records from primary storage. [2025-10-16T22:42:18.123175] [INFO ] [MAIN ] SNDR: Loaded 41893 primary data records. [2025-10-16T22:42:18.722561] [DEBUG] [MAIN ] SNDA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:18.724193] [INFO ] [MAIN ] SNDA: Generated 1807 derivative records from 4504 primary records. [2025-10-16T22:42:18.725670] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-16T22:42:18.742037] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1807 records). [2025-10-16T22:42:18.742313] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-16T22:42:18.744734] [INFO ] [MAIN ] Derivative Progress: 1411/1803 symbols completed. SNDA took 1.0s. Estimated remaining: 2m 29s. Rate: 157.4 symbols/min [2025-10-16T22:42:18.745214] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:18.786117] [DEBUG] [MAIN ] SNN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:18.786884] [INFO ] [MAIN ] SNN: Generated 1807 derivative records from 44635 primary records. [2025-10-16T22:42:18.785869] [DEBUG] [MAIN ] SNDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:18.787794] [INFO ] [MAIN ] SNDR: Generated 1807 derivative records from 41893 primary records. [2025-10-16T22:42:18.787882] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-16T22:42:18.786980] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-16T22:42:18.827356] [DEBUG] [LOCAL ] SNN: Derivative data saved (1807 records). [2025-10-16T22:42:18.828520] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-16T22:42:18.834752] [INFO ] [MAIN ] Derivative Progress: 1412/1803 symbols completed. SNN took 1.1s. Estimated remaining: 2m 29s. Rate: 157.5 symbols/min [2025-10-16T22:42:18.834959] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:18.832415] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1807 records). [2025-10-16T22:42:18.835761] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-16T22:42:18.837884] [INFO ] [MAIN ] Derivative Progress: 1413/1803 symbols completed. SNDR took 1.1s. Estimated remaining: 2m 29s. Rate: 157.6 symbols/min [2025-10-16T22:42:18.838107] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:18.854189] [DEBUG] [LOCAL ] SNV: Loaded 49426 existing records from primary storage. [2025-10-16T22:42:18.854452] [INFO ] [MAIN ] SNV: Loaded 49426 primary data records. [2025-10-16T22:42:19.055485] [DEBUG] [LOCAL ] SNX: Loaded 39754 existing records from primary storage. [2025-10-16T22:42:19.073107] [INFO ] [MAIN ] SNX: Loaded 39754 primary data records. [2025-10-16T22:42:19.306861] [DEBUG] [LOCAL ] SO: Loaded 54004 existing records from primary storage. [2025-10-16T22:42:19.317410] [INFO ] [MAIN ] SO: Loaded 54004 primary data records. [2025-10-16T22:42:19.871607] [DEBUG] [MAIN ] SNV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:19.873314] [INFO ] [MAIN ] SNV: Generated 1807 derivative records from 49426 primary records. [2025-10-16T22:42:19.873755] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-16T22:42:19.907734] [DEBUG] [LOCAL ] SNV: Derivative data saved (1807 records). [2025-10-16T22:42:19.908426] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-10-16T22:42:19.908240] [DEBUG] [MAIN ] SNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:19.910914] [INFO ] [MAIN ] Derivative Progress: 1414/1803 symbols completed. SNV took 1.2s. Estimated remaining: 2m 28s. Rate: 157.4 symbols/min [2025-10-16T22:42:19.911860] [INFO ] [MAIN ] SNX: Generated 1807 derivative records from 39754 primary records. [2025-10-16T22:42:19.912018] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-16T22:42:19.912943] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:19.930228] [DEBUG] [LOCAL ] SNX: Derivative data saved (1807 records). [2025-10-16T22:42:19.930399] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-10-16T22:42:19.932752] [INFO ] [MAIN ] Derivative Progress: 1415/1803 symbols completed. SNX took 1.1s. Estimated remaining: 2m 28s. Rate: 157.5 symbols/min [2025-10-16T22:42:19.933043] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:19.954066] [DEBUG] [MAIN ] SO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:19.954851] [INFO ] [MAIN ] SO: Generated 1807 derivative records from 54004 primary records. [2025-10-16T22:42:19.954962] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-16T22:42:19.981150] [DEBUG] [LOCAL ] SO: Derivative data saved (1807 records). [2025-10-16T22:42:19.981305] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-16T22:42:19.983715] [INFO ] [MAIN ] Derivative Progress: 1416/1803 symbols completed. SO took 1.1s. Estimated remaining: 2m 27s. Rate: 157.6 symbols/min [2025-10-16T22:42:19.984032] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:20.009749] [DEBUG] [LOCAL ] SOBO: Loaded 39708 existing records from primary storage. [2025-10-16T22:42:20.011320] [INFO ] [MAIN ] SOBO: Loaded 39708 primary data records. [2025-10-16T22:42:20.079005] [DEBUG] [LOCAL ] SOJC: Loaded 4835 existing records from primary storage. [2025-10-16T22:42:20.091015] [INFO ] [MAIN ] SOJC: Loaded 4835 primary data records. [2025-10-16T22:42:20.186457] [DEBUG] [LOCAL ] SOC: Loaded 51356 existing records from primary storage. [2025-10-16T22:42:20.217113] [INFO ] [MAIN ] SOC: Loaded 51356 primary data records. [2025-10-16T22:42:20.975592] [DEBUG] [MAIN ] SOBO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:20.976498] [INFO ] [MAIN ] SOBO: Generated 1807 derivative records from 39708 primary records. [2025-10-16T22:42:20.976716] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-16T22:42:21.005075] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1807 records). [2025-10-16T22:42:21.018727] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-16T22:42:21.020981] [INFO ] [MAIN ] Derivative Progress: 1417/1803 symbols completed. SOBO took 1.1s. Estimated remaining: 2m 27s. Rate: 157.4 symbols/min [2025-10-16T22:42:21.021232] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:21.021786] [DEBUG] [MAIN ] SOJC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:21.035420] [INFO ] [MAIN ] SOJC: Generated 1807 derivative records from 4835 primary records. [2025-10-16T22:42:21.036185] [DEBUG] [MAIN ] SOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:21.036400] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-16T22:42:21.037392] [INFO ] [MAIN ] SOC: Generated 1807 derivative records from 51356 primary records. [2025-10-16T22:42:21.037950] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-16T22:42:21.079185] [DEBUG] [LOCAL ] SOC: Derivative data saved (1807 records). [2025-10-16T22:42:21.075723] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1807 records). [2025-10-16T22:42:21.079761] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-16T22:42:21.079902] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-16T22:42:21.079628] [DEBUG] [LOCAL ] SOJD: Loaded 13066 existing records from primary storage. [2025-10-16T22:42:21.084939] [INFO ] [MAIN ] SOJD: Loaded 13066 primary data records. [2025-10-16T22:42:21.082283] [INFO ] [MAIN ] Derivative Progress: 1418/1803 symbols completed. SOC took 1.1s. Estimated remaining: 2m 27s. Rate: 157.5 symbols/min [2025-10-16T22:42:21.085241] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:21.090528] [INFO ] [MAIN ] Derivative Progress: 1419/1803 symbols completed. SOJC took 1.1s. Estimated remaining: 2m 26s. Rate: 157.6 symbols/min [2025-10-16T22:42:21.096891] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:21.200780] [DEBUG] [LOCAL ] SOJE: Loaded 8935 existing records from primary storage. [2025-10-16T22:42:21.209278] [INFO ] [MAIN ] SOJE: Loaded 8935 primary data records. [2025-10-16T22:42:21.225209] [DEBUG] [LOCAL ] SOL: Loaded 13297 existing records from primary storage. [2025-10-16T22:42:21.260120] [INFO ] [MAIN ] SOL: Loaded 13297 primary data records. [2025-10-16T22:42:22.087720] [DEBUG] [MAIN ] SOJD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:22.090214] [INFO ] [MAIN ] SOJD: Generated 1807 derivative records from 13066 primary records. [2025-10-16T22:42:22.090350] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-16T22:42:22.111131] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1807 records). [2025-10-16T22:42:22.111253] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-16T22:42:22.113406] [INFO ] [MAIN ] Derivative Progress: 1420/1803 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 26s. Rate: 157.4 symbols/min [2025-10-16T22:42:22.113579] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:22.132623] [DEBUG] [MAIN ] SOJE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:22.146954] [INFO ] [MAIN ] SOJE: Generated 1807 derivative records from 8935 primary records. [2025-10-16T22:42:22.147891] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-16T22:42:22.147824] [DEBUG] [MAIN ] SOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:22.148545] [INFO ] [MAIN ] SOL: Generated 1807 derivative records from 13297 primary records. [2025-10-16T22:42:22.148669] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-16T22:42:22.175902] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1807 records). [2025-10-16T22:42:22.176743] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-16T22:42:22.180159] [DEBUG] [LOCAL ] SOL: Derivative data saved (1807 records). [2025-10-16T22:42:22.182628] [INFO ] [MAIN ] Derivative Progress: 1421/1803 symbols completed. SOJE took 1.1s. Estimated remaining: 2m 26s. Rate: 157.5 symbols/min [2025-10-16T22:42:22.193188] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:22.193395] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-16T22:42:22.196560] [INFO ] [MAIN ] Derivative Progress: 1422/1803 symbols completed. SOL took 1.1s. Estimated remaining: 2m 25s. Rate: 157.6 symbols/min [2025-10-16T22:42:22.196983] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:22.218063] [DEBUG] [LOCAL ] SOLV: Loaded 44087 existing records from primary storage. [2025-10-16T22:42:22.218394] [INFO ] [MAIN ] SOLV: Loaded 44087 primary data records. [2025-10-16T22:42:22.465270] [DEBUG] [LOCAL ] SONY: Loaded 53769 existing records from primary storage. [2025-10-16T22:42:22.575065] [INFO ] [MAIN ] SONY: Loaded 53769 primary data records. [2025-10-16T22:42:22.575824] [DEBUG] [LOCAL ] SON: Loaded 43716 existing records from primary storage. [2025-10-16T22:42:22.590053] [INFO ] [MAIN ] SON: Loaded 43716 primary data records. [2025-10-16T22:42:23.280410] [DEBUG] [MAIN ] SOLV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:23.281630] [INFO ] [MAIN ] SOLV: Generated 1807 derivative records from 44087 primary records. [2025-10-16T22:42:23.281889] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-16T22:42:23.301822] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1807 records). [2025-10-16T22:42:23.302403] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-10-16T22:42:23.304619] [INFO ] [MAIN ] Derivative Progress: 1423/1803 symbols completed. SOLV took 1.2s. Estimated remaining: 2m 25s. Rate: 157.4 symbols/min [2025-10-16T22:42:23.326822] [DEBUG] [MAIN ] SON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:23.327612] [INFO ] [MAIN ] SON: Generated 1807 derivative records from 43716 primary records. [2025-10-16T22:42:23.339949] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-16T22:42:23.340944] [DEBUG] [MAIN ] SONY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:23.349211] [INFO ] [MAIN ] SONY: Generated 1807 derivative records from 53769 primary records. [2025-10-16T22:42:23.350475] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-16T22:42:23.374867] [DEBUG] [LOCAL ] SON: Derivative data saved (1807 records). [2025-10-16T22:42:23.374518] [DEBUG] [LOCAL ] SONY: Derivative data saved (1807 records). [2025-10-16T22:42:23.375066] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-10-16T22:42:23.375142] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-16T22:42:23.378241] [INFO ] [MAIN ] Derivative Progress: 1424/1803 symbols completed. SON took 1.2s. Estimated remaining: 2m 24s. Rate: 157.5 symbols/min [2025-10-16T22:42:23.381185] [INFO ] [MAIN ] Derivative Progress: 1425/1803 symbols completed. SONY took 1.2s. Estimated remaining: 2m 24s. Rate: 157.6 symbols/min [2025-10-16T22:42:23.381848] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:23.382393] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:23.381966] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:23.388486] [DEBUG] [LOCAL ] SOR: Loaded 2902 existing records from primary storage. [2025-10-16T22:42:23.388765] [INFO ] [MAIN ] SOR: Loaded 2902 primary data records. [2025-10-16T22:42:23.479922] [DEBUG] [LOCAL ] SOS: Loaded 9535 existing records from primary storage. [2025-10-16T22:42:23.496067] [INFO ] [MAIN ] SOS: Loaded 9535 primary data records. [2025-10-16T22:42:23.816846] [DEBUG] [LOCAL ] SPB: Loaded 34352 existing records from primary storage. [2025-10-16T22:42:23.833110] [INFO ] [MAIN ] SPB: Loaded 34352 primary data records. [2025-10-16T22:42:24.382338] [DEBUG] [MAIN ] SOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:24.383393] [INFO ] [MAIN ] SOR: Generated 1807 derivative records from 2902 primary records. [2025-10-16T22:42:24.385295] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-16T22:42:24.417323] [DEBUG] [LOCAL ] SOR: Derivative data saved (1807 records). [2025-10-16T22:42:24.417468] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-16T22:42:24.419590] [INFO ] [MAIN ] Derivative Progress: 1426/1803 symbols completed. SOR took 1.0s. Estimated remaining: 2m 24s. Rate: 157.4 symbols/min [2025-10-16T22:42:24.416802] [DEBUG] [MAIN ] SOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:24.420920] [INFO ] [MAIN ] SOS: Generated 1807 derivative records from 9535 primary records. [2025-10-16T22:42:24.421062] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:24.421948] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-16T22:42:24.437877] [DEBUG] [LOCAL ] SOS: Derivative data saved (1807 records). [2025-10-16T22:42:24.438028] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-16T22:42:24.440814] [INFO ] [MAIN ] Derivative Progress: 1427/1803 symbols completed. SOS took 1.1s. Estimated remaining: 2m 23s. Rate: 157.5 symbols/min [2025-10-16T22:42:24.444395] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:24.466229] [DEBUG] [MAIN ] SPB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:24.467295] [INFO ] [MAIN ] SPB: Generated 1807 derivative records from 34352 primary records. [2025-10-16T22:42:24.467477] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-16T22:42:24.471801] [DEBUG] [LOCAL ] SPE: Loaded 6288 existing records from primary storage. [2025-10-16T22:42:24.482852] [INFO ] [MAIN ] SPE: Loaded 6288 primary data records. [2025-10-16T22:42:24.622788] [DEBUG] [LOCAL ] SPB: Derivative data saved (1807 records). [2025-10-16T22:42:24.622310] [DEBUG] [LOCAL ] SPCE: Loaded 50365 existing records from primary storage. [2025-10-16T22:42:24.623549] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-16T22:42:24.623115] [INFO ] [MAIN ] SPCE: Loaded 50365 primary data records. [2025-10-16T22:42:24.641985] [INFO ] [MAIN ] Derivative Progress: 1428/1803 symbols completed. SPB took 1.3s. Estimated remaining: 2m 23s. Rate: 157.5 symbols/min [2025-10-16T22:42:24.683842] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:25.193334] [DEBUG] [LOCAL ] SPG: Loaded 50579 existing records from primary storage. [2025-10-16T22:42:25.205915] [INFO ] [MAIN ] SPG: Loaded 50579 primary data records. [2025-10-16T22:42:25.193790] [DEBUG] [MAIN ] SPE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:25.207286] [INFO ] [MAIN ] SPE: Generated 1807 derivative records from 6288 primary records. [2025-10-16T22:42:25.207390] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-16T22:42:25.206387] [DEBUG] [MAIN ] SPCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:25.208041] [INFO ] [MAIN ] SPCE: Generated 1807 derivative records from 50365 primary records. [2025-10-16T22:42:25.229128] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-16T22:42:25.381315] [DEBUG] [LOCAL ] SPE: Derivative data saved (1807 records). [2025-10-16T22:42:25.387943] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-16T22:42:25.392037] [INFO ] [MAIN ] Derivative Progress: 1429/1803 symbols completed. SPE took 0.9s. Estimated remaining: 2m 23s. Rate: 157.4 symbols/min [2025-10-16T22:42:25.406681] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1807 records). [2025-10-16T22:42:25.406868] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:25.437024] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-16T22:42:25.448678] [INFO ] [MAIN ] Derivative Progress: 1430/1803 symbols completed. SPCE took 1.0s. Estimated remaining: 2m 22s. Rate: 157.5 symbols/min [2025-10-16T22:42:25.479566] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:25.625671] [DEBUG] [LOCAL ] SPH: Loaded 16775 existing records from primary storage. [2025-10-16T22:42:25.626312] [INFO ] [MAIN ] SPH: Loaded 16775 primary data records. [2025-10-16T22:42:25.796964] [DEBUG] [LOCAL ] SPGI: Loaded 46239 existing records from primary storage. [2025-10-16T22:42:25.819743] [INFO ] [MAIN ] SPGI: Loaded 46239 primary data records. [2025-10-16T22:42:25.810854] [DEBUG] [MAIN ] SPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:25.847270] [INFO ] [MAIN ] SPG: Generated 1807 derivative records from 50579 primary records. [2025-10-16T22:42:25.998955] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-16T22:42:26.288202] [DEBUG] [LOCAL ] SPG: Derivative data saved (1807 records). [2025-10-16T22:42:26.288351] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-16T22:42:26.290470] [INFO ] [MAIN ] Derivative Progress: 1431/1803 symbols completed. SPG took 1.6s. Estimated remaining: 2m 22s. Rate: 157.4 symbols/min [2025-10-16T22:42:26.290936] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:26.314612] [DEBUG] [MAIN ] SPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:26.315690] [INFO ] [MAIN ] SPH: Generated 1807 derivative records from 16775 primary records. [2025-10-16T22:42:26.316032] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-16T22:42:26.369627] [DEBUG] [LOCAL ] SPH: Derivative data saved (1807 records). [2025-10-16T22:42:26.370738] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-16T22:42:26.373353] [INFO ] [MAIN ] Derivative Progress: 1432/1803 symbols completed. SPH took 0.9s. Estimated remaining: 2m 21s. Rate: 157.5 symbols/min [2025-10-16T22:42:26.373883] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:26.373696] [DEBUG] [MAIN ] SPGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:26.370543] [DEBUG] [LOCAL ] SPHR: Loaded 40893 existing records from primary storage. [2025-10-16T22:42:26.374591] [INFO ] [MAIN ] SPHR: Loaded 40893 primary data records. [2025-10-16T22:42:26.375362] [INFO ] [MAIN ] SPGI: Generated 1807 derivative records from 46239 primary records. [2025-10-16T22:42:26.375542] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-16T22:42:26.499827] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1807 records). [2025-10-16T22:42:26.500490] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-16T22:42:26.514534] [INFO ] [MAIN ] Derivative Progress: 1433/1803 symbols completed. SPGI took 1.1s. Estimated remaining: 2m 21s. Rate: 157.5 symbols/min [2025-10-16T22:42:26.542940] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:26.725489] [DEBUG] [LOCAL ] SPMC: Loaded 5301 existing records from primary storage. [2025-10-16T22:42:26.726230] [DEBUG] [LOCAL ] SPIR: Loaded 37864 existing records from primary storage. [2025-10-16T22:42:26.725669] [INFO ] [MAIN ] SPMC: Loaded 5301 primary data records. [2025-10-16T22:42:26.726360] [INFO ] [MAIN ] SPIR: Loaded 37864 primary data records. [2025-10-16T22:42:27.402055] [DEBUG] [MAIN ] SPHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:27.403195] [INFO ] [MAIN ] SPHR: Generated 1807 derivative records from 40893 primary records. [2025-10-16T22:42:27.403312] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-16T22:42:27.422109] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1807 records). [2025-10-16T22:42:27.422271] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-16T22:42:27.424343] [INFO ] [MAIN ] Derivative Progress: 1434/1803 symbols completed. SPHR took 1.1s. Estimated remaining: 2m 21s. Rate: 157.4 symbols/min [2025-10-16T22:42:27.424711] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:27.444672] [DEBUG] [MAIN ] SPIR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:27.445445] [INFO ] [MAIN ] SPIR: Generated 1807 derivative records from 37864 primary records. [2025-10-16T22:42:27.445684] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-16T22:42:27.466079] [DEBUG] [MAIN ] SPMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:27.470464] [INFO ] [MAIN ] SPMC: Generated 1807 derivative records from 5301 primary records. [2025-10-16T22:42:27.471076] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-16T22:42:27.496546] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1807 records). [2025-10-16T22:42:27.496753] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-16T22:42:27.499070] [INFO ] [MAIN ] Derivative Progress: 1435/1803 symbols completed. SPMC took 1.0s. Estimated remaining: 2m 20s. Rate: 157.5 symbols/min [2025-10-16T22:42:27.500101] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:27.500939] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1807 records). [2025-10-16T22:42:27.501092] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-16T22:42:27.503990] [INFO ] [MAIN ] Derivative Progress: 1436/1803 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 20s. Rate: 157.6 symbols/min [2025-10-16T22:42:27.514998] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:27.516234] [DEBUG] [LOCAL ] SPNT: Loaded 34961 existing records from primary storage. [2025-10-16T22:42:27.516462] [INFO ] [MAIN ] SPNT: Loaded 34961 primary data records. [2025-10-16T22:42:27.863676] [DEBUG] [LOCAL ] SPOT: Loaded 50683 existing records from primary storage. [2025-10-16T22:42:27.864004] [INFO ] [MAIN ] SPOT: Loaded 50683 primary data records. [2025-10-16T22:42:27.864625] [DEBUG] [LOCAL ] SPR: Loaded 41421 existing records from primary storage. [2025-10-16T22:42:27.886275] [INFO ] [MAIN ] SPR: Loaded 41421 primary data records. [2025-10-16T22:42:28.479532] [DEBUG] [MAIN ] SPNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:28.481555] [INFO ] [MAIN ] SPNT: Generated 1807 derivative records from 34961 primary records. [2025-10-16T22:42:28.482578] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-16T22:42:28.500201] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1807 records). [2025-10-16T22:42:28.500533] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-16T22:42:28.502908] [INFO ] [MAIN ] Derivative Progress: 1437/1803 symbols completed. SPNT took 1.1s. Estimated remaining: 2m 20s. Rate: 157.4 symbols/min [2025-10-16T22:42:28.503248] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:28.541984] [DEBUG] [MAIN ] SPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:28.541625] [DEBUG] [LOCAL ] SPRU: Loaded 9836 existing records from primary storage. [2025-10-16T22:42:28.543315] [INFO ] [MAIN ] SPR: Generated 1807 derivative records from 41421 primary records. [2025-10-16T22:42:28.542545] [DEBUG] [MAIN ] SPOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:28.544156] [INFO ] [MAIN ] SPOT: Generated 1807 derivative records from 50683 primary records. [2025-10-16T22:42:28.544272] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-16T22:42:28.544467] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-10-16T22:42:28.544371] [INFO ] [MAIN ] SPRU: Loaded 9836 primary data records. [2025-10-16T22:42:28.662599] [DEBUG] [LOCAL ] SPR: Derivative data saved (1807 records). [2025-10-16T22:42:28.676813] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-16T22:42:28.686207] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1807 records). [2025-10-16T22:42:28.685305] [INFO ] [MAIN ] Derivative Progress: 1438/1803 symbols completed. SPR took 1.2s. Estimated remaining: 2m 19s. Rate: 157.5 symbols/min [2025-10-16T22:42:28.696720] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-10-16T22:42:28.731634] [INFO ] [MAIN ] Derivative Progress: 1439/1803 symbols completed. SPOT took 1.2s. Estimated remaining: 2m 19s. Rate: 157.6 symbols/min [2025-10-16T22:42:28.896184] [DEBUG] [MAIN ] SPRU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:28.896805] [INFO ] [MAIN ] SPRU: Generated 1807 derivative records from 9836 primary records. [2025-10-16T22:42:28.896879] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-16T22:42:28.911664] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1807 records). [2025-10-16T22:42:28.911728] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-10-16T22:42:28.913842] [INFO ] [MAIN ] Derivative Progress: 1440/1803 symbols completed. SPRU took 0.4s. Estimated remaining: 2m 18s. Rate: 157.6 symbols/min [2025-10-16T22:42:28.914315] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:28.914395] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:28.914241] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:28.927203] [DEBUG] [LOCAL ] SPXX: Loaded 9377 existing records from primary storage. [2025-10-16T22:42:28.927531] [INFO ] [MAIN ] SPXX: Loaded 9377 primary data records. [2025-10-16T22:42:29.059590] [DEBUG] [LOCAL ] SPXC: Loaded 23611 existing records from primary storage. [2025-10-16T22:42:29.070392] [INFO ] [MAIN ] SPXC: Loaded 23611 primary data records. [2025-10-16T22:42:29.307707] [DEBUG] [LOCAL ] SQM: Loaded 49174 existing records from primary storage. [2025-10-16T22:42:29.378044] [INFO ] [MAIN ] SQM: Loaded 49174 primary data records. [2025-10-16T22:42:29.921988] [DEBUG] [MAIN ] SPXX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:29.935632] [INFO ] [MAIN ] SPXX: Generated 1807 derivative records from 9377 primary records. [2025-10-16T22:42:29.936153] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-16T22:42:29.937857] [DEBUG] [MAIN ] SPXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:29.939671] [INFO ] [MAIN ] SPXC: Generated 1807 derivative records from 23611 primary records. [2025-10-16T22:42:29.940129] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-16T22:42:29.974091] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1807 records). [2025-10-16T22:42:29.974371] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-16T22:42:29.973993] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1807 records). [2025-10-16T22:42:29.976603] [INFO ] [MAIN ] Derivative Progress: 1441/1803 symbols completed. SPXX took 1.1s. Estimated remaining: 2m 18s. Rate: 157.4 symbols/min [2025-10-16T22:42:29.977492] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-10-16T22:42:29.977845] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:29.981913] [INFO ] [MAIN ] Derivative Progress: 1442/1803 symbols completed. SPXC took 1.1s. Estimated remaining: 2m 17s. Rate: 157.5 symbols/min [2025-10-16T22:42:29.983140] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:29.998160] [DEBUG] [MAIN ] SQM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:29.999063] [INFO ] [MAIN ] SQM: Generated 1807 derivative records from 49174 primary records. [2025-10-16T22:42:30.000726] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-16T22:42:30.031378] [DEBUG] [LOCAL ] SQM: Derivative data saved (1807 records). [2025-10-16T22:42:30.031805] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-10-16T22:42:30.034110] [INFO ] [MAIN ] Derivative Progress: 1443/1803 symbols completed. SQM took 1.1s. Estimated remaining: 2m 17s. Rate: 157.6 symbols/min [2025-10-16T22:42:30.041688] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:30.052357] [DEBUG] [LOCAL ] SQNS: Loaded 27732 existing records from primary storage. [2025-10-16T22:42:30.052503] [INFO ] [MAIN ] SQNS: Loaded 27732 primary data records. [2025-10-16T22:42:30.156866] [DEBUG] [LOCAL ] SR: Loaded 32722 existing records from primary storage. [2025-10-16T22:42:30.167946] [INFO ] [MAIN ] SR: Loaded 32722 primary data records. [2025-10-16T22:42:30.591593] [DEBUG] [LOCAL ] SRE: Loaded 53806 existing records from primary storage. [2025-10-16T22:42:30.709294] [INFO ] [MAIN ] SRE: Loaded 53806 primary data records. [2025-10-16T22:42:31.096881] [DEBUG] [MAIN ] SQNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:31.098275] [INFO ] [MAIN ] SQNS: Generated 1807 derivative records from 27732 primary records. [2025-10-16T22:42:31.098684] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-16T22:42:31.133764] [DEBUG] [MAIN ] SR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:31.134194] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1807 records). [2025-10-16T22:42:31.134592] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-16T22:42:31.136835] [INFO ] [MAIN ] Derivative Progress: 1444/1803 symbols completed. SQNS took 1.2s. Estimated remaining: 2m 17s. Rate: 157.4 symbols/min [2025-10-16T22:42:31.137026] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:31.138081] [INFO ] [MAIN ] SR: Generated 1807 derivative records from 32722 primary records. [2025-10-16T22:42:31.138468] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-16T22:42:31.160308] [DEBUG] [LOCAL ] SR: Derivative data saved (1807 records). [2025-10-16T22:42:31.160614] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-16T22:42:31.178779] [INFO ] [MAIN ] Derivative Progress: 1445/1803 symbols completed. SR took 1.2s. Estimated remaining: 2m 16s. Rate: 157.5 symbols/min [2025-10-16T22:42:31.179378] [DEBUG] [MAIN ] SRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:31.184591] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:31.184465] [INFO ] [MAIN ] SRE: Generated 1807 derivative records from 53806 primary records. [2025-10-16T22:42:31.184949] [DEBUG] [LOCAL ] SREA: Loaded 10055 existing records from primary storage. [2025-10-16T22:42:31.185104] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-16T22:42:31.185355] [INFO ] [MAIN ] SREA: Loaded 10055 primary data records. [2025-10-16T22:42:31.258808] [DEBUG] [LOCAL ] SRE: Derivative data saved (1807 records). [2025-10-16T22:42:31.268270] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-16T22:42:31.270810] [INFO ] [MAIN ] Derivative Progress: 1446/1803 symbols completed. SRE took 1.2s. Estimated remaining: 2m 16s. Rate: 157.6 symbols/min [2025-10-16T22:42:31.288794] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:31.541011] [DEBUG] [LOCAL ] SRG: Loaded 15555 existing records from primary storage. [2025-10-16T22:42:31.541343] [INFO ] [MAIN ] SRG: Loaded 15555 primary data records. [2025-10-16T22:42:31.542060] [DEBUG] [LOCAL ] SRFM: Loaded 39445 existing records from primary storage. [2025-10-16T22:42:31.573220] [INFO ] [MAIN ] SRFM: Loaded 39445 primary data records. [2025-10-16T22:42:32.156517] [DEBUG] [MAIN ] SREA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:32.157777] [INFO ] [MAIN ] SREA: Generated 1807 derivative records from 10055 primary records. [2025-10-16T22:42:32.158142] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-16T22:42:32.177708] [DEBUG] [LOCAL ] SREA: Derivative data saved (1807 records). [2025-10-16T22:42:32.177907] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-16T22:42:32.180676] [INFO ] [MAIN ] Derivative Progress: 1447/1803 symbols completed. SREA took 1.0s. Estimated remaining: 2m 16s. Rate: 157.4 symbols/min [2025-10-16T22:42:32.193661] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:32.193981] [DEBUG] [MAIN ] SRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:32.195160] [INFO ] [MAIN ] SRG: Generated 1807 derivative records from 15555 primary records. [2025-10-16T22:42:32.195337] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-16T22:42:32.214774] [DEBUG] [LOCAL ] SRG: Derivative data saved (1807 records). [2025-10-16T22:42:32.215079] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-16T22:42:32.217323] [INFO ] [MAIN ] Derivative Progress: 1448/1803 symbols completed. SRG took 0.9s. Estimated remaining: 2m 15s. Rate: 157.5 symbols/min [2025-10-16T22:42:32.217762] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:32.237952] [DEBUG] [MAIN ] SRFM: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:42:32.238724] [INFO ] [MAIN ] SRFM: Generated 1806 derivative records from 39445 primary records. [2025-10-16T22:42:32.238934] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-16T22:42:32.261425] [DEBUG] [LOCAL ] SRI: Loaded 26642 existing records from primary storage. [2025-10-16T22:42:32.263083] [INFO ] [MAIN ] SRI: Loaded 26642 primary data records. [2025-10-16T22:42:32.267363] [DEBUG] [LOCAL ] SRV: Loaded 7481 existing records from primary storage. [2025-10-16T22:42:32.280157] [INFO ] [MAIN ] SRV: Loaded 7481 primary data records. [2025-10-16T22:42:32.291920] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1806 records). [2025-10-16T22:42:32.311578] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-16T22:42:32.344849] [INFO ] [MAIN ] Derivative Progress: 1449/1803 symbols completed. SRFM took 1.2s. Estimated remaining: 2m 15s. Rate: 157.6 symbols/min [2025-10-16T22:42:32.409907] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:32.890497] [DEBUG] [LOCAL ] SSB: Loaded 43122 existing records from primary storage. [2025-10-16T22:42:32.891175] [INFO ] [MAIN ] SSB: Loaded 43122 primary data records. [2025-10-16T22:42:33.260207] [DEBUG] [MAIN ] SRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:33.262121] [INFO ] [MAIN ] SRI: Generated 1807 derivative records from 26642 primary records. [2025-10-16T22:42:33.262336] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-16T22:42:33.293062] [DEBUG] [LOCAL ] SRI: Derivative data saved (1807 records). [2025-10-16T22:42:33.289966] [DEBUG] [MAIN ] SRV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:33.294326] [INFO ] [MAIN ] SRV: Generated 1807 derivative records from 7481 primary records. [2025-10-16T22:42:33.294502] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-16T22:42:33.294422] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-16T22:42:33.296790] [INFO ] [MAIN ] Derivative Progress: 1450/1803 symbols completed. SRI took 1.1s. Estimated remaining: 2m 15s. Rate: 157.5 symbols/min [2025-10-16T22:42:33.297542] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:33.315776] [DEBUG] [LOCAL ] SRV: Derivative data saved (1807 records). [2025-10-16T22:42:33.317184] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-16T22:42:33.319822] [INFO ] [MAIN ] Derivative Progress: 1451/1803 symbols completed. SRV took 1.1s. Estimated remaining: 2m 14s. Rate: 157.6 symbols/min [2025-10-16T22:42:33.320196] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:33.344873] [DEBUG] [MAIN ] SSB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:33.345563] [INFO ] [MAIN ] SSB: Generated 1807 derivative records from 43122 primary records. [2025-10-16T22:42:33.346089] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-16T22:42:33.354512] [DEBUG] [LOCAL ] SSD: Loaded 22749 existing records from primary storage. [2025-10-16T22:42:33.361795] [INFO ] [MAIN ] SSD: Loaded 22749 primary data records. [2025-10-16T22:42:33.468758] [DEBUG] [LOCAL ] SSB: Derivative data saved (1807 records). [2025-10-16T22:42:33.474015] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-16T22:42:33.491769] [INFO ] [MAIN ] Derivative Progress: 1452/1803 symbols completed. SSB took 1.1s. Estimated remaining: 2m 14s. Rate: 157.6 symbols/min [2025-10-16T22:42:33.491992] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:33.519954] [DEBUG] [LOCAL ] SSL: Loaded 41797 existing records from primary storage. [2025-10-16T22:42:33.548677] [INFO ] [MAIN ] SSL: Loaded 41797 primary data records. [2025-10-16T22:42:33.736279] [DEBUG] [LOCAL ] SST: Loaded 11622 existing records from primary storage. [2025-10-16T22:42:33.754032] [INFO ] [MAIN ] SST: Loaded 11622 primary data records. [2025-10-16T22:42:34.351272] [DEBUG] [MAIN ] SSD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:34.353193] [INFO ] [MAIN ] SSD: Generated 1807 derivative records from 22749 primary records. [2025-10-16T22:42:34.353383] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-16T22:42:34.370449] [DEBUG] [LOCAL ] SSD: Derivative data saved (1807 records). [2025-10-16T22:42:34.372225] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-10-16T22:42:34.374966] [INFO ] [MAIN ] Derivative Progress: 1453/1803 symbols completed. SSD took 1.1s. Estimated remaining: 2m 13s. Rate: 157.5 symbols/min [2025-10-16T22:42:34.388266] [DEBUG] [MAIN ] SSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:34.388942] [INFO ] [MAIN ] SSL: Generated 1807 derivative records from 41797 primary records. [2025-10-16T22:42:34.389095] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-16T22:42:34.415721] [DEBUG] [MAIN ] SST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:34.416554] [INFO ] [MAIN ] SST: Generated 1807 derivative records from 11622 primary records. [2025-10-16T22:42:34.417048] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-16T22:42:34.420075] [DEBUG] [LOCAL ] SSL: Derivative data saved (1807 records). [2025-10-16T22:42:34.427344] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-16T22:42:34.432112] [INFO ] [MAIN ] Derivative Progress: 1454/1803 symbols completed. SSL took 1.1s. Estimated remaining: 2m 13s. Rate: 157.6 symbols/min [2025-10-16T22:42:34.436036] [DEBUG] [LOCAL ] SST: Derivative data saved (1807 records). [2025-10-16T22:42:34.436094] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-16T22:42:34.438589] [INFO ] [MAIN ] Derivative Progress: 1455/1803 symbols completed. SST took 0.9s. Estimated remaining: 2m 12s. Rate: 157.7 symbols/min [2025-10-16T22:42:34.438971] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:34.439066] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:34.439152] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:34.466330] [DEBUG] [LOCAL ] SSTK: Loaded 25552 existing records from primary storage. [2025-10-16T22:42:34.479354] [INFO ] [MAIN ] SSTK: Loaded 25552 primary data records. [2025-10-16T22:42:34.627076] [DEBUG] [LOCAL ] STAG: Loaded 50506 existing records from primary storage. [2025-10-16T22:42:34.637580] [INFO ] [MAIN ] STAG: Loaded 50506 primary data records. [2025-10-16T22:42:34.719399] [DEBUG] [LOCAL ] ST: Loaded 50212 existing records from primary storage. [2025-10-16T22:42:34.828871] [INFO ] [MAIN ] ST: Loaded 50212 primary data records. [2025-10-16T22:42:35.490326] [DEBUG] [MAIN ] SSTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:35.491460] [INFO ] [MAIN ] SSTK: Generated 1807 derivative records from 25552 primary records. [2025-10-16T22:42:35.491710] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-16T22:42:35.509397] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1807 records). [2025-10-16T22:42:35.511883] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-16T22:42:35.513933] [INFO ] [MAIN ] Derivative Progress: 1456/1803 symbols completed. SSTK took 1.1s. Estimated remaining: 2m 12s. Rate: 157.5 symbols/min [2025-10-16T22:42:35.514084] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:35.527833] [DEBUG] [MAIN ] STAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:35.528481] [INFO ] [MAIN ] STAG: Generated 1807 derivative records from 50506 primary records. [2025-10-16T22:42:35.528779] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-16T22:42:35.546741] [DEBUG] [LOCAL ] STAG: Derivative data saved (1807 records). [2025-10-16T22:42:35.546990] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-16T22:42:35.549531] [INFO ] [MAIN ] Derivative Progress: 1457/1803 symbols completed. STAG took 1.1s. Estimated remaining: 2m 12s. Rate: 157.6 symbols/min [2025-10-16T22:42:35.553717] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:35.567536] [DEBUG] [MAIN ] ST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:35.568339] [INFO ] [MAIN ] ST: Generated 1807 derivative records from 50212 primary records. [2025-10-16T22:42:35.574029] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-16T22:42:35.574863] [DEBUG] [LOCAL ] STC: Loaded 17452 existing records from primary storage. [2025-10-16T22:42:35.575267] [INFO ] [MAIN ] STC: Loaded 17452 primary data records. [2025-10-16T22:42:35.632520] [DEBUG] [LOCAL ] ST: Derivative data saved (1807 records). [2025-10-16T22:42:35.652984] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-16T22:42:35.667267] [INFO ] [MAIN ] Derivative Progress: 1458/1803 symbols completed. ST took 1.2s. Estimated remaining: 2m 11s. Rate: 157.6 symbols/min [2025-10-16T22:42:35.694084] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:35.904469] [DEBUG] [LOCAL ] STE: Loaded 35653 existing records from primary storage. [2025-10-16T22:42:35.905428] [INFO ] [MAIN ] STE: Loaded 35653 primary data records. [2025-10-16T22:42:36.026993] [DEBUG] [LOCAL ] STEL: Loaded 22796 existing records from primary storage. [2025-10-16T22:42:36.044436] [INFO ] [MAIN ] STEL: Loaded 22796 primary data records. [2025-10-16T22:42:36.403986] [DEBUG] [MAIN ] STC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:36.433172] [INFO ] [MAIN ] STC: Generated 1807 derivative records from 17452 primary records. [2025-10-16T22:42:36.552104] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-16T22:42:36.569923] [DEBUG] [LOCAL ] STC: Derivative data saved (1807 records). [2025-10-16T22:42:36.570958] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-16T22:42:36.573024] [INFO ] [MAIN ] Derivative Progress: 1459/1803 symbols completed. STC took 1.1s. Estimated remaining: 2m 11s. Rate: 157.5 symbols/min [2025-10-16T22:42:36.573260] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:36.596461] [DEBUG] [MAIN ] STE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:36.599231] [INFO ] [MAIN ] STE: Generated 1807 derivative records from 35653 primary records. [2025-10-16T22:42:36.600990] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-10-16T22:42:36.639106] [DEBUG] [LOCAL ] STE: Derivative data saved (1807 records). [2025-10-16T22:42:36.639453] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-10-16T22:42:36.639756] [DEBUG] [MAIN ] STEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:36.642303] [INFO ] [MAIN ] Derivative Progress: 1460/1803 symbols completed. STE took 1.1s. Estimated remaining: 2m 11s. Rate: 157.6 symbols/min [2025-10-16T22:42:36.643679] [INFO ] [MAIN ] STEL: Generated 1807 derivative records from 22796 primary records. [2025-10-16T22:42:36.643960] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-16T22:42:36.652115] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:36.661409] [DEBUG] [LOCAL ] STEL: Derivative data saved (1807 records). [2025-10-16T22:42:36.661772] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-16T22:42:36.664228] [INFO ] [MAIN ] Derivative Progress: 1461/1803 symbols completed. STEL took 1.0s. Estimated remaining: 2m 10s. Rate: 157.7 symbols/min [2025-10-16T22:42:36.675310] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:36.676412] [DEBUG] [LOCAL ] STEM: Loaded 39157 existing records from primary storage. [2025-10-16T22:42:36.676571] [INFO ] [MAIN ] STEM: Loaded 39157 primary data records. [2025-10-16T22:42:36.785799] [DEBUG] [LOCAL ] STK: Loaded 9817 existing records from primary storage. [2025-10-16T22:42:36.797361] [INFO ] [MAIN ] STK: Loaded 9817 primary data records. [2025-10-16T22:42:36.833949] [DEBUG] [LOCAL ] STEW: Loaded 15758 existing records from primary storage. [2025-10-16T22:42:36.881895] [INFO ] [MAIN ] STEW: Loaded 15758 primary data records. [2025-10-16T22:42:37.651951] [DEBUG] [MAIN ] STEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:37.653079] [INFO ] [MAIN ] STEM: Generated 1807 derivative records from 39157 primary records. [2025-10-16T22:42:37.653459] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-16T22:42:37.666235] [DEBUG] [MAIN ] STK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:37.668502] [INFO ] [MAIN ] STK: Generated 1807 derivative records from 9817 primary records. [2025-10-16T22:42:37.680791] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-16T22:42:37.685074] [DEBUG] [LOCAL ] STEM: Derivative data saved (1807 records). [2025-10-16T22:42:37.694286] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-16T22:42:37.704532] [DEBUG] [LOCAL ] STK: Derivative data saved (1807 records). [2025-10-16T22:42:37.704719] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-16T22:42:37.704425] [INFO ] [MAIN ] Derivative Progress: 1462/1803 symbols completed. STEM took 1.1s. Estimated remaining: 2m 10s. Rate: 157.5 symbols/min [2025-10-16T22:42:37.707734] [INFO ] [MAIN ] Derivative Progress: 1463/1803 symbols completed. STK took 1.0s. Estimated remaining: 2m 9s. Rate: 157.6 symbols/min [2025-10-16T22:42:37.705081] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:37.707961] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:37.721416] [DEBUG] [MAIN ] STEW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:37.722070] [INFO ] [MAIN ] STEW: Generated 1807 derivative records from 15758 primary records. [2025-10-16T22:42:37.722310] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-16T22:42:37.738955] [DEBUG] [LOCAL ] STEW: Derivative data saved (1807 records). [2025-10-16T22:42:37.739159] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-16T22:42:37.741778] [INFO ] [MAIN ] Derivative Progress: 1464/1803 symbols completed. STEW took 1.1s. Estimated remaining: 2m 9s. Rate: 157.7 symbols/min [2025-10-16T22:42:37.742005] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:37.789021] [DEBUG] [LOCAL ] STN: Loaded 22966 existing records from primary storage. [2025-10-16T22:42:37.789276] [INFO ] [MAIN ] STN: Loaded 22966 primary data records. [2025-10-16T22:42:37.921989] [DEBUG] [LOCAL ] STLA: Loaded 53945 existing records from primary storage. [2025-10-16T22:42:37.920813] [DEBUG] [LOCAL ] STM: Loaded 53962 existing records from primary storage. [2025-10-16T22:42:37.922459] [INFO ] [MAIN ] STM: Loaded 53962 primary data records. [2025-10-16T22:42:37.922297] [INFO ] [MAIN ] STLA: Loaded 53945 primary data records. [2025-10-16T22:42:38.727892] [DEBUG] [MAIN ] STN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:38.730617] [INFO ] [MAIN ] STN: Generated 1807 derivative records from 22966 primary records. [2025-10-16T22:42:38.731002] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-16T22:42:38.761581] [DEBUG] [LOCAL ] STN: Derivative data saved (1807 records). [2025-10-16T22:42:38.761741] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-16T22:42:38.763409] [INFO ] [MAIN ] Derivative Progress: 1465/1803 symbols completed. STN took 1.0s. Estimated remaining: 2m 9s. Rate: 157.5 symbols/min [2025-10-16T22:42:38.760508] [DEBUG] [MAIN ] STM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:38.764372] [INFO ] [MAIN ] STM: Generated 1807 derivative records from 53962 primary records. [2025-10-16T22:42:38.764479] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-16T22:42:38.764682] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:38.790783] [DEBUG] [MAIN ] STLA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:38.792327] [INFO ] [MAIN ] STLA: Generated 1807 derivative records from 53945 primary records. [2025-10-16T22:42:38.792713] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-16T22:42:38.805164] [DEBUG] [LOCAL ] STM: Derivative data saved (1807 records). [2025-10-16T22:42:38.806313] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-16T22:42:38.809019] [INFO ] [MAIN ] Derivative Progress: 1466/1803 symbols completed. STM took 1.1s. Estimated remaining: 2m 8s. Rate: 157.6 symbols/min [2025-10-16T22:42:38.812344] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:38.818246] [DEBUG] [LOCAL ] STLA: Derivative data saved (1807 records). [2025-10-16T22:42:38.818383] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-16T22:42:38.821616] [INFO ] [MAIN ] Derivative Progress: 1467/1803 symbols completed. STLA took 1.1s. Estimated remaining: 2m 8s. Rate: 157.7 symbols/min [2025-10-16T22:42:38.822126] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:38.842488] [DEBUG] [LOCAL ] STRV: Loaded 11224 existing records from primary storage. [2025-10-16T22:42:38.842741] [INFO ] [MAIN ] STRV: Loaded 11224 primary data records. [2025-10-16T22:42:38.959380] [DEBUG] [LOCAL ] STNG: Loaded 43907 existing records from primary storage. [2025-10-16T22:42:39.018628] [INFO ] [MAIN ] STNG: Loaded 43907 primary data records. [2025-10-16T22:42:39.311530] [DEBUG] [LOCAL ] STT: Loaded 51424 existing records from primary storage. [2025-10-16T22:42:39.329992] [INFO ] [MAIN ] STT: Loaded 51424 primary data records. [2025-10-16T22:42:39.829248] [DEBUG] [MAIN ] STRV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:42:39.831071] [INFO ] [MAIN ] STRV: Generated 1806 derivative records from 11224 primary records. [2025-10-16T22:42:39.831256] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-16T22:42:39.852887] [DEBUG] [MAIN ] STNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:39.853630] [INFO ] [MAIN ] STNG: Generated 1807 derivative records from 43907 primary records. [2025-10-16T22:42:39.858677] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-16T22:42:39.863549] [DEBUG] [LOCAL ] STRV: Derivative data saved (1806 records). [2025-10-16T22:42:39.863680] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-16T22:42:39.865910] [INFO ] [MAIN ] Derivative Progress: 1468/1803 symbols completed. STRV took 1.1s. Estimated remaining: 2m 8s. Rate: 157.5 symbols/min [2025-10-16T22:42:39.895539] [DEBUG] [MAIN ] STT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:39.896237] [DEBUG] [LOCAL ] STNG: Derivative data saved (1807 records). [2025-10-16T22:42:39.896931] [INFO ] [MAIN ] STT: Generated 1807 derivative records from 51424 primary records. [2025-10-16T22:42:39.897069] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-10-16T22:42:39.897024] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-16T22:42:39.899952] [INFO ] [MAIN ] Derivative Progress: 1469/1803 symbols completed. STNG took 1.1s. Estimated remaining: 2m 7s. Rate: 157.6 symbols/min [2025-10-16T22:42:39.915729] [DEBUG] [LOCAL ] STT: Derivative data saved (1807 records). [2025-10-16T22:42:39.915792] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-10-16T22:42:39.918769] [INFO ] [MAIN ] Derivative Progress: 1470/1803 symbols completed. STT took 1.1s. Estimated remaining: 2m 7s. Rate: 157.7 symbols/min [2025-10-16T22:42:39.919126] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:39.919304] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:39.919203] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:39.925389] [DEBUG] [LOCAL ] STXD: Loaded 1253 existing records from primary storage. [2025-10-16T22:42:39.925540] [INFO ] [MAIN ] STXD: Loaded 1253 primary data records. [2025-10-16T22:42:40.259303] [DEBUG] [LOCAL ] STVN: Loaded 26968 existing records from primary storage. [2025-10-16T22:42:40.267460] [INFO ] [MAIN ] STVN: Loaded 26968 primary data records. [2025-10-16T22:42:40.396953] [DEBUG] [LOCAL ] STWD: Loaded 52371 existing records from primary storage. [2025-10-16T22:42:40.407501] [INFO ] [MAIN ] STWD: Loaded 52371 primary data records. [2025-10-16T22:42:40.957146] [DEBUG] [MAIN ] STXD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:42:40.958276] [INFO ] [MAIN ] STXD: Generated 1806 derivative records from 1253 primary records. [2025-10-16T22:42:40.958432] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-16T22:42:40.974380] [DEBUG] [LOCAL ] STXD: Derivative data saved (1806 records). [2025-10-16T22:42:40.975127] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-16T22:42:40.977071] [INFO ] [MAIN ] Derivative Progress: 1471/1803 symbols completed. STXD took 1.1s. Estimated remaining: 2m 6s. Rate: 157.5 symbols/min [2025-10-16T22:42:40.977393] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:40.984600] [DEBUG] [LOCAL ] STXE: Loaded 2117 existing records from primary storage. [2025-10-16T22:42:40.992463] [INFO ] [MAIN ] STXE: Loaded 2117 primary data records. [2025-10-16T22:42:41.027821] [DEBUG] [MAIN ] STVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:41.034114] [INFO ] [MAIN ] STVN: Generated 1807 derivative records from 26968 primary records. [2025-10-16T22:42:41.040840] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-16T22:42:41.104338] [DEBUG] [LOCAL ] STVN: Derivative data saved (1807 records). [2025-10-16T22:42:41.122299] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-16T22:42:41.130040] [INFO ] [MAIN ] Derivative Progress: 1472/1803 symbols completed. STVN took 1.2s. Estimated remaining: 2m 6s. Rate: 157.6 symbols/min [2025-10-16T22:42:41.159288] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:41.327856] [DEBUG] [MAIN ] STWD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:41.329312] [INFO ] [MAIN ] STWD: Generated 1807 derivative records from 52371 primary records. [2025-10-16T22:42:41.329554] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-16T22:42:41.331968] [DEBUG] [LOCAL ] STXG: Loaded 2433 existing records from primary storage. [2025-10-16T22:42:41.333744] [INFO ] [MAIN ] STXG: Loaded 2433 primary data records. [2025-10-16T22:42:41.545126] [DEBUG] [LOCAL ] STWD: Derivative data saved (1807 records). [2025-10-16T22:42:41.661332] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-16T22:42:41.664875] [INFO ] [MAIN ] Derivative Progress: 1473/1803 symbols completed. STWD took 1.7s. Estimated remaining: 2m 6s. Rate: 157.6 symbols/min [2025-10-16T22:42:41.665453] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:41.672952] [DEBUG] [LOCAL ] STXK: Loaded 1535 existing records from primary storage. [2025-10-16T22:42:41.675221] [INFO ] [MAIN ] STXK: Loaded 1535 primary data records. [2025-10-16T22:42:41.798426] [DEBUG] [MAIN ] STXE: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:42:41.822177] [INFO ] [MAIN ] STXE: Generated 1806 derivative records from 2117 primary records. [2025-10-16T22:42:41.830679] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-16T22:42:42.063746] [DEBUG] [MAIN ] STXG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:42:42.064863] [DEBUG] [LOCAL ] STXE: Derivative data saved (1806 records). [2025-10-16T22:42:42.065917] [INFO ] [MAIN ] STXG: Generated 1806 derivative records from 2433 primary records. [2025-10-16T22:42:42.066635] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-16T22:42:42.067262] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-16T22:42:42.069987] [INFO ] [MAIN ] Derivative Progress: 1474/1803 symbols completed. STXE took 1.1s. Estimated remaining: 2m 5s. Rate: 157.6 symbols/min [2025-10-16T22:42:42.070496] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:42.085978] [DEBUG] [LOCAL ] STXG: Derivative data saved (1806 records). [2025-10-16T22:42:42.086102] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-16T22:42:42.089002] [INFO ] [MAIN ] Derivative Progress: 1475/1803 symbols completed. STXG took 0.9s. Estimated remaining: 2m 5s. Rate: 157.7 symbols/min [2025-10-16T22:42:42.089706] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:42.095575] [DEBUG] [LOCAL ] STXV: Loaded 1531 existing records from primary storage. [2025-10-16T22:42:42.095993] [INFO ] [MAIN ] STXV: Loaded 1531 primary data records. [2025-10-16T22:42:42.098474] [DEBUG] [LOCAL ] STXT: Loaded 2516 existing records from primary storage. [2025-10-16T22:42:42.131234] [INFO ] [MAIN ] STXT: Loaded 2516 primary data records. [2025-10-16T22:42:42.487300] [DEBUG] [MAIN ] STXK: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:42:42.493258] [INFO ] [MAIN ] STXK: Generated 1806 derivative records from 1535 primary records. [2025-10-16T22:42:42.766329] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-16T22:42:42.784767] [DEBUG] [LOCAL ] STXK: Derivative data saved (1806 records). [2025-10-16T22:42:42.785295] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-16T22:42:42.787920] [INFO ] [MAIN ] Derivative Progress: 1476/1803 symbols completed. STXK took 1.1s. Estimated remaining: 2m 5s. Rate: 157.6 symbols/min [2025-10-16T22:42:42.788101] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:42.812726] [DEBUG] [MAIN ] STXV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:42:42.826194] [INFO ] [MAIN ] STXV: Generated 1806 derivative records from 1531 primary records. [2025-10-16T22:42:42.826666] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-16T22:42:42.826554] [DEBUG] [MAIN ] STXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:42.828019] [INFO ] [MAIN ] STXT: Generated 1807 derivative records from 2516 primary records. [2025-10-16T22:42:42.828412] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-16T22:42:42.867488] [DEBUG] [LOCAL ] STXV: Derivative data saved (1806 records). [2025-10-16T22:42:42.868804] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-16T22:42:42.871463] [INFO ] [MAIN ] Derivative Progress: 1477/1803 symbols completed. STXV took 0.8s. Estimated remaining: 2m 4s. Rate: 157.7 symbols/min [2025-10-16T22:42:42.872055] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:42.872595] [DEBUG] [LOCAL ] STXT: Derivative data saved (1807 records). [2025-10-16T22:42:42.872718] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-16T22:42:42.875114] [INFO ] [MAIN ] Derivative Progress: 1478/1803 symbols completed. STXT took 0.8s. Estimated remaining: 2m 4s. Rate: 157.8 symbols/min [2025-10-16T22:42:42.875432] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:42.894509] [DEBUG] [LOCAL ] STZ: Loaded 52801 existing records from primary storage. [2025-10-16T22:42:42.894712] [INFO ] [MAIN ] STZ: Loaded 52801 primary data records. [2025-10-16T22:42:43.236694] [DEBUG] [LOCAL ] SU: Loaded 53816 existing records from primary storage. [2025-10-16T22:42:43.237049] [INFO ] [MAIN ] SU: Loaded 53816 primary data records. [2025-10-16T22:42:43.237945] [DEBUG] [LOCAL ] SUI: Loaded 42398 existing records from primary storage. [2025-10-16T22:42:43.280853] [INFO ] [MAIN ] SUI: Loaded 42398 primary data records. [2025-10-16T22:42:43.845344] [DEBUG] [MAIN ] STZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:43.846853] [INFO ] [MAIN ] STZ: Generated 1807 derivative records from 52801 primary records. [2025-10-16T22:42:43.847027] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-10-16T22:42:43.864118] [DEBUG] [LOCAL ] STZ: Derivative data saved (1807 records). [2025-10-16T22:42:43.864239] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-10-16T22:42:43.866396] [INFO ] [MAIN ] Derivative Progress: 1479/1803 symbols completed. STZ took 1.1s. Estimated remaining: 2m 3s. Rate: 157.6 symbols/min [2025-10-16T22:42:43.866711] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:43.884704] [DEBUG] [MAIN ] SU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:43.885362] [INFO ] [MAIN ] SU: Generated 1807 derivative records from 53816 primary records. [2025-10-16T22:42:43.885525] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-16T22:42:43.903220] [DEBUG] [LOCAL ] SU: Derivative data saved (1807 records). [2025-10-16T22:42:43.904936] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-16T22:42:43.907052] [INFO ] [MAIN ] Derivative Progress: 1480/1803 symbols completed. SU took 1.0s. Estimated remaining: 2m 3s. Rate: 157.7 symbols/min [2025-10-16T22:42:43.907198] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:43.929542] [DEBUG] [MAIN ] SUI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:43.930242] [INFO ] [MAIN ] SUI: Generated 1807 derivative records from 42398 primary records. [2025-10-16T22:42:43.930377] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-16T22:42:43.957186] [DEBUG] [LOCAL ] SUN: Loaded 38717 existing records from primary storage. [2025-10-16T22:42:43.957795] [INFO ] [MAIN ] SUN: Loaded 38717 primary data records. [2025-10-16T22:42:43.958520] [DEBUG] [LOCAL ] SUI: Derivative data saved (1807 records). [2025-10-16T22:42:43.989296] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-16T22:42:44.015331] [INFO ] [MAIN ] Derivative Progress: 1481/1803 symbols completed. SUI took 1.1s. Estimated remaining: 2m 2s. Rate: 157.8 symbols/min [2025-10-16T22:42:44.035589] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:44.279819] [DEBUG] [LOCAL ] SUPV: Loaded 48253 existing records from primary storage. [2025-10-16T22:42:44.280101] [INFO ] [MAIN ] SUPV: Loaded 48253 primary data records. [2025-10-16T22:42:44.450777] [DEBUG] [LOCAL ] SUZ: Loaded 46035 existing records from primary storage. [2025-10-16T22:42:44.459556] [INFO ] [MAIN ] SUZ: Loaded 46035 primary data records. [2025-10-16T22:42:44.969704] [DEBUG] [MAIN ] SUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:44.971254] [INFO ] [MAIN ] SUN: Generated 1807 derivative records from 38717 primary records. [2025-10-16T22:42:44.971738] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-16T22:42:44.989138] [DEBUG] [LOCAL ] SUN: Derivative data saved (1807 records). [2025-10-16T22:42:44.989301] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-16T22:42:44.991560] [INFO ] [MAIN ] Derivative Progress: 1482/1803 symbols completed. SUN took 1.1s. Estimated remaining: 2m 2s. Rate: 157.6 symbols/min [2025-10-16T22:42:44.992860] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:45.010754] [DEBUG] [MAIN ] SUPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:45.011452] [INFO ] [MAIN ] SUPV: Generated 1807 derivative records from 48253 primary records. [2025-10-16T22:42:45.011671] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-16T22:42:45.031487] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1807 records). [2025-10-16T22:42:45.039274] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-16T22:42:45.055703] [INFO ] [MAIN ] Derivative Progress: 1483/1803 symbols completed. SUPV took 1.1s. Estimated remaining: 2m 2s. Rate: 157.7 symbols/min [2025-10-16T22:42:45.056696] [DEBUG] [MAIN ] SUZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:45.057486] [INFO ] [MAIN ] SUZ: Generated 1807 derivative records from 46035 primary records. [2025-10-16T22:42:45.057550] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-16T22:42:45.083984] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1807 records). [2025-10-16T22:42:45.085137] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-16T22:42:45.087516] [INFO ] [MAIN ] Derivative Progress: 1484/1803 symbols completed. SUZ took 1.1s. Estimated remaining: 2m 1s. Rate: 157.8 symbols/min [2025-10-16T22:42:45.088205] [DEBUG] [LOCAL ] SVV: Loaded 40548 existing records from primary storage. [2025-10-16T22:42:45.088503] [INFO ] [MAIN ] SVV: Loaded 40548 primary data records. [2025-10-16T22:42:45.388146] [DEBUG] [MAIN ] SVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:45.388817] [INFO ] [MAIN ] SVV: Generated 1807 derivative records from 40548 primary records. [2025-10-16T22:42:45.388884] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-16T22:42:45.403768] [DEBUG] [LOCAL ] SVV: Derivative data saved (1807 records). [2025-10-16T22:42:45.403825] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-16T22:42:45.406015] [INFO ] [MAIN ] Derivative Progress: 1485/1803 symbols completed. SVV took 0.4s. Estimated remaining: 2m 1s. Rate: 157.8 symbols/min [2025-10-16T22:42:45.406620] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:45.406558] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:45.406492] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:45.439674] [DEBUG] [LOCAL ] SWX: Loaded 31180 existing records from primary storage. [2025-10-16T22:42:45.465836] [INFO ] [MAIN ] SWX: Loaded 31180 primary data records. [2025-10-16T22:42:45.618908] [DEBUG] [LOCAL ] SW: Loaded 53577 existing records from primary storage. [2025-10-16T22:42:45.617510] [DEBUG] [LOCAL ] SWK: Loaded 52860 existing records from primary storage. [2025-10-16T22:42:45.624330] [INFO ] [MAIN ] SW: Loaded 53577 primary data records. [2025-10-16T22:42:45.624270] [INFO ] [MAIN ] SWK: Loaded 52860 primary data records. [2025-10-16T22:42:46.433587] [DEBUG] [MAIN ] SWX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:46.434696] [INFO ] [MAIN ] SWX: Generated 1807 derivative records from 31180 primary records. [2025-10-16T22:42:46.434931] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-16T22:42:46.483243] [DEBUG] [LOCAL ] SWX: Derivative data saved (1807 records). [2025-10-16T22:42:46.483581] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-16T22:42:46.486395] [DEBUG] [MAIN ] SW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:46.483937] [DEBUG] [MAIN ] SWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:46.486100] [INFO ] [MAIN ] Derivative Progress: 1486/1803 symbols completed. SWX took 1.1s. Estimated remaining: 2m 1s. Rate: 157.6 symbols/min [2025-10-16T22:42:46.488247] [INFO ] [MAIN ] SW: Generated 1807 derivative records from 53577 primary records. [2025-10-16T22:42:46.486823] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:46.487614] [INFO ] [MAIN ] SWK: Generated 1807 derivative records from 52860 primary records. [2025-10-16T22:42:46.488369] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-16T22:42:46.489352] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-16T22:42:46.519679] [DEBUG] [LOCAL ] SW: Derivative data saved (1807 records). [2025-10-16T22:42:46.520306] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-16T22:42:46.523373] [DEBUG] [LOCAL ] SWK: Derivative data saved (1807 records). [2025-10-16T22:42:46.525782] [INFO ] [MAIN ] Derivative Progress: 1487/1803 symbols completed. SW took 1.1s. Estimated remaining: 2m 0s. Rate: 157.7 symbols/min [2025-10-16T22:42:46.529510] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:46.529687] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-16T22:42:46.532750] [INFO ] [MAIN ] Derivative Progress: 1488/1803 symbols completed. SWK took 1.1s. Estimated remaining: 1m 60s. Rate: 157.8 symbols/min [2025-10-16T22:42:46.532897] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:46.529393] [DEBUG] [LOCAL ] SWZ: Loaded 6131 existing records from primary storage. [2025-10-16T22:42:46.533820] [INFO ] [MAIN ] SWZ: Loaded 6131 primary data records. [2025-10-16T22:42:46.691976] [DEBUG] [LOCAL ] SXI: Loaded 12057 existing records from primary storage. [2025-10-16T22:42:46.725226] [INFO ] [MAIN ] SXI: Loaded 12057 primary data records. [2025-10-16T22:42:46.985242] [DEBUG] [LOCAL ] SXC: Loaded 41934 existing records from primary storage. [2025-10-16T22:42:47.034399] [INFO ] [MAIN ] SXC: Loaded 41934 primary data records. [2025-10-16T22:42:47.494693] [DEBUG] [MAIN ] SWZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:47.495404] [INFO ] [MAIN ] SWZ: Generated 1807 derivative records from 6131 primary records. [2025-10-16T22:42:47.495724] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-16T22:42:47.515980] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1807 records). [2025-10-16T22:42:47.518053] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-16T22:42:47.520845] [INFO ] [MAIN ] Derivative Progress: 1489/1803 symbols completed. SWZ took 1.0s. Estimated remaining: 1m 60s. Rate: 157.6 symbols/min [2025-10-16T22:42:47.521017] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:47.535416] [DEBUG] [MAIN ] SXI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:47.536394] [INFO ] [MAIN ] SXI: Generated 1807 derivative records from 12057 primary records. [2025-10-16T22:42:47.536684] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-16T22:42:47.554731] [DEBUG] [LOCAL ] SXI: Derivative data saved (1807 records). [2025-10-16T22:42:47.555233] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-16T22:42:47.557604] [INFO ] [MAIN ] Derivative Progress: 1490/1803 symbols completed. SXI took 1.0s. Estimated remaining: 1m 59s. Rate: 157.7 symbols/min [2025-10-16T22:42:47.558097] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:47.582601] [DEBUG] [MAIN ] SXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:47.583448] [INFO ] [MAIN ] SXC: Generated 1807 derivative records from 41934 primary records. [2025-10-16T22:42:47.583619] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-16T22:42:47.602055] [DEBUG] [LOCAL ] SXT: Loaded 30053 existing records from primary storage. [2025-10-16T22:42:47.607796] [INFO ] [MAIN ] SXT: Loaded 30053 primary data records. [2025-10-16T22:42:47.611312] [DEBUG] [LOCAL ] SXC: Derivative data saved (1807 records). [2025-10-16T22:42:47.632228] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-16T22:42:47.635011] [INFO ] [MAIN ] Derivative Progress: 1491/1803 symbols completed. SXC took 1.1s. Estimated remaining: 1m 59s. Rate: 157.8 symbols/min [2025-10-16T22:42:47.669155] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:47.955811] [DEBUG] [LOCAL ] SYK: Loaded 47294 existing records from primary storage. [2025-10-16T22:42:47.956579] [INFO ] [MAIN ] SYK: Loaded 47294 primary data records. [2025-10-16T22:42:48.133841] [DEBUG] [LOCAL ] SYY: Loaded 53602 existing records from primary storage. [2025-10-16T22:42:48.167739] [INFO ] [MAIN ] SYY: Loaded 53602 primary data records. [2025-10-16T22:42:48.464770] [DEBUG] [MAIN ] SXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:48.573391] [INFO ] [MAIN ] SXT: Generated 1807 derivative records from 30053 primary records. [2025-10-16T22:42:48.648454] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-16T22:42:48.669826] [DEBUG] [LOCAL ] SXT: Derivative data saved (1807 records). [2025-10-16T22:42:48.671219] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-16T22:42:48.673299] [INFO ] [MAIN ] Derivative Progress: 1492/1803 symbols completed. SXT took 1.2s. Estimated remaining: 1m 58s. Rate: 157.6 symbols/min [2025-10-16T22:42:48.673690] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:48.690300] [DEBUG] [MAIN ] SYK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:48.691063] [INFO ] [MAIN ] SYK: Generated 1807 derivative records from 47294 primary records. [2025-10-16T22:42:48.691209] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-16T22:42:48.709751] [DEBUG] [LOCAL ] SYK: Derivative data saved (1807 records). [2025-10-16T22:42:48.709941] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-16T22:42:48.712588] [INFO ] [MAIN ] Derivative Progress: 1493/1803 symbols completed. SYK took 1.2s. Estimated remaining: 1m 58s. Rate: 157.7 symbols/min [2025-10-16T22:42:48.712930] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:48.726621] [DEBUG] [MAIN ] SYY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:48.727528] [INFO ] [MAIN ] SYY: Generated 1807 derivative records from 53602 primary records. [2025-10-16T22:42:48.727702] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-16T22:42:48.747419] [DEBUG] [LOCAL ] SYY: Derivative data saved (1807 records). [2025-10-16T22:42:48.760406] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-16T22:42:48.762860] [INFO ] [MAIN ] Derivative Progress: 1494/1803 symbols completed. SYY took 1.1s. Estimated remaining: 1m 57s. Rate: 157.8 symbols/min [2025-10-16T22:42:48.763175] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:48.792817] [DEBUG] [LOCAL ] T: Loaded 54188 existing records from primary storage. [2025-10-16T22:42:48.793505] [INFO ] [MAIN ] T: Loaded 54188 primary data records. [2025-10-16T22:42:48.853715] [DEBUG] [LOCAL ] TAC: Loaded 43476 existing records from primary storage. [2025-10-16T22:42:48.875031] [INFO ] [MAIN ] TAC: Loaded 43476 primary data records. [2025-10-16T22:42:49.234429] [DEBUG] [LOCAL ] TAK: Loaded 50538 existing records from primary storage. [2025-10-16T22:42:49.253050] [INFO ] [MAIN ] TAK: Loaded 50538 primary data records. [2025-10-16T22:42:49.787411] [DEBUG] [MAIN ] T: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:49.788251] [DEBUG] [MAIN ] TAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:49.789127] [INFO ] [MAIN ] T: Generated 1807 derivative records from 54188 primary records. [2025-10-16T22:42:49.790029] [INFO ] [MAIN ] TAC: Generated 1807 derivative records from 43476 primary records. [2025-10-16T22:42:49.789266] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-16T22:42:49.790176] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-16T22:42:49.826396] [DEBUG] [LOCAL ] T: Derivative data saved (1807 records). [2025-10-16T22:42:49.826973] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-16T22:42:49.826801] [DEBUG] [LOCAL ] TAC: Derivative data saved (1807 records). [2025-10-16T22:42:49.827184] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-16T22:42:49.841117] [INFO ] [MAIN ] Derivative Progress: 1495/1803 symbols completed. T took 1.2s. Estimated remaining: 1m 57s. Rate: 157.6 symbols/min [2025-10-16T22:42:49.844971] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:49.844853] [DEBUG] [MAIN ] TAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:49.846150] [INFO ] [MAIN ] TAK: Generated 1807 derivative records from 50538 primary records. [2025-10-16T22:42:49.846313] [INFO ] [MAIN ] Derivative Progress: 1496/1803 symbols completed. TAC took 1.1s. Estimated remaining: 1m 57s. Rate: 157.7 symbols/min [2025-10-16T22:42:49.846491] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-16T22:42:49.846434] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:49.865513] [DEBUG] [LOCAL ] TAK: Derivative data saved (1807 records). [2025-10-16T22:42:49.865832] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-16T22:42:49.868697] [INFO ] [MAIN ] Derivative Progress: 1497/1803 symbols completed. TAK took 1.1s. Estimated remaining: 1m 56s. Rate: 157.8 symbols/min [2025-10-16T22:42:49.868910] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:49.914513] [DEBUG] [LOCAL ] TALO: Loaded 51350 existing records from primary storage. [2025-10-16T22:42:49.928469] [INFO ] [MAIN ] TALO: Loaded 51350 primary data records. [2025-10-16T22:42:50.091764] [DEBUG] [LOCAL ] TAL: Loaded 52161 existing records from primary storage. [2025-10-16T22:42:50.098701] [INFO ] [MAIN ] TAL: Loaded 52161 primary data records. [2025-10-16T22:42:50.137304] [DEBUG] [LOCAL ] TAP: Loaded 53352 existing records from primary storage. [2025-10-16T22:42:50.237386] [INFO ] [MAIN ] TAP: Loaded 53352 primary data records. [2025-10-16T22:42:51.018377] [DEBUG] [MAIN ] TALO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:51.020085] [INFO ] [MAIN ] TALO: Generated 1807 derivative records from 51350 primary records. [2025-10-16T22:42:51.020360] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-16T22:42:51.042188] [DEBUG] [LOCAL ] TALO: Derivative data saved (1807 records). [2025-10-16T22:42:51.050664] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-16T22:42:51.057581] [INFO ] [MAIN ] Derivative Progress: 1498/1803 symbols completed. TALO took 1.2s. Estimated remaining: 1m 56s. Rate: 157.6 symbols/min [2025-10-16T22:42:51.058276] [DEBUG] [MAIN ] TAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:51.059173] [INFO ] [MAIN ] TAL: Generated 1807 derivative records from 52161 primary records. [2025-10-16T22:42:51.059531] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-16T22:42:51.077486] [DEBUG] [LOCAL ] TAL: Derivative data saved (1807 records). [2025-10-16T22:42:51.077576] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-16T22:42:51.080150] [INFO ] [MAIN ] Derivative Progress: 1499/1803 symbols completed. TAL took 1.2s. Estimated remaining: 1m 56s. Rate: 157.7 symbols/min [2025-10-16T22:42:51.095637] [DEBUG] [MAIN ] TAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:51.096301] [INFO ] [MAIN ] TAP: Generated 1807 derivative records from 53352 primary records. [2025-10-16T22:42:51.096411] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-16T22:42:51.114238] [DEBUG] [LOCAL ] TAP: Derivative data saved (1807 records). [2025-10-16T22:42:51.114381] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-16T22:42:51.117199] [INFO ] [MAIN ] Derivative Progress: 1500/1803 symbols completed. TAP took 1.2s. Estimated remaining: 1m 55s. Rate: 157.8 symbols/min [2025-10-16T22:42:51.117955] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:51.118215] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:51.118122] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:51.137184] [DEBUG] [LOCAL ] TBB: Loaded 11583 existing records from primary storage. [2025-10-16T22:42:51.137326] [INFO ] [MAIN ] TBB: Loaded 11583 primary data records. [2025-10-16T22:42:51.243502] [DEBUG] [LOCAL ] TBI: Loaded 22768 existing records from primary storage. [2025-10-16T22:42:51.273941] [INFO ] [MAIN ] TBI: Loaded 22768 primary data records. [2025-10-16T22:42:51.408721] [DEBUG] [LOCAL ] TBBB: Loaded 36038 existing records from primary storage. [2025-10-16T22:42:51.416377] [INFO ] [MAIN ] TBBB: Loaded 36038 primary data records. [2025-10-16T22:42:52.155820] [DEBUG] [MAIN ] TBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:52.156950] [INFO ] [MAIN ] TBB: Generated 1807 derivative records from 11583 primary records. [2025-10-16T22:42:52.157249] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-16T22:42:52.175771] [DEBUG] [LOCAL ] TBB: Derivative data saved (1807 records). [2025-10-16T22:42:52.176882] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-10-16T22:42:52.179807] [INFO ] [MAIN ] Derivative Progress: 1501/1803 symbols completed. TBB took 1.1s. Estimated remaining: 1m 55s. Rate: 157.6 symbols/min [2025-10-16T22:42:52.180165] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:52.194802] [DEBUG] [MAIN ] TBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:52.199734] [INFO ] [MAIN ] TBI: Generated 1807 derivative records from 22768 primary records. [2025-10-16T22:42:52.200118] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-16T22:42:52.216350] [DEBUG] [LOCAL ] TBN: Loaded 4014 existing records from primary storage. [2025-10-16T22:42:52.216572] [DEBUG] [MAIN ] TBBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:52.223485] [INFO ] [MAIN ] TBN: Loaded 4014 primary data records. [2025-10-16T22:42:52.225502] [INFO ] [MAIN ] TBBB: Generated 1807 derivative records from 36038 primary records. [2025-10-16T22:42:52.262969] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-16T22:42:52.263063] [DEBUG] [LOCAL ] TBI: Derivative data saved (1807 records). [2025-10-16T22:42:52.269166] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-16T22:42:52.278411] [INFO ] [MAIN ] Derivative Progress: 1502/1803 symbols completed. TBI took 1.2s. Estimated remaining: 1m 55s. Rate: 157.7 symbols/min [2025-10-16T22:42:52.290426] [INFO ] [MAIN ] TCBX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:52.429703] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1807 records). [2025-10-16T22:42:52.550802] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-16T22:42:52.554991] [INFO ] [MAIN ] Derivative Progress: 1503/1803 symbols completed. TBBB took 1.4s. Estimated remaining: 1m 54s. Rate: 157.7 symbols/min [2025-10-16T22:42:52.556806] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:52.556522] [DEBUG] [LOCAL ] TCBX: Loaded 10278 existing records from primary storage. [2025-10-16T22:42:52.557481] [INFO ] [MAIN ] TCBX: Loaded 10278 primary data records. [2025-10-16T22:42:52.933164] [DEBUG] [MAIN ] TBN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:52.934457] [INFO ] [MAIN ] TBN: Generated 1807 derivative records from 4014 primary records. [2025-10-16T22:42:52.934704] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-16T22:42:52.965914] [DEBUG] [LOCAL ] TBN: Derivative data saved (1807 records). [2025-10-16T22:42:52.966196] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-16T22:42:52.968323] [INFO ] [MAIN ] Derivative Progress: 1504/1803 symbols completed. TBN took 0.8s. Estimated remaining: 1m 54s. Rate: 157.7 symbols/min [2025-10-16T22:42:52.968673] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:52.970049] [DEBUG] [LOCAL ] TD: Loaded 52715 existing records from primary storage. [2025-10-16T22:42:52.970885] [INFO ] [MAIN ] TD: Loaded 52715 primary data records. [2025-10-16T22:42:53.151669] [DEBUG] [MAIN ] TCBX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:53.182824] [INFO ] [MAIN ] TCBX: Generated 1807 derivative records from 10278 primary records. [2025-10-16T22:42:53.300039] [DEBUG] [LOCAL ] TCBX: Saving derivative data. [2025-10-16T22:42:53.319516] [DEBUG] [LOCAL ] TCBX: Derivative data saved (1807 records). [2025-10-16T22:42:53.333054] [INFO ] [MAIN ] TCBX: Successfully saved derivative data. [2025-10-16T22:42:53.333823] [DEBUG] [LOCAL ] TDC: Loaded 46906 existing records from primary storage. [2025-10-16T22:42:53.336965] [INFO ] [MAIN ] Derivative Progress: 1505/1803 symbols completed. TCBX took 1.0s. Estimated remaining: 1m 53s. Rate: 157.7 symbols/min [2025-10-16T22:42:53.337505] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:53.334185] [INFO ] [MAIN ] TDC: Loaded 46906 primary data records. [2025-10-16T22:42:53.454438] [DEBUG] [LOCAL ] TDF: Loaded 6394 existing records from primary storage. [2025-10-16T22:42:53.459897] [INFO ] [MAIN ] TDF: Loaded 6394 primary data records. [2025-10-16T22:42:53.789248] [DEBUG] [MAIN ] TD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:53.817363] [INFO ] [MAIN ] TD: Generated 1807 derivative records from 52715 primary records. [2025-10-16T22:42:53.848103] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-16T22:42:54.005431] [DEBUG] [LOCAL ] TD: Derivative data saved (1807 records). [2025-10-16T22:42:54.006369] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-16T22:42:54.008619] [INFO ] [MAIN ] Derivative Progress: 1506/1803 symbols completed. TD took 1.5s. Estimated remaining: 1m 53s. Rate: 157.6 symbols/min [2025-10-16T22:42:54.010613] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:54.033728] [DEBUG] [MAIN ] TDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:54.034756] [INFO ] [MAIN ] TDC: Generated 1807 derivative records from 46906 primary records. [2025-10-16T22:42:54.035054] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-16T22:42:54.064540] [DEBUG] [LOCAL ] TDG: Loaded 22358 existing records from primary storage. [2025-10-16T22:42:54.072943] [INFO ] [MAIN ] TDG: Loaded 22358 primary data records. [2025-10-16T22:42:54.079108] [DEBUG] [MAIN ] TDF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:54.124800] [INFO ] [MAIN ] TDF: Generated 1807 derivative records from 6394 primary records. [2025-10-16T22:42:54.150515] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-16T22:42:54.145108] [DEBUG] [LOCAL ] TDC: Derivative data saved (1807 records). [2025-10-16T22:42:54.193800] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-16T22:42:54.214977] [INFO ] [MAIN ] Derivative Progress: 1507/1803 symbols completed. TDC took 1.2s. Estimated remaining: 1m 53s. Rate: 157.7 symbols/min [2025-10-16T22:42:54.223101] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:54.282525] [DEBUG] [LOCAL ] TDF: Derivative data saved (1807 records). [2025-10-16T22:42:54.287257] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-16T22:42:54.318329] [INFO ] [MAIN ] Derivative Progress: 1508/1803 symbols completed. TDF took 1.0s. Estimated remaining: 1m 52s. Rate: 157.8 symbols/min [2025-10-16T22:42:54.403306] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:54.430067] [DEBUG] [MAIN ] TDG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:54.430736] [INFO ] [MAIN ] TDG: Generated 1807 derivative records from 22358 primary records. [2025-10-16T22:42:54.430858] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-16T22:42:54.459220] [DEBUG] [LOCAL ] TDG: Derivative data saved (1807 records). [2025-10-16T22:42:54.459599] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-16T22:42:54.474562] [INFO ] [MAIN ] Derivative Progress: 1509/1803 symbols completed. TDG took 0.5s. Estimated remaining: 1m 52s. Rate: 157.8 symbols/min [2025-10-16T22:42:54.474852] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:54.489789] [DEBUG] [LOCAL ] TDS: Loaded 42828 existing records from primary storage. [2025-10-16T22:42:54.490627] [INFO ] [MAIN ] TDS: Loaded 42828 primary data records. [2025-10-16T22:42:54.548025] [DEBUG] [LOCAL ] TDOC: Loaded 53755 existing records from primary storage. [2025-10-16T22:42:54.560778] [INFO ] [MAIN ] TDOC: Loaded 53755 primary data records. [2025-10-16T22:42:54.877766] [DEBUG] [LOCAL ] TDW: Loaded 45348 existing records from primary storage. [2025-10-16T22:42:55.040582] [INFO ] [MAIN ] TDW: Loaded 45348 primary data records. [2025-10-16T22:42:55.498391] [DEBUG] [MAIN ] TDOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:55.500311] [INFO ] [MAIN ] TDOC: Generated 1807 derivative records from 53755 primary records. [2025-10-16T22:42:55.500520] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-16T22:42:55.515809] [DEBUG] [MAIN ] TDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:55.528348] [INFO ] [MAIN ] TDS: Generated 1807 derivative records from 42828 primary records. [2025-10-16T22:42:55.528708] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-16T22:42:55.547269] [DEBUG] [LOCAL ] TDS: Derivative data saved (1807 records). [2025-10-16T22:42:55.547491] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-16T22:42:55.549750] [INFO ] [MAIN ] Derivative Progress: 1510/1803 symbols completed. TDS took 1.1s. Estimated remaining: 1m 52s. Rate: 157.6 symbols/min [2025-10-16T22:42:55.550349] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:55.552797] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1807 records). [2025-10-16T22:42:55.552891] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-16T22:42:55.554964] [INFO ] [MAIN ] Derivative Progress: 1511/1803 symbols completed. TDOC took 1.3s. Estimated remaining: 1m 51s. Rate: 157.7 symbols/min [2025-10-16T22:42:55.555204] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:55.573154] [DEBUG] [MAIN ] TDW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:55.573953] [INFO ] [MAIN ] TDW: Generated 1807 derivative records from 45348 primary records. [2025-10-16T22:42:55.581404] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-16T22:42:55.596941] [DEBUG] [LOCAL ] TEAF: Loaded 7473 existing records from primary storage. [2025-10-16T22:42:55.605047] [INFO ] [MAIN ] TEAF: Loaded 7473 primary data records. [2025-10-16T22:42:55.606786] [DEBUG] [LOCAL ] TDY: Loaded 22418 existing records from primary storage. [2025-10-16T22:42:55.618591] [INFO ] [MAIN ] TDY: Loaded 22418 primary data records. [2025-10-16T22:42:55.733767] [DEBUG] [LOCAL ] TDW: Derivative data saved (1807 records). [2025-10-16T22:42:55.781606] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-16T22:42:55.796106] [INFO ] [MAIN ] Derivative Progress: 1512/1803 symbols completed. TDW took 1.3s. Estimated remaining: 1m 51s. Rate: 157.8 symbols/min [2025-10-16T22:42:55.823479] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:56.352017] [DEBUG] [LOCAL ] TECK: Loaded 53824 existing records from primary storage. [2025-10-16T22:42:56.370971] [INFO ] [MAIN ] TECK: Loaded 53824 primary data records. [2025-10-16T22:42:56.373143] [DEBUG] [MAIN ] TDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:56.418126] [DEBUG] [MAIN ] TEAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:56.441501] [INFO ] [MAIN ] TDY: Generated 1807 derivative records from 22418 primary records. [2025-10-16T22:42:56.457400] [INFO ] [MAIN ] TEAF: Generated 1807 derivative records from 7473 primary records. [2025-10-16T22:42:56.495393] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-16T22:42:56.495194] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-16T22:42:56.619717] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1807 records). [2025-10-16T22:42:56.625295] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-16T22:42:56.625172] [DEBUG] [LOCAL ] TDY: Derivative data saved (1807 records). [2025-10-16T22:42:56.628636] [INFO ] [MAIN ] Derivative Progress: 1513/1803 symbols completed. TEAF took 1.1s. Estimated remaining: 1m 50s. Rate: 157.6 symbols/min [2025-10-16T22:42:56.645600] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-16T22:42:56.684446] [INFO ] [MAIN ] Derivative Progress: 1514/1803 symbols completed. TDY took 1.1s. Estimated remaining: 1m 50s. Rate: 157.7 symbols/min [2025-10-16T22:42:56.950613] [DEBUG] [MAIN ] TECK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:56.951439] [INFO ] [MAIN ] TECK: Generated 1807 derivative records from 53824 primary records. [2025-10-16T22:42:56.951554] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-16T22:42:56.966993] [DEBUG] [LOCAL ] TECK: Derivative data saved (1807 records). [2025-10-16T22:42:56.967110] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-16T22:42:56.969547] [INFO ] [MAIN ] Derivative Progress: 1515/1803 symbols completed. TECK took 1.1s. Estimated remaining: 1m 50s. Rate: 157.8 symbols/min [2025-10-16T22:42:56.970213] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:56.970357] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:56.970307] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:56.999836] [DEBUG] [LOCAL ] TEI: Loaded 21475 existing records from primary storage. [2025-10-16T22:42:57.000218] [INFO ] [MAIN ] TEI: Loaded 21475 primary data records. [2025-10-16T22:42:57.177518] [DEBUG] [LOCAL ] TEF: Loaded 37124 existing records from primary storage. [2025-10-16T22:42:57.178361] [INFO ] [MAIN ] TEF: Loaded 37124 primary data records. [2025-10-16T22:42:57.178280] [DEBUG] [LOCAL ] TEL: Loaded 51440 existing records from primary storage. [2025-10-16T22:42:57.189820] [INFO ] [MAIN ] TEL: Loaded 51440 primary data records. [2025-10-16T22:42:58.010287] [DEBUG] [MAIN ] TEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:58.011090] [INFO ] [MAIN ] TEI: Generated 1807 derivative records from 21475 primary records. [2025-10-16T22:42:58.011289] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-16T22:42:58.043278] [DEBUG] [MAIN ] TEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:58.043616] [DEBUG] [LOCAL ] TEI: Derivative data saved (1807 records). [2025-10-16T22:42:58.044596] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-16T22:42:58.045890] [INFO ] [MAIN ] TEL: Generated 1807 derivative records from 51440 primary records. [2025-10-16T22:42:58.046632] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-16T22:42:58.048933] [INFO ] [MAIN ] Derivative Progress: 1516/1803 symbols completed. TEI took 1.1s. Estimated remaining: 1m 49s. Rate: 157.6 symbols/min [2025-10-16T22:42:58.049977] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:58.065913] [DEBUG] [LOCAL ] TEL: Derivative data saved (1807 records). [2025-10-16T22:42:58.066107] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-16T22:42:58.068333] [INFO ] [MAIN ] Derivative Progress: 1517/1803 symbols completed. TEL took 1.1s. Estimated remaining: 1m 49s. Rate: 157.7 symbols/min [2025-10-16T22:42:58.081104] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:58.081547] [DEBUG] [MAIN ] TEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:58.082691] [INFO ] [MAIN ] TEF: Generated 1807 derivative records from 37124 primary records. [2025-10-16T22:42:58.082758] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-16T22:42:58.111155] [DEBUG] [LOCAL ] TEF: Derivative data saved (1807 records). [2025-10-16T22:42:58.111356] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-16T22:42:58.113928] [INFO ] [MAIN ] Derivative Progress: 1518/1803 symbols completed. TEF took 1.1s. Estimated remaining: 1m 48s. Rate: 157.8 symbols/min [2025-10-16T22:42:58.114093] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:58.123893] [DEBUG] [LOCAL ] TEO: Loaded 22784 existing records from primary storage. [2025-10-16T22:42:58.124142] [INFO ] [MAIN ] TEO: Loaded 22784 primary data records. [2025-10-16T22:42:58.144893] [DEBUG] [LOCAL ] TEN: Loaded 30779 existing records from primary storage. [2025-10-16T22:42:58.170388] [INFO ] [MAIN ] TEN: Loaded 30779 primary data records. [2025-10-16T22:42:58.795978] [DEBUG] [LOCAL ] TEVA: Loaded 54017 existing records from primary storage. [2025-10-16T22:42:58.796670] [INFO ] [MAIN ] TEVA: Loaded 54017 primary data records. [2025-10-16T22:42:59.121717] [DEBUG] [MAIN ] TEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:59.123198] [INFO ] [MAIN ] TEO: Generated 1807 derivative records from 22784 primary records. [2025-10-16T22:42:59.123924] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-16T22:42:59.153897] [DEBUG] [LOCAL ] TEO: Derivative data saved (1807 records). [2025-10-16T22:42:59.160176] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-16T22:42:59.160504] [DEBUG] [MAIN ] TEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:59.164687] [INFO ] [MAIN ] TEN: Generated 1807 derivative records from 30779 primary records. [2025-10-16T22:42:59.164787] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-16T22:42:59.163590] [INFO ] [MAIN ] Derivative Progress: 1519/1803 symbols completed. TEO took 1.1s. Estimated remaining: 1m 48s. Rate: 157.6 symbols/min [2025-10-16T22:42:59.165589] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:59.183169] [DEBUG] [LOCAL ] TEN: Derivative data saved (1807 records). [2025-10-16T22:42:59.183433] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-16T22:42:59.185871] [INFO ] [MAIN ] Derivative Progress: 1520/1803 symbols completed. TEN took 1.1s. Estimated remaining: 1m 48s. Rate: 157.7 symbols/min [2025-10-16T22:42:59.186137] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:59.203441] [DEBUG] [MAIN ] TEVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:42:59.204172] [INFO ] [MAIN ] TEVA: Generated 1807 derivative records from 54017 primary records. [2025-10-16T22:42:59.204303] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-16T22:42:59.230497] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1807 records). [2025-10-16T22:42:59.230638] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-10-16T22:42:59.232820] [INFO ] [MAIN ] Derivative Progress: 1521/1803 symbols completed. TEVA took 1.1s. Estimated remaining: 1m 47s. Rate: 157.8 symbols/min [2025-10-16T22:42:59.233052] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:42:59.247871] [DEBUG] [LOCAL ] TEX: Loaded 44119 existing records from primary storage. [2025-10-16T22:42:59.248020] [INFO ] [MAIN ] TEX: Loaded 44119 primary data records. [2025-10-16T22:42:59.476324] [DEBUG] [LOCAL ] TFC: Loaded 54057 existing records from primary storage. [2025-10-16T22:42:59.476954] [DEBUG] [LOCAL ] TFII: Loaded 33095 existing records from primary storage. [2025-10-16T22:42:59.477381] [INFO ] [MAIN ] TFC: Loaded 54057 primary data records. [2025-10-16T22:42:59.577741] [INFO ] [MAIN ] TFII: Loaded 33095 primary data records. [2025-10-16T22:43:00.241987] [DEBUG] [MAIN ] TEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:00.243351] [INFO ] [MAIN ] TEX: Generated 1807 derivative records from 44119 primary records. [2025-10-16T22:43:00.243772] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-16T22:43:00.265355] [DEBUG] [LOCAL ] TEX: Derivative data saved (1807 records). [2025-10-16T22:43:00.265515] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-16T22:43:00.267530] [INFO ] [MAIN ] Derivative Progress: 1522/1803 symbols completed. TEX took 1.1s. Estimated remaining: 1m 47s. Rate: 157.6 symbols/min [2025-10-16T22:43:00.267882] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:00.297467] [DEBUG] [MAIN ] TFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:00.298612] [INFO ] [MAIN ] TFC: Generated 1807 derivative records from 54057 primary records. [2025-10-16T22:43:00.301533] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-16T22:43:00.336114] [DEBUG] [LOCAL ] TFIN: Loaded 23892 existing records from primary storage. [2025-10-16T22:43:00.337186] [DEBUG] [MAIN ] TFII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:00.338458] [INFO ] [MAIN ] TFII: Generated 1807 derivative records from 33095 primary records. [2025-10-16T22:43:00.339066] [INFO ] [MAIN ] TFIN: Loaded 23892 primary data records. [2025-10-16T22:43:00.339564] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-16T22:43:00.443586] [DEBUG] [LOCAL ] TFII: Derivative data saved (1807 records). [2025-10-16T22:43:00.450173] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-16T22:43:00.450051] [DEBUG] [LOCAL ] TFC: Derivative data saved (1807 records). [2025-10-16T22:43:00.463569] [INFO ] [MAIN ] Derivative Progress: 1523/1803 symbols completed. TFII took 1.2s. Estimated remaining: 1m 47s. Rate: 157.6 symbols/min [2025-10-16T22:43:00.463846] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-16T22:43:00.464386] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:00.485691] [INFO ] [MAIN ] Derivative Progress: 1524/1803 symbols completed. TFC took 1.3s. Estimated remaining: 1m 46s. Rate: 157.7 symbols/min [2025-10-16T22:43:00.486798] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:00.723245] [DEBUG] [LOCAL ] TFX: Loaded 36449 existing records from primary storage. [2025-10-16T22:43:00.724296] [DEBUG] [LOCAL ] TFPM: Loaded 39778 existing records from primary storage. [2025-10-16T22:43:00.724697] [INFO ] [MAIN ] TFX: Loaded 36449 primary data records. [2025-10-16T22:43:00.725129] [INFO ] [MAIN ] TFPM: Loaded 39778 primary data records. [2025-10-16T22:43:00.960606] [DEBUG] [MAIN ] TFIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:00.976401] [INFO ] [MAIN ] TFIN: Generated 1807 derivative records from 23892 primary records. [2025-10-16T22:43:00.986791] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-16T22:43:01.309493] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1807 records). [2025-10-16T22:43:01.311488] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-16T22:43:01.314210] [INFO ] [MAIN ] Derivative Progress: 1525/1803 symbols completed. TFIN took 1.0s. Estimated remaining: 1m 46s. Rate: 157.6 symbols/min [2025-10-16T22:43:01.314881] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:01.464130] [DEBUG] [LOCAL ] TG: Loaded 10651 existing records from primary storage. [2025-10-16T22:43:01.464683] [INFO ] [MAIN ] TG: Loaded 10651 primary data records. [2025-10-16T22:43:01.664534] [DEBUG] [MAIN ] TFX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:01.781112] [INFO ] [MAIN ] TFX: Generated 1807 derivative records from 36449 primary records. [2025-10-16T22:43:01.781293] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-16T22:43:01.817710] [DEBUG] [MAIN ] TFPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:01.817869] [DEBUG] [LOCAL ] TFX: Derivative data saved (1807 records). [2025-10-16T22:43:01.819694] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-16T22:43:01.818741] [INFO ] [MAIN ] TFPM: Generated 1807 derivative records from 39778 primary records. [2025-10-16T22:43:01.822234] [INFO ] [MAIN ] Derivative Progress: 1526/1803 symbols completed. TFX took 1.3s. Estimated remaining: 1m 45s. Rate: 157.6 symbols/min [2025-10-16T22:43:01.822603] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:01.822820] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-16T22:43:01.840620] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1807 records). [2025-10-16T22:43:01.841112] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-16T22:43:01.843307] [INFO ] [MAIN ] Derivative Progress: 1527/1803 symbols completed. TFPM took 1.4s. Estimated remaining: 1m 45s. Rate: 157.7 symbols/min [2025-10-16T22:43:01.843633] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:01.860556] [DEBUG] [MAIN ] TG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:01.861299] [INFO ] [MAIN ] TG: Generated 1807 derivative records from 10651 primary records. [2025-10-16T22:43:01.861471] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-16T22:43:01.885416] [DEBUG] [LOCAL ] TG: Derivative data saved (1807 records). [2025-10-16T22:43:01.885588] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-16T22:43:01.887772] [INFO ] [MAIN ] Derivative Progress: 1528/1803 symbols completed. TG took 0.6s. Estimated remaining: 1m 45s. Rate: 157.8 symbols/min [2025-10-16T22:43:01.899668] [DEBUG] [LOCAL ] TGLS: Loaded 27778 existing records from primary storage. [2025-10-16T22:43:01.899775] [INFO ] [MAIN ] TGLS: Loaded 27778 primary data records. [2025-10-16T22:43:02.249102] [DEBUG] [LOCAL ] TGNA: Loaded 48978 existing records from primary storage. [2025-10-16T22:43:02.266740] [INFO ] [MAIN ] TGNA: Loaded 48978 primary data records. [2025-10-16T22:43:02.605018] [DEBUG] [MAIN ] TGLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:02.606563] [INFO ] [MAIN ] TGLS: Generated 1807 derivative records from 27778 primary records. [2025-10-16T22:43:02.606853] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-16T22:43:02.623991] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1807 records). [2025-10-16T22:43:02.624085] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-16T22:43:02.627120] [INFO ] [MAIN ] Derivative Progress: 1529/1803 symbols completed. TGLS took 0.8s. Estimated remaining: 1m 44s. Rate: 157.7 symbols/min [2025-10-16T22:43:02.647606] [DEBUG] [MAIN ] TGNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:02.648468] [INFO ] [MAIN ] TGNA: Generated 1807 derivative records from 48978 primary records. [2025-10-16T22:43:02.648538] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-16T22:43:02.664958] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1807 records). [2025-10-16T22:43:02.665088] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-16T22:43:02.668959] [INFO ] [MAIN ] Derivative Progress: 1530/1803 symbols completed. TGNA took 0.8s. Estimated remaining: 1m 44s. Rate: 157.8 symbols/min [2025-10-16T22:43:02.669905] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:02.669757] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:02.670315] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:02.733512] [DEBUG] [LOCAL ] TGS: Loaded 33802 existing records from primary storage. [2025-10-16T22:43:02.734934] [INFO ] [MAIN ] TGS: Loaded 33802 primary data records. [2025-10-16T22:43:02.877262] [DEBUG] [LOCAL ] TGT: Loaded 54168 existing records from primary storage. [2025-10-16T22:43:02.875781] [DEBUG] [LOCAL ] THC: Loaded 47312 existing records from primary storage. [2025-10-16T22:43:02.877680] [INFO ] [MAIN ] TGT: Loaded 54168 primary data records. [2025-10-16T22:43:02.877837] [INFO ] [MAIN ] THC: Loaded 47312 primary data records. [2025-10-16T22:43:03.795353] [DEBUG] [MAIN ] TGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:03.797260] [INFO ] [MAIN ] TGS: Generated 1807 derivative records from 33802 primary records. [2025-10-16T22:43:03.797951] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-16T22:43:03.839922] [DEBUG] [MAIN ] TGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:03.831070] [DEBUG] [LOCAL ] TGS: Derivative data saved (1807 records). [2025-10-16T22:43:03.840909] [INFO ] [MAIN ] TGT: Generated 1807 derivative records from 54168 primary records. [2025-10-16T22:43:03.840995] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-16T22:43:03.842344] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-16T22:43:03.845791] [INFO ] [MAIN ] Derivative Progress: 1531/1803 symbols completed. TGS took 1.2s. Estimated remaining: 1m 44s. Rate: 157.5 symbols/min [2025-10-16T22:43:03.854110] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:03.880317] [DEBUG] [MAIN ] THC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:03.883039] [INFO ] [MAIN ] THC: Generated 1807 derivative records from 47312 primary records. [2025-10-16T22:43:03.884091] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-16T22:43:03.899923] [DEBUG] [LOCAL ] TGT: Derivative data saved (1807 records). [2025-10-16T22:43:03.901193] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-16T22:43:03.905558] [INFO ] [MAIN ] Derivative Progress: 1532/1803 symbols completed. TGT took 1.2s. Estimated remaining: 1m 43s. Rate: 157.6 symbols/min [2025-10-16T22:43:03.912244] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:03.920426] [DEBUG] [LOCAL ] THIR: Loaded 2404 existing records from primary storage. [2025-10-16T22:43:03.921391] [INFO ] [MAIN ] THIR: Loaded 2404 primary data records. [2025-10-16T22:43:03.921262] [DEBUG] [LOCAL ] THC: Derivative data saved (1807 records). [2025-10-16T22:43:03.953673] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-16T22:43:03.992771] [INFO ] [MAIN ] Derivative Progress: 1533/1803 symbols completed. THC took 1.3s. Estimated remaining: 1m 43s. Rate: 157.7 symbols/min [2025-10-16T22:43:04.028029] [DEBUG] [LOCAL ] THG: Loaded 21941 existing records from primary storage. [2025-10-16T22:43:04.047467] [INFO ] [MAIN ] THG: Loaded 21941 primary data records. [2025-10-16T22:43:04.051872] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:04.223959] [DEBUG] [LOCAL ] THLV: Loaded 1530 existing records from primary storage. [2025-10-16T22:43:04.371998] [INFO ] [MAIN ] THLV: Loaded 1530 primary data records. [2025-10-16T22:43:04.995617] [DEBUG] [MAIN ] THIR: Filtered 6966 bins outside market hours, 7764 incomplete bins [2025-10-16T22:43:04.996748] [INFO ] [MAIN ] THIR: Generated 1802 derivative records from 2404 primary records. [2025-10-16T22:43:04.996945] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-16T22:43:05.024245] [DEBUG] [MAIN ] THG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:05.026202] [INFO ] [MAIN ] THG: Generated 1807 derivative records from 21941 primary records. [2025-10-16T22:43:05.026482] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-16T22:43:05.041804] [DEBUG] [LOCAL ] THIR: Derivative data saved (1802 records). [2025-10-16T22:43:05.043364] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-16T22:43:05.046100] [INFO ] [MAIN ] Derivative Progress: 1534/1803 symbols completed. THIR took 1.1s. Estimated remaining: 1m 42s. Rate: 157.5 symbols/min [2025-10-16T22:43:05.063112] [DEBUG] [LOCAL ] THG: Derivative data saved (1807 records). [2025-10-16T22:43:05.063456] [DEBUG] [MAIN ] THLV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:43:05.047276] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:05.064535] [INFO ] [MAIN ] THLV: Generated 1806 derivative records from 1530 primary records. [2025-10-16T22:43:05.064594] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-16T22:43:05.066829] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-16T22:43:05.066751] [INFO ] [MAIN ] Derivative Progress: 1535/1803 symbols completed. THG took 1.2s. Estimated remaining: 1m 42s. Rate: 157.6 symbols/min [2025-10-16T22:43:05.067951] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:05.082885] [DEBUG] [LOCAL ] THLV: Derivative data saved (1806 records). [2025-10-16T22:43:05.083074] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-16T22:43:05.085824] [INFO ] [MAIN ] Derivative Progress: 1536/1803 symbols completed. THLV took 1.0s. Estimated remaining: 1m 42s. Rate: 157.7 symbols/min [2025-10-16T22:43:05.085998] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:05.120512] [DEBUG] [LOCAL ] THQ: Loaded 25501 existing records from primary storage. [2025-10-16T22:43:05.120727] [INFO ] [MAIN ] THQ: Loaded 25501 primary data records. [2025-10-16T22:43:05.174521] [DEBUG] [LOCAL ] THR: Loaded 19933 existing records from primary storage. [2025-10-16T22:43:05.200390] [INFO ] [MAIN ] THR: Loaded 19933 primary data records. [2025-10-16T22:43:05.281495] [DEBUG] [LOCAL ] THO: Loaded 41680 existing records from primary storage. [2025-10-16T22:43:05.341915] [INFO ] [MAIN ] THO: Loaded 41680 primary data records. [2025-10-16T22:43:06.175507] [DEBUG] [MAIN ] THQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:06.183739] [INFO ] [MAIN ] THQ: Generated 1807 derivative records from 25501 primary records. [2025-10-16T22:43:06.189473] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-16T22:43:06.190887] [DEBUG] [MAIN ] THR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:06.202703] [INFO ] [MAIN ] THR: Generated 1807 derivative records from 19933 primary records. [2025-10-16T22:43:06.202988] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-16T22:43:06.223223] [DEBUG] [LOCAL ] THQ: Derivative data saved (1807 records). [2025-10-16T22:43:06.225692] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-16T22:43:06.228056] [INFO ] [MAIN ] Derivative Progress: 1537/1803 symbols completed. THQ took 1.2s. Estimated remaining: 1m 41s. Rate: 157.5 symbols/min [2025-10-16T22:43:06.228363] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:06.230991] [DEBUG] [LOCAL ] THR: Derivative data saved (1807 records). [2025-10-16T22:43:06.231445] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-16T22:43:06.233875] [INFO ] [MAIN ] Derivative Progress: 1538/1803 symbols completed. THR took 1.1s. Estimated remaining: 1m 41s. Rate: 157.6 symbols/min [2025-10-16T22:43:06.234123] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:06.250338] [DEBUG] [MAIN ] THO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:06.251413] [INFO ] [MAIN ] THO: Generated 1807 derivative records from 41680 primary records. [2025-10-16T22:43:06.251693] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-16T22:43:06.274564] [DEBUG] [LOCAL ] THO: Derivative data saved (1807 records). [2025-10-16T22:43:06.274838] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-16T22:43:06.278825] [INFO ] [MAIN ] Derivative Progress: 1539/1803 symbols completed. THO took 1.2s. Estimated remaining: 1m 40s. Rate: 157.7 symbols/min [2025-10-16T22:43:06.279119] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:06.295715] [DEBUG] [LOCAL ] THW: Loaded 19846 existing records from primary storage. [2025-10-16T22:43:06.295856] [INFO ] [MAIN ] THW: Loaded 19846 primary data records. [2025-10-16T22:43:06.417437] [DEBUG] [LOCAL ] THS: Loaded 38873 existing records from primary storage. [2025-10-16T22:43:06.417617] [INFO ] [MAIN ] THS: Loaded 38873 primary data records. [2025-10-16T22:43:06.692510] [DEBUG] [LOCAL ] TIMB: Loaded 35551 existing records from primary storage. [2025-10-16T22:43:06.710750] [INFO ] [MAIN ] TIMB: Loaded 35551 primary data records. [2025-10-16T22:43:07.313335] [DEBUG] [MAIN ] THW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:07.315320] [INFO ] [MAIN ] THW: Generated 1807 derivative records from 19846 primary records. [2025-10-16T22:43:07.315499] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-16T22:43:07.337124] [DEBUG] [LOCAL ] THW: Derivative data saved (1807 records). [2025-10-16T22:43:07.337525] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-16T22:43:07.339827] [INFO ] [MAIN ] Derivative Progress: 1540/1803 symbols completed. THW took 1.1s. Estimated remaining: 1m 40s. Rate: 157.5 symbols/min [2025-10-16T22:43:07.347617] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:07.353499] [DEBUG] [MAIN ] THS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:07.354526] [INFO ] [MAIN ] THS: Generated 1807 derivative records from 38873 primary records. [2025-10-16T22:43:07.354800] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-16T22:43:07.370821] [DEBUG] [LOCAL ] TISI: Loaded 3349 existing records from primary storage. [2025-10-16T22:43:07.373935] [INFO ] [MAIN ] TISI: Loaded 3349 primary data records. [2025-10-16T22:43:07.375164] [DEBUG] [LOCAL ] THS: Derivative data saved (1807 records). [2025-10-16T22:43:07.375264] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-16T22:43:07.413737] [INFO ] [MAIN ] Derivative Progress: 1541/1803 symbols completed. THS took 1.2s. Estimated remaining: 1m 40s. Rate: 157.6 symbols/min [2025-10-16T22:43:07.460805] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:07.537618] [DEBUG] [MAIN ] TIMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:07.551696] [INFO ] [MAIN ] TIMB: Generated 1807 derivative records from 35551 primary records. [2025-10-16T22:43:07.560688] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-16T22:43:07.728319] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1807 records). [2025-10-16T22:43:07.728737] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-16T22:43:07.730994] [INFO ] [MAIN ] Derivative Progress: 1542/1803 symbols completed. TIMB took 1.5s. Estimated remaining: 1m 39s. Rate: 157.6 symbols/min [2025-10-16T22:43:07.731768] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:07.747731] [DEBUG] [LOCAL ] TIXT: Loaded 32709 existing records from primary storage. [2025-10-16T22:43:07.748504] [INFO ] [MAIN ] TIXT: Loaded 32709 primary data records. [2025-10-16T22:43:08.107047] [DEBUG] [MAIN ] TISI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:43:08.108207] [INFO ] [MAIN ] TISI: Generated 1806 derivative records from 3349 primary records. [2025-10-16T22:43:08.108398] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-16T22:43:08.145322] [DEBUG] [LOCAL ] TJX: Loaded 54057 existing records from primary storage. [2025-10-16T22:43:08.145608] [INFO ] [MAIN ] TJX: Loaded 54057 primary data records. [2025-10-16T22:43:08.145444] [DEBUG] [LOCAL ] TISI: Derivative data saved (1806 records). [2025-10-16T22:43:08.145871] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-16T22:43:08.153432] [INFO ] [MAIN ] Derivative Progress: 1543/1803 symbols completed. TISI took 0.8s. Estimated remaining: 1m 39s. Rate: 157.6 symbols/min [2025-10-16T22:43:08.468269] [DEBUG] [MAIN ] TIXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:08.469301] [INFO ] [MAIN ] TIXT: Generated 1807 derivative records from 32709 primary records. [2025-10-16T22:43:08.469572] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-16T22:43:08.488570] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1807 records). [2025-10-16T22:43:08.488788] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-16T22:43:08.492941] [INFO ] [MAIN ] Derivative Progress: 1544/1803 symbols completed. TIXT took 1.0s. Estimated remaining: 1m 39s. Rate: 157.6 symbols/min [2025-10-16T22:43:08.512736] [DEBUG] [MAIN ] TJX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:08.513554] [INFO ] [MAIN ] TJX: Generated 1807 derivative records from 54057 primary records. [2025-10-16T22:43:08.513619] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-16T22:43:08.529809] [DEBUG] [LOCAL ] TJX: Derivative data saved (1807 records). [2025-10-16T22:43:08.529869] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-16T22:43:08.531924] [INFO ] [MAIN ] Derivative Progress: 1545/1803 symbols completed. TJX took 0.8s. Estimated remaining: 1m 38s. Rate: 157.7 symbols/min [2025-10-16T22:43:08.532381] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:08.532316] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:08.532570] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:08.615457] [DEBUG] [LOCAL ] TK: Loaded 39426 existing records from primary storage. [2025-10-16T22:43:08.616195] [DEBUG] [LOCAL ] TKC: Loaded 39841 existing records from primary storage. [2025-10-16T22:43:08.627708] [INFO ] [MAIN ] TK: Loaded 39426 primary data records. [2025-10-16T22:43:08.629264] [INFO ] [MAIN ] TKC: Loaded 39841 primary data records. [2025-10-16T22:43:08.671162] [DEBUG] [LOCAL ] TKO: Loaded 44026 existing records from primary storage. [2025-10-16T22:43:08.741403] [INFO ] [MAIN ] TKO: Loaded 44026 primary data records. [2025-10-16T22:43:09.689136] [DEBUG] [MAIN ] TK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:09.692007] [INFO ] [MAIN ] TK: Generated 1807 derivative records from 39426 primary records. [2025-10-16T22:43:09.692440] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-16T22:43:09.726488] [DEBUG] [LOCAL ] TK: Derivative data saved (1807 records). [2025-10-16T22:43:09.727707] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-10-16T22:43:09.730324] [INFO ] [MAIN ] Derivative Progress: 1546/1803 symbols completed. TK took 1.2s. Estimated remaining: 1m 38s. Rate: 157.5 symbols/min [2025-10-16T22:43:09.730956] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:09.730783] [DEBUG] [MAIN ] TKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:09.732583] [INFO ] [MAIN ] TKC: Generated 1807 derivative records from 39841 primary records. [2025-10-16T22:43:09.732814] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-16T22:43:09.753659] [DEBUG] [LOCAL ] TKC: Derivative data saved (1807 records). [2025-10-16T22:43:09.754028] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-16T22:43:09.757188] [INFO ] [MAIN ] Derivative Progress: 1547/1803 symbols completed. TKC took 1.2s. Estimated remaining: 1m 37s. Rate: 157.6 symbols/min [2025-10-16T22:43:09.757371] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:09.773069] [DEBUG] [MAIN ] TKO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:09.773768] [INFO ] [MAIN ] TKO: Generated 1807 derivative records from 44026 primary records. [2025-10-16T22:43:09.773855] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-16T22:43:09.803533] [DEBUG] [LOCAL ] TKO: Derivative data saved (1807 records). [2025-10-16T22:43:09.803705] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-10-16T22:43:09.806160] [INFO ] [MAIN ] Derivative Progress: 1548/1803 symbols completed. TKO took 1.3s. Estimated remaining: 1m 37s. Rate: 157.7 symbols/min [2025-10-16T22:43:09.806397] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:09.834184] [DEBUG] [LOCAL ] TKR: Loaded 39969 existing records from primary storage. [2025-10-16T22:43:09.843974] [INFO ] [MAIN ] TKR: Loaded 39969 primary data records. [2025-10-16T22:43:09.906074] [DEBUG] [LOCAL ] TLYS: Loaded 16632 existing records from primary storage. [2025-10-16T22:43:09.876621] [DEBUG] [LOCAL ] TLK: Loaded 39006 existing records from primary storage. [2025-10-16T22:43:09.932328] [INFO ] [MAIN ] TLYS: Loaded 16632 primary data records. [2025-10-16T22:43:09.932232] [INFO ] [MAIN ] TLK: Loaded 39006 primary data records. [2025-10-16T22:43:10.779472] [DEBUG] [MAIN ] TKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:10.780389] [INFO ] [MAIN ] TKR: Generated 1807 derivative records from 39969 primary records. [2025-10-16T22:43:10.781027] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-16T22:43:10.824978] [DEBUG] [MAIN ] TLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:10.824480] [DEBUG] [MAIN ] TLYS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:10.826176] [INFO ] [MAIN ] TLK: Generated 1807 derivative records from 39006 primary records. [2025-10-16T22:43:10.826852] [INFO ] [MAIN ] TLYS: Generated 1807 derivative records from 16632 primary records. [2025-10-16T22:43:10.827581] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-16T22:43:10.829243] [DEBUG] [LOCAL ] TKR: Derivative data saved (1807 records). [2025-10-16T22:43:10.830101] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-16T22:43:10.832083] [INFO ] [MAIN ] Derivative Progress: 1549/1803 symbols completed. TKR took 1.1s. Estimated remaining: 1m 37s. Rate: 157.5 symbols/min [2025-10-16T22:43:10.829305] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-16T22:43:10.840042] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:10.865358] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1807 records). [2025-10-16T22:43:10.866035] [DEBUG] [LOCAL ] TLK: Derivative data saved (1807 records). [2025-10-16T22:43:10.866184] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-16T22:43:10.866125] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-16T22:43:10.868563] [INFO ] [MAIN ] Derivative Progress: 1550/1803 symbols completed. TLK took 1.1s. Estimated remaining: 1m 36s. Rate: 157.6 symbols/min [2025-10-16T22:43:10.871395] [INFO ] [MAIN ] Derivative Progress: 1551/1803 symbols completed. TLYS took 1.1s. Estimated remaining: 1m 36s. Rate: 157.7 symbols/min [2025-10-16T22:43:10.868765] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:10.871564] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:10.903835] [DEBUG] [LOCAL ] TM: Loaded 36641 existing records from primary storage. [2025-10-16T22:43:10.903972] [INFO ] [MAIN ] TM: Loaded 36641 primary data records. [2025-10-16T22:43:11.138846] [DEBUG] [LOCAL ] TME: Loaded 53584 existing records from primary storage. [2025-10-16T22:43:11.224204] [DEBUG] [LOCAL ] TMHC: Loaded 45838 existing records from primary storage. [2025-10-16T22:43:11.280232] [INFO ] [MAIN ] TME: Loaded 53584 primary data records. [2025-10-16T22:43:11.280971] [INFO ] [MAIN ] TMHC: Loaded 45838 primary data records. [2025-10-16T22:43:11.935156] [DEBUG] [MAIN ] TM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:11.937178] [INFO ] [MAIN ] TM: Generated 1807 derivative records from 36641 primary records. [2025-10-16T22:43:11.937371] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-16T22:43:11.961242] [DEBUG] [LOCAL ] TM: Derivative data saved (1807 records). [2025-10-16T22:43:11.961905] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-16T22:43:11.964715] [INFO ] [MAIN ] Derivative Progress: 1552/1803 symbols completed. TM took 1.1s. Estimated remaining: 1m 36s. Rate: 157.5 symbols/min [2025-10-16T22:43:11.965009] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:11.997905] [DEBUG] [MAIN ] TME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:12.000091] [INFO ] [MAIN ] TME: Generated 1807 derivative records from 53584 primary records. [2025-10-16T22:43:12.000347] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-16T22:43:12.034420] [DEBUG] [MAIN ] TMHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:12.036200] [INFO ] [MAIN ] TMHC: Generated 1807 derivative records from 45838 primary records. [2025-10-16T22:43:12.037685] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-16T22:43:12.051826] [DEBUG] [LOCAL ] TME: Derivative data saved (1807 records). [2025-10-16T22:43:12.071864] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-16T22:43:12.075562] [INFO ] [MAIN ] Derivative Progress: 1553/1803 symbols completed. TME took 1.2s. Estimated remaining: 1m 35s. Rate: 157.6 symbols/min [2025-10-16T22:43:12.076520] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:12.081512] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1807 records). [2025-10-16T22:43:12.081835] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-16T22:43:12.089390] [INFO ] [MAIN ] Derivative Progress: 1554/1803 symbols completed. TMHC took 1.2s. Estimated remaining: 1m 35s. Rate: 157.7 symbols/min [2025-10-16T22:43:12.089603] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:12.110597] [DEBUG] [LOCAL ] TMO: Loaded 52826 existing records from primary storage. [2025-10-16T22:43:12.110923] [INFO ] [MAIN ] TMO: Loaded 52826 primary data records. [2025-10-16T22:43:12.170763] [DEBUG] [LOCAL ] TNC: Loaded 14518 existing records from primary storage. [2025-10-16T22:43:12.190864] [INFO ] [MAIN ] TNC: Loaded 14518 primary data records. [2025-10-16T22:43:12.579477] [DEBUG] [LOCAL ] TNET: Loaded 28518 existing records from primary storage. [2025-10-16T22:43:12.586145] [INFO ] [MAIN ] TNET: Loaded 28518 primary data records. [2025-10-16T22:43:13.093170] [DEBUG] [MAIN ] TMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:13.106417] [INFO ] [MAIN ] TMO: Generated 1807 derivative records from 52826 primary records. [2025-10-16T22:43:13.108011] [DEBUG] [MAIN ] TNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:13.108078] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-16T22:43:13.109354] [INFO ] [MAIN ] TNC: Generated 1807 derivative records from 14518 primary records. [2025-10-16T22:43:13.110348] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-16T22:43:13.140016] [DEBUG] [LOCAL ] TNC: Derivative data saved (1807 records). [2025-10-16T22:43:13.140495] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-16T22:43:13.144409] [INFO ] [MAIN ] Derivative Progress: 1555/1803 symbols completed. TNC took 1.1s. Estimated remaining: 1m 34s. Rate: 157.5 symbols/min [2025-10-16T22:43:13.145081] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:13.147076] [DEBUG] [LOCAL ] TMO: Derivative data saved (1807 records). [2025-10-16T22:43:13.147160] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-16T22:43:13.150376] [INFO ] [MAIN ] Derivative Progress: 1556/1803 symbols completed. TMO took 1.2s. Estimated remaining: 1m 34s. Rate: 157.6 symbols/min [2025-10-16T22:43:13.151612] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:13.165221] [DEBUG] [MAIN ] TNET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:13.165962] [INFO ] [MAIN ] TNET: Generated 1807 derivative records from 28518 primary records. [2025-10-16T22:43:13.166172] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-16T22:43:13.202964] [DEBUG] [LOCAL ] TNET: Derivative data saved (1807 records). [2025-10-16T22:43:13.203253] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-16T22:43:13.205810] [INFO ] [MAIN ] Derivative Progress: 1557/1803 symbols completed. TNET took 1.1s. Estimated remaining: 1m 34s. Rate: 157.7 symbols/min [2025-10-16T22:43:13.206127] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:13.231467] [DEBUG] [LOCAL ] TNK: Loaded 35627 existing records from primary storage. [2025-10-16T22:43:13.232283] [INFO ] [MAIN ] TNK: Loaded 35627 primary data records. [2025-10-16T22:43:13.325071] [DEBUG] [LOCAL ] TNL: Loaded 42043 existing records from primary storage. [2025-10-16T22:43:13.336440] [INFO ] [MAIN ] TNL: Loaded 42043 primary data records. [2025-10-16T22:43:13.854393] [DEBUG] [LOCAL ] TOL: Loaded 51005 existing records from primary storage. [2025-10-16T22:43:13.856155] [INFO ] [MAIN ] TOL: Loaded 51005 primary data records. [2025-10-16T22:43:14.184495] [DEBUG] [MAIN ] TNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:14.185763] [INFO ] [MAIN ] TNK: Generated 1807 derivative records from 35627 primary records. [2025-10-16T22:43:14.185911] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-16T22:43:14.212951] [DEBUG] [MAIN ] TNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:14.216970] [INFO ] [MAIN ] TNL: Generated 1807 derivative records from 42043 primary records. [2025-10-16T22:43:14.217323] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-16T22:43:14.217151] [DEBUG] [LOCAL ] TNK: Derivative data saved (1807 records). [2025-10-16T22:43:14.217465] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-16T22:43:14.219879] [INFO ] [MAIN ] Derivative Progress: 1558/1803 symbols completed. TNK took 1.1s. Estimated remaining: 1m 33s. Rate: 157.5 symbols/min [2025-10-16T22:43:14.236259] [DEBUG] [LOCAL ] TNL: Derivative data saved (1807 records). [2025-10-16T22:43:14.236407] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-16T22:43:14.238872] [INFO ] [MAIN ] Derivative Progress: 1559/1803 symbols completed. TNL took 1.1s. Estimated remaining: 1m 33s. Rate: 157.6 symbols/min [2025-10-16T22:43:14.253485] [DEBUG] [MAIN ] TOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:14.254006] [INFO ] [MAIN ] TOL: Generated 1807 derivative records from 51005 primary records. [2025-10-16T22:43:14.254066] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-16T22:43:14.269322] [DEBUG] [LOCAL ] TOL: Derivative data saved (1807 records). [2025-10-16T22:43:14.269381] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-16T22:43:14.271750] [INFO ] [MAIN ] Derivative Progress: 1560/1803 symbols completed. TOL took 1.1s. Estimated remaining: 1m 32s. Rate: 157.7 symbols/min [2025-10-16T22:43:14.272144] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:14.272210] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:14.272323] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:14.323420] [DEBUG] [LOCAL ] TPB: Loaded 26306 existing records from primary storage. [2025-10-16T22:43:14.324538] [INFO ] [MAIN ] TPB: Loaded 26306 primary data records. [2025-10-16T22:43:14.325287] [DEBUG] [LOCAL ] TPC: Loaded 39334 existing records from primary storage. [2025-10-16T22:43:14.325371] [INFO ] [MAIN ] TPC: Loaded 39334 primary data records. [2025-10-16T22:43:14.581468] [DEBUG] [LOCAL ] TOST: Loaded 54080 existing records from primary storage. [2025-10-16T22:43:14.621065] [INFO ] [MAIN ] TOST: Loaded 54080 primary data records. [2025-10-16T22:43:15.326708] [DEBUG] [MAIN ] TPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:15.327814] [INFO ] [MAIN ] TPC: Generated 1807 derivative records from 39334 primary records. [2025-10-16T22:43:15.328091] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-16T22:43:15.359788] [DEBUG] [LOCAL ] TPC: Derivative data saved (1807 records). [2025-10-16T22:43:15.361179] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-16T22:43:15.362232] [DEBUG] [MAIN ] TPB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:15.364390] [INFO ] [MAIN ] TPB: Generated 1807 derivative records from 26306 primary records. [2025-10-16T22:43:15.364547] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-16T22:43:15.367317] [INFO ] [MAIN ] Derivative Progress: 1561/1803 symbols completed. TPC took 1.1s. Estimated remaining: 1m 32s. Rate: 157.5 symbols/min [2025-10-16T22:43:15.367754] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:15.396353] [DEBUG] [MAIN ] TOST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:15.398305] [INFO ] [MAIN ] TOST: Generated 1807 derivative records from 54080 primary records. [2025-10-16T22:43:15.398394] [DEBUG] [LOCAL ] TPB: Derivative data saved (1807 records). [2025-10-16T22:43:15.398590] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-16T22:43:15.401372] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-16T22:43:15.401300] [INFO ] [MAIN ] Derivative Progress: 1562/1803 symbols completed. TPB took 1.1s. Estimated remaining: 1m 32s. Rate: 157.6 symbols/min [2025-10-16T22:43:15.401615] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:15.418410] [DEBUG] [LOCAL ] TOST: Derivative data saved (1807 records). [2025-10-16T22:43:15.418804] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-16T22:43:15.421538] [INFO ] [MAIN ] Derivative Progress: 1563/1803 symbols completed. TOST took 1.1s. Estimated remaining: 1m 31s. Rate: 157.7 symbols/min [2025-10-16T22:43:15.424812] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:15.432816] [DEBUG] [LOCAL ] TPL: Loaded 12470 existing records from primary storage. [2025-10-16T22:43:15.433031] [INFO ] [MAIN ] TPL: Loaded 12470 primary data records. [2025-10-16T22:43:15.573396] [DEBUG] [LOCAL ] TPH: Loaded 45161 existing records from primary storage. [2025-10-16T22:43:15.621194] [INFO ] [MAIN ] TPH: Loaded 45161 primary data records. [2025-10-16T22:43:15.892590] [DEBUG] [LOCAL ] TPR: Loaded 53806 existing records from primary storage. [2025-10-16T22:43:15.920282] [INFO ] [MAIN ] TPR: Loaded 53806 primary data records. [2025-10-16T22:43:16.444307] [DEBUG] [MAIN ] TPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:16.445991] [INFO ] [MAIN ] TPL: Generated 1807 derivative records from 12470 primary records. [2025-10-16T22:43:16.448164] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-16T22:43:16.477895] [DEBUG] [MAIN ] TPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:16.478878] [INFO ] [MAIN ] TPH: Generated 1807 derivative records from 45161 primary records. [2025-10-16T22:43:16.480188] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-16T22:43:16.481246] [DEBUG] [LOCAL ] TPL: Derivative data saved (1807 records). [2025-10-16T22:43:16.482440] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-16T22:43:16.485215] [INFO ] [MAIN ] Derivative Progress: 1564/1803 symbols completed. TPL took 1.1s. Estimated remaining: 1m 31s. Rate: 157.5 symbols/min [2025-10-16T22:43:16.492524] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:16.506877] [DEBUG] [MAIN ] TPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:16.507636] [INFO ] [MAIN ] TPR: Generated 1807 derivative records from 53806 primary records. [2025-10-16T22:43:16.510531] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-16T22:43:16.530385] [DEBUG] [LOCAL ] TPR: Derivative data saved (1807 records). [2025-10-16T22:43:16.532100] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-16T22:43:16.532016] [DEBUG] [LOCAL ] TPH: Derivative data saved (1807 records). [2025-10-16T22:43:16.534736] [INFO ] [MAIN ] Derivative Progress: 1565/1803 symbols completed. TPR took 1.1s. Estimated remaining: 1m 31s. Rate: 157.6 symbols/min [2025-10-16T22:43:16.532287] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-16T22:43:16.537723] [INFO ] [MAIN ] Derivative Progress: 1566/1803 symbols completed. TPH took 1.2s. Estimated remaining: 1m 30s. Rate: 157.7 symbols/min [2025-10-16T22:43:16.537450] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:16.545053] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:16.561112] [DEBUG] [LOCAL ] TPVG: Loaded 27498 existing records from primary storage. [2025-10-16T22:43:16.561358] [INFO ] [MAIN ] TPVG: Loaded 27498 primary data records. [2025-10-16T22:43:16.600472] [DEBUG] [LOCAL ] TPZ: Loaded 4722 existing records from primary storage. [2025-10-16T22:43:16.600616] [INFO ] [MAIN ] TPZ: Loaded 4722 primary data records. [2025-10-16T22:43:16.631291] [DEBUG] [LOCAL ] TPYP: Loaded 7970 existing records from primary storage. [2025-10-16T22:43:16.648509] [INFO ] [MAIN ] TPYP: Loaded 7970 primary data records. [2025-10-16T22:43:17.532938] [DEBUG] [MAIN ] TPZ: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:43:17.533308] [DEBUG] [MAIN ] TPVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:17.534059] [INFO ] [MAIN ] TPZ: Generated 1806 derivative records from 4722 primary records. [2025-10-16T22:43:17.534247] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-16T22:43:17.534887] [INFO ] [MAIN ] TPVG: Generated 1807 derivative records from 27498 primary records. [2025-10-16T22:43:17.547891] [DEBUG] [MAIN ] TPYP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:17.554897] [INFO ] [MAIN ] TPYP: Generated 1807 derivative records from 7970 primary records. [2025-10-16T22:43:17.547970] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-16T22:43:17.554988] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-16T22:43:17.589978] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1807 records). [2025-10-16T22:43:17.591260] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-16T22:43:17.595008] [INFO ] [MAIN ] Derivative Progress: 1567/1803 symbols completed. TPYP took 1.1s. Estimated remaining: 1m 30s. Rate: 157.5 symbols/min [2025-10-16T22:43:17.592473] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1806 records). [2025-10-16T22:43:17.596177] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-16T22:43:17.599406] [INFO ] [MAIN ] Derivative Progress: 1568/1803 symbols completed. TPZ took 1.1s. Estimated remaining: 1m 29s. Rate: 157.6 symbols/min [2025-10-16T22:43:17.596318] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:17.599758] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:17.599979] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1807 records). [2025-10-16T22:43:17.600174] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-16T22:43:17.603023] [INFO ] [MAIN ] Derivative Progress: 1569/1803 symbols completed. TPVG took 1.1s. Estimated remaining: 1m 29s. Rate: 157.7 symbols/min [2025-10-16T22:43:17.603399] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:17.623924] [DEBUG] [LOCAL ] TRAK: Loaded 9724 existing records from primary storage. [2025-10-16T22:43:17.624118] [INFO ] [MAIN ] TRAK: Loaded 9724 primary data records. [2025-10-16T22:43:17.669046] [DEBUG] [LOCAL ] TR: Loaded 19082 existing records from primary storage. [2025-10-16T22:43:17.674468] [DEBUG] [LOCAL ] TRC: Loaded 15667 existing records from primary storage. [2025-10-16T22:43:17.704874] [INFO ] [MAIN ] TR: Loaded 19082 primary data records. [2025-10-16T22:43:17.710081] [INFO ] [MAIN ] TRC: Loaded 15667 primary data records. [2025-10-16T22:43:18.602953] [DEBUG] [MAIN ] TRAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:18.604115] [INFO ] [MAIN ] TRAK: Generated 1807 derivative records from 9724 primary records. [2025-10-16T22:43:18.617118] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-16T22:43:18.617030] [DEBUG] [MAIN ] TR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:18.618512] [INFO ] [MAIN ] TR: Generated 1807 derivative records from 19082 primary records. [2025-10-16T22:43:18.632066] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-16T22:43:18.658840] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1807 records). [2025-10-16T22:43:18.667375] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-16T22:43:18.675089] [INFO ] [MAIN ] Derivative Progress: 1570/1803 symbols completed. TRAK took 1.1s. Estimated remaining: 1m 29s. Rate: 157.5 symbols/min [2025-10-16T22:43:18.676079] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:18.675598] [DEBUG] [MAIN ] TRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:18.679628] [INFO ] [MAIN ] TRC: Generated 1807 derivative records from 15667 primary records. [2025-10-16T22:43:18.679909] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-16T22:43:18.682409] [DEBUG] [LOCAL ] TR: Derivative data saved (1807 records). [2025-10-16T22:43:18.682535] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-16T22:43:18.685629] [INFO ] [MAIN ] Derivative Progress: 1571/1803 symbols completed. TR took 1.1s. Estimated remaining: 1m 28s. Rate: 157.6 symbols/min [2025-10-16T22:43:18.694665] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:18.701891] [DEBUG] [LOCAL ] TRC: Derivative data saved (1807 records). [2025-10-16T22:43:18.701966] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-16T22:43:18.704505] [INFO ] [MAIN ] Derivative Progress: 1572/1803 symbols completed. TRC took 1.1s. Estimated remaining: 1m 28s. Rate: 157.7 symbols/min [2025-10-16T22:43:18.704692] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:18.773546] [DEBUG] [LOCAL ] TREX: Loaded 50214 existing records from primary storage. [2025-10-16T22:43:18.774110] [DEBUG] [LOCAL ] TRN: Loaded 36976 existing records from primary storage. [2025-10-16T22:43:18.774269] [INFO ] [MAIN ] TRN: Loaded 36976 primary data records. [2025-10-16T22:43:18.774349] [INFO ] [MAIN ] TREX: Loaded 50214 primary data records. [2025-10-16T22:43:18.906856] [DEBUG] [LOCAL ] TRGP: Loaded 51196 existing records from primary storage. [2025-10-16T22:43:18.968373] [INFO ] [MAIN ] TRGP: Loaded 51196 primary data records. [2025-10-16T22:43:19.740094] [DEBUG] [MAIN ] TRN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:19.753759] [INFO ] [MAIN ] TRN: Generated 1807 derivative records from 36976 primary records. [2025-10-16T22:43:19.755045] [DEBUG] [MAIN ] TREX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:19.755133] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-16T22:43:19.755817] [INFO ] [MAIN ] TREX: Generated 1807 derivative records from 50214 primary records. [2025-10-16T22:43:19.756638] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-16T22:43:19.789256] [DEBUG] [MAIN ] TRGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:19.794475] [INFO ] [MAIN ] TRGP: Generated 1807 derivative records from 51196 primary records. [2025-10-16T22:43:19.797222] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-16T22:43:19.799425] [DEBUG] [LOCAL ] TREX: Derivative data saved (1807 records). [2025-10-16T22:43:19.801210] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-16T22:43:19.804205] [INFO ] [MAIN ] Derivative Progress: 1573/1803 symbols completed. TREX took 1.1s. Estimated remaining: 1m 28s. Rate: 157.6 symbols/min [2025-10-16T22:43:19.813052] [DEBUG] [LOCAL ] TRN: Derivative data saved (1807 records). [2025-10-16T22:43:19.814404] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-16T22:43:19.816624] [INFO ] [MAIN ] Derivative Progress: 1574/1803 symbols completed. TRN took 1.1s. Estimated remaining: 1m 27s. Rate: 157.6 symbols/min [2025-10-16T22:43:19.823263] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1807 records). [2025-10-16T22:43:19.823340] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-16T22:43:19.826151] [INFO ] [MAIN ] Derivative Progress: 1575/1803 symbols completed. TRGP took 1.1s. Estimated remaining: 1m 27s. Rate: 157.7 symbols/min [2025-10-16T22:43:19.826601] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:19.826543] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:19.826840] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:19.893883] [DEBUG] [LOCAL ] TRNO: Loaded 44252 existing records from primary storage. [2025-10-16T22:43:19.894141] [INFO ] [MAIN ] TRNO: Loaded 44252 primary data records. [2025-10-16T22:43:20.019046] [DEBUG] [LOCAL ] TROX: Loaded 52556 existing records from primary storage. [2025-10-16T22:43:20.012347] [DEBUG] [LOCAL ] TRP: Loaded 52524 existing records from primary storage. [2025-10-16T22:43:20.029905] [INFO ] [MAIN ] TRP: Loaded 52524 primary data records. [2025-10-16T22:43:20.030057] [INFO ] [MAIN ] TROX: Loaded 52556 primary data records. [2025-10-16T22:43:20.903081] [DEBUG] [MAIN ] TRNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:20.904070] [INFO ] [MAIN ] TRNO: Generated 1807 derivative records from 44252 primary records. [2025-10-16T22:43:20.906568] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-16T22:43:20.933272] [DEBUG] [MAIN ] TROX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:20.934522] [INFO ] [MAIN ] TROX: Generated 1807 derivative records from 52556 primary records. [2025-10-16T22:43:20.935588] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-16T22:43:20.957999] [DEBUG] [MAIN ] TRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:20.959386] [INFO ] [MAIN ] TRP: Generated 1807 derivative records from 52524 primary records. [2025-10-16T22:43:20.958778] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1807 records). [2025-10-16T22:43:20.963118] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-16T22:43:20.963863] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-16T22:43:20.965904] [INFO ] [MAIN ] Derivative Progress: 1576/1803 symbols completed. TRNO took 1.1s. Estimated remaining: 1m 26s. Rate: 157.5 symbols/min [2025-10-16T22:43:20.966057] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:20.983872] [DEBUG] [LOCAL ] TROX: Derivative data saved (1807 records). [2025-10-16T22:43:20.984675] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-16T22:43:20.989470] [INFO ] [MAIN ] Derivative Progress: 1577/1803 symbols completed. TROX took 1.2s. Estimated remaining: 1m 26s. Rate: 157.6 symbols/min [2025-10-16T22:43:20.989918] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:20.990574] [DEBUG] [LOCAL ] TRP: Derivative data saved (1807 records). [2025-10-16T22:43:20.991058] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-16T22:43:20.993407] [INFO ] [MAIN ] Derivative Progress: 1578/1803 symbols completed. TRP took 1.2s. Estimated remaining: 1m 26s. Rate: 157.7 symbols/min [2025-10-16T22:43:20.993761] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:21.025700] [DEBUG] [LOCAL ] TRTX: Loaded 37536 existing records from primary storage. [2025-10-16T22:43:21.025981] [INFO ] [MAIN ] TRTX: Loaded 37536 primary data records. [2025-10-16T22:43:21.379103] [DEBUG] [LOCAL ] TRV: Loaded 47824 existing records from primary storage. [2025-10-16T22:43:21.379913] [DEBUG] [LOCAL ] TRU: Loaded 51815 existing records from primary storage. [2025-10-16T22:43:21.380014] [INFO ] [MAIN ] TRV: Loaded 47824 primary data records. [2025-10-16T22:43:21.380091] [INFO ] [MAIN ] TRU: Loaded 51815 primary data records. [2025-10-16T22:43:22.015422] [DEBUG] [MAIN ] TRTX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:22.017551] [INFO ] [MAIN ] TRTX: Generated 1807 derivative records from 37536 primary records. [2025-10-16T22:43:22.017893] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-16T22:43:22.036560] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1807 records). [2025-10-16T22:43:22.037719] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-16T22:43:22.040255] [INFO ] [MAIN ] Derivative Progress: 1579/1803 symbols completed. TRTX took 1.1s. Estimated remaining: 1m 25s. Rate: 157.6 symbols/min [2025-10-16T22:43:22.042233] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:22.056301] [DEBUG] [MAIN ] TRU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:22.057061] [INFO ] [MAIN ] TRU: Generated 1807 derivative records from 51815 primary records. [2025-10-16T22:43:22.057255] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-16T22:43:22.087026] [DEBUG] [MAIN ] TRV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:22.088619] [INFO ] [MAIN ] TRV: Generated 1807 derivative records from 47824 primary records. [2025-10-16T22:43:22.088944] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-16T22:43:22.091741] [DEBUG] [LOCAL ] TRU: Derivative data saved (1807 records). [2025-10-16T22:43:22.092392] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-16T22:43:22.095261] [INFO ] [MAIN ] Derivative Progress: 1580/1803 symbols completed. TRU took 1.1s. Estimated remaining: 1m 25s. Rate: 157.6 symbols/min [2025-10-16T22:43:22.106450] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:22.111002] [DEBUG] [LOCAL ] TRV: Derivative data saved (1807 records). [2025-10-16T22:43:22.111090] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-16T22:43:22.114408] [INFO ] [MAIN ] Derivative Progress: 1581/1803 symbols completed. TRV took 1.1s. Estimated remaining: 1m 24s. Rate: 157.7 symbols/min [2025-10-16T22:43:22.114824] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:22.137446] [DEBUG] [LOCAL ] TSI: Loaded 8147 existing records from primary storage. [2025-10-16T22:43:22.137666] [INFO ] [MAIN ] TSI: Loaded 8147 primary data records. [2025-10-16T22:43:22.269411] [DEBUG] [LOCAL ] TSE: Loaded 27928 existing records from primary storage. [2025-10-16T22:43:22.290512] [INFO ] [MAIN ] TSE: Loaded 27928 primary data records. [2025-10-16T22:43:22.317760] [DEBUG] [LOCAL ] TS: Loaded 52062 existing records from primary storage. [2025-10-16T22:43:22.484070] [INFO ] [MAIN ] TS: Loaded 52062 primary data records. [2025-10-16T22:43:23.160464] [DEBUG] [MAIN ] TSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:23.161911] [INFO ] [MAIN ] TSI: Generated 1807 derivative records from 8147 primary records. [2025-10-16T22:43:23.162084] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-10-16T22:43:23.177682] [DEBUG] [LOCAL ] TSI: Derivative data saved (1807 records). [2025-10-16T22:43:23.178848] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-10-16T22:43:23.182122] [INFO ] [MAIN ] Derivative Progress: 1582/1803 symbols completed. TSI took 1.1s. Estimated remaining: 1m 24s. Rate: 157.6 symbols/min [2025-10-16T22:43:23.182511] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:23.197037] [DEBUG] [MAIN ] TSE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:23.197746] [INFO ] [MAIN ] TSE: Generated 1807 derivative records from 27928 primary records. [2025-10-16T22:43:23.198006] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-16T22:43:23.217885] [DEBUG] [LOCAL ] TSE: Derivative data saved (1807 records). [2025-10-16T22:43:23.218362] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-16T22:43:23.221319] [INFO ] [MAIN ] Derivative Progress: 1583/1803 symbols completed. TSE took 1.1s. Estimated remaining: 1m 24s. Rate: 157.7 symbols/min [2025-10-16T22:43:23.233894] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:23.234235] [DEBUG] [MAIN ] TS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:23.235486] [INFO ] [MAIN ] TS: Generated 1807 derivative records from 52062 primary records. [2025-10-16T22:43:23.244351] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-16T22:43:23.271265] [DEBUG] [LOCAL ] TS: Derivative data saved (1807 records). [2025-10-16T22:43:23.271376] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-16T22:43:23.273802] [INFO ] [MAIN ] Derivative Progress: 1584/1803 symbols completed. TS took 1.2s. Estimated remaining: 1m 23s. Rate: 157.7 symbols/min [2025-10-16T22:43:23.274101] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:23.274971] [DEBUG] [LOCAL ] TSLX: Loaded 36199 existing records from primary storage. [2025-10-16T22:43:23.275733] [INFO ] [MAIN ] TSLX: Loaded 36199 primary data records. [2025-10-16T22:43:23.637353] [DEBUG] [LOCAL ] TSM: Loaded 54209 existing records from primary storage. [2025-10-16T22:43:23.637685] [INFO ] [MAIN ] TSM: Loaded 54209 primary data records. [2025-10-16T22:43:23.772853] [DEBUG] [LOCAL ] TSN: Loaded 53431 existing records from primary storage. [2025-10-16T22:43:23.774124] [INFO ] [MAIN ] TSN: Loaded 53431 primary data records. [2025-10-16T22:43:24.305500] [DEBUG] [MAIN ] TSLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:24.306624] [INFO ] [MAIN ] TSLX: Generated 1807 derivative records from 36199 primary records. [2025-10-16T22:43:24.306858] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-16T22:43:24.325464] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1807 records). [2025-10-16T22:43:24.325849] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-16T22:43:24.330828] [INFO ] [MAIN ] Derivative Progress: 1585/1803 symbols completed. TSLX took 1.1s. Estimated remaining: 1m 23s. Rate: 157.6 symbols/min [2025-10-16T22:43:24.331111] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:24.345488] [DEBUG] [MAIN ] TSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:24.346389] [INFO ] [MAIN ] TSM: Generated 1807 derivative records from 54209 primary records. [2025-10-16T22:43:24.346555] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-16T22:43:24.367747] [DEBUG] [LOCAL ] TSM: Derivative data saved (1807 records). [2025-10-16T22:43:24.373033] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-16T22:43:24.373318] [DEBUG] [LOCAL ] TSQ: Loaded 11747 existing records from primary storage. [2025-10-16T22:43:24.376150] [INFO ] [MAIN ] Derivative Progress: 1586/1803 symbols completed. TSM took 1.1s. Estimated remaining: 1m 23s. Rate: 157.6 symbols/min [2025-10-16T22:43:24.376279] [INFO ] [MAIN ] TSQ: Loaded 11747 primary data records. [2025-10-16T22:43:24.376629] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:24.432297] [DEBUG] [MAIN ] TSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:24.472475] [INFO ] [MAIN ] TSN: Generated 1807 derivative records from 53431 primary records. [2025-10-16T22:43:24.491948] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-16T22:43:24.704401] [DEBUG] [LOCAL ] TSN: Derivative data saved (1807 records). [2025-10-16T22:43:24.704626] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-16T22:43:24.707325] [INFO ] [MAIN ] Derivative Progress: 1587/1803 symbols completed. TSN took 1.4s. Estimated remaining: 1m 22s. Rate: 157.7 symbols/min [2025-10-16T22:43:24.707830] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:24.738797] [DEBUG] [LOCAL ] TT: Loaded 47661 existing records from primary storage. [2025-10-16T22:43:24.739826] [INFO ] [MAIN ] TT: Loaded 47661 primary data records. [2025-10-16T22:43:24.946383] [DEBUG] [MAIN ] TSQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:24.959338] [INFO ] [MAIN ] TSQ: Generated 1807 derivative records from 11747 primary records. [2025-10-16T22:43:24.998703] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-16T22:43:25.101863] [DEBUG] [LOCAL ] TTC: Loaded 42274 existing records from primary storage. [2025-10-16T22:43:25.111483] [INFO ] [MAIN ] TTC: Loaded 42274 primary data records. [2025-10-16T22:43:25.184537] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1807 records). [2025-10-16T22:43:25.215899] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-16T22:43:25.223726] [INFO ] [MAIN ] Derivative Progress: 1588/1803 symbols completed. TSQ took 0.9s. Estimated remaining: 1m 22s. Rate: 157.6 symbols/min [2025-10-16T22:43:25.454373] [DEBUG] [MAIN ] TT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:25.455759] [INFO ] [MAIN ] TT: Generated 1807 derivative records from 47661 primary records. [2025-10-16T22:43:25.456458] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-16T22:43:25.478794] [DEBUG] [LOCAL ] TT: Derivative data saved (1807 records). [2025-10-16T22:43:25.479150] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-16T22:43:25.482951] [INFO ] [MAIN ] Derivative Progress: 1589/1803 symbols completed. TT took 1.1s. Estimated remaining: 1m 21s. Rate: 157.7 symbols/min [2025-10-16T22:43:25.496120] [DEBUG] [MAIN ] TTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:25.496916] [INFO ] [MAIN ] TTC: Generated 1807 derivative records from 42274 primary records. [2025-10-16T22:43:25.496983] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-16T22:43:25.511983] [DEBUG] [LOCAL ] TTC: Derivative data saved (1807 records). [2025-10-16T22:43:25.512051] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-16T22:43:25.514287] [INFO ] [MAIN ] Derivative Progress: 1590/1803 symbols completed. TTC took 0.8s. Estimated remaining: 1m 21s. Rate: 157.8 symbols/min [2025-10-16T22:43:25.514818] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:25.514947] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:25.515533] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:25.599920] [DEBUG] [LOCAL ] TTI: Loaded 46751 existing records from primary storage. [2025-10-16T22:43:25.601403] [INFO ] [MAIN ] TTI: Loaded 46751 primary data records. [2025-10-16T22:43:25.624328] [DEBUG] [LOCAL ] TU: Loaded 50192 existing records from primary storage. [2025-10-16T22:43:25.640029] [INFO ] [MAIN ] TU: Loaded 50192 primary data records. [2025-10-16T22:43:25.761871] [DEBUG] [LOCAL ] TTE: Loaded 51968 existing records from primary storage. [2025-10-16T22:43:25.786261] [INFO ] [MAIN ] TTE: Loaded 51968 primary data records. [2025-10-16T22:43:26.563313] [DEBUG] [MAIN ] TTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:26.564201] [INFO ] [MAIN ] TTI: Generated 1807 derivative records from 46751 primary records. [2025-10-16T22:43:26.564486] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-16T22:43:26.578846] [DEBUG] [MAIN ] TU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:26.586383] [INFO ] [MAIN ] TU: Generated 1807 derivative records from 50192 primary records. [2025-10-16T22:43:26.587224] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-16T22:43:26.623569] [DEBUG] [MAIN ] TTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:26.625439] [DEBUG] [LOCAL ] TU: Derivative data saved (1807 records). [2025-10-16T22:43:26.621895] [DEBUG] [LOCAL ] TTI: Derivative data saved (1807 records). [2025-10-16T22:43:26.624301] [INFO ] [MAIN ] TTE: Generated 1807 derivative records from 51968 primary records. [2025-10-16T22:43:26.625574] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-16T22:43:26.627886] [INFO ] [MAIN ] Derivative Progress: 1591/1803 symbols completed. TTI took 1.1s. Estimated remaining: 1m 21s. Rate: 157.6 symbols/min [2025-10-16T22:43:26.628145] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-16T22:43:26.625699] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-16T22:43:26.628068] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:26.631677] [INFO ] [MAIN ] Derivative Progress: 1592/1803 symbols completed. TU took 1.1s. Estimated remaining: 1m 20s. Rate: 157.7 symbols/min [2025-10-16T22:43:26.632395] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:26.649082] [DEBUG] [LOCAL ] TTE: Derivative data saved (1807 records). [2025-10-16T22:43:26.649286] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-16T22:43:26.651842] [INFO ] [MAIN ] Derivative Progress: 1593/1803 symbols completed. TTE took 1.1s. Estimated remaining: 1m 20s. Rate: 157.8 symbols/min [2025-10-16T22:43:26.652013] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:26.659945] [DEBUG] [LOCAL ] TVC: Loaded 3226 existing records from primary storage. [2025-10-16T22:43:26.660168] [INFO ] [MAIN ] TVC: Loaded 3226 primary data records. [2025-10-16T22:43:26.996170] [DEBUG] [LOCAL ] TUYA: Loaded 46284 existing records from primary storage. [2025-10-16T22:43:27.045928] [INFO ] [MAIN ] TUYA: Loaded 46284 primary data records. [2025-10-16T22:43:27.045786] [DEBUG] [LOCAL ] TV: Loaded 41831 existing records from primary storage. [2025-10-16T22:43:27.046204] [INFO ] [MAIN ] TV: Loaded 41831 primary data records. [2025-10-16T22:43:27.671700] [DEBUG] [MAIN ] TVC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:43:27.674288] [INFO ] [MAIN ] TVC: Generated 1806 derivative records from 3226 primary records. [2025-10-16T22:43:27.674539] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-16T22:43:27.707597] [DEBUG] [LOCAL ] TVC: Derivative data saved (1806 records). [2025-10-16T22:43:27.707853] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-16T22:43:27.722558] [DEBUG] [MAIN ] TUYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:27.733264] [INFO ] [MAIN ] Derivative Progress: 1594/1803 symbols completed. TVC took 1.1s. Estimated remaining: 1m 20s. Rate: 157.6 symbols/min [2025-10-16T22:43:27.733973] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:27.733892] [DEBUG] [MAIN ] TV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:27.735423] [INFO ] [MAIN ] TUYA: Generated 1807 derivative records from 46284 primary records. [2025-10-16T22:43:27.735664] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-16T22:43:27.737047] [INFO ] [MAIN ] TV: Generated 1807 derivative records from 41831 primary records. [2025-10-16T22:43:27.738057] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-16T22:43:27.752229] [DEBUG] [LOCAL ] TVE: Loaded 2647 existing records from primary storage. [2025-10-16T22:43:27.753296] [INFO ] [MAIN ] TVE: Loaded 2647 primary data records. [2025-10-16T22:43:27.807911] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1807 records). [2025-10-16T22:43:27.808167] [DEBUG] [LOCAL ] TV: Derivative data saved (1807 records). [2025-10-16T22:43:27.816005] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-16T22:43:27.830682] [INFO ] [MAIN ] Derivative Progress: 1595/1803 symbols completed. TV took 1.2s. Estimated remaining: 1m 19s. Rate: 157.6 symbols/min [2025-10-16T22:43:27.844714] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:27.815795] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-16T22:43:27.864019] [INFO ] [MAIN ] Derivative Progress: 1596/1803 symbols completed. TUYA took 1.2s. Estimated remaining: 1m 19s. Rate: 157.7 symbols/min [2025-10-16T22:43:27.888041] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:28.106030] [DEBUG] [LOCAL ] TWI: Loaded 34191 existing records from primary storage. [2025-10-16T22:43:28.106301] [INFO ] [MAIN ] TWI: Loaded 34191 primary data records. [2025-10-16T22:43:28.432119] [DEBUG] [LOCAL ] TWLO: Loaded 53217 existing records from primary storage. [2025-10-16T22:43:28.433378] [INFO ] [MAIN ] TWLO: Loaded 53217 primary data records. [2025-10-16T22:43:28.524857] [DEBUG] [MAIN ] TVE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:28.551613] [INFO ] [MAIN ] TVE: Generated 1807 derivative records from 2647 primary records. [2025-10-16T22:43:28.554703] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-16T22:43:28.646410] [DEBUG] [LOCAL ] TVE: Derivative data saved (1807 records). [2025-10-16T22:43:28.646529] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-16T22:43:28.648590] [INFO ] [MAIN ] Derivative Progress: 1597/1803 symbols completed. TVE took 0.9s. Estimated remaining: 1m 18s. Rate: 157.6 symbols/min [2025-10-16T22:43:28.649079] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:28.768868] [DEBUG] [LOCAL ] TWN: Loaded 3306 existing records from primary storage. [2025-10-16T22:43:28.770840] [INFO ] [MAIN ] TWN: Loaded 3306 primary data records. [2025-10-16T22:43:28.878523] [DEBUG] [MAIN ] TWI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:28.956491] [INFO ] [MAIN ] TWI: Generated 1807 derivative records from 34191 primary records. [2025-10-16T22:43:29.011145] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-16T22:43:29.147473] [DEBUG] [LOCAL ] TWI: Derivative data saved (1807 records). [2025-10-16T22:43:29.147999] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-16T22:43:29.150737] [INFO ] [MAIN ] Derivative Progress: 1598/1803 symbols completed. TWI took 1.3s. Estimated remaining: 1m 18s. Rate: 157.6 symbols/min [2025-10-16T22:43:29.151753] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:29.171529] [DEBUG] [MAIN ] TWLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:29.173634] [INFO ] [MAIN ] TWLO: Generated 1807 derivative records from 53217 primary records. [2025-10-16T22:43:29.173891] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-16T22:43:29.192618] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1807 records). [2025-10-16T22:43:29.192946] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-16T22:43:29.195552] [INFO ] [MAIN ] Derivative Progress: 1599/1803 symbols completed. TWLO took 1.3s. Estimated remaining: 1m 18s. Rate: 157.7 symbols/min [2025-10-16T22:43:29.195714] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:29.213738] [DEBUG] [MAIN ] TWN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:29.214539] [INFO ] [MAIN ] TWN: Generated 1807 derivative records from 3306 primary records. [2025-10-16T22:43:29.214681] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-16T22:43:29.240871] [DEBUG] [LOCAL ] TWN: Derivative data saved (1807 records). [2025-10-16T22:43:29.240961] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-16T22:43:29.244719] [INFO ] [MAIN ] Derivative Progress: 1600/1803 symbols completed. TWN took 0.6s. Estimated remaining: 1m 17s. Rate: 157.8 symbols/min [2025-10-16T22:43:29.245097] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:29.264213] [DEBUG] [LOCAL ] TWO: Loaded 49008 existing records from primary storage. [2025-10-16T22:43:29.264359] [INFO ] [MAIN ] TWO: Loaded 49008 primary data records. [2025-10-16T22:43:29.407009] [DEBUG] [LOCAL ] TXO: Loaded 19992 existing records from primary storage. [2025-10-16T22:43:29.451493] [INFO ] [MAIN ] TXO: Loaded 19992 primary data records. [2025-10-16T22:43:29.451360] [DEBUG] [LOCAL ] TXNM: Loaded 43712 existing records from primary storage. [2025-10-16T22:43:29.534723] [INFO ] [MAIN ] TXNM: Loaded 43712 primary data records. [2025-10-16T22:43:30.214813] [DEBUG] [MAIN ] TWO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:30.216119] [INFO ] [MAIN ] TWO: Generated 1807 derivative records from 49008 primary records. [2025-10-16T22:43:30.216345] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-16T22:43:30.234278] [DEBUG] [LOCAL ] TWO: Derivative data saved (1807 records). [2025-10-16T22:43:30.234506] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-16T22:43:30.237122] [INFO ] [MAIN ] Derivative Progress: 1601/1803 symbols completed. TWO took 1.1s. Estimated remaining: 1m 17s. Rate: 157.6 symbols/min [2025-10-16T22:43:30.237392] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:30.258469] [DEBUG] [MAIN ] TXO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:30.260191] [INFO ] [MAIN ] TXO: Generated 1807 derivative records from 19992 primary records. [2025-10-16T22:43:30.260520] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-16T22:43:30.282127] [DEBUG] [MAIN ] TXNM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:30.287111] [INFO ] [MAIN ] TXNM: Generated 1807 derivative records from 43712 primary records. [2025-10-16T22:43:30.291807] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-16T22:43:30.291711] [DEBUG] [LOCAL ] TXO: Derivative data saved (1807 records). [2025-10-16T22:43:30.292067] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-16T22:43:30.294693] [INFO ] [MAIN ] Derivative Progress: 1602/1803 symbols completed. TXO took 1.0s. Estimated remaining: 1m 16s. Rate: 157.7 symbols/min [2025-10-16T22:43:30.294869] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:30.330065] [DEBUG] [LOCAL ] TY: Loaded 7643 existing records from primary storage. [2025-10-16T22:43:30.330176] [INFO ] [MAIN ] TY: Loaded 7643 primary data records. [2025-10-16T22:43:30.329846] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1807 records). [2025-10-16T22:43:30.341470] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-10-16T22:43:30.369607] [INFO ] [MAIN ] Derivative Progress: 1603/1803 symbols completed. TXNM took 1.2s. Estimated remaining: 1m 16s. Rate: 157.8 symbols/min [2025-10-16T22:43:30.449532] [DEBUG] [LOCAL ] TXT: Loaded 49959 existing records from primary storage. [2025-10-16T22:43:30.465285] [INFO ] [MAIN ] TXT: Loaded 49959 primary data records. [2025-10-16T22:43:30.999235] [DEBUG] [MAIN ] TY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:31.000602] [INFO ] [MAIN ] TY: Generated 1807 derivative records from 7643 primary records. [2025-10-16T22:43:31.000958] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-16T22:43:31.016624] [DEBUG] [LOCAL ] TY: Derivative data saved (1807 records). [2025-10-16T22:43:31.016729] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-16T22:43:31.018690] [INFO ] [MAIN ] Derivative Progress: 1604/1803 symbols completed. TY took 0.7s. Estimated remaining: 1m 16s. Rate: 157.7 symbols/min [2025-10-16T22:43:31.035264] [DEBUG] [MAIN ] TXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:31.035896] [INFO ] [MAIN ] TXT: Generated 1807 derivative records from 49959 primary records. [2025-10-16T22:43:31.035959] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-16T22:43:31.050938] [DEBUG] [LOCAL ] TXT: Derivative data saved (1807 records). [2025-10-16T22:43:31.051006] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-16T22:43:31.053671] [INFO ] [MAIN ] Derivative Progress: 1605/1803 symbols completed. TXT took 0.8s. Estimated remaining: 1m 15s. Rate: 157.8 symbols/min [2025-10-16T22:43:31.054149] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:31.054263] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:31.054874] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:31.076406] [DEBUG] [LOCAL ] TYG: Loaded 13989 existing records from primary storage. [2025-10-16T22:43:31.076601] [INFO ] [MAIN ] TYG: Loaded 13989 primary data records. [2025-10-16T22:43:31.116328] [DEBUG] [LOCAL ] TYL: Loaded 22523 existing records from primary storage. [2025-10-16T22:43:31.154089] [INFO ] [MAIN ] TYL: Loaded 22523 primary data records. [2025-10-16T22:43:31.446373] [DEBUG] [LOCAL ] U: Loaded 54189 existing records from primary storage. [2025-10-16T22:43:31.607677] [INFO ] [MAIN ] U: Loaded 54189 primary data records. [2025-10-16T22:43:32.084721] [DEBUG] [MAIN ] TYG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:32.086044] [INFO ] [MAIN ] TYG: Generated 1807 derivative records from 13989 primary records. [2025-10-16T22:43:32.098206] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-16T22:43:32.100316] [DEBUG] [MAIN ] TYL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:32.112589] [INFO ] [MAIN ] TYL: Generated 1807 derivative records from 22523 primary records. [2025-10-16T22:43:32.112872] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-16T22:43:32.133893] [DEBUG] [LOCAL ] TYL: Derivative data saved (1807 records). [2025-10-16T22:43:32.134095] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-16T22:43:32.136756] [INFO ] [MAIN ] Derivative Progress: 1606/1803 symbols completed. TYL took 1.1s. Estimated remaining: 1m 15s. Rate: 157.6 symbols/min [2025-10-16T22:43:32.137351] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:32.152767] [DEBUG] [LOCAL ] TYG: Derivative data saved (1807 records). [2025-10-16T22:43:32.153214] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-16T22:43:32.153114] [DEBUG] [MAIN ] U: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:32.156363] [INFO ] [MAIN ] U: Generated 1807 derivative records from 54189 primary records. [2025-10-16T22:43:32.156506] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-16T22:43:32.155605] [INFO ] [MAIN ] Derivative Progress: 1607/1803 symbols completed. TYG took 1.1s. Estimated remaining: 1m 15s. Rate: 157.7 symbols/min [2025-10-16T22:43:32.157276] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:32.172978] [DEBUG] [LOCAL ] U: Derivative data saved (1807 records). [2025-10-16T22:43:32.173138] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-16T22:43:32.175752] [INFO ] [MAIN ] Derivative Progress: 1608/1803 symbols completed. U took 1.1s. Estimated remaining: 1m 14s. Rate: 157.8 symbols/min [2025-10-16T22:43:32.175953] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:32.184793] [DEBUG] [LOCAL ] UAN: Loaded 5451 existing records from primary storage. [2025-10-16T22:43:32.185144] [INFO ] [MAIN ] UAN: Loaded 5451 primary data records. [2025-10-16T22:43:32.384830] [DEBUG] [LOCAL ] UA: Loaded 50852 existing records from primary storage. [2025-10-16T22:43:32.406597] [INFO ] [MAIN ] UA: Loaded 50852 primary data records. [2025-10-16T22:43:32.564825] [DEBUG] [LOCAL ] UAA: Loaded 53890 existing records from primary storage. [2025-10-16T22:43:32.577319] [INFO ] [MAIN ] UAA: Loaded 53890 primary data records. [2025-10-16T22:43:33.200944] [DEBUG] [MAIN ] UAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:33.201988] [INFO ] [MAIN ] UAN: Generated 1807 derivative records from 5451 primary records. [2025-10-16T22:43:33.202258] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-16T22:43:33.219310] [DEBUG] [LOCAL ] UAN: Derivative data saved (1807 records). [2025-10-16T22:43:33.220296] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-16T22:43:33.223500] [INFO ] [MAIN ] Derivative Progress: 1609/1803 symbols completed. UAN took 1.0s. Estimated remaining: 1m 14s. Rate: 157.6 symbols/min [2025-10-16T22:43:33.223699] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:33.239252] [DEBUG] [MAIN ] UAA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:33.240878] [INFO ] [MAIN ] UAA: Generated 1807 derivative records from 53890 primary records. [2025-10-16T22:43:33.241058] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-16T22:43:33.265622] [DEBUG] [MAIN ] UA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:33.266775] [INFO ] [MAIN ] UA: Generated 1807 derivative records from 50852 primary records. [2025-10-16T22:43:33.267488] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-16T22:43:33.271205] [DEBUG] [LOCAL ] UAA: Derivative data saved (1807 records). [2025-10-16T22:43:33.277980] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-16T22:43:33.281495] [INFO ] [MAIN ] Derivative Progress: 1610/1803 symbols completed. UAA took 1.1s. Estimated remaining: 1m 13s. Rate: 157.7 symbols/min [2025-10-16T22:43:33.288553] [DEBUG] [LOCAL ] UA: Derivative data saved (1807 records). [2025-10-16T22:43:33.288929] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-16T22:43:33.288694] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:33.291781] [INFO ] [MAIN ] Derivative Progress: 1611/1803 symbols completed. UA took 1.2s. Estimated remaining: 1m 13s. Rate: 157.8 symbols/min [2025-10-16T22:43:33.292112] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:33.333444] [DEBUG] [LOCAL ] UBER: Loaded 54196 existing records from primary storage. [2025-10-16T22:43:33.333730] [INFO ] [MAIN ] UBER: Loaded 54196 primary data records. [2025-10-16T22:43:33.559870] [DEBUG] [LOCAL ] UBS: Loaded 52699 existing records from primary storage. [2025-10-16T22:43:33.667628] [INFO ] [MAIN ] UBS: Loaded 52699 primary data records. [2025-10-16T22:43:33.703338] [DEBUG] [LOCAL ] UDR: Loaded 52444 existing records from primary storage. [2025-10-16T22:43:33.749191] [INFO ] [MAIN ] UDR: Loaded 52444 primary data records. [2025-10-16T22:43:34.303604] [DEBUG] [MAIN ] UBER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:34.304601] [INFO ] [MAIN ] UBER: Generated 1807 derivative records from 54196 primary records. [2025-10-16T22:43:34.306172] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-16T22:43:34.327001] [DEBUG] [LOCAL ] UBER: Derivative data saved (1807 records). [2025-10-16T22:43:34.327281] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-16T22:43:34.329671] [INFO ] [MAIN ] Derivative Progress: 1612/1803 symbols completed. UBER took 1.1s. Estimated remaining: 1m 13s. Rate: 157.6 symbols/min [2025-10-16T22:43:34.331700] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:34.347883] [DEBUG] [MAIN ] UDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:34.348817] [INFO ] [MAIN ] UDR: Generated 1807 derivative records from 52444 primary records. [2025-10-16T22:43:34.349037] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-16T22:43:34.369117] [DEBUG] [MAIN ] UBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:34.374973] [INFO ] [MAIN ] UBS: Generated 1807 derivative records from 52699 primary records. [2025-10-16T22:43:34.377554] [DEBUG] [LOCAL ] UDR: Derivative data saved (1807 records). [2025-10-16T22:43:34.377804] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-16T22:43:34.380373] [INFO ] [MAIN ] Derivative Progress: 1613/1803 symbols completed. UDR took 1.1s. Estimated remaining: 1m 12s. Rate: 157.7 symbols/min [2025-10-16T22:43:34.377687] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-16T22:43:34.381327] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:34.397387] [DEBUG] [LOCAL ] UBS: Derivative data saved (1807 records). [2025-10-16T22:43:34.397528] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-16T22:43:34.399992] [INFO ] [MAIN ] Derivative Progress: 1614/1803 symbols completed. UBS took 1.1s. Estimated remaining: 1m 12s. Rate: 157.8 symbols/min [2025-10-16T22:43:34.401871] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:34.419499] [DEBUG] [LOCAL ] UFI: Loaded 8215 existing records from primary storage. [2025-10-16T22:43:34.419625] [INFO ] [MAIN ] UFI: Loaded 8215 primary data records. [2025-10-16T22:43:34.537198] [DEBUG] [LOCAL ] UE: Loaded 42905 existing records from primary storage. [2025-10-16T22:43:34.540733] [INFO ] [MAIN ] UE: Loaded 42905 primary data records. [2025-10-16T22:43:35.092693] [DEBUG] [LOCAL ] UGI: Loaded 50994 existing records from primary storage. [2025-10-16T22:43:35.102255] [INFO ] [MAIN ] UGI: Loaded 50994 primary data records. [2025-10-16T22:43:35.419621] [DEBUG] [MAIN ] UFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:35.420840] [INFO ] [MAIN ] UFI: Generated 1807 derivative records from 8215 primary records. [2025-10-16T22:43:35.421317] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-16T22:43:35.438940] [DEBUG] [LOCAL ] UFI: Derivative data saved (1807 records). [2025-10-16T22:43:35.439551] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-16T22:43:35.443875] [INFO ] [MAIN ] Derivative Progress: 1615/1803 symbols completed. UFI took 1.1s. Estimated remaining: 1m 12s. Rate: 157.6 symbols/min [2025-10-16T22:43:35.444502] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:35.458845] [DEBUG] [MAIN ] UE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:35.459916] [INFO ] [MAIN ] UE: Generated 1807 derivative records from 42905 primary records. [2025-10-16T22:43:35.460071] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-16T22:43:35.479598] [DEBUG] [LOCAL ] UE: Derivative data saved (1807 records). [2025-10-16T22:43:35.479936] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-16T22:43:35.483440] [INFO ] [MAIN ] Derivative Progress: 1616/1803 symbols completed. UE took 1.2s. Estimated remaining: 1m 11s. Rate: 157.7 symbols/min [2025-10-16T22:43:35.483769] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:35.511622] [DEBUG] [MAIN ] UGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:35.512396] [INFO ] [MAIN ] UGI: Generated 1807 derivative records from 50994 primary records. [2025-10-16T22:43:35.512627] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-16T22:43:35.532535] [DEBUG] [LOCAL ] UGI: Derivative data saved (1807 records). [2025-10-16T22:43:35.543343] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-16T22:43:35.547279] [INFO ] [MAIN ] Derivative Progress: 1617/1803 symbols completed. UGI took 1.1s. Estimated remaining: 1m 11s. Rate: 157.8 symbols/min [2025-10-16T22:43:35.553044] [DEBUG] [LOCAL ] UHAL: Loaded 16985 existing records from primary storage. [2025-10-16T22:43:35.554462] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:35.554974] [INFO ] [MAIN ] UHAL: Loaded 16985 primary data records. [2025-10-16T22:43:35.554293] [DEBUG] [LOCAL ] UGP: Loaded 43205 existing records from primary storage. [2025-10-16T22:43:35.555386] [INFO ] [MAIN ] UGP: Loaded 43205 primary data records. [2025-10-16T22:43:36.159490] [DEBUG] [LOCAL ] UHS: Loaded 40374 existing records from primary storage. [2025-10-16T22:43:36.159895] [INFO ] [MAIN ] UHS: Loaded 40374 primary data records. [2025-10-16T22:43:36.500276] [DEBUG] [MAIN ] UGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:36.505944] [DEBUG] [MAIN ] UHAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:36.506738] [INFO ] [MAIN ] UHAL: Generated 1807 derivative records from 16985 primary records. [2025-10-16T22:43:36.506891] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-16T22:43:36.509372] [INFO ] [MAIN ] UGP: Generated 1807 derivative records from 43205 primary records. [2025-10-16T22:43:36.509466] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-16T22:43:36.539511] [DEBUG] [LOCAL ] UGP: Derivative data saved (1807 records). [2025-10-16T22:43:36.540422] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-16T22:43:36.542562] [INFO ] [MAIN ] Derivative Progress: 1618/1803 symbols completed. UGP took 1.1s. Estimated remaining: 1m 10s. Rate: 157.7 symbols/min [2025-10-16T22:43:36.543902] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1807 records). [2025-10-16T22:43:36.544162] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-16T22:43:36.547162] [INFO ] [MAIN ] Derivative Progress: 1619/1803 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 10s. Rate: 157.7 symbols/min [2025-10-16T22:43:36.562829] [DEBUG] [MAIN ] UHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:36.563427] [INFO ] [MAIN ] UHS: Generated 1807 derivative records from 40374 primary records. [2025-10-16T22:43:36.563489] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-16T22:43:36.578733] [DEBUG] [LOCAL ] UHS: Derivative data saved (1807 records). [2025-10-16T22:43:36.578791] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-16T22:43:36.581440] [INFO ] [MAIN ] Derivative Progress: 1620/1803 symbols completed. UHS took 1.0s. Estimated remaining: 1m 10s. Rate: 157.8 symbols/min [2025-10-16T22:43:36.581927] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:36.581986] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:36.582133] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:36.598708] [DEBUG] [LOCAL ] UHT: Loaded 10250 existing records from primary storage. [2025-10-16T22:43:36.598995] [INFO ] [MAIN ] UHT: Loaded 10250 primary data records. [2025-10-16T22:43:36.640411] [DEBUG] [LOCAL ] UI: Loaded 14120 existing records from primary storage. [2025-10-16T22:43:36.650045] [INFO ] [MAIN ] UI: Loaded 14120 primary data records. [2025-10-16T22:43:36.874035] [DEBUG] [LOCAL ] UIS: Loaded 37124 existing records from primary storage. [2025-10-16T22:43:36.976472] [INFO ] [MAIN ] UIS: Loaded 37124 primary data records. [2025-10-16T22:43:37.600897] [DEBUG] [MAIN ] UHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:37.602001] [INFO ] [MAIN ] UHT: Generated 1807 derivative records from 10250 primary records. [2025-10-16T22:43:37.602096] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-16T22:43:37.623401] [DEBUG] [LOCAL ] UHT: Derivative data saved (1807 records). [2025-10-16T22:43:37.623846] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-16T22:43:37.644567] [INFO ] [MAIN ] Derivative Progress: 1621/1803 symbols completed. UHT took 1.1s. Estimated remaining: 1m 9s. Rate: 157.7 symbols/min [2025-10-16T22:43:37.646345] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:37.647021] [DEBUG] [MAIN ] UI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:37.648384] [INFO ] [MAIN ] UI: Generated 1807 derivative records from 14120 primary records. [2025-10-16T22:43:37.648567] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-16T22:43:37.679019] [DEBUG] [MAIN ] UIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:37.680429] [DEBUG] [LOCAL ] UI: Derivative data saved (1807 records). [2025-10-16T22:43:37.680548] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-16T22:43:37.681229] [INFO ] [MAIN ] UIS: Generated 1807 derivative records from 37124 primary records. [2025-10-16T22:43:37.684198] [INFO ] [MAIN ] Derivative Progress: 1622/1803 symbols completed. UI took 1.1s. Estimated remaining: 1m 9s. Rate: 157.8 symbols/min [2025-10-16T22:43:37.684297] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-16T22:43:37.684392] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:37.701406] [DEBUG] [LOCAL ] UIS: Derivative data saved (1807 records). [2025-10-16T22:43:37.715118] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-16T22:43:37.717554] [INFO ] [MAIN ] Derivative Progress: 1623/1803 symbols completed. UIS took 1.1s. Estimated remaining: 1m 8s. Rate: 157.8 symbols/min [2025-10-16T22:43:37.717880] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:37.741043] [DEBUG] [LOCAL ] UL: Loaded 53468 existing records from primary storage. [2025-10-16T22:43:37.741368] [INFO ] [MAIN ] UL: Loaded 53468 primary data records. [2025-10-16T22:43:37.880368] [DEBUG] [LOCAL ] ULS: Loaded 39279 existing records from primary storage. [2025-10-16T22:43:37.914722] [INFO ] [MAIN ] ULS: Loaded 39279 primary data records. [2025-10-16T22:43:38.233827] [DEBUG] [LOCAL ] UMC: Loaded 53073 existing records from primary storage. [2025-10-16T22:43:38.239684] [INFO ] [MAIN ] UMC: Loaded 53073 primary data records. [2025-10-16T22:43:38.809501] [DEBUG] [MAIN ] UL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:38.810672] [INFO ] [MAIN ] UL: Generated 1807 derivative records from 53468 primary records. [2025-10-16T22:43:38.810883] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-16T22:43:38.828533] [DEBUG] [LOCAL ] UL: Derivative data saved (1807 records). [2025-10-16T22:43:38.828809] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-16T22:43:38.831021] [INFO ] [MAIN ] Derivative Progress: 1624/1803 symbols completed. UL took 1.2s. Estimated remaining: 1m 8s. Rate: 157.7 symbols/min [2025-10-16T22:43:38.831305] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:38.852780] [DEBUG] [MAIN ] ULS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:38.853495] [INFO ] [MAIN ] ULS: Generated 1807 derivative records from 39279 primary records. [2025-10-16T22:43:38.853762] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-16T22:43:38.866591] [DEBUG] [MAIN ] UMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:38.867441] [INFO ] [MAIN ] UMC: Generated 1807 derivative records from 53073 primary records. [2025-10-16T22:43:38.874540] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-16T22:43:38.896078] [DEBUG] [LOCAL ] ULS: Derivative data saved (1807 records). [2025-10-16T22:43:38.896744] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-16T22:43:38.899566] [INFO ] [MAIN ] Derivative Progress: 1625/1803 symbols completed. ULS took 1.2s. Estimated remaining: 1m 8s. Rate: 157.7 symbols/min [2025-10-16T22:43:38.900062] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:38.911902] [DEBUG] [LOCAL ] UMC: Derivative data saved (1807 records). [2025-10-16T22:43:38.912031] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-16T22:43:38.915379] [INFO ] [MAIN ] Derivative Progress: 1626/1803 symbols completed. UMC took 1.2s. Estimated remaining: 1m 7s. Rate: 157.8 symbols/min [2025-10-16T22:43:38.915665] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:38.930920] [DEBUG] [LOCAL ] UMH: Loaded 34443 existing records from primary storage. [2025-10-16T22:43:38.931193] [INFO ] [MAIN ] UMH: Loaded 34443 primary data records. [2025-10-16T22:43:38.967775] [DEBUG] [LOCAL ] UNF: Loaded 11978 existing records from primary storage. [2025-10-16T22:43:38.985854] [INFO ] [MAIN ] UNF: Loaded 11978 primary data records. [2025-10-16T22:43:39.554404] [DEBUG] [LOCAL ] UNFI: Loaded 42911 existing records from primary storage. [2025-10-16T22:43:39.554622] [INFO ] [MAIN ] UNFI: Loaded 42911 primary data records. [2025-10-16T22:43:39.895981] [DEBUG] [MAIN ] UMH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:39.895794] [DEBUG] [MAIN ] UNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:39.897531] [INFO ] [MAIN ] UNF: Generated 1807 derivative records from 11978 primary records. [2025-10-16T22:43:39.896961] [INFO ] [MAIN ] UMH: Generated 1807 derivative records from 34443 primary records. [2025-10-16T22:43:39.897749] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-16T22:43:39.898218] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-16T22:43:39.925518] [DEBUG] [LOCAL ] UNF: Derivative data saved (1807 records). [2025-10-16T22:43:39.929980] [DEBUG] [LOCAL ] UMH: Derivative data saved (1807 records). [2025-10-16T22:43:39.930068] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-16T22:43:39.933126] [INFO ] [MAIN ] Derivative Progress: 1627/1803 symbols completed. UMH took 1.1s. Estimated remaining: 1m 7s. Rate: 157.7 symbols/min [2025-10-16T22:43:39.928875] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-16T22:43:39.935308] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:39.936435] [INFO ] [MAIN ] Derivative Progress: 1628/1803 symbols completed. UNF took 1.0s. Estimated remaining: 1m 7s. Rate: 157.8 symbols/min [2025-10-16T22:43:39.937673] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:39.952034] [DEBUG] [MAIN ] UNFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:39.952864] [INFO ] [MAIN ] UNFI: Generated 1807 derivative records from 42911 primary records. [2025-10-16T22:43:39.953007] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-16T22:43:39.969432] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1807 records). [2025-10-16T22:43:39.969550] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-16T22:43:39.971996] [INFO ] [MAIN ] Derivative Progress: 1629/1803 symbols completed. UNFI took 1.1s. Estimated remaining: 1m 6s. Rate: 157.8 symbols/min [2025-10-16T22:43:39.972403] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:39.980374] [DEBUG] [LOCAL ] UNMA: Loaded 3537 existing records from primary storage. [2025-10-16T22:43:39.980685] [INFO ] [MAIN ] UNMA: Loaded 3537 primary data records. [2025-10-16T22:43:40.197919] [DEBUG] [LOCAL ] UNM: Loaded 48472 existing records from primary storage. [2025-10-16T22:43:40.311008] [INFO ] [MAIN ] UNM: Loaded 48472 primary data records. [2025-10-16T22:43:40.413203] [DEBUG] [LOCAL ] UNH: Loaded 54208 existing records from primary storage. [2025-10-16T22:43:40.426853] [INFO ] [MAIN ] UNH: Loaded 54208 primary data records. [2025-10-16T22:43:40.987175] [DEBUG] [MAIN ] UNMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:40.988483] [INFO ] [MAIN ] UNMA: Generated 1807 derivative records from 3537 primary records. [2025-10-16T22:43:40.988708] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-16T22:43:41.004805] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1807 records). [2025-10-16T22:43:41.005011] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-16T22:43:41.007536] [INFO ] [MAIN ] Derivative Progress: 1630/1803 symbols completed. UNMA took 1.0s. Estimated remaining: 1m 6s. Rate: 157.7 symbols/min [2025-10-16T22:43:41.007881] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:41.027107] [DEBUG] [MAIN ] UNM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:41.028124] [INFO ] [MAIN ] UNM: Generated 1807 derivative records from 48472 primary records. [2025-10-16T22:43:41.028460] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-16T22:43:41.047199] [DEBUG] [LOCAL ] UNM: Derivative data saved (1807 records). [2025-10-16T22:43:41.048223] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-16T22:43:41.050927] [INFO ] [MAIN ] Derivative Progress: 1631/1803 symbols completed. UNM took 1.1s. Estimated remaining: 1m 5s. Rate: 157.8 symbols/min [2025-10-16T22:43:41.058810] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:41.064394] [DEBUG] [MAIN ] UNH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:41.065245] [INFO ] [MAIN ] UNH: Generated 1807 derivative records from 54208 primary records. [2025-10-16T22:43:41.065469] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-16T22:43:41.096472] [DEBUG] [LOCAL ] UNH: Derivative data saved (1807 records). [2025-10-16T22:43:41.096672] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-16T22:43:41.099595] [INFO ] [MAIN ] Derivative Progress: 1632/1803 symbols completed. UNH took 1.2s. Estimated remaining: 1m 5s. Rate: 157.8 symbols/min [2025-10-16T22:43:41.099997] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:41.117268] [DEBUG] [LOCAL ] UNP: Loaded 53718 existing records from primary storage. [2025-10-16T22:43:41.117533] [INFO ] [MAIN ] UNP: Loaded 53718 primary data records. [2025-10-16T22:43:41.454730] [DEBUG] [LOCAL ] UP: Loaded 44555 existing records from primary storage. [2025-10-16T22:43:41.455774] [INFO ] [MAIN ] UP: Loaded 44555 primary data records. [2025-10-16T22:43:41.604191] [DEBUG] [LOCAL ] UPS: Loaded 54109 existing records from primary storage. [2025-10-16T22:43:41.656068] [INFO ] [MAIN ] UPS: Loaded 54109 primary data records. [2025-10-16T22:43:42.081926] [DEBUG] [MAIN ] UNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:42.091197] [INFO ] [MAIN ] UNP: Generated 1807 derivative records from 53718 primary records. [2025-10-16T22:43:42.091508] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-16T22:43:42.109484] [DEBUG] [LOCAL ] UNP: Derivative data saved (1807 records). [2025-10-16T22:43:42.109939] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-16T22:43:42.112345] [INFO ] [MAIN ] Derivative Progress: 1633/1803 symbols completed. UNP took 1.1s. Estimated remaining: 1m 5s. Rate: 157.7 symbols/min [2025-10-16T22:43:42.130677] [DEBUG] [MAIN ] UP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:42.132205] [INFO ] [MAIN ] UP: Generated 1807 derivative records from 44555 primary records. [2025-10-16T22:43:42.132444] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-16T22:43:42.148718] [DEBUG] [LOCAL ] UP: Derivative data saved (1807 records). [2025-10-16T22:43:42.148910] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-16T22:43:42.150977] [INFO ] [MAIN ] Derivative Progress: 1634/1803 symbols completed. UP took 1.1s. Estimated remaining: 1m 4s. Rate: 157.8 symbols/min [2025-10-16T22:43:42.167270] [DEBUG] [MAIN ] UPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:42.167955] [INFO ] [MAIN ] UPS: Generated 1807 derivative records from 54109 primary records. [2025-10-16T22:43:42.168020] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-16T22:43:42.183396] [DEBUG] [LOCAL ] UPS: Derivative data saved (1807 records). [2025-10-16T22:43:42.183499] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-10-16T22:43:42.186311] [INFO ] [MAIN ] Derivative Progress: 1635/1803 symbols completed. UPS took 1.1s. Estimated remaining: 1m 4s. Rate: 157.9 symbols/min [2025-10-16T22:43:42.186995] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:42.187106] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:42.187249] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:42.220888] [DEBUG] [LOCAL ] USAC: Loaded 21905 existing records from primary storage. [2025-10-16T22:43:42.230016] [INFO ] [MAIN ] USAC: Loaded 21905 primary data records. [2025-10-16T22:43:42.294553] [DEBUG] [LOCAL ] URI: Loaded 34979 existing records from primary storage. [2025-10-16T22:43:42.321056] [DEBUG] [LOCAL ] USA: Loaded 36692 existing records from primary storage. [2025-10-16T22:43:42.338029] [INFO ] [MAIN ] URI: Loaded 34979 primary data records. [2025-10-16T22:43:42.353746] [INFO ] [MAIN ] USA: Loaded 36692 primary data records. [2025-10-16T22:43:43.221791] [DEBUG] [MAIN ] USAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:43.222977] [INFO ] [MAIN ] USAC: Generated 1807 derivative records from 21905 primary records. [2025-10-16T22:43:43.223304] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-16T22:43:43.243001] [DEBUG] [LOCAL ] USAC: Derivative data saved (1807 records). [2025-10-16T22:43:43.244245] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-16T22:43:43.259889] [INFO ] [MAIN ] Derivative Progress: 1636/1803 symbols completed. USAC took 1.1s. Estimated remaining: 1m 4s. Rate: 157.7 symbols/min [2025-10-16T22:43:43.260143] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:43.260706] [DEBUG] [MAIN ] URI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:43.261886] [INFO ] [MAIN ] URI: Generated 1807 derivative records from 34979 primary records. [2025-10-16T22:43:43.262032] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-16T22:43:43.275020] [DEBUG] [MAIN ] USA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:43.275817] [INFO ] [MAIN ] USA: Generated 1807 derivative records from 36692 primary records. [2025-10-16T22:43:43.283113] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-16T22:43:43.306289] [DEBUG] [LOCAL ] USA: Derivative data saved (1807 records). [2025-10-16T22:43:43.306504] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-16T22:43:43.309420] [INFO ] [MAIN ] Derivative Progress: 1637/1803 symbols completed. USA took 1.1s. Estimated remaining: 1m 3s. Rate: 157.8 symbols/min [2025-10-16T22:43:43.309801] [DEBUG] [LOCAL ] URI: Derivative data saved (1807 records). [2025-10-16T22:43:43.310271] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-10-16T22:43:43.310012] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:43.312567] [INFO ] [MAIN ] Derivative Progress: 1638/1803 symbols completed. URI took 1.1s. Estimated remaining: 1m 3s. Rate: 157.9 symbols/min [2025-10-16T22:43:43.313065] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:43.345422] [DEBUG] [LOCAL ] USNA: Loaded 18138 existing records from primary storage. [2025-10-16T22:43:43.345742] [INFO ] [MAIN ] USNA: Loaded 18138 primary data records. [2025-10-16T22:43:43.417274] [DEBUG] [LOCAL ] USB: Loaded 54078 existing records from primary storage. [2025-10-16T22:43:43.431329] [INFO ] [MAIN ] USB: Loaded 54078 primary data records. [2025-10-16T22:43:43.970470] [DEBUG] [LOCAL ] USFD: Loaded 51565 existing records from primary storage. [2025-10-16T22:43:43.984719] [INFO ] [MAIN ] USFD: Loaded 51565 primary data records. [2025-10-16T22:43:44.323999] [DEBUG] [MAIN ] USNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:44.325809] [INFO ] [MAIN ] USNA: Generated 1807 derivative records from 18138 primary records. [2025-10-16T22:43:44.325114] [DEBUG] [MAIN ] USB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:44.326753] [INFO ] [MAIN ] USB: Generated 1807 derivative records from 54078 primary records. [2025-10-16T22:43:44.325910] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-16T22:43:44.327770] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-16T22:43:44.357236] [DEBUG] [LOCAL ] USNA: Derivative data saved (1807 records). [2025-10-16T22:43:44.360834] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-16T22:43:44.363964] [INFO ] [MAIN ] Derivative Progress: 1639/1803 symbols completed. USNA took 1.1s. Estimated remaining: 1m 2s. Rate: 157.7 symbols/min [2025-10-16T22:43:44.364716] [DEBUG] [LOCAL ] USB: Derivative data saved (1807 records). [2025-10-16T22:43:44.364932] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-16T22:43:44.367801] [INFO ] [MAIN ] Derivative Progress: 1640/1803 symbols completed. USB took 1.1s. Estimated remaining: 1m 2s. Rate: 157.8 symbols/min [2025-10-16T22:43:44.364513] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:44.368013] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:44.381540] [DEBUG] [MAIN ] USFD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:44.382123] [INFO ] [MAIN ] USFD: Generated 1807 derivative records from 51565 primary records. [2025-10-16T22:43:44.382231] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-16T22:43:44.398264] [DEBUG] [LOCAL ] USFD: Derivative data saved (1807 records). [2025-10-16T22:43:44.398486] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-16T22:43:44.400731] [INFO ] [MAIN ] Derivative Progress: 1641/1803 symbols completed. USFD took 1.1s. Estimated remaining: 1m 2s. Rate: 157.9 symbols/min [2025-10-16T22:43:44.405136] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:44.414243] [DEBUG] [LOCAL ] USPH: Loaded 17259 existing records from primary storage. [2025-10-16T22:43:44.414475] [INFO ] [MAIN ] USPH: Loaded 17259 primary data records. [2025-10-16T22:43:44.571186] [DEBUG] [LOCAL ] UTF: Loaded 31127 existing records from primary storage. [2025-10-16T22:43:44.621078] [INFO ] [MAIN ] UTF: Loaded 31127 primary data records. [2025-10-16T22:43:44.776284] [DEBUG] [LOCAL ] UTI: Loaded 40786 existing records from primary storage. [2025-10-16T22:43:44.797056] [INFO ] [MAIN ] UTI: Loaded 40786 primary data records. [2025-10-16T22:43:45.404142] [DEBUG] [MAIN ] USPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:45.405401] [INFO ] [MAIN ] USPH: Generated 1807 derivative records from 17259 primary records. [2025-10-16T22:43:45.405530] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-16T22:43:45.425059] [DEBUG] [LOCAL ] USPH: Derivative data saved (1807 records). [2025-10-16T22:43:45.425696] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-16T22:43:45.428419] [INFO ] [MAIN ] Derivative Progress: 1642/1803 symbols completed. USPH took 1.1s. Estimated remaining: 1m 1s. Rate: 157.7 symbols/min [2025-10-16T22:43:45.428848] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:45.465057] [DEBUG] [MAIN ] UTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:45.464773] [DEBUG] [MAIN ] UTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:45.470169] [INFO ] [MAIN ] UTI: Generated 1807 derivative records from 40786 primary records. [2025-10-16T22:43:45.470914] [INFO ] [MAIN ] UTF: Generated 1807 derivative records from 31127 primary records. [2025-10-16T22:43:45.471246] [DEBUG] [LOCAL ] UTL: Loaded 11917 existing records from primary storage. [2025-10-16T22:43:45.471373] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-16T22:43:45.472068] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-16T22:43:45.471823] [INFO ] [MAIN ] UTL: Loaded 11917 primary data records. [2025-10-16T22:43:45.540295] [DEBUG] [LOCAL ] UTI: Derivative data saved (1807 records). [2025-10-16T22:43:45.562555] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-10-16T22:43:45.580344] [DEBUG] [LOCAL ] UTF: Derivative data saved (1807 records). [2025-10-16T22:43:45.575133] [INFO ] [MAIN ] Derivative Progress: 1643/1803 symbols completed. UTI took 1.2s. Estimated remaining: 1m 1s. Rate: 157.8 symbols/min [2025-10-16T22:43:45.598222] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:45.598104] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-16T22:43:45.617428] [INFO ] [MAIN ] Derivative Progress: 1644/1803 symbols completed. UTF took 1.2s. Estimated remaining: 1m 0s. Rate: 157.9 symbols/min [2025-10-16T22:43:45.618276] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:45.831116] [DEBUG] [LOCAL ] UVE: Loaded 22150 existing records from primary storage. [2025-10-16T22:43:45.841691] [INFO ] [MAIN ] UVE: Loaded 22150 primary data records. [2025-10-16T22:43:46.026698] [DEBUG] [LOCAL ] UTZ: Loaded 44886 existing records from primary storage. [2025-10-16T22:43:46.049012] [INFO ] [MAIN ] UTZ: Loaded 44886 primary data records. [2025-10-16T22:43:46.366467] [DEBUG] [MAIN ] UTL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:46.477120] [INFO ] [MAIN ] UTL: Generated 1807 derivative records from 11917 primary records. [2025-10-16T22:43:46.522860] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-16T22:43:46.551923] [DEBUG] [LOCAL ] UTL: Derivative data saved (1807 records). [2025-10-16T22:43:46.552876] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-16T22:43:46.556779] [INFO ] [MAIN ] Derivative Progress: 1645/1803 symbols completed. UTL took 1.1s. Estimated remaining: 1m 0s. Rate: 157.7 symbols/min [2025-10-16T22:43:46.556946] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:46.572185] [DEBUG] [MAIN ] UVE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:46.572870] [INFO ] [MAIN ] UVE: Generated 1807 derivative records from 22150 primary records. [2025-10-16T22:43:46.572961] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-16T22:43:46.589850] [DEBUG] [LOCAL ] UVE: Derivative data saved (1807 records). [2025-10-16T22:43:46.595026] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-16T22:43:46.597820] [INFO ] [MAIN ] Derivative Progress: 1646/1803 symbols completed. UVE took 1.0s. Estimated remaining: 59.7s. Rate: 157.8 symbols/min [2025-10-16T22:43:46.598151] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:46.609947] [DEBUG] [LOCAL ] UVV: Loaded 22878 existing records from primary storage. [2025-10-16T22:43:46.610330] [INFO ] [MAIN ] UVV: Loaded 22878 primary data records. [2025-10-16T22:43:46.637914] [DEBUG] [MAIN ] UTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:46.659507] [INFO ] [MAIN ] UTZ: Generated 1807 derivative records from 44886 primary records. [2025-10-16T22:43:46.672239] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-16T22:43:46.822829] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1807 records). [2025-10-16T22:43:46.847076] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-16T22:43:46.849848] [INFO ] [MAIN ] Derivative Progress: 1647/1803 symbols completed. UTZ took 1.3s. Estimated remaining: 59.3s. Rate: 157.8 symbols/min [2025-10-16T22:43:46.970224] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:46.992529] [DEBUG] [LOCAL ] UWMC: Loaded 53342 existing records from primary storage. [2025-10-16T22:43:46.997783] [INFO ] [MAIN ] UWMC: Loaded 53342 primary data records. [2025-10-16T22:43:46.998229] [DEBUG] [LOCAL ] UZD: Loaded 6131 existing records from primary storage. [2025-10-16T22:43:46.999033] [INFO ] [MAIN ] UZD: Loaded 6131 primary data records. [2025-10-16T22:43:47.633521] [DEBUG] [MAIN ] UVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:47.635985] [INFO ] [MAIN ] UVV: Generated 1807 derivative records from 22878 primary records. [2025-10-16T22:43:47.636222] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-16T22:43:47.657340] [DEBUG] [LOCAL ] UVV: Derivative data saved (1807 records). [2025-10-16T22:43:47.657408] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-16T22:43:47.659748] [INFO ] [MAIN ] Derivative Progress: 1648/1803 symbols completed. UVV took 1.1s. Estimated remaining: 59.0s. Rate: 157.7 symbols/min [2025-10-16T22:43:47.679949] [DEBUG] [MAIN ] UZD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:47.680971] [INFO ] [MAIN ] UZD: Generated 1807 derivative records from 6131 primary records. [2025-10-16T22:43:47.681143] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-16T22:43:47.694402] [DEBUG] [MAIN ] UWMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:47.701611] [INFO ] [MAIN ] UWMC: Generated 1807 derivative records from 53342 primary records. [2025-10-16T22:43:47.705617] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-16T22:43:47.725784] [DEBUG] [LOCAL ] UZD: Derivative data saved (1807 records). [2025-10-16T22:43:47.726279] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-16T22:43:47.728573] [INFO ] [MAIN ] Derivative Progress: 1649/1803 symbols completed. UZD took 0.8s. Estimated remaining: 58.6s. Rate: 157.8 symbols/min [2025-10-16T22:43:47.728703] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1807 records). [2025-10-16T22:43:47.728809] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-16T22:43:47.731912] [INFO ] [MAIN ] Derivative Progress: 1650/1803 symbols completed. UWMC took 1.1s. Estimated remaining: 58.1s. Rate: 157.9 symbols/min [2025-10-16T22:43:47.732486] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:47.732385] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:47.732603] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:47.743843] [DEBUG] [LOCAL ] UZE: Loaded 7288 existing records from primary storage. [2025-10-16T22:43:47.744058] [INFO ] [MAIN ] UZE: Loaded 7288 primary data records. [2025-10-16T22:43:48.076635] [DEBUG] [LOCAL ] VAC: Loaded 34301 existing records from primary storage. [2025-10-16T22:43:48.076944] [INFO ] [MAIN ] VAC: Loaded 34301 primary data records. [2025-10-16T22:43:48.223811] [DEBUG] [LOCAL ] V: Loaded 54143 existing records from primary storage. [2025-10-16T22:43:48.245741] [INFO ] [MAIN ] V: Loaded 54143 primary data records. [2025-10-16T22:43:48.746451] [DEBUG] [MAIN ] UZE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:48.747791] [INFO ] [MAIN ] UZE: Generated 1807 derivative records from 7288 primary records. [2025-10-16T22:43:48.747892] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-16T22:43:48.765431] [DEBUG] [LOCAL ] UZE: Derivative data saved (1807 records). [2025-10-16T22:43:48.765853] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-16T22:43:48.767972] [INFO ] [MAIN ] Derivative Progress: 1651/1803 symbols completed. UZE took 1.0s. Estimated remaining: 57.8s. Rate: 157.7 symbols/min [2025-10-16T22:43:48.768133] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:48.785768] [DEBUG] [MAIN ] VAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:48.786468] [INFO ] [MAIN ] VAC: Generated 1807 derivative records from 34301 primary records. [2025-10-16T22:43:48.786827] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-16T22:43:48.808249] [DEBUG] [LOCAL ] VAC: Derivative data saved (1807 records). [2025-10-16T22:43:48.809303] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-16T22:43:48.812402] [INFO ] [MAIN ] Derivative Progress: 1652/1803 symbols completed. VAC took 1.1s. Estimated remaining: 57.4s. Rate: 157.8 symbols/min [2025-10-16T22:43:48.812909] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:48.829945] [DEBUG] [MAIN ] V: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:48.830712] [INFO ] [MAIN ] V: Generated 1807 derivative records from 54143 primary records. [2025-10-16T22:43:48.830902] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-16T22:43:48.867302] [DEBUG] [LOCAL ] V: Derivative data saved (1807 records). [2025-10-16T22:43:48.867433] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-16T22:43:48.870737] [INFO ] [MAIN ] Derivative Progress: 1653/1803 symbols completed. V took 1.1s. Estimated remaining: 57.0s. Rate: 157.9 symbols/min [2025-10-16T22:43:48.871099] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:48.889876] [DEBUG] [LOCAL ] VAL: Loaded 50523 existing records from primary storage. [2025-10-16T22:43:48.890068] [INFO ] [MAIN ] VAL: Loaded 50523 primary data records. [2025-10-16T22:43:48.913930] [DEBUG] [LOCAL ] VATE: Loaded 5231 existing records from primary storage. [2025-10-16T22:43:48.956537] [INFO ] [MAIN ] VATE: Loaded 5231 primary data records. [2025-10-16T22:43:49.289139] [DEBUG] [LOCAL ] VALE: Loaded 54083 existing records from primary storage. [2025-10-16T22:43:49.414971] [INFO ] [MAIN ] VALE: Loaded 54083 primary data records. [2025-10-16T22:43:49.880774] [DEBUG] [MAIN ] VAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:49.880496] [DEBUG] [MAIN ] VATE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:49.881538] [INFO ] [MAIN ] VATE: Generated 1807 derivative records from 5231 primary records. [2025-10-16T22:43:49.882157] [INFO ] [MAIN ] VAL: Generated 1807 derivative records from 50523 primary records. [2025-10-16T22:43:49.882252] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-16T22:43:49.882347] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-16T22:43:49.913333] [DEBUG] [LOCAL ] VAL: Derivative data saved (1807 records). [2025-10-16T22:43:49.913526] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-16T22:43:49.913458] [DEBUG] [LOCAL ] VATE: Derivative data saved (1807 records). [2025-10-16T22:43:49.916319] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-16T22:43:49.916084] [INFO ] [MAIN ] Derivative Progress: 1654/1803 symbols completed. VAL took 1.1s. Estimated remaining: 56.7s. Rate: 157.7 symbols/min [2025-10-16T22:43:49.918934] [INFO ] [MAIN ] Derivative Progress: 1655/1803 symbols completed. VATE took 1.0s. Estimated remaining: 56.3s. Rate: 157.8 symbols/min [2025-10-16T22:43:49.918828] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:49.919383] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:49.938498] [DEBUG] [MAIN ] VALE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:49.939257] [INFO ] [MAIN ] VALE: Generated 1807 derivative records from 54083 primary records. [2025-10-16T22:43:49.939488] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-16T22:43:49.955964] [DEBUG] [LOCAL ] VBF: Loaded 7296 existing records from primary storage. [2025-10-16T22:43:49.956153] [INFO ] [MAIN ] VBF: Loaded 7296 primary data records. [2025-10-16T22:43:50.023008] [DEBUG] [LOCAL ] VALE: Derivative data saved (1807 records). [2025-10-16T22:43:50.037770] [DEBUG] [LOCAL ] VCV: Loaded 13732 existing records from primary storage. [2025-10-16T22:43:50.049763] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-16T22:43:50.057415] [INFO ] [MAIN ] Derivative Progress: 1656/1803 symbols completed. VALE took 1.2s. Estimated remaining: 55.9s. Rate: 157.9 symbols/min [2025-10-16T22:43:50.063828] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:50.074625] [INFO ] [MAIN ] VCV: Loaded 13732 primary data records. [2025-10-16T22:43:50.650707] [DEBUG] [LOCAL ] VEEV: Loaded 47681 existing records from primary storage. [2025-10-16T22:43:50.650984] [INFO ] [MAIN ] VEEV: Loaded 47681 primary data records. [2025-10-16T22:43:50.770429] [DEBUG] [MAIN ] VBF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:50.786849] [INFO ] [MAIN ] VBF: Generated 1807 derivative records from 7296 primary records. [2025-10-16T22:43:50.810112] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-16T22:43:50.969609] [DEBUG] [LOCAL ] VBF: Derivative data saved (1807 records). [2025-10-16T22:43:50.984102] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-16T22:43:50.999849] [INFO ] [MAIN ] Derivative Progress: 1657/1803 symbols completed. VBF took 1.1s. Estimated remaining: 55.5s. Rate: 157.7 symbols/min [2025-10-16T22:43:51.001245] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:51.000558] [DEBUG] [MAIN ] VCV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:51.003264] [INFO ] [MAIN ] VCV: Generated 1807 derivative records from 13732 primary records. [2025-10-16T22:43:51.004116] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-16T22:43:51.020769] [DEBUG] [LOCAL ] VCV: Derivative data saved (1807 records). [2025-10-16T22:43:51.020881] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-16T22:43:51.023482] [INFO ] [MAIN ] Derivative Progress: 1658/1803 symbols completed. VCV took 1.1s. Estimated remaining: 55.1s. Rate: 157.8 symbols/min [2025-10-16T22:43:51.024973] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:51.038508] [DEBUG] [LOCAL ] VEL: Loaded 12291 existing records from primary storage. [2025-10-16T22:43:51.040299] [INFO ] [MAIN ] VEL: Loaded 12291 primary data records. [2025-10-16T22:43:51.138397] [DEBUG] [MAIN ] VEEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:51.151454] [INFO ] [MAIN ] VEEV: Generated 1807 derivative records from 47681 primary records. [2025-10-16T22:43:51.159199] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-16T22:43:51.283882] [DEBUG] [LOCAL ] VET: Loaded 44441 existing records from primary storage. [2025-10-16T22:43:51.394236] [INFO ] [MAIN ] VET: Loaded 44441 primary data records. [2025-10-16T22:43:51.443957] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1807 records). [2025-10-16T22:43:51.456899] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-16T22:43:51.467449] [INFO ] [MAIN ] Derivative Progress: 1659/1803 symbols completed. VEEV took 1.4s. Estimated remaining: 54.7s. Rate: 157.8 symbols/min [2025-10-16T22:43:51.477307] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:51.754819] [DEBUG] [MAIN ] VEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:51.756731] [INFO ] [MAIN ] VEL: Generated 1807 derivative records from 12291 primary records. [2025-10-16T22:43:51.756825] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-16T22:43:51.775268] [DEBUG] [LOCAL ] VEL: Derivative data saved (1807 records). [2025-10-16T22:43:51.775716] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-16T22:43:51.779522] [INFO ] [MAIN ] Derivative Progress: 1660/1803 symbols completed. VEL took 0.8s. Estimated remaining: 54.4s. Rate: 157.8 symbols/min [2025-10-16T22:43:51.795604] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:51.797437] [DEBUG] [LOCAL ] VFC: Loaded 53995 existing records from primary storage. [2025-10-16T22:43:51.797822] [INFO ] [MAIN ] VFC: Loaded 53995 primary data records. [2025-10-16T22:43:51.918384] [DEBUG] [LOCAL ] VGI: Loaded 5246 existing records from primary storage. [2025-10-16T22:43:51.919748] [INFO ] [MAIN ] VGI: Loaded 5246 primary data records. [2025-10-16T22:43:52.067717] [DEBUG] [MAIN ] VET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:52.121242] [INFO ] [MAIN ] VET: Generated 1807 derivative records from 44441 primary records. [2025-10-16T22:43:52.121883] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-16T22:43:52.493229] [DEBUG] [LOCAL ] VET: Derivative data saved (1807 records). [2025-10-16T22:43:52.507702] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-16T22:43:52.511241] [INFO ] [MAIN ] Derivative Progress: 1661/1803 symbols completed. VET took 1.5s. Estimated remaining: 54.0s. Rate: 157.8 symbols/min [2025-10-16T22:43:52.511553] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:52.545091] [DEBUG] [MAIN ] VFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:52.546279] [INFO ] [MAIN ] VFC: Generated 1807 derivative records from 53995 primary records. [2025-10-16T22:43:52.546972] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-16T22:43:52.564562] [DEBUG] [LOCAL ] VGM: Loaded 18717 existing records from primary storage. [2025-10-16T22:43:52.567963] [INFO ] [MAIN ] VGM: Loaded 18717 primary data records. [2025-10-16T22:43:52.647033] [DEBUG] [MAIN ] VGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:52.663391] [INFO ] [MAIN ] VGI: Generated 1807 derivative records from 5246 primary records. [2025-10-16T22:43:52.681409] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-16T22:43:52.689489] [DEBUG] [LOCAL ] VFC: Derivative data saved (1807 records). [2025-10-16T22:43:52.714365] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-16T22:43:52.717966] [INFO ] [MAIN ] Derivative Progress: 1662/1803 symbols completed. VFC took 1.2s. Estimated remaining: 53.6s. Rate: 157.8 symbols/min [2025-10-16T22:43:52.732993] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:52.910788] [DEBUG] [LOCAL ] VHI: Loaded 2792 existing records from primary storage. [2025-10-16T22:43:52.916136] [INFO ] [MAIN ] VHI: Loaded 2792 primary data records. [2025-10-16T22:43:52.938140] [DEBUG] [LOCAL ] VGI: Derivative data saved (1807 records). [2025-10-16T22:43:52.981677] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-16T22:43:52.999954] [INFO ] [MAIN ] Derivative Progress: 1663/1803 symbols completed. VGI took 1.2s. Estimated remaining: 53.2s. Rate: 157.8 symbols/min [2025-10-16T22:43:53.261018] [DEBUG] [MAIN ] VGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:53.262000] [INFO ] [MAIN ] VGM: Generated 1807 derivative records from 18717 primary records. [2025-10-16T22:43:53.262067] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-16T22:43:53.281179] [DEBUG] [LOCAL ] VGM: Derivative data saved (1807 records). [2025-10-16T22:43:53.281248] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-16T22:43:53.283717] [INFO ] [MAIN ] Derivative Progress: 1664/1803 symbols completed. VGM took 0.8s. Estimated remaining: 52.8s. Rate: 157.8 symbols/min [2025-10-16T22:43:53.299899] [DEBUG] [MAIN ] VHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:53.300638] [INFO ] [MAIN ] VHI: Generated 1807 derivative records from 2792 primary records. [2025-10-16T22:43:53.300729] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-16T22:43:53.315136] [DEBUG] [LOCAL ] VHI: Derivative data saved (1807 records). [2025-10-16T22:43:53.315194] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-16T22:43:53.318842] [INFO ] [MAIN ] Derivative Progress: 1665/1803 symbols completed. VHI took 0.6s. Estimated remaining: 52.4s. Rate: 157.9 symbols/min [2025-10-16T22:43:53.319595] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:53.319796] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:53.319517] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:53.430750] [DEBUG] [LOCAL ] VIK: Loaded 52852 existing records from primary storage. [2025-10-16T22:43:53.415196] [DEBUG] [LOCAL ] VIPS: Loaded 51666 existing records from primary storage. [2025-10-16T22:43:53.430975] [INFO ] [MAIN ] VIK: Loaded 52852 primary data records. [2025-10-16T22:43:53.431051] [INFO ] [MAIN ] VIPS: Loaded 51666 primary data records. [2025-10-16T22:43:53.463094] [DEBUG] [LOCAL ] VICI: Loaded 54043 existing records from primary storage. [2025-10-16T22:43:53.511866] [INFO ] [MAIN ] VICI: Loaded 54043 primary data records. [2025-10-16T22:43:54.522925] [DEBUG] [MAIN ] VIPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:54.523454] [DEBUG] [MAIN ] VIK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:54.524629] [INFO ] [MAIN ] VIK: Generated 1807 derivative records from 52852 primary records. [2025-10-16T22:43:54.525249] [INFO ] [MAIN ] VIPS: Generated 1807 derivative records from 51666 primary records. [2025-10-16T22:43:54.525351] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-16T22:43:54.526490] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-16T22:43:54.561770] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1807 records). [2025-10-16T22:43:54.561903] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-16T22:43:54.564329] [INFO ] [MAIN ] Derivative Progress: 1666/1803 symbols completed. VIPS took 1.2s. Estimated remaining: 52.1s. Rate: 157.7 symbols/min [2025-10-16T22:43:54.565594] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:54.565484] [DEBUG] [LOCAL ] VIK: Derivative data saved (1807 records). [2025-10-16T22:43:54.566306] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-16T22:43:54.568776] [INFO ] [MAIN ] Derivative Progress: 1667/1803 symbols completed. VIK took 1.2s. Estimated remaining: 51.7s. Rate: 157.8 symbols/min [2025-10-16T22:43:54.576814] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:54.582567] [DEBUG] [MAIN ] VICI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:54.583464] [INFO ] [MAIN ] VICI: Generated 1807 derivative records from 54043 primary records. [2025-10-16T22:43:54.583538] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-16T22:43:54.600726] [DEBUG] [LOCAL ] VICI: Derivative data saved (1807 records). [2025-10-16T22:43:54.600972] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-16T22:43:54.604699] [INFO ] [MAIN ] Derivative Progress: 1668/1803 symbols completed. VICI took 1.3s. Estimated remaining: 51.3s. Rate: 157.9 symbols/min [2025-10-16T22:43:54.604957] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:54.650949] [DEBUG] [LOCAL ] VIRT: Loaded 47005 existing records from primary storage. [2025-10-16T22:43:54.662709] [INFO ] [MAIN ] VIRT: Loaded 47005 primary data records. [2025-10-16T22:43:54.719957] [DEBUG] [LOCAL ] VIST: Loaded 46887 existing records from primary storage. [2025-10-16T22:43:54.752672] [INFO ] [MAIN ] VIST: Loaded 46887 primary data records. [2025-10-16T22:43:54.941176] [DEBUG] [LOCAL ] VIV: Loaded 45156 existing records from primary storage. [2025-10-16T22:43:54.945805] [INFO ] [MAIN ] VIV: Loaded 45156 primary data records. [2025-10-16T22:43:55.637400] [DEBUG] [MAIN ] VIRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:55.639058] [INFO ] [MAIN ] VIRT: Generated 1807 derivative records from 47005 primary records. [2025-10-16T22:43:55.639189] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-16T22:43:55.658416] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1807 records). [2025-10-16T22:43:55.658952] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-16T22:43:55.660835] [INFO ] [MAIN ] Derivative Progress: 1669/1803 symbols completed. VIRT took 1.1s. Estimated remaining: 51.0s. Rate: 157.7 symbols/min [2025-10-16T22:43:55.661171] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:55.684291] [DEBUG] [MAIN ] VIST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:55.685750] [INFO ] [MAIN ] VIST: Generated 1807 derivative records from 46887 primary records. [2025-10-16T22:43:55.686008] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-16T22:43:55.704413] [DEBUG] [MAIN ] VIV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:55.706436] [INFO ] [MAIN ] VIV: Generated 1807 derivative records from 45156 primary records. [2025-10-16T22:43:55.706583] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-16T22:43:55.744168] [DEBUG] [LOCAL ] VKQ: Loaded 17804 existing records from primary storage. [2025-10-16T22:43:55.747579] [DEBUG] [LOCAL ] VIST: Derivative data saved (1807 records). [2025-10-16T22:43:55.748106] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-16T22:43:55.748409] [INFO ] [MAIN ] VKQ: Loaded 17804 primary data records. [2025-10-16T22:43:55.751058] [INFO ] [MAIN ] Derivative Progress: 1670/1803 symbols completed. VIST took 1.2s. Estimated remaining: 50.6s. Rate: 157.8 symbols/min [2025-10-16T22:43:55.763359] [DEBUG] [LOCAL ] VIV: Derivative data saved (1807 records). [2025-10-16T22:43:55.763159] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:55.796522] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-16T22:43:55.799847] [INFO ] [MAIN ] Derivative Progress: 1671/1803 symbols completed. VIV took 1.2s. Estimated remaining: 50.2s. Rate: 157.9 symbols/min [2025-10-16T22:43:55.822340] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:56.079934] [DEBUG] [LOCAL ] VLN: Loaded 31015 existing records from primary storage. [2025-10-16T22:43:56.080121] [INFO ] [MAIN ] VLN: Loaded 31015 primary data records. [2025-10-16T22:43:56.401403] [DEBUG] [LOCAL ] VLO: Loaded 53400 existing records from primary storage. [2025-10-16T22:43:56.410442] [INFO ] [MAIN ] VLO: Loaded 53400 primary data records. [2025-10-16T22:43:56.752258] [DEBUG] [MAIN ] VKQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:56.761899] [INFO ] [MAIN ] VKQ: Generated 1807 derivative records from 17804 primary records. [2025-10-16T22:43:56.762242] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-16T22:43:56.782150] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1807 records). [2025-10-16T22:43:56.783502] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-16T22:43:56.785469] [INFO ] [MAIN ] Derivative Progress: 1672/1803 symbols completed. VKQ took 1.1s. Estimated remaining: 49.8s. Rate: 157.7 symbols/min [2025-10-16T22:43:56.785667] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:56.802360] [DEBUG] [MAIN ] VLN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:56.803300] [INFO ] [MAIN ] VLN: Generated 1807 derivative records from 31015 primary records. [2025-10-16T22:43:56.803516] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-16T22:43:56.820686] [DEBUG] [LOCAL ] VLN: Derivative data saved (1807 records). [2025-10-16T22:43:56.821925] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-16T22:43:56.824352] [INFO ] [MAIN ] Derivative Progress: 1673/1803 symbols completed. VLN took 1.1s. Estimated remaining: 49.4s. Rate: 157.8 symbols/min [2025-10-16T22:43:56.835574] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:56.849881] [DEBUG] [MAIN ] VLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:56.850595] [INFO ] [MAIN ] VLO: Generated 1807 derivative records from 53400 primary records. [2025-10-16T22:43:56.851712] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-16T22:43:56.879147] [DEBUG] [LOCAL ] VLT: Loaded 4434 existing records from primary storage. [2025-10-16T22:43:56.880039] [DEBUG] [LOCAL ] VLRS: Loaded 40013 existing records from primary storage. [2025-10-16T22:43:56.880888] [INFO ] [MAIN ] VLRS: Loaded 40013 primary data records. [2025-10-16T22:43:56.881364] [INFO ] [MAIN ] VLT: Loaded 4434 primary data records. [2025-10-16T22:43:56.951558] [DEBUG] [LOCAL ] VLO: Derivative data saved (1807 records). [2025-10-16T22:43:56.965746] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-16T22:43:56.968294] [INFO ] [MAIN ] Derivative Progress: 1674/1803 symbols completed. VLO took 1.1s. Estimated remaining: 49.0s. Rate: 157.9 symbols/min [2025-10-16T22:43:56.975226] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:57.526944] [DEBUG] [LOCAL ] VLTO: Loaded 46553 existing records from primary storage. [2025-10-16T22:43:57.527757] [INFO ] [MAIN ] VLTO: Loaded 46553 primary data records. [2025-10-16T22:43:57.740227] [DEBUG] [MAIN ] VLRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:57.739528] [DEBUG] [MAIN ] VLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:57.752292] [INFO ] [MAIN ] VLRS: Generated 1807 derivative records from 40013 primary records. [2025-10-16T22:43:57.856591] [INFO ] [MAIN ] VLT: Generated 1807 derivative records from 4434 primary records. [2025-10-16T22:43:57.854558] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-16T22:43:57.856967] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-16T22:43:57.887995] [DEBUG] [LOCAL ] VLT: Derivative data saved (1807 records). [2025-10-16T22:43:57.888921] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-16T22:43:57.892075] [INFO ] [MAIN ] Derivative Progress: 1675/1803 symbols completed. VLT took 1.1s. Estimated remaining: 48.7s. Rate: 157.7 symbols/min [2025-10-16T22:43:57.893196] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:57.895788] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1807 records). [2025-10-16T22:43:57.896885] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-16T22:43:57.899050] [INFO ] [MAIN ] Derivative Progress: 1676/1803 symbols completed. VLRS took 1.1s. Estimated remaining: 48.3s. Rate: 157.8 symbols/min [2025-10-16T22:43:57.899295] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:57.930145] [DEBUG] [LOCAL ] VMI: Loaded 15183 existing records from primary storage. [2025-10-16T22:43:57.929708] [DEBUG] [MAIN ] VLTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:57.930287] [INFO ] [MAIN ] VMI: Loaded 15183 primary data records. [2025-10-16T22:43:57.931293] [INFO ] [MAIN ] VLTO: Generated 1807 derivative records from 46553 primary records. [2025-10-16T22:43:57.942590] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-16T22:43:58.093219] [DEBUG] [LOCAL ] VMC: Loaded 42844 existing records from primary storage. [2025-10-16T22:43:58.092252] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1807 records). [2025-10-16T22:43:58.098956] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-16T22:43:58.104211] [INFO ] [MAIN ] VMC: Loaded 42844 primary data records. [2025-10-16T22:43:58.109392] [INFO ] [MAIN ] Derivative Progress: 1677/1803 symbols completed. VLTO took 1.1s. Estimated remaining: 47.9s. Rate: 157.9 symbols/min [2025-10-16T22:43:58.172571] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:58.675597] [DEBUG] [LOCAL ] VMO: Loaded 20913 existing records from primary storage. [2025-10-16T22:43:58.675901] [INFO ] [MAIN ] VMO: Loaded 20913 primary data records. [2025-10-16T22:43:59.038169] [DEBUG] [MAIN ] VMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:59.039587] [INFO ] [MAIN ] VMI: Generated 1807 derivative records from 15183 primary records. [2025-10-16T22:43:59.040854] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-16T22:43:59.062840] [DEBUG] [LOCAL ] VMI: Derivative data saved (1807 records). [2025-10-16T22:43:59.063180] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-16T22:43:59.078663] [INFO ] [MAIN ] Derivative Progress: 1678/1803 symbols completed. VMI took 1.2s. Estimated remaining: 47.6s. Rate: 157.7 symbols/min [2025-10-16T22:43:59.079347] [DEBUG] [MAIN ] VMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:59.080639] [INFO ] [MAIN ] VMC: Generated 1807 derivative records from 42844 primary records. [2025-10-16T22:43:59.081037] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-16T22:43:59.098338] [DEBUG] [LOCAL ] VMC: Derivative data saved (1807 records). [2025-10-16T22:43:59.098429] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-16T22:43:59.100889] [INFO ] [MAIN ] Derivative Progress: 1679/1803 symbols completed. VMC took 1.2s. Estimated remaining: 47.1s. Rate: 157.8 symbols/min [2025-10-16T22:43:59.117304] [DEBUG] [MAIN ] VMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:43:59.117897] [INFO ] [MAIN ] VMO: Generated 1807 derivative records from 20913 primary records. [2025-10-16T22:43:59.117957] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-16T22:43:59.132854] [DEBUG] [LOCAL ] VMO: Derivative data saved (1807 records). [2025-10-16T22:43:59.132909] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-16T22:43:59.135410] [INFO ] [MAIN ] Derivative Progress: 1680/1803 symbols completed. VMO took 1.0s. Estimated remaining: 46.7s. Rate: 157.9 symbols/min [2025-10-16T22:43:59.135892] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:59.136053] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:59.135989] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:43:59.150539] [DEBUG] [LOCAL ] VNCE: Loaded 9103 existing records from primary storage. [2025-10-16T22:43:59.150728] [INFO ] [MAIN ] VNCE: Loaded 9103 primary data records. [2025-10-16T22:43:59.479961] [DEBUG] [LOCAL ] VNO: Loaded 49317 existing records from primary storage. [2025-10-16T22:43:59.492549] [INFO ] [MAIN ] VNO: Loaded 49317 primary data records. [2025-10-16T22:43:59.504786] [DEBUG] [LOCAL ] VNT: Loaded 44321 existing records from primary storage. [2025-10-16T22:43:59.530280] [INFO ] [MAIN ] VNT: Loaded 44321 primary data records. [2025-10-16T22:44:00.125220] [DEBUG] [MAIN ] VNCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:00.127120] [INFO ] [MAIN ] VNCE: Generated 1807 derivative records from 9103 primary records. [2025-10-16T22:44:00.127554] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-10-16T22:44:00.145824] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1807 records). [2025-10-16T22:44:00.146064] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-10-16T22:44:00.148505] [INFO ] [MAIN ] Derivative Progress: 1681/1803 symbols completed. VNCE took 1.0s. Estimated remaining: 46.4s. Rate: 157.7 symbols/min [2025-10-16T22:44:00.149447] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:00.187378] [DEBUG] [LOCAL ] VOC: Loaded 9054 existing records from primary storage. [2025-10-16T22:44:00.201981] [INFO ] [MAIN ] VOC: Loaded 9054 primary data records. [2025-10-16T22:44:00.196416] [DEBUG] [MAIN ] VNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:00.202321] [DEBUG] [MAIN ] VNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:00.203719] [INFO ] [MAIN ] VNT: Generated 1807 derivative records from 44321 primary records. [2025-10-16T22:44:00.209156] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-16T22:44:00.217120] [INFO ] [MAIN ] VNO: Generated 1807 derivative records from 49317 primary records. [2025-10-16T22:44:00.252482] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-16T22:44:00.350352] [DEBUG] [LOCAL ] VNT: Derivative data saved (1807 records). [2025-10-16T22:44:00.357800] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-16T22:44:00.374049] [INFO ] [MAIN ] Derivative Progress: 1682/1803 symbols completed. VNT took 1.2s. Estimated remaining: 46.0s. Rate: 157.8 symbols/min [2025-10-16T22:44:00.380446] [DEBUG] [LOCAL ] VNO: Derivative data saved (1807 records). [2025-10-16T22:44:00.380721] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:00.380571] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-16T22:44:00.432546] [INFO ] [MAIN ] Derivative Progress: 1683/1803 symbols completed. VNO took 1.3s. Estimated remaining: 45.6s. Rate: 157.9 symbols/min [2025-10-16T22:44:00.439007] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:00.600698] [DEBUG] [LOCAL ] VPG: Loaded 17336 existing records from primary storage. [2025-10-16T22:44:00.601240] [INFO ] [MAIN ] VPG: Loaded 17336 primary data records. [2025-10-16T22:44:00.809099] [DEBUG] [LOCAL ] VOYA: Loaded 42544 existing records from primary storage. [2025-10-16T22:44:00.916734] [INFO ] [MAIN ] VOYA: Loaded 42544 primary data records. [2025-10-16T22:44:01.028379] [DEBUG] [MAIN ] VOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:01.040227] [INFO ] [MAIN ] VOC: Generated 1807 derivative records from 9054 primary records. [2025-10-16T22:44:01.052083] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-16T22:44:01.151013] [DEBUG] [LOCAL ] VOC: Derivative data saved (1807 records). [2025-10-16T22:44:01.258119] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-16T22:44:01.268937] [INFO ] [MAIN ] Derivative Progress: 1684/1803 symbols completed. VOC took 1.1s. Estimated remaining: 45.3s. Rate: 157.7 symbols/min [2025-10-16T22:44:01.270019] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:01.291818] [DEBUG] [MAIN ] VPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:01.295124] [DEBUG] [LOCAL ] VPV: Loaded 5476 existing records from primary storage. [2025-10-16T22:44:01.296511] [INFO ] [MAIN ] VPG: Generated 1807 derivative records from 17336 primary records. [2025-10-16T22:44:01.296685] [INFO ] [MAIN ] VPV: Loaded 5476 primary data records. [2025-10-16T22:44:01.307944] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-16T22:44:01.438707] [DEBUG] [LOCAL ] VPG: Derivative data saved (1807 records). [2025-10-16T22:44:01.444551] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-16T22:44:01.452843] [INFO ] [MAIN ] Derivative Progress: 1685/1803 symbols completed. VPG took 1.0s. Estimated remaining: 44.9s. Rate: 157.8 symbols/min [2025-10-16T22:44:01.458118] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:01.665848] [DEBUG] [MAIN ] VOYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:01.667075] [INFO ] [MAIN ] VOYA: Generated 1807 derivative records from 42544 primary records. [2025-10-16T22:44:01.667308] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-16T22:44:01.692491] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1807 records). [2025-10-16T22:44:01.693156] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-16T22:44:01.695560] [INFO ] [MAIN ] Derivative Progress: 1686/1803 symbols completed. VOYA took 1.3s. Estimated remaining: 44.5s. Rate: 157.8 symbols/min [2025-10-16T22:44:01.695783] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:01.708438] [DEBUG] [LOCAL ] VRE: Loaded 35522 existing records from primary storage. [2025-10-16T22:44:01.709732] [INFO ] [MAIN ] VRE: Loaded 35522 primary data records. [2025-10-16T22:44:02.046041] [DEBUG] [MAIN ] VPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:02.047745] [INFO ] [MAIN ] VPV: Generated 1807 derivative records from 5476 primary records. [2025-10-16T22:44:02.062103] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-16T22:44:02.065934] [DEBUG] [LOCAL ] VRT: Loaded 54143 existing records from primary storage. [2025-10-16T22:44:02.079854] [DEBUG] [LOCAL ] VPV: Derivative data saved (1807 records). [2025-10-16T22:44:02.080029] [INFO ] [MAIN ] VRT: Loaded 54143 primary data records. [2025-10-16T22:44:02.080257] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-16T22:44:02.103069] [INFO ] [MAIN ] Derivative Progress: 1687/1803 symbols completed. VPV took 0.8s. Estimated remaining: 44.1s. Rate: 157.8 symbols/min [2025-10-16T22:44:02.125924] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:02.218087] [DEBUG] [LOCAL ] VRTS: Loaded 9431 existing records from primary storage. [2025-10-16T22:44:02.235756] [INFO ] [MAIN ] VRTS: Loaded 9431 primary data records. [2025-10-16T22:44:02.615693] [DEBUG] [MAIN ] VRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:02.655479] [INFO ] [MAIN ] VRE: Generated 1807 derivative records from 35522 primary records. [2025-10-16T22:44:02.796352] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-16T22:44:02.822916] [DEBUG] [LOCAL ] VRE: Derivative data saved (1807 records). [2025-10-16T22:44:02.824896] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-16T22:44:02.827735] [INFO ] [MAIN ] Derivative Progress: 1688/1803 symbols completed. VRE took 1.4s. Estimated remaining: 43.7s. Rate: 157.7 symbols/min [2025-10-16T22:44:02.829929] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:02.846698] [DEBUG] [MAIN ] VRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:02.848036] [INFO ] [MAIN ] VRT: Generated 1807 derivative records from 54143 primary records. [2025-10-16T22:44:02.848211] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-16T22:44:02.870466] [DEBUG] [LOCAL ] VRT: Derivative data saved (1807 records). [2025-10-16T22:44:02.871104] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-16T22:44:02.874369] [INFO ] [MAIN ] Derivative Progress: 1689/1803 symbols completed. VRT took 1.2s. Estimated remaining: 43.3s. Rate: 157.8 symbols/min [2025-10-16T22:44:02.888025] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:02.887846] [DEBUG] [MAIN ] VRTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:02.889549] [INFO ] [MAIN ] VRTS: Generated 1807 derivative records from 9431 primary records. [2025-10-16T22:44:02.889780] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-16T22:44:02.924577] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1807 records). [2025-10-16T22:44:02.924921] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-16T22:44:02.927759] [INFO ] [MAIN ] Derivative Progress: 1690/1803 symbols completed. VRTS took 0.8s. Estimated remaining: 42.9s. Rate: 157.9 symbols/min [2025-10-16T22:44:02.928142] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:02.953963] [DEBUG] [LOCAL ] VSCO: Loaded 53126 existing records from primary storage. [2025-10-16T22:44:02.954426] [INFO ] [MAIN ] VSCO: Loaded 53126 primary data records. [2025-10-16T22:44:03.141898] [DEBUG] [LOCAL ] VSH: Loaded 48605 existing records from primary storage. [2025-10-16T22:44:03.210675] [INFO ] [MAIN ] VSH: Loaded 48605 primary data records. [2025-10-16T22:44:03.372044] [DEBUG] [LOCAL ] VST: Loaded 54101 existing records from primary storage. [2025-10-16T22:44:03.413763] [INFO ] [MAIN ] VST: Loaded 54101 primary data records. [2025-10-16T22:44:04.100390] [DEBUG] [MAIN ] VSCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:04.102085] [INFO ] [MAIN ] VSCO: Generated 1807 derivative records from 53126 primary records. [2025-10-16T22:44:04.102336] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-16T22:44:04.122217] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1807 records). [2025-10-16T22:44:04.122800] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-16T22:44:04.125462] [INFO ] [MAIN ] Derivative Progress: 1691/1803 symbols completed. VSCO took 1.3s. Estimated remaining: 42.6s. Rate: 157.7 symbols/min [2025-10-16T22:44:04.125805] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:04.146605] [DEBUG] [MAIN ] VSH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:04.148517] [INFO ] [MAIN ] VSH: Generated 1807 derivative records from 48605 primary records. [2025-10-16T22:44:04.148610] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-16T22:44:04.180008] [DEBUG] [MAIN ] VST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:04.181733] [INFO ] [MAIN ] VST: Generated 1807 derivative records from 54101 primary records. [2025-10-16T22:44:04.181868] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-16T22:44:04.184080] [DEBUG] [LOCAL ] VSH: Derivative data saved (1807 records). [2025-10-16T22:44:04.184227] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-16T22:44:04.186843] [INFO ] [MAIN ] Derivative Progress: 1692/1803 symbols completed. VSH took 1.3s. Estimated remaining: 42.2s. Rate: 157.8 symbols/min [2025-10-16T22:44:04.187117] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:04.217929] [DEBUG] [LOCAL ] VST: Derivative data saved (1807 records). [2025-10-16T22:44:04.218297] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-16T22:44:04.221024] [INFO ] [MAIN ] Derivative Progress: 1693/1803 symbols completed. VST took 1.3s. Estimated remaining: 41.8s. Rate: 157.9 symbols/min [2025-10-16T22:44:04.239288] [DEBUG] [LOCAL ] VSTS: Loaded 49292 existing records from primary storage. [2025-10-16T22:44:04.239488] [INFO ] [MAIN ] VSTS: Loaded 49292 primary data records. [2025-10-16T22:44:04.469058] [DEBUG] [LOCAL ] VTEX: Loaded 43293 existing records from primary storage. [2025-10-16T22:44:04.548561] [INFO ] [MAIN ] VTEX: Loaded 43293 primary data records. [2025-10-16T22:44:05.112785] [DEBUG] [MAIN ] VSTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:05.113541] [INFO ] [MAIN ] VSTS: Generated 1807 derivative records from 49292 primary records. [2025-10-16T22:44:05.113663] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-16T22:44:05.133577] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1807 records). [2025-10-16T22:44:05.133896] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-16T22:44:05.135935] [INFO ] [MAIN ] Derivative Progress: 1694/1803 symbols completed. VSTS took 1.0s. Estimated remaining: 41.5s. Rate: 157.7 symbols/min [2025-10-16T22:44:05.157347] [DEBUG] [MAIN ] VTEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:05.158073] [INFO ] [MAIN ] VTEX: Generated 1807 derivative records from 43293 primary records. [2025-10-16T22:44:05.158166] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-16T22:44:05.173376] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1807 records). [2025-10-16T22:44:05.173514] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-16T22:44:05.176900] [INFO ] [MAIN ] Derivative Progress: 1695/1803 symbols completed. VTEX took 1.0s. Estimated remaining: 41.1s. Rate: 157.8 symbols/min [2025-10-16T22:44:05.177525] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:05.177668] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:05.177450] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:05.189441] [DEBUG] [LOCAL ] VTN: Loaded 7094 existing records from primary storage. [2025-10-16T22:44:05.189704] [INFO ] [MAIN ] VTN: Loaded 7094 primary data records. [2025-10-16T22:44:05.317638] [DEBUG] [LOCAL ] VTMX: Loaded 17721 existing records from primary storage. [2025-10-16T22:44:05.337812] [INFO ] [MAIN ] VTMX: Loaded 17721 primary data records. [2025-10-16T22:44:05.678951] [DEBUG] [LOCAL ] VTLE: Loaded 48338 existing records from primary storage. [2025-10-16T22:44:05.721258] [INFO ] [MAIN ] VTLE: Loaded 48338 primary data records. [2025-10-16T22:44:06.220127] [DEBUG] [MAIN ] VTN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:06.221722] [INFO ] [MAIN ] VTN: Generated 1807 derivative records from 7094 primary records. [2025-10-16T22:44:06.221954] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-16T22:44:06.242447] [DEBUG] [LOCAL ] VTN: Derivative data saved (1807 records). [2025-10-16T22:44:06.242779] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-16T22:44:06.257750] [INFO ] [MAIN ] Derivative Progress: 1696/1803 symbols completed. VTN took 1.1s. Estimated remaining: 40.7s. Rate: 157.6 symbols/min [2025-10-16T22:44:06.258566] [DEBUG] [MAIN ] VTMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:06.258156] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:06.259586] [INFO ] [MAIN ] VTMX: Generated 1807 derivative records from 17721 primary records. [2025-10-16T22:44:06.260176] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-16T22:44:06.280813] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1807 records). [2025-10-16T22:44:06.281039] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-16T22:44:06.295065] [INFO ] [MAIN ] Derivative Progress: 1697/1803 symbols completed. VTMX took 1.1s. Estimated remaining: 40.3s. Rate: 157.7 symbols/min [2025-10-16T22:44:06.295638] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:06.300804] [DEBUG] [MAIN ] VTLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:06.301513] [INFO ] [MAIN ] VTLE: Generated 1807 derivative records from 48338 primary records. [2025-10-16T22:44:06.301740] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-16T22:44:06.321554] [DEBUG] [LOCAL ] VTOL: Loaded 19752 existing records from primary storage. [2025-10-16T22:44:06.322163] [INFO ] [MAIN ] VTOL: Loaded 19752 primary data records. [2025-10-16T22:44:06.418332] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1807 records). [2025-10-16T22:44:06.436118] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-16T22:44:06.438841] [INFO ] [MAIN ] Derivative Progress: 1698/1803 symbols completed. VTLE took 1.3s. Estimated remaining: 39.9s. Rate: 157.8 symbols/min [2025-10-16T22:44:06.439432] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:06.682159] [DEBUG] [LOCAL ] VTR: Loaded 53155 existing records from primary storage. [2025-10-16T22:44:06.682465] [INFO ] [MAIN ] VTR: Loaded 53155 primary data records. [2025-10-16T22:44:06.819420] [DEBUG] [LOCAL ] VTS: Loaded 30212 existing records from primary storage. [2025-10-16T22:44:06.851203] [INFO ] [MAIN ] VTS: Loaded 30212 primary data records. [2025-10-16T22:44:07.248686] [DEBUG] [MAIN ] VTOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:07.355411] [INFO ] [MAIN ] VTOL: Generated 1807 derivative records from 19752 primary records. [2025-10-16T22:44:07.360666] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-16T22:44:07.389580] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1807 records). [2025-10-16T22:44:07.391839] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-16T22:44:07.394162] [INFO ] [MAIN ] Derivative Progress: 1699/1803 symbols completed. VTOL took 1.1s. Estimated remaining: 39.6s. Rate: 157.6 symbols/min [2025-10-16T22:44:07.395453] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:07.410290] [DEBUG] [MAIN ] VTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:07.411865] [INFO ] [MAIN ] VTR: Generated 1807 derivative records from 53155 primary records. [2025-10-16T22:44:07.412046] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-16T22:44:07.429343] [DEBUG] [LOCAL ] VTR: Derivative data saved (1807 records). [2025-10-16T22:44:07.429626] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-16T22:44:07.432825] [INFO ] [MAIN ] Derivative Progress: 1700/1803 symbols completed. VTR took 1.1s. Estimated remaining: 39.2s. Rate: 157.7 symbols/min [2025-10-16T22:44:07.433272] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:07.469504] [DEBUG] [MAIN ] VTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:07.471153] [DEBUG] [LOCAL ] VVR: Loaded 31476 existing records from primary storage. [2025-10-16T22:44:07.472154] [INFO ] [MAIN ] VTS: Generated 1807 derivative records from 30212 primary records. [2025-10-16T22:44:07.472479] [INFO ] [MAIN ] VVR: Loaded 31476 primary data records. [2025-10-16T22:44:07.472706] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-16T22:44:07.655044] [DEBUG] [LOCAL ] VTS: Derivative data saved (1807 records). [2025-10-16T22:44:07.798270] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-16T22:44:07.830174] [INFO ] [MAIN ] Derivative Progress: 1701/1803 symbols completed. VTS took 1.4s. Estimated remaining: 38.8s. Rate: 157.7 symbols/min [2025-10-16T22:44:07.830397] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:07.832072] [DEBUG] [LOCAL ] VVV: Loaded 50661 existing records from primary storage. [2025-10-16T22:44:07.833369] [INFO ] [MAIN ] VVV: Loaded 50661 primary data records. [2025-10-16T22:44:08.155091] [DEBUG] [LOCAL ] VVX: Loaded 23115 existing records from primary storage. [2025-10-16T22:44:08.155627] [INFO ] [MAIN ] VVX: Loaded 23115 primary data records. [2025-10-16T22:44:08.294313] [DEBUG] [MAIN ] VVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:08.311183] [INFO ] [MAIN ] VVR: Generated 1807 derivative records from 31476 primary records. [2025-10-16T22:44:08.360765] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-16T22:44:08.499698] [DEBUG] [LOCAL ] VVR: Derivative data saved (1807 records). [2025-10-16T22:44:08.500123] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-16T22:44:08.502537] [INFO ] [MAIN ] Derivative Progress: 1702/1803 symbols completed. VVR took 1.1s. Estimated remaining: 38.4s. Rate: 157.7 symbols/min [2025-10-16T22:44:08.502900] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:08.520535] [DEBUG] [MAIN ] VVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:08.521468] [INFO ] [MAIN ] VVV: Generated 1807 derivative records from 50661 primary records. [2025-10-16T22:44:08.521695] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-16T22:44:08.540454] [DEBUG] [LOCAL ] VVV: Derivative data saved (1807 records). [2025-10-16T22:44:08.542015] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-16T22:44:08.544605] [INFO ] [MAIN ] Derivative Progress: 1703/1803 symbols completed. VVV took 1.1s. Estimated remaining: 38.0s. Rate: 157.7 symbols/min [2025-10-16T22:44:08.544974] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:08.558253] [DEBUG] [MAIN ] VVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:08.559039] [INFO ] [MAIN ] VVX: Generated 1807 derivative records from 23115 primary records. [2025-10-16T22:44:08.559230] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-16T22:44:08.585586] [DEBUG] [LOCAL ] VVX: Derivative data saved (1807 records). [2025-10-16T22:44:08.585830] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-16T22:44:08.588485] [INFO ] [MAIN ] Derivative Progress: 1704/1803 symbols completed. VVX took 0.8s. Estimated remaining: 37.6s. Rate: 157.8 symbols/min [2025-10-16T22:44:08.588758] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:08.606830] [DEBUG] [LOCAL ] VYX: Loaded 48829 existing records from primary storage. [2025-10-16T22:44:08.607078] [INFO ] [MAIN ] VYX: Loaded 48829 primary data records. [2025-10-16T22:44:08.881431] [DEBUG] [LOCAL ] VZ: Loaded 54181 existing records from primary storage. [2025-10-16T22:44:08.973407] [INFO ] [MAIN ] VZ: Loaded 54181 primary data records. [2025-10-16T22:44:09.097459] [DEBUG] [LOCAL ] W: Loaded 53825 existing records from primary storage. [2025-10-16T22:44:09.098302] [INFO ] [MAIN ] W: Loaded 53825 primary data records. [2025-10-16T22:44:09.656988] [DEBUG] [MAIN ] VYX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:09.659408] [INFO ] [MAIN ] VYX: Generated 1807 derivative records from 48829 primary records. [2025-10-16T22:44:09.659592] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-16T22:44:09.679768] [DEBUG] [LOCAL ] VYX: Derivative data saved (1807 records). [2025-10-16T22:44:09.680160] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-16T22:44:09.683316] [INFO ] [MAIN ] Derivative Progress: 1705/1803 symbols completed. VYX took 1.2s. Estimated remaining: 37.3s. Rate: 157.6 symbols/min [2025-10-16T22:44:09.683777] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:09.703707] [DEBUG] [MAIN ] VZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:09.704544] [INFO ] [MAIN ] VZ: Generated 1807 derivative records from 54181 primary records. [2025-10-16T22:44:09.704698] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-16T22:44:09.741227] [DEBUG] [LOCAL ] VZ: Derivative data saved (1807 records). [2025-10-16T22:44:09.741923] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-16T22:44:09.744166] [INFO ] [MAIN ] Derivative Progress: 1706/1803 symbols completed. VZ took 1.2s. Estimated remaining: 36.9s. Rate: 157.7 symbols/min [2025-10-16T22:44:09.744397] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:09.744891] [DEBUG] [MAIN ] W: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:09.745997] [INFO ] [MAIN ] W: Generated 1807 derivative records from 53825 primary records. [2025-10-16T22:44:09.755905] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-16T22:44:09.772371] [DEBUG] [LOCAL ] W: Derivative data saved (1807 records). [2025-10-16T22:44:09.772556] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-16T22:44:09.775081] [INFO ] [MAIN ] Derivative Progress: 1707/1803 symbols completed. W took 1.2s. Estimated remaining: 36.5s. Rate: 157.8 symbols/min [2025-10-16T22:44:09.776061] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:09.792903] [DEBUG] [LOCAL ] WAB: Loaded 44289 existing records from primary storage. [2025-10-16T22:44:09.793243] [INFO ] [MAIN ] WAB: Loaded 44289 primary data records. [2025-10-16T22:44:10.029375] [DEBUG] [LOCAL ] WAL: Loaded 45902 existing records from primary storage. [2025-10-16T22:44:10.030185] [INFO ] [MAIN ] WAL: Loaded 45902 primary data records. [2025-10-16T22:44:10.029950] [DEBUG] [LOCAL ] WAT: Loaded 36136 existing records from primary storage. [2025-10-16T22:44:10.098477] [INFO ] [MAIN ] WAT: Loaded 36136 primary data records. [2025-10-16T22:44:10.783812] [DEBUG] [MAIN ] WAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:10.784967] [INFO ] [MAIN ] WAB: Generated 1807 derivative records from 44289 primary records. [2025-10-16T22:44:10.785207] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-16T22:44:10.808161] [DEBUG] [LOCAL ] WAB: Derivative data saved (1807 records). [2025-10-16T22:44:10.808842] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-16T22:44:10.811016] [INFO ] [MAIN ] Derivative Progress: 1708/1803 symbols completed. WAB took 1.1s. Estimated remaining: 36.2s. Rate: 157.6 symbols/min [2025-10-16T22:44:10.830044] [DEBUG] [MAIN ] WAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:10.830926] [INFO ] [MAIN ] WAL: Generated 1807 derivative records from 45902 primary records. [2025-10-16T22:44:10.844156] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-16T22:44:10.844406] [DEBUG] [MAIN ] WAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:10.845740] [INFO ] [MAIN ] WAT: Generated 1807 derivative records from 36136 primary records. [2025-10-16T22:44:10.846004] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-16T22:44:10.876149] [DEBUG] [LOCAL ] WAL: Derivative data saved (1807 records). [2025-10-16T22:44:10.876252] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-16T22:44:10.879066] [INFO ] [MAIN ] Derivative Progress: 1709/1803 symbols completed. WAL took 1.1s. Estimated remaining: 35.8s. Rate: 157.7 symbols/min [2025-10-16T22:44:10.881556] [DEBUG] [LOCAL ] WAT: Derivative data saved (1807 records). [2025-10-16T22:44:10.881825] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-16T22:44:10.884330] [INFO ] [MAIN ] Derivative Progress: 1710/1803 symbols completed. WAT took 1.1s. Estimated remaining: 35.4s. Rate: 157.8 symbols/min [2025-10-16T22:44:10.884793] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:10.884890] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:10.885026] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:10.898428] [DEBUG] [LOCAL ] WBX: Loaded 10474 existing records from primary storage. [2025-10-16T22:44:10.898702] [INFO ] [MAIN ] WBX: Loaded 10474 primary data records. [2025-10-16T22:44:11.264800] [DEBUG] [LOCAL ] WCC: Loaded 39326 existing records from primary storage. [2025-10-16T22:44:11.278486] [INFO ] [MAIN ] WCC: Loaded 39326 primary data records. [2025-10-16T22:44:11.279416] [DEBUG] [LOCAL ] WBS: Loaded 49129 existing records from primary storage. [2025-10-16T22:44:11.279679] [INFO ] [MAIN ] WBS: Loaded 49129 primary data records. [2025-10-16T22:44:11.965883] [DEBUG] [MAIN ] WBX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:11.967263] [INFO ] [MAIN ] WBX: Generated 1807 derivative records from 10474 primary records. [2025-10-16T22:44:11.968473] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-16T22:44:11.984869] [DEBUG] [LOCAL ] WBX: Derivative data saved (1807 records). [2025-10-16T22:44:11.986193] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-16T22:44:11.988803] [INFO ] [MAIN ] Derivative Progress: 1711/1803 symbols completed. WBX took 1.1s. Estimated remaining: 35.0s. Rate: 157.6 symbols/min [2025-10-16T22:44:11.989130] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:12.008355] [DEBUG] [MAIN ] WBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:12.009749] [INFO ] [MAIN ] WBS: Generated 1807 derivative records from 49129 primary records. [2025-10-16T22:44:12.010874] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-16T22:44:12.041926] [DEBUG] [LOCAL ] WBS: Derivative data saved (1807 records). [2025-10-16T22:44:12.042266] [DEBUG] [MAIN ] WCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:12.042522] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-16T22:44:12.045393] [INFO ] [MAIN ] Derivative Progress: 1712/1803 symbols completed. WBS took 1.2s. Estimated remaining: 34.6s. Rate: 157.7 symbols/min [2025-10-16T22:44:12.046452] [INFO ] [MAIN ] WCC: Generated 1807 derivative records from 39326 primary records. [2025-10-16T22:44:12.046619] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-16T22:44:12.047263] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:12.076206] [DEBUG] [LOCAL ] WCC: Derivative data saved (1807 records). [2025-10-16T22:44:12.081611] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-16T22:44:12.084456] [INFO ] [MAIN ] Derivative Progress: 1713/1803 symbols completed. WCC took 1.2s. Estimated remaining: 34.2s. Rate: 157.8 symbols/min [2025-10-16T22:44:12.084797] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:12.107815] [DEBUG] [LOCAL ] WCN: Loaded 48419 existing records from primary storage. [2025-10-16T22:44:12.108014] [INFO ] [MAIN ] WCN: Loaded 48419 primary data records. [2025-10-16T22:44:12.107036] [DEBUG] [LOCAL ] WD: Loaded 23265 existing records from primary storage. [2025-10-16T22:44:12.108100] [INFO ] [MAIN ] WD: Loaded 23265 primary data records. [2025-10-16T22:44:12.327583] [DEBUG] [LOCAL ] WDH: Loaded 18241 existing records from primary storage. [2025-10-16T22:44:12.333616] [INFO ] [MAIN ] WDH: Loaded 18241 primary data records. [2025-10-16T22:44:13.101983] [DEBUG] [MAIN ] WCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:13.102985] [INFO ] [MAIN ] WCN: Generated 1807 derivative records from 48419 primary records. [2025-10-16T22:44:13.103878] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-16T22:44:13.118702] [DEBUG] [MAIN ] WD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:13.127811] [INFO ] [MAIN ] WD: Generated 1807 derivative records from 23265 primary records. [2025-10-16T22:44:13.127911] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-16T22:44:13.162040] [DEBUG] [MAIN ] WDH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:13.163043] [DEBUG] [LOCAL ] WCN: Derivative data saved (1807 records). [2025-10-16T22:44:13.169113] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-16T22:44:13.171844] [INFO ] [MAIN ] Derivative Progress: 1714/1803 symbols completed. WCN took 1.2s. Estimated remaining: 33.9s. Rate: 157.6 symbols/min [2025-10-16T22:44:13.172342] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:13.173545] [DEBUG] [LOCAL ] WD: Derivative data saved (1807 records). [2025-10-16T22:44:13.169058] [INFO ] [MAIN ] WDH: Generated 1807 derivative records from 18241 primary records. [2025-10-16T22:44:13.174050] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-16T22:44:13.173997] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-16T22:44:13.176860] [INFO ] [MAIN ] Derivative Progress: 1715/1803 symbols completed. WD took 1.1s. Estimated remaining: 33.5s. Rate: 157.7 symbols/min [2025-10-16T22:44:13.178551] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:13.194179] [DEBUG] [LOCAL ] WDH: Derivative data saved (1807 records). [2025-10-16T22:44:13.194368] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-16T22:44:13.197057] [INFO ] [MAIN ] Derivative Progress: 1716/1803 symbols completed. WDH took 1.1s. Estimated remaining: 33.1s. Rate: 157.8 symbols/min [2025-10-16T22:44:13.197247] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:13.218073] [DEBUG] [LOCAL ] WDI: Loaded 21363 existing records from primary storage. [2025-10-16T22:44:13.222281] [INFO ] [MAIN ] WDI: Loaded 21363 primary data records. [2025-10-16T22:44:13.222191] [DEBUG] [LOCAL ] WEA: Loaded 7830 existing records from primary storage. [2025-10-16T22:44:13.222383] [INFO ] [MAIN ] WEA: Loaded 7830 primary data records. [2025-10-16T22:44:13.539051] [DEBUG] [LOCAL ] WDS: Loaded 43496 existing records from primary storage. [2025-10-16T22:44:13.716475] [INFO ] [MAIN ] WDS: Loaded 43496 primary data records. [2025-10-16T22:44:14.221488] [DEBUG] [MAIN ] WDI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:14.231870] [INFO ] [MAIN ] WDI: Generated 1807 derivative records from 21363 primary records. [2025-10-16T22:44:14.237372] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-16T22:44:14.237265] [DEBUG] [MAIN ] WEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:14.238922] [INFO ] [MAIN ] WEA: Generated 1807 derivative records from 7830 primary records. [2025-10-16T22:44:14.239198] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-16T22:44:14.269293] [DEBUG] [LOCAL ] WEA: Derivative data saved (1807 records). [2025-10-16T22:44:14.269453] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-16T22:44:14.272712] [INFO ] [MAIN ] Derivative Progress: 1717/1803 symbols completed. WEA took 1.1s. Estimated remaining: 32.7s. Rate: 157.6 symbols/min [2025-10-16T22:44:14.274264] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:14.274699] [DEBUG] [LOCAL ] WDI: Derivative data saved (1807 records). [2025-10-16T22:44:14.275358] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-16T22:44:14.277437] [INFO ] [MAIN ] Derivative Progress: 1718/1803 symbols completed. WDI took 1.1s. Estimated remaining: 32.3s. Rate: 157.7 symbols/min [2025-10-16T22:44:14.277565] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:14.295252] [DEBUG] [MAIN ] WDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:14.296088] [INFO ] [MAIN ] WDS: Generated 1807 derivative records from 43496 primary records. [2025-10-16T22:44:14.296231] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-16T22:44:14.322117] [DEBUG] [LOCAL ] WDS: Derivative data saved (1807 records). [2025-10-16T22:44:14.331594] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-16T22:44:14.335330] [INFO ] [MAIN ] Derivative Progress: 1719/1803 symbols completed. WDS took 1.2s. Estimated remaining: 31.9s. Rate: 157.8 symbols/min [2025-10-16T22:44:14.335707] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:14.364968] [DEBUG] [LOCAL ] WEAV: Loaded 42602 existing records from primary storage. [2025-10-16T22:44:14.365294] [INFO ] [MAIN ] WEAV: Loaded 42602 primary data records. [2025-10-16T22:44:14.482885] [DEBUG] [LOCAL ] WEC: Loaded 52558 existing records from primary storage. [2025-10-16T22:44:14.488569] [INFO ] [MAIN ] WEC: Loaded 52558 primary data records. [2025-10-16T22:44:14.871846] [DEBUG] [LOCAL ] WELL: Loaded 52706 existing records from primary storage. [2025-10-16T22:44:14.888489] [INFO ] [MAIN ] WELL: Loaded 52706 primary data records. [2025-10-16T22:44:15.376800] [DEBUG] [MAIN ] WEAV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:15.378265] [INFO ] [MAIN ] WEAV: Generated 1807 derivative records from 42602 primary records. [2025-10-16T22:44:15.378679] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-16T22:44:15.397351] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1807 records). [2025-10-16T22:44:15.399348] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-16T22:44:15.402083] [INFO ] [MAIN ] Derivative Progress: 1720/1803 symbols completed. WEAV took 1.1s. Estimated remaining: 31.6s. Rate: 157.6 symbols/min [2025-10-16T22:44:15.402266] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:15.416248] [DEBUG] [MAIN ] WEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:15.417158] [INFO ] [MAIN ] WEC: Generated 1807 derivative records from 52558 primary records. [2025-10-16T22:44:15.417438] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-16T22:44:15.449454] [DEBUG] [LOCAL ] WEC: Derivative data saved (1807 records). [2025-10-16T22:44:15.454626] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-16T22:44:15.457386] [INFO ] [MAIN ] Derivative Progress: 1721/1803 symbols completed. WEC took 1.2s. Estimated remaining: 31.2s. Rate: 157.7 symbols/min [2025-10-16T22:44:15.458019] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:15.457625] [DEBUG] [MAIN ] WELL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:15.459289] [INFO ] [MAIN ] WELL: Generated 1807 derivative records from 52706 primary records. [2025-10-16T22:44:15.459501] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-16T22:44:15.487700] [DEBUG] [LOCAL ] WELL: Derivative data saved (1807 records). [2025-10-16T22:44:15.487828] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-16T22:44:15.491426] [INFO ] [MAIN ] Derivative Progress: 1722/1803 symbols completed. WELL took 1.2s. Estimated remaining: 30.8s. Rate: 157.8 symbols/min [2025-10-16T22:44:15.505138] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:15.506466] [DEBUG] [LOCAL ] WES: Loaded 48881 existing records from primary storage. [2025-10-16T22:44:15.506798] [INFO ] [MAIN ] WES: Loaded 48881 primary data records. [2025-10-16T22:44:15.643912] [DEBUG] [LOCAL ] WEX: Loaded 33254 existing records from primary storage. [2025-10-16T22:44:15.660257] [INFO ] [MAIN ] WEX: Loaded 33254 primary data records. [2025-10-16T22:44:15.675063] [DEBUG] [LOCAL ] WF: Loaded 11033 existing records from primary storage. [2025-10-16T22:44:15.687881] [INFO ] [MAIN ] WF: Loaded 11033 primary data records. [2025-10-16T22:44:16.583319] [DEBUG] [MAIN ] WES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:16.584569] [INFO ] [MAIN ] WES: Generated 1807 derivative records from 48881 primary records. [2025-10-16T22:44:16.585473] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-16T22:44:16.605803] [DEBUG] [LOCAL ] WES: Derivative data saved (1807 records). [2025-10-16T22:44:16.606334] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-16T22:44:16.609297] [INFO ] [MAIN ] Derivative Progress: 1723/1803 symbols completed. WES took 1.2s. Estimated remaining: 30.5s. Rate: 157.6 symbols/min [2025-10-16T22:44:16.626590] [DEBUG] [MAIN ] WEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:16.628230] [INFO ] [MAIN ] WEX: Generated 1807 derivative records from 33254 primary records. [2025-10-16T22:44:16.629019] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-16T22:44:16.655860] [DEBUG] [MAIN ] WF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:16.657381] [INFO ] [MAIN ] WF: Generated 1807 derivative records from 11033 primary records. [2025-10-16T22:44:16.657691] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-16T22:44:16.658781] [DEBUG] [LOCAL ] WEX: Derivative data saved (1807 records). [2025-10-16T22:44:16.659364] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-16T22:44:16.662067] [INFO ] [MAIN ] Derivative Progress: 1724/1803 symbols completed. WEX took 1.2s. Estimated remaining: 30.1s. Rate: 157.7 symbols/min [2025-10-16T22:44:16.676247] [DEBUG] [LOCAL ] WF: Derivative data saved (1807 records). [2025-10-16T22:44:16.676311] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-16T22:44:16.678921] [INFO ] [MAIN ] Derivative Progress: 1725/1803 symbols completed. WF took 1.2s. Estimated remaining: 29.7s. Rate: 157.8 symbols/min [2025-10-16T22:44:16.679539] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:16.679733] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:16.679470] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:16.730370] [DEBUG] [LOCAL ] WGO: Loaded 38394 existing records from primary storage. [2025-10-16T22:44:16.729731] [DEBUG] [LOCAL ] WFG: Loaded 24996 existing records from primary storage. [2025-10-16T22:44:16.730862] [INFO ] [MAIN ] WGO: Loaded 38394 primary data records. [2025-10-16T22:44:16.731045] [INFO ] [MAIN ] WFG: Loaded 24996 primary data records. [2025-10-16T22:44:17.092082] [DEBUG] [LOCAL ] WFC: Loaded 54138 existing records from primary storage. [2025-10-16T22:44:17.243694] [INFO ] [MAIN ] WFC: Loaded 54138 primary data records. [2025-10-16T22:44:17.788066] [DEBUG] [MAIN ] WGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:17.789778] [INFO ] [MAIN ] WGO: Generated 1807 derivative records from 38394 primary records. [2025-10-16T22:44:17.790508] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-16T22:44:17.790839] [DEBUG] [MAIN ] WFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:17.792479] [INFO ] [MAIN ] WFG: Generated 1807 derivative records from 24996 primary records. [2025-10-16T22:44:17.792842] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-16T22:44:17.809008] [DEBUG] [LOCAL ] WGO: Derivative data saved (1807 records). [2025-10-16T22:44:17.809173] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-16T22:44:17.811382] [INFO ] [MAIN ] Derivative Progress: 1726/1803 symbols completed. WGO took 1.1s. Estimated remaining: 29.3s. Rate: 157.6 symbols/min [2025-10-16T22:44:17.824194] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:17.830247] [DEBUG] [LOCAL ] WFG: Derivative data saved (1807 records). [2025-10-16T22:44:17.830343] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-16T22:44:17.833118] [INFO ] [MAIN ] Derivative Progress: 1727/1803 symbols completed. WFG took 1.2s. Estimated remaining: 28.9s. Rate: 157.7 symbols/min [2025-10-16T22:44:17.833449] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:17.850667] [DEBUG] [MAIN ] WFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:17.851365] [INFO ] [MAIN ] WFC: Generated 1807 derivative records from 54138 primary records. [2025-10-16T22:44:17.851577] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-16T22:44:17.878228] [DEBUG] [LOCAL ] WFC: Derivative data saved (1807 records). [2025-10-16T22:44:17.878503] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-16T22:44:17.881527] [INFO ] [MAIN ] Derivative Progress: 1728/1803 symbols completed. WFC took 1.2s. Estimated remaining: 28.5s. Rate: 157.8 symbols/min [2025-10-16T22:44:17.881854] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:17.895969] [DEBUG] [LOCAL ] WHG: Loaded 3162 existing records from primary storage. [2025-10-16T22:44:17.896786] [INFO ] [MAIN ] WHG: Loaded 3162 primary data records. [2025-10-16T22:44:17.965538] [DEBUG] [LOCAL ] WH: Loaded 45585 existing records from primary storage. [2025-10-16T22:44:18.003327] [INFO ] [MAIN ] WH: Loaded 45585 primary data records. [2025-10-16T22:44:18.039375] [DEBUG] [LOCAL ] WHD: Loaded 40434 existing records from primary storage. [2025-10-16T22:44:18.059624] [INFO ] [MAIN ] WHD: Loaded 40434 primary data records. [2025-10-16T22:44:18.866911] [DEBUG] [MAIN ] WHG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:44:18.867951] [INFO ] [MAIN ] WHG: Generated 1806 derivative records from 3162 primary records. [2025-10-16T22:44:18.868327] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-16T22:44:18.890574] [DEBUG] [LOCAL ] WHG: Derivative data saved (1806 records). [2025-10-16T22:44:18.912721] [DEBUG] [MAIN ] WH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:18.918701] [INFO ] [MAIN ] WH: Generated 1807 derivative records from 45585 primary records. [2025-10-16T22:44:18.912822] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-16T22:44:18.921416] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-16T22:44:18.921310] [INFO ] [MAIN ] Derivative Progress: 1729/1803 symbols completed. WHG took 1.0s. Estimated remaining: 28.2s. Rate: 157.6 symbols/min [2025-10-16T22:44:18.922853] [DEBUG] [MAIN ] WHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:18.923015] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:18.924573] [INFO ] [MAIN ] WHD: Generated 1807 derivative records from 40434 primary records. [2025-10-16T22:44:18.932276] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-16T22:44:18.949594] [DEBUG] [LOCAL ] WH: Derivative data saved (1807 records). [2025-10-16T22:44:18.951094] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-16T22:44:18.958720] [INFO ] [MAIN ] Derivative Progress: 1730/1803 symbols completed. WH took 1.1s. Estimated remaining: 27.8s. Rate: 157.7 symbols/min [2025-10-16T22:44:18.961982] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:18.961851] [DEBUG] [LOCAL ] WHD: Derivative data saved (1807 records). [2025-10-16T22:44:18.962705] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-16T22:44:18.965457] [INFO ] [MAIN ] Derivative Progress: 1731/1803 symbols completed. WHD took 1.1s. Estimated remaining: 27.4s. Rate: 157.8 symbols/min [2025-10-16T22:44:18.966292] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:18.973765] [DEBUG] [LOCAL ] WIA: Loaded 5036 existing records from primary storage. [2025-10-16T22:44:18.974011] [INFO ] [MAIN ] WIA: Loaded 5036 primary data records. [2025-10-16T22:44:19.108076] [DEBUG] [LOCAL ] WINN: Loaded 11615 existing records from primary storage. [2025-10-16T22:44:19.114257] [INFO ] [MAIN ] WINN: Loaded 11615 primary data records. [2025-10-16T22:44:19.315905] [DEBUG] [LOCAL ] WHR: Loaded 49168 existing records from primary storage. [2025-10-16T22:44:19.457933] [INFO ] [MAIN ] WHR: Loaded 49168 primary data records. [2025-10-16T22:44:20.035419] [DEBUG] [MAIN ] WIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:20.037208] [INFO ] [MAIN ] WIA: Generated 1807 derivative records from 5036 primary records. [2025-10-16T22:44:20.037627] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-16T22:44:20.059578] [DEBUG] [MAIN ] WINN: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-16T22:44:20.067365] [INFO ] [MAIN ] WINN: Generated 1806 derivative records from 11615 primary records. [2025-10-16T22:44:20.070256] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-16T22:44:20.069914] [DEBUG] [LOCAL ] WIA: Derivative data saved (1807 records). [2025-10-16T22:44:20.071119] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-16T22:44:20.074104] [INFO ] [MAIN ] Derivative Progress: 1732/1803 symbols completed. WIA took 1.1s. Estimated remaining: 27.0s. Rate: 157.6 symbols/min [2025-10-16T22:44:20.074627] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:20.115228] [DEBUG] [MAIN ] WHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:20.116711] [INFO ] [MAIN ] WHR: Generated 1807 derivative records from 49168 primary records. [2025-10-16T22:44:20.116803] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-16T22:44:20.119173] [DEBUG] [LOCAL ] WINN: Derivative data saved (1806 records). [2025-10-16T22:44:20.134002] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-16T22:44:20.141458] [INFO ] [MAIN ] Derivative Progress: 1733/1803 symbols completed. WINN took 1.2s. Estimated remaining: 26.6s. Rate: 157.7 symbols/min [2025-10-16T22:44:20.138404] [DEBUG] [LOCAL ] WHR: Derivative data saved (1807 records). [2025-10-16T22:44:20.141978] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:20.142085] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-16T22:44:20.145100] [INFO ] [MAIN ] Derivative Progress: 1734/1803 symbols completed. WHR took 1.2s. Estimated remaining: 26.2s. Rate: 157.8 symbols/min [2025-10-16T22:44:20.145873] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:20.207831] [DEBUG] [LOCAL ] WIT: Loaded 52880 existing records from primary storage. [2025-10-16T22:44:20.208693] [INFO ] [MAIN ] WIT: Loaded 52880 primary data records. [2025-10-16T22:44:20.208420] [DEBUG] [LOCAL ] WIW: Loaded 20407 existing records from primary storage. [2025-10-16T22:44:20.221077] [INFO ] [MAIN ] WIW: Loaded 20407 primary data records. [2025-10-16T22:44:20.352935] [DEBUG] [LOCAL ] WK: Loaded 37595 existing records from primary storage. [2025-10-16T22:44:20.401545] [INFO ] [MAIN ] WK: Loaded 37595 primary data records. [2025-10-16T22:44:21.329761] [DEBUG] [MAIN ] WIW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:21.336747] [DEBUG] [MAIN ] WIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:21.336154] [INFO ] [MAIN ] WIW: Generated 1807 derivative records from 20407 primary records. [2025-10-16T22:44:21.338914] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-16T22:44:21.338785] [INFO ] [MAIN ] WIT: Generated 1807 derivative records from 52880 primary records. [2025-10-16T22:44:21.340274] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-16T22:44:21.369511] [DEBUG] [LOCAL ] WIW: Derivative data saved (1807 records). [2025-10-16T22:44:21.369912] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-16T22:44:21.378609] [INFO ] [MAIN ] Derivative Progress: 1735/1803 symbols completed. WIW took 1.2s. Estimated remaining: 25.9s. Rate: 157.6 symbols/min [2025-10-16T22:44:21.382992] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:21.384403] [DEBUG] [LOCAL ] WIT: Derivative data saved (1807 records). [2025-10-16T22:44:21.399738] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-16T22:44:21.404145] [INFO ] [MAIN ] Derivative Progress: 1736/1803 symbols completed. WIT took 1.3s. Estimated remaining: 25.5s. Rate: 157.7 symbols/min [2025-10-16T22:44:21.404305] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:21.404826] [DEBUG] [MAIN ] WK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:21.406582] [INFO ] [MAIN ] WK: Generated 1807 derivative records from 37595 primary records. [2025-10-16T22:44:21.406691] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-16T22:44:21.427985] [DEBUG] [LOCAL ] WK: Derivative data saved (1807 records). [2025-10-16T22:44:21.428218] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-16T22:44:21.431158] [INFO ] [MAIN ] Derivative Progress: 1737/1803 symbols completed. WK took 1.3s. Estimated remaining: 25.1s. Rate: 157.7 symbols/min [2025-10-16T22:44:21.431444] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:21.453797] [DEBUG] [LOCAL ] WLKP: Loaded 7090 existing records from primary storage. [2025-10-16T22:44:21.455108] [INFO ] [MAIN ] WLKP: Loaded 7090 primary data records. [2025-10-16T22:44:21.540252] [DEBUG] [LOCAL ] WKC: Loaded 34850 existing records from primary storage. [2025-10-16T22:44:21.565985] [INFO ] [MAIN ] WKC: Loaded 34850 primary data records. [2025-10-16T22:44:21.700405] [DEBUG] [LOCAL ] WLK: Loaded 46068 existing records from primary storage. [2025-10-16T22:44:21.758219] [INFO ] [MAIN ] WLK: Loaded 46068 primary data records. [2025-10-16T22:44:22.501441] [DEBUG] [MAIN ] WLKP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:22.503180] [INFO ] [MAIN ] WLKP: Generated 1807 derivative records from 7090 primary records. [2025-10-16T22:44:22.503462] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-16T22:44:22.520215] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1807 records). [2025-10-16T22:44:22.523944] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-16T22:44:22.526984] [INFO ] [MAIN ] Derivative Progress: 1738/1803 symbols completed. WLKP took 1.1s. Estimated remaining: 24.7s. Rate: 157.6 symbols/min [2025-10-16T22:44:22.540868] [DEBUG] [MAIN ] WKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:22.541837] [INFO ] [MAIN ] WKC: Generated 1807 derivative records from 34850 primary records. [2025-10-16T22:44:22.542018] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-16T22:44:22.561150] [DEBUG] [LOCAL ] WKC: Derivative data saved (1807 records). [2025-10-16T22:44:22.561311] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-16T22:44:22.565497] [INFO ] [MAIN ] Derivative Progress: 1739/1803 symbols completed. WKC took 1.2s. Estimated remaining: 24.4s. Rate: 157.7 symbols/min [2025-10-16T22:44:22.578758] [DEBUG] [MAIN ] WLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:22.579432] [INFO ] [MAIN ] WLK: Generated 1807 derivative records from 46068 primary records. [2025-10-16T22:44:22.579496] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-16T22:44:22.595624] [DEBUG] [LOCAL ] WLK: Derivative data saved (1807 records). [2025-10-16T22:44:22.595717] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-16T22:44:22.602765] [INFO ] [MAIN ] Derivative Progress: 1740/1803 symbols completed. WLK took 1.2s. Estimated remaining: 24.0s. Rate: 157.7 symbols/min [2025-10-16T22:44:22.603541] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:22.603761] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:22.604447] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:22.637616] [DEBUG] [LOCAL ] WLY: Loaded 30121 existing records from primary storage. [2025-10-16T22:44:22.637831] [INFO ] [MAIN ] WLY: Loaded 30121 primary data records. [2025-10-16T22:44:22.813917] [DEBUG] [LOCAL ] WMB: Loaded 54062 existing records from primary storage. [2025-10-16T22:44:22.866740] [INFO ] [MAIN ] WMB: Loaded 54062 primary data records. [2025-10-16T22:44:23.066569] [DEBUG] [LOCAL ] WM: Loaded 51360 existing records from primary storage. [2025-10-16T22:44:23.081469] [INFO ] [MAIN ] WM: Loaded 51360 primary data records. [2025-10-16T22:44:23.756354] [DEBUG] [MAIN ] WLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:23.758225] [INFO ] [MAIN ] WLY: Generated 1807 derivative records from 30121 primary records. [2025-10-16T22:44:23.758546] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-16T22:44:23.777755] [DEBUG] [LOCAL ] WLY: Derivative data saved (1807 records). [2025-10-16T22:44:23.777919] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-16T22:44:23.780445] [INFO ] [MAIN ] Derivative Progress: 1741/1803 symbols completed. WLY took 1.2s. Estimated remaining: 23.6s. Rate: 157.6 symbols/min [2025-10-16T22:44:23.781302] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:23.809467] [DEBUG] [MAIN ] WMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:23.817295] [INFO ] [MAIN ] WMB: Generated 1807 derivative records from 54062 primary records. [2025-10-16T22:44:23.819357] [DEBUG] [LOCAL ] WMK: Loaded 14814 existing records from primary storage. [2025-10-16T22:44:23.819484] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-16T22:44:23.819639] [INFO ] [MAIN ] WMK: Loaded 14814 primary data records. [2025-10-16T22:44:23.915324] [DEBUG] [LOCAL ] WMB: Derivative data saved (1807 records). [2025-10-16T22:44:23.927261] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-16T22:44:23.940271] [INFO ] [MAIN ] Derivative Progress: 1742/1803 symbols completed. WMB took 1.3s. Estimated remaining: 23.2s. Rate: 157.6 symbols/min [2025-10-16T22:44:23.940510] [DEBUG] [MAIN ] WM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:23.956439] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:23.957355] [INFO ] [MAIN ] WM: Generated 1807 derivative records from 51360 primary records. [2025-10-16T22:44:23.958001] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-16T22:44:24.053092] [DEBUG] [LOCAL ] WM: Derivative data saved (1807 records). [2025-10-16T22:44:24.149979] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-16T22:44:24.165916] [INFO ] [MAIN ] Derivative Progress: 1743/1803 symbols completed. WM took 1.6s. Estimated remaining: 22.8s. Rate: 157.6 symbols/min [2025-10-16T22:44:24.166919] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:24.221815] [DEBUG] [MAIN ] WMK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:24.235737] [DEBUG] [LOCAL ] WMS: Loaded 39953 existing records from primary storage. [2025-10-16T22:44:24.236910] [INFO ] [MAIN ] WMK: Generated 1807 derivative records from 14814 primary records. [2025-10-16T22:44:24.237252] [INFO ] [MAIN ] WMS: Loaded 39953 primary data records. [2025-10-16T22:44:24.237377] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-16T22:44:24.330286] [DEBUG] [LOCAL ] WMK: Derivative data saved (1807 records). [2025-10-16T22:44:24.357609] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-16T22:44:24.380320] [INFO ] [MAIN ] Derivative Progress: 1744/1803 symbols completed. WMK took 0.6s. Estimated remaining: 22.5s. Rate: 157.7 symbols/min [2025-10-16T22:44:24.396285] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:24.409383] [DEBUG] [LOCAL ] WMT: Loaded 54190 existing records from primary storage. [2025-10-16T22:44:24.419983] [INFO ] [MAIN ] WMT: Loaded 54190 primary data records. [2025-10-16T22:44:24.829025] [DEBUG] [LOCAL ] WNC: Loaded 38772 existing records from primary storage. [2025-10-16T22:44:24.945616] [INFO ] [MAIN ] WNC: Loaded 38772 primary data records. [2025-10-16T22:44:25.343905] [DEBUG] [MAIN ] WMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:25.344997] [INFO ] [MAIN ] WMS: Generated 1807 derivative records from 39953 primary records. [2025-10-16T22:44:25.346146] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-16T22:44:25.379612] [DEBUG] [LOCAL ] WMS: Derivative data saved (1807 records). [2025-10-16T22:44:25.379889] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-16T22:44:25.380444] [DEBUG] [MAIN ] WMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:25.383743] [INFO ] [MAIN ] WMT: Generated 1807 derivative records from 54190 primary records. [2025-10-16T22:44:25.382979] [INFO ] [MAIN ] Derivative Progress: 1745/1803 symbols completed. WMS took 1.4s. Estimated remaining: 22.1s. Rate: 157.5 symbols/min [2025-10-16T22:44:25.383978] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-16T22:44:25.385295] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:25.406303] [DEBUG] [LOCAL ] WMT: Derivative data saved (1807 records). [2025-10-16T22:44:25.408282] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-16T22:44:25.411312] [INFO ] [MAIN ] Derivative Progress: 1746/1803 symbols completed. WMT took 1.2s. Estimated remaining: 21.7s. Rate: 157.6 symbols/min [2025-10-16T22:44:25.411687] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:25.426386] [DEBUG] [MAIN ] WNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:25.427565] [INFO ] [MAIN ] WNC: Generated 1807 derivative records from 38772 primary records. [2025-10-16T22:44:25.437618] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-16T22:44:25.455839] [DEBUG] [LOCAL ] WNC: Derivative data saved (1807 records). [2025-10-16T22:44:25.456160] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-16T22:44:25.470092] [INFO ] [MAIN ] Derivative Progress: 1747/1803 symbols completed. WNC took 1.1s. Estimated remaining: 21.3s. Rate: 157.7 symbols/min [2025-10-16T22:44:25.471998] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:25.472981] [DEBUG] [LOCAL ] WNS: Loaded 40573 existing records from primary storage. [2025-10-16T22:44:25.473485] [INFO ] [MAIN ] WNS: Loaded 40573 primary data records. [2025-10-16T22:44:25.708744] [DEBUG] [LOCAL ] WOLF: Loaded 53549 existing records from primary storage. [2025-10-16T22:44:25.713551] [INFO ] [MAIN ] WOLF: Loaded 53549 primary data records. [2025-10-16T22:44:25.918444] [DEBUG] [LOCAL ] WOR: Loaded 24158 existing records from primary storage. [2025-10-16T22:44:25.933524] [INFO ] [MAIN ] WOR: Loaded 24158 primary data records. [2025-10-16T22:44:26.548121] [DEBUG] [MAIN ] WNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:26.549427] [INFO ] [MAIN ] WNS: Generated 1807 derivative records from 40573 primary records. [2025-10-16T22:44:26.549671] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-10-16T22:44:26.585958] [DEBUG] [MAIN ] WOLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:26.586074] [DEBUG] [LOCAL ] WNS: Derivative data saved (1807 records). [2025-10-16T22:44:26.586448] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-10-16T22:44:26.591118] [INFO ] [MAIN ] WOLF: Generated 1807 derivative records from 53549 primary records. [2025-10-16T22:44:26.591369] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-16T22:44:26.590973] [INFO ] [MAIN ] Derivative Progress: 1748/1803 symbols completed. WNS took 1.2s. Estimated remaining: 21.0s. Rate: 157.5 symbols/min [2025-10-16T22:44:26.592619] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:26.618971] [DEBUG] [MAIN ] WOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:26.622824] [INFO ] [MAIN ] WOR: Generated 1807 derivative records from 24158 primary records. [2025-10-16T22:44:26.623072] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-16T22:44:26.645928] [DEBUG] [LOCAL ] WOR: Derivative data saved (1807 records). [2025-10-16T22:44:26.646767] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-16T22:44:26.653161] [INFO ] [MAIN ] Derivative Progress: 1749/1803 symbols completed. WOR took 1.2s. Estimated remaining: 20.6s. Rate: 157.6 symbols/min [2025-10-16T22:44:26.655914] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1807 records). [2025-10-16T22:44:26.656213] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:26.656702] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-16T22:44:26.660256] [INFO ] [MAIN ] Derivative Progress: 1750/1803 symbols completed. WOLF took 1.2s. Estimated remaining: 20.2s. Rate: 157.7 symbols/min [2025-10-16T22:44:26.660524] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:26.685936] [DEBUG] [LOCAL ] WOW: Loaded 31268 existing records from primary storage. [2025-10-16T22:44:26.686193] [INFO ] [MAIN ] WOW: Loaded 31268 primary data records. [2025-10-16T22:44:27.049496] [DEBUG] [LOCAL ] WPC: Loaded 48619 existing records from primary storage. [2025-10-16T22:44:27.064757] [INFO ] [MAIN ] WPC: Loaded 48619 primary data records. [2025-10-16T22:44:27.099682] [DEBUG] [LOCAL ] WPM: Loaded 53164 existing records from primary storage. [2025-10-16T22:44:27.113626] [INFO ] [MAIN ] WPM: Loaded 53164 primary data records. [2025-10-16T22:44:27.740030] [DEBUG] [MAIN ] WOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:27.742103] [INFO ] [MAIN ] WOW: Generated 1807 derivative records from 31268 primary records. [2025-10-16T22:44:27.742403] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-16T22:44:27.764582] [DEBUG] [LOCAL ] WOW: Derivative data saved (1807 records). [2025-10-16T22:44:27.765001] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-16T22:44:27.768595] [INFO ] [MAIN ] Derivative Progress: 1751/1803 symbols completed. WOW took 1.2s. Estimated remaining: 19.8s. Rate: 157.5 symbols/min [2025-10-16T22:44:27.770163] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:27.799565] [DEBUG] [MAIN ] WPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:27.800922] [INFO ] [MAIN ] WPC: Generated 1807 derivative records from 48619 primary records. [2025-10-16T22:44:27.801050] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-16T22:44:27.800068] [DEBUG] [MAIN ] WPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:27.802236] [INFO ] [MAIN ] WPM: Generated 1807 derivative records from 53164 primary records. [2025-10-16T22:44:27.802622] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-16T22:44:27.818660] [DEBUG] [LOCAL ] WPC: Derivative data saved (1807 records). [2025-10-16T22:44:27.825918] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-16T22:44:27.832149] [INFO ] [MAIN ] Derivative Progress: 1752/1803 symbols completed. WPC took 1.2s. Estimated remaining: 19.4s. Rate: 157.6 symbols/min [2025-10-16T22:44:27.832601] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:27.838387] [DEBUG] [LOCAL ] WPM: Derivative data saved (1807 records). [2025-10-16T22:44:27.838558] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-16T22:44:27.841355] [INFO ] [MAIN ] Derivative Progress: 1753/1803 symbols completed. WPM took 1.2s. Estimated remaining: 19.0s. Rate: 157.7 symbols/min [2025-10-16T22:44:27.877509] [DEBUG] [LOCAL ] WRB: Loaded 51168 existing records from primary storage. [2025-10-16T22:44:27.877747] [INFO ] [MAIN ] WRB: Loaded 51168 primary data records. [2025-10-16T22:44:28.083052] [DEBUG] [LOCAL ] WRBY: Loaded 51103 existing records from primary storage. [2025-10-16T22:44:28.083347] [INFO ] [MAIN ] WRBY: Loaded 51103 primary data records. [2025-10-16T22:44:28.527205] [DEBUG] [MAIN ] WRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:28.529434] [INFO ] [MAIN ] WRB: Generated 1807 derivative records from 51168 primary records. [2025-10-16T22:44:28.529571] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-16T22:44:28.551127] [DEBUG] [LOCAL ] WRB: Derivative data saved (1807 records). [2025-10-16T22:44:28.551369] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-16T22:44:28.554129] [INFO ] [MAIN ] Derivative Progress: 1754/1803 symbols completed. WRB took 0.8s. Estimated remaining: 18.7s. Rate: 157.6 symbols/min [2025-10-16T22:44:28.568170] [DEBUG] [MAIN ] WRBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:28.568999] [INFO ] [MAIN ] WRBY: Generated 1807 derivative records from 51103 primary records. [2025-10-16T22:44:28.569068] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-16T22:44:28.586467] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1807 records). [2025-10-16T22:44:28.586564] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-16T22:44:28.589490] [INFO ] [MAIN ] Derivative Progress: 1755/1803 symbols completed. WRBY took 0.8s. Estimated remaining: 18.3s. Rate: 157.7 symbols/min [2025-10-16T22:44:28.589967] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:28.590625] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:28.590117] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:28.623686] [DEBUG] [LOCAL ] WS: Loaded 23549 existing records from primary storage. [2025-10-16T22:44:28.623820] [INFO ] [MAIN ] WS: Loaded 23549 primary data records. [2025-10-16T22:44:28.665314] [DEBUG] [LOCAL ] WSO: Loaded 25974 existing records from primary storage. [2025-10-16T22:44:28.740177] [INFO ] [MAIN ] WSO: Loaded 25974 primary data records. [2025-10-16T22:44:28.829998] [DEBUG] [LOCAL ] WSM: Loaded 49435 existing records from primary storage. [2025-10-16T22:44:28.862326] [INFO ] [MAIN ] WSM: Loaded 49435 primary data records. [2025-10-16T22:44:29.691409] [DEBUG] [MAIN ] WSO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:29.690977] [DEBUG] [MAIN ] WS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:29.692833] [INFO ] [MAIN ] WSO: Generated 1807 derivative records from 25974 primary records. [2025-10-16T22:44:29.694152] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-16T22:44:29.693823] [INFO ] [MAIN ] WS: Generated 1807 derivative records from 23549 primary records. [2025-10-16T22:44:29.694671] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-16T22:44:29.742222] [DEBUG] [LOCAL ] WS: Derivative data saved (1807 records). [2025-10-16T22:44:29.743568] [DEBUG] [MAIN ] WSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:29.743259] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-16T22:44:29.747611] [INFO ] [MAIN ] Derivative Progress: 1756/1803 symbols completed. WS took 1.2s. Estimated remaining: 17.9s. Rate: 157.5 symbols/min [2025-10-16T22:44:29.744806] [INFO ] [MAIN ] WSM: Generated 1807 derivative records from 49435 primary records. [2025-10-16T22:44:29.748918] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-16T22:44:29.748111] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:29.748847] [DEBUG] [LOCAL ] WSO: Derivative data saved (1807 records). [2025-10-16T22:44:29.749448] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-16T22:44:29.752591] [INFO ] [MAIN ] Derivative Progress: 1757/1803 symbols completed. WSO took 1.2s. Estimated remaining: 17.5s. Rate: 157.6 symbols/min [2025-10-16T22:44:29.752897] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:29.770246] [DEBUG] [LOCAL ] WSM: Derivative data saved (1807 records). [2025-10-16T22:44:29.770376] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-16T22:44:29.773618] [INFO ] [MAIN ] Derivative Progress: 1758/1803 symbols completed. WSM took 1.2s. Estimated remaining: 17.1s. Rate: 157.7 symbols/min [2025-10-16T22:44:29.774003] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:29.804707] [DEBUG] [LOCAL ] WSR: Loaded 23098 existing records from primary storage. [2025-10-16T22:44:29.804992] [INFO ] [MAIN ] WSR: Loaded 23098 primary data records. [2025-10-16T22:44:29.892484] [DEBUG] [LOCAL ] WST: Loaded 37051 existing records from primary storage. [2025-10-16T22:44:29.909800] [INFO ] [MAIN ] WST: Loaded 37051 primary data records. [2025-10-16T22:44:30.262438] [DEBUG] [LOCAL ] WT: Loaded 48467 existing records from primary storage. [2025-10-16T22:44:30.299131] [INFO ] [MAIN ] WT: Loaded 48467 primary data records. [2025-10-16T22:44:30.829761] [DEBUG] [MAIN ] WSR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:30.830310] [DEBUG] [MAIN ] WST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:30.832875] [INFO ] [MAIN ] WSR: Generated 1807 derivative records from 23098 primary records. [2025-10-16T22:44:30.831505] [INFO ] [MAIN ] WST: Generated 1807 derivative records from 37051 primary records. [2025-10-16T22:44:30.833075] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-16T22:44:30.833217] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-16T22:44:30.885773] [DEBUG] [LOCAL ] WST: Derivative data saved (1807 records). [2025-10-16T22:44:30.877130] [DEBUG] [LOCAL ] WSR: Derivative data saved (1807 records). [2025-10-16T22:44:30.891317] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-16T22:44:30.891121] [DEBUG] [MAIN ] WT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:30.891620] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-16T22:44:30.894293] [INFO ] [MAIN ] Derivative Progress: 1759/1803 symbols completed. WST took 1.1s. Estimated remaining: 16.8s. Rate: 157.5 symbols/min [2025-10-16T22:44:30.897816] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:30.897689] [INFO ] [MAIN ] WT: Generated 1807 derivative records from 48467 primary records. [2025-10-16T22:44:30.898691] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-16T22:44:30.897947] [INFO ] [MAIN ] Derivative Progress: 1760/1803 symbols completed. WSR took 1.1s. Estimated remaining: 16.4s. Rate: 157.6 symbols/min [2025-10-16T22:44:30.899548] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:30.916331] [DEBUG] [LOCAL ] WT: Derivative data saved (1807 records). [2025-10-16T22:44:30.916588] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-16T22:44:30.920997] [INFO ] [MAIN ] Derivative Progress: 1761/1803 symbols completed. WT took 1.1s. Estimated remaining: 16.0s. Rate: 157.7 symbols/min [2025-10-16T22:44:30.921234] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:30.951632] [DEBUG] [LOCAL ] WTS: Loaded 17528 existing records from primary storage. [2025-10-16T22:44:30.951793] [INFO ] [MAIN ] WTS: Loaded 17528 primary data records. [2025-10-16T22:44:31.070060] [DEBUG] [LOCAL ] WTI: Loaded 44979 existing records from primary storage. [2025-10-16T22:44:31.085847] [INFO ] [MAIN ] WTI: Loaded 44979 primary data records. [2025-10-16T22:44:31.449057] [DEBUG] [LOCAL ] WTRG: Loaded 51347 existing records from primary storage. [2025-10-16T22:44:31.463695] [INFO ] [MAIN ] WTRG: Loaded 51347 primary data records. [2025-10-16T22:44:32.002566] [DEBUG] [MAIN ] WTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:32.001987] [DEBUG] [MAIN ] WTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:32.005522] [INFO ] [MAIN ] WTI: Generated 1807 derivative records from 44979 primary records. [2025-10-16T22:44:32.004714] [INFO ] [MAIN ] WTS: Generated 1807 derivative records from 17528 primary records. [2025-10-16T22:44:32.005714] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-16T22:44:32.005769] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-16T22:44:32.040767] [DEBUG] [LOCAL ] WTS: Derivative data saved (1807 records). [2025-10-16T22:44:32.043610] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-16T22:44:32.046892] [INFO ] [MAIN ] Derivative Progress: 1762/1803 symbols completed. WTS took 1.1s. Estimated remaining: 15.6s. Rate: 157.5 symbols/min [2025-10-16T22:44:32.047592] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:32.052000] [DEBUG] [LOCAL ] WTI: Derivative data saved (1807 records). [2025-10-16T22:44:32.052443] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-16T22:44:32.055682] [INFO ] [MAIN ] Derivative Progress: 1763/1803 symbols completed. WTI took 1.2s. Estimated remaining: 15.2s. Rate: 157.6 symbols/min [2025-10-16T22:44:32.056089] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:32.072232] [DEBUG] [MAIN ] WTRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:32.072959] [INFO ] [MAIN ] WTRG: Generated 1807 derivative records from 51347 primary records. [2025-10-16T22:44:32.073022] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-16T22:44:32.089357] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1807 records). [2025-10-16T22:44:32.089525] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-16T22:44:32.092088] [INFO ] [MAIN ] Derivative Progress: 1764/1803 symbols completed. WTRG took 1.2s. Estimated remaining: 14.8s. Rate: 157.7 symbols/min [2025-10-16T22:44:32.092207] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:32.176416] [DEBUG] [LOCAL ] WTTR: Loaded 44977 existing records from primary storage. [2025-10-16T22:44:32.190623] [INFO ] [MAIN ] WTTR: Loaded 44977 primary data records. [2025-10-16T22:44:32.204185] [DEBUG] [LOCAL ] WU: Loaded 53869 existing records from primary storage. [2025-10-16T22:44:32.236394] [INFO ] [MAIN ] WU: Loaded 53869 primary data records. [2025-10-16T22:44:32.229311] [DEBUG] [LOCAL ] WWW: Loaded 49601 existing records from primary storage. [2025-10-16T22:44:32.270042] [INFO ] [MAIN ] WWW: Loaded 49601 primary data records. [2025-10-16T22:44:33.151907] [DEBUG] [MAIN ] WTTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:33.153315] [INFO ] [MAIN ] WTTR: Generated 1807 derivative records from 44977 primary records. [2025-10-16T22:44:33.153669] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-16T22:44:33.170506] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1807 records). [2025-10-16T22:44:33.170639] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-16T22:44:33.172502] [INFO ] [MAIN ] Derivative Progress: 1765/1803 symbols completed. WTTR took 1.1s. Estimated remaining: 14.5s. Rate: 157.5 symbols/min [2025-10-16T22:44:33.172778] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:33.191753] [DEBUG] [MAIN ] WU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:33.204665] [INFO ] [MAIN ] WU: Generated 1807 derivative records from 53869 primary records. [2025-10-16T22:44:33.204958] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-16T22:44:33.205216] [DEBUG] [MAIN ] WWW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:33.206573] [INFO ] [MAIN ] WWW: Generated 1807 derivative records from 49601 primary records. [2025-10-16T22:44:33.206702] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-16T22:44:33.238987] [DEBUG] [LOCAL ] WU: Derivative data saved (1807 records). [2025-10-16T22:44:33.241083] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-16T22:44:33.244344] [INFO ] [MAIN ] Derivative Progress: 1766/1803 symbols completed. WU took 1.2s. Estimated remaining: 14.1s. Rate: 157.6 symbols/min [2025-10-16T22:44:33.244504] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:33.246630] [DEBUG] [LOCAL ] WWW: Derivative data saved (1807 records). [2025-10-16T22:44:33.246885] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-16T22:44:33.250167] [INFO ] [MAIN ] Derivative Progress: 1767/1803 symbols completed. WWW took 1.2s. Estimated remaining: 13.7s. Rate: 157.7 symbols/min [2025-10-16T22:44:33.250664] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:33.294014] [DEBUG] [LOCAL ] WY: Loaded 53609 existing records from primary storage. [2025-10-16T22:44:33.294260] [INFO ] [MAIN ] WY: Loaded 53609 primary data records. [2025-10-16T22:44:33.420693] [DEBUG] [LOCAL ] XFLT: Loaded 30243 existing records from primary storage. [2025-10-16T22:44:33.455100] [INFO ] [MAIN ] XFLT: Loaded 30243 primary data records. [2025-10-16T22:44:33.716417] [DEBUG] [LOCAL ] XHR: Loaded 43863 existing records from primary storage. [2025-10-16T22:44:33.725353] [INFO ] [MAIN ] XHR: Loaded 43863 primary data records. [2025-10-16T22:44:34.300577] [DEBUG] [MAIN ] WY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:34.302311] [INFO ] [MAIN ] WY: Generated 1807 derivative records from 53609 primary records. [2025-10-16T22:44:34.302408] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-16T22:44:34.335589] [DEBUG] [LOCAL ] WY: Derivative data saved (1807 records). [2025-10-16T22:44:34.341035] [DEBUG] [MAIN ] XFLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:34.340716] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-16T22:44:34.342074] [INFO ] [MAIN ] XFLT: Generated 1807 derivative records from 30243 primary records. [2025-10-16T22:44:34.344903] [INFO ] [MAIN ] Derivative Progress: 1768/1803 symbols completed. WY took 1.2s. Estimated remaining: 13.3s. Rate: 157.5 symbols/min [2025-10-16T22:44:34.345047] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-16T22:44:34.365503] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1807 records). [2025-10-16T22:44:34.365770] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-16T22:44:34.368629] [INFO ] [MAIN ] Derivative Progress: 1769/1803 symbols completed. XFLT took 1.1s. Estimated remaining: 12.9s. Rate: 157.6 symbols/min [2025-10-16T22:44:34.381396] [DEBUG] [MAIN ] XHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:34.382030] [INFO ] [MAIN ] XHR: Generated 1807 derivative records from 43863 primary records. [2025-10-16T22:44:34.382092] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-16T22:44:34.397147] [DEBUG] [LOCAL ] XHR: Derivative data saved (1807 records). [2025-10-16T22:44:34.397207] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-16T22:44:34.399887] [INFO ] [MAIN ] Derivative Progress: 1770/1803 symbols completed. XHR took 1.1s. Estimated remaining: 12.6s. Rate: 157.7 symbols/min [2025-10-16T22:44:34.400376] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:34.400296] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:34.400883] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:34.451552] [DEBUG] [LOCAL ] XPER: Loaded 30698 existing records from primary storage. [2025-10-16T22:44:34.451787] [INFO ] [MAIN ] XPER: Loaded 30698 primary data records. [2025-10-16T22:44:34.651477] [DEBUG] [LOCAL ] XOM: Loaded 54183 existing records from primary storage. [2025-10-16T22:44:34.677703] [INFO ] [MAIN ] XOM: Loaded 54183 primary data records. [2025-10-16T22:44:34.791442] [DEBUG] [LOCAL ] XPEV: Loaded 54020 existing records from primary storage. [2025-10-16T22:44:34.814071] [INFO ] [MAIN ] XPEV: Loaded 54020 primary data records. [2025-10-16T22:44:35.424888] [DEBUG] [MAIN ] XPER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:35.426092] [INFO ] [MAIN ] XPER: Generated 1807 derivative records from 30698 primary records. [2025-10-16T22:44:35.426343] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-16T22:44:35.446200] [DEBUG] [LOCAL ] XPER: Derivative data saved (1807 records). [2025-10-16T22:44:35.447506] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-16T22:44:35.449775] [INFO ] [MAIN ] Derivative Progress: 1771/1803 symbols completed. XPER took 1.0s. Estimated remaining: 12.2s. Rate: 157.5 symbols/min [2025-10-16T22:44:35.450171] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:35.464793] [DEBUG] [MAIN ] XOM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:35.465823] [INFO ] [MAIN ] XOM: Generated 1807 derivative records from 54183 primary records. [2025-10-16T22:44:35.466038] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-16T22:44:35.486605] [DEBUG] [LOCAL ] XOM: Derivative data saved (1807 records). [2025-10-16T22:44:35.488082] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-16T22:44:35.492226] [INFO ] [MAIN ] Derivative Progress: 1772/1803 symbols completed. XOM took 1.1s. Estimated remaining: 11.8s. Rate: 157.6 symbols/min [2025-10-16T22:44:35.493365] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:35.508823] [DEBUG] [MAIN ] XPEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:35.509707] [INFO ] [MAIN ] XPEV: Generated 1807 derivative records from 54020 primary records. [2025-10-16T22:44:35.509943] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-16T22:44:35.539726] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1807 records). [2025-10-16T22:44:35.539982] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-16T22:44:35.542510] [INFO ] [MAIN ] Derivative Progress: 1773/1803 symbols completed. XPEV took 1.1s. Estimated remaining: 11.4s. Rate: 157.7 symbols/min [2025-10-16T22:44:35.542742] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:35.567024] [DEBUG] [LOCAL ] XPO: Loaded 48000 existing records from primary storage. [2025-10-16T22:44:35.567374] [INFO ] [MAIN ] XPO: Loaded 48000 primary data records. [2025-10-16T22:44:35.682319] [DEBUG] [LOCAL ] XPOF: Loaded 37670 existing records from primary storage. [2025-10-16T22:44:35.682637] [INFO ] [MAIN ] XPOF: Loaded 37670 primary data records. [2025-10-16T22:44:36.045197] [DEBUG] [LOCAL ] XPRO: Loaded 46247 existing records from primary storage. [2025-10-16T22:44:36.057485] [INFO ] [MAIN ] XPRO: Loaded 46247 primary data records. [2025-10-16T22:44:36.565067] [DEBUG] [MAIN ] XPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:36.566204] [INFO ] [MAIN ] XPO: Generated 1807 derivative records from 48000 primary records. [2025-10-16T22:44:36.566838] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-16T22:44:36.599953] [DEBUG] [MAIN ] XPOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:36.601869] [INFO ] [MAIN ] XPOF: Generated 1807 derivative records from 37670 primary records. [2025-10-16T22:44:36.602706] [DEBUG] [LOCAL ] XPO: Derivative data saved (1807 records). [2025-10-16T22:44:36.602862] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-16T22:44:36.605155] [INFO ] [MAIN ] Derivative Progress: 1774/1803 symbols completed. XPO took 1.2s. Estimated remaining: 11.0s. Rate: 157.5 symbols/min [2025-10-16T22:44:36.605435] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:36.602615] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-16T22:44:36.638701] [DEBUG] [MAIN ] XPRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:36.638295] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1807 records). [2025-10-16T22:44:36.638838] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-16T22:44:36.641297] [INFO ] [MAIN ] Derivative Progress: 1775/1803 symbols completed. XPOF took 1.1s. Estimated remaining: 10.7s. Rate: 157.6 symbols/min [2025-10-16T22:44:36.642297] [INFO ] [MAIN ] XPRO: Generated 1807 derivative records from 46247 primary records. [2025-10-16T22:44:36.641502] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:36.642876] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-16T22:44:36.669737] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1807 records). [2025-10-16T22:44:36.669862] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-16T22:44:36.672414] [INFO ] [MAIN ] Derivative Progress: 1776/1803 symbols completed. XPRO took 1.1s. Estimated remaining: 10.3s. Rate: 157.7 symbols/min [2025-10-16T22:44:36.672689] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:36.684949] [DEBUG] [LOCAL ] XYF: Loaded 28000 existing records from primary storage. [2025-10-16T22:44:36.685192] [INFO ] [MAIN ] XYF: Loaded 28000 primary data records. [2025-10-16T22:44:37.022860] [DEBUG] [LOCAL ] YALA: Loaded 37013 existing records from primary storage. [2025-10-16T22:44:37.037101] [INFO ] [MAIN ] YALA: Loaded 37013 primary data records. [2025-10-16T22:44:37.075535] [DEBUG] [LOCAL ] XYL: Loaded 48164 existing records from primary storage. [2025-10-16T22:44:37.104533] [INFO ] [MAIN ] XYL: Loaded 48164 primary data records. [2025-10-16T22:44:37.716242] [DEBUG] [MAIN ] XYF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:37.717162] [INFO ] [MAIN ] XYF: Generated 1807 derivative records from 28000 primary records. [2025-10-16T22:44:37.717781] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-16T22:44:37.738067] [DEBUG] [LOCAL ] XYF: Derivative data saved (1807 records). [2025-10-16T22:44:37.740102] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-16T22:44:37.743494] [INFO ] [MAIN ] Derivative Progress: 1777/1803 symbols completed. XYF took 1.1s. Estimated remaining: 9.9s. Rate: 157.5 symbols/min [2025-10-16T22:44:37.744744] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:37.758467] [DEBUG] [MAIN ] YALA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:37.759182] [INFO ] [MAIN ] YALA: Generated 1807 derivative records from 37013 primary records. [2025-10-16T22:44:37.759360] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-16T22:44:37.779207] [DEBUG] [LOCAL ] YALA: Derivative data saved (1807 records). [2025-10-16T22:44:37.779498] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-16T22:44:37.781891] [INFO ] [MAIN ] Derivative Progress: 1778/1803 symbols completed. YALA took 1.1s. Estimated remaining: 9.5s. Rate: 157.6 symbols/min [2025-10-16T22:44:37.794507] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:37.794853] [DEBUG] [MAIN ] XYL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:37.795607] [INFO ] [MAIN ] XYL: Generated 1807 derivative records from 48164 primary records. [2025-10-16T22:44:37.796026] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-16T22:44:37.822458] [DEBUG] [LOCAL ] XYL: Derivative data saved (1807 records). [2025-10-16T22:44:37.822592] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-16T22:44:37.825794] [INFO ] [MAIN ] Derivative Progress: 1779/1803 symbols completed. XYL took 1.2s. Estimated remaining: 9.1s. Rate: 157.7 symbols/min [2025-10-16T22:44:37.826068] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:37.841856] [DEBUG] [LOCAL ] YELP: Loaded 45813 existing records from primary storage. [2025-10-16T22:44:37.842080] [INFO ] [MAIN ] YELP: Loaded 45813 primary data records. [2025-10-16T22:44:38.191043] [DEBUG] [LOCAL ] YEXT: Loaded 43500 existing records from primary storage. [2025-10-16T22:44:38.190270] [DEBUG] [LOCAL ] YETI: Loaded 52880 existing records from primary storage. [2025-10-16T22:44:38.191289] [INFO ] [MAIN ] YETI: Loaded 52880 primary data records. [2025-10-16T22:44:38.191732] [INFO ] [MAIN ] YEXT: Loaded 43500 primary data records. [2025-10-16T22:44:38.841575] [DEBUG] [MAIN ] YELP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:38.843607] [INFO ] [MAIN ] YELP: Generated 1807 derivative records from 45813 primary records. [2025-10-16T22:44:38.844228] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-16T22:44:38.863370] [DEBUG] [LOCAL ] YELP: Derivative data saved (1807 records). [2025-10-16T22:44:38.864018] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-16T22:44:38.866800] [INFO ] [MAIN ] Derivative Progress: 1780/1803 symbols completed. YELP took 1.1s. Estimated remaining: 8.8s. Rate: 157.5 symbols/min [2025-10-16T22:44:38.867124] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:38.884796] [DEBUG] [MAIN ] YETI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:38.885518] [INFO ] [MAIN ] YETI: Generated 1807 derivative records from 52880 primary records. [2025-10-16T22:44:38.885598] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-16T22:44:38.916745] [DEBUG] [MAIN ] YEXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:38.918023] [INFO ] [MAIN ] YEXT: Generated 1807 derivative records from 43500 primary records. [2025-10-16T22:44:38.918691] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-16T22:44:38.920473] [DEBUG] [LOCAL ] YETI: Derivative data saved (1807 records). [2025-10-16T22:44:38.920750] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-16T22:44:38.922791] [INFO ] [MAIN ] Derivative Progress: 1781/1803 symbols completed. YETI took 1.1s. Estimated remaining: 8.4s. Rate: 157.6 symbols/min [2025-10-16T22:44:38.922940] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:38.939537] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1807 records). [2025-10-16T22:44:38.953585] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-16T22:44:38.956849] [INFO ] [MAIN ] Derivative Progress: 1782/1803 symbols completed. YEXT took 1.1s. Estimated remaining: 8.0s. Rate: 157.7 symbols/min [2025-10-16T22:44:38.957278] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:38.980354] [DEBUG] [LOCAL ] YMM: Loaded 52990 existing records from primary storage. [2025-10-16T22:44:38.980674] [INFO ] [MAIN ] YMM: Loaded 52990 primary data records. [2025-10-16T22:44:39.335581] [DEBUG] [LOCAL ] YOU: Loaded 50016 existing records from primary storage. [2025-10-16T22:44:39.336789] [INFO ] [MAIN ] YOU: Loaded 50016 primary data records. [2025-10-16T22:44:39.336682] [DEBUG] [LOCAL ] YPF: Loaded 51053 existing records from primary storage. [2025-10-16T22:44:39.358222] [INFO ] [MAIN ] YPF: Loaded 51053 primary data records. [2025-10-16T22:44:40.042888] [DEBUG] [MAIN ] YMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:40.044834] [INFO ] [MAIN ] YMM: Generated 1807 derivative records from 52990 primary records. [2025-10-16T22:44:40.046081] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-16T22:44:40.066457] [DEBUG] [LOCAL ] YMM: Derivative data saved (1807 records). [2025-10-16T22:44:40.067014] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-16T22:44:40.069798] [INFO ] [MAIN ] Derivative Progress: 1783/1803 symbols completed. YMM took 1.2s. Estimated remaining: 7.6s. Rate: 157.5 symbols/min [2025-10-16T22:44:40.087981] [DEBUG] [MAIN ] YOU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:40.088949] [INFO ] [MAIN ] YOU: Generated 1807 derivative records from 50016 primary records. [2025-10-16T22:44:40.089034] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-16T22:44:40.118903] [DEBUG] [MAIN ] YPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:40.120734] [INFO ] [MAIN ] YPF: Generated 1807 derivative records from 51053 primary records. [2025-10-16T22:44:40.121000] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-16T22:44:40.122890] [DEBUG] [LOCAL ] YOU: Derivative data saved (1807 records). [2025-10-16T22:44:40.130310] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-16T22:44:40.134044] [INFO ] [MAIN ] Derivative Progress: 1784/1803 symbols completed. YOU took 1.2s. Estimated remaining: 7.2s. Rate: 157.6 symbols/min [2025-10-16T22:44:40.141314] [DEBUG] [LOCAL ] YPF: Derivative data saved (1807 records). [2025-10-16T22:44:40.141454] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-16T22:44:40.144254] [INFO ] [MAIN ] Derivative Progress: 1785/1803 symbols completed. YPF took 1.2s. Estimated remaining: 6.9s. Rate: 157.6 symbols/min [2025-10-16T22:44:40.144880] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:40.145630] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:40.145138] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:40.160170] [DEBUG] [LOCAL ] YRD: Loaded 11610 existing records from primary storage. [2025-10-16T22:44:40.160418] [INFO ] [MAIN ] YRD: Loaded 11610 primary data records. [2025-10-16T22:44:40.281162] [DEBUG] [LOCAL ] YSG: Loaded 25729 existing records from primary storage. [2025-10-16T22:44:40.286907] [INFO ] [MAIN ] YSG: Loaded 25729 primary data records. [2025-10-16T22:44:40.640177] [DEBUG] [LOCAL ] YUM: Loaded 51556 existing records from primary storage. [2025-10-16T22:44:40.657118] [INFO ] [MAIN ] YUM: Loaded 51556 primary data records. [2025-10-16T22:44:41.174101] [DEBUG] [MAIN ] YRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:41.175071] [INFO ] [MAIN ] YRD: Generated 1807 derivative records from 11610 primary records. [2025-10-16T22:44:41.175311] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-16T22:44:41.195241] [DEBUG] [LOCAL ] YRD: Derivative data saved (1807 records). [2025-10-16T22:44:41.195527] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-16T22:44:41.197732] [INFO ] [MAIN ] Derivative Progress: 1786/1803 symbols completed. YRD took 1.1s. Estimated remaining: 6.5s. Rate: 157.5 symbols/min [2025-10-16T22:44:41.197910] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:41.211333] [DEBUG] [MAIN ] YSG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:41.212164] [INFO ] [MAIN ] YSG: Generated 1807 derivative records from 25729 primary records. [2025-10-16T22:44:41.212237] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-16T22:44:41.235940] [DEBUG] [LOCAL ] YSG: Derivative data saved (1807 records). [2025-10-16T22:44:41.236141] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-16T22:44:41.239287] [INFO ] [MAIN ] Derivative Progress: 1787/1803 symbols completed. YSG took 1.1s. Estimated remaining: 6.1s. Rate: 157.6 symbols/min [2025-10-16T22:44:41.239574] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:41.254600] [DEBUG] [MAIN ] YUM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:41.255800] [INFO ] [MAIN ] YUM: Generated 1807 derivative records from 51556 primary records. [2025-10-16T22:44:41.256156] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-16T22:44:41.275514] [DEBUG] [LOCAL ] YUM: Derivative data saved (1807 records). [2025-10-16T22:44:41.275703] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-16T22:44:41.278828] [INFO ] [MAIN ] Derivative Progress: 1788/1803 symbols completed. YUM took 1.1s. Estimated remaining: 5.7s. Rate: 157.6 symbols/min [2025-10-16T22:44:41.279029] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:41.315294] [DEBUG] [LOCAL ] ZEPP: Loaded 19177 existing records from primary storage. [2025-10-16T22:44:41.330498] [INFO ] [MAIN ] ZEPP: Loaded 19177 primary data records. [2025-10-16T22:44:41.355806] [DEBUG] [LOCAL ] YUMC: Loaded 52976 existing records from primary storage. [2025-10-16T22:44:41.386604] [INFO ] [MAIN ] YUMC: Loaded 52976 primary data records. [2025-10-16T22:44:41.562238] [DEBUG] [LOCAL ] ZBH: Loaded 51201 existing records from primary storage. [2025-10-16T22:44:41.572636] [INFO ] [MAIN ] ZBH: Loaded 51201 primary data records. [2025-10-16T22:44:42.355984] [DEBUG] [MAIN ] ZEPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:42.357225] [INFO ] [MAIN ] ZEPP: Generated 1807 derivative records from 19177 primary records. [2025-10-16T22:44:42.360381] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-16T22:44:42.386018] [DEBUG] [MAIN ] YUMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:42.392317] [INFO ] [MAIN ] YUMC: Generated 1807 derivative records from 52976 primary records. [2025-10-16T22:44:42.391341] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1807 records). [2025-10-16T22:44:42.394545] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-16T22:44:42.393632] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-16T22:44:42.396810] [INFO ] [MAIN ] Derivative Progress: 1789/1803 symbols completed. ZEPP took 1.1s. Estimated remaining: 5.3s. Rate: 157.5 symbols/min [2025-10-16T22:44:42.397789] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:42.420927] [DEBUG] [MAIN ] ZBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:42.421959] [INFO ] [MAIN ] ZBH: Generated 1807 derivative records from 51201 primary records. [2025-10-16T22:44:42.426239] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-16T22:44:42.449831] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1807 records). [2025-10-16T22:44:42.450543] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1807 records). [2025-10-16T22:44:42.450852] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-16T22:44:42.454602] [INFO ] [MAIN ] Derivative Progress: 1790/1803 symbols completed. ZBH took 1.2s. Estimated remaining: 5.0s. Rate: 157.5 symbols/min [2025-10-16T22:44:42.454883] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-16T22:44:42.455069] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:42.458151] [INFO ] [MAIN ] Derivative Progress: 1791/1803 symbols completed. YUMC took 1.3s. Estimated remaining: 4.6s. Rate: 157.6 symbols/min [2025-10-16T22:44:42.459102] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:42.507194] [DEBUG] [LOCAL ] ZETA: Loaded 54007 existing records from primary storage. [2025-10-16T22:44:42.525786] [INFO ] [MAIN ] ZETA: Loaded 54007 primary data records. [2025-10-16T22:44:42.526314] [DEBUG] [LOCAL ] ZH: Loaded 25479 existing records from primary storage. [2025-10-16T22:44:42.538093] [INFO ] [MAIN ] ZH: Loaded 25479 primary data records. [2025-10-16T22:44:42.719171] [DEBUG] [LOCAL ] ZGN: Loaded 41214 existing records from primary storage. [2025-10-16T22:44:42.761356] [INFO ] [MAIN ] ZGN: Loaded 41214 primary data records. [2025-10-16T22:44:43.484312] [DEBUG] [MAIN ] ZETA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:43.485329] [INFO ] [MAIN ] ZETA: Generated 1807 derivative records from 54007 primary records. [2025-10-16T22:44:43.485677] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-16T22:44:43.514385] [DEBUG] [MAIN ] ZH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:43.516541] [INFO ] [MAIN ] ZH: Generated 1807 derivative records from 25479 primary records. [2025-10-16T22:44:43.518299] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-16T22:44:43.518200] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1807 records). [2025-10-16T22:44:43.519780] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-16T22:44:43.522173] [INFO ] [MAIN ] Derivative Progress: 1792/1803 symbols completed. ZETA took 1.1s. Estimated remaining: 4.2s. Rate: 157.5 symbols/min [2025-10-16T22:44:43.529211] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:43.549788] [DEBUG] [MAIN ] ZGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:43.551221] [INFO ] [MAIN ] ZGN: Generated 1807 derivative records from 41214 primary records. [2025-10-16T22:44:43.551437] [DEBUG] [LOCAL ] ZH: Derivative data saved (1807 records). [2025-10-16T22:44:43.551528] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-16T22:44:43.552287] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-16T22:44:43.554843] [INFO ] [MAIN ] Derivative Progress: 1793/1803 symbols completed. ZH took 1.1s. Estimated remaining: 3.8s. Rate: 157.6 symbols/min [2025-10-16T22:44:43.555342] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:43.572294] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1807 records). [2025-10-16T22:44:43.572584] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-16T22:44:43.575184] [INFO ] [MAIN ] Derivative Progress: 1794/1803 symbols completed. ZGN took 1.1s. Estimated remaining: 3.4s. Rate: 157.6 symbols/min [2025-10-16T22:44:43.575370] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:43.629610] [DEBUG] [LOCAL ] ZIP: Loaded 43935 existing records from primary storage. [2025-10-16T22:44:43.629894] [INFO ] [MAIN ] ZIP: Loaded 43935 primary data records. [2025-10-16T22:44:43.726700] [DEBUG] [LOCAL ] ZK: Loaded 39387 existing records from primary storage. [2025-10-16T22:44:43.757837] [DEBUG] [LOCAL ] ZIM: Loaded 53881 existing records from primary storage. [2025-10-16T22:44:43.753941] [INFO ] [MAIN ] ZK: Loaded 39387 primary data records. [2025-10-16T22:44:43.758289] [INFO ] [MAIN ] ZIM: Loaded 53881 primary data records. [2025-10-16T22:44:44.629280] [DEBUG] [MAIN ] ZIP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:44.631370] [INFO ] [MAIN ] ZIP: Generated 1807 derivative records from 43935 primary records. [2025-10-16T22:44:44.632149] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-16T22:44:44.650137] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1807 records). [2025-10-16T22:44:44.651063] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-16T22:44:44.654918] [INFO ] [MAIN ] Derivative Progress: 1795/1803 symbols completed. ZIP took 1.1s. Estimated remaining: 3.0s. Rate: 157.5 symbols/min [2025-10-16T22:44:44.655867] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:44.670434] [DEBUG] [MAIN ] ZIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:44.679231] [INFO ] [MAIN ] ZIM: Generated 1807 derivative records from 53881 primary records. [2025-10-16T22:44:44.684619] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-16T22:44:44.685006] [DEBUG] [MAIN ] ZK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:44.689385] [INFO ] [MAIN ] ZK: Generated 1807 derivative records from 39387 primary records. [2025-10-16T22:44:44.700697] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-16T22:44:44.708095] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1807 records). [2025-10-16T22:44:44.709402] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-16T22:44:44.708374] [DEBUG] [LOCAL ] ZKH: Loaded 7484 existing records from primary storage. [2025-10-16T22:44:44.709909] [INFO ] [MAIN ] ZKH: Loaded 7484 primary data records. [2025-10-16T22:44:44.725717] [INFO ] [MAIN ] Derivative Progress: 1796/1803 symbols completed. ZIM took 1.2s. Estimated remaining: 2.7s. Rate: 157.6 symbols/min [2025-10-16T22:44:44.732297] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:44.834172] [DEBUG] [LOCAL ] ZK: Derivative data saved (1807 records). [2025-10-16T22:44:44.834827] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-16T22:44:44.843839] [INFO ] [MAIN ] Derivative Progress: 1797/1803 symbols completed. ZK took 1.3s. Estimated remaining: 2.3s. Rate: 157.6 symbols/min [2025-10-16T22:44:44.865519] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:45.057977] [DEBUG] [LOCAL ] ZTR: Loaded 16776 existing records from primary storage. [2025-10-16T22:44:45.058473] [INFO ] [MAIN ] ZTR: Loaded 16776 primary data records. [2025-10-16T22:44:45.129216] [DEBUG] [LOCAL ] ZTO: Loaded 49876 existing records from primary storage. [2025-10-16T22:44:45.161189] [INFO ] [MAIN ] ZTO: Loaded 49876 primary data records. [2025-10-16T22:44:45.502095] [DEBUG] [MAIN ] ZKH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:45.503851] [INFO ] [MAIN ] ZKH: Generated 1807 derivative records from 7484 primary records. [2025-10-16T22:44:45.515239] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-16T22:44:45.755009] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1807 records). [2025-10-16T22:44:45.765104] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-16T22:44:45.767319] [INFO ] [MAIN ] Derivative Progress: 1798/1803 symbols completed. ZKH took 1.1s. Estimated remaining: 1.9s. Rate: 157.5 symbols/min [2025-10-16T22:44:45.791858] [DEBUG] [MAIN ] ZTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:45.792590] [INFO ] [MAIN ] ZTR: Generated 1807 derivative records from 16776 primary records. [2025-10-16T22:44:45.792764] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-16T22:44:45.822132] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1807 records). [2025-10-16T22:44:45.822077] [DEBUG] [MAIN ] ZTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:45.822266] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-16T22:44:45.824722] [INFO ] [MAIN ] Derivative Progress: 1799/1803 symbols completed. ZTR took 1.0s. Estimated remaining: 1.5s. Rate: 157.6 symbols/min [2025-10-16T22:44:45.825403] [INFO ] [MAIN ] ZTO: Generated 1807 derivative records from 49876 primary records. [2025-10-16T22:44:45.825586] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-16T22:44:45.840500] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1807 records). [2025-10-16T22:44:45.840564] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-16T22:44:45.843660] [INFO ] [MAIN ] Derivative Progress: 1800/1803 symbols completed. ZTO took 1.1s. Estimated remaining: 1.1s. Rate: 157.6 symbols/min [2025-10-16T22:44:45.844076] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:45.844319] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:45.844450] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-16T22:44:45.882018] [DEBUG] [LOCAL ] ZVIA: Loaded 36071 existing records from primary storage. [2025-10-16T22:44:45.882260] [INFO ] [MAIN ] ZVIA: Loaded 36071 primary data records. [2025-10-16T22:44:46.237371] [DEBUG] [LOCAL ] ZWS: Loaded 42718 existing records from primary storage. [2025-10-16T22:44:46.242848] [INFO ] [MAIN ] ZWS: Loaded 42718 primary data records. [2025-10-16T22:44:46.284060] [DEBUG] [LOCAL ] ZTS: Loaded 53529 existing records from primary storage. [2025-10-16T22:44:46.297289] [INFO ] [MAIN ] ZTS: Loaded 53529 primary data records. [2025-10-16T22:44:46.934968] [DEBUG] [MAIN ] ZVIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:46.936613] [INFO ] [MAIN ] ZVIA: Generated 1807 derivative records from 36071 primary records. [2025-10-16T22:44:46.937313] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-16T22:44:46.960496] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1807 records). [2025-10-16T22:44:46.960848] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-16T22:44:46.963268] [INFO ] [MAIN ] Derivative Progress: 1801/1803 symbols completed. ZVIA took 1.1s. Estimated remaining: 0.8s. Rate: 157.5 symbols/min [2025-10-16T22:44:46.980475] [DEBUG] [MAIN ] ZWS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:46.981978] [INFO ] [MAIN ] ZWS: Generated 1807 derivative records from 42718 primary records. [2025-10-16T22:44:46.982686] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-16T22:44:47.009083] [DEBUG] [MAIN ] ZTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-16T22:44:47.010940] [INFO ] [MAIN ] ZTS: Generated 1807 derivative records from 53529 primary records. [2025-10-16T22:44:47.011241] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-16T22:44:47.022036] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1807 records). [2025-10-16T22:44:47.025915] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-16T22:44:47.029973] [INFO ] [MAIN ] Derivative Progress: 1802/1803 symbols completed. ZWS took 1.2s. Estimated remaining: 0.4s. Rate: 157.5 symbols/min [2025-10-16T22:44:47.033496] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1807 records). [2025-10-16T22:44:47.033561] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-16T22:44:47.037088] [INFO ] [MAIN ] Derivative Progress: 1803/1803 symbols completed. ZTS took 1.2s. Estimated remaining: 0.0s. Rate: 157.6 symbols/min [2025-10-16T22:44:47.037995] [INFO ] [MAIN ] Parallel derivative generation completed in 11m 26s [2025-10-16T22:44:47.038201] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (1803/1803 symbols) [2025-10-16T22:44:47.695118] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (1803/1803 @ 100.00%)' [2025-10-16T22:44:47.695707] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-16T22:44:47.696892] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-16T22:44:47.697159] [INFO ] [STATE ] Last completion updated: 2025-10-16T22:44:47.696982